2023-12-01T00:43:02.737 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-01T00:43:02.737 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150 --verbose --name yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150/orig.config.yaml 2023-12-01T00:43:02.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T00:43:02.872 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150 branch: reef-release description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} email: yweinste@redhat.com first_in_suite: false job_id: '7473150' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: reef-release ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=crc - wsync rbytes: false syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef-release sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 owner: scheduled_yuriw@teuthology priority: 55 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 8832 sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: reef-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi093.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi116.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-11-30_22:47:08 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-01T00:43:02.872 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa; will attempt to use it 2023-12-01T00:43:02.873 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks 2023-12-01T00:43:02.873 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-01T00:43:02.875 INFO:teuthology.task.internal:Checking packages... 2023-12-01T00:43:02.899 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'a6f82997ac57b70a895455dfed6256360a1e4c32' 2023-12-01T00:43:02.899 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-01T00:43:02.899 INFO:teuthology.packaging:ref: None 2023-12-01T00:43:02.899 INFO:teuthology.packaging:tag: None 2023-12-01T00:43:02.899 INFO:teuthology.packaging:branch: reef-release 2023-12-01T00:43:02.899 INFO:teuthology.packaging:sha1: a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T00:43:02.899 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=reef-release 2023-12-01T00:43:03.048 INFO:teuthology.task.internal:Found packages for ceph version 18.2.0-1249.ga6f82997 2023-12-01T00:43:03.049 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-01T00:43:03.056 INFO:teuthology.task.internal:no buildpackages task found 2023-12-01T00:43:03.056 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-01T00:43:03.065 INFO:teuthology.task.internal:Saving configuration 2023-12-01T00:43:03.085 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-01T00:43:03.091 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T00:43:03.121 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 00:37:54.899274', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-01T00:43:03.142 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 00:37:54.898345', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-01T00:43:03.165 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 00:37:54.900019', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-01T00:43:03.165 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-01T00:43:03.172 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-12-01T00:43:03.172 INFO:teuthology.task.internal:roles: ubuntu@smithi093.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-12-01T00:43:03.172 INFO:teuthology.task.internal:roles: ubuntu@smithi116.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-12-01T00:43:03.172 INFO:teuthology.run_tasks:Running task console_log... 2023-12-01T00:43:03.271 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe22dbc2dc0>, signals=[15]) 2023-12-01T00:43:03.271 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-01T00:43:03.278 INFO:teuthology.task.internal:Opening connections... 2023-12-01T00:43:03.278 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2023-12-01T00:43:03.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T00:43:03.349 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi093.front.sepia.ceph.com 2023-12-01T00:43:03.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T00:43:03.417 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi116.front.sepia.ceph.com 2023-12-01T00:43:03.418 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T00:43:03.484 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-01T00:43:03.489 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2023-12-01T00:43:03.511 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2023-12-01T00:43:03.511 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2023-12-01T00:43:03.571 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T00:43:03.571 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T00:43:03.571 INFO:teuthology.orchestra.run.smithi026.stdout:ID="rhel" 2023-12-01T00:43:03.571 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE="fedora" 2023-12-01T00:43:03.571 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="8.6" 2023-12-01T00:43:03.571 INFO:teuthology.orchestra.run.smithi026.stdout:PLATFORM_ID="platform:el8" 2023-12-01T00:43:03.571 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T00:43:03.572 INFO:teuthology.orchestra.run.smithi026.stdout:ANSI_COLOR="0;31" 2023-12-01T00:43:03.572 INFO:teuthology.orchestra.run.smithi026.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T00:43:03.572 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T00:43:03.572 INFO:teuthology.orchestra.run.smithi026.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T00:43:03.572 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T00:43:03.572 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:43:03.572 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T00:43:03.572 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T00:43:03.572 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T00:43:03.572 INFO:teuthology.orchestra.run.smithi026.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T00:43:03.573 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2023-12-01T00:43:03.594 DEBUG:teuthology.orchestra.run.smithi093:> uname -m 2023-12-01T00:43:03.614 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2023-12-01T00:43:03.614 DEBUG:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2023-12-01T00:43:03.674 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T00:43:03.674 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T00:43:03.674 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2023-12-01T00:43:03.674 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2023-12-01T00:43:03.674 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.6" 2023-12-01T00:43:03.674 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2023-12-01T00:43:03.675 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T00:43:03.675 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2023-12-01T00:43:03.675 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T00:43:03.675 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T00:43:03.675 INFO:teuthology.orchestra.run.smithi093.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T00:43:03.675 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T00:43:03.675 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-01T00:43:03.675 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T00:43:03.675 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T00:43:03.675 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T00:43:03.675 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T00:43:03.675 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2023-12-01T00:43:03.693 DEBUG:teuthology.orchestra.run.smithi116:> uname -m 2023-12-01T00:43:03.713 INFO:teuthology.orchestra.run.smithi116.stdout:x86_64 2023-12-01T00:43:03.714 DEBUG:teuthology.orchestra.run.smithi116:> cat /etc/os-release 2023-12-01T00:43:03.773 INFO:teuthology.orchestra.run.smithi116.stdout:NAME="Red Hat Enterprise Linux" 2023-12-01T00:43:03.773 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION="8.6 (Ootpa)" 2023-12-01T00:43:03.773 INFO:teuthology.orchestra.run.smithi116.stdout:ID="rhel" 2023-12-01T00:43:03.773 INFO:teuthology.orchestra.run.smithi116.stdout:ID_LIKE="fedora" 2023-12-01T00:43:03.773 INFO:teuthology.orchestra.run.smithi116.stdout:VERSION_ID="8.6" 2023-12-01T00:43:03.773 INFO:teuthology.orchestra.run.smithi116.stdout:PLATFORM_ID="platform:el8" 2023-12-01T00:43:03.773 INFO:teuthology.orchestra.run.smithi116.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-01T00:43:03.773 INFO:teuthology.orchestra.run.smithi116.stdout:ANSI_COLOR="0;31" 2023-12-01T00:43:03.773 INFO:teuthology.orchestra.run.smithi116.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-01T00:43:03.774 INFO:teuthology.orchestra.run.smithi116.stdout:HOME_URL="https://www.redhat.com/" 2023-12-01T00:43:03.774 INFO:teuthology.orchestra.run.smithi116.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-01T00:43:03.774 INFO:teuthology.orchestra.run.smithi116.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-01T00:43:03.774 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-01T00:43:03.774 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-01T00:43:03.774 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-01T00:43:03.774 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-01T00:43:03.774 INFO:teuthology.orchestra.run.smithi116.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-01T00:43:03.774 INFO:teuthology.lock.ops:Updating smithi116.front.sepia.ceph.com on lock server 2023-12-01T00:43:03.793 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-01T00:43:03.804 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-01T00:43:03.808 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-01T00:43:03.809 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2023-12-01T00:43:03.811 DEBUG:teuthology.orchestra.run.smithi093:> test '!' -e /home/ubuntu/cephtest 2023-12-01T00:43:03.813 DEBUG:teuthology.orchestra.run.smithi116:> test '!' -e /home/ubuntu/cephtest 2023-12-01T00:43:03.834 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-01T00:43:03.841 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-01T00:43:03.841 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2023-12-01T00:43:03.871 DEBUG:teuthology.orchestra.run.smithi093:> test -z $(ls -A /var/lib/ceph) 2023-12-01T00:43:03.873 DEBUG:teuthology.orchestra.run.smithi116:> test -z $(ls -A /var/lib/ceph) 2023-12-01T00:43:03.908 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-01T00:43:04.002 INFO:teuthology.run_tasks:Running task kernel... 2023-12-01T00:43:04.017 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-12-01T00:43:04.018 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-12-01T00:43:04.018 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-12-01T00:43:04.018 DEBUG:teuthology.orchestra.run.smithi026:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-01T00:43:04.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T00:43:04.041 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2023-12-01T00:43:04.101 INFO:teuthology.orchestra.run.smithi026.stdout:4.18.0-372.9.1.el8.x86_64 2023-12-01T00:43:04.102 INFO:teuthology.task.kernel:Running kernel on smithi026: 4.18.0-372.9.1.el8.x86_64 2023-12-01T00:43:04.102 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum install -y kernel 2023-12-01T00:43:05.395 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-12-01T00:43:05.395 INFO:teuthology.orchestra.run.smithi026.stdout:Unable to read consumer identity 2023-12-01T00:43:06.830 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-12-01T00:43:07.564 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-12-01T00:43:11.397 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 412 kB/s | 24 kB 00:00 2023-12-01T00:43:12.150 INFO:teuthology.orchestra.run.smithi026.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-12-01T00:43:12.208 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2023-12-01T00:43:12.209 INFO:teuthology.orchestra.run.smithi026.stdout:Nothing to do. 2023-12-01T00:43:12.209 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2023-12-01T00:43:12.336 DEBUG:teuthology.orchestra.run.smithi026:> echo no | sudo yum reinstall kernel || true 2023-12-01T00:43:12.728 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-12-01T00:43:12.728 INFO:teuthology.orchestra.run.smithi026.stdout:Unable to read consumer identity 2023-12-01T00:43:13.007 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:02 ago on Fri 01 Dec 2023 12:43:11 AM UTC. 2023-12-01T00:43:13.052 INFO:teuthology.orchestra.run.smithi026.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-01T00:43:13.080 INFO:teuthology.orchestra.run.smithi026.stderr:Error: No packages marked for reinstall. 2023-12-01T00:43:13.127 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum reinstall -y kernel || true 2023-12-01T00:43:13.476 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-12-01T00:43:13.476 INFO:teuthology.orchestra.run.smithi026.stdout:Unable to read consumer identity 2023-12-01T00:43:13.755 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:00:02 ago on Fri 01 Dec 2023 12:43:11 AM UTC. 2023-12-01T00:43:13.799 INFO:teuthology.orchestra.run.smithi026.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-12-01T00:43:13.824 INFO:teuthology.orchestra.run.smithi026.stderr:Error: No packages marked for reinstall. 2023-12-01T00:43:13.871 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q kernel | sort -rV | head -n 1 2023-12-01T00:43:13.953 INFO:teuthology.orchestra.run.smithi026.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-12-01T00:43:13.954 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-12-01T00:43:13.954 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-12-01T00:43:13.954 DEBUG:teuthology.parallel:result is None 2023-12-01T00:43:13.954 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-01T00:43:13.961 INFO:teuthology.task.internal:Creating test directory... 2023-12-01T00:43:13.961 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-01T00:43:13.964 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-01T00:43:13.966 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-01T00:43:13.987 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-01T00:43:13.994 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-01T00:43:14.002 INFO:teuthology.task.internal:Creating archive directory... 2023-12-01T00:43:14.002 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-01T00:43:14.021 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-01T00:43:14.026 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-01T00:43:14.060 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-01T00:43:14.069 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-01T00:43:14.069 DEBUG:teuthology.orchestra.run.smithi093:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-01T00:43:14.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T00:43:14.107 DEBUG:teuthology.orchestra.run.smithi116:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-01T00:43:14.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T00:43:14.125 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-01T00:43:14.127 DEBUG:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-01T00:43:14.149 DEBUG:teuthology.orchestra.run.smithi116:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-01T00:43:14.163 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-01T00:43:14.181 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-01T00:43:14.182 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-01T00:43:14.200 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-01T00:43:14.204 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-01T00:43:14.218 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-01T00:43:14.220 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-01T00:43:14.227 INFO:teuthology.task.internal:Configuring sudo... 2023-12-01T00:43:14.227 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-01T00:43:14.229 DEBUG:teuthology.orchestra.run.smithi093:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-01T00:43:14.247 DEBUG:teuthology.orchestra.run.smithi116:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-01T00:43:14.289 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-01T00:43:14.299 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-01T00:43:14.299 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-01T00:43:14.301 DEBUG:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-01T00:43:14.317 DEBUG:teuthology.orchestra.run.smithi116:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-01T00:43:14.347 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-01T00:43:14.401 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-01T00:43:14.458 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-01T00:43:14.543 DEBUG:teuthology.orchestra.run.smithi026:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-01T00:43:14.584 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T00:43:14.584 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-01T00:43:14.653 DEBUG:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-01T00:43:14.698 DEBUG:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-01T00:43:14.755 DEBUG:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-01T00:43:14.841 DEBUG:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-01T00:43:14.882 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-01T00:43:14.882 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-01T00:43:14.950 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-01T00:43:14.995 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-01T00:43:15.053 DEBUG:teuthology.orchestra.run.smithi116:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-01T00:43:15.139 DEBUG:teuthology.orchestra.run.smithi116:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-01T00:43:15.182 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-12-01T00:43:15.183 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-01T00:43:15.253 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2023-12-01T00:43:15.256 DEBUG:teuthology.orchestra.run.smithi093:> sudo service rsyslog restart 2023-12-01T00:43:15.258 DEBUG:teuthology.orchestra.run.smithi116:> sudo service rsyslog restart 2023-12-01T00:43:15.317 INFO:teuthology.orchestra.run.smithi093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-01T00:43:15.334 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-01T00:43:15.363 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-01T00:43:15.729 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-01T00:43:15.737 INFO:teuthology.task.internal:Starting timer... 2023-12-01T00:43:15.737 INFO:teuthology.run_tasks:Running task pcp... 2023-12-01T00:43:15.791 INFO:teuthology.run_tasks:Running task selinux... 2023-12-01T00:43:15.800 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-12-01T00:43:15.801 DEBUG:teuthology.orchestra.run.smithi026:> sudo service auditd rotate 2023-12-01T00:43:15.857 INFO:teuthology.orchestra.run.smithi026.stdout:Rotating logs: 2023-12-01T00:43:15.859 DEBUG:teuthology.orchestra.run.smithi093:> sudo service auditd rotate 2023-12-01T00:43:15.933 INFO:teuthology.orchestra.run.smithi093.stdout:Rotating logs: 2023-12-01T00:43:15.935 DEBUG:teuthology.orchestra.run.smithi116:> sudo service auditd rotate 2023-12-01T00:43:16.002 INFO:teuthology.orchestra.run.smithi116.stdout:Rotating logs: 2023-12-01T00:43:16.004 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-01T00:43:16.004 DEBUG:teuthology.orchestra.run.smithi026:> /usr/sbin/getenforce 2023-12-01T00:43:16.027 INFO:teuthology.orchestra.run.smithi026.stdout:Permissive 2023-12-01T00:43:16.028 DEBUG:teuthology.orchestra.run.smithi093:> /usr/sbin/getenforce 2023-12-01T00:43:16.053 INFO:teuthology.orchestra.run.smithi093.stdout:Permissive 2023-12-01T00:43:16.054 DEBUG:teuthology.orchestra.run.smithi116:> /usr/sbin/getenforce 2023-12-01T00:43:16.078 INFO:teuthology.orchestra.run.smithi116.stdout:Permissive 2023-12-01T00:43:16.079 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi026.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi093.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi116.front.sepia.ceph.com': 'permissive'} 2023-12-01T00:43:16.079 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-01T00:43:16.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T00:43:16.110 DEBUG:teuthology.orchestra.run.smithi093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-01T00:43:16.139 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T00:43:16.139 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-01T00:43:16.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T00:43:16.166 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-01T00:43:16.166 DEBUG:teuthology.orchestra.run.smithi026:> sudo /usr/sbin/setenforce permissive 2023-12-01T00:43:16.195 DEBUG:teuthology.orchestra.run.smithi093:> sudo /usr/sbin/setenforce permissive 2023-12-01T00:43:16.222 DEBUG:teuthology.orchestra.run.smithi116:> sudo /usr/sbin/setenforce permissive 2023-12-01T00:43:16.249 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-01T00:43:16.259 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-01T00:43:16.265 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-01T00:43:16.393 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-01T00:43:16.410 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-01T00:43:16.411 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi026.front.sepia.ceph.com,smithi093.front.sepia.ceph.com,smithi116.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-01T00:52:28.913 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi026.front.sepia.ceph.com'), Remote(name='ubuntu@smithi093.front.sepia.ceph.com'), Remote(name='ubuntu@smithi116.front.sepia.ceph.com')] 2023-12-01T00:52:28.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-12-01T00:52:28.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T00:52:29.009 DEBUG:teuthology.orchestra.run.smithi026:> true 2023-12-01T00:52:29.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2023-12-01T00:52:29.085 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-01T00:52:29.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T00:52:29.154 DEBUG:teuthology.orchestra.run.smithi093:> true 2023-12-01T00:52:29.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi093.front.sepia.ceph.com' 2023-12-01T00:52:29.228 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-12-01T00:52:29.229 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi116.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-01T00:52:29.296 DEBUG:teuthology.orchestra.run.smithi116:> true 2023-12-01T00:52:29.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi116.front.sepia.ceph.com' 2023-12-01T00:52:29.364 INFO:teuthology.run_tasks:Running task clock... 2023-12-01T00:52:29.376 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-01T00:52:29.376 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-01T00:52:29.376 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-01T00:52:29.378 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-01T00:52:29.379 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-01T00:52:29.381 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-01T00:52:29.381 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-01T00:52:29.413 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-01T00:52:29.414 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-01T00:52:29.428 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-01T00:52:29.430 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-01T00:52:29.436 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-01T00:52:29.451 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-01T00:52:29.504 INFO:teuthology.orchestra.run.smithi093.stderr:sudo: ntpd: command not found 2023-12-01T00:52:29.505 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: ntpd: command not found 2023-12-01T00:52:29.516 INFO:teuthology.orchestra.run.smithi093.stdout:506 Cannot talk to daemon 2023-12-01T00:52:29.517 INFO:teuthology.orchestra.run.smithi026.stdout:506 Cannot talk to daemon 2023-12-01T00:52:29.528 INFO:teuthology.orchestra.run.smithi116.stderr:sudo: ntpd: command not found 2023-12-01T00:52:29.530 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-01T00:52:29.532 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-01T00:52:29.540 INFO:teuthology.orchestra.run.smithi116.stdout:506 Cannot talk to daemon 2023-12-01T00:52:29.545 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-01T00:52:29.547 INFO:teuthology.orchestra.run.smithi026.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-01T00:52:29.554 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-01T00:52:29.568 INFO:teuthology.orchestra.run.smithi116.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-01T00:52:29.622 INFO:teuthology.orchestra.run.smithi093.stderr:bash: ntpq: command not found 2023-12-01T00:52:29.623 INFO:teuthology.orchestra.run.smithi026.stderr:bash: ntpq: command not found 2023-12-01T00:52:29.625 INFO:teuthology.orchestra.run.smithi093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-01T00:52:29.625 INFO:teuthology.orchestra.run.smithi093.stdout:=============================================================================== 2023-12-01T00:52:29.626 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T00:52:29.626 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T00:52:29.626 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T00:52:29.626 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T00:52:29.627 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-01T00:52:29.627 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2023-12-01T00:52:29.627 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T00:52:29.627 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T00:52:29.628 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T00:52:29.628 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T00:52:29.661 INFO:teuthology.orchestra.run.smithi116.stderr:bash: ntpq: command not found 2023-12-01T00:52:29.665 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-01T00:52:29.665 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2023-12-01T00:52:29.665 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T00:52:29.665 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T00:52:29.665 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T00:52:29.665 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T00:52:29.666 INFO:teuthology.run_tasks:Running task pexec... 2023-12-01T00:52:29.676 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-01T00:52:29.676 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi026.front.sepia.ceph.com 2023-12-01T00:52:29.676 DEBUG:teuthology.orchestra.run.smithi026:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-01T00:52:29.677 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi093.front.sepia.ceph.com 2023-12-01T00:52:29.677 DEBUG:teuthology.orchestra.run.smithi093:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-01T00:52:29.677 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi116.front.sepia.ceph.com 2023-12-01T00:52:29.677 DEBUG:teuthology.orchestra.run.smithi116:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-01T00:52:30.049 INFO:teuthology.orchestra.run.smithi093.stdout:Updating Subscription Management repositories. 2023-12-01T00:52:30.069 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-12-01T00:52:30.078 INFO:teuthology.orchestra.run.smithi116.stdout:Updating Subscription Management repositories. 2023-12-01T00:52:30.870 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:38 ago on Fri 01 Dec 2023 12:50:52 AM UTC. 2023-12-01T00:52:30.897 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:38 ago on Fri 01 Dec 2023 12:50:52 AM UTC. 2023-12-01T00:52:30.909 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:30 ago on Fri 01 Dec 2023 12:51:00 AM UTC. 2023-12-01T00:52:32.586 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-01T00:52:32.587 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-01T00:52:32.587 INFO:teuthology.orchestra.run.smithi093.stdout: Package Architecture Version Repository Size 2023-12-01T00:52:32.587 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-01T00:52:32.587 INFO:teuthology.orchestra.run.smithi093.stdout:Resetting modules: 2023-12-01T00:52:32.587 INFO:teuthology.orchestra.run.smithi093.stdout: container-tools 2023-12-01T00:52:32.587 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-01T00:52:32.588 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-01T00:52:32.588 INFO:teuthology.orchestra.run.smithi093.stdout:================================================================================ 2023-12-01T00:52:32.588 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-01T00:52:32.625 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-12-01T00:52:32.626 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-12-01T00:52:32.626 INFO:teuthology.orchestra.run.smithi116.stdout: Package Architecture Version Repository Size 2023-12-01T00:52:32.626 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-12-01T00:52:32.626 INFO:teuthology.orchestra.run.smithi116.stdout:Resetting modules: 2023-12-01T00:52:32.626 INFO:teuthology.orchestra.run.smithi116.stdout: container-tools 2023-12-01T00:52:32.627 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-01T00:52:32.627 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-12-01T00:52:32.627 INFO:teuthology.orchestra.run.smithi116.stdout:================================================================================ 2023-12-01T00:52:32.627 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-01T00:52:32.882 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2023-12-01T00:52:32.883 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2023-12-01T00:52:32.883 INFO:teuthology.orchestra.run.smithi026.stdout: Package Architecture Version Repository Size 2023-12-01T00:52:32.883 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2023-12-01T00:52:32.883 INFO:teuthology.orchestra.run.smithi026.stdout:Resetting modules: 2023-12-01T00:52:32.883 INFO:teuthology.orchestra.run.smithi026.stdout: container-tools 2023-12-01T00:52:32.883 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:52:32.884 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2023-12-01T00:52:32.884 INFO:teuthology.orchestra.run.smithi026.stdout:================================================================================ 2023-12-01T00:52:32.884 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:52:33.556 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:41 ago on Fri 01 Dec 2023 12:50:52 AM UTC. 2023-12-01T00:52:33.594 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:41 ago on Fri 01 Dec 2023 12:50:52 AM UTC. 2023-12-01T00:52:33.888 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:33 ago on Fri 01 Dec 2023 12:51:00 AM UTC. 2023-12-01T00:52:36.624 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-01T00:52:36.658 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-12-01T00:52:36.793 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2023-12-01T00:52:37.097 INFO:teuthology.orchestra.run.smithi093.stdout:Updating Subscription Management repositories. 2023-12-01T00:52:37.131 INFO:teuthology.orchestra.run.smithi116.stdout:Updating Subscription Management repositories. 2023-12-01T00:52:37.267 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-12-01T00:52:37.880 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:45 ago on Fri 01 Dec 2023 12:50:52 AM UTC. 2023-12-01T00:52:37.935 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:45 ago on Fri 01 Dec 2023 12:50:52 AM UTC. 2023-12-01T00:52:38.078 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:37 ago on Fri 01 Dec 2023 12:51:00 AM UTC. 2023-12-01T00:52:39.751 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-01T00:52:39.789 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-12-01T00:52:39.844 INFO:teuthology.orchestra.run.smithi093.stdout:============================================================================================================ 2023-12-01T00:52:39.845 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-01T00:52:39.845 INFO:teuthology.orchestra.run.smithi093.stdout:============================================================================================================ 2023-12-01T00:52:39.845 INFO:teuthology.orchestra.run.smithi093.stdout:Installing group/module packages: 2023-12-01T00:52:39.845 INFO:teuthology.orchestra.run.smithi093.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-12-01T00:52:39.845 INFO:teuthology.orchestra.run.smithi093.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-12-01T00:52:39.845 INFO:teuthology.orchestra.run.smithi093.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-12-01T00:52:39.845 INFO:teuthology.orchestra.run.smithi093.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-12-01T00:52:39.845 INFO:teuthology.orchestra.run.smithi093.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-12-01T00:52:39.845 INFO:teuthology.orchestra.run.smithi093.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-12-01T00:52:39.845 INFO:teuthology.orchestra.run.smithi093.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-12-01T00:52:39.845 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-01T00:52:39.845 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-12-01T00:52:39.845 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-12-01T00:52:39.846 INFO:teuthology.orchestra.run.smithi093.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-12-01T00:52:39.846 INFO:teuthology.orchestra.run.smithi093.stdout:Installing module profiles: 2023-12-01T00:52:39.846 INFO:teuthology.orchestra.run.smithi093.stdout: container-tools/common 2023-12-01T00:52:39.846 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-01T00:52:39.846 INFO:teuthology.orchestra.run.smithi093.stdout:Enabling module streams: 2023-12-01T00:52:39.846 INFO:teuthology.orchestra.run.smithi093.stdout: container-tools rhel8 2023-12-01T00:52:39.846 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-01T00:52:39.846 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-01T00:52:39.846 INFO:teuthology.orchestra.run.smithi093.stdout:============================================================================================================ 2023-12-01T00:52:39.846 INFO:teuthology.orchestra.run.smithi093.stdout:Install 10 Packages 2023-12-01T00:52:39.846 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-01T00:52:39.847 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 18 M 2023-12-01T00:52:39.847 INFO:teuthology.orchestra.run.smithi093.stdout:Installed size: 65 M 2023-12-01T00:52:39.847 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-01T00:52:39.881 INFO:teuthology.orchestra.run.smithi116.stdout:============================================================================================================ 2023-12-01T00:52:39.882 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2023-12-01T00:52:39.882 INFO:teuthology.orchestra.run.smithi116.stdout:============================================================================================================ 2023-12-01T00:52:39.882 INFO:teuthology.orchestra.run.smithi116.stdout:Installing group/module packages: 2023-12-01T00:52:39.882 INFO:teuthology.orchestra.run.smithi116.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-12-01T00:52:39.882 INFO:teuthology.orchestra.run.smithi116.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-12-01T00:52:39.882 INFO:teuthology.orchestra.run.smithi116.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-12-01T00:52:39.882 INFO:teuthology.orchestra.run.smithi116.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-12-01T00:52:39.882 INFO:teuthology.orchestra.run.smithi116.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-12-01T00:52:39.882 INFO:teuthology.orchestra.run.smithi116.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-12-01T00:52:39.882 INFO:teuthology.orchestra.run.smithi116.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-12-01T00:52:39.882 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2023-12-01T00:52:39.882 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-12-01T00:52:39.882 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-12-01T00:52:39.883 INFO:teuthology.orchestra.run.smithi116.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-12-01T00:52:39.883 INFO:teuthology.orchestra.run.smithi116.stdout:Installing module profiles: 2023-12-01T00:52:39.883 INFO:teuthology.orchestra.run.smithi116.stdout: container-tools/common 2023-12-01T00:52:39.883 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-01T00:52:39.883 INFO:teuthology.orchestra.run.smithi116.stdout:Enabling module streams: 2023-12-01T00:52:39.883 INFO:teuthology.orchestra.run.smithi116.stdout: container-tools rhel8 2023-12-01T00:52:39.883 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-01T00:52:39.883 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-12-01T00:52:39.883 INFO:teuthology.orchestra.run.smithi116.stdout:============================================================================================================ 2023-12-01T00:52:39.883 INFO:teuthology.orchestra.run.smithi116.stdout:Install 10 Packages 2023-12-01T00:52:39.883 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-01T00:52:39.884 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 18 M 2023-12-01T00:52:39.884 INFO:teuthology.orchestra.run.smithi116.stdout:Installed size: 65 M 2023-12-01T00:52:39.884 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-12-01T00:52:39.946 INFO:teuthology.orchestra.run.smithi093.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 250 kB/s | 25 kB 00:00 2023-12-01T00:52:39.948 INFO:teuthology.orchestra.run.smithi116.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.4 MB/s | 94 kB 00:00 2023-12-01T00:52:39.972 INFO:teuthology.orchestra.run.smithi093.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 328 kB/s | 41 kB 00:00 2023-12-01T00:52:39.973 INFO:teuthology.orchestra.run.smithi116.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 278 kB/s | 25 kB 00:00 2023-12-01T00:52:39.989 INFO:teuthology.orchestra.run.smithi093.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 663 kB/s | 94 kB 00:00 2023-12-01T00:52:39.999 INFO:teuthology.orchestra.run.smithi116.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 356 kB/s | 41 kB 00:00 2023-12-01T00:52:40.014 INFO:teuthology.orchestra.run.smithi093.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 734 kB/s | 49 kB 00:00 2023-12-01T00:52:40.024 INFO:teuthology.orchestra.run.smithi116.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 654 kB/s | 49 kB 00:00 2023-12-01T00:52:40.047 INFO:teuthology.orchestra.run.smithi093.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.8 MB/s | 524 kB 00:00 2023-12-01T00:52:40.066 INFO:teuthology.orchestra.run.smithi116.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 5.5 MB/s | 524 kB 00:00 2023-12-01T00:52:40.070 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2023-12-01T00:52:40.073 INFO:teuthology.orchestra.run.smithi093.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-12-01T00:52:40.091 INFO:teuthology.orchestra.run.smithi116.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.2 MB/s | 149 kB 00:00 2023-12-01T00:52:40.106 INFO:teuthology.orchestra.run.smithi093.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 3.6 MB/s | 213 kB 00:00 2023-12-01T00:52:40.116 INFO:teuthology.orchestra.run.smithi116.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-12-01T00:52:40.170 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================================================ 2023-12-01T00:52:40.170 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2023-12-01T00:52:40.170 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================================================ 2023-12-01T00:52:40.170 INFO:teuthology.orchestra.run.smithi026.stdout:Installing group/module packages: 2023-12-01T00:52:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-12-01T00:52:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-12-01T00:52:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-12-01T00:52:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-12-01T00:52:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-12-01T00:52:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-12-01T00:52:40.173 INFO:teuthology.orchestra.run.smithi026.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-12-01T00:52:40.173 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2023-12-01T00:52:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-12-01T00:52:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-12-01T00:52:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-12-01T00:52:40.174 INFO:teuthology.orchestra.run.smithi026.stdout:Installing module profiles: 2023-12-01T00:52:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: container-tools/common 2023-12-01T00:52:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:52:40.174 INFO:teuthology.orchestra.run.smithi026.stdout:Enabling module streams: 2023-12-01T00:52:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: container-tools rhel8 2023-12-01T00:52:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:52:40.174 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2023-12-01T00:52:40.174 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================================================ 2023-12-01T00:52:40.174 INFO:teuthology.orchestra.run.smithi026.stdout:Install 10 Packages 2023-12-01T00:52:40.174 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:52:40.175 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 18 M 2023-12-01T00:52:40.175 INFO:teuthology.orchestra.run.smithi026.stdout:Installed size: 65 M 2023-12-01T00:52:40.175 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2023-12-01T00:52:40.223 INFO:teuthology.orchestra.run.smithi093.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 19 MB/s | 2.2 MB 00:00 2023-12-01T00:52:40.233 INFO:teuthology.orchestra.run.smithi116.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 19 MB/s | 2.2 MB 00:00 2023-12-01T00:52:40.241 INFO:teuthology.orchestra.run.smithi026.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.4 MB/s | 94 kB 00:00 2023-12-01T00:52:40.257 INFO:teuthology.orchestra.run.smithi026.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 293 kB/s | 25 kB 00:00 2023-12-01T00:52:40.283 INFO:teuthology.orchestra.run.smithi026.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 371 kB/s | 41 kB 00:00 2023-12-01T00:52:40.308 INFO:teuthology.orchestra.run.smithi026.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 735 kB/s | 49 kB 00:00 2023-12-01T00:52:40.323 INFO:teuthology.orchestra.run.smithi093.stdout:(9/10): buildah-1.26.2-1.module+el8.6.0+16771+2 24 MB/s | 8.0 MB 00:00 2023-12-01T00:52:40.325 INFO:teuthology.orchestra.run.smithi116.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 30 MB/s | 7.0 MB 00:00 2023-12-01T00:52:40.342 INFO:teuthology.orchestra.run.smithi026.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-12-01T00:52:40.367 INFO:teuthology.orchestra.run.smithi026.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-12-01T00:52:40.392 INFO:teuthology.orchestra.run.smithi026.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-12-01T00:52:40.399 INFO:teuthology.orchestra.run.smithi093.stdout:(10/10): skopeo-1.9.1-1.module+el8.6.0+16771+28 22 MB/s | 7.0 MB 00:00 2023-12-01T00:52:40.399 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-01T00:52:40.399 INFO:teuthology.orchestra.run.smithi093.stdout:Total 33 MB/s | 18 MB 00:00 2023-12-01T00:52:40.409 INFO:teuthology.orchestra.run.smithi116.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 19 MB/s | 8.0 MB 00:00 2023-12-01T00:52:40.409 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-12-01T00:52:40.409 INFO:teuthology.orchestra.run.smithi116.stdout:Total 35 MB/s | 18 MB 00:00 2023-12-01T00:52:40.517 INFO:teuthology.orchestra.run.smithi026.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 18 MB/s | 2.2 MB 00:00 2023-12-01T00:52:40.600 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-01T00:52:40.609 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-12-01T00:52:40.618 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-01T00:52:40.619 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-01T00:52:40.627 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-12-01T00:52:40.627 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-12-01T00:52:40.768 INFO:teuthology.orchestra.run.smithi026.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 18 MB/s | 7.0 MB 00:00 2023-12-01T00:52:40.800 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-01T00:52:40.804 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-01T00:52:40.810 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-12-01T00:52:40.819 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-12-01T00:52:40.859 INFO:teuthology.orchestra.run.smithi026.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 14 MB/s | 8.0 MB 00:00 2023-12-01T00:52:40.860 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2023-12-01T00:52:40.860 INFO:teuthology.orchestra.run.smithi026.stdout:Total 27 MB/s | 18 MB 00:00 2023-12-01T00:52:41.069 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2023-12-01T00:52:41.090 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2023-12-01T00:52:41.090 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2023-12-01T00:52:41.285 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2023-12-01T00:52:41.289 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2023-12-01T00:52:41.324 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-01T00:52:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-12-01T00:52:41.493 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-12-01T00:52:41.563 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-12-01T00:52:41.653 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-12-01T00:52:41.748 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-12-01T00:52:41.796 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2023-12-01T00:52:41.823 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-12-01T00:52:41.943 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-12-01T00:52:42.024 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-12-01T00:52:42.104 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-12-01T00:52:42.160 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-12-01T00:52:42.297 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-12-01T00:52:42.423 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-12-01T00:52:42.486 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-12-01T00:52:42.503 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-12-01T00:52:42.699 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-12-01T00:52:43.087 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-12-01T00:52:43.203 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-12-01T00:52:43.267 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-12-01T00:52:43.883 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-12-01T00:52:44.095 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-12-01T00:52:44.156 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-12-01T00:52:44.310 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-12-01T00:52:44.389 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-12-01T00:52:44.486 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-12-01T00:52:44.588 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-12-01T00:52:44.663 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-12-01T00:52:44.782 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-12-01T00:52:44.814 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-12-01T00:52:44.925 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-12-01T00:52:44.925 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-12-01T00:52:44.925 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-12-01T00:52:44.925 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-12-01T00:52:44.925 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-12-01T00:52:44.925 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-12-01T00:52:44.925 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-12-01T00:52:44.925 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-12-01T00:52:44.925 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-12-01T00:52:44.925 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-12-01T00:52:45.015 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-12-01T00:52:45.063 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-12-01T00:52:45.064 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-12-01T00:52:45.064 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-12-01T00:52:45.064 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-12-01T00:52:45.064 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-12-01T00:52:45.064 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-12-01T00:52:45.064 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-12-01T00:52:45.064 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-12-01T00:52:45.064 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-12-01T00:52:45.064 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-12-01T00:52:45.201 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-12-01T00:52:45.361 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-12-01T00:52:45.625 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-12-01T00:52:45.625 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-12-01T00:52:45.625 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-12-01T00:52:45.626 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-12-01T00:52:45.626 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-12-01T00:52:45.626 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-12-01T00:52:45.626 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-12-01T00:52:45.626 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-12-01T00:52:45.626 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-12-01T00:52:45.626 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-12-01T00:52:45.992 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-12-01T00:52:45.993 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:53 ago on Fri 01 Dec 2023 12:50:52 AM UTC. 2023-12-01T00:52:46.230 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-12-01T00:52:46.230 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:53 ago on Fri 01 Dec 2023 12:50:52 AM UTC. 2023-12-01T00:52:46.838 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-12-01T00:52:46.838 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:46 ago on Fri 01 Dec 2023 12:51:00 AM UTC. 2023-12-01T00:52:49.190 INFO:teuthology.orchestra.run.smithi093.stdout:Installed products updated. 2023-12-01T00:52:49.384 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-01T00:52:49.384 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-01T00:52:49.384 INFO:teuthology.orchestra.run.smithi093.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-01T00:52:49.384 INFO:teuthology.orchestra.run.smithi093.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-12-01T00:52:49.384 INFO:teuthology.orchestra.run.smithi093.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-01T00:52:49.384 INFO:teuthology.orchestra.run.smithi093.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-12-01T00:52:49.384 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-01T00:52:49.384 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-01T00:52:49.384 INFO:teuthology.orchestra.run.smithi093.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-01T00:52:49.384 INFO:teuthology.orchestra.run.smithi093.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-12-01T00:52:49.384 INFO:teuthology.orchestra.run.smithi093.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-12-01T00:52:49.385 INFO:teuthology.orchestra.run.smithi093.stdout: yajl-2.1.0-10.el8.x86_64 2023-12-01T00:52:49.385 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-01T00:52:49.385 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-01T00:52:49.506 INFO:teuthology.orchestra.run.smithi116.stdout:Installed products updated. 2023-12-01T00:52:49.531 DEBUG:teuthology.parallel:result is None 2023-12-01T00:52:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-01T00:52:49.694 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-12-01T00:52:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-01T00:52:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-12-01T00:52:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-01T00:52:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-12-01T00:52:49.694 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-01T00:52:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-01T00:52:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-01T00:52:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-12-01T00:52:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-12-01T00:52:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: yajl-2.1.0-10.el8.x86_64 2023-12-01T00:52:49.695 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-01T00:52:49.695 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-12-01T00:52:49.812 INFO:teuthology.orchestra.run.smithi026.stdout:Installed products updated. 2023-12-01T00:52:49.828 DEBUG:teuthology.parallel:result is None 2023-12-01T00:52:50.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:52:50.021 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2023-12-01T00:52:50.021 INFO:teuthology.orchestra.run.smithi026.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-01T00:52:50.021 INFO:teuthology.orchestra.run.smithi026.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-12-01T00:52:50.021 INFO:teuthology.orchestra.run.smithi026.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-01T00:52:50.021 INFO:teuthology.orchestra.run.smithi026.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-12-01T00:52:50.021 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-01T00:52:50.021 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-01T00:52:50.021 INFO:teuthology.orchestra.run.smithi026.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-12-01T00:52:50.021 INFO:teuthology.orchestra.run.smithi026.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-12-01T00:52:50.022 INFO:teuthology.orchestra.run.smithi026.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-12-01T00:52:50.022 INFO:teuthology.orchestra.run.smithi026.stdout: yajl-2.1.0-10.el8.x86_64 2023-12-01T00:52:50.022 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:52:50.022 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2023-12-01T00:52:50.161 DEBUG:teuthology.parallel:result is None 2023-12-01T00:52:50.162 INFO:teuthology.run_tasks:Running task install... 2023-12-01T00:52:50.182 DEBUG:teuthology.task.install:project ceph 2023-12-01T00:52:50.182 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32'}} 2023-12-01T00:52:50.183 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32'} 2023-12-01T00:52:50.183 INFO:teuthology.task.install:Using flavor: default 2023-12-01T00:52:50.195 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-01T00:52:50.195 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-01T00:52:50.196 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32', 'tag': None, 'wait_for_package': False} 2023-12-01T00:52:50.196 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T00:52:50.199 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32', 'tag': None, 'wait_for_package': False} 2023-12-01T00:52:50.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T00:52:50.201 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32', 'tag': None, 'wait_for_package': False} 2023-12-01T00:52:50.202 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T00:52:50.350 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/flavors/default/ 2023-12-01T00:52:50.350 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1249.ga6f82997 2023-12-01T00:52:50.354 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/flavors/default/ 2023-12-01T00:52:50.354 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1249.ga6f82997 2023-12-01T00:52:50.421 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/flavors/default/ 2023-12-01T00:52:50.421 INFO:teuthology.task.install.rpm:Package version is 18.2.0-1249.ga6f82997 2023-12-01T00:52:50.460 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-01T00:52:50.460 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-12-01T00:52:50.460 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-01T00:52:50.468 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-01T00:52:50.468 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-01T00:52:50.469 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-01T00:52:50.495 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-01T00:52:50.495 DEBUG:teuthology.orchestra.run.smithi116:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a6f82997ac57b70a895455dfed6256360a1e4c32/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-01T00:52:50.502 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-01T00:52:50.502 DEBUG:teuthology.orchestra.run.smithi093:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a6f82997ac57b70a895455dfed6256360a1e4c32/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-01T00:52:50.563 DEBUG:teuthology.orchestra.run.smithi116:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-01T00:52:50.575 DEBUG:teuthology.orchestra.run.smithi093:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-01T00:52:50.590 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-01T00:52:50.590 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T00:52:50.590 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-01T00:52:50.620 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-01T00:52:50.620 DEBUG:teuthology.orchestra.run.smithi026:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a6f82997ac57b70a895455dfed6256360a1e4c32/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-01T00:52:50.639 DEBUG:teuthology.orchestra.run.smithi116:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-01T00:52:50.660 DEBUG:teuthology.orchestra.run.smithi093:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-01T00:52:50.689 DEBUG:teuthology.orchestra.run.smithi026:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-01T00:52:50.705 INFO:teuthology.orchestra.run.smithi116.stdout:check_obsoletes = 1 2023-12-01T00:52:50.707 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum clean all 2023-12-01T00:52:50.732 INFO:teuthology.orchestra.run.smithi093.stdout:check_obsoletes = 1 2023-12-01T00:52:50.733 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum clean all 2023-12-01T00:52:50.769 DEBUG:teuthology.orchestra.run.smithi026:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-01T00:52:50.836 INFO:teuthology.orchestra.run.smithi026.stdout:check_obsoletes = 1 2023-12-01T00:52:50.837 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum clean all 2023-12-01T00:52:51.076 INFO:teuthology.orchestra.run.smithi116.stdout:Updating Subscription Management repositories. 2023-12-01T00:52:51.128 INFO:teuthology.orchestra.run.smithi093.stdout:Updating Subscription Management repositories. 2023-12-01T00:52:51.229 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-12-01T00:52:51.427 INFO:teuthology.orchestra.run.smithi116.stdout:44 files removed 2023-12-01T00:52:51.474 DEBUG:teuthology.orchestra.run.smithi116:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-01T00:52:51.486 INFO:teuthology.orchestra.run.smithi093.stdout:44 files removed 2023-12-01T00:52:51.532 DEBUG:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-01T00:52:51.589 INFO:teuthology.orchestra.run.smithi026.stdout:44 files removed 2023-12-01T00:52:51.636 DEBUG:teuthology.orchestra.run.smithi026:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-01T00:52:51.802 INFO:teuthology.orchestra.run.smithi116.stdout:Updating Subscription Management repositories. 2023-12-01T00:52:51.861 INFO:teuthology.orchestra.run.smithi093.stdout:Updating Subscription Management repositories. 2023-12-01T00:52:51.989 INFO:teuthology.orchestra.run.smithi026.stdout:Updating Subscription Management repositories. 2023-12-01T00:52:52.673 INFO:teuthology.orchestra.run.smithi116.stdout:ceph packages for x86_64 178 kB/s | 80 kB 00:00 2023-12-01T00:52:52.674 INFO:teuthology.orchestra.run.smithi093.stdout:ceph packages for x86_64 183 kB/s | 80 kB 00:00 2023-12-01T00:52:52.689 INFO:teuthology.orchestra.run.smithi026.stdout:ceph packages for x86_64 255 kB/s | 80 kB 00:00 2023-12-01T00:52:52.991 INFO:teuthology.orchestra.run.smithi093.stdout:ceph noarch packages 33 kB/s | 9.5 kB 00:00 2023-12-01T00:52:53.199 INFO:teuthology.orchestra.run.smithi026.stdout:ceph noarch packages 20 kB/s | 9.5 kB 00:00 2023-12-01T00:52:53.311 INFO:teuthology.orchestra.run.smithi116.stdout:ceph noarch packages 15 kB/s | 9.5 kB 00:00 2023-12-01T00:52:53.725 INFO:teuthology.orchestra.run.smithi093.stdout:ceph source packages 2.1 kB/s | 1.5 kB 00:00 2023-12-01T00:52:53.884 INFO:teuthology.orchestra.run.smithi093.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-12-01T00:52:53.899 INFO:teuthology.orchestra.run.smithi026.stdout:ceph source packages 2.2 kB/s | 1.5 kB 00:00 2023-12-01T00:52:54.003 INFO:teuthology.orchestra.run.smithi116.stdout:ceph source packages 2.2 kB/s | 1.5 kB 00:00 2023-12-01T00:52:54.058 INFO:teuthology.orchestra.run.smithi026.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-12-01T00:52:54.162 INFO:teuthology.orchestra.run.smithi116.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-12-01T00:52:55.923 INFO:teuthology.orchestra.run.smithi116.stdout:Extra Packages for Enterprise Linux 9.2 MB/s | 16 MB 00:01 2023-12-01T00:52:56.326 INFO:teuthology.orchestra.run.smithi093.stdout:Extra Packages for Enterprise Linux 6.6 MB/s | 16 MB 00:02 2023-12-01T00:52:57.703 INFO:teuthology.orchestra.run.smithi026.stdout:Extra Packages for Enterprise Linux 4.4 MB/s | 16 MB 00:03 2023-12-01T00:52:59.430 INFO:teuthology.orchestra.run.smithi116.stdout:lab-extras 410 kB/s | 24 kB 00:00 2023-12-01T00:52:59.860 INFO:teuthology.orchestra.run.smithi093.stdout:lab-extras 489 kB/s | 24 kB 00:00 2023-12-01T00:53:00.290 INFO:teuthology.orchestra.run.smithi116.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 MB/s | 47 MB 00:00 2023-12-01T00:53:00.787 INFO:teuthology.orchestra.run.smithi093.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-12-01T00:53:01.476 INFO:teuthology.orchestra.run.smithi026.stdout:lab-extras 425 kB/s | 24 kB 00:00 2023-12-01T00:53:02.469 INFO:teuthology.orchestra.run.smithi026.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 58 MB/s | 53 MB 00:00 2023-12-01T00:53:08.041 INFO:teuthology.orchestra.run.smithi116.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 66 MB/s | 53 MB 00:00 2023-12-01T00:53:08.979 INFO:teuthology.orchestra.run.smithi093.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-12-01T00:53:11.235 INFO:teuthology.orchestra.run.smithi026.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 48 MB/s | 47 MB 00:00 2023-12-01T00:53:19.122 INFO:teuthology.orchestra.run.smithi116.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-01T00:53:19.123 INFO:teuthology.orchestra.run.smithi116.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-01T00:53:19.137 INFO:teuthology.orchestra.run.smithi116.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-01T00:53:19.138 INFO:teuthology.orchestra.run.smithi116.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-01T00:53:19.139 INFO:teuthology.orchestra.run.smithi116.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-01T00:53:19.140 INFO:teuthology.orchestra.run.smithi116.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-01T00:53:19.142 INFO:teuthology.orchestra.run.smithi116.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-01T00:53:19.145 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-01T00:53:19.146 INFO:teuthology.orchestra.run.smithi116.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-01T00:53:19.274 INFO:teuthology.orchestra.run.smithi116.stdout:Dependencies resolved. 2023-12-01T00:53:19.287 INFO:teuthology.orchestra.run.smithi116.stdout:=========================================================================================================================== 2023-12-01T00:53:19.287 INFO:teuthology.orchestra.run.smithi116.stdout: Package Arch Version Repository Size 2023-12-01T00:53:19.287 INFO:teuthology.orchestra.run.smithi116.stdout:=========================================================================================================================== 2023-12-01T00:53:19.287 INFO:teuthology.orchestra.run.smithi116.stdout:Installing: 2023-12-01T00:53:19.287 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-12-01T00:53:19.287 INFO:teuthology.orchestra.run.smithi116.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-01T00:53:19.287 INFO:teuthology.orchestra.run.smithi116.stdout: ceph x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 6.4 k 2023-12-01T00:53:19.287 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 5.4 M 2023-12-01T00:53:19.287 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 851 k 2023-12-01T00:53:19.287 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 165 k 2023-12-01T00:53:19.287 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 1.6 M 2023-12-01T00:53:19.288 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 132 k 2023-12-01T00:53:19.288 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 1.8 M 2023-12-01T00:53:19.288 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 7.4 M 2023-12-01T00:53:19.288 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 50 k 2023-12-01T00:53:19.288 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 13 M 2023-12-01T00:53:19.288 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 47 M 2023-12-01T00:53:19.288 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 262 k 2023-12-01T00:53:19.288 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 168 k 2023-12-01T00:53:19.288 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 258 k 2023-12-01T00:53:19.288 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 18 k 2023-12-01T00:53:19.288 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-12-01T00:53:19.288 INFO:teuthology.orchestra.run.smithi116.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-01T00:53:19.288 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-01T00:53:19.289 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 31 k 2023-12-01T00:53:19.289 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2 x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 774 k 2023-12-01T00:53:19.289 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 139 k 2023-12-01T00:53:19.289 INFO:teuthology.orchestra.run.smithi116.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-01T00:53:19.289 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-12-01T00:53:19.289 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-01T00:53:19.289 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-01T00:53:19.289 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-12-01T00:53:19.289 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-01T00:53:19.289 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 196 k 2023-12-01T00:53:19.289 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 371 k 2023-12-01T00:53:19.289 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 364 k 2023-12-01T00:53:19.289 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 107 k 2023-12-01T00:53:19.289 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 94 k 2023-12-01T00:53:19.290 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 3.4 M 2023-12-01T00:53:19.290 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 181 k 2023-12-01T00:53:19.290 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-12-01T00:53:19.290 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrading: 2023-12-01T00:53:19.290 INFO:teuthology.orchestra.run.smithi116.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-12-01T00:53:19.290 INFO:teuthology.orchestra.run.smithi116.stdout: librados2 x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 3.7 M 2023-12-01T00:53:19.290 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1 x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 3.6 M 2023-12-01T00:53:19.290 INFO:teuthology.orchestra.run.smithi116.stdout:Installing dependencies: 2023-12-01T00:53:19.290 INFO:teuthology.orchestra.run.smithi116.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-12-01T00:53:19.290 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 22 M 2023-12-01T00:53:19.290 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 23 k 2023-12-01T00:53:19.290 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 2.3 M 2023-12-01T00:53:19.290 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 242 k 2023-12-01T00:53:19.291 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 4.6 M 2023-12-01T00:53:19.291 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 18 M 2023-12-01T00:53:19.291 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 15 k 2023-12-01T00:53:19.291 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 24 k 2023-12-01T00:53:19.291 INFO:teuthology.orchestra.run.smithi116.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-01T00:53:19.291 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-01T00:53:19.291 INFO:teuthology.orchestra.run.smithi116.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-01T00:53:19.291 INFO:teuthology.orchestra.run.smithi116.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-01T00:53:19.291 INFO:teuthology.orchestra.run.smithi116.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-12-01T00:53:19.291 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 141 k 2023-12-01T00:53:19.291 INFO:teuthology.orchestra.run.smithi116.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-01T00:53:19.291 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-12-01T00:53:19.291 INFO:teuthology.orchestra.run.smithi116.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-01T00:53:19.292 INFO:teuthology.orchestra.run.smithi116.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-01T00:53:19.292 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-12-01T00:53:19.292 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-01T00:53:19.292 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1 x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 474 k 2023-12-01T00:53:19.292 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-01T00:53:19.292 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2 x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 6.6 M 2023-12-01T00:53:19.292 INFO:teuthology.orchestra.run.smithi116.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-01T00:53:19.292 INFO:teuthology.orchestra.run.smithi116.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-01T00:53:19.292 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-01T00:53:19.292 INFO:teuthology.orchestra.run.smithi116.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-01T00:53:19.292 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-01T00:53:19.292 INFO:teuthology.orchestra.run.smithi116.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-01T00:53:19.292 INFO:teuthology.orchestra.run.smithi116.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-12-01T00:53:19.292 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-12-01T00:53:19.293 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-01T00:53:19.293 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-01T00:53:19.293 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-01T00:53:19.293 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-01T00:53:19.293 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-01T00:53:19.293 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-01T00:53:19.293 INFO:teuthology.orchestra.run.smithi116.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-01T00:53:19.293 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-01T00:53:19.293 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 45 k 2023-12-01T00:53:19.293 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 123 k 2023-12-01T00:53:19.293 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-01T00:53:19.293 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-01T00:53:19.293 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-01T00:53:19.293 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-01T00:53:19.293 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-01T00:53:19.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-01T00:53:19.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-01T00:53:19.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-01T00:53:19.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-01T00:53:19.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-01T00:53:19.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-01T00:53:19.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-01T00:53:19.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-01T00:53:19.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-01T00:53:19.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-01T00:53:19.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-01T00:53:19.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-01T00:53:19.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-01T00:53:19.294 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-01T00:53:19.295 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-01T00:53:19.295 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-01T00:53:19.295 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-01T00:53:19.295 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-01T00:53:19.295 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-01T00:53:19.295 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-01T00:53:19.295 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-01T00:53:19.295 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-01T00:53:19.295 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-01T00:53:19.295 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-01T00:53:19.295 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-01T00:53:19.295 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-01T00:53:19.295 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-01T00:53:19.295 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-01T00:53:19.295 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-01T00:53:19.296 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-01T00:53:19.296 INFO:teuthology.orchestra.run.smithi116.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-01T00:53:19.296 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-01T00:53:19.296 INFO:teuthology.orchestra.run.smithi116.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-01T00:53:19.296 INFO:teuthology.orchestra.run.smithi116.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-01T00:53:19.296 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-01T00:53:19.296 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-01T00:53:19.296 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-01T00:53:19.296 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-01T00:53:19.296 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-01T00:53:19.296 INFO:teuthology.orchestra.run.smithi116.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-01T00:53:19.296 INFO:teuthology.orchestra.run.smithi116.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-01T00:53:19.296 INFO:teuthology.orchestra.run.smithi116.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-01T00:53:19.296 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-01T00:53:19.297 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-01T00:53:19.297 INFO:teuthology.orchestra.run.smithi116.stdout:Enabling module streams: 2023-12-01T00:53:19.297 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql 10 2023-12-01T00:53:19.297 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-01T00:53:19.297 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction Summary 2023-12-01T00:53:19.297 INFO:teuthology.orchestra.run.smithi116.stdout:=========================================================================================================================== 2023-12-01T00:53:19.297 INFO:teuthology.orchestra.run.smithi116.stdout:Install 128 Packages 2023-12-01T00:53:19.297 INFO:teuthology.orchestra.run.smithi116.stdout:Upgrade 3 Packages 2023-12-01T00:53:19.297 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-01T00:53:19.298 INFO:teuthology.orchestra.run.smithi116.stdout:Total download size: 203 M 2023-12-01T00:53:19.298 INFO:teuthology.orchestra.run.smithi116.stdout:Downloading Packages: 2023-12-01T00:53:19.517 INFO:teuthology.orchestra.run.smithi116.stdout:(1/131): ceph-18.2.0-1249.ga6f82997.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2023-12-01T00:53:19.808 INFO:teuthology.orchestra.run.smithi116.stdout:(2/131): ceph-fuse-18.2.0-1249.ga6f82997.el8.x8 2.9 MB/s | 851 kB 00:00 2023-12-01T00:53:19.892 INFO:teuthology.orchestra.run.smithi116.stdout:(3/131): ceph-immutable-object-cache-18.2.0-124 1.9 MB/s | 165 kB 00:00 2023-12-01T00:53:19.959 INFO:teuthology.orchestra.run.smithi116.stdout:(4/131): ceph-base-18.2.0-1249.ga6f82997.el8.x8 8.6 MB/s | 5.4 MB 00:00 2023-12-01T00:53:20.052 INFO:teuthology.orchestra.run.smithi093.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-01T00:53:20.053 INFO:teuthology.orchestra.run.smithi093.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-01T00:53:20.066 INFO:teuthology.orchestra.run.smithi093.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-01T00:53:20.067 INFO:teuthology.orchestra.run.smithi093.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-01T00:53:20.069 INFO:teuthology.orchestra.run.smithi093.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-01T00:53:20.070 INFO:teuthology.orchestra.run.smithi093.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-01T00:53:20.072 INFO:teuthology.orchestra.run.smithi093.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-01T00:53:20.075 INFO:teuthology.orchestra.run.smithi093.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-01T00:53:20.076 INFO:teuthology.orchestra.run.smithi093.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-01T00:53:20.109 INFO:teuthology.orchestra.run.smithi116.stdout:(5/131): ceph-mgr-18.2.0-1249.ga6f82997.el8.x86 10 MB/s | 1.6 MB 00:00 2023-12-01T00:53:20.206 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2023-12-01T00:53:20.218 INFO:teuthology.orchestra.run.smithi093.stdout:=========================================================================================================================== 2023-12-01T00:53:20.219 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2023-12-01T00:53:20.219 INFO:teuthology.orchestra.run.smithi093.stdout:=========================================================================================================================== 2023-12-01T00:53:20.219 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2023-12-01T00:53:20.219 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-12-01T00:53:20.219 INFO:teuthology.orchestra.run.smithi093.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-01T00:53:20.219 INFO:teuthology.orchestra.run.smithi093.stdout: ceph x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 6.4 k 2023-12-01T00:53:20.219 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-base x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 5.4 M 2023-12-01T00:53:20.219 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-fuse x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 851 k 2023-12-01T00:53:20.219 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 165 k 2023-12-01T00:53:20.219 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 1.6 M 2023-12-01T00:53:20.219 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 132 k 2023-12-01T00:53:20.219 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 1.8 M 2023-12-01T00:53:20.219 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 7.4 M 2023-12-01T00:53:20.219 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-rook noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 50 k 2023-12-01T00:53:20.220 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-radosgw x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 13 M 2023-12-01T00:53:20.220 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-test x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 47 M 2023-12-01T00:53:20.220 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-volume noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 262 k 2023-12-01T00:53:20.220 INFO:teuthology.orchestra.run.smithi093.stdout: cephadm noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 168 k 2023-12-01T00:53:20.220 INFO:teuthology.orchestra.run.smithi093.stdout: cephfs-mirror x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 258 k 2023-12-01T00:53:20.220 INFO:teuthology.orchestra.run.smithi093.stdout: cephfs-top noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 18 k 2023-12-01T00:53:20.220 INFO:teuthology.orchestra.run.smithi093.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-12-01T00:53:20.220 INFO:teuthology.orchestra.run.smithi093.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-01T00:53:20.220 INFO:teuthology.orchestra.run.smithi093.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-01T00:53:20.220 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs-devel x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 31 k 2023-12-01T00:53:20.220 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs2 x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 774 k 2023-12-01T00:53:20.220 INFO:teuthology.orchestra.run.smithi093.stdout: librados-devel x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 139 k 2023-12-01T00:53:20.220 INFO:teuthology.orchestra.run.smithi093.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-01T00:53:20.220 INFO:teuthology.orchestra.run.smithi093.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-12-01T00:53:20.220 INFO:teuthology.orchestra.run.smithi093.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-01T00:53:20.221 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-01T00:53:20.221 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-12-01T00:53:20.221 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-01T00:53:20.221 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cephfs x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 196 k 2023-12-01T00:53:20.221 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rados x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 371 k 2023-12-01T00:53:20.221 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rbd x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 364 k 2023-12-01T00:53:20.221 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rgw x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 107 k 2023-12-01T00:53:20.221 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-fuse x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 94 k 2023-12-01T00:53:20.221 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-mirror x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 3.4 M 2023-12-01T00:53:20.221 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-nbd x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 181 k 2023-12-01T00:53:20.221 INFO:teuthology.orchestra.run.smithi093.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-12-01T00:53:20.221 INFO:teuthology.orchestra.run.smithi093.stdout:Upgrading: 2023-12-01T00:53:20.221 INFO:teuthology.orchestra.run.smithi093.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-12-01T00:53:20.221 INFO:teuthology.orchestra.run.smithi093.stdout: librados2 x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 3.7 M 2023-12-01T00:53:20.222 INFO:teuthology.orchestra.run.smithi093.stdout: librbd1 x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 3.6 M 2023-12-01T00:53:20.222 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2023-12-01T00:53:20.222 INFO:teuthology.orchestra.run.smithi093.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-12-01T00:53:20.222 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-common x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 22 M 2023-12-01T00:53:20.222 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 23 k 2023-12-01T00:53:20.222 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mds x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 2.3 M 2023-12-01T00:53:20.222 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 242 k 2023-12-01T00:53:20.222 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mon x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 4.6 M 2023-12-01T00:53:20.222 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-osd x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 18 M 2023-12-01T00:53:20.222 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 15 k 2023-12-01T00:53:20.222 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-selinux x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 24 k 2023-12-01T00:53:20.222 INFO:teuthology.orchestra.run.smithi093.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-01T00:53:20.222 INFO:teuthology.orchestra.run.smithi093.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-01T00:53:20.222 INFO:teuthology.orchestra.run.smithi093.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-01T00:53:20.223 INFO:teuthology.orchestra.run.smithi093.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-01T00:53:20.223 INFO:teuthology.orchestra.run.smithi093.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-12-01T00:53:20.223 INFO:teuthology.orchestra.run.smithi093.stdout: libcephsqlite x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 141 k 2023-12-01T00:53:20.223 INFO:teuthology.orchestra.run.smithi093.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-01T00:53:20.223 INFO:teuthology.orchestra.run.smithi093.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-12-01T00:53:20.223 INFO:teuthology.orchestra.run.smithi093.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-01T00:53:20.223 INFO:teuthology.orchestra.run.smithi093.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-01T00:53:20.223 INFO:teuthology.orchestra.run.smithi093.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-12-01T00:53:20.223 INFO:teuthology.orchestra.run.smithi093.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-01T00:53:20.223 INFO:teuthology.orchestra.run.smithi093.stdout: libradosstriper1 x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 474 k 2023-12-01T00:53:20.223 INFO:teuthology.orchestra.run.smithi093.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-01T00:53:20.223 INFO:teuthology.orchestra.run.smithi093.stdout: librgw2 x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 6.6 M 2023-12-01T00:53:20.223 INFO:teuthology.orchestra.run.smithi093.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-01T00:53:20.224 INFO:teuthology.orchestra.run.smithi093.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-01T00:53:20.224 INFO:teuthology.orchestra.run.smithi093.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-01T00:53:20.224 INFO:teuthology.orchestra.run.smithi093.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-01T00:53:20.224 INFO:teuthology.orchestra.run.smithi093.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-01T00:53:20.224 INFO:teuthology.orchestra.run.smithi093.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-01T00:53:20.224 INFO:teuthology.orchestra.run.smithi093.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-12-01T00:53:20.224 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-12-01T00:53:20.224 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-01T00:53:20.224 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-01T00:53:20.224 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-01T00:53:20.224 INFO:teuthology.orchestra.run.smithi093.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-01T00:53:20.224 INFO:teuthology.orchestra.run.smithi093.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-01T00:53:20.224 INFO:teuthology.orchestra.run.smithi093.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-01T00:53:20.224 INFO:teuthology.orchestra.run.smithi093.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-01T00:53:20.225 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-01T00:53:20.225 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-argparse x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 45 k 2023-12-01T00:53:20.225 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-common x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 123 k 2023-12-01T00:53:20.225 INFO:teuthology.orchestra.run.smithi093.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-01T00:53:20.225 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-01T00:53:20.225 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-01T00:53:20.225 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-01T00:53:20.225 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-01T00:53:20.225 INFO:teuthology.orchestra.run.smithi093.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-01T00:53:20.225 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-01T00:53:20.225 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-01T00:53:20.225 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-01T00:53:20.225 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-01T00:53:20.225 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-01T00:53:20.225 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-01T00:53:20.226 INFO:teuthology.orchestra.run.smithi093.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-01T00:53:20.226 INFO:teuthology.orchestra.run.smithi093.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-01T00:53:20.226 INFO:teuthology.orchestra.run.smithi093.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-01T00:53:20.226 INFO:teuthology.orchestra.run.smithi093.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-01T00:53:20.226 INFO:teuthology.orchestra.run.smithi093.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-01T00:53:20.226 INFO:teuthology.orchestra.run.smithi093.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-01T00:53:20.226 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-01T00:53:20.226 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-01T00:53:20.226 INFO:teuthology.orchestra.run.smithi093.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-01T00:53:20.226 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-01T00:53:20.226 INFO:teuthology.orchestra.run.smithi093.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-01T00:53:20.226 INFO:teuthology.orchestra.run.smithi093.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-01T00:53:20.226 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-01T00:53:20.226 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-01T00:53:20.226 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-01T00:53:20.227 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-01T00:53:20.227 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-01T00:53:20.227 INFO:teuthology.orchestra.run.smithi093.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-01T00:53:20.227 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-01T00:53:20.227 INFO:teuthology.orchestra.run.smithi093.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-01T00:53:20.227 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-01T00:53:20.227 INFO:teuthology.orchestra.run.smithi093.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-01T00:53:20.227 INFO:teuthology.orchestra.run.smithi093.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-01T00:53:20.227 INFO:teuthology.orchestra.run.smithi093.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-01T00:53:20.227 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-01T00:53:20.227 INFO:teuthology.orchestra.run.smithi093.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-01T00:53:20.227 INFO:teuthology.orchestra.run.smithi093.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-01T00:53:20.227 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-01T00:53:20.227 INFO:teuthology.orchestra.run.smithi093.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-01T00:53:20.227 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-01T00:53:20.228 INFO:teuthology.orchestra.run.smithi093.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-01T00:53:20.228 INFO:teuthology.orchestra.run.smithi093.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-01T00:53:20.228 INFO:teuthology.orchestra.run.smithi093.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-01T00:53:20.228 INFO:teuthology.orchestra.run.smithi093.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-01T00:53:20.228 INFO:teuthology.orchestra.run.smithi093.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-01T00:53:20.228 INFO:teuthology.orchestra.run.smithi093.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-01T00:53:20.228 INFO:teuthology.orchestra.run.smithi093.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-01T00:53:20.228 INFO:teuthology.orchestra.run.smithi093.stdout:Enabling module streams: 2023-12-01T00:53:20.228 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql 10 2023-12-01T00:53:20.228 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-01T00:53:20.228 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2023-12-01T00:53:20.228 INFO:teuthology.orchestra.run.smithi093.stdout:=========================================================================================================================== 2023-12-01T00:53:20.228 INFO:teuthology.orchestra.run.smithi093.stdout:Install 128 Packages 2023-12-01T00:53:20.228 INFO:teuthology.orchestra.run.smithi093.stdout:Upgrade 3 Packages 2023-12-01T00:53:20.229 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-01T00:53:20.229 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 203 M 2023-12-01T00:53:20.229 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2023-12-01T00:53:20.334 INFO:teuthology.orchestra.run.smithi116.stdout:(6/131): ceph-mds-18.2.0-1249.ga6f82997.el8.x86 5.2 MB/s | 2.3 MB 00:00 2023-12-01T00:53:20.463 INFO:teuthology.orchestra.run.smithi093.stdout:(1/131): ceph-18.2.0-1249.ga6f82997.el8.x86_64. 32 kB/s | 6.4 kB 00:00 2023-12-01T00:53:20.476 INFO:teuthology.orchestra.run.smithi116.stdout:(7/131): ceph-mon-18.2.0-1249.ga6f82997.el8.x86 13 MB/s | 4.6 MB 00:00 2023-12-01T00:53:21.364 INFO:teuthology.orchestra.run.smithi093.stdout:(2/131): ceph-fuse-18.2.0-1249.ga6f82997.el8.x8 946 kB/s | 851 kB 00:00 2023-12-01T00:53:21.547 INFO:teuthology.orchestra.run.smithi093.stdout:(3/131): ceph-immutable-object-cache-18.2.0-124 902 kB/s | 165 kB 00:00 2023-12-01T00:53:21.985 INFO:teuthology.orchestra.run.smithi116.stdout:(8/131): ceph-radosgw-18.2.0-1249.ga6f82997.el8 8.7 MB/s | 13 MB 00:01 2023-12-01T00:53:22.052 INFO:teuthology.orchestra.run.smithi116.stdout:(9/131): ceph-selinux-18.2.0-1249.ga6f82997.el8 365 kB/s | 24 kB 00:00 2023-12-01T00:53:22.197 INFO:teuthology.orchestra.run.smithi093.stdout:(4/131): ceph-mds-18.2.0-1249.ga6f82997.el8.x86 3.5 MB/s | 2.3 MB 00:00 2023-12-01T00:53:22.252 INFO:teuthology.orchestra.run.smithi116.stdout:(10/131): ceph-common-18.2.0-1249.ga6f82997.el8 7.4 MB/s | 22 MB 00:02 2023-12-01T00:53:22.369 INFO:teuthology.orchestra.run.smithi116.stdout:(11/131): cephfs-mirror-18.2.0-1249.ga6f82997.e 2.2 MB/s | 258 kB 00:00 2023-12-01T00:53:22.461 INFO:teuthology.orchestra.run.smithi116.stdout:(12/131): libcephfs-devel-18.2.0-1249.ga6f82997 337 kB/s | 31 kB 00:00 2023-12-01T00:53:22.523 INFO:teuthology.orchestra.run.smithi093.stdout:(5/131): ceph-mgr-18.2.0-1249.ga6f82997.el8.x86 4.8 MB/s | 1.6 MB 00:00 2023-12-01T00:53:22.595 INFO:teuthology.orchestra.run.smithi116.stdout:(13/131): libcephfs2-18.2.0-1249.ga6f82997.el8. 5.7 MB/s | 774 kB 00:00 2023-12-01T00:53:22.720 INFO:teuthology.orchestra.run.smithi116.stdout:(14/131): libcephsqlite-18.2.0-1249.ga6f82997.e 1.1 MB/s | 141 kB 00:00 2023-12-01T00:53:22.845 INFO:teuthology.orchestra.run.smithi116.stdout:(15/131): librados-devel-18.2.0-1249.ga6f82997. 1.1 MB/s | 139 kB 00:00 2023-12-01T00:53:22.987 INFO:teuthology.orchestra.run.smithi116.stdout:(16/131): libradosstriper1-18.2.0-1249.ga6f8299 3.3 MB/s | 474 kB 00:00 2023-12-01T00:53:23.294 INFO:teuthology.orchestra.run.smithi026.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-01T00:53:23.295 INFO:teuthology.orchestra.run.smithi026.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-01T00:53:23.311 INFO:teuthology.orchestra.run.smithi026.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-01T00:53:23.312 INFO:teuthology.orchestra.run.smithi026.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-01T00:53:23.313 INFO:teuthology.orchestra.run.smithi026.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-01T00:53:23.314 INFO:teuthology.orchestra.run.smithi026.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-01T00:53:23.317 INFO:teuthology.orchestra.run.smithi026.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-01T00:53:23.320 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-01T00:53:23.321 INFO:teuthology.orchestra.run.smithi026.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-01T00:53:23.331 INFO:teuthology.orchestra.run.smithi093.stdout:(6/131): ceph-mon-18.2.0-1249.ga6f82997.el8.x86 5.7 MB/s | 4.6 MB 00:00 2023-12-01T00:53:23.464 INFO:teuthology.orchestra.run.smithi026.stdout:Dependencies resolved. 2023-12-01T00:53:23.478 INFO:teuthology.orchestra.run.smithi026.stdout:=========================================================================================================================== 2023-12-01T00:53:23.478 INFO:teuthology.orchestra.run.smithi026.stdout: Package Arch Version Repository Size 2023-12-01T00:53:23.479 INFO:teuthology.orchestra.run.smithi026.stdout:=========================================================================================================================== 2023-12-01T00:53:23.479 INFO:teuthology.orchestra.run.smithi026.stdout:Installing: 2023-12-01T00:53:23.479 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-12-01T00:53:23.479 INFO:teuthology.orchestra.run.smithi026.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-01T00:53:23.479 INFO:teuthology.orchestra.run.smithi026.stdout: ceph x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 6.4 k 2023-12-01T00:53:23.479 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 5.4 M 2023-12-01T00:53:23.479 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 851 k 2023-12-01T00:53:23.479 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 165 k 2023-12-01T00:53:23.479 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 1.6 M 2023-12-01T00:53:23.479 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 132 k 2023-12-01T00:53:23.479 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 1.8 M 2023-12-01T00:53:23.479 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 7.4 M 2023-12-01T00:53:23.479 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 50 k 2023-12-01T00:53:23.479 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 13 M 2023-12-01T00:53:23.480 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 47 M 2023-12-01T00:53:23.480 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 262 k 2023-12-01T00:53:23.480 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 168 k 2023-12-01T00:53:23.480 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 258 k 2023-12-01T00:53:23.480 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-top noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 18 k 2023-12-01T00:53:23.480 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-12-01T00:53:23.480 INFO:teuthology.orchestra.run.smithi026.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-01T00:53:23.480 INFO:teuthology.orchestra.run.smithi026.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-01T00:53:23.480 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 31 k 2023-12-01T00:53:23.480 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2 x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 774 k 2023-12-01T00:53:23.480 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 139 k 2023-12-01T00:53:23.480 INFO:teuthology.orchestra.run.smithi026.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-01T00:53:23.480 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-12-01T00:53:23.481 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-01T00:53:23.481 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-01T00:53:23.481 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-12-01T00:53:23.481 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-01T00:53:23.481 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 196 k 2023-12-01T00:53:23.481 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 371 k 2023-12-01T00:53:23.481 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 364 k 2023-12-01T00:53:23.481 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 107 k 2023-12-01T00:53:23.481 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 94 k 2023-12-01T00:53:23.481 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 3.4 M 2023-12-01T00:53:23.481 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 181 k 2023-12-01T00:53:23.481 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-12-01T00:53:23.481 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrading: 2023-12-01T00:53:23.481 INFO:teuthology.orchestra.run.smithi026.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-12-01T00:53:23.482 INFO:teuthology.orchestra.run.smithi026.stdout: librados2 x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 3.7 M 2023-12-01T00:53:23.482 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1 x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 3.6 M 2023-12-01T00:53:23.482 INFO:teuthology.orchestra.run.smithi026.stdout:Installing dependencies: 2023-12-01T00:53:23.482 INFO:teuthology.orchestra.run.smithi026.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-12-01T00:53:23.482 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 22 M 2023-12-01T00:53:23.482 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 23 k 2023-12-01T00:53:23.482 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 2.3 M 2023-12-01T00:53:23.482 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 242 k 2023-12-01T00:53:23.483 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 4.6 M 2023-12-01T00:53:23.483 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 18 M 2023-12-01T00:53:23.483 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts noarch 2:18.2.0-1249.ga6f82997.el8 ceph-noarch 15 k 2023-12-01T00:53:23.483 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 24 k 2023-12-01T00:53:23.483 INFO:teuthology.orchestra.run.smithi026.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-01T00:53:23.483 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-01T00:53:23.483 INFO:teuthology.orchestra.run.smithi026.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-01T00:53:23.483 INFO:teuthology.orchestra.run.smithi026.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-01T00:53:23.483 INFO:teuthology.orchestra.run.smithi026.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-12-01T00:53:23.483 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 141 k 2023-12-01T00:53:23.483 INFO:teuthology.orchestra.run.smithi026.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-01T00:53:23.484 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-12-01T00:53:23.484 INFO:teuthology.orchestra.run.smithi026.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-01T00:53:23.484 INFO:teuthology.orchestra.run.smithi026.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-01T00:53:23.484 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-12-01T00:53:23.484 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-01T00:53:23.484 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 474 k 2023-12-01T00:53:23.484 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-01T00:53:23.484 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2 x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 6.6 M 2023-12-01T00:53:23.484 INFO:teuthology.orchestra.run.smithi026.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-01T00:53:23.485 INFO:teuthology.orchestra.run.smithi026.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-01T00:53:23.485 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-01T00:53:23.485 INFO:teuthology.orchestra.run.smithi026.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-01T00:53:23.485 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-01T00:53:23.485 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-01T00:53:23.485 INFO:teuthology.orchestra.run.smithi026.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-12-01T00:53:23.485 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-12-01T00:53:23.485 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-01T00:53:23.485 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-01T00:53:23.485 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-01T00:53:23.486 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-01T00:53:23.486 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-01T00:53:23.486 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-01T00:53:23.486 INFO:teuthology.orchestra.run.smithi026.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-01T00:53:23.486 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-01T00:53:23.486 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 45 k 2023-12-01T00:53:23.486 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common x86_64 2:18.2.0-1249.ga6f82997.el8 ceph 123 k 2023-12-01T00:53:23.486 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-01T00:53:23.486 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-01T00:53:23.486 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-01T00:53:23.486 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-01T00:53:23.486 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-01T00:53:23.487 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-01T00:53:23.487 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-01T00:53:23.487 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-01T00:53:23.487 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-01T00:53:23.487 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-01T00:53:23.487 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-01T00:53:23.488 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-01T00:53:23.488 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-01T00:53:23.488 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-01T00:53:23.488 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-01T00:53:23.488 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-01T00:53:23.489 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-01T00:53:23.489 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-01T00:53:23.489 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-01T00:53:23.489 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-01T00:53:23.489 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-01T00:53:23.489 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-01T00:53:23.489 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-01T00:53:23.489 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-01T00:53:23.489 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-01T00:53:23.489 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-01T00:53:23.489 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-01T00:53:23.489 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-01T00:53:23.490 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-01T00:53:23.490 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-01T00:53:23.490 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-01T00:53:23.490 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-01T00:53:23.490 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-01T00:53:23.490 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-01T00:53:23.490 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-01T00:53:23.490 INFO:teuthology.orchestra.run.smithi026.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-01T00:53:23.490 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-01T00:53:23.490 INFO:teuthology.orchestra.run.smithi026.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-01T00:53:23.490 INFO:teuthology.orchestra.run.smithi026.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-01T00:53:23.490 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-01T00:53:23.490 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-01T00:53:23.491 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-01T00:53:23.491 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-01T00:53:23.491 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-01T00:53:23.491 INFO:teuthology.orchestra.run.smithi026.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-01T00:53:23.491 INFO:teuthology.orchestra.run.smithi026.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-01T00:53:23.491 INFO:teuthology.orchestra.run.smithi026.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-01T00:53:23.491 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-01T00:53:23.491 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-01T00:53:23.491 INFO:teuthology.orchestra.run.smithi026.stdout:Enabling module streams: 2023-12-01T00:53:23.491 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql 10 2023-12-01T00:53:23.491 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:53:23.491 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction Summary 2023-12-01T00:53:23.491 INFO:teuthology.orchestra.run.smithi026.stdout:=========================================================================================================================== 2023-12-01T00:53:23.491 INFO:teuthology.orchestra.run.smithi026.stdout:Install 128 Packages 2023-12-01T00:53:23.492 INFO:teuthology.orchestra.run.smithi026.stdout:Upgrade 3 Packages 2023-12-01T00:53:23.492 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:53:23.492 INFO:teuthology.orchestra.run.smithi026.stdout:Total download size: 203 M 2023-12-01T00:53:23.492 INFO:teuthology.orchestra.run.smithi026.stdout:Downloading Packages: 2023-12-01T00:53:23.499 INFO:teuthology.orchestra.run.smithi093.stdout:(7/131): ceph-base-18.2.0-1249.ga6f82997.el8.x8 1.7 MB/s | 5.4 MB 00:03 2023-12-01T00:53:23.914 INFO:teuthology.orchestra.run.smithi116.stdout:(17/131): librgw2-18.2.0-1249.ga6f82997.el8.x86 7.1 MB/s | 6.6 MB 00:00 2023-12-01T00:53:24.037 INFO:teuthology.orchestra.run.smithi026.stdout:(1/131): ceph-18.2.0-1249.ga6f82997.el8.x86_64. 24 kB/s | 6.4 kB 00:00 2023-12-01T00:53:24.140 INFO:teuthology.orchestra.run.smithi116.stdout:(18/131): ceph-osd-18.2.0-1249.ga6f82997.el8.x8 4.6 MB/s | 18 MB 00:03 2023-12-01T00:53:24.165 INFO:teuthology.orchestra.run.smithi116.stdout:(19/131): python3-ceph-argparse-18.2.0-1249.ga6 178 kB/s | 45 kB 00:00 2023-12-01T00:53:24.223 INFO:teuthology.orchestra.run.smithi116.stdout:(20/131): python3-ceph-common-18.2.0-1249.ga6f8 1.4 MB/s | 123 kB 00:00 2023-12-01T00:53:24.265 INFO:teuthology.orchestra.run.smithi116.stdout:(21/131): python3-cephfs-18.2.0-1249.ga6f82997. 1.9 MB/s | 196 kB 00:00 2023-12-01T00:53:24.374 INFO:teuthology.orchestra.run.smithi116.stdout:(22/131): python3-rbd-18.2.0-1249.ga6f82997.el8 3.3 MB/s | 364 kB 00:00 2023-12-01T00:53:24.399 INFO:teuthology.orchestra.run.smithi116.stdout:(23/131): python3-rados-18.2.0-1249.ga6f82997.e 2.1 MB/s | 371 kB 00:00 2023-12-01T00:53:24.466 INFO:teuthology.orchestra.run.smithi116.stdout:(24/131): python3-rgw-18.2.0-1249.ga6f82997.el8 1.1 MB/s | 107 kB 00:00 2023-12-01T00:53:24.492 INFO:teuthology.orchestra.run.smithi116.stdout:(25/131): rbd-fuse-18.2.0-1249.ga6f82997.el8.x8 1.0 MB/s | 94 kB 00:00 2023-12-01T00:53:24.712 INFO:teuthology.orchestra.run.smithi026.stdout:(2/131): ceph-fuse-18.2.0-1249.ga6f82997.el8.x8 1.2 MB/s | 851 kB 00:00 2023-12-01T00:53:24.879 INFO:teuthology.orchestra.run.smithi026.stdout:(3/131): ceph-immutable-object-cache-18.2.0-124 993 kB/s | 165 kB 00:00 2023-12-01T00:53:24.883 INFO:teuthology.orchestra.run.smithi116.stdout:(26/131): rbd-mirror-18.2.0-1249.ga6f82997.el8. 8.3 MB/s | 3.4 MB 00:00 2023-12-01T00:53:24.992 INFO:teuthology.orchestra.run.smithi116.stdout:(27/131): ceph-grafana-dashboards-18.2.0-1249.g 213 kB/s | 23 kB 00:00 2023-12-01T00:53:25.101 INFO:teuthology.orchestra.run.smithi116.stdout:(28/131): ceph-mgr-cephadm-18.2.0-1249.ga6f8299 1.2 MB/s | 132 kB 00:00 2023-12-01T00:53:25.318 INFO:teuthology.orchestra.run.smithi116.stdout:(29/131): rbd-nbd-18.2.0-1249.ga6f82997.el8.x86 219 kB/s | 181 kB 00:00 2023-12-01T00:53:25.360 INFO:teuthology.orchestra.run.smithi116.stdout:(30/131): ceph-mgr-dashboard-18.2.0-1249.ga6f82 6.8 MB/s | 1.8 MB 00:00 2023-12-01T00:53:25.452 INFO:teuthology.orchestra.run.smithi116.stdout:(31/131): ceph-mgr-modules-core-18.2.0-1249.ga6 2.6 MB/s | 242 kB 00:00 2023-12-01T00:53:25.544 INFO:teuthology.orchestra.run.smithi116.stdout:(32/131): ceph-mgr-rook-18.2.0-1249.ga6f82997.e 547 kB/s | 50 kB 00:00 2023-12-01T00:53:25.627 INFO:teuthology.orchestra.run.smithi116.stdout:(33/131): ceph-prometheus-alerts-18.2.0-1249.ga 175 kB/s | 15 kB 00:00 2023-12-01T00:53:25.646 INFO:teuthology.orchestra.run.smithi026.stdout:(4/131): ceph-mds-18.2.0-1249.ga6f82997.el8.x86 3.0 MB/s | 2.3 MB 00:00 2023-12-01T00:53:25.711 INFO:teuthology.orchestra.run.smithi116.stdout:(34/131): ceph-volume-18.2.0-1249.ga6f82997.el8 3.1 MB/s | 262 kB 00:00 2023-12-01T00:53:25.803 INFO:teuthology.orchestra.run.smithi116.stdout:(35/131): cephadm-18.2.0-1249.ga6f82997.el8.noa 1.8 MB/s | 168 kB 00:00 2023-12-01T00:53:25.886 INFO:teuthology.orchestra.run.smithi116.stdout:(36/131): cephfs-top-18.2.0-1249.ga6f82997.el8. 216 kB/s | 18 kB 00:00 2023-12-01T00:53:26.020 INFO:teuthology.orchestra.run.smithi116.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.2 MB/s | 306 kB 00:00 2023-12-01T00:53:26.053 INFO:teuthology.orchestra.run.smithi116.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.7 MB/s | 59 kB 00:00 2023-12-01T00:53:26.071 INFO:teuthology.orchestra.run.smithi026.stdout:(5/131): ceph-mgr-18.2.0-1249.ga6f82997.el8.x86 3.7 MB/s | 1.6 MB 00:00 2023-12-01T00:53:26.095 INFO:teuthology.orchestra.run.smithi116.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.8 MB/s | 75 kB 00:00 2023-12-01T00:53:26.148 INFO:teuthology.orchestra.run.smithi093.stdout:(8/131): ceph-osd-18.2.0-1249.ga6f82997.el8.x86 6.3 MB/s | 18 MB 00:02 2023-12-01T00:53:26.162 INFO:teuthology.orchestra.run.smithi116.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 7.0 MB/s | 476 kB 00:00 2023-12-01T00:53:26.196 INFO:teuthology.orchestra.run.smithi116.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.3 MB/s | 44 kB 00:00 2023-12-01T00:53:26.206 INFO:teuthology.orchestra.run.smithi093.stdout:(9/131): ceph-selinux-18.2.0-1249.ga6f82997.el8 419 kB/s | 24 kB 00:00 2023-12-01T00:53:26.238 INFO:teuthology.orchestra.run.smithi116.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 4.3 MB/s | 185 kB 00:00 2023-12-01T00:53:26.273 INFO:teuthology.orchestra.run.smithi116.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 990 kB/s | 33 kB 00:00 2023-12-01T00:53:26.305 INFO:teuthology.orchestra.run.smithi116.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 489 kB/s | 16 kB 00:00 2023-12-01T00:53:26.356 INFO:teuthology.orchestra.run.smithi116.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2023-12-01T00:53:26.406 INFO:teuthology.orchestra.run.smithi116.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 7.5 MB/s | 384 kB 00:00 2023-12-01T00:53:26.607 INFO:teuthology.orchestra.run.smithi116.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 406 kB/s | 81 kB 00:00 2023-12-01T00:53:26.649 INFO:teuthology.orchestra.run.smithi116.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 268 kB/s | 11 kB 00:00 2023-12-01T00:53:26.691 INFO:teuthology.orchestra.run.smithi116.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 423 kB/s | 18 kB 00:00 2023-12-01T00:53:26.766 INFO:teuthology.orchestra.run.smithi116.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 16 MB/s | 1.2 MB 00:00 2023-12-01T00:53:26.808 INFO:teuthology.orchestra.run.smithi116.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 1.1 MB/s | 49 kB 00:00 2023-12-01T00:53:26.821 INFO:teuthology.orchestra.run.smithi026.stdout:(6/131): ceph-base-18.2.0-1249.ga6f82997.el8.x8 1.8 MB/s | 5.4 MB 00:03 2023-12-01T00:53:26.850 INFO:teuthology.orchestra.run.smithi116.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.4 MB/s | 59 kB 00:00 2023-12-01T00:53:26.880 INFO:teuthology.orchestra.run.smithi026.stdout:(7/131): ceph-mon-18.2.0-1249.ga6f82997.el8.x86 5.7 MB/s | 4.6 MB 00:00 2023-12-01T00:53:26.892 INFO:teuthology.orchestra.run.smithi116.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2023-12-01T00:53:26.942 INFO:teuthology.orchestra.run.smithi116.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 5.6 MB/s | 283 kB 00:00 2023-12-01T00:53:26.984 INFO:teuthology.orchestra.run.smithi116.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 375 kB/s | 16 kB 00:00 2023-12-01T00:53:27.034 INFO:teuthology.orchestra.run.smithi116.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 671 kB/s | 34 kB 00:00 2023-12-01T00:53:27.085 INFO:teuthology.orchestra.run.smithi116.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 3.9 MB/s | 196 kB 00:00 2023-12-01T00:53:27.090 INFO:teuthology.orchestra.run.smithi093.stdout:(10/131): ceph-common-18.2.0-1249.ga6f82997.el8 3.2 MB/s | 22 MB 00:06 2023-12-01T00:53:27.118 INFO:teuthology.orchestra.run.smithi116.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 1.9 MB/s | 64 kB 00:00 2023-12-01T00:53:27.160 INFO:teuthology.orchestra.run.smithi116.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 451 kB/s | 19 kB 00:00 2023-12-01T00:53:27.202 INFO:teuthology.orchestra.run.smithi116.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 577 kB/s | 24 kB 00:00 2023-12-01T00:53:27.244 INFO:teuthology.orchestra.run.smithi116.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 705 kB/s | 29 kB 00:00 2023-12-01T00:53:27.257 INFO:teuthology.orchestra.run.smithi093.stdout:(11/131): cephfs-mirror-18.2.0-1249.ga6f82997.e 1.5 MB/s | 258 kB 00:00 2023-12-01T00:53:27.286 INFO:teuthology.orchestra.run.smithi116.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 664 kB/s | 27 kB 00:00 2023-12-01T00:53:27.336 INFO:teuthology.orchestra.run.smithi116.stdout:(63/131): python3-waitress-1.4.3-1.el8.noarch.r 5.0 MB/s | 255 kB 00:00 2023-12-01T00:53:27.357 INFO:teuthology.orchestra.run.smithi093.stdout:(12/131): libcephfs-devel-18.2.0-1249.ga6f82997 309 kB/s | 31 kB 00:00 2023-12-01T00:53:27.387 INFO:teuthology.orchestra.run.smithi116.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.9 MB/s | 251 kB 00:00 2023-12-01T00:53:27.429 INFO:teuthology.orchestra.run.smithi116.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2023-12-01T00:53:27.471 INFO:teuthology.orchestra.run.smithi116.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 2.0 MB/s | 85 kB 00:00 2023-12-01T00:53:27.513 INFO:teuthology.orchestra.run.smithi116.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 553 kB/s | 23 kB 00:00 2023-12-01T00:53:27.588 INFO:teuthology.orchestra.run.smithi116.stdout:(68/131): thrift-0.13.0-2.el8.x86_64.rpm 23 MB/s | 1.7 MB 00:00 2023-12-01T00:53:27.613 INFO:teuthology.orchestra.run.smithi116.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-12-01T00:53:27.741 INFO:teuthology.orchestra.run.smithi093.stdout:(13/131): libcephfs2-18.2.0-1249.ga6f82997.el8. 2.0 MB/s | 774 kB 00:00 2023-12-01T00:53:27.908 INFO:teuthology.orchestra.run.smithi093.stdout:(14/131): ceph-radosgw-18.2.0-1249.ga6f82997.el 3.0 MB/s | 13 MB 00:04 2023-12-01T00:53:27.914 INFO:teuthology.orchestra.run.smithi116.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 46 MB/s | 14 MB 00:00 2023-12-01T00:53:27.933 INFO:teuthology.orchestra.run.smithi093.stdout:(15/131): libcephsqlite-18.2.0-1249.ga6f82997.e 738 kB/s | 141 kB 00:00 2023-12-01T00:53:27.964 INFO:teuthology.orchestra.run.smithi116.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.2 MB/s | 110 kB 00:00 2023-12-01T00:53:28.025 INFO:teuthology.orchestra.run.smithi093.stdout:(16/131): librados-devel-18.2.0-1249.ga6f82997. 1.2 MB/s | 139 kB 00:00 2023-12-01T00:53:28.046 INFO:teuthology.orchestra.run.smithi116.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 665 kB/s | 54 kB 00:00 2023-12-01T00:53:28.098 INFO:teuthology.orchestra.run.smithi116.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.9 MB/s | 259 kB 00:00 2023-12-01T00:53:28.148 INFO:teuthology.orchestra.run.smithi116.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-12-01T00:53:28.192 INFO:teuthology.orchestra.run.smithi093.stdout:(17/131): libradosstriper1-18.2.0-1249.ga6f8299 1.8 MB/s | 474 kB 00:00 2023-12-01T00:53:28.198 INFO:teuthology.orchestra.run.smithi116.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 779 kB/s | 39 kB 00:00 2023-12-01T00:53:28.257 INFO:teuthology.orchestra.run.smithi116.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-12-01T00:53:28.259 INFO:teuthology.orchestra.run.smithi093.stdout:(18/131): python3-ceph-argparse-18.2.0-1249.ga6 672 kB/s | 45 kB 00:00 2023-12-01T00:53:28.307 INFO:teuthology.orchestra.run.smithi116.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 10 MB/s | 538 kB 00:00 2023-12-01T00:53:28.326 INFO:teuthology.orchestra.run.smithi093.stdout:(19/131): python3-ceph-common-18.2.0-1249.ga6f8 1.8 MB/s | 123 kB 00:00 2023-12-01T00:53:28.355 INFO:teuthology.orchestra.run.smithi026.stdout:(8/131): ceph-radosgw-18.2.0-1249.ga6f82997.el8 8.9 MB/s | 13 MB 00:01 2023-12-01T00:53:28.357 INFO:teuthology.orchestra.run.smithi116.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-12-01T00:53:28.401 INFO:teuthology.orchestra.run.smithi093.stdout:(20/131): python3-cephfs-18.2.0-1249.ga6f82997. 2.6 MB/s | 196 kB 00:00 2023-12-01T00:53:28.408 INFO:teuthology.orchestra.run.smithi116.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-12-01T00:53:28.414 INFO:teuthology.orchestra.run.smithi026.stdout:(9/131): ceph-selinux-18.2.0-1249.ga6f82997.el8 418 kB/s | 24 kB 00:00 2023-12-01T00:53:28.467 INFO:teuthology.orchestra.run.smithi116.stdout:(80/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-12-01T00:53:28.521 INFO:teuthology.orchestra.run.smithi093.stdout:(21/131): python3-rados-18.2.0-1249.ga6f82997.e 3.1 MB/s | 371 kB 00:00 2023-12-01T00:53:28.593 INFO:teuthology.orchestra.run.smithi116.stdout:(81/131): python3-babel-2.5.1-7.el8.noarch.rpm 38 MB/s | 4.8 MB 00:00 2023-12-01T00:53:28.642 INFO:teuthology.orchestra.run.smithi116.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 534 kB/s | 27 kB 00:00 2023-12-01T00:53:28.661 INFO:teuthology.orchestra.run.smithi093.stdout:(22/131): python3-rbd-18.2.0-1249.ga6f82997.el8 2.5 MB/s | 364 kB 00:00 2023-12-01T00:53:28.693 INFO:teuthology.orchestra.run.smithi116.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 6.2 MB/s | 320 kB 00:00 2023-12-01T00:53:28.743 INFO:teuthology.orchestra.run.smithi116.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 882 kB/s | 44 kB 00:00 2023-12-01T00:53:28.745 INFO:teuthology.orchestra.run.smithi093.stdout:(23/131): python3-rgw-18.2.0-1249.ga6f82997.el8 1.3 MB/s | 107 kB 00:00 2023-12-01T00:53:28.811 INFO:teuthology.orchestra.run.smithi093.stdout:(24/131): rbd-fuse-18.2.0-1249.ga6f82997.el8.x8 1.4 MB/s | 94 kB 00:00 2023-12-01T00:53:28.860 INFO:teuthology.orchestra.run.smithi116.stdout:(85/131): python3-numpy-1.14.3-10.el8.x86_64.rp 32 MB/s | 3.7 MB 00:00 2023-12-01T00:53:28.910 INFO:teuthology.orchestra.run.smithi116.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 8.9 MB/s | 457 kB 00:00 2023-12-01T00:53:28.960 INFO:teuthology.orchestra.run.smithi116.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 4.4 MB/s | 225 kB 00:00 2023-12-01T00:53:29.011 INFO:teuthology.orchestra.run.smithi116.stdout:(88/131): uuid-1.6.2-43.el8.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2023-12-01T00:53:29.086 INFO:teuthology.orchestra.run.smithi116.stdout:(89/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.6 MB/s | 126 kB 00:00 2023-12-01T00:53:29.138 INFO:teuthology.orchestra.run.smithi116.stdout:(90/131): python3-jsonpointer-1.10-11.el8.noarc 399 kB/s | 20 kB 00:00 2023-12-01T00:53:29.187 INFO:teuthology.orchestra.run.smithi116.stdout:(91/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-12-01T00:53:29.245 INFO:teuthology.orchestra.run.smithi116.stdout:(92/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-12-01T00:53:29.379 INFO:teuthology.orchestra.run.smithi116.stdout:(93/131): openblas-threads-0.3.15-3.el8.x86_64. 36 MB/s | 4.9 MB 00:00 2023-12-01T00:53:29.421 INFO:teuthology.orchestra.run.smithi116.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-12-01T00:53:29.538 INFO:teuthology.orchestra.run.smithi116.stdout:(95/131): ceph-mgr-diskprediction-local-18.2.0- 1.8 MB/s | 7.4 MB 00:04 2023-12-01T00:53:29.727 INFO:teuthology.orchestra.run.smithi093.stdout:(25/131): rbd-mirror-18.2.0-1249.ga6f82997.el8. 3.8 MB/s | 3.4 MB 00:00 2023-12-01T00:53:29.946 INFO:teuthology.orchestra.run.smithi116.stdout:(96/131): ceph-test-18.2.0-1249.ga6f82997.el8.x 5.9 MB/s | 47 MB 00:07 2023-12-01T00:53:29.972 INFO:teuthology.orchestra.run.smithi116.stdout:(97/131): jq-1.6-3.el8.x86_64.rpm 466 kB/s | 202 kB 00:00 2023-12-01T00:53:30.053 INFO:teuthology.orchestra.run.smithi093.stdout:(26/131): rbd-nbd-18.2.0-1249.ga6f82997.el8.x86 557 kB/s | 181 kB 00:00 2023-12-01T00:53:30.084 INFO:teuthology.orchestra.run.smithi116.stdout:(98/131): openblas-0.3.15-3.el8.x86_64.rpm 7.1 MB/s | 4.7 MB 00:00 2023-12-01T00:53:30.095 INFO:teuthology.orchestra.run.smithi093.stdout:(27/131): ceph-grafana-dashboards-18.2.0-1249.g 556 kB/s | 23 kB 00:00 2023-12-01T00:53:30.122 INFO:teuthology.orchestra.run.smithi116.stdout:(99/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.0 MB/s | 354 kB 00:00 2023-12-01T00:53:30.173 INFO:teuthology.orchestra.run.smithi116.stdout:(100/131): postgresql-contrib-10.21-2.module+el 8.9 MB/s | 808 kB 00:00 2023-12-01T00:53:30.187 INFO:teuthology.orchestra.run.smithi093.stdout:(28/131): ceph-mgr-cephadm-18.2.0-1249.ga6f8299 1.4 MB/s | 132 kB 00:00 2023-12-01T00:53:30.231 INFO:teuthology.orchestra.run.smithi116.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 14 MB/s | 1.5 MB 00:00 2023-12-01T00:53:30.257 INFO:teuthology.orchestra.run.smithi116.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 561 kB/s | 47 kB 00:00 2023-12-01T00:53:30.282 INFO:teuthology.orchestra.run.smithi116.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 3.9 MB/s | 200 kB 00:00 2023-12-01T00:53:30.307 INFO:teuthology.orchestra.run.smithi116.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 848 kB/s | 43 kB 00:00 2023-12-01T00:53:30.332 INFO:teuthology.orchestra.run.smithi116.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-12-01T00:53:30.358 INFO:teuthology.orchestra.run.smithi116.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 960 kB/s | 48 kB 00:00 2023-12-01T00:53:30.383 INFO:teuthology.orchestra.run.smithi116.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-12-01T00:53:30.408 INFO:teuthology.orchestra.run.smithi116.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 852 kB/s | 43 kB 00:00 2023-12-01T00:53:30.425 INFO:teuthology.orchestra.run.smithi116.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.5 MB/s | 109 kB 00:00 2023-12-01T00:53:30.459 INFO:teuthology.orchestra.run.smithi116.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-12-01T00:53:30.492 INFO:teuthology.orchestra.run.smithi116.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 8.2 MB/s | 560 kB 00:00 2023-12-01T00:53:30.518 INFO:teuthology.orchestra.run.smithi116.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 319 kB/s | 19 kB 00:00 2023-12-01T00:53:30.543 INFO:teuthology.orchestra.run.smithi116.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-12-01T00:53:30.588 INFO:teuthology.orchestra.run.smithi093.stdout:(29/131): librgw2-18.2.0-1249.ga6f82997.el8.x86 2.6 MB/s | 6.6 MB 00:02 2023-12-01T00:53:30.602 INFO:teuthology.orchestra.run.smithi116.stdout:(114/131): postgresql-server-10.21-2.module+el8 8.1 MB/s | 5.1 MB 00:00 2023-12-01T00:53:30.627 INFO:teuthology.orchestra.run.smithi116.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 214 kB/s | 18 kB 00:00 2023-12-01T00:53:30.669 INFO:teuthology.orchestra.run.smithi116.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.6 MB/s | 559 kB 00:00 2023-12-01T00:53:30.680 INFO:teuthology.orchestra.run.smithi093.stdout:(30/131): ceph-mgr-dashboard-18.2.0-1249.ga6f82 3.6 MB/s | 1.8 MB 00:00 2023-12-01T00:53:30.702 INFO:teuthology.orchestra.run.smithi116.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.9 MB/s | 605 kB 00:00 2023-12-01T00:53:30.728 INFO:teuthology.orchestra.run.smithi116.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.3 MB/s | 238 kB 00:00 2023-12-01T00:53:30.753 INFO:teuthology.orchestra.run.smithi116.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-12-01T00:53:30.778 INFO:teuthology.orchestra.run.smithi116.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-12-01T00:53:30.796 INFO:teuthology.orchestra.run.smithi093.stdout:(31/131): ceph-mgr-modules-core-18.2.0-1249.ga6 2.0 MB/s | 242 kB 00:00 2023-12-01T00:53:30.804 INFO:teuthology.orchestra.run.smithi116.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-12-01T00:53:30.829 INFO:teuthology.orchestra.run.smithi116.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-12-01T00:53:30.854 INFO:teuthology.orchestra.run.smithi116.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-12-01T00:53:30.855 INFO:teuthology.orchestra.run.smithi093.stdout:(32/131): ceph-mgr-rook-18.2.0-1249.ga6f82997.e 863 kB/s | 50 kB 00:00 2023-12-01T00:53:30.879 INFO:teuthology.orchestra.run.smithi116.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 770 kB/s | 39 kB 00:00 2023-12-01T00:53:30.913 INFO:teuthology.orchestra.run.smithi093.stdout:(33/131): ceph-prometheus-alerts-18.2.0-1249.ga 249 kB/s | 15 kB 00:00 2023-12-01T00:53:30.921 INFO:teuthology.orchestra.run.smithi116.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-12-01T00:53:30.947 INFO:teuthology.orchestra.run.smithi116.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-12-01T00:53:30.972 INFO:teuthology.orchestra.run.smithi116.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-12-01T00:53:31.022 INFO:teuthology.orchestra.run.smithi116.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.6 MB/s | 2.3 MB 00:00 2023-12-01T00:53:31.030 INFO:teuthology.orchestra.run.smithi093.stdout:(34/131): ceph-volume-18.2.0-1249.ga6f82997.el8 2.2 MB/s | 262 kB 00:00 2023-12-01T00:53:31.081 INFO:teuthology.orchestra.run.smithi116.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 13 MB/s | 798 kB 00:00 2023-12-01T00:53:31.097 INFO:teuthology.orchestra.run.smithi093.stdout:(35/131): cephadm-18.2.0-1249.ga6f82997.el8.noa 2.5 MB/s | 168 kB 00:00 2023-12-01T00:53:31.164 INFO:teuthology.orchestra.run.smithi093.stdout:(36/131): cephfs-top-18.2.0-1249.ga6f82997.el8. 270 kB/s | 18 kB 00:00 2023-12-01T00:53:31.306 INFO:teuthology.orchestra.run.smithi093.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 2.1 MB/s | 306 kB 00:00 2023-12-01T00:53:31.348 INFO:teuthology.orchestra.run.smithi093.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2023-12-01T00:53:31.390 INFO:teuthology.orchestra.run.smithi093.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.8 MB/s | 75 kB 00:00 2023-12-01T00:53:31.457 INFO:teuthology.orchestra.run.smithi093.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 7.0 MB/s | 476 kB 00:00 2023-12-01T00:53:31.499 INFO:teuthology.orchestra.run.smithi093.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2023-12-01T00:53:31.541 INFO:teuthology.orchestra.run.smithi093.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 4.4 MB/s | 185 kB 00:00 2023-12-01T00:53:31.583 INFO:teuthology.orchestra.run.smithi093.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 792 kB/s | 33 kB 00:00 2023-12-01T00:53:31.625 INFO:teuthology.orchestra.run.smithi093.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 394 kB/s | 16 kB 00:00 2023-12-01T00:53:31.667 INFO:teuthology.orchestra.run.smithi093.stdout:(45/131): python3-cheroot-8.5.2-1.el8.noarch.rp 4.1 MB/s | 173 kB 00:00 2023-12-01T00:53:31.726 INFO:teuthology.orchestra.run.smithi093.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 6.4 MB/s | 384 kB 00:00 2023-12-01T00:53:31.767 INFO:teuthology.orchestra.run.smithi093.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 1.9 MB/s | 81 kB 00:00 2023-12-01T00:53:31.809 INFO:teuthology.orchestra.run.smithi093.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 267 kB/s | 11 kB 00:00 2023-12-01T00:53:31.939 INFO:teuthology.orchestra.run.smithi116.stdout:(130/131): librbd1-18.2.0-1249.ga6f82997.el8.x8 3.7 MB/s | 3.6 MB 00:00 2023-12-01T00:53:32.093 INFO:teuthology.orchestra.run.smithi093.stdout:(49/131): python3-jaraco-functools-2.0-4.el8.no 62 kB/s | 18 kB 00:00 2023-12-01T00:53:32.185 INFO:teuthology.orchestra.run.smithi093.stdout:(50/131): python3-kubernetes-11.0.0-6.el8.noarc 13 MB/s | 1.2 MB 00:00 2023-12-01T00:53:32.252 INFO:teuthology.orchestra.run.smithi093.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 734 kB/s | 49 kB 00:00 2023-12-01T00:53:32.294 INFO:teuthology.orchestra.run.smithi093.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 1.4 MB/s | 59 kB 00:00 2023-12-01T00:53:32.336 INFO:teuthology.orchestra.run.smithi093.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.4 MB/s | 60 kB 00:00 2023-12-01T00:53:32.378 INFO:teuthology.orchestra.run.smithi093.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 6.7 MB/s | 283 kB 00:00 2023-12-01T00:53:32.421 INFO:teuthology.orchestra.run.smithi093.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 375 kB/s | 16 kB 00:00 2023-12-01T00:53:32.462 INFO:teuthology.orchestra.run.smithi093.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 809 kB/s | 34 kB 00:00 2023-12-01T00:53:32.504 INFO:teuthology.orchestra.run.smithi093.stdout:(57/131): python3-routes-2.4.1-12.el8.noarch.rp 4.6 MB/s | 196 kB 00:00 2023-12-01T00:53:32.523 INFO:teuthology.orchestra.run.smithi116.stdout:(131/131): librados2-18.2.0-1249.ga6f82997.el8. 2.3 MB/s | 3.7 MB 00:01 2023-12-01T00:53:32.526 INFO:teuthology.orchestra.run.smithi116.stdout:-------------------------------------------------------------------------------- 2023-12-01T00:53:32.526 INFO:teuthology.orchestra.run.smithi116.stdout:Total 15 MB/s | 203 MB 00:13 2023-12-01T00:53:32.538 INFO:teuthology.orchestra.run.smithi093.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 1.9 MB/s | 64 kB 00:00 2023-12-01T00:53:32.571 INFO:teuthology.orchestra.run.smithi093.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 563 kB/s | 19 kB 00:00 2023-12-01T00:53:32.605 INFO:teuthology.orchestra.run.smithi093.stdout:(60/131): python3-singledispatch-3.4.0.3-18.el8 720 kB/s | 24 kB 00:00 2023-12-01T00:53:32.638 INFO:teuthology.orchestra.run.smithi093.stdout:(61/131): python3-tempora-1.14.1-5.el8.noarch.r 882 kB/s | 29 kB 00:00 2023-12-01T00:53:32.680 INFO:teuthology.orchestra.run.smithi093.stdout:(62/131): python3-trustme-0.6.0-4.el8.noarch.rp 665 kB/s | 27 kB 00:00 2023-12-01T00:53:32.722 INFO:teuthology.orchestra.run.smithi093.stdout:(63/131): python3-waitress-1.4.3-1.el8.noarch.r 6.0 MB/s | 255 kB 00:00 2023-12-01T00:53:32.781 INFO:teuthology.orchestra.run.smithi093.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 4.2 MB/s | 251 kB 00:00 2023-12-01T00:53:32.823 INFO:teuthology.orchestra.run.smithi093.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 1.4 MB/s | 61 kB 00:00 2023-12-01T00:53:32.881 INFO:teuthology.orchestra.run.smithi093.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2023-12-01T00:53:32.932 INFO:teuthology.orchestra.run.smithi093.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 458 kB/s | 23 kB 00:00 2023-12-01T00:53:33.065 INFO:teuthology.orchestra.run.smithi093.stdout:(68/131): thrift-0.13.0-2.el8.x86_64.rpm 13 MB/s | 1.7 MB 00:00 2023-12-01T00:53:33.072 INFO:teuthology.orchestra.run.smithi026.stdout:(10/131): ceph-test-18.2.0-1249.ga6f82997.el8.x 10 MB/s | 47 MB 00:04 2023-12-01T00:53:33.149 INFO:teuthology.orchestra.run.smithi093.stdout:(69/131): ceph-mgr-diskprediction-local-18.2.0- 2.9 MB/s | 7.4 MB 00:02 2023-12-01T00:53:33.174 INFO:teuthology.orchestra.run.smithi093.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 641 kB/s | 70 kB 00:00 2023-12-01T00:53:33.225 INFO:teuthology.orchestra.run.smithi093.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 624 kB/s | 47 kB 00:00 2023-12-01T00:53:33.241 INFO:teuthology.orchestra.run.smithi093.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.9 MB/s | 200 kB 00:00 2023-12-01T00:53:33.267 INFO:teuthology.orchestra.run.smithi093.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-12-01T00:53:33.292 INFO:teuthology.orchestra.run.smithi093.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-12-01T00:53:33.297 INFO:teuthology.orchestra.run.smithi026.stdout:(11/131): ceph-common-18.2.0-1249.ga6f82997.el8 2.3 MB/s | 22 MB 00:09 2023-12-01T00:53:33.317 INFO:teuthology.orchestra.run.smithi093.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 963 kB/s | 48 kB 00:00 2023-12-01T00:53:33.322 INFO:teuthology.orchestra.run.smithi026.stdout:(12/131): cephfs-mirror-18.2.0-1249.ga6f82997.e 1.0 MB/s | 258 kB 00:00 2023-12-01T00:53:33.338 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction check 2023-12-01T00:53:33.342 INFO:teuthology.orchestra.run.smithi093.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-12-01T00:53:33.347 INFO:teuthology.orchestra.run.smithi026.stdout:(13/131): libcephfs-devel-18.2.0-1249.ga6f82997 619 kB/s | 31 kB 00:00 2023-12-01T00:53:33.368 INFO:teuthology.orchestra.run.smithi093.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 849 kB/s | 43 kB 00:00 2023-12-01T00:53:33.393 INFO:teuthology.orchestra.run.smithi093.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-12-01T00:53:33.415 INFO:teuthology.orchestra.run.smithi026.stdout:(14/131): libcephsqlite-18.2.0-1249.ga6f82997.e 2.1 MB/s | 141 kB 00:00 2023-12-01T00:53:33.418 INFO:teuthology.orchestra.run.smithi093.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-12-01T00:53:33.457 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction check succeeded. 2023-12-01T00:53:33.457 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction test 2023-12-01T00:53:33.460 INFO:teuthology.orchestra.run.smithi093.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 8.2 MB/s | 560 kB 00:00 2023-12-01T00:53:33.465 INFO:teuthology.orchestra.run.smithi026.stdout:(15/131): librados-devel-18.2.0-1249.ga6f82997. 2.7 MB/s | 139 kB 00:00 2023-12-01T00:53:33.486 INFO:teuthology.orchestra.run.smithi093.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 279 kB/s | 19 kB 00:00 2023-12-01T00:53:33.498 INFO:teuthology.orchestra.run.smithi026.stdout:(16/131): libcephfs2-18.2.0-1249.ga6f82997.el8. 4.3 MB/s | 774 kB 00:00 2023-12-01T00:53:33.511 INFO:teuthology.orchestra.run.smithi093.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-12-01T00:53:33.545 INFO:teuthology.orchestra.run.smithi093.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 9.3 MB/s | 559 kB 00:00 2023-12-01T00:53:33.570 INFO:teuthology.orchestra.run.smithi093.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 306 kB/s | 18 kB 00:00 2023-12-01T00:53:33.582 INFO:teuthology.orchestra.run.smithi026.stdout:(17/131): libradosstriper1-18.2.0-1249.ga6f8299 4.0 MB/s | 474 kB 00:00 2023-12-01T00:53:33.612 INFO:teuthology.orchestra.run.smithi093.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 8.9 MB/s | 605 kB 00:00 2023-12-01T00:53:33.637 INFO:teuthology.orchestra.run.smithi093.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-12-01T00:53:33.641 INFO:teuthology.orchestra.run.smithi026.stdout:(18/131): python3-ceph-argparse-18.2.0-1249.ga6 766 kB/s | 45 kB 00:00 2023-12-01T00:53:33.671 INFO:teuthology.orchestra.run.smithi093.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 2.1 MB/s | 72 kB 00:00 2023-12-01T00:53:33.708 INFO:teuthology.orchestra.run.smithi026.stdout:(19/131): python3-ceph-common-18.2.0-1249.ga6f8 1.8 MB/s | 123 kB 00:00 2023-12-01T00:53:33.777 INFO:teuthology.orchestra.run.smithi026.stdout:(20/131): python3-cephfs-18.2.0-1249.ga6f82997. 2.9 MB/s | 196 kB 00:00 2023-12-01T00:53:33.867 INFO:teuthology.orchestra.run.smithi026.stdout:(21/131): python3-rados-18.2.0-1249.ga6f82997.e 4.0 MB/s | 371 kB 00:00 2023-12-01T00:53:33.959 INFO:teuthology.orchestra.run.smithi026.stdout:(22/131): python3-rbd-18.2.0-1249.ga6f82997.el8 3.9 MB/s | 364 kB 00:00 2023-12-01T00:53:34.009 INFO:teuthology.orchestra.run.smithi026.stdout:(23/131): python3-rgw-18.2.0-1249.ga6f82997.el8 2.1 MB/s | 107 kB 00:00 2023-12-01T00:53:34.043 INFO:teuthology.orchestra.run.smithi026.stdout:(24/131): rbd-fuse-18.2.0-1249.ga6f82997.el8.x8 2.8 MB/s | 94 kB 00:00 2023-12-01T00:53:34.105 INFO:teuthology.orchestra.run.smithi093.stdout:(88/131): ceph-test-18.2.0-1249.ga6f82997.el8.x 5.9 MB/s | 47 MB 00:07 2023-12-01T00:53:34.130 INFO:teuthology.orchestra.run.smithi093.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 180 kB/s | 83 kB 00:00 2023-12-01T00:53:34.189 INFO:teuthology.orchestra.run.smithi093.stdout:(90/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 4.0 MB/s | 2.3 MB 00:00 2023-12-01T00:53:34.214 INFO:teuthology.orchestra.run.smithi093.stdout:(91/131): elfutils-libelf-devel-0.186-1.el8.x86 552 kB/s | 60 kB 00:00 2023-12-01T00:53:34.239 INFO:teuthology.orchestra.run.smithi093.stdout:(92/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 950 kB/s | 98 kB 00:00 2023-12-01T00:53:34.264 INFO:teuthology.orchestra.run.smithi093.stdout:(93/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 764 kB/s | 58 kB 00:00 2023-12-01T00:53:34.290 INFO:teuthology.orchestra.run.smithi093.stdout:(94/131): libcom_err-devel-1.45.6-4.el8.x86_64. 512 kB/s | 39 kB 00:00 2023-12-01T00:53:34.315 INFO:teuthology.orchestra.run.smithi093.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 3.3 MB/s | 171 kB 00:00 2023-12-01T00:53:34.340 INFO:teuthology.orchestra.run.smithi093.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-12-01T00:53:34.374 INFO:teuthology.orchestra.run.smithi093.stdout:(97/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 4.7 MB/s | 644 kB 00:00 2023-12-01T00:53:34.399 INFO:teuthology.orchestra.run.smithi093.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-12-01T00:53:34.418 INFO:teuthology.orchestra.run.smithi026.stdout:(25/131): librgw2-18.2.0-1249.ga6f82997.el8.x86 7.1 MB/s | 6.6 MB 00:00 2023-12-01T00:53:34.424 INFO:teuthology.orchestra.run.smithi093.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2023-12-01T00:53:34.449 INFO:teuthology.orchestra.run.smithi093.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-12-01T00:53:34.483 INFO:teuthology.orchestra.run.smithi093.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-12-01T00:53:34.508 INFO:teuthology.orchestra.run.smithi093.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 663 kB/s | 39 kB 00:00 2023-12-01T00:53:34.518 INFO:teuthology.orchestra.run.smithi026.stdout:(26/131): rbd-nbd-18.2.0-1249.ga6f82997.el8.x86 1.8 MB/s | 181 kB 00:00 2023-12-01T00:53:34.550 INFO:teuthology.orchestra.run.smithi093.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-12-01T00:53:34.561 INFO:teuthology.orchestra.run.smithi116.stdout:Transaction test succeeded. 2023-12-01T00:53:34.565 INFO:teuthology.orchestra.run.smithi116.stdout:Running transaction 2023-12-01T00:53:34.577 INFO:teuthology.orchestra.run.smithi026.stdout:(27/131): rbd-mirror-18.2.0-1249.ga6f82997.el8. 6.5 MB/s | 3.4 MB 00:00 2023-12-01T00:53:34.584 INFO:teuthology.orchestra.run.smithi093.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.0 MB/s | 538 kB 00:00 2023-12-01T00:53:34.609 INFO:teuthology.orchestra.run.smithi093.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-12-01T00:53:34.610 INFO:teuthology.orchestra.run.smithi026.stdout:(28/131): ceph-grafana-dashboards-18.2.0-1249.g 251 kB/s | 23 kB 00:00 2023-12-01T00:53:34.628 INFO:teuthology.orchestra.run.smithi026.stdout:(29/131): ceph-mgr-cephadm-18.2.0-1249.ga6f8299 2.6 MB/s | 132 kB 00:00 2023-12-01T00:53:34.634 INFO:teuthology.orchestra.run.smithi093.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-12-01T00:53:34.676 INFO:teuthology.orchestra.run.smithi093.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-12-01T00:53:34.710 INFO:teuthology.orchestra.run.smithi093.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 795 kB/s | 27 kB 00:00 2023-12-01T00:53:34.752 INFO:teuthology.orchestra.run.smithi093.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-12-01T00:53:34.777 INFO:teuthology.orchestra.run.smithi093.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.7 MB/s | 44 kB 00:00 2023-12-01T00:53:34.861 INFO:teuthology.orchestra.run.smithi093.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-12-01T00:53:34.911 INFO:teuthology.orchestra.run.smithi093.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-12-01T00:53:34.919 INFO:teuthology.orchestra.run.smithi026.stdout:(30/131): ceph-mgr-dashboard-18.2.0-1249.ga6f82 5.7 MB/s | 1.8 MB 00:00 2023-12-01T00:53:34.944 INFO:teuthology.orchestra.run.smithi093.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 6.6 MB/s | 225 kB 00:00 2023-12-01T00:53:35.003 INFO:teuthology.orchestra.run.smithi093.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 17 MB/s | 3.7 MB 00:00 2023-12-01T00:53:35.020 INFO:teuthology.orchestra.run.smithi093.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 852 kB/s | 64 kB 00:00 2023-12-01T00:53:35.028 INFO:teuthology.orchestra.run.smithi026.stdout:(31/131): ceph-mgr-modules-core-18.2.0-1249.ga6 2.2 MB/s | 242 kB 00:00 2023-12-01T00:53:35.045 INFO:teuthology.orchestra.run.smithi093.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.0 MB/s | 126 kB 00:00 2023-12-01T00:53:35.071 INFO:teuthology.orchestra.run.smithi093.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 395 kB/s | 20 kB 00:00 2023-12-01T00:53:35.095 INFO:teuthology.orchestra.run.smithi026.stdout:(32/131): ceph-mgr-rook-18.2.0-1249.ga6f82997.e 753 kB/s | 50 kB 00:00 2023-12-01T00:53:35.096 INFO:teuthology.orchestra.run.smithi093.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-12-01T00:53:35.130 INFO:teuthology.orchestra.run.smithi093.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-12-01T00:53:35.170 INFO:teuthology.orchestra.run.smithi026.stdout:(33/131): ceph-prometheus-alerts-18.2.0-1249.ga 194 kB/s | 15 kB 00:00 2023-12-01T00:53:35.171 INFO:teuthology.orchestra.run.smithi093.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-12-01T00:53:35.262 INFO:teuthology.orchestra.run.smithi026.stdout:(34/131): ceph-volume-18.2.0-1249.ga6f82997.el8 2.8 MB/s | 262 kB 00:00 2023-12-01T00:53:35.305 INFO:teuthology.orchestra.run.smithi093.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 14 MB/s | 14 MB 00:00 2023-12-01T00:53:35.347 INFO:teuthology.orchestra.run.smithi093.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-12-01T00:53:35.354 INFO:teuthology.orchestra.run.smithi026.stdout:(35/131): cephadm-18.2.0-1249.ga6f82997.el8.noa 1.8 MB/s | 168 kB 00:00 2023-12-01T00:53:35.389 INFO:teuthology.orchestra.run.smithi093.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-12-01T00:53:35.446 INFO:teuthology.orchestra.run.smithi026.stdout:(36/131): cephfs-top-18.2.0-1249.ga6f82997.el8. 196 kB/s | 18 kB 00:00 2023-12-01T00:53:35.514 INFO:teuthology.orchestra.run.smithi093.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 12 MB/s | 4.9 MB 00:00 2023-12-01T00:53:35.596 INFO:teuthology.orchestra.run.smithi026.stdout:(37/131): ceph-mgr-diskprediction-local-18.2.0- 7.6 MB/s | 7.4 MB 00:00 2023-12-01T00:53:35.598 INFO:teuthology.orchestra.run.smithi093.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2023-12-01T00:53:35.632 INFO:teuthology.orchestra.run.smithi093.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-12-01T00:53:35.682 INFO:teuthology.orchestra.run.smithi093.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 18 MB/s | 1.5 MB 00:00 2023-12-01T00:53:35.713 INFO:teuthology.orchestra.run.smithi026.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 505 kB/s | 59 kB 00:00 2023-12-01T00:53:35.739 INFO:teuthology.orchestra.run.smithi026.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.0 MB/s | 306 kB 00:00 2023-12-01T00:53:35.772 INFO:teuthology.orchestra.run.smithi026.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 1.3 MB/s | 75 kB 00:00 2023-12-01T00:53:35.782 INFO:teuthology.orchestra.run.smithi093.stdout:(128/131): postgresql-server-10.21-2.module+el8 13 MB/s | 5.1 MB 00:00 2023-12-01T00:53:35.814 INFO:teuthology.orchestra.run.smithi026.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 6.2 MB/s | 476 kB 00:00 2023-12-01T00:53:35.832 INFO:teuthology.orchestra.run.smithi093.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-12-01T00:53:35.839 INFO:teuthology.orchestra.run.smithi026.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 651 kB/s | 44 kB 00:00 2023-12-01T00:53:35.865 INFO:teuthology.orchestra.run.smithi026.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 3.6 MB/s | 185 kB 00:00 2023-12-01T00:53:35.890 INFO:teuthology.orchestra.run.smithi026.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 658 kB/s | 33 kB 00:00 2023-12-01T00:53:35.915 INFO:teuthology.orchestra.run.smithi026.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 324 kB/s | 16 kB 00:00 2023-12-01T00:53:35.949 INFO:teuthology.orchestra.run.smithi026.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.9 MB/s | 173 kB 00:00 2023-12-01T00:53:36.091 INFO:teuthology.orchestra.run.smithi093.stdout:(130/131): librados2-18.2.0-1249.ga6f82997.el8. 8.0 MB/s | 3.7 MB 00:00 2023-12-01T00:53:36.125 INFO:teuthology.orchestra.run.smithi026.stdout:(47/131): ceph-osd-18.2.0-1249.ga6f82997.el8.x8 1.9 MB/s | 18 MB 00:09 2023-12-01T00:53:36.230 INFO:teuthology.orchestra.run.smithi026.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 290 kB/s | 81 kB 00:00 2023-12-01T00:53:36.342 INFO:teuthology.orchestra.run.smithi026.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 903 kB/s | 384 kB 00:00 2023-12-01T00:53:36.367 INFO:teuthology.orchestra.run.smithi026.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 46 kB/s | 11 kB 00:00 2023-12-01T00:53:36.392 INFO:teuthology.orchestra.run.smithi026.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 108 kB/s | 18 kB 00:00 2023-12-01T00:53:36.418 INFO:teuthology.orchestra.run.smithi026.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 969 kB/s | 49 kB 00:00 2023-12-01T00:53:36.460 INFO:teuthology.orchestra.run.smithi026.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 9.9 MB/s | 1.2 MB 00:00 2023-12-01T00:53:36.485 INFO:teuthology.orchestra.run.smithi026.stdout:(54/131): python3-more-itertools-7.2.0-3.el8.no 637 kB/s | 59 kB 00:00 2023-12-01T00:53:36.510 INFO:teuthology.orchestra.run.smithi026.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 655 kB/s | 60 kB 00:00 2023-12-01T00:53:36.536 INFO:teuthology.orchestra.run.smithi026.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2023-12-01T00:53:36.586 INFO:teuthology.orchestra.run.smithi026.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 447 kB/s | 34 kB 00:00 2023-12-01T00:53:36.611 INFO:teuthology.orchestra.run.smithi026.stdout:(58/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2023-12-01T00:53:36.636 INFO:teuthology.orchestra.run.smithi026.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-12-01T00:53:36.662 INFO:teuthology.orchestra.run.smithi026.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 852 kB/s | 64 kB 00:00 2023-12-01T00:53:36.687 INFO:teuthology.orchestra.run.smithi026.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 248 kB/s | 19 kB 00:00 2023-12-01T00:53:36.713 INFO:teuthology.orchestra.run.smithi026.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 479 kB/s | 24 kB 00:00 2023-12-01T00:53:36.737 INFO:teuthology.orchestra.run.smithi026.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 390 kB/s | 29 kB 00:00 2023-12-01T00:53:36.741 INFO:teuthology.orchestra.run.smithi093.stdout:(131/131): librbd1-18.2.0-1249.ga6f82997.el8.x8 3.4 MB/s | 3.6 MB 00:01 2023-12-01T00:53:36.744 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2023-12-01T00:53:36.744 INFO:teuthology.orchestra.run.smithi093.stdout:Total 12 MB/s | 203 MB 00:16 2023-12-01T00:53:36.762 INFO:teuthology.orchestra.run.smithi026.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 365 kB/s | 27 kB 00:00 2023-12-01T00:53:36.796 INFO:teuthology.orchestra.run.smithi026.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 4.3 MB/s | 255 kB 00:00 2023-12-01T00:53:36.821 INFO:teuthology.orchestra.run.smithi026.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-12-01T00:53:36.847 INFO:teuthology.orchestra.run.smithi026.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-12-01T00:53:36.872 INFO:teuthology.orchestra.run.smithi026.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 458 kB/s | 23 kB 00:00 2023-12-01T00:53:36.897 INFO:teuthology.orchestra.run.smithi026.stdout:(69/131): python3-webtest-2.0.33-1.el8.noarch.r 849 kB/s | 85 kB 00:00 2023-12-01T00:53:36.914 INFO:teuthology.orchestra.run.smithi026.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-12-01T00:53:36.989 INFO:teuthology.orchestra.run.smithi026.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2023-12-01T00:53:37.023 INFO:teuthology.orchestra.run.smithi026.stdout:(72/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 374 kB/s | 47 kB 00:00 2023-12-01T00:53:37.057 INFO:teuthology.orchestra.run.smithi026.stdout:(73/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.5 MB/s | 200 kB 00:00 2023-12-01T00:53:37.082 INFO:teuthology.orchestra.run.smithi026.stdout:(74/131): python3-jwt-1.6.1-2.el8.noarch.rpm 509 kB/s | 43 kB 00:00 2023-12-01T00:53:37.107 INFO:teuthology.orchestra.run.smithi026.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 959 kB/s | 48 kB 00:00 2023-12-01T00:53:37.158 INFO:teuthology.orchestra.run.smithi026.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2023-12-01T00:53:37.183 INFO:teuthology.orchestra.run.smithi026.stdout:(77/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2023-12-01T00:53:37.200 INFO:teuthology.orchestra.run.smithi026.stdout:(78/131): python3-requests-oauthlib-1.0.0-1.el8 462 kB/s | 43 kB 00:00 2023-12-01T00:53:37.225 INFO:teuthology.orchestra.run.smithi026.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2023-12-01T00:53:37.250 INFO:teuthology.orchestra.run.smithi026.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.3 MB/s | 229 kB 00:00 2023-12-01T00:53:37.267 INFO:teuthology.orchestra.run.smithi026.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 449 kB/s | 19 kB 00:00 2023-12-01T00:53:37.293 INFO:teuthology.orchestra.run.smithi026.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2023-12-01T00:53:37.326 INFO:teuthology.orchestra.run.smithi026.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.3 MB/s | 560 kB 00:00 2023-12-01T00:53:37.352 INFO:teuthology.orchestra.run.smithi026.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 305 kB/s | 18 kB 00:00 2023-12-01T00:53:37.385 INFO:teuthology.orchestra.run.smithi026.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.6 MB/s | 559 kB 00:00 2023-12-01T00:53:37.411 INFO:teuthology.orchestra.run.smithi026.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-12-01T00:53:37.444 INFO:teuthology.orchestra.run.smithi026.stdout:(87/131): pcre2-devel-10.32-2.el8.x86_64.rpm 5.0 MB/s | 605 kB 00:00 2023-12-01T00:53:37.470 INFO:teuthology.orchestra.run.smithi026.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.2 MB/s | 72 kB 00:00 2023-12-01T00:53:37.495 INFO:teuthology.orchestra.run.smithi026.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-12-01T00:53:37.520 INFO:teuthology.orchestra.run.smithi026.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-12-01T00:53:37.546 INFO:teuthology.orchestra.run.smithi026.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-12-01T00:53:37.571 INFO:teuthology.orchestra.run.smithi026.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-12-01T00:53:37.573 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2023-12-01T00:53:37.596 INFO:teuthology.orchestra.run.smithi026.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 772 kB/s | 39 kB 00:00 2023-12-01T00:53:37.638 INFO:teuthology.orchestra.run.smithi026.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.4 MB/s | 644 kB 00:00 2023-12-01T00:53:37.663 INFO:teuthology.orchestra.run.smithi026.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-12-01T00:53:37.688 INFO:teuthology.orchestra.run.smithi026.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-12-01T00:53:37.693 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2023-12-01T00:53:37.693 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2023-12-01T00:53:37.739 INFO:teuthology.orchestra.run.smithi026.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.2 MB/s | 110 kB 00:00 2023-12-01T00:53:37.789 INFO:teuthology.orchestra.run.smithi026.stdout:(98/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 5.8 MB/s | 2.3 MB 00:00 2023-12-01T00:53:37.814 INFO:teuthology.orchestra.run.smithi026.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 720 kB/s | 54 kB 00:00 2023-12-01T00:53:37.848 INFO:teuthology.orchestra.run.smithi026.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-12-01T00:53:37.881 INFO:teuthology.orchestra.run.smithi026.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-12-01T00:53:37.907 INFO:teuthology.orchestra.run.smithi026.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 662 kB/s | 39 kB 00:00 2023-12-01T00:53:37.949 INFO:teuthology.orchestra.run.smithi026.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-12-01T00:53:37.982 INFO:teuthology.orchestra.run.smithi026.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.0 MB/s | 538 kB 00:00 2023-12-01T00:53:38.016 INFO:teuthology.orchestra.run.smithi026.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-12-01T00:53:38.033 INFO:teuthology.orchestra.run.smithi026.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-12-01T00:53:38.083 INFO:teuthology.orchestra.run.smithi026.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-12-01T00:53:38.117 INFO:teuthology.orchestra.run.smithi026.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 804 kB/s | 27 kB 00:00 2023-12-01T00:53:38.176 INFO:teuthology.orchestra.run.smithi026.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 5.3 MB/s | 320 kB 00:00 2023-12-01T00:53:38.209 INFO:teuthology.orchestra.run.smithi026.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-12-01T00:53:38.343 INFO:teuthology.orchestra.run.smithi026.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-12-01T00:53:38.393 INFO:teuthology.orchestra.run.smithi026.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-12-01T00:53:38.435 INFO:teuthology.orchestra.run.smithi026.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-12-01T00:53:38.460 INFO:teuthology.orchestra.run.smithi026.stdout:(114/131): uuid-1.6.2-43.el8.x86_64.rpm 2.5 MB/s | 64 kB 00:00 2023-12-01T00:53:38.510 INFO:teuthology.orchestra.run.smithi026.stdout:(115/131): python3-numpy-1.14.3-10.el8.x86_64.r 12 MB/s | 3.7 MB 00:00 2023-12-01T00:53:38.536 INFO:teuthology.orchestra.run.smithi026.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.6 MB/s | 126 kB 00:00 2023-12-01T00:53:38.553 INFO:teuthology.orchestra.run.smithi026.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 477 kB/s | 20 kB 00:00 2023-12-01T00:53:38.578 INFO:teuthology.orchestra.run.smithi026.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2023-12-01T00:53:38.620 INFO:teuthology.orchestra.run.smithi026.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-12-01T00:53:38.662 INFO:teuthology.orchestra.run.smithi026.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-12-01T00:53:38.804 INFO:teuthology.orchestra.run.smithi026.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 12 MB/s | 14 MB 00:01 2023-12-01T00:53:38.806 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2023-12-01T00:53:38.810 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2023-12-01T00:53:38.866 INFO:teuthology.orchestra.run.smithi026.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 3.2 MB/s | 202 kB 00:00 2023-12-01T00:53:38.913 INFO:teuthology.orchestra.run.smithi026.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 7.4 MB/s | 354 kB 00:00 2023-12-01T00:53:39.005 INFO:teuthology.orchestra.run.smithi026.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 11 MB/s | 4.9 MB 00:00 2023-12-01T00:53:39.080 INFO:teuthology.orchestra.run.smithi026.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 11 MB/s | 4.7 MB 00:00 2023-12-01T00:53:39.189 INFO:teuthology.orchestra.run.smithi026.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.8 MB/s | 808 kB 00:00 2023-12-01T00:53:39.189 INFO:teuthology.orchestra.run.smithi026.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 15 MB/s | 1.5 MB 00:00 2023-12-01T00:53:39.264 INFO:teuthology.orchestra.run.smithi026.stdout:(128/131): postgresql-server-10.21-2.module+el8 14 MB/s | 5.1 MB 00:00 2023-12-01T00:53:39.314 INFO:teuthology.orchestra.run.smithi026.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-12-01T00:53:39.626 INFO:teuthology.orchestra.run.smithi116.stdout: Preparing : 1/1 2023-12-01T00:53:39.825 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-12-01T00:53:39.999 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-12-01T00:53:40.208 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-12-01T00:53:40.298 INFO:teuthology.orchestra.run.smithi026.stdout:(130/131): librbd1-18.2.0-1249.ga6f82997.el8.x8 3.2 MB/s | 3.6 MB 00:01 2023-12-01T00:53:40.393 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-12-01T00:53:40.481 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-12-01T00:53:40.718 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-12-01T00:53:41.122 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-12-01T00:53:41.347 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librados2-2:18.2.0-1249.ga6f82997.el8.x86_64 6/134 2023-12-01T00:53:41.556 INFO:teuthology.orchestra.run.smithi026.stdout:(131/131): librados2-18.2.0-1249.ga6f82997.el8. 1.5 MB/s | 3.7 MB 00:02 2023-12-01T00:53:41.559 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2023-12-01T00:53:41.559 INFO:teuthology.orchestra.run.smithi026.stdout:Total 11 MB/s | 203 MB 00:18 2023-12-01T00:53:41.747 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-2:18.2.0-1249.ga6f82997.el8.x86_64 6/134 2023-12-01T00:53:41.926 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : librbd1-2:18.2.0-1249.ga6f82997.el8.x86_64 7/134 2023-12-01T00:53:42.056 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-2:18.2.0-1249.ga6f82997.el8.x86_64 7/134 2023-12-01T00:53:42.251 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs2-2:18.2.0-1249.ga6f82997.el8.x86_64 8/134 2023-12-01T00:53:42.353 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephfs2-2:18.2.0-1249.ga6f82997.el8.x86_64 8/134 2023-12-01T00:53:42.419 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction check 2023-12-01T00:53:42.551 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction check succeeded. 2023-12-01T00:53:42.552 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction test 2023-12-01T00:53:42.561 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rados-2:18.2.0-1249.ga6f82997.el8.x86_64 9/134 2023-12-01T00:53:42.771 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-12-01T00:53:43.046 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-12-01T00:53:43.445 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-12-01T00:53:43.672 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-12-01T00:53:43.729 INFO:teuthology.orchestra.run.smithi026.stdout:Transaction test succeeded. 2023-12-01T00:53:43.734 INFO:teuthology.orchestra.run.smithi026.stdout:Running transaction 2023-12-01T00:53:43.818 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephsqlite-2:18.2.0-1249.ga6f82997.el8.x86_64 14/134 2023-12-01T00:53:43.909 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1249.ga6f82997.el8.x86_64 14/134 2023-12-01T00:53:43.969 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2023-12-01T00:53:44.051 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libradosstriper1-2:18.2.0-1249.ga6f82997.el8.x86 15/134 2023-12-01T00:53:44.113 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-12-01T00:53:44.132 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1249.ga6f82997.el8.x86 15/134 2023-12-01T00:53:44.276 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-12-01T00:53:44.305 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-12-01T00:53:44.404 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-12-01T00:53:44.473 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-12-01T00:53:44.576 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-12-01T00:53:44.579 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-12-01T00:53:44.798 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-12-01T00:53:45.187 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-12-01T00:53:45.188 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-12-01T00:53:45.367 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-12-01T00:53:45.381 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : librados2-2:18.2.0-1249.ga6f82997.el8.x86_64 5/134 2023-12-01T00:53:45.772 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librados2-2:18.2.0-1249.ga6f82997.el8.x86_64 5/134 2023-12-01T00:53:45.949 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : librbd1-2:18.2.0-1249.ga6f82997.el8.x86_64 6/134 2023-12-01T00:53:45.983 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-12-01T00:53:46.072 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librbd1-2:18.2.0-1249.ga6f82997.el8.x86_64 6/134 2023-12-01T00:53:46.167 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-12-01T00:53:46.440 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephfs2-2:18.2.0-1249.ga6f82997.el8.x86_64 7/134 2023-12-01T00:53:46.537 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libcephfs2-2:18.2.0-1249.ga6f82997.el8.x86_64 7/134 2023-12-01T00:53:46.695 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rados-2:18.2.0-1249.ga6f82997.el8.x86_64 8/134 2023-12-01T00:53:46.851 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-12-01T00:53:46.859 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-12-01T00:53:47.066 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-12-01T00:53:47.140 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-12-01T00:53:47.286 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-12-01T00:53:47.369 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-12-01T00:53:47.613 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-12-01T00:53:47.681 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-12-01T00:53:47.790 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-12-01T00:53:47.897 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-12-01T00:53:48.023 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephsqlite-2:18.2.0-1249.ga6f82997.el8.x86_64 14/134 2023-12-01T00:53:48.125 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1249.ga6f82997.el8.x86_64 14/134 2023-12-01T00:53:48.220 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-12-01T00:53:48.256 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libradosstriper1-2:18.2.0-1249.ga6f82997.el8.x86 15/134 2023-12-01T00:53:48.401 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1249.ga6f82997.el8.x86 15/134 2023-12-01T00:53:48.438 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-12-01T00:53:48.593 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-12-01T00:53:48.624 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-common-2:18.2.0-1249.ga6f82997.el8. 26/134 2023-12-01T00:53:48.644 INFO:teuthology.orchestra.run.smithi026.stdout: Preparing : 1/1 2023-12-01T00:53:48.745 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-ceph-argparse-2:18.2.0-1249.ga6f82997.el 27/134 2023-12-01T00:53:48.750 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-12-01T00:53:48.834 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-12-01T00:53:48.925 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-12-01T00:53:49.011 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-12-01T00:53:49.047 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-12-01T00:53:49.169 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-12-01T00:53:49.176 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-12-01T00:53:49.303 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-12-01T00:53:49.331 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-12-01T00:53:49.536 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-12-01T00:53:49.664 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cephfs-2:18.2.0-1249.ga6f82997.el8.x86_6 28/134 2023-12-01T00:53:49.940 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-12-01T00:53:49.981 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-12-01T00:53:49.991 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-12-01T00:53:50.106 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-12-01T00:53:50.169 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librados2-2:18.2.0-1249.ga6f82997.el8.x86_64 5/134 2023-12-01T00:53:50.287 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-12-01T00:53:50.552 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-12-01T00:53:50.587 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-2:18.2.0-1249.ga6f82997.el8.x86_64 5/134 2023-12-01T00:53:50.698 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-12-01T00:53:50.753 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : librbd1-2:18.2.0-1249.ga6f82997.el8.x86_64 6/134 2023-12-01T00:53:50.768 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-12-01T00:53:50.881 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-12-01T00:53:50.884 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-2:18.2.0-1249.ga6f82997.el8.x86_64 6/134 2023-12-01T00:53:51.086 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs2-2:18.2.0-1249.ga6f82997.el8.x86_64 7/134 2023-12-01T00:53:51.179 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephfs2-2:18.2.0-1249.ga6f82997.el8.x86_64 7/134 2023-12-01T00:53:51.349 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rados-2:18.2.0-1249.ga6f82997.el8.x86_64 8/134 2023-12-01T00:53:51.556 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-12-01T00:53:51.573 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-12-01T00:53:51.788 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-12-01T00:53:51.856 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-12-01T00:53:51.982 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-12-01T00:53:52.036 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-12-01T00:53:52.249 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-12-01T00:53:52.412 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-ceph-common-2:18.2.0-1249.ga6f82997.el8. 26/134 2023-12-01T00:53:52.420 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-12-01T00:53:52.516 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-12-01T00:53:52.558 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-ceph-argparse-2:18.2.0-1249.ga6f82997.el 27/134 2023-12-01T00:53:52.769 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cephfs-2:18.2.0-1249.ga6f82997.el8.x86_6 28/134 2023-12-01T00:53:52.859 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-12-01T00:53:52.927 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-12-01T00:53:52.947 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-12-01T00:53:53.061 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephsqlite-2:18.2.0-1249.ga6f82997.el8.x86_64 14/134 2023-12-01T00:53:53.078 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-12-01T00:53:53.171 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libcephsqlite-2:18.2.0-1249.ga6f82997.el8.x86_64 14/134 2023-12-01T00:53:53.268 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-12-01T00:53:53.327 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libradosstriper1-2:18.2.0-1249.ga6f82997.el8.x86 15/134 2023-12-01T00:53:53.472 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libradosstriper1-2:18.2.0-1249.ga6f82997.el8.x86 15/134 2023-12-01T00:53:53.489 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rbd-2:18.2.0-1249.ga6f82997.el8.x86_64 36/134 2023-12-01T00:53:53.666 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-12-01T00:53:53.711 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librados-devel-2:18.2.0-1249.ga6f82997.el8.x86_6 37/134 2023-12-01T00:53:53.881 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-12-01T00:53:53.890 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-12-01T00:53:54.051 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-12-01T00:53:54.092 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-12-01T00:53:54.185 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-12-01T00:53:54.277 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-12-01T00:53:54.338 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-12-01T00:53:54.436 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-12-01T00:53:54.527 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-12-01T00:53:54.695 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-12-01T00:53:54.698 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-12-01T00:53:54.895 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-12-01T00:53:55.185 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-12-01T00:53:55.260 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-12-01T00:53:55.343 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-12-01T00:53:55.553 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-12-01T00:53:55.680 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-12-01T00:53:55.784 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-12-01T00:53:55.981 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-12-01T00:53:55.993 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-12-01T00:53:56.004 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-12-01T00:53:56.177 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-12-01T00:53:56.248 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-12-01T00:53:56.270 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-12-01T00:53:56.459 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-12-01T00:53:56.591 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-12-01T00:53:56.641 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-12-01T00:53:56.807 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-12-01T00:53:56.832 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-12-01T00:53:56.915 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-12-01T00:53:56.984 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-12-01T00:53:57.010 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rbd-2:18.2.0-1249.ga6f82997.el8.x86_64 36/134 2023-12-01T00:53:57.150 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-12-01T00:53:57.161 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librados-devel-2:18.2.0-1249.ga6f82997.el8.x86_6 37/134 2023-12-01T00:53:57.187 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-12-01T00:53:57.296 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-12-01T00:53:57.378 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-12-01T00:53:57.379 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-12-01T00:53:57.406 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-12-01T00:53:57.536 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-12-01T00:53:57.588 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-12-01T00:53:57.607 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-12-01T00:53:57.657 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-12-01T00:53:57.758 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-common-2:18.2.0-1249.ga6f82997.el8. 26/134 2023-12-01T00:53:57.865 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-12-01T00:53:57.867 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-12-01T00:53:57.914 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-ceph-argparse-2:18.2.0-1249.ga6f82997.el 27/134 2023-12-01T00:53:58.066 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-12-01T00:53:58.123 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-12-01T00:53:58.128 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cephfs-2:18.2.0-1249.ga6f82997.el8.x86_6 28/134 2023-12-01T00:53:58.221 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-12-01T00:53:58.302 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-12-01T00:53:58.370 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-12-01T00:53:58.500 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-12-01T00:53:58.580 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-12-01T00:53:58.585 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-12-01T00:53:58.667 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-12-01T00:53:58.820 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-12-01T00:53:58.972 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-12-01T00:53:59.123 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-12-01T00:53:59.190 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-12-01T00:53:59.292 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-12-01T00:53:59.308 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-12-01T00:53:59.440 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-12-01T00:53:59.484 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-12-01T00:53:59.514 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-12-01T00:53:59.649 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-12-01T00:53:59.768 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-12-01T00:53:59.985 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-12-01T00:54:00.014 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-12-01T00:54:00.140 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-12-01T00:54:00.224 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-12-01T00:54:00.281 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-12-01T00:54:00.438 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-12-01T00:54:00.490 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-12-01T00:54:00.491 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-12-01T00:54:00.626 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-12-01T00:54:00.700 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-12-01T00:54:00.766 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-12-01T00:54:00.942 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-12-01T00:54:00.963 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-12-01T00:54:01.198 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-12-01T00:54:01.229 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-12-01T00:54:01.412 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-12-01T00:54:01.422 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-12-01T00:54:01.574 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-12-01T00:54:01.580 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-12-01T00:54:01.595 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-12-01T00:54:01.760 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-12-01T00:54:01.791 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-12-01T00:54:01.890 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-12-01T00:54:01.941 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-12-01T00:54:01.992 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-12-01T00:54:02.115 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-12-01T00:54:02.140 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-12-01T00:54:02.212 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-12-01T00:54:02.345 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-12-01T00:54:02.383 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-12-01T00:54:02.427 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-12-01T00:54:02.557 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-12-01T00:54:02.618 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-12-01T00:54:02.650 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-12-01T00:54:02.738 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-12-01T00:54:02.754 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-12-01T00:54:02.884 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-12-01T00:54:02.907 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rbd-2:18.2.0-1249.ga6f82997.el8.x86_64 36/134 2023-12-01T00:54:03.020 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-12-01T00:54:03.089 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-12-01T00:54:03.091 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librados-devel-2:18.2.0-1249.ga6f82997.el8.x86_6 37/134 2023-12-01T00:54:03.228 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-12-01T00:54:03.233 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-12-01T00:54:03.235 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-12-01T00:54:03.377 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-12-01T00:54:03.406 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-12-01T00:54:03.412 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-12-01T00:54:03.534 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-12-01T00:54:03.610 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-12-01T00:54:03.638 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-12-01T00:54:03.654 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-12-01T00:54:03.852 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-12-01T00:54:03.872 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-12-01T00:54:03.875 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-12-01T00:54:03.974 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-12-01T00:54:04.072 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-12-01T00:54:04.072 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-12-01T00:54:04.114 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-12-01T00:54:04.259 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-12-01T00:54:04.274 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-12-01T00:54:04.320 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-12-01T00:54:04.338 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-12-01T00:54:04.523 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-12-01T00:54:04.525 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-12-01T00:54:04.688 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-12-01T00:54:04.697 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-12-01T00:54:04.850 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-12-01T00:54:04.857 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-12-01T00:54:04.976 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-12-01T00:54:05.003 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-12-01T00:54:05.178 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-12-01T00:54:05.192 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-12-01T00:54:05.331 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-12-01T00:54:05.391 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-12-01T00:54:05.421 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-12-01T00:54:05.551 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-12-01T00:54:05.561 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-12-01T00:54:05.693 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-12-01T00:54:05.745 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-12-01T00:54:05.774 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-12-01T00:54:05.949 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-12-01T00:54:05.995 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-12-01T00:54:06.153 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-12-01T00:54:06.156 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-12-01T00:54:06.274 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-12-01T00:54:06.370 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-12-01T00:54:06.436 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-12-01T00:54:06.539 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-12-01T00:54:06.680 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-12-01T00:54:06.776 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-12-01T00:54:06.878 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-12-01T00:54:07.148 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-12-01T00:54:07.454 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-12-01T00:54:07.486 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-12-01T00:54:07.542 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-12-01T00:54:07.689 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : librgw2-2:18.2.0-1249.ga6f82997.el8.x86_64 92/134 2023-12-01T00:54:07.732 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-12-01T00:54:07.758 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-12-01T00:54:07.762 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librgw2-2:18.2.0-1249.ga6f82997.el8.x86_64 92/134 2023-12-01T00:54:07.914 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : python3-rgw-2:18.2.0-1249.ga6f82997.el8.x86_64 93/134 2023-12-01T00:54:07.950 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-12-01T00:54:07.969 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-12-01T00:54:08.169 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-12-01T00:54:08.262 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-12-01T00:54:08.356 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-12-01T00:54:08.512 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-12-01T00:54:08.522 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-12-01T00:54:08.741 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-12-01T00:54:08.833 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-12-01T00:54:09.072 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-12-01T00:54:09.299 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-12-01T00:54:09.482 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-12-01T00:54:09.543 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-12-01T00:54:09.611 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librgw2-2:18.2.0-1249.ga6f82997.el8.x86_64 92/134 2023-12-01T00:54:09.683 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-12-01T00:54:09.692 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librgw2-2:18.2.0-1249.ga6f82997.el8.x86_64 92/134 2023-12-01T00:54:09.838 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-12-01T00:54:09.853 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rgw-2:18.2.0-1249.ga6f82997.el8.x86_64 93/134 2023-12-01T00:54:10.075 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-12-01T00:54:10.282 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-12-01T00:54:10.412 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-12-01T00:54:10.536 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-12-01T00:54:10.754 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-12-01T00:54:10.939 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-12-01T00:54:11.105 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-12-01T00:54:11.302 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-12-01T00:54:11.431 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-12-01T00:54:11.453 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 94/134 2023-12-01T00:54:11.681 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 94/134 2023-12-01T00:54:11.681 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-12-01T00:54:11.921 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-12-01T00:54:12.080 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-12-01T00:54:12.261 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 94/134 2023-12-01T00:54:12.329 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-12-01T00:54:12.527 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-base-2:18.2.0-1249.ga6f82997.el8.x86_64 95/134 2023-12-01T00:54:12.532 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-12-01T00:54:12.601 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-base-2:18.2.0-1249.ga6f82997.el8.x86_64 95/134 2023-12-01T00:54:12.690 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-12-01T00:54:12.730 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-selinux-2:18.2.0-1249.ga6f82997.el8.x86_64 96/134 2023-12-01T00:54:12.885 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-12-01T00:54:13.480 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 94/134 2023-12-01T00:54:13.703 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 94/134 2023-12-01T00:54:14.085 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-12-01T00:54:14.291 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 94/134 2023-12-01T00:54:14.397 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-12-01T00:54:14.541 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-base-2:18.2.0-1249.ga6f82997.el8.x86_64 95/134 2023-12-01T00:54:14.609 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-12-01T00:54:14.623 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-base-2:18.2.0-1249.ga6f82997.el8.x86_64 95/134 2023-12-01T00:54:14.728 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-selinux-2:18.2.0-1249.ga6f82997.el8.x86_64 96/134 2023-12-01T00:54:14.934 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-12-01T00:54:15.168 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-12-01T00:54:15.408 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-12-01T00:54:16.187 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-12-01T00:54:16.357 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : librgw2-2:18.2.0-1249.ga6f82997.el8.x86_64 92/134 2023-12-01T00:54:16.445 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librgw2-2:18.2.0-1249.ga6f82997.el8.x86_64 92/134 2023-12-01T00:54:16.599 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : python3-rgw-2:18.2.0-1249.ga6f82997.el8.x86_64 93/134 2023-12-01T00:54:20.475 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 94/134 2023-12-01T00:54:20.690 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 94/134 2023-12-01T00:54:21.317 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 94/134 2023-12-01T00:54:21.589 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-base-2:18.2.0-1249.ga6f82997.el8.x86_64 95/134 2023-12-01T00:54:21.675 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-base-2:18.2.0-1249.ga6f82997.el8.x86_64 95/134 2023-12-01T00:54:21.806 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-selinux-2:18.2.0-1249.ga6f82997.el8.x86_64 96/134 2023-12-01T00:54:31.458 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1249.ga6f82997.el8.x86_64 96/134 2023-12-01T00:54:31.458 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /sys 2023-12-01T00:54:31.458 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /proc 2023-12-01T00:54:31.458 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /dev 2023-12-01T00:54:31.458 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /run 2023-12-01T00:54:31.458 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /mnt 2023-12-01T00:54:31.458 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /var/tmp 2023-12-01T00:54:31.458 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /home 2023-12-01T00:54:31.458 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /tmp 2023-12-01T00:54:31.458 INFO:teuthology.orchestra.run.smithi116.stdout:skipping the directory /dev 2023-12-01T00:54:31.459 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-01T00:54:31.844 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-volume-2:18.2.0-1249.ga6f82997.el8.noarch 97/134 2023-12-01T00:54:33.406 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-volume-2:18.2.0-1249.ga6f82997.el8.noarch 97/134 2023-12-01T00:54:33.409 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1249.ga6f82997.el8.x86_64 96/134 2023-12-01T00:54:33.409 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /sys 2023-12-01T00:54:33.409 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /proc 2023-12-01T00:54:33.409 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /dev 2023-12-01T00:54:33.409 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /run 2023-12-01T00:54:33.409 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /mnt 2023-12-01T00:54:33.409 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /var/tmp 2023-12-01T00:54:33.409 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /home 2023-12-01T00:54:33.409 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /tmp 2023-12-01T00:54:33.409 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /dev 2023-12-01T00:54:33.409 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-01T00:54:33.599 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-osd-2:18.2.0-1249.ga6f82997.el8.x86_64 98/134 2023-12-01T00:54:33.725 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-volume-2:18.2.0-1249.ga6f82997.el8.noarch 97/134 2023-12-01T00:54:33.826 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-osd-2:18.2.0-1249.ga6f82997.el8.x86_64 98/134 2023-12-01T00:54:33.986 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mds-2:18.2.0-1249.ga6f82997.el8.x86_64 99/134 2023-12-01T00:54:34.440 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mds-2:18.2.0-1249.ga6f82997.el8.x86_64 99/134 2023-12-01T00:54:34.586 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mon-2:18.2.0-1249.ga6f82997.el8.x86_64 100/134 2023-12-01T00:54:34.602 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mon-2:18.2.0-1249.ga6f82997.el8.x86_64 100/134 2023-12-01T00:54:35.286 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-volume-2:18.2.0-1249.ga6f82997.el8.noarch 97/134 2023-12-01T00:54:35.487 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-osd-2:18.2.0-1249.ga6f82997.el8.x86_64 98/134 2023-12-01T00:54:35.712 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-osd-2:18.2.0-1249.ga6f82997.el8.x86_64 98/134 2023-12-01T00:54:35.933 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mds-2:18.2.0-1249.ga6f82997.el8.x86_64 99/134 2023-12-01T00:54:36.306 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephadm-2:18.2.0-1249.ga6f82997.el8.noarch 101/134 2023-12-01T00:54:36.391 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mds-2:18.2.0-1249.ga6f82997.el8.x86_64 99/134 2023-12-01T00:54:36.493 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephadm-2:18.2.0-1249.ga6f82997.el8.noarch 101/134 2023-12-01T00:54:36.550 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mon-2:18.2.0-1249.ga6f82997.el8.x86_64 100/134 2023-12-01T00:54:36.567 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mon-2:18.2.0-1249.ga6f82997.el8.x86_64 100/134 2023-12-01T00:54:36.624 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1249.ga6f82997.e 102/134 2023-12-01T00:54:36.885 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1249.ga6f82997. 103/134 2023-12-01T00:54:37.076 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1249.ga6f82997.el8.noa 104/134 2023-12-01T00:54:37.296 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1249.ga6f82997.el8.noa 104/134 2023-12-01T00:54:37.590 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1249.ga6f82997.el8.n 105/134 2023-12-01T00:54:38.252 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: cephadm-2:18.2.0-1249.ga6f82997.el8.noarch 101/134 2023-12-01T00:54:38.440 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : cephadm-2:18.2.0-1249.ga6f82997.el8.noarch 101/134 2023-12-01T00:54:38.548 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1249.ga6f82997.el8.n 105/134 2023-12-01T00:54:38.580 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1249.ga6f82997.e 102/134 2023-12-01T00:54:38.735 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1249.ga6f 106/134 2023-12-01T00:54:38.790 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1249.ga6f82997. 103/134 2023-12-01T00:54:38.825 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1249.ga6f 106/134 2023-12-01T00:54:38.982 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1249.ga6f82997.el8.noa 104/134 2023-12-01T00:54:39.185 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1249.ga6f82997.el 107/134 2023-12-01T00:54:39.201 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1249.ga6f82997.el8.noa 104/134 2023-12-01T00:54:39.395 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-2:18.2.0-1249.ga6f82997.el8.x86_64 108/134 2023-12-01T00:54:39.431 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1249.ga6f82997.el8.x86_64 108/134 2023-12-01T00:54:39.503 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1249.ga6f82997.el8.n 105/134 2023-12-01T00:54:39.634 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-mgr-rook-2:18.2.0-1249.ga6f82997.el8.noarch 109/134 2023-12-01T00:54:39.645 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1249.ga6f82997.el8.noarch 109/134 2023-12-01T00:54:40.464 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1249.ga6f82997.el8.n 105/134 2023-12-01T00:54:40.640 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1249.ga6f 106/134 2023-12-01T00:54:40.730 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1249.ga6f 106/134 2023-12-01T00:54:40.902 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-2:18.2.0-1249.ga6f82997.el8.x86_64 110/134 2023-12-01T00:54:41.098 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1249.ga6f82997.el 107/134 2023-12-01T00:54:41.134 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-radosgw-2:18.2.0-1249.ga6f82997.el8.x86_64 111/134 2023-12-01T00:54:41.170 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1249.ga6f82997.el8.x86_64 111/134 2023-12-01T00:54:41.281 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-2:18.2.0-1249.ga6f82997.el8.x86_64 108/134 2023-12-01T00:54:41.317 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1249.ga6f82997.el8.x86_64 108/134 2023-12-01T00:54:41.326 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1249.ga6f82 112/134 2023-12-01T00:54:41.373 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1249.ga6f82 112/134 2023-12-01T00:54:41.481 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-rook-2:18.2.0-1249.ga6f82997.el8.noarch 109/134 2023-12-01T00:54:41.492 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1249.ga6f82997.el8.noarch 109/134 2023-12-01T00:54:41.551 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 113/134 2023-12-01T00:54:41.686 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-selinux-2:18.2.0-1249.ga6f82997.el8.x86_64 96/134 2023-12-01T00:54:41.686 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /sys 2023-12-01T00:54:41.686 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /proc 2023-12-01T00:54:41.686 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /dev 2023-12-01T00:54:41.686 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /run 2023-12-01T00:54:41.686 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /mnt 2023-12-01T00:54:41.687 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /var/tmp 2023-12-01T00:54:41.687 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /home 2023-12-01T00:54:41.687 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /tmp 2023-12-01T00:54:41.687 INFO:teuthology.orchestra.run.smithi026.stdout:skipping the directory /dev 2023-12-01T00:54:41.687 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:54:41.895 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 113/134 2023-12-01T00:54:42.059 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 114/134 2023-12-01T00:54:42.070 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-volume-2:18.2.0-1249.ga6f82997.el8.noarch 97/134 2023-12-01T00:54:42.741 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-2:18.2.0-1249.ga6f82997.el8.x86_64 110/134 2023-12-01T00:54:42.939 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-radosgw-2:18.2.0-1249.ga6f82997.el8.x86_64 111/134 2023-12-01T00:54:42.977 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1249.ga6f82997.el8.x86_64 111/134 2023-12-01T00:54:43.123 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1249.ga6f82 112/134 2023-12-01T00:54:43.170 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1249.ga6f82 112/134 2023-12-01T00:54:43.323 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : cephfs-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 113/134 2023-12-01T00:54:43.668 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 113/134 2023-12-01T00:54:43.738 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-volume-2:18.2.0-1249.ga6f82997.el8.noarch 97/134 2023-12-01T00:54:43.832 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 114/134 2023-12-01T00:54:43.902 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-osd-2:18.2.0-1249.ga6f82997.el8.x86_64 98/134 2023-12-01T00:54:44.152 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-osd-2:18.2.0-1249.ga6f82997.el8.x86_64 98/134 2023-12-01T00:54:44.336 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mds-2:18.2.0-1249.ga6f82997.el8.x86_64 99/134 2023-12-01T00:54:44.831 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mds-2:18.2.0-1249.ga6f82997.el8.x86_64 99/134 2023-12-01T00:54:44.961 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mon-2:18.2.0-1249.ga6f82997.el8.x86_64 100/134 2023-12-01T00:54:44.979 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mon-2:18.2.0-1249.ga6f82997.el8.x86_64 100/134 2023-12-01T00:54:46.491 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 114/134 2023-12-01T00:54:46.796 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-test-2:18.2.0-1249.ga6f82997.el8.x86_64 115/134 2023-12-01T00:54:46.812 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephadm-2:18.2.0-1249.ga6f82997.el8.noarch 101/134 2023-12-01T00:54:46.950 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-12-01T00:54:46.988 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephadm-2:18.2.0-1249.ga6f82997.el8.noarch 101/134 2023-12-01T00:54:47.134 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-prometheus-alerts-2:18.2.0-1249.ga6f82997.e 102/134 2023-12-01T00:54:47.146 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-12-01T00:54:47.329 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-grafana-dashboards-2:18.2.0-1249.ga6f82997. 103/134 2023-12-01T00:54:47.510 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-cephadm-2:18.2.0-1249.ga6f82997.el8.noa 104/134 2023-12-01T00:54:47.750 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.0-1249.ga6f82997.el8.noa 104/134 2023-12-01T00:54:48.006 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-12-01T00:54:48.009 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-dashboard-2:18.2.0-1249.ga6f82997.el8.n 105/134 2023-12-01T00:54:48.266 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 114/134 2023-12-01T00:54:48.365 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-12-01T00:54:48.528 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : ceph-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 119/134 2023-12-01T00:54:48.696 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-12-01T00:54:48.863 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libcephfs-devel-2:18.2.0-1249.ga6f82997.el8.x86_ 121/134 2023-12-01T00:54:49.034 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.0-1249.ga6f82997.el8.n 105/134 2023-12-01T00:54:49.060 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-12-01T00:54:49.113 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-test-2:18.2.0-1249.ga6f82997.el8.x86_64 115/134 2023-12-01T00:54:49.210 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.0-1249.ga6f 106/134 2023-12-01T00:54:49.306 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.0-1249.ga6f 106/134 2023-12-01T00:54:49.437 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-12-01T00:54:49.600 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 117/134 2023-12-01T00:54:49.647 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-modules-core-2:18.2.0-1249.ga6f82997.el 107/134 2023-12-01T00:54:49.838 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-2:18.2.0-1249.ga6f82997.el8.x86_64 108/134 2023-12-01T00:54:49.848 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-12-01T00:54:49.877 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-2:18.2.0-1249.ga6f82997.el8.x86_64 108/134 2023-12-01T00:54:49.989 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-12-01T00:54:50.059 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-mgr-rook-2:18.2.0-1249.ga6f82997.el8.noarch 109/134 2023-12-01T00:54:50.071 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.0-1249.ga6f82997.el8.noarch 109/134 2023-12-01T00:54:50.178 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-12-01T00:54:50.393 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-12-01T00:54:50.543 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephfs-devel-2:18.2.0-1249.ga6f82997.el8.x86_ 121/134 2023-12-01T00:54:50.673 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-12-01T00:54:51.253 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-12-01T00:54:51.385 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-2:18.2.0-1249.ga6f82997.el8.x86_64 110/134 2023-12-01T00:54:51.483 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-12-01T00:54:51.501 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-12-01T00:54:51.585 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-radosgw-2:18.2.0-1249.ga6f82997.el8.x86_64 111/134 2023-12-01T00:54:51.636 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-radosgw-2:18.2.0-1249.ga6f82997.el8.x86_64 111/134 2023-12-01T00:54:51.650 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : cephfs-top-2:18.2.0-1249.ga6f82997.el8.noarch 124/134 2023-12-01T00:54:51.793 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-immutable-object-cache-2:18.2.0-1249.ga6f82 112/134 2023-12-01T00:54:51.843 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.0-1249.ga6f82 112/134 2023-12-01T00:54:51.942 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 125/134 2023-12-01T00:54:51.993 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 113/134 2023-12-01T00:54:52.236 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : rbd-nbd-2:18.2.0-1249.ga6f82997.el8.x86_64 126/134 2023-12-01T00:54:52.360 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: cephfs-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 113/134 2023-12-01T00:54:52.510 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 114/134 2023-12-01T00:54:52.526 INFO:teuthology.orchestra.run.smithi116.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-12-01T00:54:52.658 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-12-01T00:54:52.666 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-12-01T00:54:52.847 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-12-01T00:54:52.857 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-12-01T00:54:53.049 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-12-01T00:54:53.097 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-12-01T00:54:53.114 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-12-01T00:54:53.140 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-12-01T00:54:53.264 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : cephfs-top-2:18.2.0-1249.ga6f82997.el8.noarch 124/134 2023-12-01T00:54:53.382 INFO:teuthology.orchestra.run.smithi116.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-12-01T00:54:53.395 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-12-01T00:54:53.395 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-12-01T00:54:53.559 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 125/134 2023-12-01T00:54:53.593 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-12-01T00:54:53.594 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-12-01T00:54:53.850 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-12-01T00:54:53.865 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-nbd-2:18.2.0-1249.ga6f82997.el8.x86_64 126/134 2023-12-01T00:54:54.056 INFO:teuthology.orchestra.run.smithi116.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-12-01T00:54:54.210 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-12-01T00:54:54.396 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-12-01T00:54:54.478 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-12-01T00:54:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-12-01T00:54:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-2:18.2.0-1249.ga6f82997.el8.x86_64 1/134 2023-12-01T00:54:54.553 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-base-2:18.2.0-1249.ga6f82997.el8.x86_64 2/134 2023-12-01T00:54:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 3/134 2023-12-01T00:54:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 4/134 2023-12-01T00:54:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1249.ga6f82 5/134 2023-12-01T00:54:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mds-2:18.2.0-1249.ga6f82997.el8.x86_64 6/134 2023-12-01T00:54:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-2:18.2.0-1249.ga6f82997.el8.x86_64 7/134 2023-12-01T00:54:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mon-2:18.2.0-1249.ga6f82997.el8.x86_64 8/134 2023-12-01T00:54:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-osd-2:18.2.0-1249.ga6f82997.el8.x86_64 9/134 2023-12-01T00:54:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-radosgw-2:18.2.0-1249.ga6f82997.el8.x86_64 10/134 2023-12-01T00:54:54.554 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-selinux-2:18.2.0-1249.ga6f82997.el8.x86_64 11/134 2023-12-01T00:54:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-test-2:18.2.0-1249.ga6f82997.el8.x86_64 12/134 2023-12-01T00:54:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 13/134 2023-12-01T00:54:54.555 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs-devel-2:18.2.0-1249.ga6f82997.el8.x86_ 14/134 2023-12-01T00:54:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephfs2-2:18.2.0-1249.ga6f82997.el8.x86_64 15/134 2023-12-01T00:54:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcephsqlite-2:18.2.0-1249.ga6f82997.el8.x86_64 16/134 2023-12-01T00:54:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados-devel-2:18.2.0-1249.ga6f82997.el8.x86_6 17/134 2023-12-01T00:54:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libradosstriper1-2:18.2.0-1249.ga6f82997.el8.x86 18/134 2023-12-01T00:54:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librgw2-2:18.2.0-1249.ga6f82997.el8.x86_64 19/134 2023-12-01T00:54:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1249.ga6f82997.el 20/134 2023-12-01T00:54:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-ceph-common-2:18.2.0-1249.ga6f82997.el8. 21/134 2023-12-01T00:54:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cephfs-2:18.2.0-1249.ga6f82997.el8.x86_6 22/134 2023-12-01T00:54:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rados-2:18.2.0-1249.ga6f82997.el8.x86_64 23/134 2023-12-01T00:54:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rbd-2:18.2.0-1249.ga6f82997.el8.x86_64 24/134 2023-12-01T00:54:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rgw-2:18.2.0-1249.ga6f82997.el8.x86_64 25/134 2023-12-01T00:54:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 26/134 2023-12-01T00:54:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 27/134 2023-12-01T00:54:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : rbd-nbd-2:18.2.0-1249.ga6f82997.el8.x86_64 28/134 2023-12-01T00:54:54.556 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1249.ga6f82997. 29/134 2023-12-01T00:54:54.557 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1249.ga6f82997.el8.noa 30/134 2023-12-01T00:54:54.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1249.ga6f82997.el8.n 31/134 2023-12-01T00:54:54.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1249.ga6f 32/134 2023-12-01T00:54:54.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1249.ga6f82997.el 33/134 2023-12-01T00:54:54.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1249.ga6f82997.el8.noarch 34/134 2023-12-01T00:54:54.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1249.ga6f82997.e 35/134 2023-12-01T00:54:54.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : ceph-volume-2:18.2.0-1249.ga6f82997.el8.noarch 36/134 2023-12-01T00:54:54.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephadm-2:18.2.0-1249.ga6f82997.el8.noarch 37/134 2023-12-01T00:54:54.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : cephfs-top-2:18.2.0-1249.ga6f82997.el8.noarch 38/134 2023-12-01T00:54:54.566 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-12-01T00:54:54.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-12-01T00:54:54.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-12-01T00:54:54.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-12-01T00:54:54.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-12-01T00:54:54.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-12-01T00:54:54.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-12-01T00:54:54.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-12-01T00:54:54.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-12-01T00:54:54.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-12-01T00:54:54.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-12-01T00:54:54.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-12-01T00:54:54.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-12-01T00:54:54.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-12-01T00:54:54.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-12-01T00:54:54.567 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-12-01T00:54:54.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-12-01T00:54:54.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-12-01T00:54:54.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-12-01T00:54:54.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-12-01T00:54:54.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-12-01T00:54:54.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-12-01T00:54:54.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-12-01T00:54:54.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-12-01T00:54:54.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-12-01T00:54:54.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-12-01T00:54:54.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-12-01T00:54:54.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-12-01T00:54:54.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-12-01T00:54:54.568 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-12-01T00:54:54.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-12-01T00:54:54.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-12-01T00:54:54.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-12-01T00:54:54.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-12-01T00:54:54.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-12-01T00:54:54.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-12-01T00:54:54.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-12-01T00:54:54.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-12-01T00:54:54.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-12-01T00:54:54.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-12-01T00:54:54.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-12-01T00:54:54.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-12-01T00:54:54.569 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-12-01T00:54:54.570 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-12-01T00:54:54.570 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-12-01T00:54:54.570 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-12-01T00:54:54.570 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-12-01T00:54:54.570 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-12-01T00:54:54.570 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-12-01T00:54:54.570 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-12-01T00:54:54.570 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-12-01T00:54:54.570 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-12-01T00:54:54.570 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-12-01T00:54:54.570 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-12-01T00:54:54.570 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-12-01T00:54:54.570 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-12-01T00:54:54.570 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-12-01T00:54:54.571 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-12-01T00:54:54.571 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-12-01T00:54:54.571 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-12-01T00:54:54.571 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-12-01T00:54:54.571 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-12-01T00:54:54.571 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-12-01T00:54:54.571 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-12-01T00:54:54.571 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-12-01T00:54:54.571 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-12-01T00:54:54.571 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-12-01T00:54:54.571 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-12-01T00:54:54.571 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-12-01T00:54:54.571 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-12-01T00:54:54.571 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-12-01T00:54:54.572 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-12-01T00:54:54.572 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-12-01T00:54:54.572 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-12-01T00:54:54.572 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-12-01T00:54:54.572 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-12-01T00:54:54.572 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-12-01T00:54:54.572 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-12-01T00:54:54.572 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-12-01T00:54:54.572 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-12-01T00:54:54.572 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-12-01T00:54:54.572 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-12-01T00:54:54.572 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-12-01T00:54:54.572 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-12-01T00:54:54.572 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-12-01T00:54:54.573 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-12-01T00:54:54.573 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-12-01T00:54:54.573 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-12-01T00:54:54.573 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-12-01T00:54:54.573 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-12-01T00:54:54.573 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-2:18.2.0-1249.ga6f82997.el8.x86_64 129/134 2023-12-01T00:54:54.573 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-12-01T00:54:54.573 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-2:18.2.0-1249.ga6f82997.el8.x86_64 131/134 2023-12-01T00:54:54.573 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-12-01T00:54:54.573 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-12-01T00:54:54.680 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-12-01T00:54:54.692 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-12-01T00:54:54.838 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-12-01T00:54:54.846 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-12-01T00:54:54.966 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-12-01T00:54:54.966 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-12-01T00:54:55.158 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-12-01T00:54:55.158 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-12-01T00:54:55.405 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-12-01T00:54:55.579 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-12-01T00:54:56.116 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-12-01T00:54:56.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-2:18.2.0-1249.ga6f82997.el8.x86_64 1/134 2023-12-01T00:54:56.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-base-2:18.2.0-1249.ga6f82997.el8.x86_64 2/134 2023-12-01T00:54:56.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 3/134 2023-12-01T00:54:56.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 4/134 2023-12-01T00:54:56.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1249.ga6f82 5/134 2023-12-01T00:54:56.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mds-2:18.2.0-1249.ga6f82997.el8.x86_64 6/134 2023-12-01T00:54:56.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-2:18.2.0-1249.ga6f82997.el8.x86_64 7/134 2023-12-01T00:54:56.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mon-2:18.2.0-1249.ga6f82997.el8.x86_64 8/134 2023-12-01T00:54:56.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-osd-2:18.2.0-1249.ga6f82997.el8.x86_64 9/134 2023-12-01T00:54:56.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-radosgw-2:18.2.0-1249.ga6f82997.el8.x86_64 10/134 2023-12-01T00:54:56.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-selinux-2:18.2.0-1249.ga6f82997.el8.x86_64 11/134 2023-12-01T00:54:56.116 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-test-2:18.2.0-1249.ga6f82997.el8.x86_64 12/134 2023-12-01T00:54:56.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : cephfs-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 13/134 2023-12-01T00:54:56.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephfs-devel-2:18.2.0-1249.ga6f82997.el8.x86_ 14/134 2023-12-01T00:54:56.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephfs2-2:18.2.0-1249.ga6f82997.el8.x86_64 15/134 2023-12-01T00:54:56.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephsqlite-2:18.2.0-1249.ga6f82997.el8.x86_64 16/134 2023-12-01T00:54:56.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados-devel-2:18.2.0-1249.ga6f82997.el8.x86_6 17/134 2023-12-01T00:54:56.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libradosstriper1-2:18.2.0-1249.ga6f82997.el8.x86 18/134 2023-12-01T00:54:56.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librgw2-2:18.2.0-1249.ga6f82997.el8.x86_64 19/134 2023-12-01T00:54:56.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1249.ga6f82997.el 20/134 2023-12-01T00:54:56.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-ceph-common-2:18.2.0-1249.ga6f82997.el8. 21/134 2023-12-01T00:54:56.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cephfs-2:18.2.0-1249.ga6f82997.el8.x86_6 22/134 2023-12-01T00:54:56.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rados-2:18.2.0-1249.ga6f82997.el8.x86_64 23/134 2023-12-01T00:54:56.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rbd-2:18.2.0-1249.ga6f82997.el8.x86_64 24/134 2023-12-01T00:54:56.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rgw-2:18.2.0-1249.ga6f82997.el8.x86_64 25/134 2023-12-01T00:54:56.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 26/134 2023-12-01T00:54:56.117 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 27/134 2023-12-01T00:54:56.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-nbd-2:18.2.0-1249.ga6f82997.el8.x86_64 28/134 2023-12-01T00:54:56.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1249.ga6f82997. 29/134 2023-12-01T00:54:56.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1249.ga6f82997.el8.noa 30/134 2023-12-01T00:54:56.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1249.ga6f82997.el8.n 31/134 2023-12-01T00:54:56.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1249.ga6f 32/134 2023-12-01T00:54:56.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1249.ga6f82997.el 33/134 2023-12-01T00:54:56.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1249.ga6f82997.el8.noarch 34/134 2023-12-01T00:54:56.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1249.ga6f82997.e 35/134 2023-12-01T00:54:56.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-volume-2:18.2.0-1249.ga6f82997.el8.noarch 36/134 2023-12-01T00:54:56.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : cephadm-2:18.2.0-1249.ga6f82997.el8.noarch 37/134 2023-12-01T00:54:56.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : cephfs-top-2:18.2.0-1249.ga6f82997.el8.noarch 38/134 2023-12-01T00:54:56.118 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-12-01T00:54:56.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-12-01T00:54:56.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-12-01T00:54:56.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-12-01T00:54:56.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-12-01T00:54:56.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-12-01T00:54:56.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-12-01T00:54:56.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-12-01T00:54:56.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-12-01T00:54:56.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-12-01T00:54:56.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-12-01T00:54:56.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-12-01T00:54:56.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-12-01T00:54:56.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-12-01T00:54:56.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-12-01T00:54:56.119 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-12-01T00:54:56.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-12-01T00:54:56.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-12-01T00:54:56.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-12-01T00:54:56.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-12-01T00:54:56.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-12-01T00:54:56.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-12-01T00:54:56.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-12-01T00:54:56.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-12-01T00:54:56.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-12-01T00:54:56.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-12-01T00:54:56.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-12-01T00:54:56.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-12-01T00:54:56.120 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-12-01T00:54:56.121 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-12-01T00:54:56.121 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-12-01T00:54:56.121 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-12-01T00:54:56.121 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-12-01T00:54:56.121 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-12-01T00:54:56.121 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-12-01T00:54:56.121 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-12-01T00:54:56.121 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-12-01T00:54:56.121 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-12-01T00:54:56.121 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-12-01T00:54:56.121 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-12-01T00:54:56.121 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-12-01T00:54:56.121 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-12-01T00:54:56.121 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-12-01T00:54:56.121 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-12-01T00:54:56.122 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-12-01T00:54:56.122 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-12-01T00:54:56.122 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-12-01T00:54:56.122 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-12-01T00:54:56.122 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-12-01T00:54:56.122 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-12-01T00:54:56.122 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-12-01T00:54:56.122 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-12-01T00:54:56.122 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-12-01T00:54:56.122 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-12-01T00:54:56.122 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-12-01T00:54:56.122 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-12-01T00:54:56.122 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-12-01T00:54:56.122 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-12-01T00:54:56.123 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-12-01T00:54:56.123 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-12-01T00:54:56.123 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-12-01T00:54:56.123 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-12-01T00:54:56.123 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-12-01T00:54:56.123 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-12-01T00:54:56.123 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-12-01T00:54:56.123 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-12-01T00:54:56.123 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-12-01T00:54:56.123 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-12-01T00:54:56.123 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-12-01T00:54:56.123 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-12-01T00:54:56.123 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-12-01T00:54:56.123 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-12-01T00:54:56.124 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-12-01T00:54:56.124 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-12-01T00:54:56.124 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-12-01T00:54:56.124 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-12-01T00:54:56.124 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-12-01T00:54:56.124 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-12-01T00:54:56.124 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-12-01T00:54:56.124 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-12-01T00:54:56.124 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-12-01T00:54:56.124 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-12-01T00:54:56.124 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-12-01T00:54:56.124 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-12-01T00:54:56.124 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-12-01T00:54:56.124 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-12-01T00:54:56.124 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-12-01T00:54:56.125 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-12-01T00:54:56.125 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-12-01T00:54:56.125 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-12-01T00:54:56.125 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados2-2:18.2.0-1249.ga6f82997.el8.x86_64 129/134 2023-12-01T00:54:56.125 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-12-01T00:54:56.125 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librbd1-2:18.2.0-1249.ga6f82997.el8.x86_64 131/134 2023-12-01T00:54:56.125 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-12-01T00:54:56.125 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-12-01T00:54:56.965 INFO:teuthology.orchestra.run.smithi116.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-12-01T00:54:56.965 INFO:teuthology.orchestra.run.smithi116.stdout:Last metadata expiration check: 0:01:49 ago on Fri 01 Dec 2023 12:53:07 AM UTC. 2023-12-01T00:54:57.249 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: rbd-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 114/134 2023-12-01T00:54:58.205 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-test-2:18.2.0-1249.ga6f82997.el8.x86_64 115/134 2023-12-01T00:54:58.512 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-12-01T00:54:58.529 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-12-01T00:54:58.529 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:01:50 ago on Fri 01 Dec 2023 12:53:08 AM UTC. 2023-12-01T00:54:58.704 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : ceph-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 117/134 2023-12-01T00:54:58.951 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-12-01T00:54:59.141 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-12-01T00:54:59.348 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-12-01T00:54:59.434 INFO:teuthology.orchestra.run.smithi116.stdout:Installed products updated. 2023-12-01T00:54:59.571 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-12-01T00:54:59.645 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-01T00:54:59.645 INFO:teuthology.orchestra.run.smithi116.stdout:Upgraded: 2023-12-01T00:54:59.645 INFO:teuthology.orchestra.run.smithi116.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-12-01T00:54:59.645 INFO:teuthology.orchestra.run.smithi116.stdout: librados2-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.646 INFO:teuthology.orchestra.run.smithi116.stdout: librbd1-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.646 INFO:teuthology.orchestra.run.smithi116.stdout:Installed: 2023-12-01T00:54:59.646 INFO:teuthology.orchestra.run.smithi116.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-12-01T00:54:59.646 INFO:teuthology.orchestra.run.smithi116.stdout: automake-1.16.1-7.el8.noarch 2023-12-01T00:54:59.646 INFO:teuthology.orchestra.run.smithi116.stdout: bison-3.0.4-10.el8.x86_64 2023-12-01T00:54:59.646 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.646 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-base-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.646 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.646 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.646 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-grafana-dashboards-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:54:59.646 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-immutable-object-cache-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.646 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mds-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.646 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.647 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-cephadm-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:54:59.647 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-dashboard-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:54:59.647 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:54:59.647 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-modules-core-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:54:59.647 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mgr-rook-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:54:59.647 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-mon-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.647 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-osd-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.647 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-prometheus-alerts-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:54:59.647 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-radosgw-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.647 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-selinux-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.647 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-test-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.647 INFO:teuthology.orchestra.run.smithi116.stdout: ceph-volume-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:54:59.647 INFO:teuthology.orchestra.run.smithi116.stdout: cephadm-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:54:59.648 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.648 INFO:teuthology.orchestra.run.smithi116.stdout: cephfs-top-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:54:59.648 INFO:teuthology.orchestra.run.smithi116.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-12-01T00:54:59.648 INFO:teuthology.orchestra.run.smithi116.stdout: flex-2.6.1-9.el8.x86_64 2023-12-01T00:54:59.648 INFO:teuthology.orchestra.run.smithi116.stdout: fuse-2.9.7-15.el8.x86_64 2023-12-01T00:54:59.648 INFO:teuthology.orchestra.run.smithi116.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-01T00:54:59.648 INFO:teuthology.orchestra.run.smithi116.stdout: jq-1.6-3.el8.x86_64 2023-12-01T00:54:59.648 INFO:teuthology.orchestra.run.smithi116.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-01T00:54:59.648 INFO:teuthology.orchestra.run.smithi116.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-12-01T00:54:59.649 INFO:teuthology.orchestra.run.smithi116.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-01T00:54:59.649 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs-devel-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.649 INFO:teuthology.orchestra.run.smithi116.stdout: libcephfs2-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.649 INFO:teuthology.orchestra.run.smithi116.stdout: libcephsqlite-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.649 INFO:teuthology.orchestra.run.smithi116.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-01T00:54:59.649 INFO:teuthology.orchestra.run.smithi116.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-12-01T00:54:59.649 INFO:teuthology.orchestra.run.smithi116.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-01T00:54:59.649 INFO:teuthology.orchestra.run.smithi116.stdout: libpq-13.5-1.el8.x86_64 2023-12-01T00:54:59.649 INFO:teuthology.orchestra.run.smithi116.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-12-01T00:54:59.649 INFO:teuthology.orchestra.run.smithi116.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-12-01T00:54:59.649 INFO:teuthology.orchestra.run.smithi116.stdout: librados-devel-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.649 INFO:teuthology.orchestra.run.smithi116.stdout: libradosstriper1-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.649 INFO:teuthology.orchestra.run.smithi116.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-01T00:54:59.649 INFO:teuthology.orchestra.run.smithi116.stdout: librgw2-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.650 INFO:teuthology.orchestra.run.smithi116.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-01T00:54:59.650 INFO:teuthology.orchestra.run.smithi116.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-01T00:54:59.650 INFO:teuthology.orchestra.run.smithi116.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-01T00:54:59.650 INFO:teuthology.orchestra.run.smithi116.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-01T00:54:59.650 INFO:teuthology.orchestra.run.smithi116.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-12-01T00:54:59.650 INFO:teuthology.orchestra.run.smithi116.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-01T00:54:59.650 INFO:teuthology.orchestra.run.smithi116.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-01T00:54:59.650 INFO:teuthology.orchestra.run.smithi116.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-01T00:54:59.650 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-0.3.15-3.el8.x86_64 2023-12-01T00:54:59.650 INFO:teuthology.orchestra.run.smithi116.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-12-01T00:54:59.650 INFO:teuthology.orchestra.run.smithi116.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-12-01T00:54:59.650 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-01T00:54:59.650 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-01T00:54:59.651 INFO:teuthology.orchestra.run.smithi116.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-01T00:54:59.651 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-01T00:54:59.651 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-01T00:54:59.651 INFO:teuthology.orchestra.run.smithi116.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-01T00:54:59.651 INFO:teuthology.orchestra.run.smithi116.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-01T00:54:59.651 INFO:teuthology.orchestra.run.smithi116.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-01T00:54:59.651 INFO:teuthology.orchestra.run.smithi116.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-01T00:54:59.651 INFO:teuthology.orchestra.run.smithi116.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-01T00:54:59.651 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-01T00:54:59.651 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-argparse-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.651 INFO:teuthology.orchestra.run.smithi116.stdout: python3-ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.651 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cephfs-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.651 INFO:teuthology.orchestra.run.smithi116.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-01T00:54:59.651 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-12-01T00:54:59.652 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-01T00:54:59.652 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-01T00:54:59.652 INFO:teuthology.orchestra.run.smithi116.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-12-01T00:54:59.652 INFO:teuthology.orchestra.run.smithi116.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-01T00:54:59.652 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-01T00:54:59.652 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-01T00:54:59.652 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-01T00:54:59.652 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-01T00:54:59.652 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-01T00:54:59.652 INFO:teuthology.orchestra.run.smithi116.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-01T00:54:59.652 INFO:teuthology.orchestra.run.smithi116.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-01T00:54:59.652 INFO:teuthology.orchestra.run.smithi116.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-01T00:54:59.652 INFO:teuthology.orchestra.run.smithi116.stdout: python3-mako-1.0.6-13.el8.noarch 2023-12-01T00:54:59.652 INFO:teuthology.orchestra.run.smithi116.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-01T00:54:59.652 INFO:teuthology.orchestra.run.smithi116.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-01T00:54:59.653 INFO:teuthology.orchestra.run.smithi116.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-01T00:54:59.653 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-01T00:54:59.653 INFO:teuthology.orchestra.run.smithi116.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-01T00:54:59.653 INFO:teuthology.orchestra.run.smithi116.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-01T00:54:59.653 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-01T00:54:59.653 INFO:teuthology.orchestra.run.smithi116.stdout: python3-portend-2.6-1.el8.noarch 2023-12-01T00:54:59.653 INFO:teuthology.orchestra.run.smithi116.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-01T00:54:59.653 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-01T00:54:59.653 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-01T00:54:59.653 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-01T00:54:59.653 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-01T00:54:59.653 INFO:teuthology.orchestra.run.smithi116.stdout: python3-pytz-2017.2-9.el8.noarch 2023-12-01T00:54:59.654 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rados-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.654 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rbd-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.654 INFO:teuthology.orchestra.run.smithi116.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-01T00:54:59.654 INFO:teuthology.orchestra.run.smithi116.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-01T00:54:59.654 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rgw-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.654 INFO:teuthology.orchestra.run.smithi116.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-01T00:54:59.654 INFO:teuthology.orchestra.run.smithi116.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-01T00:54:59.654 INFO:teuthology.orchestra.run.smithi116.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-12-01T00:54:59.654 INFO:teuthology.orchestra.run.smithi116.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-01T00:54:59.655 INFO:teuthology.orchestra.run.smithi116.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-01T00:54:59.655 INFO:teuthology.orchestra.run.smithi116.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-01T00:54:59.655 INFO:teuthology.orchestra.run.smithi116.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-01T00:54:59.655 INFO:teuthology.orchestra.run.smithi116.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-01T00:54:59.655 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-01T00:54:59.655 INFO:teuthology.orchestra.run.smithi116.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-01T00:54:59.655 INFO:teuthology.orchestra.run.smithi116.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-01T00:54:59.655 INFO:teuthology.orchestra.run.smithi116.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-01T00:54:59.655 INFO:teuthology.orchestra.run.smithi116.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-01T00:54:59.655 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.655 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.655 INFO:teuthology.orchestra.run.smithi116.stdout: rbd-nbd-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:54:59.655 INFO:teuthology.orchestra.run.smithi116.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-01T00:54:59.655 INFO:teuthology.orchestra.run.smithi116.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-01T00:54:59.656 INFO:teuthology.orchestra.run.smithi116.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-01T00:54:59.656 INFO:teuthology.orchestra.run.smithi116.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-12-01T00:54:59.656 INFO:teuthology.orchestra.run.smithi116.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-01T00:54:59.657 INFO:teuthology.orchestra.run.smithi116.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-01T00:54:59.657 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-01T00:54:59.657 INFO:teuthology.orchestra.run.smithi116.stdout:Complete! 2023-12-01T00:54:59.746 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libcephfs-devel-2:18.2.0-1249.ga6f82997.el8.x86_ 121/134 2023-12-01T00:54:59.833 DEBUG:teuthology.parallel:result is None 2023-12-01T00:54:59.859 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-12-01T00:55:01.029 INFO:teuthology.orchestra.run.smithi093.stdout:Installed products updated. 2023-12-01T00:55:01.240 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-01T00:55:01.241 INFO:teuthology.orchestra.run.smithi093.stdout:Upgraded: 2023-12-01T00:55:01.241 INFO:teuthology.orchestra.run.smithi093.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-12-01T00:55:01.241 INFO:teuthology.orchestra.run.smithi093.stdout: librados2-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.241 INFO:teuthology.orchestra.run.smithi093.stdout: librbd1-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.241 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2023-12-01T00:55:01.241 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-12-01T00:55:01.241 INFO:teuthology.orchestra.run.smithi093.stdout: automake-1.16.1-7.el8.noarch 2023-12-01T00:55:01.241 INFO:teuthology.orchestra.run.smithi093.stdout: bison-3.0.4-10.el8.x86_64 2023-12-01T00:55:01.241 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.241 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-base-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.241 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.241 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.241 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-grafana-dashboards-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:01.242 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-immutable-object-cache-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.242 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mds-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.242 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.242 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-cephadm-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:01.242 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-dashboard-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:01.242 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:01.242 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-modules-core-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:01.242 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-rook-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:01.242 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mon-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.242 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-osd-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.242 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-prometheus-alerts-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:01.242 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-radosgw-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.242 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-selinux-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.242 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-test-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.243 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-volume-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:01.243 INFO:teuthology.orchestra.run.smithi093.stdout: cephadm-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:01.243 INFO:teuthology.orchestra.run.smithi093.stdout: cephfs-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.243 INFO:teuthology.orchestra.run.smithi093.stdout: cephfs-top-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:01.243 INFO:teuthology.orchestra.run.smithi093.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-12-01T00:55:01.243 INFO:teuthology.orchestra.run.smithi093.stdout: flex-2.6.1-9.el8.x86_64 2023-12-01T00:55:01.243 INFO:teuthology.orchestra.run.smithi093.stdout: fuse-2.9.7-15.el8.x86_64 2023-12-01T00:55:01.243 INFO:teuthology.orchestra.run.smithi093.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-01T00:55:01.243 INFO:teuthology.orchestra.run.smithi093.stdout: jq-1.6-3.el8.x86_64 2023-12-01T00:55:01.243 INFO:teuthology.orchestra.run.smithi093.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-01T00:55:01.243 INFO:teuthology.orchestra.run.smithi093.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-12-01T00:55:01.243 INFO:teuthology.orchestra.run.smithi093.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-01T00:55:01.243 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs-devel-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.243 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs2-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.244 INFO:teuthology.orchestra.run.smithi093.stdout: libcephsqlite-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.244 INFO:teuthology.orchestra.run.smithi093.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-01T00:55:01.244 INFO:teuthology.orchestra.run.smithi093.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-12-01T00:55:01.244 INFO:teuthology.orchestra.run.smithi093.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-01T00:55:01.244 INFO:teuthology.orchestra.run.smithi093.stdout: libpq-13.5-1.el8.x86_64 2023-12-01T00:55:01.244 INFO:teuthology.orchestra.run.smithi093.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-12-01T00:55:01.244 INFO:teuthology.orchestra.run.smithi093.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-12-01T00:55:01.244 INFO:teuthology.orchestra.run.smithi093.stdout: librados-devel-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.244 INFO:teuthology.orchestra.run.smithi093.stdout: libradosstriper1-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.244 INFO:teuthology.orchestra.run.smithi093.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-01T00:55:01.244 INFO:teuthology.orchestra.run.smithi093.stdout: librgw2-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.244 INFO:teuthology.orchestra.run.smithi093.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-01T00:55:01.244 INFO:teuthology.orchestra.run.smithi093.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-01T00:55:01.244 INFO:teuthology.orchestra.run.smithi093.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-01T00:55:01.244 INFO:teuthology.orchestra.run.smithi093.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-01T00:55:01.245 INFO:teuthology.orchestra.run.smithi093.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-12-01T00:55:01.245 INFO:teuthology.orchestra.run.smithi093.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-01T00:55:01.245 INFO:teuthology.orchestra.run.smithi093.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-01T00:55:01.245 INFO:teuthology.orchestra.run.smithi093.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-01T00:55:01.245 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-0.3.15-3.el8.x86_64 2023-12-01T00:55:01.245 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-12-01T00:55:01.245 INFO:teuthology.orchestra.run.smithi093.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-12-01T00:55:01.245 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-01T00:55:01.245 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-01T00:55:01.245 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-01T00:55:01.245 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-01T00:55:01.245 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-01T00:55:01.245 INFO:teuthology.orchestra.run.smithi093.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-01T00:55:01.245 INFO:teuthology.orchestra.run.smithi093.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-01T00:55:01.246 INFO:teuthology.orchestra.run.smithi093.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-01T00:55:01.246 INFO:teuthology.orchestra.run.smithi093.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-01T00:55:01.246 INFO:teuthology.orchestra.run.smithi093.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-01T00:55:01.246 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-01T00:55:01.246 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-argparse-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.246 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.246 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cephfs-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.246 INFO:teuthology.orchestra.run.smithi093.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-01T00:55:01.246 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-12-01T00:55:01.246 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-01T00:55:01.246 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-01T00:55:01.246 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-12-01T00:55:01.246 INFO:teuthology.orchestra.run.smithi093.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-01T00:55:01.246 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-01T00:55:01.247 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-01T00:55:01.247 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-01T00:55:01.247 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-01T00:55:01.247 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-01T00:55:01.247 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-01T00:55:01.247 INFO:teuthology.orchestra.run.smithi093.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-01T00:55:01.247 INFO:teuthology.orchestra.run.smithi093.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-01T00:55:01.247 INFO:teuthology.orchestra.run.smithi093.stdout: python3-mako-1.0.6-13.el8.noarch 2023-12-01T00:55:01.247 INFO:teuthology.orchestra.run.smithi093.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-01T00:55:01.247 INFO:teuthology.orchestra.run.smithi093.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-01T00:55:01.247 INFO:teuthology.orchestra.run.smithi093.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-01T00:55:01.247 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-01T00:55:01.247 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-01T00:55:01.247 INFO:teuthology.orchestra.run.smithi093.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-01T00:55:01.247 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-01T00:55:01.248 INFO:teuthology.orchestra.run.smithi093.stdout: python3-portend-2.6-1.el8.noarch 2023-12-01T00:55:01.248 INFO:teuthology.orchestra.run.smithi093.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-01T00:55:01.248 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-01T00:55:01.248 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-01T00:55:01.248 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-01T00:55:01.248 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-01T00:55:01.248 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytz-2017.2-9.el8.noarch 2023-12-01T00:55:01.248 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rados-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.248 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rbd-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.248 INFO:teuthology.orchestra.run.smithi093.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-01T00:55:01.248 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-01T00:55:01.248 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rgw-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.248 INFO:teuthology.orchestra.run.smithi093.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-01T00:55:01.248 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-01T00:55:01.248 INFO:teuthology.orchestra.run.smithi093.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-12-01T00:55:01.249 INFO:teuthology.orchestra.run.smithi093.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-01T00:55:01.249 INFO:teuthology.orchestra.run.smithi093.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-01T00:55:01.249 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-01T00:55:01.249 INFO:teuthology.orchestra.run.smithi093.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-01T00:55:01.249 INFO:teuthology.orchestra.run.smithi093.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-01T00:55:01.249 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-01T00:55:01.249 INFO:teuthology.orchestra.run.smithi093.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-01T00:55:01.249 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-01T00:55:01.249 INFO:teuthology.orchestra.run.smithi093.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-01T00:55:01.249 INFO:teuthology.orchestra.run.smithi093.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-01T00:55:01.249 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.249 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.249 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-nbd-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:01.249 INFO:teuthology.orchestra.run.smithi093.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-01T00:55:01.250 INFO:teuthology.orchestra.run.smithi093.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-01T00:55:01.250 INFO:teuthology.orchestra.run.smithi093.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-01T00:55:01.250 INFO:teuthology.orchestra.run.smithi093.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-12-01T00:55:01.250 INFO:teuthology.orchestra.run.smithi093.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-01T00:55:01.250 INFO:teuthology.orchestra.run.smithi093.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-01T00:55:01.250 INFO:teuthology.orchestra.run.smithi093.stdout: 2023-12-01T00:55:01.250 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2023-12-01T00:55:01.444 DEBUG:teuthology.parallel:result is None 2023-12-01T00:55:02.197 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-12-01T00:55:02.408 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-12-01T00:55:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-12-01T00:55:02.601 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : cephfs-top-2:18.2.0-1249.ga6f82997.el8.noarch 124/134 2023-12-01T00:55:02.875 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 125/134 2023-12-01T00:55:03.156 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : rbd-nbd-2:18.2.0-1249.ga6f82997.el8.x86_64 126/134 2023-12-01T00:55:03.536 INFO:teuthology.orchestra.run.smithi026.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-12-01T00:55:03.741 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-12-01T00:55:03.839 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-12-01T00:55:04.032 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-12-01T00:55:04.045 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-12-01T00:55:04.182 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-12-01T00:55:04.191 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-12-01T00:55:04.335 INFO:teuthology.orchestra.run.smithi026.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-12-01T00:55:04.335 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-12-01T00:55:04.520 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-12-01T00:55:04.520 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-12-01T00:55:04.756 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-12-01T00:55:04.990 INFO:teuthology.orchestra.run.smithi026.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-12-01T00:55:05.582 INFO:teuthology.orchestra.run.smithi026.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-12-01T00:55:05.582 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-2:18.2.0-1249.ga6f82997.el8.x86_64 1/134 2023-12-01T00:55:05.582 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-base-2:18.2.0-1249.ga6f82997.el8.x86_64 2/134 2023-12-01T00:55:05.582 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 3/134 2023-12-01T00:55:05.582 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 4/134 2023-12-01T00:55:05.582 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-immutable-object-cache-2:18.2.0-1249.ga6f82 5/134 2023-12-01T00:55:05.582 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mds-2:18.2.0-1249.ga6f82997.el8.x86_64 6/134 2023-12-01T00:55:05.582 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-2:18.2.0-1249.ga6f82997.el8.x86_64 7/134 2023-12-01T00:55:05.582 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mon-2:18.2.0-1249.ga6f82997.el8.x86_64 8/134 2023-12-01T00:55:05.582 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-osd-2:18.2.0-1249.ga6f82997.el8.x86_64 9/134 2023-12-01T00:55:05.583 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-radosgw-2:18.2.0-1249.ga6f82997.el8.x86_64 10/134 2023-12-01T00:55:05.583 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-selinux-2:18.2.0-1249.ga6f82997.el8.x86_64 11/134 2023-12-01T00:55:05.583 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-test-2:18.2.0-1249.ga6f82997.el8.x86_64 12/134 2023-12-01T00:55:05.583 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 13/134 2023-12-01T00:55:05.583 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs-devel-2:18.2.0-1249.ga6f82997.el8.x86_ 14/134 2023-12-01T00:55:05.583 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephfs2-2:18.2.0-1249.ga6f82997.el8.x86_64 15/134 2023-12-01T00:55:05.583 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcephsqlite-2:18.2.0-1249.ga6f82997.el8.x86_64 16/134 2023-12-01T00:55:05.583 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados-devel-2:18.2.0-1249.ga6f82997.el8.x86_6 17/134 2023-12-01T00:55:05.583 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libradosstriper1-2:18.2.0-1249.ga6f82997.el8.x86 18/134 2023-12-01T00:55:05.583 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librgw2-2:18.2.0-1249.ga6f82997.el8.x86_64 19/134 2023-12-01T00:55:05.583 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-argparse-2:18.2.0-1249.ga6f82997.el 20/134 2023-12-01T00:55:05.583 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-ceph-common-2:18.2.0-1249.ga6f82997.el8. 21/134 2023-12-01T00:55:05.583 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cephfs-2:18.2.0-1249.ga6f82997.el8.x86_6 22/134 2023-12-01T00:55:05.583 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rados-2:18.2.0-1249.ga6f82997.el8.x86_64 23/134 2023-12-01T00:55:05.583 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rbd-2:18.2.0-1249.ga6f82997.el8.x86_64 24/134 2023-12-01T00:55:05.584 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rgw-2:18.2.0-1249.ga6f82997.el8.x86_64 25/134 2023-12-01T00:55:05.584 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 26/134 2023-12-01T00:55:05.584 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 27/134 2023-12-01T00:55:05.584 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : rbd-nbd-2:18.2.0-1249.ga6f82997.el8.x86_64 28/134 2023-12-01T00:55:05.584 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-grafana-dashboards-2:18.2.0-1249.ga6f82997. 29/134 2023-12-01T00:55:05.584 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-cephadm-2:18.2.0-1249.ga6f82997.el8.noa 30/134 2023-12-01T00:55:05.584 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-dashboard-2:18.2.0-1249.ga6f82997.el8.n 31/134 2023-12-01T00:55:05.584 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.0-1249.ga6f 32/134 2023-12-01T00:55:05.584 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-modules-core-2:18.2.0-1249.ga6f82997.el 33/134 2023-12-01T00:55:05.584 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-mgr-rook-2:18.2.0-1249.ga6f82997.el8.noarch 34/134 2023-12-01T00:55:05.584 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-prometheus-alerts-2:18.2.0-1249.ga6f82997.e 35/134 2023-12-01T00:55:05.584 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : ceph-volume-2:18.2.0-1249.ga6f82997.el8.noarch 36/134 2023-12-01T00:55:05.584 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephadm-2:18.2.0-1249.ga6f82997.el8.noarch 37/134 2023-12-01T00:55:05.584 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : cephfs-top-2:18.2.0-1249.ga6f82997.el8.noarch 38/134 2023-12-01T00:55:05.584 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-12-01T00:55:05.585 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-12-01T00:55:05.585 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-12-01T00:55:05.585 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-12-01T00:55:05.585 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-12-01T00:55:05.585 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-12-01T00:55:05.585 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-12-01T00:55:05.585 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-12-01T00:55:05.585 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-12-01T00:55:05.585 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-12-01T00:55:05.585 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-12-01T00:55:05.585 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-12-01T00:55:05.585 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-12-01T00:55:05.585 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-12-01T00:55:05.585 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-12-01T00:55:05.585 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-12-01T00:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-12-01T00:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-12-01T00:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-12-01T00:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-12-01T00:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-12-01T00:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-12-01T00:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-12-01T00:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-12-01T00:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-12-01T00:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-12-01T00:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-12-01T00:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-12-01T00:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-12-01T00:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-12-01T00:55:05.586 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-12-01T00:55:05.587 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-12-01T00:55:05.587 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-12-01T00:55:05.587 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-12-01T00:55:05.587 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-12-01T00:55:05.587 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-12-01T00:55:05.587 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-12-01T00:55:05.587 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-12-01T00:55:05.587 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-12-01T00:55:05.587 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-12-01T00:55:05.587 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-12-01T00:55:05.587 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-12-01T00:55:05.587 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-12-01T00:55:05.587 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-12-01T00:55:05.587 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-12-01T00:55:05.587 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-12-01T00:55:05.588 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-12-01T00:55:05.588 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-12-01T00:55:05.588 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-12-01T00:55:05.588 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-12-01T00:55:05.588 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-12-01T00:55:05.588 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-12-01T00:55:05.588 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-12-01T00:55:05.588 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-12-01T00:55:05.588 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-12-01T00:55:05.588 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-12-01T00:55:05.588 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-12-01T00:55:05.588 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-12-01T00:55:05.588 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-12-01T00:55:05.588 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-12-01T00:55:05.588 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-12-01T00:55:05.588 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-12-01T00:55:05.589 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-12-01T00:55:05.589 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-12-01T00:55:05.589 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-12-01T00:55:05.589 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-12-01T00:55:05.589 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-12-01T00:55:05.589 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-12-01T00:55:05.589 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-12-01T00:55:05.589 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-12-01T00:55:05.589 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-12-01T00:55:05.589 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-12-01T00:55:05.589 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-12-01T00:55:05.589 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-12-01T00:55:05.589 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-12-01T00:55:05.589 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-12-01T00:55:05.590 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-12-01T00:55:05.590 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-12-01T00:55:05.590 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-12-01T00:55:05.590 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-12-01T00:55:05.590 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-12-01T00:55:05.590 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-12-01T00:55:05.590 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-12-01T00:55:05.590 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-12-01T00:55:05.590 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-12-01T00:55:05.590 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-12-01T00:55:05.590 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-12-01T00:55:05.590 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-12-01T00:55:05.590 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-12-01T00:55:05.590 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-12-01T00:55:05.590 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-2:18.2.0-1249.ga6f82997.el8.x86_64 129/134 2023-12-01T00:55:05.591 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-12-01T00:55:05.591 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-2:18.2.0-1249.ga6f82997.el8.x86_64 131/134 2023-12-01T00:55:05.591 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-12-01T00:55:05.591 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-12-01T00:55:08.106 INFO:teuthology.orchestra.run.smithi026.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-12-01T00:55:08.107 INFO:teuthology.orchestra.run.smithi026.stdout:Last metadata expiration check: 0:01:58 ago on Fri 01 Dec 2023 12:53:10 AM UTC. 2023-12-01T00:55:10.881 INFO:teuthology.orchestra.run.smithi026.stdout:Installed products updated. 2023-12-01T00:55:11.114 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:55:11.114 INFO:teuthology.orchestra.run.smithi026.stdout:Upgraded: 2023-12-01T00:55:11.114 INFO:teuthology.orchestra.run.smithi026.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-12-01T00:55:11.115 INFO:teuthology.orchestra.run.smithi026.stdout: librados2-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.115 INFO:teuthology.orchestra.run.smithi026.stdout: librbd1-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.115 INFO:teuthology.orchestra.run.smithi026.stdout:Installed: 2023-12-01T00:55:11.115 INFO:teuthology.orchestra.run.smithi026.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-12-01T00:55:11.115 INFO:teuthology.orchestra.run.smithi026.stdout: automake-1.16.1-7.el8.noarch 2023-12-01T00:55:11.115 INFO:teuthology.orchestra.run.smithi026.stdout: bison-3.0.4-10.el8.x86_64 2023-12-01T00:55:11.115 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.115 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.115 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.116 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.116 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-grafana-dashboards-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:11.116 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-immutable-object-cache-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.116 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mds-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.116 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.116 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-cephadm-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:11.116 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:11.116 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-diskprediction-local-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:11.116 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:11.116 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-rook-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:11.116 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mon-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.117 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-osd-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.117 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-prometheus-alerts-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:11.117 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-radosgw-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.117 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-selinux-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.117 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-test-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.117 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-volume-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:11.117 INFO:teuthology.orchestra.run.smithi026.stdout: cephadm-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:11.117 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.117 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-top-2:18.2.0-1249.ga6f82997.el8.noarch 2023-12-01T00:55:11.117 INFO:teuthology.orchestra.run.smithi026.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-12-01T00:55:11.118 INFO:teuthology.orchestra.run.smithi026.stdout: flex-2.6.1-9.el8.x86_64 2023-12-01T00:55:11.118 INFO:teuthology.orchestra.run.smithi026.stdout: fuse-2.9.7-15.el8.x86_64 2023-12-01T00:55:11.118 INFO:teuthology.orchestra.run.smithi026.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-01T00:55:11.118 INFO:teuthology.orchestra.run.smithi026.stdout: jq-1.6-3.el8.x86_64 2023-12-01T00:55:11.118 INFO:teuthology.orchestra.run.smithi026.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-01T00:55:11.118 INFO:teuthology.orchestra.run.smithi026.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-12-01T00:55:11.118 INFO:teuthology.orchestra.run.smithi026.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-01T00:55:11.118 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs-devel-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.119 INFO:teuthology.orchestra.run.smithi026.stdout: libcephfs2-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.119 INFO:teuthology.orchestra.run.smithi026.stdout: libcephsqlite-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.119 INFO:teuthology.orchestra.run.smithi026.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-01T00:55:11.119 INFO:teuthology.orchestra.run.smithi026.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-12-01T00:55:11.119 INFO:teuthology.orchestra.run.smithi026.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-01T00:55:11.119 INFO:teuthology.orchestra.run.smithi026.stdout: libpq-13.5-1.el8.x86_64 2023-12-01T00:55:11.119 INFO:teuthology.orchestra.run.smithi026.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-12-01T00:55:11.119 INFO:teuthology.orchestra.run.smithi026.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-12-01T00:55:11.119 INFO:teuthology.orchestra.run.smithi026.stdout: librados-devel-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.119 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.119 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-01T00:55:11.119 INFO:teuthology.orchestra.run.smithi026.stdout: librgw2-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.120 INFO:teuthology.orchestra.run.smithi026.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-01T00:55:11.120 INFO:teuthology.orchestra.run.smithi026.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-01T00:55:11.120 INFO:teuthology.orchestra.run.smithi026.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-01T00:55:11.120 INFO:teuthology.orchestra.run.smithi026.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-01T00:55:11.120 INFO:teuthology.orchestra.run.smithi026.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-12-01T00:55:11.120 INFO:teuthology.orchestra.run.smithi026.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-01T00:55:11.121 INFO:teuthology.orchestra.run.smithi026.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-01T00:55:11.121 INFO:teuthology.orchestra.run.smithi026.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-01T00:55:11.121 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-0.3.15-3.el8.x86_64 2023-12-01T00:55:11.121 INFO:teuthology.orchestra.run.smithi026.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-12-01T00:55:11.121 INFO:teuthology.orchestra.run.smithi026.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-12-01T00:55:11.121 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-01T00:55:11.121 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-01T00:55:11.121 INFO:teuthology.orchestra.run.smithi026.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-01T00:55:11.122 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-01T00:55:11.122 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-01T00:55:11.122 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-12-01T00:55:11.122 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-01T00:55:11.122 INFO:teuthology.orchestra.run.smithi026.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-01T00:55:11.122 INFO:teuthology.orchestra.run.smithi026.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-01T00:55:11.122 INFO:teuthology.orchestra.run.smithi026.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-01T00:55:11.122 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-01T00:55:11.122 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.122 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-common-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.123 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cephfs-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.123 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-01T00:55:11.123 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-12-01T00:55:11.123 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-01T00:55:11.123 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-01T00:55:11.123 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-12-01T00:55:11.123 INFO:teuthology.orchestra.run.smithi026.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-01T00:55:11.123 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-01T00:55:11.123 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-01T00:55:11.123 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-01T00:55:11.123 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-01T00:55:11.123 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-01T00:55:11.123 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-01T00:55:11.124 INFO:teuthology.orchestra.run.smithi026.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-01T00:55:11.124 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-01T00:55:11.124 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako-1.0.6-13.el8.noarch 2023-12-01T00:55:11.124 INFO:teuthology.orchestra.run.smithi026.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-01T00:55:11.124 INFO:teuthology.orchestra.run.smithi026.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-01T00:55:11.124 INFO:teuthology.orchestra.run.smithi026.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-01T00:55:11.124 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-01T00:55:11.124 INFO:teuthology.orchestra.run.smithi026.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-01T00:55:11.124 INFO:teuthology.orchestra.run.smithi026.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-01T00:55:11.124 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-01T00:55:11.124 INFO:teuthology.orchestra.run.smithi026.stdout: python3-portend-2.6-1.el8.noarch 2023-12-01T00:55:11.124 INFO:teuthology.orchestra.run.smithi026.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-01T00:55:11.124 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-01T00:55:11.124 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-01T00:55:11.125 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-01T00:55:11.125 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-01T00:55:11.125 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pytz-2017.2-9.el8.noarch 2023-12-01T00:55:11.125 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.125 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rbd-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.125 INFO:teuthology.orchestra.run.smithi026.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-01T00:55:11.125 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-01T00:55:11.125 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rgw-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.126 INFO:teuthology.orchestra.run.smithi026.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-01T00:55:11.126 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-01T00:55:11.126 INFO:teuthology.orchestra.run.smithi026.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-12-01T00:55:11.126 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-01T00:55:11.126 INFO:teuthology.orchestra.run.smithi026.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-01T00:55:11.126 INFO:teuthology.orchestra.run.smithi026.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-01T00:55:11.126 INFO:teuthology.orchestra.run.smithi026.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-01T00:55:11.126 INFO:teuthology.orchestra.run.smithi026.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-01T00:55:11.126 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-01T00:55:11.126 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-01T00:55:11.129 INFO:teuthology.orchestra.run.smithi026.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-01T00:55:11.129 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-01T00:55:11.129 INFO:teuthology.orchestra.run.smithi026.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-01T00:55:11.129 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-fuse-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.129 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-mirror-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.129 INFO:teuthology.orchestra.run.smithi026.stdout: rbd-nbd-2:18.2.0-1249.ga6f82997.el8.x86_64 2023-12-01T00:55:11.129 INFO:teuthology.orchestra.run.smithi026.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-01T00:55:11.129 INFO:teuthology.orchestra.run.smithi026.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-01T00:55:11.129 INFO:teuthology.orchestra.run.smithi026.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-01T00:55:11.130 INFO:teuthology.orchestra.run.smithi026.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-12-01T00:55:11.130 INFO:teuthology.orchestra.run.smithi026.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-01T00:55:11.131 INFO:teuthology.orchestra.run.smithi026.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-01T00:55:11.131 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:55:11.131 INFO:teuthology.orchestra.run.smithi026.stdout:Complete! 2023-12-01T00:55:11.365 DEBUG:teuthology.parallel:result is None 2023-12-01T00:55:11.365 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T00:55:11.508 DEBUG:teuthology.orchestra.run.smithi026:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-01T00:55:11.532 INFO:teuthology.orchestra.run.smithi026.stdout:18.2.0-1249.ga6f82997.el8 2023-12-01T00:55:11.533 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1249.ga6f82997.el8 2023-12-01T00:55:11.533 INFO:teuthology.task.install:The correct ceph version 18.2.0-1249.ga6f82997 is installed. 2023-12-01T00:55:11.533 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T00:55:11.679 DEBUG:teuthology.orchestra.run.smithi093:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-01T00:55:11.707 INFO:teuthology.orchestra.run.smithi093.stdout:18.2.0-1249.ga6f82997.el8 2023-12-01T00:55:11.708 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1249.ga6f82997.el8 2023-12-01T00:55:11.708 INFO:teuthology.task.install:The correct ceph version 18.2.0-1249.ga6f82997 is installed. 2023-12-01T00:55:11.708 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T00:55:11.926 DEBUG:teuthology.orchestra.run.smithi116:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-01T00:55:11.954 INFO:teuthology.orchestra.run.smithi116.stdout:18.2.0-1249.ga6f82997.el8 2023-12-01T00:55:11.955 INFO:teuthology.packaging:The installed version of ceph is 18.2.0-1249.ga6f82997.el8 2023-12-01T00:55:11.955 INFO:teuthology.task.install:The correct ceph version 18.2.0-1249.ga6f82997 is installed. 2023-12-01T00:55:11.955 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-01T00:55:11.955 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T00:55:11.955 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-01T00:55:12.000 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-01T00:55:12.000 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-01T00:55:12.049 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-12-01T00:55:12.049 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-01T00:55:12.095 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-01T00:55:12.095 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T00:55:12.095 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2023-12-01T00:55:12.124 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-01T00:55:12.192 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-01T00:55:12.193 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/daemon-helper 2023-12-01T00:55:12.224 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-01T00:55:12.294 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-12-01T00:55:12.295 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/daemon-helper 2023-12-01T00:55:12.326 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-01T00:55:12.396 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-01T00:55:12.396 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T00:55:12.396 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-01T00:55:12.424 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-01T00:55:12.491 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-01T00:55:12.491 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-01T00:55:12.523 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-01T00:55:12.596 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-12-01T00:55:12.596 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-01T00:55:12.629 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-01T00:55:12.700 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-01T00:55:12.700 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T00:55:12.700 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/stdin-killer 2023-12-01T00:55:12.728 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-01T00:55:12.795 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-01T00:55:12.795 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/stdin-killer 2023-12-01T00:55:12.826 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-01T00:55:12.896 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-12-01T00:55:12.896 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/usr/bin/stdin-killer 2023-12-01T00:55:12.928 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-01T00:55:13.001 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-01T00:55:13.090 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2023-12-01T00:55:13.091 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T00:55:13.092 INFO:tasks.cephadm:Cluster fsid is 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:55:13.092 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-01T00:55:13.092 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.26', 'mon.b': '172.21.15.93', 'mon.c': '172.21.15.116'} 2023-12-01T00:55:13.092 INFO:tasks.cephadm:First mon is mon.a on smithi026 2023-12-01T00:55:13.092 INFO:tasks.cephadm:First mgr is x 2023-12-01T00:55:13.092 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-01T00:55:13.092 DEBUG:teuthology.orchestra.run.smithi026:> sudo hostname $(hostname -s) 2023-12-01T00:55:13.121 DEBUG:teuthology.orchestra.run.smithi093:> sudo hostname $(hostname -s) 2023-12-01T00:55:13.152 DEBUG:teuthology.orchestra.run.smithi116:> sudo hostname $(hostname -s) 2023-12-01T00:55:13.185 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-12-01T00:55:13.186 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T00:55:13.326 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'a6f82997ac57b70a895455dfed6256360a1e4c32', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/74585/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.2.0-1249-ga6f82997', 'node_name': '172.21.4.65+confusa03', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.2.0-1249.ga6f82997'}, 'url': 'https://3.chacra.ceph.com/r/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-11-30 23:20:29.682137', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'reef-release', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}] 2023-12-01T00:55:13.551 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref reef-release, sha1 a6f82997ac57b70a895455dfed6256360a1e4c32 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T00:55:13.551 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/x86_64/flavors/default/cephadm 2023-12-01T00:55:13.551 DEBUG:teuthology.orchestra.run.smithi026:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-01T00:55:14.243 INFO:teuthology.orchestra.run.smithi026.stdout:-rw-rw-r--. 1 ubuntu ubuntu 690689 Dec 1 00:55 /home/ubuntu/cephtest/cephadm 2023-12-01T00:55:14.244 DEBUG:teuthology.orchestra.run.smithi093:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-01T00:55:14.773 INFO:teuthology.orchestra.run.smithi093.stdout:-rw-rw-r--. 1 ubuntu ubuntu 690689 Dec 1 00:55 /home/ubuntu/cephtest/cephadm 2023-12-01T00:55:14.773 DEBUG:teuthology.orchestra.run.smithi116:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef-release/a6f82997ac57b70a895455dfed6256360a1e4c32/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-01T00:55:15.426 INFO:teuthology.orchestra.run.smithi116.stdout:-rw-rw-r--. 1 ubuntu ubuntu 690689 Dec 1 00:55 /home/ubuntu/cephtest/cephadm 2023-12-01T00:55:15.426 DEBUG:teuthology.orchestra.run.smithi026:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-01T00:55:15.449 DEBUG:teuthology.orchestra.run.smithi093:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-01T00:55:15.471 DEBUG:teuthology.orchestra.run.smithi116:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-01T00:55:15.509 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 on all hosts... 2023-12-01T00:55:15.509 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 pull 2023-12-01T00:55:15.512 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 pull 2023-12-01T00:55:15.514 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 pull 2023-12-01T00:55:18.485 INFO:teuthology.orchestra.run.smithi116.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32... 2023-12-01T00:55:18.803 INFO:teuthology.orchestra.run.smithi093.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32... 2023-12-01T00:55:21.471 INFO:teuthology.orchestra.run.smithi026.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32... 2023-12-01T00:55:46.760 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T00:55:46.760 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 18.2.0-1249-ga6f82997 (a6f82997ac57b70a895455dfed6256360a1e4c32) reef (stable)", 2023-12-01T00:55:46.760 INFO:teuthology.orchestra.run.smithi026.stdout: "image_id": "96d837748436087e6a178851a9eca1321e50ebbd34bb41f0a6c21f217e801f91", 2023-12-01T00:55:46.761 INFO:teuthology.orchestra.run.smithi026.stdout: "repo_digests": [ 2023-12-01T00:55:46.761 INFO:teuthology.orchestra.run.smithi026.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:7cce186d5741e90182960931ace897a7b2a2061bc709a9daf86e9971f6fbef16" 2023-12-01T00:55:46.761 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-12-01T00:55:46.761 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T00:55:49.303 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-12-01T00:55:49.303 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_version": "ceph version 18.2.0-1249-ga6f82997 (a6f82997ac57b70a895455dfed6256360a1e4c32) reef (stable)", 2023-12-01T00:55:49.303 INFO:teuthology.orchestra.run.smithi093.stdout: "image_id": "96d837748436087e6a178851a9eca1321e50ebbd34bb41f0a6c21f217e801f91", 2023-12-01T00:55:49.303 INFO:teuthology.orchestra.run.smithi093.stdout: "repo_digests": [ 2023-12-01T00:55:49.303 INFO:teuthology.orchestra.run.smithi093.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:7cce186d5741e90182960931ace897a7b2a2061bc709a9daf86e9971f6fbef16" 2023-12-01T00:55:49.303 INFO:teuthology.orchestra.run.smithi093.stdout: ] 2023-12-01T00:55:49.303 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-12-01T00:55:49.493 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2023-12-01T00:55:49.493 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_version": "ceph version 18.2.0-1249-ga6f82997 (a6f82997ac57b70a895455dfed6256360a1e4c32) reef (stable)", 2023-12-01T00:55:49.493 INFO:teuthology.orchestra.run.smithi116.stdout: "image_id": "96d837748436087e6a178851a9eca1321e50ebbd34bb41f0a6c21f217e801f91", 2023-12-01T00:55:49.493 INFO:teuthology.orchestra.run.smithi116.stdout: "repo_digests": [ 2023-12-01T00:55:49.493 INFO:teuthology.orchestra.run.smithi116.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:7cce186d5741e90182960931ace897a7b2a2061bc709a9daf86e9971f6fbef16" 2023-12-01T00:55:49.493 INFO:teuthology.orchestra.run.smithi116.stdout: ] 2023-12-01T00:55:49.493 INFO:teuthology.orchestra.run.smithi116.stdout:} 2023-12-01T00:55:49.512 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph 2023-12-01T00:55:49.550 DEBUG:teuthology.orchestra.run.smithi093:> sudo mkdir -p /etc/ceph 2023-12-01T00:55:49.581 DEBUG:teuthology.orchestra.run.smithi116:> sudo mkdir -p /etc/ceph 2023-12-01T00:55:49.610 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 777 /etc/ceph 2023-12-01T00:55:49.642 DEBUG:teuthology.orchestra.run.smithi093:> sudo chmod 777 /etc/ceph 2023-12-01T00:55:49.669 DEBUG:teuthology.orchestra.run.smithi116:> sudo chmod 777 /etc/ceph 2023-12-01T00:55:49.695 INFO:tasks.cephadm:Writing seed config... 2023-12-01T00:55:49.696 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2023-12-01T00:55:49.696 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-01T00:55:49.696 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-01T00:55:49.696 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-01T00:55:49.696 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-01T00:55:49.697 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-01T00:55:49.697 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-12-01T00:55:49.697 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-01T00:55:49.697 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-01T00:55:49.697 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-01T00:55:49.697 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-12-01T00:55:49.697 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-12-01T00:55:49.697 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-12-01T00:55:49.697 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-12-01T00:55:49.697 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-01T00:55:49.697 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-01T00:55:49.697 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-01T00:55:49.697 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-01T00:55:49.697 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-12-01T00:55:49.697 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-01T00:55:49.697 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-01T00:55:49.698 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-01T00:55:49.698 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-12-01T00:55:49.698 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-01T00:55:49.698 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-01T00:55:49.698 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-01T00:55:49.698 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-01T00:55:49.698 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-01T00:55:49.698 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-01T00:55:49.698 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-01T00:55:49.698 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2023-12-01T00:55:49.698 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-01T00:55:49.698 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-12-01T00:55:49.698 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-12-01T00:55:49.698 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-01T00:55:49.698 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-01T00:55:49.699 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-12-01T00:55:49.699 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-01T00:55:49.699 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-01T00:55:49.699 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-01T00:55:49.699 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-01T00:55:49.699 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-01T00:55:49.699 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-01T00:55:49.699 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-12-01T00:55:49.699 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2023-12-01T00:55:49.700 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T00:55:49.700 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-01T00:55:49.720 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 48bff570-8fe4-11ee-95a2-87774f69a715 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-01T00:55:49.720 DEBUG:teuthology.orchestra.run.smithi026:mon.a> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mon.a.service 2023-12-01T00:55:49.763 DEBUG:teuthology.orchestra.run.smithi026:mgr.x> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mgr.x.service 2023-12-01T00:55:49.794 INFO:journalctl@ceph.mon.a.smithi026.stdout:-- Logs begin at Fri 2023-12-01 00:41:45 UTC. -- 2023-12-01T00:55:49.795 INFO:tasks.cephadm:Bootstrapping... 2023-12-01T00:55:49.796 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 -v bootstrap --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.26 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-01T00:55:49.824 INFO:journalctl@ceph.mgr.x.smithi026.stdout:-- Logs begin at Fri 2023-12-01 00:41:45 UTC. -- 2023-12-01T00:55:49.966 INFO:teuthology.orchestra.run.smithi026.stdout:-------------------------------------------------------------------------------- 2023-12-01T00:55:49.966 INFO:teuthology.orchestra.run.smithi026.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32', '-v', 'bootstrap', '--fsid', '48bff570-8fe4-11ee-95a2-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.26', '--skip-admin-label'] 2023-12-01T00:55:50.110 INFO:teuthology.orchestra.run.smithi026.stdout:/bin/podman: stdout 4.1.1 2023-12-01T00:55:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-01T00:55:50.110 INFO:teuthology.orchestra.run.smithi026.stdout:Verifying podman|docker is present... 2023-12-01T00:55:50.258 INFO:teuthology.orchestra.run.smithi026.stdout:/bin/podman: stdout 4.1.1 2023-12-01T00:55:50.258 INFO:teuthology.orchestra.run.smithi026.stdout:Verifying lvm2 is present... 2023-12-01T00:55:50.258 INFO:teuthology.orchestra.run.smithi026.stdout:Verifying time synchronization is in place... 2023-12-01T00:55:50.265 INFO:teuthology.orchestra.run.smithi026.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-01T00:55:50.266 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-01T00:55:50.271 INFO:teuthology.orchestra.run.smithi026.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-01T00:55:50.271 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stdout inactive 2023-12-01T00:55:50.277 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stdout enabled 2023-12-01T00:55:50.283 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stdout active 2023-12-01T00:55:50.284 INFO:teuthology.orchestra.run.smithi026.stdout:Unit chronyd.service is enabled and running 2023-12-01T00:55:50.284 INFO:teuthology.orchestra.run.smithi026.stdout:Repeating the final host check... 2023-12-01T00:55:50.432 INFO:teuthology.orchestra.run.smithi026.stdout:/bin/podman: stdout 4.1.1 2023-12-01T00:55:50.432 INFO:teuthology.orchestra.run.smithi026.stdout:podman (/bin/podman) version 4.1.1 is present 2023-12-01T00:55:50.432 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl is present 2023-12-01T00:55:50.432 INFO:teuthology.orchestra.run.smithi026.stdout:lvcreate is present 2023-12-01T00:55:50.438 INFO:teuthology.orchestra.run.smithi026.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-01T00:55:50.438 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-01T00:55:50.446 INFO:teuthology.orchestra.run.smithi026.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-01T00:55:50.446 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stdout inactive 2023-12-01T00:55:50.450 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stdout enabled 2023-12-01T00:55:50.456 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stdout active 2023-12-01T00:55:50.456 INFO:teuthology.orchestra.run.smithi026.stdout:Unit chronyd.service is enabled and running 2023-12-01T00:55:50.456 INFO:teuthology.orchestra.run.smithi026.stdout:Host looks OK 2023-12-01T00:55:50.456 INFO:teuthology.orchestra.run.smithi026.stdout:Cluster fsid: 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:55:50.456 INFO:teuthology.orchestra.run.smithi026.stdout:Acquiring lock 140433549482472 on /run/cephadm/48bff570-8fe4-11ee-95a2-87774f69a715.lock 2023-12-01T00:55:50.456 INFO:teuthology.orchestra.run.smithi026.stdout:Lock 140433549482472 acquired on /run/cephadm/48bff570-8fe4-11ee-95a2-87774f69a715.lock 2023-12-01T00:55:50.457 INFO:teuthology.orchestra.run.smithi026.stdout:Verifying IP 172.21.15.26 port 3300 ... 2023-12-01T00:55:50.457 INFO:teuthology.orchestra.run.smithi026.stdout:Verifying IP 172.21.15.26 port 6789 ... 2023-12-01T00:55:50.457 INFO:teuthology.orchestra.run.smithi026.stdout:Base mon IP(s) is [172.21.15.26:3300, 172.21.15.26:6789], mon addrv is [v2:172.21.15.26:3300,v1:172.21.15.26:6789] 2023-12-01T00:55:50.461 INFO:teuthology.orchestra.run.smithi026.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-12-01T00:55:50.461 INFO:teuthology.orchestra.run.smithi026.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.26 metric 100 2023-12-01T00:55:50.463 INFO:teuthology.orchestra.run.smithi026.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-01T00:55:50.464 INFO:teuthology.orchestra.run.smithi026.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-12-01T00:55:50.464 INFO:teuthology.orchestra.run.smithi026.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1795sec hoplimit 64 pref medium 2023-12-01T00:55:50.466 INFO:teuthology.orchestra.run.smithi026.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-01T00:55:50.466 INFO:teuthology.orchestra.run.smithi026.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-01T00:55:50.466 INFO:teuthology.orchestra.run.smithi026.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-01T00:55:50.466 INFO:teuthology.orchestra.run.smithi026.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-12-01T00:55:50.466 INFO:teuthology.orchestra.run.smithi026.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-12-01T00:55:50.466 INFO:teuthology.orchestra.run.smithi026.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-01T00:55:50.467 INFO:teuthology.orchestra.run.smithi026.stdout:Mon IP `172.21.15.26` is in CIDR network `172.21.0.0/20` 2023-12-01T00:55:50.467 INFO:teuthology.orchestra.run.smithi026.stdout:Mon IP `172.21.15.26` is in CIDR network `172.21.0.0/20` 2023-12-01T00:55:50.467 INFO:teuthology.orchestra.run.smithi026.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-01T00:55:50.468 INFO:teuthology.orchestra.run.smithi026.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-01T00:55:50.469 INFO:teuthology.orchestra.run.smithi026.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32... 2023-12-01T00:55:50.816 INFO:teuthology.orchestra.run.smithi026.stdout:/bin/podman: stdout 96d837748436087e6a178851a9eca1321e50ebbd34bb41f0a6c21f217e801f91 2023-12-01T00:55:50.816 INFO:teuthology.orchestra.run.smithi026.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32... 2023-12-01T00:55:50.816 INFO:teuthology.orchestra.run.smithi026.stdout:/bin/podman: stderr Getting image source signatures 2023-12-01T00:55:50.816 INFO:teuthology.orchestra.run.smithi026.stdout:/bin/podman: stderr Copying blob sha256:96395add11bdaea6c79b23b622f6a5a532b33bf04ac49dcc9b4900c1b06af734 2023-12-01T00:55:50.817 INFO:teuthology.orchestra.run.smithi026.stdout:/bin/podman: stderr Copying blob sha256:d3e436ac93e4b5a6d94c7ac8024df331e66e67275836276615dc044fd3cbf83a 2023-12-01T00:55:50.817 INFO:teuthology.orchestra.run.smithi026.stdout:/bin/podman: stderr Copying config sha256:96d837748436087e6a178851a9eca1321e50ebbd34bb41f0a6c21f217e801f91 2023-12-01T00:55:50.817 INFO:teuthology.orchestra.run.smithi026.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-01T00:55:50.817 INFO:teuthology.orchestra.run.smithi026.stdout:/bin/podman: stderr Storing signatures 2023-12-01T00:55:51.662 INFO:teuthology.orchestra.run.smithi026.stdout:ceph: stdout ceph version 18.2.0-1249-ga6f82997 (a6f82997ac57b70a895455dfed6256360a1e4c32) reef (stable) 2023-12-01T00:55:51.662 INFO:teuthology.orchestra.run.smithi026.stdout:Ceph version: ceph version 18.2.0-1249-ga6f82997 (a6f82997ac57b70a895455dfed6256360a1e4c32) reef (stable) 2023-12-01T00:55:51.662 INFO:teuthology.orchestra.run.smithi026.stdout:Extracting ceph user uid/gid from container image... 2023-12-01T00:55:52.411 INFO:teuthology.orchestra.run.smithi026.stdout:stat: stdout 167 167 2023-12-01T00:55:52.411 INFO:teuthology.orchestra.run.smithi026.stdout:Creating initial keys... 2023-12-01T00:55:53.072 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph-authtool: stdout AQAYL2llpn2gLBAAVO5zc2RDGtGwObzdpGR5Pg== 2023-12-01T00:55:53.818 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph-authtool: stdout AQAZL2ll6ihJHRAAeaGym4c9Uq5mr59TrPpryQ== 2023-12-01T00:55:54.568 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph-authtool: stdout AQAaL2llPjefDBAAmWeSLjC1z9/jADtVf+w4Jw== 2023-12-01T00:55:54.569 INFO:teuthology.orchestra.run.smithi026.stdout:Creating initial monmap... 2023-12-01T00:55:55.329 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-01T00:55:55.329 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-12-01T00:55:55.329 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:55:55.330 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-01T00:55:55.330 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool for a [v2:172.21.15.26:3300,v1:172.21.15.26:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-01T00:55:55.330 INFO:teuthology.orchestra.run.smithi026.stdout:setting min_mon_release = pacific 2023-12-01T00:55:55.330 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/monmaptool: set fsid to 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:55:55.330 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-01T00:55:55.330 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:55:55.330 INFO:teuthology.orchestra.run.smithi026.stdout:Creating mon... 2023-12-01T00:55:56.077 INFO:teuthology.orchestra.run.smithi026.stdout:create mon.a on 2023-12-01T00:55:56.196 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-01T00:55:56.288 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-01T00:55:56.420 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-48bff570-8fe4-11ee-95a2-87774f69a715.target → /etc/systemd/system/ceph-48bff570-8fe4-11ee-95a2-87774f69a715.target. 2023-12-01T00:55:56.420 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-48bff570-8fe4-11ee-95a2-87774f69a715.target → /etc/systemd/system/ceph-48bff570-8fe4-11ee-95a2-87774f69a715.target. 2023-12-01T00:55:56.612 INFO:teuthology.orchestra.run.smithi026.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mon.a 2023-12-01T00:55:56.612 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stderr Failed to reset failed state of unit ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mon.a.service: Unit ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mon.a.service not loaded. 2023-12-01T00:55:56.703 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-48bff570-8fe4-11ee-95a2-87774f69a715.target.wants/ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mon.a.service → /etc/systemd/system/ceph-48bff570-8fe4-11ee-95a2-87774f69a715@.service. 2023-12-01T00:55:56.981 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:55:56 smithi026 systemd[1]: Starting Ceph mon.a for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T00:55:57.210 INFO:teuthology.orchestra.run.smithi026.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-01T00:55:57.210 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stdout disabled 2023-12-01T00:55:57.217 INFO:teuthology.orchestra.run.smithi026.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-01T00:55:57.218 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stdout inactive 2023-12-01T00:55:57.218 INFO:teuthology.orchestra.run.smithi026.stdout:firewalld.service is not enabled 2023-12-01T00:55:57.218 INFO:teuthology.orchestra.run.smithi026.stdout:Not possible to enable service . firewalld.service is not available 2023-12-01T00:55:57.218 INFO:teuthology.orchestra.run.smithi026.stdout:Waiting for mon to start... 2023-12-01T00:55:57.218 INFO:teuthology.orchestra.run.smithi026.stdout:Waiting for mon... 2023-12-01T00:55:57.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:55:56 smithi026 podman[98259]: 2023-12-01T00:55:57.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:55:57 smithi026 bash[98259]: 10cc90ee90b4db975615718150e472bdd82e68b9b00632024a103d08023863f7 2023-12-01T00:55:57.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:55:57 smithi026 systemd[1]: Started Ceph mon.a for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T00:55:57.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:55:57 smithi026 ceph-mon[98299]: mkfs 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:55:57.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:55:57 smithi026 ceph-mon[98299]: mon.a is new leader, mons a in quorum (ranks 0) 2023-12-01T00:55:58.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:55:58 smithi026 ceph-mon[98299]: mon.a is new leader, mons a in quorum (ranks 0) 2023-12-01T00:55:58.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:55:58 smithi026 ceph-mon[98299]: monmap e1: 1 mons at {a=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-01T00:55:58.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:55:58 smithi026 ceph-mon[98299]: fsmap 2023-12-01T00:55:58.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:55:58 smithi026 ceph-mon[98299]: osdmap e1: 0 total, 0 up, 0 in 2023-12-01T00:55:58.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:55:58 smithi026 ceph-mon[98299]: mgrmap e1: no daemons active 2023-12-01T00:55:58.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:55:58 smithi026 ceph-mon[98299]: from='client.? 172.21.15.26:0/881788374' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-01T00:55:59.569 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout cluster: 2023-12-01T00:55:59.571 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout id: 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:55:59.571 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-01T00:55:59.571 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 2023-12-01T00:55:59.571 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout services: 2023-12-01T00:55:59.571 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.652021s) 2023-12-01T00:55:59.571 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-01T00:55:59.571 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-01T00:55:59.571 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 2023-12-01T00:55:59.571 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout data: 2023-12-01T00:55:59.571 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-01T00:55:59.572 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-01T00:55:59.572 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-01T00:55:59.577 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout pgs: 2023-12-01T00:55:59.577 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 2023-12-01T00:55:59.577 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.732+0000 7f115c733700 1 Processor -- start 2023-12-01T00:55:59.577 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.732+0000 7f115c733700 1 -- start start 2023-12-01T00:55:59.577 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.732+0000 7f115c733700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f115407be90 0x7f115407a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:55:59.577 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.732+0000 7f115c733700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115407a8c0 con 0x7f115407be90 2023-12-01T00:55:59.577 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.732+0000 7f115a4cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f115407be90 0x7f115407a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:55:59.577 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.733+0000 7f115a4cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f115407be90 0x7f115407a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52158/0 (socket says 172.21.15.26:52158) 2023-12-01T00:55:59.577 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.733+0000 7f115a4cf700 1 -- 172.21.15.26:0/2681640453 learned_addr learned my addr 172.21.15.26:0/2681640453 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:55:59.577 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.733+0000 7f115a4cf700 1 -- 172.21.15.26:0/2681640453 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115407aa00 con 0x7f115407be90 2023-12-01T00:55:59.577 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.733+0000 7f115a4cf700 1 --2- 172.21.15.26:0/2681640453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f115407be90 0x7f115407a2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f11500098a0 tx=0x7f1150009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee83ef2cf58af0cd server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:55:59.578 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.733+0000 7f11594cd700 1 -- 172.21.15.26:0/2681640453 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1150004160 con 0x7f115407be90 2023-12-01T00:55:59.578 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.733+0000 7f11594cd700 1 -- 172.21.15.26:0/2681640453 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11500042c0 con 0x7f115407be90 2023-12-01T00:55:59.578 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.733+0000 7f11594cd700 1 -- 172.21.15.26:0/2681640453 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11500045a0 con 0x7f115407be90 2023-12-01T00:55:59.578 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.734+0000 7f115c733700 1 -- 172.21.15.26:0/2681640453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f115407be90 msgr2=0x7f115407a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:55:59.578 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.734+0000 7f115c733700 1 --2- 172.21.15.26:0/2681640453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f115407be90 0x7f115407a2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f11500098a0 tx=0x7f1150009bb0 comp rx=0 tx=0).stop 2023-12-01T00:55:59.578 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.734+0000 7f115c733700 1 -- 172.21.15.26:0/2681640453 shutdown_connections 2023-12-01T00:55:59.578 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.734+0000 7f115c733700 1 --2- 172.21.15.26:0/2681640453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f115407be90 0x7f115407a2f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:55:59.578 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.734+0000 7f115c733700 1 -- 172.21.15.26:0/2681640453 >> 172.21.15.26:0/2681640453 conn(0x7f1154101c70 msgr2=0x7f11541040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:55:59.578 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.734+0000 7f115c733700 1 -- 172.21.15.26:0/2681640453 shutdown_connections 2023-12-01T00:55:59.578 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.734+0000 7f115c733700 1 -- 172.21.15.26:0/2681640453 wait complete. 2023-12-01T00:55:59.578 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.735+0000 7f115c733700 1 Processor -- start 2023-12-01T00:55:59.578 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.735+0000 7f115c733700 1 -- start start 2023-12-01T00:55:59.578 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.735+0000 7f115c733700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f115407be90 0x7f115419be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:55:59.578 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.735+0000 7f115c733700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115419c390 con 0x7f115407be90 2023-12-01T00:55:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.735+0000 7f115a4cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f115407be90 0x7f115419be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:55:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.735+0000 7f115a4cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f115407be90 0x7f115419be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52160/0 (socket says 172.21.15.26:52160) 2023-12-01T00:55:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.735+0000 7f115a4cf700 1 -- 172.21.15.26:0/881788374 learned_addr learned my addr 172.21.15.26:0/881788374 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:55:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.735+0000 7f115a4cf700 1 -- 172.21.15.26:0/881788374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1150009550 con 0x7f115407be90 2023-12-01T00:55:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.735+0000 7f115a4cf700 1 --2- 172.21.15.26:0/881788374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f115407be90 0x7f115419be50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f115407b360 tx=0x7f1150004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:55:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.735+0000 7f114b7fe700 1 -- 172.21.15.26:0/881788374 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1150011630 con 0x7f115407be90 2023-12-01T00:55:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.736+0000 7f114b7fe700 1 -- 172.21.15.26:0/881788374 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1150011790 con 0x7f115407be90 2023-12-01T00:55:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.736+0000 7f115c733700 1 -- 172.21.15.26:0/881788374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f115419c590 con 0x7f115407be90 2023-12-01T00:55:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.736+0000 7f114b7fe700 1 -- 172.21.15.26:0/881788374 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1150011a30 con 0x7f115407be90 2023-12-01T00:55:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.736+0000 7f115c733700 1 -- 172.21.15.26:0/881788374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115419d140 con 0x7f115407be90 2023-12-01T00:55:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.736+0000 7f114b7fe700 1 -- 172.21.15.26:0/881788374 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1150022070 con 0x7f115407be90 2023-12-01T00:55:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.736+0000 7f114b7fe700 1 -- 172.21.15.26:0/881788374 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f115001c450 con 0x7f115407be90 2023-12-01T00:55:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.737+0000 7f115c733700 1 -- 172.21.15.26:0/881788374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11540623c0 con 0x7f115407be90 2023-12-01T00:55:59.579 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.739+0000 7f114b7fe700 1 -- 172.21.15.26:0/881788374 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f115001b450 con 0x7f115407be90 2023-12-01T00:55:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.871+0000 7f115c733700 1 -- 172.21.15.26:0/881788374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f115419db50 con 0x7f115407be90 2023-12-01T00:55:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.871+0000 7f114b7fe700 1 -- 172.21.15.26:0/881788374 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f115001b5f0 con 0x7f115407be90 2023-12-01T00:55:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.872+0000 7f115c733700 1 -- 172.21.15.26:0/881788374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f115407be90 msgr2=0x7f115419be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:55:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.872+0000 7f115c733700 1 --2- 172.21.15.26:0/881788374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f115407be90 0x7f115419be50 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f115407b360 tx=0x7f1150004750 comp rx=0 tx=0).stop 2023-12-01T00:55:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.872+0000 7f115c733700 1 -- 172.21.15.26:0/881788374 shutdown_connections 2023-12-01T00:55:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.872+0000 7f115c733700 1 --2- 172.21.15.26:0/881788374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f115407be90 0x7f115419be50 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:55:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.872+0000 7f115c733700 1 -- 172.21.15.26:0/881788374 >> 172.21.15.26:0/881788374 conn(0x7f1154101c70 msgr2=0x7f11541035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:55:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.872+0000 7f115c733700 1 -- 172.21.15.26:0/881788374 shutdown_connections 2023-12-01T00:55:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:55:57.872+0000 7f115c733700 1 -- 172.21.15.26:0/881788374 wait complete. 2023-12-01T00:55:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:mon is available 2023-12-01T00:55:59.580 INFO:teuthology.orchestra.run.smithi026.stdout:Assimilating anything we can from ceph.conf... 2023-12-01T00:56:01.500 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:01 smithi026 ceph-mon[98299]: from='client.? 172.21.15.26:0/2756750959' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-01T00:56:01.500 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:01 smithi026 ceph-mon[98299]: from='client.? 172.21.15.26:0/2756750959' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-01T00:56:01.536 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 2023-12-01T00:56:01.536 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout [global] 2023-12-01T00:56:01.536 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout fsid = 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:56:01.536 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.26:3300,v1:172.21.15.26:6789] 2023-12-01T00:56:01.536 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-01T00:56:01.536 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-01T00:56:01.536 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-01T00:56:01.536 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-01T00:56:01.536 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 2023-12-01T00:56:01.537 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-01T00:56:01.537 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-01T00:56:01.537 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 2023-12-01T00:56:01.537 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout [osd] 2023-12-01T00:56:01.537 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-01T00:56:01.537 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-01T00:56:01.537 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-01T00:56:01.537 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-01T00:56:01.537 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-01T00:56:01.537 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.022+0000 7ff15d63c700 1 Processor -- start 2023-12-01T00:56:01.537 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.022+0000 7ff15d63c700 1 -- start start 2023-12-01T00:56:01.537 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.022+0000 7ff15d63c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158104f80 0x7ff1581053a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:01.537 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.022+0000 7ff15d63c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff158079e60 con 0x7ff158104f80 2023-12-01T00:56:01.538 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.022+0000 7ff156ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158104f80 0x7ff1581053a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:01.538 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.022+0000 7ff156ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158104f80 0x7ff1581053a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52162/0 (socket says 172.21.15.26:52162) 2023-12-01T00:56:01.538 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.022+0000 7ff156ffd700 1 -- 172.21.15.26:0/3152291418 learned_addr learned my addr 172.21.15.26:0/3152291418 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:01.538 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.023+0000 7ff156ffd700 1 -- 172.21.15.26:0/3152291418 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1581058e0 con 0x7ff158104f80 2023-12-01T00:56:01.538 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.023+0000 7ff156ffd700 1 --2- 172.21.15.26:0/3152291418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158104f80 0x7ff1581053a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0098a0 tx=0x7ff14c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662495eb3f4c47f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:01.538 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.023+0000 7ff155ffb700 1 -- 172.21.15.26:0/3152291418 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff14c004160 con 0x7ff158104f80 2023-12-01T00:56:01.538 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.023+0000 7ff155ffb700 1 -- 172.21.15.26:0/3152291418 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c0042c0 con 0x7ff158104f80 2023-12-01T00:56:01.538 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.023+0000 7ff155ffb700 1 -- 172.21.15.26:0/3152291418 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff14c0045a0 con 0x7ff158104f80 2023-12-01T00:56:01.538 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.023+0000 7ff15d63c700 1 -- 172.21.15.26:0/3152291418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158104f80 msgr2=0x7ff1581053a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:01.538 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.023+0000 7ff15d63c700 1 --2- 172.21.15.26:0/3152291418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158104f80 0x7ff1581053a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff14c0098a0 tx=0x7ff14c009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:01.538 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.024+0000 7ff15d63c700 1 -- 172.21.15.26:0/3152291418 shutdown_connections 2023-12-01T00:56:01.538 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.024+0000 7ff15d63c700 1 --2- 172.21.15.26:0/3152291418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158104f80 0x7ff1581053a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:01.539 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.024+0000 7ff15d63c700 1 -- 172.21.15.26:0/3152291418 >> 172.21.15.26:0/3152291418 conn(0x7ff158100b80 msgr2=0x7ff158102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:01.539 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.024+0000 7ff15d63c700 1 -- 172.21.15.26:0/3152291418 shutdown_connections 2023-12-01T00:56:01.539 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.024+0000 7ff15d63c700 1 -- 172.21.15.26:0/3152291418 wait complete. 2023-12-01T00:56:01.539 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.024+0000 7ff15d63c700 1 Processor -- start 2023-12-01T00:56:01.539 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.024+0000 7ff15d63c700 1 -- start start 2023-12-01T00:56:01.539 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.025+0000 7ff15d63c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158104f80 0x7ff15819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:01.539 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.025+0000 7ff15d63c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15819c260 con 0x7ff158104f80 2023-12-01T00:56:01.539 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.025+0000 7ff156ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158104f80 0x7ff15819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:01.539 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.025+0000 7ff156ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158104f80 0x7ff15819bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52164/0 (socket says 172.21.15.26:52164) 2023-12-01T00:56:01.539 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.025+0000 7ff156ffd700 1 -- 172.21.15.26:0/2756750959 learned_addr learned my addr 172.21.15.26:0/2756750959 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:01.539 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.025+0000 7ff156ffd700 1 -- 172.21.15.26:0/2756750959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c009550 con 0x7ff158104f80 2023-12-01T00:56:01.539 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.025+0000 7ff156ffd700 1 --2- 172.21.15.26:0/2756750959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158104f80 0x7ff15819bd20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff1580792a0 tx=0x7ff14c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:01.539 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.025+0000 7ff13ffff700 1 -- 172.21.15.26:0/2756750959 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff14c011630 con 0x7ff158104f80 2023-12-01T00:56:01.540 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.025+0000 7ff13ffff700 1 -- 172.21.15.26:0/2756750959 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c011790 con 0x7ff158104f80 2023-12-01T00:56:01.540 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.025+0000 7ff15d63c700 1 -- 172.21.15.26:0/2756750959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff15819c460 con 0x7ff158104f80 2023-12-01T00:56:01.540 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.025+0000 7ff13ffff700 1 -- 172.21.15.26:0/2756750959 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff14c011a30 con 0x7ff158104f80 2023-12-01T00:56:01.540 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.025+0000 7ff15d63c700 1 -- 172.21.15.26:0/2756750959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15819c900 con 0x7ff158104f80 2023-12-01T00:56:01.540 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.026+0000 7ff13ffff700 1 -- 172.21.15.26:0/2756750959 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff14c022070 con 0x7ff158104f80 2023-12-01T00:56:01.540 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.026+0000 7ff13ffff700 1 -- 172.21.15.26:0/2756750959 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff14c01c450 con 0x7ff158104f80 2023-12-01T00:56:01.540 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.027+0000 7ff15d63c700 1 -- 172.21.15.26:0/2756750959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff158195a10 con 0x7ff158104f80 2023-12-01T00:56:01.540 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.029+0000 7ff13ffff700 1 -- 172.21.15.26:0/2756750959 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7ff14c01b450 con 0x7ff158104f80 2023-12-01T00:56:01.540 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.157+0000 7ff15d63c700 1 -- 172.21.15.26:0/2756750959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7ff15802cf20 con 0x7ff158104f80 2023-12-01T00:56:01.540 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.160+0000 7ff13ffff700 1 -- 172.21.15.26:0/2756750959 <== mon.0 v2:172.21.15.26:3300/0 7 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7ff14c01b5f0 con 0x7ff158104f80 2023-12-01T00:56:01.540 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.160+0000 7ff13ffff700 1 -- 172.21.15.26:0/2756750959 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7ff14c0246a0 con 0x7ff158104f80 2023-12-01T00:56:01.540 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.161+0000 7ff15d63c700 1 -- 172.21.15.26:0/2756750959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158104f80 msgr2=0x7ff15819bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:01.541 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.161+0000 7ff15d63c700 1 --2- 172.21.15.26:0/2756750959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158104f80 0x7ff15819bd20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff1580792a0 tx=0x7ff14c004750 comp rx=0 tx=0).stop 2023-12-01T00:56:01.541 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.161+0000 7ff15d63c700 1 -- 172.21.15.26:0/2756750959 shutdown_connections 2023-12-01T00:56:01.541 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.161+0000 7ff15d63c700 1 --2- 172.21.15.26:0/2756750959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff158104f80 0x7ff15819bd20 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:01.541 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.161+0000 7ff15d63c700 1 -- 172.21.15.26:0/2756750959 >> 172.21.15.26:0/2756750959 conn(0x7ff158100b80 msgr2=0x7ff158192b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:01.541 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.162+0000 7ff15d63c700 1 -- 172.21.15.26:0/2756750959 shutdown_connections 2023-12-01T00:56:01.541 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:01.162+0000 7ff15d63c700 1 -- 172.21.15.26:0/2756750959 wait complete. 2023-12-01T00:56:01.541 INFO:teuthology.orchestra.run.smithi026.stdout:Generating new minimal ceph.conf... 2023-12-01T00:56:02.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:02 smithi026 ceph-mon[98299]: from='client.? 172.21.15.26:0/2244477910' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:56:02.681 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.038+0000 7fd9f1523700 1 Processor -- start 2023-12-01T00:56:02.681 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.038+0000 7fd9f1523700 1 -- start start 2023-12-01T00:56:02.681 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.039+0000 7fd9f1523700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9ec07be90 0x7fd9ec07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:02.681 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.039+0000 7fd9f1523700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec07a8c0 con 0x7fd9ec07be90 2023-12-01T00:56:02.681 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.039+0000 7fd9eaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9ec07be90 0x7fd9ec07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:02.681 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.039+0000 7fd9eaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9ec07be90 0x7fd9ec07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52166/0 (socket says 172.21.15.26:52166) 2023-12-01T00:56:02.681 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.039+0000 7fd9eaffd700 1 -- 172.21.15.26:0/2201254433 learned_addr learned my addr 172.21.15.26:0/2201254433 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:02.682 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.039+0000 7fd9eaffd700 1 -- 172.21.15.26:0/2201254433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ec07aa00 con 0x7fd9ec07be90 2023-12-01T00:56:02.682 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.039+0000 7fd9eaffd700 1 --2- 172.21.15.26:0/2201254433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9ec07be90 0x7fd9ec07a2f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0098a0 tx=0x7fd9dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea4714c61854379 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:02.682 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.039+0000 7fd9e9ffb700 1 -- 172.21.15.26:0/2201254433 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9dc004160 con 0x7fd9ec07be90 2023-12-01T00:56:02.682 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.039+0000 7fd9e9ffb700 1 -- 172.21.15.26:0/2201254433 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fd9dc0042c0 con 0x7fd9ec07be90 2023-12-01T00:56:02.682 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.039+0000 7fd9e9ffb700 1 -- 172.21.15.26:0/2201254433 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9dc011ac0 con 0x7fd9ec07be90 2023-12-01T00:56:02.682 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.040+0000 7fd9f1523700 1 -- 172.21.15.26:0/2201254433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9ec07be90 msgr2=0x7fd9ec07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:02.682 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.040+0000 7fd9f1523700 1 --2- 172.21.15.26:0/2201254433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9ec07be90 0x7fd9ec07a2f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0098a0 tx=0x7fd9dc009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:02.682 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.040+0000 7fd9f1523700 1 -- 172.21.15.26:0/2201254433 shutdown_connections 2023-12-01T00:56:02.682 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.040+0000 7fd9f1523700 1 --2- 172.21.15.26:0/2201254433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9ec07be90 0x7fd9ec07a2f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:02.682 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.040+0000 7fd9f1523700 1 -- 172.21.15.26:0/2201254433 >> 172.21.15.26:0/2201254433 conn(0x7fd9ec101ca0 msgr2=0x7fd9ec1040c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:02.682 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.040+0000 7fd9f1523700 1 -- 172.21.15.26:0/2201254433 shutdown_connections 2023-12-01T00:56:02.682 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.040+0000 7fd9f1523700 1 -- 172.21.15.26:0/2201254433 wait complete. 2023-12-01T00:56:02.682 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.041+0000 7fd9f1523700 1 Processor -- start 2023-12-01T00:56:02.682 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.041+0000 7fd9f1523700 1 -- start start 2023-12-01T00:56:02.682 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.041+0000 7fd9f1523700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9ec07be90 0x7fd9ec19c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:02.683 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.041+0000 7fd9f1523700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9ec19caa0 con 0x7fd9ec07be90 2023-12-01T00:56:02.683 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.041+0000 7fd9eaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9ec07be90 0x7fd9ec19c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:02.683 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.041+0000 7fd9eaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9ec07be90 0x7fd9ec19c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52168/0 (socket says 172.21.15.26:52168) 2023-12-01T00:56:02.683 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.041+0000 7fd9eaffd700 1 -- 172.21.15.26:0/2244477910 learned_addr learned my addr 172.21.15.26:0/2244477910 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:02.683 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.042+0000 7fd9eaffd700 1 -- 172.21.15.26:0/2244477910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc009550 con 0x7fd9ec07be90 2023-12-01T00:56:02.683 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.042+0000 7fd9eaffd700 1 --2- 172.21.15.26:0/2244477910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9ec07be90 0x7fd9ec19c560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc003f70 tx=0x7fd9dc011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:02.683 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.042+0000 7fd9e3fff700 1 -- 172.21.15.26:0/2244477910 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9dc003b20 con 0x7fd9ec07be90 2023-12-01T00:56:02.683 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.042+0000 7fd9e3fff700 1 -- 172.21.15.26:0/2244477910 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fd9dc003c80 con 0x7fd9ec07be90 2023-12-01T00:56:02.683 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.042+0000 7fd9f1523700 1 -- 172.21.15.26:0/2244477910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9ec19cca0 con 0x7fd9ec07be90 2023-12-01T00:56:02.683 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.042+0000 7fd9e3fff700 1 -- 172.21.15.26:0/2244477910 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9dc024880 con 0x7fd9ec07be90 2023-12-01T00:56:02.683 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.042+0000 7fd9f1523700 1 -- 172.21.15.26:0/2244477910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9ec19d140 con 0x7fd9ec07be90 2023-12-01T00:56:02.683 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.042+0000 7fd9e3fff700 1 -- 172.21.15.26:0/2244477910 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd9dc02d3f0 con 0x7fd9ec07be90 2023-12-01T00:56:02.683 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.042+0000 7fd9e3fff700 1 -- 172.21.15.26:0/2244477910 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd9dc0194a0 con 0x7fd9ec07be90 2023-12-01T00:56:02.683 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.043+0000 7fd9f1523700 1 -- 172.21.15.26:0/2244477910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9ec0623c0 con 0x7fd9ec07be90 2023-12-01T00:56:02.683 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.046+0000 7fd9e3fff700 1 -- 172.21.15.26:0/2244477910 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fd9dc01abf0 con 0x7fd9ec07be90 2023-12-01T00:56:02.684 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.174+0000 7fd9f1523700 1 -- 172.21.15.26:0/2244477910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fd9ec19fb00 con 0x7fd9ec07be90 2023-12-01T00:56:02.684 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.174+0000 7fd9e3fff700 1 -- 172.21.15.26:0/2244477910 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fd9dc01a430 con 0x7fd9ec07be90 2023-12-01T00:56:02.684 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.175+0000 7fd9f1523700 1 -- 172.21.15.26:0/2244477910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9ec07be90 msgr2=0x7fd9ec19c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:02.684 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.175+0000 7fd9f1523700 1 --2- 172.21.15.26:0/2244477910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9ec07be90 0x7fd9ec19c560 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc003f70 tx=0x7fd9dc011b40 comp rx=0 tx=0).stop 2023-12-01T00:56:02.684 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.175+0000 7fd9f1523700 1 -- 172.21.15.26:0/2244477910 shutdown_connections 2023-12-01T00:56:02.684 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.175+0000 7fd9f1523700 1 --2- 172.21.15.26:0/2244477910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9ec07be90 0x7fd9ec19c560 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:02.684 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.175+0000 7fd9f1523700 1 -- 172.21.15.26:0/2244477910 >> 172.21.15.26:0/2244477910 conn(0x7fd9ec101ca0 msgr2=0x7fd9ec103360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:02.684 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.175+0000 7fd9f1523700 1 -- 172.21.15.26:0/2244477910 shutdown_connections 2023-12-01T00:56:02.684 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:02.175+0000 7fd9f1523700 1 -- 172.21.15.26:0/2244477910 wait complete. 2023-12-01T00:56:02.684 INFO:teuthology.orchestra.run.smithi026.stdout:Restarting the monitor... 2023-12-01T00:56:03.034 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:02 smithi026 systemd[1]: Stopping Ceph mon.a for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T00:56:03.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:03 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mon-a[98275]: 2023-12-01T00:56:03.031+0000 7ff55d0ad700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T00:56:03.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:03 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mon-a[98275]: 2023-12-01T00:56:03.031+0000 7ff55d0ad700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-01T00:56:03.578 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:03 smithi026 bash[98636]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mon-a 2023-12-01T00:56:04.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:03 smithi026 systemd[1]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mon.a.service: Succeeded. 2023-12-01T00:56:04.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:03 smithi026 systemd[1]: Stopped Ceph mon.a for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T00:56:04.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:03 smithi026 systemd[1]: Starting Ceph mon.a for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T00:56:04.267 INFO:teuthology.orchestra.run.smithi026.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-12-01T00:56:04.448 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 podman[98761]: 2023-12-01T00:56:04.449 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 bash[98761]: eea3c91803a79c17d850376a2793468940be1626ca63cf4079a7cddba28a9657 2023-12-01T00:56:04.449 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: set uid:gid to 167:167 (ceph:ceph) 2023-12-01T00:56:04.449 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: ceph version 18.2.0-1249-ga6f82997 (a6f82997ac57b70a895455dfed6256360a1e4c32) reef (stable), process ceph-mon, pid 7 2023-12-01T00:56:04.449 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: pidfile_write: ignore empty --pid-file 2023-12-01T00:56:04.449 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: load: jerasure load: lrc 2023-12-01T00:56:04.449 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: RocksDB version: 7.9.2 2023-12-01T00:56:04.449 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Git sha 0 2023-12-01T00:56:04.449 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Compile date 2023-11-30 20:12:29 2023-12-01T00:56:04.449 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: DB SUMMARY 2023-12-01T00:56:04.449 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: DB Session ID: 360TIF14NHA0SK13BT6H 2023-12-01T00:56:04.449 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: CURRENT file: CURRENT 2023-12-01T00:56:04.449 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: IDENTITY file: IDENTITY 2023-12-01T00:56:04.449 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-12-01T00:56:04.449 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-12-01T00:56:04.450 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 99934 ; 2023-12-01T00:56:04.450 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.error_if_exists: 0 2023-12-01T00:56:04.450 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.create_if_missing: 0 2023-12-01T00:56:04.450 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.paranoid_checks: 1 2023-12-01T00:56:04.450 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-01T00:56:04.450 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-01T00:56:04.450 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-01T00:56:04.450 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.env: 0x5591fc9f2720 2023-12-01T00:56:04.450 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.fs: PosixFileSystem 2023-12-01T00:56:04.450 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.info_log: 0x5591ffe0d440 2023-12-01T00:56:04.450 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_file_opening_threads: 16 2023-12-01T00:56:04.450 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.statistics: (nil) 2023-12-01T00:56:04.450 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.use_fsync: 0 2023-12-01T00:56:04.450 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_log_file_size: 0 2023-12-01T00:56:04.451 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-01T00:56:04.451 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-01T00:56:04.451 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.keep_log_file_num: 1000 2023-12-01T00:56:04.451 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.recycle_log_file_num: 0 2023-12-01T00:56:04.451 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.allow_fallocate: 1 2023-12-01T00:56:04.451 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.allow_mmap_reads: 0 2023-12-01T00:56:04.451 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.allow_mmap_writes: 0 2023-12-01T00:56:04.451 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.use_direct_reads: 0 2023-12-01T00:56:04.451 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-01T00:56:04.451 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.create_missing_column_families: 0 2023-12-01T00:56:04.451 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.db_log_dir: 2023-12-01T00:56:04.451 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.wal_dir: 2023-12-01T00:56:04.451 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-01T00:56:04.451 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-01T00:56:04.451 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-01T00:56:04.452 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-01T00:56:04.452 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-01T00:56:04.452 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-01T00:56:04.452 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.advise_random_on_open: 1 2023-12-01T00:56:04.452 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.db_write_buffer_size: 0 2023-12-01T00:56:04.452 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.write_buffer_manager: 0x5591ff09e320 2023-12-01T00:56:04.452 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-01T00:56:04.452 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-01T00:56:04.452 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-01T00:56:04.452 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.rate_limiter: (nil) 2023-12-01T00:56:04.452 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-01T00:56:04.452 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.wal_recovery_mode: 2 2023-12-01T00:56:04.453 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.enable_thread_tracking: 0 2023-12-01T00:56:04.453 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.enable_pipelined_write: 0 2023-12-01T00:56:04.453 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.unordered_write: 0 2023-12-01T00:56:04.453 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-01T00:56:04.453 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-01T00:56:04.453 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-01T00:56:04.453 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-01T00:56:04.453 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.row_cache: None 2023-12-01T00:56:04.453 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.wal_filter: None 2023-12-01T00:56:04.453 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-01T00:56:04.453 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.allow_ingest_behind: 0 2023-12-01T00:56:04.453 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.two_write_queues: 0 2023-12-01T00:56:04.453 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.manual_wal_flush: 0 2023-12-01T00:56:04.453 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.wal_compression: 0 2023-12-01T00:56:04.453 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.atomic_flush: 0 2023-12-01T00:56:04.454 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-01T00:56:04.454 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-01T00:56:04.454 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-01T00:56:04.454 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.log_readahead_size: 0 2023-12-01T00:56:04.454 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-01T00:56:04.454 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.best_efforts_recovery: 0 2023-12-01T00:56:04.454 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-01T00:56:04.454 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-01T00:56:04.454 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.allow_data_in_errors: 0 2023-12-01T00:56:04.455 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.db_host_id: __hostname__ 2023-12-01T00:56:04.455 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-01T00:56:04.455 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_background_jobs: 2 2023-12-01T00:56:04.456 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_background_compactions: -1 2023-12-01T00:56:04.456 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_subcompactions: 1 2023-12-01T00:56:04.456 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-01T00:56:04.456 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-01T00:56:04.456 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-01T00:56:04.456 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_total_wal_size: 0 2023-12-01T00:56:04.456 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-01T00:56:04.456 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-01T00:56:04.456 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-01T00:56:04.456 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-01T00:56:04.456 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_open_files: -1 2023-12-01T00:56:04.456 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.bytes_per_sync: 0 2023-12-01T00:56:04.456 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-01T00:56:04.456 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-01T00:56:04.456 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compaction_readahead_size: 0 2023-12-01T00:56:04.457 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_background_flushes: -1 2023-12-01T00:56:04.457 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Compression algorithms supported: 2023-12-01T00:56:04.457 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-01T00:56:04.457 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: kZSTD supported: 0 2023-12-01T00:56:04.457 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: kXpressCompression supported: 0 2023-12-01T00:56:04.457 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: kLZ4HCCompression supported: 1 2023-12-01T00:56:04.457 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: kZlibCompression supported: 1 2023-12-01T00:56:04.457 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: kSnappyCompression supported: 1 2023-12-01T00:56:04.457 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: kLZ4Compression supported: 1 2023-12-01T00:56:04.457 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: kBZip2Compression supported: 0 2023-12-01T00:56:04.457 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-01T00:56:04.457 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-01T00:56:04.457 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-12-01T00:56:04.457 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-01T00:56:04.457 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-01T00:56:04.458 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.merge_operator: 2023-12-01T00:56:04.458 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compaction_filter: None 2023-12-01T00:56:04.458 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compaction_filter_factory: None 2023-12-01T00:56:04.458 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.sst_partitioner_factory: None 2023-12-01T00:56:04.458 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-01T00:56:04.458 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-01T00:56:04.458 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5591ffe0d540) 2023-12-01T00:56:04.458 INFO:journalctl@ceph.mon.a.smithi026.stdout: cache_index_and_filter_blocks: 1 2023-12-01T00:56:04.458 INFO:journalctl@ceph.mon.a.smithi026.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-01T00:56:04.458 INFO:journalctl@ceph.mon.a.smithi026.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-01T00:56:04.458 INFO:journalctl@ceph.mon.a.smithi026.stdout: pin_top_level_index_and_filter: 1 2023-12-01T00:56:04.458 INFO:journalctl@ceph.mon.a.smithi026.stdout: index_type: 0 2023-12-01T00:56:04.458 INFO:journalctl@ceph.mon.a.smithi026.stdout: data_block_index_type: 0 2023-12-01T00:56:04.458 INFO:journalctl@ceph.mon.a.smithi026.stdout: index_shortening: 1 2023-12-01T00:56:04.458 INFO:journalctl@ceph.mon.a.smithi026.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-01T00:56:04.459 INFO:journalctl@ceph.mon.a.smithi026.stdout: checksum: 4 2023-12-01T00:56:04.459 INFO:journalctl@ceph.mon.a.smithi026.stdout: no_block_cache: 0 2023-12-01T00:56:04.459 INFO:journalctl@ceph.mon.a.smithi026.stdout: block_cache: 0x5591ff11f350 2023-12-01T00:56:04.459 INFO:journalctl@ceph.mon.a.smithi026.stdout: block_cache_name: BinnedLRUCache 2023-12-01T00:56:04.459 INFO:journalctl@ceph.mon.a.smithi026.stdout: block_cache_options: 2023-12-01T00:56:04.459 INFO:journalctl@ceph.mon.a.smithi026.stdout: capacity : 536870912 2023-12-01T00:56:04.459 INFO:journalctl@ceph.mon.a.smithi026.stdout: num_shard_bits : 4 2023-12-01T00:56:04.459 INFO:journalctl@ceph.mon.a.smithi026.stdout: strict_capacity_limit : 0 2023-12-01T00:56:04.459 INFO:journalctl@ceph.mon.a.smithi026.stdout: high_pri_pool_ratio: 0.000 2023-12-01T00:56:04.459 INFO:journalctl@ceph.mon.a.smithi026.stdout: block_cache_compressed: (nil) 2023-12-01T00:56:04.459 INFO:journalctl@ceph.mon.a.smithi026.stdout: persistent_cache: (nil) 2023-12-01T00:56:04.459 INFO:journalctl@ceph.mon.a.smithi026.stdout: block_size: 4096 2023-12-01T00:56:04.459 INFO:journalctl@ceph.mon.a.smithi026.stdout: block_size_deviation: 10 2023-12-01T00:56:04.459 INFO:journalctl@ceph.mon.a.smithi026.stdout: block_restart_interval: 16 2023-12-01T00:56:04.459 INFO:journalctl@ceph.mon.a.smithi026.stdout: index_block_restart_interval: 1 2023-12-01T00:56:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout: metadata_block_size: 4096 2023-12-01T00:56:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout: partition_filters: 0 2023-12-01T00:56:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout: use_delta_encoding: 1 2023-12-01T00:56:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout: filter_policy: bloomfilter 2023-12-01T00:56:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout: whole_key_filtering: 1 2023-12-01T00:56:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout: verify_compression: 0 2023-12-01T00:56:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout: read_amp_bytes_per_bit: 0 2023-12-01T00:56:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout: format_version: 5 2023-12-01T00:56:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout: enable_index_compression: 1 2023-12-01T00:56:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout: block_align: 0 2023-12-01T00:56:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout: max_auto_readahead_size: 262144 2023-12-01T00:56:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout: prepopulate_block_cache: 0 2023-12-01T00:56:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout: initial_auto_readahead_size: 8192 2023-12-01T00:56:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout: num_file_reads_for_auto_readahead: 2 2023-12-01T00:56:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.write_buffer_size: 33554432 2023-12-01T00:56:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_write_buffer_number: 2 2023-12-01T00:56:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compression: NoCompression 2023-12-01T00:56:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.bottommost_compression: Disabled 2023-12-01T00:56:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.prefix_extractor: nullptr 2023-12-01T00:56:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-01T00:56:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.num_levels: 7 2023-12-01T00:56:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-01T00:56:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-01T00:56:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-01T00:56:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-01T00:56:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-01T00:56:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-01T00:56:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-01T00:56:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-01T00:56:04.462 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-01T00:56:04.462 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-01T00:56:04.462 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-01T00:56:04.462 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-01T00:56:04.462 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-01T00:56:04.462 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compression_opts.level: 32767 2023-12-01T00:56:04.462 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compression_opts.strategy: 0 2023-12-01T00:56:04.462 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-01T00:56:04.462 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-01T00:56:04.462 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-01T00:56:04.462 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-01T00:56:04.462 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compression_opts.enabled: false 2023-12-01T00:56:04.462 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-01T00:56:04.462 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-01T00:56:04.462 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-01T00:56:04.463 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-01T00:56:04.463 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.target_file_size_base: 67108864 2023-12-01T00:56:04.463 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-01T00:56:04.463 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-01T00:56:04.463 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-01T00:56:04.463 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-01T00:56:04.463 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-01T00:56:04.463 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-01T00:56:04.463 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-01T00:56:04.463 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-01T00:56:04.463 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-01T00:56:04.463 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-01T00:56:04.463 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-01T00:56:04.463 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-01T00:56:04.463 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-01T00:56:04.463 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-01T00:56:04.464 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.arena_block_size: 1048576 2023-12-01T00:56:04.464 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-01T00:56:04.464 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-01T00:56:04.464 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.disable_auto_compactions: 0 2023-12-01T00:56:04.464 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-01T00:56:04.464 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-01T00:56:04.464 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-01T00:56:04.464 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-01T00:56:04.464 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-01T00:56:04.464 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-01T00:56:04.464 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-01T00:56:04.464 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-01T00:56:04.464 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-01T00:56:04.464 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-01T00:56:04.464 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.table_properties_collectors: 2023-12-01T00:56:04.465 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.inplace_update_support: 0 2023-12-01T00:56:04.465 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-01T00:56:04.465 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-01T00:56:04.465 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-01T00:56:04.465 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-01T00:56:04.465 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.bloom_locality: 0 2023-12-01T00:56:04.465 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.max_successive_merges: 0 2023-12-01T00:56:04.465 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-01T00:56:04.465 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.paranoid_file_checks: 0 2023-12-01T00:56:04.465 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.force_consistency_checks: 1 2023-12-01T00:56:04.465 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.report_bg_io_stats: 0 2023-12-01T00:56:04.465 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.ttl: 2592000 2023-12-01T00:56:04.465 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-01T00:56:04.465 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-01T00:56:04.465 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-01T00:56:04.466 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.enable_blob_files: false 2023-12-01T00:56:04.466 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.min_blob_size: 0 2023-12-01T00:56:04.466 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.blob_file_size: 268435456 2023-12-01T00:56:04.466 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-01T00:56:04.466 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-01T00:56:04.466 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-01T00:56:04.466 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-01T00:56:04.466 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-01T00:56:04.466 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.blob_file_starting_level: 0 2023-12-01T00:56:04.466 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-01T00:56:04.466 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-12-01T00:56:04.466 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-12-01T00:56:04.466 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a494f26c-0330-4543-b9c8-85f3adee1c60 2023-12-01T00:56:04.466 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701392164210994, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-12-01T00:56:04.467 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-12-01T00:56:04.467 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701392164212506, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94870, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 325, "table_properties": {"data_size": 92868, "index_size": 284, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13805, "raw_average_key_size": 50, "raw_value_size": 85349, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 276, "num_filter_entries": 276, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1701392164, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a494f26c-0330-4543-b9c8-85f3adee1c60", "db_session_id": "360TIF14NHA0SK13BT6H", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-12-01T00:56:04.467 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701392164212578, "job": 1, "event": "recovery_finished"} 2023-12-01T00:56:04.467 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-12-01T00:56:04.467 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-01T00:56:04.467 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5591ff1bc000 2023-12-01T00:56:04.467 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: DB pointer 0x5591ff1a8000 2023-12-01T00:56:04.467 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-01T00:56:04.467 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-01T00:56:04.467 INFO:journalctl@ceph.mon.a.smithi026.stdout: ** DB Stats ** 2023-12-01T00:56:04.467 INFO:journalctl@ceph.mon.a.smithi026.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-01T00:56:04.467 INFO:journalctl@ceph.mon.a.smithi026.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-01T00:56:04.467 INFO:journalctl@ceph.mon.a.smithi026.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-01T00:56:04.467 INFO:journalctl@ceph.mon.a.smithi026.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-01T00:56:04.467 INFO:journalctl@ceph.mon.a.smithi026.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-01T00:56:04.468 INFO:journalctl@ceph.mon.a.smithi026.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-01T00:56:04.468 INFO:journalctl@ceph.mon.a.smithi026.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-01T00:56:04.468 INFO:journalctl@ceph.mon.a.smithi026.stdout: 2023-12-01T00:56:04.468 INFO:journalctl@ceph.mon.a.smithi026.stdout: ** Compaction Stats [default] ** 2023-12-01T00:56:04.468 INFO:journalctl@ceph.mon.a.smithi026.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-01T00:56:04.468 INFO:journalctl@ceph.mon.a.smithi026.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-01T00:56:04.468 INFO:journalctl@ceph.mon.a.smithi026.stdout: L0 2/0 94.48 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-01T00:56:04.468 INFO:journalctl@ceph.mon.a.smithi026.stdout: Sum 2/0 94.48 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-01T00:56:04.468 INFO:journalctl@ceph.mon.a.smithi026.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 134.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-01T00:56:04.468 INFO:journalctl@ceph.mon.a.smithi026.stdout: 2023-12-01T00:56:04.468 INFO:journalctl@ceph.mon.a.smithi026.stdout: ** Compaction Stats [default] ** 2023-12-01T00:56:04.468 INFO:journalctl@ceph.mon.a.smithi026.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-01T00:56:04.468 INFO:journalctl@ceph.mon.a.smithi026.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-01T00:56:04.468 INFO:journalctl@ceph.mon.a.smithi026.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 134.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-01T00:56:04.468 INFO:journalctl@ceph.mon.a.smithi026.stdout: 2023-12-01T00:56:04.469 INFO:journalctl@ceph.mon.a.smithi026.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-01T00:56:04.469 INFO:journalctl@ceph.mon.a.smithi026.stdout: 2023-12-01T00:56:04.469 INFO:journalctl@ceph.mon.a.smithi026.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-01T00:56:04.469 INFO:journalctl@ceph.mon.a.smithi026.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-01T00:56:04.469 INFO:journalctl@ceph.mon.a.smithi026.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-01T00:56:04.469 INFO:journalctl@ceph.mon.a.smithi026.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-01T00:56:04.469 INFO:journalctl@ceph.mon.a.smithi026.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-01T00:56:04.469 INFO:journalctl@ceph.mon.a.smithi026.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-01T00:56:04.469 INFO:journalctl@ceph.mon.a.smithi026.stdout: Cumulative compaction: 0.00 GB write, 24.99 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-01T00:56:04.469 INFO:journalctl@ceph.mon.a.smithi026.stdout: Interval compaction: 0.00 GB write, 24.99 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-01T00:56:04.469 INFO:journalctl@ceph.mon.a.smithi026.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-01T00:56:04.469 INFO:journalctl@ceph.mon.a.smithi026.stdout: Block cache BinnedLRUCache@0x5591ff11f350#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-12-01T00:56:04.469 INFO:journalctl@ceph.mon.a.smithi026.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-12-01T00:56:04.469 INFO:journalctl@ceph.mon.a.smithi026.stdout: 2023-12-01T00:56:04.469 INFO:journalctl@ceph.mon.a.smithi026.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-01T00:56:04.469 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: starting mon.a rank 0 at public addrs [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] at bind addrs [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:56:04.470 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: mon.a@-1(???) e1 preinit fsid 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:56:04.470 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: mon.a@-1(???).mds e1 new map 2023-12-01T00:56:04.470 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: mon.a@-1(???).mds e1 print_map 2023-12-01T00:56:04.470 INFO:journalctl@ceph.mon.a.smithi026.stdout: e1 2023-12-01T00:56:04.470 INFO:journalctl@ceph.mon.a.smithi026.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-01T00:56:04.470 INFO:journalctl@ceph.mon.a.smithi026.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-01T00:56:04.470 INFO:journalctl@ceph.mon.a.smithi026.stdout: legacy client fscid: -1 2023-12-01T00:56:04.470 INFO:journalctl@ceph.mon.a.smithi026.stdout: 2023-12-01T00:56:04.470 INFO:journalctl@ceph.mon.a.smithi026.stdout: No filesystems configured 2023-12-01T00:56:04.470 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-01T00:56:04.470 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-01T00:56:04.470 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-01T00:56:04.470 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-01T00:56:04.470 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-01T00:56:04.471 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: expand_channel_meta expand map: {default=false} 2023-12-01T00:56:04.471 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: expand_channel_meta from 'false' to 'false' 2023-12-01T00:56:04.471 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: expand_channel_meta expanded map: {default=false} 2023-12-01T00:56:04.471 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: expand_channel_meta expand map: {default=info} 2023-12-01T00:56:04.471 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: expand_channel_meta from 'info' to 'info' 2023-12-01T00:56:04.471 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: expand_channel_meta expanded map: {default=info} 2023-12-01T00:56:04.471 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: expand_channel_meta expand map: {default=daemon} 2023-12-01T00:56:04.471 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: expand_channel_meta from 'daemon' to 'daemon' 2023-12-01T00:56:04.471 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: expand_channel_meta expanded map: {default=daemon} 2023-12-01T00:56:04.471 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: expand_channel_meta expand map: {default=debug} 2023-12-01T00:56:04.471 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: expand_channel_meta from 'debug' to 'debug' 2023-12-01T00:56:04.471 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: expand_channel_meta expanded map: {default=debug} 2023-12-01T00:56:04.471 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 systemd[1]: Started Ceph mon.a for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T00:56:04.471 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: mon.a is new leader, mons a in quorum (ranks 0) 2023-12-01T00:56:04.471 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: monmap e1: 1 mons at {a=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-01T00:56:04.471 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: fsmap 2023-12-01T00:56:04.472 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: osdmap e1: 0 total, 0 up, 0 in 2023-12-01T00:56:04.472 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:04 smithi026 ceph-mon[98801]: mgrmap e1: no daemons active 2023-12-01T00:56:05.219 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.719+0000 7f9932a6d700 1 Processor -- start 2023-12-01T00:56:05.221 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.719+0000 7f9932a6d700 1 -- start start 2023-12-01T00:56:05.221 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.720+0000 7f9932a6d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f992c1055e0 0x7f992c105a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:05.221 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.720+0000 7f9932a6d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c105fd0 con 0x7f992c1055e0 2023-12-01T00:56:05.221 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.720+0000 7f9930809700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f992c1055e0 0x7f992c105a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:05.221 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.720+0000 7f9930809700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f992c1055e0 0x7f992c105a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52170/0 (socket says 172.21.15.26:52170) 2023-12-01T00:56:05.221 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.720+0000 7f9930809700 1 -- 172.21.15.26:0/467539027 learned_addr learned my addr 172.21.15.26:0/467539027 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:05.221 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.720+0000 7f9930809700 1 -- 172.21.15.26:0/467539027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c1067e0 con 0x7f992c1055e0 2023-12-01T00:56:05.221 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.721+0000 7f9930809700 1 --2- 172.21.15.26:0/467539027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f992c1055e0 0x7f992c105a00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f99200098a0 tx=0x7f9920009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8990c618d93a253b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:05.222 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.721+0000 7f992b7fe700 1 -- 172.21.15.26:0/467539027 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9920004160 con 0x7f992c1055e0 2023-12-01T00:56:05.222 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.721+0000 7f992b7fe700 1 -- 172.21.15.26:0/467539027 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f99200042c0 con 0x7f992c1055e0 2023-12-01T00:56:05.222 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.721+0000 7f992b7fe700 1 -- 172.21.15.26:0/467539027 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9920011ac0 con 0x7f992c1055e0 2023-12-01T00:56:05.222 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.721+0000 7f9932a6d700 1 -- 172.21.15.26:0/467539027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f992c1055e0 msgr2=0x7f992c105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:05.222 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.721+0000 7f9932a6d700 1 --2- 172.21.15.26:0/467539027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f992c1055e0 0x7f992c105a00 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f99200098a0 tx=0x7f9920009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:05.222 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.721+0000 7f9932a6d700 1 -- 172.21.15.26:0/467539027 shutdown_connections 2023-12-01T00:56:05.222 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.721+0000 7f9932a6d700 1 --2- 172.21.15.26:0/467539027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f992c1055e0 0x7f992c105a00 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:05.222 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.721+0000 7f9932a6d700 1 -- 172.21.15.26:0/467539027 >> 172.21.15.26:0/467539027 conn(0x7f992c100b80 msgr2=0x7f992c102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:05.222 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.722+0000 7f9932a6d700 1 -- 172.21.15.26:0/467539027 shutdown_connections 2023-12-01T00:56:05.222 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.722+0000 7f9932a6d700 1 -- 172.21.15.26:0/467539027 wait complete. 2023-12-01T00:56:05.222 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.722+0000 7f9932a6d700 1 Processor -- start 2023-12-01T00:56:05.222 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.722+0000 7f9932a6d700 1 -- start start 2023-12-01T00:56:05.222 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.722+0000 7f9932a6d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f992c1055e0 0x7f992c1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:05.223 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.722+0000 7f9932a6d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c1998f0 con 0x7f992c1055e0 2023-12-01T00:56:05.223 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.723+0000 7f9930809700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f992c1055e0 0x7f992c1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:05.223 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.723+0000 7f9930809700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f992c1055e0 0x7f992c1993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52172/0 (socket says 172.21.15.26:52172) 2023-12-01T00:56:05.223 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.723+0000 7f9930809700 1 -- 172.21.15.26:0/718632726 learned_addr learned my addr 172.21.15.26:0/718632726 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:05.223 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.723+0000 7f9930809700 1 -- 172.21.15.26:0/718632726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9920009550 con 0x7f992c1055e0 2023-12-01T00:56:05.223 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.723+0000 7f9930809700 1 --2- 172.21.15.26:0/718632726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f992c1055e0 0x7f992c1993b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9920003f70 tx=0x7f9920011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:05.223 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.723+0000 7f9929ffb700 1 -- 172.21.15.26:0/718632726 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9920003af0 con 0x7f992c1055e0 2023-12-01T00:56:05.223 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.723+0000 7f9929ffb700 1 -- 172.21.15.26:0/718632726 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f9920003c50 con 0x7f992c1055e0 2023-12-01T00:56:05.223 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.723+0000 7f9932a6d700 1 -- 172.21.15.26:0/718632726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992c199af0 con 0x7f992c1055e0 2023-12-01T00:56:05.223 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.723+0000 7f9929ffb700 1 -- 172.21.15.26:0/718632726 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9920024880 con 0x7f992c1055e0 2023-12-01T00:56:05.223 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.723+0000 7f9932a6d700 1 -- 172.21.15.26:0/718632726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992c19a780 con 0x7f992c1055e0 2023-12-01T00:56:05.223 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.724+0000 7f9929ffb700 1 -- 172.21.15.26:0/718632726 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f992002d3f0 con 0x7f992c1055e0 2023-12-01T00:56:05.223 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.724+0000 7f9929ffb700 1 -- 172.21.15.26:0/718632726 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f99200193c0 con 0x7f992c1055e0 2023-12-01T00:56:05.223 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.724+0000 7f9932a6d700 1 -- 172.21.15.26:0/718632726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f992c199f90 con 0x7f992c1055e0 2023-12-01T00:56:05.223 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.727+0000 7f9929ffb700 1 -- 172.21.15.26:0/718632726 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f992c199f90 con 0x7f992c1055e0 2023-12-01T00:56:05.224 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.853+0000 7f9932a6d700 1 -- 172.21.15.26:0/718632726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f992c19ab30 con 0x7f992c1055e0 2023-12-01T00:56:05.224 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.855+0000 7f9929ffb700 1 -- 172.21.15.26:0/718632726 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f992001ac40 con 0x7f992c1055e0 2023-12-01T00:56:05.224 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.856+0000 7f9932a6d700 1 -- 172.21.15.26:0/718632726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f992c1055e0 msgr2=0x7f992c1993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:05.224 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.856+0000 7f9932a6d700 1 --2- 172.21.15.26:0/718632726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f992c1055e0 0x7f992c1993b0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9920003f70 tx=0x7f9920011a90 comp rx=0 tx=0).stop 2023-12-01T00:56:05.224 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.856+0000 7f9932a6d700 1 -- 172.21.15.26:0/718632726 shutdown_connections 2023-12-01T00:56:05.224 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.856+0000 7f9932a6d700 1 --2- 172.21.15.26:0/718632726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f992c1055e0 0x7f992c1993b0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:05.224 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.856+0000 7f9932a6d700 1 -- 172.21.15.26:0/718632726 >> 172.21.15.26:0/718632726 conn(0x7f992c100b80 msgr2=0x7f992c101950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:05.224 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.856+0000 7f9932a6d700 1 -- 172.21.15.26:0/718632726 shutdown_connections 2023-12-01T00:56:05.224 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:04.856+0000 7f9932a6d700 1 -- 172.21.15.26:0/718632726 wait complete. 2023-12-01T00:56:05.224 INFO:teuthology.orchestra.run.smithi026.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-01T00:56:05.238 INFO:teuthology.orchestra.run.smithi026.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-01T00:56:05.239 INFO:teuthology.orchestra.run.smithi026.stdout:Creating mgr... 2023-12-01T00:56:05.239 INFO:teuthology.orchestra.run.smithi026.stdout:Verifying port 0.0.0.0:9283 ... 2023-12-01T00:56:05.239 INFO:teuthology.orchestra.run.smithi026.stdout:Verifying port 0.0.0.0:8765 ... 2023-12-01T00:56:05.445 INFO:teuthology.orchestra.run.smithi026.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mgr.x 2023-12-01T00:56:05.445 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stderr Failed to reset failed state of unit ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mgr.x.service: Unit ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mgr.x.service not loaded. 2023-12-01T00:56:05.544 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-48bff570-8fe4-11ee-95a2-87774f69a715.target.wants/ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-48bff570-8fe4-11ee-95a2-87774f69a715@.service. 2023-12-01T00:56:05.816 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:05 smithi026 systemd[1]: Starting Ceph mgr.x for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T00:56:06.138 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:05 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/718632726' entity='client.admin' 2023-12-01T00:56:06.138 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:05 smithi026 podman[99029]: 2023-12-01T00:56:06.138 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:06 smithi026 bash[99029]: f480fc700e77760a71ce1ad85f1d582b6f998eb55b4ecdc36dc6e78f64fd86d8 2023-12-01T00:56:06.151 INFO:teuthology.orchestra.run.smithi026.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-01T00:56:06.151 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stdout disabled 2023-12-01T00:56:06.159 INFO:teuthology.orchestra.run.smithi026.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-01T00:56:06.159 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stdout inactive 2023-12-01T00:56:06.159 INFO:teuthology.orchestra.run.smithi026.stdout:firewalld.service is not enabled 2023-12-01T00:56:06.159 INFO:teuthology.orchestra.run.smithi026.stdout:Not possible to enable service . firewalld.service is not available 2023-12-01T00:56:06.168 INFO:teuthology.orchestra.run.smithi026.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-01T00:56:06.168 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stdout disabled 2023-12-01T00:56:06.176 INFO:teuthology.orchestra.run.smithi026.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-01T00:56:06.177 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stdout inactive 2023-12-01T00:56:06.177 INFO:teuthology.orchestra.run.smithi026.stdout:firewalld.service is not enabled 2023-12-01T00:56:06.177 INFO:teuthology.orchestra.run.smithi026.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-12-01T00:56:06.177 INFO:teuthology.orchestra.run.smithi026.stdout:Waiting for mgr to start... 2023-12-01T00:56:06.177 INFO:teuthology.orchestra.run.smithi026.stdout:Waiting for mgr... 2023-12-01T00:56:06.426 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:06 smithi026 systemd[1]: Started Ceph mgr.x for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T00:56:06.426 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:06 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:06.218+0000 7fde7de0e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-01T00:56:06.426 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:06 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:06.315+0000 7fde7de0e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-01T00:56:06.426 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:06 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:06.424+0000 7fde7de0e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-01T00:56:06.766 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:06 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:06.536+0000 7fde7de0e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-01T00:56:06.767 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:06 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:06.763+0000 7fde7de0e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-01T00:56:07.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:07 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1396775140' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-01T00:56:07.296 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:07 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:07.255+0000 7fde7de0e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-01T00:56:07.337 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 2023-12-01T00:56:07.337 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout { 2023-12-01T00:56:07.337 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "fsid": "48bff570-8fe4-11ee-95a2-87774f69a715", 2023-12-01T00:56:07.337 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "health": { 2023-12-01T00:56:07.337 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-01T00:56:07.337 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-01T00:56:07.337 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-01T00:56:07.337 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:07.337 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-01T00:56:07.338 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-01T00:56:07.338 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 0 2023-12-01T00:56:07.338 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout ], 2023-12-01T00:56:07.338 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-01T00:56:07.338 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "a" 2023-12-01T00:56:07.338 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout ], 2023-12-01T00:56:07.338 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-12-01T00:56:07.338 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-01T00:56:07.338 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-01T00:56:07.338 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-01T00:56:07.338 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-01T00:56:07.338 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:07.338 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-01T00:56:07.338 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-01T00:56:07.339 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-01T00:56:07.339 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-01T00:56:07.339 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-01T00:56:07.346 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-01T00:56:07.349 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-01T00:56:07.349 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-01T00:56:07.349 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:07.349 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-01T00:56:07.349 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-01T00:56:07.349 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-01T00:56:07.349 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-01T00:56:07.350 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-01T00:56:07.350 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-01T00:56:07.350 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-01T00:56:07.350 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-01T00:56:07.350 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-01T00:56:07.350 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:07.350 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-01T00:56:07.350 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-01T00:56:07.350 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-01T00:56:07.350 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-01T00:56:07.350 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:07.350 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-01T00:56:07.350 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-01T00:56:07.350 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-01T00:56:07.350 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-01T00:56:07.351 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-01T00:56:07.351 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-01T00:56:07.351 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "restful" 2023-12-01T00:56:07.351 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout ], 2023-12-01T00:56:07.351 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-01T00:56:07.351 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:07.351 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-01T00:56:07.351 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-01T00:56:07.351 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "modified": "2023-12-01T00:55:57.222486+0000", 2023-12-01T00:56:07.351 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-01T00:56:07.351 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:07.351 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-01T00:56:07.351 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout } 2023-12-01T00:56:07.351 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.842+0000 7efc29b0e700 1 Processor -- start 2023-12-01T00:56:07.351 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.842+0000 7efc29b0e700 1 -- start start 2023-12-01T00:56:07.352 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.842+0000 7efc29b0e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc241055e0 0x7efc24105a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:07.352 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.842+0000 7efc29b0e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc24105fd0 con 0x7efc241055e0 2023-12-01T00:56:07.352 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.842+0000 7efc237fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc241055e0 0x7efc24105a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:07.352 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.842+0000 7efc237fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc241055e0 0x7efc24105a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52178/0 (socket says 172.21.15.26:52178) 2023-12-01T00:56:07.352 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.842+0000 7efc237fe700 1 -- 172.21.15.26:0/3879846860 learned_addr learned my addr 172.21.15.26:0/3879846860 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:07.352 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.843+0000 7efc237fe700 1 -- 172.21.15.26:0/3879846860 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc241067e0 con 0x7efc241055e0 2023-12-01T00:56:07.352 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.843+0000 7efc237fe700 1 --2- 172.21.15.26:0/3879846860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc241055e0 0x7efc24105a00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efc140098a0 tx=0x7efc14009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e358120bcb6fe3 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:07.352 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.843+0000 7efc227fc700 1 -- 172.21.15.26:0/3879846860 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc14004160 con 0x7efc241055e0 2023-12-01T00:56:07.352 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.843+0000 7efc227fc700 1 -- 172.21.15.26:0/3879846860 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7efc140042c0 con 0x7efc241055e0 2023-12-01T00:56:07.352 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.843+0000 7efc227fc700 1 -- 172.21.15.26:0/3879846860 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc14011ac0 con 0x7efc241055e0 2023-12-01T00:56:07.352 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.844+0000 7efc29b0e700 1 -- 172.21.15.26:0/3879846860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc241055e0 msgr2=0x7efc24105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:07.352 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.844+0000 7efc29b0e700 1 --2- 172.21.15.26:0/3879846860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc241055e0 0x7efc24105a00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7efc140098a0 tx=0x7efc14009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:07.352 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.844+0000 7efc29b0e700 1 -- 172.21.15.26:0/3879846860 shutdown_connections 2023-12-01T00:56:07.352 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.844+0000 7efc29b0e700 1 --2- 172.21.15.26:0/3879846860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc241055e0 0x7efc24105a00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:07.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.844+0000 7efc29b0e700 1 -- 172.21.15.26:0/3879846860 >> 172.21.15.26:0/3879846860 conn(0x7efc24100b80 msgr2=0x7efc24102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:07.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.844+0000 7efc29b0e700 1 -- 172.21.15.26:0/3879846860 shutdown_connections 2023-12-01T00:56:07.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.844+0000 7efc29b0e700 1 -- 172.21.15.26:0/3879846860 wait complete. 2023-12-01T00:56:07.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.844+0000 7efc29b0e700 1 Processor -- start 2023-12-01T00:56:07.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.845+0000 7efc29b0e700 1 -- start start 2023-12-01T00:56:07.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.845+0000 7efc29b0e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc241055e0 0x7efc2419d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:07.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.845+0000 7efc29b0e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc24079d80 con 0x7efc241055e0 2023-12-01T00:56:07.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.845+0000 7efc237fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc241055e0 0x7efc2419d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:07.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.845+0000 7efc237fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc241055e0 0x7efc2419d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52180/0 (socket says 172.21.15.26:52180) 2023-12-01T00:56:07.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.845+0000 7efc237fe700 1 -- 172.21.15.26:0/1396775140 learned_addr learned my addr 172.21.15.26:0/1396775140 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:07.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.845+0000 7efc237fe700 1 -- 172.21.15.26:0/1396775140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc14009550 con 0x7efc241055e0 2023-12-01T00:56:07.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.845+0000 7efc237fe700 1 --2- 172.21.15.26:0/1396775140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc241055e0 0x7efc2419d090 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efc14003f70 tx=0x7efc14011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:07.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.846+0000 7efc20ff9700 1 -- 172.21.15.26:0/1396775140 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc14003af0 con 0x7efc241055e0 2023-12-01T00:56:07.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.846+0000 7efc29b0e700 1 -- 172.21.15.26:0/1396775140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2419d5d0 con 0x7efc241055e0 2023-12-01T00:56:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.846+0000 7efc20ff9700 1 -- 172.21.15.26:0/1396775140 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7efc14003c50 con 0x7efc241055e0 2023-12-01T00:56:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.846+0000 7efc20ff9700 1 -- 172.21.15.26:0/1396775140 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efc14024880 con 0x7efc241055e0 2023-12-01T00:56:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.846+0000 7efc29b0e700 1 -- 172.21.15.26:0/1396775140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2419d930 con 0x7efc241055e0 2023-12-01T00:56:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.847+0000 7efc20ff9700 1 -- 172.21.15.26:0/1396775140 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efc1402d3f0 con 0x7efc241055e0 2023-12-01T00:56:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.847+0000 7efc20ff9700 1 -- 172.21.15.26:0/1396775140 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efc14019450 con 0x7efc241055e0 2023-12-01T00:56:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.847+0000 7efc29b0e700 1 -- 172.21.15.26:0/1396775140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc24067280 con 0x7efc241055e0 2023-12-01T00:56:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.852+0000 7efc20ff9700 1 -- 172.21.15.26:0/1396775140 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7efc1401ac40 con 0x7efc241055e0 2023-12-01T00:56:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.985+0000 7efc29b0e700 1 -- 172.21.15.26:0/1396775140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7efc2419dc70 con 0x7efc241055e0 2023-12-01T00:56:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.985+0000 7efc20ff9700 1 -- 172.21.15.26:0/1396775140 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7efc1401ade0 con 0x7efc241055e0 2023-12-01T00:56:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.986+0000 7efc29b0e700 1 -- 172.21.15.26:0/1396775140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc241055e0 msgr2=0x7efc2419d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.986+0000 7efc29b0e700 1 --2- 172.21.15.26:0/1396775140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc241055e0 0x7efc2419d090 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7efc14003f70 tx=0x7efc14011a90 comp rx=0 tx=0).stop 2023-12-01T00:56:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.986+0000 7efc29b0e700 1 -- 172.21.15.26:0/1396775140 shutdown_connections 2023-12-01T00:56:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.986+0000 7efc29b0e700 1 --2- 172.21.15.26:0/1396775140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc241055e0 0x7efc2419d090 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.986+0000 7efc29b0e700 1 -- 172.21.15.26:0/1396775140 >> 172.21.15.26:0/1396775140 conn(0x7efc24100b80 msgr2=0x7efc24101970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:07.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.986+0000 7efc29b0e700 1 -- 172.21.15.26:0/1396775140 shutdown_connections 2023-12-01T00:56:07.355 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:06.986+0000 7efc29b0e700 1 -- 172.21.15.26:0/1396775140 wait complete. 2023-12-01T00:56:07.355 INFO:teuthology.orchestra.run.smithi026.stdout:mgr not available, waiting (1/15)... 2023-12-01T00:56:07.632 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:07 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:07.408+0000 7fde7de0e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-01T00:56:07.632 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:07 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:07.515+0000 7fde7de0e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-01T00:56:08.546 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:07 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:07.630+0000 7fde7de0e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-01T00:56:08.546 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:08 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:08.138+0000 7fde7de0e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-01T00:56:09.296 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:08 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:08.929+0000 7fde7de0e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-01T00:56:09.296 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:09 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:09.027+0000 7fde7de0e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-01T00:56:10.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:10 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3905306055' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-01T00:56:10.296 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:10 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:10.031+0000 7fde7de0e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-01T00:56:10.296 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:10 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:10.146+0000 7fde7de0e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-01T00:56:10.390 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 2023-12-01T00:56:10.390 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout { 2023-12-01T00:56:10.390 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "fsid": "48bff570-8fe4-11ee-95a2-87774f69a715", 2023-12-01T00:56:10.390 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "health": { 2023-12-01T00:56:10.390 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-01T00:56:10.390 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-01T00:56:10.390 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-01T00:56:10.390 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:10.390 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-01T00:56:10.390 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-01T00:56:10.390 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 0 2023-12-01T00:56:10.390 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout ], 2023-12-01T00:56:10.391 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-01T00:56:10.391 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "a" 2023-12-01T00:56:10.391 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout ], 2023-12-01T00:56:10.391 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-12-01T00:56:10.391 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-01T00:56:10.391 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-01T00:56:10.391 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-01T00:56:10.391 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-01T00:56:10.391 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:10.391 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-01T00:56:10.391 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-01T00:56:10.391 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-01T00:56:10.391 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-01T00:56:10.391 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-01T00:56:10.399 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-01T00:56:10.399 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-01T00:56:10.399 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-01T00:56:10.399 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:10.399 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-01T00:56:10.399 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-01T00:56:10.399 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-01T00:56:10.399 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-01T00:56:10.399 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-01T00:56:10.400 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-01T00:56:10.400 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-01T00:56:10.400 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-01T00:56:10.400 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-01T00:56:10.400 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:10.400 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-01T00:56:10.400 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-01T00:56:10.400 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-01T00:56:10.400 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-01T00:56:10.400 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:10.400 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-01T00:56:10.400 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-01T00:56:10.401 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-01T00:56:10.401 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-01T00:56:10.401 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-01T00:56:10.401 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-01T00:56:10.401 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "restful" 2023-12-01T00:56:10.401 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout ], 2023-12-01T00:56:10.401 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-01T00:56:10.401 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:10.401 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-01T00:56:10.401 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-01T00:56:10.401 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "modified": "2023-12-01T00:55:57.222486+0000", 2023-12-01T00:56:10.401 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-01T00:56:10.401 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:10.401 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-01T00:56:10.401 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout } 2023-12-01T00:56:10.402 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.858+0000 7f5a0da4f700 1 Processor -- start 2023-12-01T00:56:10.402 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.858+0000 7f5a0da4f700 1 -- start start 2023-12-01T00:56:10.402 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.859+0000 7f5a0da4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a08104fa0 0x7f5a081053c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:10.402 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.859+0000 7f5a0da4f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a08079e60 con 0x7f5a08104fa0 2023-12-01T00:56:10.402 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.859+0000 7f5a06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a08104fa0 0x7f5a081053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:10.402 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.859+0000 7f5a06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a08104fa0 0x7f5a081053c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52182/0 (socket says 172.21.15.26:52182) 2023-12-01T00:56:10.402 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.859+0000 7f5a06ffd700 1 -- 172.21.15.26:0/4093831601 learned_addr learned my addr 172.21.15.26:0/4093831601 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:10.402 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.859+0000 7f5a06ffd700 1 -- 172.21.15.26:0/4093831601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a08105900 con 0x7f5a08104fa0 2023-12-01T00:56:10.402 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.859+0000 7f5a06ffd700 1 --2- 172.21.15.26:0/4093831601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a08104fa0 0x7f5a081053c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f59f80098a0 tx=0x7f59f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f79d45158dd3c8d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:10.402 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.860+0000 7f5a05ffb700 1 -- 172.21.15.26:0/4093831601 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59f8004160 con 0x7f5a08104fa0 2023-12-01T00:56:10.402 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.860+0000 7f5a05ffb700 1 -- 172.21.15.26:0/4093831601 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f59f80042c0 con 0x7f5a08104fa0 2023-12-01T00:56:10.402 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.860+0000 7f5a05ffb700 1 -- 172.21.15.26:0/4093831601 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59f8011ac0 con 0x7f5a08104fa0 2023-12-01T00:56:10.402 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.860+0000 7f5a0da4f700 1 -- 172.21.15.26:0/4093831601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a08104fa0 msgr2=0x7f5a081053c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:10.402 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.860+0000 7f5a0da4f700 1 --2- 172.21.15.26:0/4093831601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a08104fa0 0x7f5a081053c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f59f80098a0 tx=0x7f59f8009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:10.403 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.860+0000 7f5a0da4f700 1 -- 172.21.15.26:0/4093831601 shutdown_connections 2023-12-01T00:56:10.403 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.860+0000 7f5a0da4f700 1 --2- 172.21.15.26:0/4093831601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a08104fa0 0x7f5a081053c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:10.403 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.860+0000 7f5a0da4f700 1 -- 172.21.15.26:0/4093831601 >> 172.21.15.26:0/4093831601 conn(0x7f5a08100b80 msgr2=0x7f5a08102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:10.403 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.860+0000 7f5a0da4f700 1 -- 172.21.15.26:0/4093831601 shutdown_connections 2023-12-01T00:56:10.403 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.861+0000 7f5a0da4f700 1 -- 172.21.15.26:0/4093831601 wait complete. 2023-12-01T00:56:10.403 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.861+0000 7f5a0da4f700 1 Processor -- start 2023-12-01T00:56:10.403 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.861+0000 7f5a0da4f700 1 -- start start 2023-12-01T00:56:10.403 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.861+0000 7f5a0da4f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a08104fa0 0x7f5a0819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:10.403 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.861+0000 7f5a0da4f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0819cbb0 con 0x7f5a08104fa0 2023-12-01T00:56:10.403 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.862+0000 7f5a06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a08104fa0 0x7f5a0819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:10.403 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.862+0000 7f5a06ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a08104fa0 0x7f5a0819c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52184/0 (socket says 172.21.15.26:52184) 2023-12-01T00:56:10.403 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.862+0000 7f5a06ffd700 1 -- 172.21.15.26:0/3905306055 learned_addr learned my addr 172.21.15.26:0/3905306055 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:10.403 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.862+0000 7f5a06ffd700 1 -- 172.21.15.26:0/3905306055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f8009550 con 0x7f5a08104fa0 2023-12-01T00:56:10.403 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.862+0000 7f5a06ffd700 1 --2- 172.21.15.26:0/3905306055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a08104fa0 0x7f5a0819c670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f59f8003f70 tx=0x7f59f8011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:10.404 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.862+0000 7f5a0ca4d700 1 -- 172.21.15.26:0/3905306055 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59f8003b20 con 0x7f5a08104fa0 2023-12-01T00:56:10.404 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.862+0000 7f5a0da4f700 1 -- 172.21.15.26:0/3905306055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0819cdb0 con 0x7f5a08104fa0 2023-12-01T00:56:10.404 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.862+0000 7f5a0ca4d700 1 -- 172.21.15.26:0/3905306055 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f59f8003c80 con 0x7f5a08104fa0 2023-12-01T00:56:10.404 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.862+0000 7f5a0ca4d700 1 -- 172.21.15.26:0/3905306055 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59f8024880 con 0x7f5a08104fa0 2023-12-01T00:56:10.404 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.862+0000 7f5a0da4f700 1 -- 172.21.15.26:0/3905306055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0819da40 con 0x7f5a08104fa0 2023-12-01T00:56:10.404 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.862+0000 7f5a0ca4d700 1 -- 172.21.15.26:0/3905306055 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f59f802d3f0 con 0x7f5a08104fa0 2023-12-01T00:56:10.404 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.863+0000 7f5a0ca4d700 1 -- 172.21.15.26:0/3905306055 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f59f80194f0 con 0x7f5a08104fa0 2023-12-01T00:56:10.404 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.863+0000 7f5a0da4f700 1 -- 172.21.15.26:0/3905306055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a080623c0 con 0x7f5a08104fa0 2023-12-01T00:56:10.404 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.866+0000 7f5a0ca4d700 1 -- 172.21.15.26:0/3905306055 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f59f801abf0 con 0x7f5a08104fa0 2023-12-01T00:56:10.404 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.999+0000 7f5a0da4f700 1 -- 172.21.15.26:0/3905306055 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f5a0819e840 con 0x7f5a08104fa0 2023-12-01T00:56:10.404 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:09.999+0000 7f5a0ca4d700 1 -- 172.21.15.26:0/3905306055 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f59f801a430 con 0x7f5a08104fa0 2023-12-01T00:56:10.404 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:10.000+0000 7f5a0da4f700 1 -- 172.21.15.26:0/3905306055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a08104fa0 msgr2=0x7f5a0819c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:10.404 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:10.000+0000 7f5a0da4f700 1 --2- 172.21.15.26:0/3905306055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a08104fa0 0x7f5a0819c670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f59f8003f70 tx=0x7f59f8011b40 comp rx=0 tx=0).stop 2023-12-01T00:56:10.404 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:10.000+0000 7f5a0da4f700 1 -- 172.21.15.26:0/3905306055 shutdown_connections 2023-12-01T00:56:10.404 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:10.000+0000 7f5a0da4f700 1 --2- 172.21.15.26:0/3905306055 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a08104fa0 0x7f5a0819c670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:10.405 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:10.000+0000 7f5a0da4f700 1 -- 172.21.15.26:0/3905306055 >> 172.21.15.26:0/3905306055 conn(0x7f5a08100b80 msgr2=0x7f5a08190b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:10.405 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:10.000+0000 7f5a0da4f700 1 -- 172.21.15.26:0/3905306055 shutdown_connections 2023-12-01T00:56:10.405 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:10.000+0000 7f5a0da4f700 1 -- 172.21.15.26:0/3905306055 wait complete. 2023-12-01T00:56:10.405 INFO:teuthology.orchestra.run.smithi026.stdout:mgr not available, waiting (2/15)... 2023-12-01T00:56:10.722 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:10 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:10.369+0000 7fde7de0e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-01T00:56:10.980 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:10 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:10.720+0000 7fde7de0e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-01T00:56:11.296 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:10 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:10.978+0000 7fde7de0e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-01T00:56:11.296 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:11 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:11.161+0000 7fde7de0e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-01T00:56:11.796 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:11 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:11.490+0000 7fde7de0e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-01T00:56:12.731 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:12 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:12.317+0000 7fde7de0e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-01T00:56:12.731 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:12 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:12.484+0000 7fde7de0e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-01T00:56:13.046 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:12 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:12.729+0000 7fde7de0e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-01T00:56:13.046 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:12 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:12.867+0000 7fde7de0e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-01T00:56:13.546 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:13 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:13.138+0000 7fde7de0e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-01T00:56:14.546 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:14 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:14.199+0000 7fde7de0e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-01T00:56:14.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:14 smithi026 ceph-mon[98801]: Activating manager daemon x 2023-12-01T00:56:14.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:14 smithi026 ceph-mon[98801]: mgrmap e2: x(active, starting, since 0.00308795s) 2023-12-01T00:56:14.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:14 smithi026 ceph-mon[98801]: from='mgr.14100 172.21.15.26:0/1980629013' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-01T00:56:14.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:14 smithi026 ceph-mon[98801]: from='mgr.14100 172.21.15.26:0/1980629013' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-01T00:56:14.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:14 smithi026 ceph-mon[98801]: from='mgr.14100 172.21.15.26:0/1980629013' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-01T00:56:14.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:14 smithi026 ceph-mon[98801]: from='mgr.14100 172.21.15.26:0/1980629013' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:56:14.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:14 smithi026 ceph-mon[98801]: from='mgr.14100 172.21.15.26:0/1980629013' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-01T00:56:14.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:14 smithi026 ceph-mon[98801]: Manager daemon x is now available 2023-12-01T00:56:14.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:14 smithi026 ceph-mon[98801]: from='mgr.14100 172.21.15.26:0/1980629013' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-01T00:56:14.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:14 smithi026 ceph-mon[98801]: from='mgr.14100 172.21.15.26:0/1980629013' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-01T00:56:14.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:14 smithi026 ceph-mon[98801]: from='mgr.14100 172.21.15.26:0/1980629013' entity='mgr.x' 2023-12-01T00:56:14.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:14 smithi026 ceph-mon[98801]: from='mgr.14100 172.21.15.26:0/1980629013' entity='mgr.x' 2023-12-01T00:56:14.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:14 smithi026 ceph-mon[98801]: from='mgr.14100 172.21.15.26:0/1980629013' entity='mgr.x' 2023-12-01T00:56:15.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:15 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3789642366' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-01T00:56:15.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:15 smithi026 ceph-mon[98801]: mgrmap e3: x(active, since 1.01153s) 2023-12-01T00:56:17.352 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 2023-12-01T00:56:17.352 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout { 2023-12-01T00:56:17.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "fsid": "48bff570-8fe4-11ee-95a2-87774f69a715", 2023-12-01T00:56:17.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "health": { 2023-12-01T00:56:17.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-01T00:56:17.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-01T00:56:17.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-01T00:56:17.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:17.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-01T00:56:17.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-01T00:56:17.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 0 2023-12-01T00:56:17.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout ], 2023-12-01T00:56:17.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-01T00:56:17.353 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "a" 2023-12-01T00:56:17.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout ], 2023-12-01T00:56:17.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2023-12-01T00:56:17.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-01T00:56:17.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-01T00:56:17.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-01T00:56:17.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-01T00:56:17.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:17.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-01T00:56:17.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-01T00:56:17.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-01T00:56:17.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-01T00:56:17.354 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-01T00:56:17.362 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-01T00:56:17.362 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-01T00:56:17.362 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-01T00:56:17.363 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:17.363 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-01T00:56:17.363 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-01T00:56:17.363 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-01T00:56:17.363 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-01T00:56:17.363 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-01T00:56:17.363 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-01T00:56:17.363 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-01T00:56:17.363 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-01T00:56:17.363 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-01T00:56:17.363 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:17.363 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-01T00:56:17.363 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-01T00:56:17.363 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-01T00:56:17.363 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-01T00:56:17.363 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-01T00:56:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-01T00:56:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-01T00:56:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-01T00:56:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-01T00:56:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-01T00:56:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "restful" 2023-12-01T00:56:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout ], 2023-12-01T00:56:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-01T00:56:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-01T00:56:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-01T00:56:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "modified": "2023-12-01T00:55:57.222486+0000", 2023-12-01T00:56:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-01T00:56:17.364 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-01T00:56:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout } 2023-12-01T00:56:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.907+0000 7ff199e65700 1 Processor -- start 2023-12-01T00:56:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.907+0000 7ff199e65700 1 -- start start 2023-12-01T00:56:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.908+0000 7ff199e65700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1941071f0 0x7ff1941095e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.908+0000 7ff199e65700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff194079e20 con 0x7ff1941071f0 2023-12-01T00:56:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.908+0000 7ff1937fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1941071f0 0x7ff1941095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.908+0000 7ff1937fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1941071f0 0x7ff1941095e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52200/0 (socket says 172.21.15.26:52200) 2023-12-01T00:56:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.908+0000 7ff1937fe700 1 -- 172.21.15.26:0/2318865625 learned_addr learned my addr 172.21.15.26:0/2318865625 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.908+0000 7ff1937fe700 1 -- 172.21.15.26:0/2318865625 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff194079f60 con 0x7ff1941071f0 2023-12-01T00:56:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.908+0000 7ff1937fe700 1 --2- 172.21.15.26:0/2318865625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1941071f0 0x7ff1941095e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0098a0 tx=0x7ff18c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92affaa8f42551dc server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.909+0000 7ff1927fc700 1 -- 172.21.15.26:0/2318865625 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff18c004160 con 0x7ff1941071f0 2023-12-01T00:56:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.909+0000 7ff1927fc700 1 -- 172.21.15.26:0/2318865625 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7ff18c0042c0 con 0x7ff1941071f0 2023-12-01T00:56:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.909+0000 7ff1927fc700 1 -- 172.21.15.26:0/2318865625 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff18c011ac0 con 0x7ff1941071f0 2023-12-01T00:56:17.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.909+0000 7ff199e65700 1 -- 172.21.15.26:0/2318865625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1941071f0 msgr2=0x7ff1941095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:17.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.909+0000 7ff199e65700 1 --2- 172.21.15.26:0/2318865625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1941071f0 0x7ff1941095e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0098a0 tx=0x7ff18c009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:17.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.909+0000 7ff199e65700 1 -- 172.21.15.26:0/2318865625 shutdown_connections 2023-12-01T00:56:17.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.909+0000 7ff199e65700 1 --2- 172.21.15.26:0/2318865625 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1941071f0 0x7ff1941095e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:17.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.909+0000 7ff199e65700 1 -- 172.21.15.26:0/2318865625 >> 172.21.15.26:0/2318865625 conn(0x7ff194100b80 msgr2=0x7ff194102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:17.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.909+0000 7ff199e65700 1 -- 172.21.15.26:0/2318865625 shutdown_connections 2023-12-01T00:56:17.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.909+0000 7ff199e65700 1 -- 172.21.15.26:0/2318865625 wait complete. 2023-12-01T00:56:17.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.910+0000 7ff199e65700 1 Processor -- start 2023-12-01T00:56:17.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.910+0000 7ff199e65700 1 -- start start 2023-12-01T00:56:17.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.911+0000 7ff199e65700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1941071f0 0x7ff19419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:17.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.911+0000 7ff199e65700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff19419a990 con 0x7ff1941071f0 2023-12-01T00:56:17.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.911+0000 7ff1937fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1941071f0 0x7ff19419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:17.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.911+0000 7ff1937fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1941071f0 0x7ff19419a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52202/0 (socket says 172.21.15.26:52202) 2023-12-01T00:56:17.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.911+0000 7ff1937fe700 1 -- 172.21.15.26:0/3789642366 learned_addr learned my addr 172.21.15.26:0/3789642366 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:17.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.911+0000 7ff1937fe700 1 -- 172.21.15.26:0/3789642366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c009550 con 0x7ff1941071f0 2023-12-01T00:56:17.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.911+0000 7ff1937fe700 1 --2- 172.21.15.26:0/3789642366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1941071f0 0x7ff19419a450 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff18c003f70 tx=0x7ff18c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:17.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.911+0000 7ff190ff9700 1 -- 172.21.15.26:0/3789642366 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff18c003b20 con 0x7ff1941071f0 2023-12-01T00:56:17.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.911+0000 7ff190ff9700 1 -- 172.21.15.26:0/3789642366 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7ff18c003c80 con 0x7ff1941071f0 2023-12-01T00:56:17.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.911+0000 7ff199e65700 1 -- 172.21.15.26:0/3789642366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff19419ab90 con 0x7ff1941071f0 2023-12-01T00:56:17.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.911+0000 7ff190ff9700 1 -- 172.21.15.26:0/3789642366 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff18c0248c0 con 0x7ff1941071f0 2023-12-01T00:56:17.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.912+0000 7ff199e65700 1 -- 172.21.15.26:0/3789642366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19419b820 con 0x7ff1941071f0 2023-12-01T00:56:17.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.913+0000 7ff190ff9700 1 -- 172.21.15.26:0/3789642366 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 2) v1 ==== 45024+0+0 (secure 0 0 0) 0x7ff18c024b80 con 0x7ff1941071f0 2023-12-01T00:56:17.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.913+0000 7ff199e65700 1 -- 172.21.15.26:0/3789642366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1940623c0 con 0x7ff1941071f0 2023-12-01T00:56:17.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.913+0000 7ff190ff9700 1 -- 172.21.15.26:0/3789642366 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff18c04bd40 con 0x7ff1941071f0 2023-12-01T00:56:17.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:14.915+0000 7ff190ff9700 1 -- 172.21.15.26:0/3789642366 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7ff18c02dbf0 con 0x7ff1941071f0 2023-12-01T00:56:17.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:15.050+0000 7ff199e65700 1 -- 172.21.15.26:0/3789642366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff194067280 con 0x7ff1941071f0 2023-12-01T00:56:17.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:15.051+0000 7ff190ff9700 1 -- 172.21.15.26:0/3789642366 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7ff18c018350 con 0x7ff1941071f0 2023-12-01T00:56:17.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:15.052+0000 7ff199e65700 1 -- 172.21.15.26:0/3789642366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1941071f0 msgr2=0x7ff19419a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:17.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:15.052+0000 7ff199e65700 1 --2- 172.21.15.26:0/3789642366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1941071f0 0x7ff19419a450 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff18c003f70 tx=0x7ff18c011a90 comp rx=0 tx=0).stop 2023-12-01T00:56:17.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:15.052+0000 7ff199e65700 1 -- 172.21.15.26:0/3789642366 shutdown_connections 2023-12-01T00:56:17.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:15.052+0000 7ff199e65700 1 --2- 172.21.15.26:0/3789642366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1941071f0 0x7ff19419a450 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:17.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:15.052+0000 7ff199e65700 1 -- 172.21.15.26:0/3789642366 >> 172.21.15.26:0/3789642366 conn(0x7ff194100b80 msgr2=0x7ff194101910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:17.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:15.052+0000 7ff199e65700 1 -- 172.21.15.26:0/3789642366 shutdown_connections 2023-12-01T00:56:17.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:15.052+0000 7ff199e65700 1 -- 172.21.15.26:0/3789642366 wait complete. 2023-12-01T00:56:17.368 INFO:teuthology.orchestra.run.smithi026.stdout:mgr not available, waiting (3/15)... 2023-12-01T00:56:17.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:17 smithi026 ceph-mon[98801]: mgrmap e4: x(active, since 2s) 2023-12-01T00:56:21.044 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:20 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3402747630' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-01T00:56:21.111 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 2023-12-01T00:56:21.114 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout { 2023-12-01T00:56:21.114 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "fsid": "48bff570-8fe4-11ee-95a2-87774f69a715", 2023-12-01T00:56:21.114 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "health": { 2023-12-01T00:56:21.114 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-01T00:56:21.114 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-01T00:56:21.114 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-01T00:56:21.114 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:21.114 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-01T00:56:21.114 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-01T00:56:21.114 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 0 2023-12-01T00:56:21.114 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout ], 2023-12-01T00:56:21.114 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-01T00:56:21.114 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "a" 2023-12-01T00:56:21.115 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout ], 2023-12-01T00:56:21.115 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "quorum_age": 16, 2023-12-01T00:56:21.115 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-01T00:56:21.115 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-01T00:56:21.115 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-01T00:56:21.115 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-01T00:56:21.115 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:21.115 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-01T00:56:21.115 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-01T00:56:21.115 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-01T00:56:21.115 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-01T00:56:21.124 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-01T00:56:21.124 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-01T00:56:21.124 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-01T00:56:21.125 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-01T00:56:21.125 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:21.125 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-01T00:56:21.125 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-01T00:56:21.125 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-01T00:56:21.125 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-01T00:56:21.125 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-01T00:56:21.125 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-01T00:56:21.125 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-01T00:56:21.125 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-01T00:56:21.125 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-01T00:56:21.125 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:21.125 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-01T00:56:21.125 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-01T00:56:21.125 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-01T00:56:21.126 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-01T00:56:21.126 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:21.126 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-01T00:56:21.126 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-01T00:56:21.126 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-01T00:56:21.126 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-01T00:56:21.126 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-01T00:56:21.126 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-01T00:56:21.126 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "restful" 2023-12-01T00:56:21.126 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout ], 2023-12-01T00:56:21.126 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-01T00:56:21.126 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:21.127 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-01T00:56:21.127 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-01T00:56:21.127 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "modified": "2023-12-01T00:55:57.222486+0000", 2023-12-01T00:56:21.127 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-01T00:56:21.127 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout }, 2023-12-01T00:56:21.127 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-01T00:56:21.127 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout } 2023-12-01T00:56:21.127 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.161+0000 7fa8a3128700 1 Processor -- start 2023-12-01T00:56:21.128 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.161+0000 7fa8a3128700 1 -- start start 2023-12-01T00:56:21.128 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.161+0000 7fa8a3128700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89c107190 0x7fa89c109580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:21.128 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.161+0000 7fa8a3128700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c079e80 con 0x7fa89c107190 2023-12-01T00:56:21.128 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.161+0000 7fa8a0ec4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89c107190 0x7fa89c109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:21.128 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.161+0000 7fa8a0ec4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89c107190 0x7fa89c109580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52214/0 (socket says 172.21.15.26:52214) 2023-12-01T00:56:21.128 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.161+0000 7fa8a0ec4700 1 -- 172.21.15.26:0/4048258224 learned_addr learned my addr 172.21.15.26:0/4048258224 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:21.128 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.162+0000 7fa8a0ec4700 1 -- 172.21.15.26:0/4048258224 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c109ac0 con 0x7fa89c107190 2023-12-01T00:56:21.128 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.162+0000 7fa8a0ec4700 1 --2- 172.21.15.26:0/4048258224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89c107190 0x7fa89c109580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa8900098a0 tx=0x7fa890009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a34d6b25d52d22 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:21.128 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.162+0000 7fa89b7fe700 1 -- 172.21.15.26:0/4048258224 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa890004160 con 0x7fa89c107190 2023-12-01T00:56:21.128 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.162+0000 7fa89b7fe700 1 -- 172.21.15.26:0/4048258224 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fa8900042c0 con 0x7fa89c107190 2023-12-01T00:56:21.128 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.162+0000 7fa89b7fe700 1 -- 172.21.15.26:0/4048258224 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa890011ac0 con 0x7fa89c107190 2023-12-01T00:56:21.128 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.163+0000 7fa8a3128700 1 -- 172.21.15.26:0/4048258224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89c107190 msgr2=0x7fa89c109580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:21.128 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.163+0000 7fa8a3128700 1 --2- 172.21.15.26:0/4048258224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89c107190 0x7fa89c109580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa8900098a0 tx=0x7fa890009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:21.129 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.163+0000 7fa8a3128700 1 -- 172.21.15.26:0/4048258224 shutdown_connections 2023-12-01T00:56:21.129 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.163+0000 7fa8a3128700 1 --2- 172.21.15.26:0/4048258224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89c107190 0x7fa89c109580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:21.129 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.163+0000 7fa8a3128700 1 -- 172.21.15.26:0/4048258224 >> 172.21.15.26:0/4048258224 conn(0x7fa89c100b80 msgr2=0x7fa89c102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:21.129 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.163+0000 7fa8a3128700 1 -- 172.21.15.26:0/4048258224 shutdown_connections 2023-12-01T00:56:21.129 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.163+0000 7fa8a3128700 1 -- 172.21.15.26:0/4048258224 wait complete. 2023-12-01T00:56:21.129 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.163+0000 7fa8a3128700 1 Processor -- start 2023-12-01T00:56:21.129 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.163+0000 7fa8a3128700 1 -- start start 2023-12-01T00:56:21.129 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.164+0000 7fa8a3128700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89c107190 0x7fa89c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:21.129 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.164+0000 7fa8a3128700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa89c19a970 con 0x7fa89c107190 2023-12-01T00:56:21.129 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.164+0000 7fa8a0ec4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89c107190 0x7fa89c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:21.129 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.164+0000 7fa8a0ec4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89c107190 0x7fa89c19a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52216/0 (socket says 172.21.15.26:52216) 2023-12-01T00:56:21.129 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.164+0000 7fa8a0ec4700 1 -- 172.21.15.26:0/3402747630 learned_addr learned my addr 172.21.15.26:0/3402747630 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:21.129 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.164+0000 7fa8a0ec4700 1 -- 172.21.15.26:0/3402747630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa890009550 con 0x7fa89c107190 2023-12-01T00:56:21.129 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.164+0000 7fa8a0ec4700 1 --2- 172.21.15.26:0/3402747630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89c107190 0x7fa89c19a430 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa890003f70 tx=0x7fa890011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:21.130 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.164+0000 7fa899ffb700 1 -- 172.21.15.26:0/3402747630 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa890003b20 con 0x7fa89c107190 2023-12-01T00:56:21.130 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.164+0000 7fa899ffb700 1 -- 172.21.15.26:0/3402747630 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fa890003c80 con 0x7fa89c107190 2023-12-01T00:56:21.130 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.164+0000 7fa8a3128700 1 -- 172.21.15.26:0/3402747630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa89c19ab70 con 0x7fa89c107190 2023-12-01T00:56:21.130 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.164+0000 7fa899ffb700 1 -- 172.21.15.26:0/3402747630 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8900248c0 con 0x7fa89c107190 2023-12-01T00:56:21.130 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.165+0000 7fa8a3128700 1 -- 172.21.15.26:0/3402747630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa89c19b800 con 0x7fa89c107190 2023-12-01T00:56:21.130 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.165+0000 7fa899ffb700 1 -- 172.21.15.26:0/3402747630 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 45257+0+0 (secure 0 0 0) 0x7fa890024b80 con 0x7fa89c107190 2023-12-01T00:56:21.130 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.166+0000 7fa899ffb700 1 --2- 172.21.15.26:0/3402747630 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fa88c038260 0x7fa88c03a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:21.130 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.166+0000 7fa899ffb700 1 -- 172.21.15.26:0/3402747630 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa89004bff0 con 0x7fa89c107190 2023-12-01T00:56:21.130 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.166+0000 7fa8a3128700 1 -- 172.21.15.26:0/3402747630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa89c0623c0 con 0x7fa89c107190 2023-12-01T00:56:21.130 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.166+0000 7fa89bfff700 1 --2- 172.21.15.26:0/3402747630 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fa88c038260 0x7fa88c03a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:21.130 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.166+0000 7fa89bfff700 1 --2- 172.21.15.26:0/3402747630 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fa88c038260 0x7fa88c03a720 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa888006fd0 tx=0x7fa888006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:21.130 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.171+0000 7fa899ffb700 1 -- 172.21.15.26:0/3402747630 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa890045e60 con 0x7fa89c107190 2023-12-01T00:56:21.130 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.698+0000 7fa8a3128700 1 -- 172.21.15.26:0/3402747630 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fa89c19b010 con 0x7fa89c107190 2023-12-01T00:56:21.131 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.699+0000 7fa899ffb700 1 -- 172.21.15.26:0/3402747630 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fa89c19b010 con 0x7fa89c107190 2023-12-01T00:56:21.131 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.701+0000 7fa8a3128700 1 -- 172.21.15.26:0/3402747630 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fa88c038260 msgr2=0x7fa88c03a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:21.131 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.701+0000 7fa8a3128700 1 --2- 172.21.15.26:0/3402747630 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fa88c038260 0x7fa88c03a720 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa888006fd0 tx=0x7fa888006e40 comp rx=0 tx=0).stop 2023-12-01T00:56:21.131 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.701+0000 7fa8a3128700 1 -- 172.21.15.26:0/3402747630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89c107190 msgr2=0x7fa89c19a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:21.131 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.701+0000 7fa8a3128700 1 --2- 172.21.15.26:0/3402747630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89c107190 0x7fa89c19a430 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa890003f70 tx=0x7fa890011a90 comp rx=0 tx=0).stop 2023-12-01T00:56:21.131 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.701+0000 7fa8a3128700 1 -- 172.21.15.26:0/3402747630 shutdown_connections 2023-12-01T00:56:21.131 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.701+0000 7fa8a3128700 1 --2- 172.21.15.26:0/3402747630 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fa88c038260 0x7fa88c03a720 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:21.131 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.701+0000 7fa8a3128700 1 --2- 172.21.15.26:0/3402747630 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa89c107190 0x7fa89c19a430 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:21.131 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.701+0000 7fa8a3128700 1 -- 172.21.15.26:0/3402747630 >> 172.21.15.26:0/3402747630 conn(0x7fa89c100b80 msgr2=0x7fa89c101960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:21.131 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.701+0000 7fa8a3128700 1 -- 172.21.15.26:0/3402747630 shutdown_connections 2023-12-01T00:56:21.132 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:20.701+0000 7fa8a3128700 1 -- 172.21.15.26:0/3402747630 wait complete. 2023-12-01T00:56:21.132 INFO:teuthology.orchestra.run.smithi026.stdout:mgr is available 2023-12-01T00:56:22.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:21 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3672816181' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-01T00:56:22.364 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 2023-12-01T00:56:22.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout [global] 2023-12-01T00:56:22.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout fsid = 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:56:22.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-01T00:56:22.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-01T00:56:22.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-01T00:56:22.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-01T00:56:22.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 2023-12-01T00:56:22.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-01T00:56:22.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-01T00:56:22.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 2023-12-01T00:56:22.365 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout [osd] 2023-12-01T00:56:22.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-01T00:56:22.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-01T00:56:22.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-01T00:56:22.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-01T00:56:22.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-01T00:56:22.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.565+0000 7fd97b13b700 1 Processor -- start 2023-12-01T00:56:22.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.565+0000 7fd97b13b700 1 -- start start 2023-12-01T00:56:22.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.565+0000 7fd97b13b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd974105ae0 0x7fd974105f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:22.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.565+0000 7fd97b13b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9741064d0 con 0x7fd974105ae0 2023-12-01T00:56:22.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.565+0000 7fd978ed7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd974105ae0 0x7fd974105f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:22.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.565+0000 7fd978ed7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd974105ae0 0x7fd974105f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52220/0 (socket says 172.21.15.26:52220) 2023-12-01T00:56:22.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.565+0000 7fd978ed7700 1 -- 172.21.15.26:0/898148286 learned_addr learned my addr 172.21.15.26:0/898148286 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:22.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.566+0000 7fd978ed7700 1 -- 172.21.15.26:0/898148286 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd974106800 con 0x7fd974105ae0 2023-12-01T00:56:22.366 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.566+0000 7fd978ed7700 1 --2- 172.21.15.26:0/898148286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd974105ae0 0x7fd974105f00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd9680098a0 tx=0x7fd968009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e5bceaa4165c76 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:22.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.566+0000 7fd9737fe700 1 -- 172.21.15.26:0/898148286 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd968004160 con 0x7fd974105ae0 2023-12-01T00:56:22.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.566+0000 7fd9737fe700 1 -- 172.21.15.26:0/898148286 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fd9680042c0 con 0x7fd974105ae0 2023-12-01T00:56:22.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.566+0000 7fd9737fe700 1 -- 172.21.15.26:0/898148286 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd968011ac0 con 0x7fd974105ae0 2023-12-01T00:56:22.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.567+0000 7fd97b13b700 1 -- 172.21.15.26:0/898148286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd974105ae0 msgr2=0x7fd974105f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:22.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.567+0000 7fd97b13b700 1 --2- 172.21.15.26:0/898148286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd974105ae0 0x7fd974105f00 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd9680098a0 tx=0x7fd968009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:22.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.567+0000 7fd97b13b700 1 -- 172.21.15.26:0/898148286 shutdown_connections 2023-12-01T00:56:22.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.567+0000 7fd97b13b700 1 --2- 172.21.15.26:0/898148286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd974105ae0 0x7fd974105f00 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:22.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.567+0000 7fd97b13b700 1 -- 172.21.15.26:0/898148286 >> 172.21.15.26:0/898148286 conn(0x7fd974100300 msgr2=0x7fd974102740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:22.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.567+0000 7fd97b13b700 1 -- 172.21.15.26:0/898148286 shutdown_connections 2023-12-01T00:56:22.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.567+0000 7fd97b13b700 1 -- 172.21.15.26:0/898148286 wait complete. 2023-12-01T00:56:22.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.567+0000 7fd97b13b700 1 Processor -- start 2023-12-01T00:56:22.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.567+0000 7fd97b13b700 1 -- start start 2023-12-01T00:56:22.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.568+0000 7fd97b13b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd974105ae0 0x7fd97418ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:22.367 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.568+0000 7fd97b13b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9741909a0 con 0x7fd974105ae0 2023-12-01T00:56:22.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.568+0000 7fd978ed7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd974105ae0 0x7fd97418ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:22.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.568+0000 7fd978ed7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd974105ae0 0x7fd97418ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52222/0 (socket says 172.21.15.26:52222) 2023-12-01T00:56:22.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.568+0000 7fd978ed7700 1 -- 172.21.15.26:0/3672816181 learned_addr learned my addr 172.21.15.26:0/3672816181 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:22.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.568+0000 7fd978ed7700 1 -- 172.21.15.26:0/3672816181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd968009550 con 0x7fd974105ae0 2023-12-01T00:56:22.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.568+0000 7fd978ed7700 1 --2- 172.21.15.26:0/3672816181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd974105ae0 0x7fd97418ee10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd968003f70 tx=0x7fd968011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:22.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.568+0000 7fd971ffb700 1 -- 172.21.15.26:0/3672816181 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd968003b20 con 0x7fd974105ae0 2023-12-01T00:56:22.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.568+0000 7fd971ffb700 1 -- 172.21.15.26:0/3672816181 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fd968003c80 con 0x7fd974105ae0 2023-12-01T00:56:22.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.568+0000 7fd971ffb700 1 -- 172.21.15.26:0/3672816181 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd9680248c0 con 0x7fd974105ae0 2023-12-01T00:56:22.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.568+0000 7fd97b13b700 1 -- 172.21.15.26:0/3672816181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd974190ba0 con 0x7fd974105ae0 2023-12-01T00:56:22.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.569+0000 7fd97b13b700 1 -- 172.21.15.26:0/3672816181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97418f5a0 con 0x7fd974105ae0 2023-12-01T00:56:22.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.569+0000 7fd971ffb700 1 -- 172.21.15.26:0/3672816181 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 45257+0+0 (secure 0 0 0) 0x7fd96801ac40 con 0x7fd974105ae0 2023-12-01T00:56:22.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.570+0000 7fd971ffb700 1 --2- 172.21.15.26:0/3672816181 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fd964038260 0x7fd96403a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:22.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.570+0000 7fd971ffb700 1 -- 172.21.15.26:0/3672816181 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd96804c050 con 0x7fd974105ae0 2023-12-01T00:56:22.368 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.570+0000 7fd973fff700 1 --2- 172.21.15.26:0/3672816181 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fd964038260 0x7fd96403a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:22.369 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.570+0000 7fd97b13b700 1 -- 172.21.15.26:0/3672816181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9740623c0 con 0x7fd974105ae0 2023-12-01T00:56:22.369 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.570+0000 7fd973fff700 1 --2- 172.21.15.26:0/3672816181 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fd964038260 0x7fd96403a720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd960006fd0 tx=0x7fd960006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:22.369 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.575+0000 7fd971ffb700 1 -- 172.21.15.26:0/3672816181 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd96802d3f0 con 0x7fd974105ae0 2023-12-01T00:56:22.369 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.935+0000 7fd97b13b700 1 -- 172.21.15.26:0/3672816181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fd974067280 con 0x7fd974105ae0 2023-12-01T00:56:22.369 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.936+0000 7fd971ffb700 1 -- 172.21.15.26:0/3672816181 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7fd968049020 con 0x7fd974105ae0 2023-12-01T00:56:22.369 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.938+0000 7fd97b13b700 1 -- 172.21.15.26:0/3672816181 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fd964038260 msgr2=0x7fd96403a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:22.369 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.938+0000 7fd97b13b700 1 --2- 172.21.15.26:0/3672816181 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fd964038260 0x7fd96403a720 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd960006fd0 tx=0x7fd960006e40 comp rx=0 tx=0).stop 2023-12-01T00:56:22.369 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.938+0000 7fd97b13b700 1 -- 172.21.15.26:0/3672816181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd974105ae0 msgr2=0x7fd97418ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:22.369 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.938+0000 7fd97b13b700 1 --2- 172.21.15.26:0/3672816181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd974105ae0 0x7fd97418ee10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd968003f70 tx=0x7fd968011a90 comp rx=0 tx=0).stop 2023-12-01T00:56:22.369 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.938+0000 7fd97b13b700 1 -- 172.21.15.26:0/3672816181 shutdown_connections 2023-12-01T00:56:22.369 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.938+0000 7fd97b13b700 1 --2- 172.21.15.26:0/3672816181 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fd964038260 0x7fd96403a720 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:22.369 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.938+0000 7fd97b13b700 1 --2- 172.21.15.26:0/3672816181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd974105ae0 0x7fd97418ee10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:22.369 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.938+0000 7fd97b13b700 1 -- 172.21.15.26:0/3672816181 >> 172.21.15.26:0/3672816181 conn(0x7fd974100300 msgr2=0x7fd974104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:22.370 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.939+0000 7fd97b13b700 1 -- 172.21.15.26:0/3672816181 shutdown_connections 2023-12-01T00:56:22.370 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:21.939+0000 7fd97b13b700 1 -- 172.21.15.26:0/3672816181 wait complete. 2023-12-01T00:56:22.370 INFO:teuthology.orchestra.run.smithi026.stdout:Enabling cephadm module... 2023-12-01T00:56:23.666 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:23 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1540121673' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-01T00:56:23.666 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:23 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: ignoring --setuser ceph since I am not root 2023-12-01T00:56:23.666 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:23 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: ignoring --setgroup ceph since I am not root 2023-12-01T00:56:23.666 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:23 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:23.569+0000 7f18e4f3d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-01T00:56:23.666 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:23 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:23.664+0000 7f18e4f3d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-01T00:56:23.709 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.833+0000 7fadeac17700 1 Processor -- start 2023-12-01T00:56:23.709 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.834+0000 7fadeac17700 1 -- start start 2023-12-01T00:56:23.709 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.834+0000 7fadeac17700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade4107150 0x7fade4109540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:23.710 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.834+0000 7fadeac17700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade4079ec0 con 0x7fade4107150 2023-12-01T00:56:23.710 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.834+0000 7fade89b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade4107150 0x7fade4109540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:23.710 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.834+0000 7fade89b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade4107150 0x7fade4109540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52226/0 (socket says 172.21.15.26:52226) 2023-12-01T00:56:23.710 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.834+0000 7fade89b3700 1 -- 172.21.15.26:0/804097010 learned_addr learned my addr 172.21.15.26:0/804097010 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:23.710 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.834+0000 7fade89b3700 1 -- 172.21.15.26:0/804097010 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade4109a80 con 0x7fade4107150 2023-12-01T00:56:23.710 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.834+0000 7fade89b3700 1 --2- 172.21.15.26:0/804097010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade4107150 0x7fade4109540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fadd80098a0 tx=0x7fadd8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8adf4720e5f2cc88 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:23.710 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.835+0000 7fade37fe700 1 -- 172.21.15.26:0/804097010 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadd8004160 con 0x7fade4107150 2023-12-01T00:56:23.710 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.835+0000 7fade37fe700 1 -- 172.21.15.26:0/804097010 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fadd80042c0 con 0x7fade4107150 2023-12-01T00:56:23.710 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.835+0000 7fade37fe700 1 -- 172.21.15.26:0/804097010 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadd8011ac0 con 0x7fade4107150 2023-12-01T00:56:23.710 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.835+0000 7fadeac17700 1 -- 172.21.15.26:0/804097010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade4107150 msgr2=0x7fade4109540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:23.711 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.835+0000 7fadeac17700 1 --2- 172.21.15.26:0/804097010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade4107150 0x7fade4109540 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fadd80098a0 tx=0x7fadd8009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:23.711 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.835+0000 7fadeac17700 1 -- 172.21.15.26:0/804097010 shutdown_connections 2023-12-01T00:56:23.711 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.835+0000 7fadeac17700 1 --2- 172.21.15.26:0/804097010 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade4107150 0x7fade4109540 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:23.711 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.835+0000 7fadeac17700 1 -- 172.21.15.26:0/804097010 >> 172.21.15.26:0/804097010 conn(0x7fade4100b80 msgr2=0x7fade4102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:23.711 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.835+0000 7fadeac17700 1 -- 172.21.15.26:0/804097010 shutdown_connections 2023-12-01T00:56:23.711 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.835+0000 7fadeac17700 1 -- 172.21.15.26:0/804097010 wait complete. 2023-12-01T00:56:23.711 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.836+0000 7fadeac17700 1 Processor -- start 2023-12-01T00:56:23.711 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.836+0000 7fadeac17700 1 -- start start 2023-12-01T00:56:23.711 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.836+0000 7fadeac17700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade4107150 0x7fade419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:23.712 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.836+0000 7fadeac17700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade419a970 con 0x7fade4107150 2023-12-01T00:56:23.712 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.836+0000 7fade89b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade4107150 0x7fade419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:23.712 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.836+0000 7fade89b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade4107150 0x7fade419a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52228/0 (socket says 172.21.15.26:52228) 2023-12-01T00:56:23.712 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.836+0000 7fade89b3700 1 -- 172.21.15.26:0/1540121673 learned_addr learned my addr 172.21.15.26:0/1540121673 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:23.712 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.836+0000 7fade89b3700 1 -- 172.21.15.26:0/1540121673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd8009550 con 0x7fade4107150 2023-12-01T00:56:23.712 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.837+0000 7fade89b3700 1 --2- 172.21.15.26:0/1540121673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade4107150 0x7fade419a430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fadd8003f70 tx=0x7fadd8011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:23.712 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.837+0000 7fade1ffb700 1 -- 172.21.15.26:0/1540121673 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadd8003b20 con 0x7fade4107150 2023-12-01T00:56:23.712 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.837+0000 7fade1ffb700 1 -- 172.21.15.26:0/1540121673 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fadd8003c80 con 0x7fade4107150 2023-12-01T00:56:23.712 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.837+0000 7fadeac17700 1 -- 172.21.15.26:0/1540121673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade419ab70 con 0x7fade4107150 2023-12-01T00:56:23.712 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.837+0000 7fade1ffb700 1 -- 172.21.15.26:0/1540121673 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadd80248c0 con 0x7fade4107150 2023-12-01T00:56:23.712 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.837+0000 7fadeac17700 1 -- 172.21.15.26:0/1540121673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade419b800 con 0x7fade4107150 2023-12-01T00:56:23.713 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.838+0000 7fade1ffb700 1 -- 172.21.15.26:0/1540121673 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) v1 ==== 45257+0+0 (secure 0 0 0) 0x7fadd8024b30 con 0x7fade4107150 2023-12-01T00:56:23.713 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.838+0000 7fade1ffb700 1 --2- 172.21.15.26:0/1540121673 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fadd4038300 0x7fadd403a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:23.713 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.838+0000 7fade1ffb700 1 -- 172.21.15.26:0/1540121673 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fadd804c110 con 0x7fade4107150 2023-12-01T00:56:23.713 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.838+0000 7fade3fff700 1 --2- 172.21.15.26:0/1540121673 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fadd4038300 0x7fadd403a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:23.713 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.838+0000 7fadeac17700 1 -- 172.21.15.26:0/1540121673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade419b010 con 0x7fade4107150 2023-12-01T00:56:23.713 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.839+0000 7fade3fff700 1 --2- 172.21.15.26:0/1540121673 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fadd4038300 0x7fadd403a7c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fadd0006fd0 tx=0x7fadd0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:23.713 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:22.843+0000 7fade1ffb700 1 -- 172.21.15.26:0/1540121673 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fade419b010 con 0x7fade4107150 2023-12-01T00:56:23.713 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:23.317+0000 7fadeac17700 1 -- 172.21.15.26:0/1540121673 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fade419b010 con 0x7fade4107150 2023-12-01T00:56:23.713 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:23.370+0000 7fade1ffb700 1 -- 172.21.15.26:0/1540121673 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 5) v1 ==== 45268+0+0 (secure 0 0 0) 0x7fadd8018350 con 0x7fade4107150 2023-12-01T00:56:23.713 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:23.372+0000 7fade1ffb700 1 -- 172.21.15.26:0/1540121673 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fadd801a9d0 con 0x7fade4107150 2023-12-01T00:56:23.713 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:23.375+0000 7fadeac17700 1 -- 172.21.15.26:0/1540121673 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fadd4038300 msgr2=0x7fadd403a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:23.713 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:23.375+0000 7fadeac17700 1 --2- 172.21.15.26:0/1540121673 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fadd4038300 0x7fadd403a7c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fadd0006fd0 tx=0x7fadd0006e40 comp rx=0 tx=0).stop 2023-12-01T00:56:23.713 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:23.375+0000 7fadeac17700 1 -- 172.21.15.26:0/1540121673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade4107150 msgr2=0x7fade419a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:23.714 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:23.375+0000 7fadeac17700 1 --2- 172.21.15.26:0/1540121673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade4107150 0x7fade419a430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fadd8003f70 tx=0x7fadd8011a90 comp rx=0 tx=0).stop 2023-12-01T00:56:23.714 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:23.375+0000 7fadeac17700 1 -- 172.21.15.26:0/1540121673 shutdown_connections 2023-12-01T00:56:23.714 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:23.375+0000 7fadeac17700 1 --2- 172.21.15.26:0/1540121673 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7fadd4038300 0x7fadd403a7c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:23.714 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:23.375+0000 7fadeac17700 1 --2- 172.21.15.26:0/1540121673 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fade4107150 0x7fade419a430 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:23.714 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:23.375+0000 7fadeac17700 1 -- 172.21.15.26:0/1540121673 >> 172.21.15.26:0/1540121673 conn(0x7fade4100b80 msgr2=0x7fade4101920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:23.714 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:23.375+0000 7fadeac17700 1 -- 172.21.15.26:0/1540121673 shutdown_connections 2023-12-01T00:56:23.714 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:23.375+0000 7fadeac17700 1 -- 172.21.15.26:0/1540121673 wait complete. 2023-12-01T00:56:23.934 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:23 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:23.778+0000 7f18e4f3d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-01T00:56:23.935 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:23 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:23.890+0000 7f18e4f3d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-01T00:56:24.296 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:24 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:24.104+0000 7f18e4f3d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-01T00:56:24.709 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:24 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:24.581+0000 7f18e4f3d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-01T00:56:24.710 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:24 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1540121673' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-01T00:56:24.710 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:24 smithi026 ceph-mon[98801]: mgrmap e5: x(active, since 9s) 2023-12-01T00:56:24.965 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:24 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:24.735+0000 7f18e4f3d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-01T00:56:24.966 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:24 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:24.849+0000 7f18e4f3d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-01T00:56:24.966 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:24 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:24.964+0000 7f18e4f3d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-01T00:56:25.056 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout { 2023-12-01T00:56:25.056 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-01T00:56:25.056 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-01T00:56:25.056 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-12-01T00:56:25.056 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-01T00:56:25.056 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout } 2023-12-01T00:56:25.056 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.199+0000 7f0636b0c700 1 Processor -- start 2023-12-01T00:56:25.056 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.199+0000 7f0636b0c700 1 -- start start 2023-12-01T00:56:25.056 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.200+0000 7f0636b0c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06301055e0 0x7f0630105a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.200+0000 7f0636b0c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0630105fd0 con 0x7f06301055e0 2023-12-01T00:56:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.200+0000 7f06348a8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06301055e0 0x7f0630105a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.200+0000 7f06348a8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06301055e0 0x7f0630105a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52242/0 (socket says 172.21.15.26:52242) 2023-12-01T00:56:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.200+0000 7f06348a8700 1 -- 172.21.15.26:0/3871451854 learned_addr learned my addr 172.21.15.26:0/3871451854 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.200+0000 7f06348a8700 1 -- 172.21.15.26:0/3871451854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06301067e0 con 0x7f06301055e0 2023-12-01T00:56:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.200+0000 7f06348a8700 1 --2- 172.21.15.26:0/3871451854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06301055e0 0x7f0630105a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f06240098a0 tx=0x7f0624009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9dc3d63ed4834f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.201+0000 7f062f7fe700 1 -- 172.21.15.26:0/3871451854 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0624004160 con 0x7f06301055e0 2023-12-01T00:56:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.201+0000 7f062f7fe700 1 -- 172.21.15.26:0/3871451854 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f06240042c0 con 0x7f06301055e0 2023-12-01T00:56:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.201+0000 7f062f7fe700 1 -- 172.21.15.26:0/3871451854 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0624011ac0 con 0x7f06301055e0 2023-12-01T00:56:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.201+0000 7f0636b0c700 1 -- 172.21.15.26:0/3871451854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06301055e0 msgr2=0x7f0630105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.201+0000 7f0636b0c700 1 --2- 172.21.15.26:0/3871451854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06301055e0 0x7f0630105a00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f06240098a0 tx=0x7f0624009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.201+0000 7f0636b0c700 1 -- 172.21.15.26:0/3871451854 shutdown_connections 2023-12-01T00:56:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.201+0000 7f0636b0c700 1 --2- 172.21.15.26:0/3871451854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06301055e0 0x7f0630105a00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.201+0000 7f0636b0c700 1 -- 172.21.15.26:0/3871451854 >> 172.21.15.26:0/3871451854 conn(0x7f0630100b80 msgr2=0x7f0630102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:25.057 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.201+0000 7f0636b0c700 1 -- 172.21.15.26:0/3871451854 shutdown_connections 2023-12-01T00:56:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.201+0000 7f0636b0c700 1 -- 172.21.15.26:0/3871451854 wait complete. 2023-12-01T00:56:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.202+0000 7f0636b0c700 1 Processor -- start 2023-12-01T00:56:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.202+0000 7f0636b0c700 1 -- start start 2023-12-01T00:56:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.203+0000 7f0636b0c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06301055e0 0x7f063019d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.203+0000 7f0636b0c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0630079d20 con 0x7f06301055e0 2023-12-01T00:56:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.203+0000 7f06348a8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06301055e0 0x7f063019d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.203+0000 7f06348a8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06301055e0 0x7f063019d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52244/0 (socket says 172.21.15.26:52244) 2023-12-01T00:56:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.203+0000 7f06348a8700 1 -- 172.21.15.26:0/2609174340 learned_addr learned my addr 172.21.15.26:0/2609174340 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.203+0000 7f06348a8700 1 -- 172.21.15.26:0/2609174340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0624009550 con 0x7f06301055e0 2023-12-01T00:56:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.203+0000 7f06348a8700 1 --2- 172.21.15.26:0/2609174340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06301055e0 0x7f063019d0f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0624003f70 tx=0x7f0624011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.203+0000 7f062dffb700 1 -- 172.21.15.26:0/2609174340 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0624003b20 con 0x7f06301055e0 2023-12-01T00:56:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.203+0000 7f062dffb700 1 -- 172.21.15.26:0/2609174340 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f0624003c80 con 0x7f06301055e0 2023-12-01T00:56:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.203+0000 7f0636b0c700 1 -- 172.21.15.26:0/2609174340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0630079f20 con 0x7f06301055e0 2023-12-01T00:56:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.203+0000 7f062dffb700 1 -- 172.21.15.26:0/2609174340 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0624024860 con 0x7f06301055e0 2023-12-01T00:56:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.204+0000 7f0636b0c700 1 -- 172.21.15.26:0/2609174340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063019d880 con 0x7f06301055e0 2023-12-01T00:56:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.204+0000 7f062dffb700 1 -- 172.21.15.26:0/2609174340 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 45268+0+0 (secure 0 0 0) 0x7f062402d3f0 con 0x7f06301055e0 2023-12-01T00:56:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.205+0000 7f062dffb700 1 --2- 172.21.15.26:0/2609174340 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7f0620038300 0x7f062003a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.205+0000 7f062dffb700 1 -- 172.21.15.26:0/2609174340 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f062401a430 con 0x7f06301055e0 2023-12-01T00:56:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.205+0000 7f062ffff700 1 -- 172.21.15.26:0/2609174340 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7f0620038300 msgr2=0x7f062003a7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/4102663452 2023-12-01T00:56:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.205+0000 7f062ffff700 1 --2- 172.21.15.26:0/2609174340 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7f0620038300 0x7f062003a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T00:56:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.205+0000 7f0636b0c700 1 -- 172.21.15.26:0/2609174340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0630067280 con 0x7f06301055e0 2023-12-01T00:56:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.210+0000 7f062dffb700 1 -- 172.21.15.26:0/2609174340 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f062402d6f0 con 0x7f06301055e0 2023-12-01T00:56:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.406+0000 7f062ffff700 1 -- 172.21.15.26:0/2609174340 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7f0620038300 msgr2=0x7f062003a7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/4102663452 2023-12-01T00:56:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.406+0000 7f062ffff700 1 --2- 172.21.15.26:0/2609174340 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7f0620038300 0x7f062003a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-01T00:56:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.684+0000 7f0636b0c700 1 -- 172.21.15.26:0/2609174340 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f063019dbb0 con 0x7f06301055e0 2023-12-01T00:56:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.684+0000 7f062dffb700 1 -- 172.21.15.26:0/2609174340 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f0624020220 con 0x7f06301055e0 2023-12-01T00:56:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.686+0000 7f0636b0c700 1 -- 172.21.15.26:0/2609174340 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7f0620038300 msgr2=0x7f062003a7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-01T00:56:25.059 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.686+0000 7f0636b0c700 1 --2- 172.21.15.26:0/2609174340 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7f0620038300 0x7f062003a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:25.060 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.686+0000 7f0636b0c700 1 -- 172.21.15.26:0/2609174340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06301055e0 msgr2=0x7f063019d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:25.060 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.686+0000 7f0636b0c700 1 --2- 172.21.15.26:0/2609174340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06301055e0 0x7f063019d0f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0624003f70 tx=0x7f0624011b40 comp rx=0 tx=0).stop 2023-12-01T00:56:25.060 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.686+0000 7f0636b0c700 1 -- 172.21.15.26:0/2609174340 shutdown_connections 2023-12-01T00:56:25.060 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.686+0000 7f0636b0c700 1 --2- 172.21.15.26:0/2609174340 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7f0620038300 0x7f062003a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:25.060 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.686+0000 7f0636b0c700 1 --2- 172.21.15.26:0/2609174340 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f06301055e0 0x7f063019d0f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:25.060 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.686+0000 7f0636b0c700 1 -- 172.21.15.26:0/2609174340 >> 172.21.15.26:0/2609174340 conn(0x7f0630100b80 msgr2=0x7f0630101970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:25.060 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.687+0000 7f0636b0c700 1 -- 172.21.15.26:0/2609174340 shutdown_connections 2023-12-01T00:56:25.060 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:24.687+0000 7f0636b0c700 1 -- 172.21.15.26:0/2609174340 wait complete. 2023-12-01T00:56:25.060 INFO:teuthology.orchestra.run.smithi026.stdout:Waiting for the mgr to restart... 2023-12-01T00:56:25.060 INFO:teuthology.orchestra.run.smithi026.stdout:Waiting for mgr epoch 5... 2023-12-01T00:56:25.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:25 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2609174340' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-01T00:56:25.546 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:25 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:25.488+0000 7f18e4f3d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-01T00:56:26.546 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:26 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:26.272+0000 7f18e4f3d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-01T00:56:26.546 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:26 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:26.370+0000 7f18e4f3d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-01T00:56:27.667 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:27 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:27.336+0000 7f18e4f3d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-01T00:56:27.667 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:27 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:27.446+0000 7f18e4f3d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-01T00:56:28.291 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:27 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:27.666+0000 7f18e4f3d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-01T00:56:28.291 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:28 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:28.015+0000 7f18e4f3d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-01T00:56:28.546 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:28 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:28.290+0000 7f18e4f3d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-01T00:56:28.546 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:28 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:28.472+0000 7f18e4f3d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-01T00:56:29.296 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:28 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:28.802+0000 7f18e4f3d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-01T00:56:30.037 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:29 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:29.630+0000 7f18e4f3d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-01T00:56:30.037 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:29 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:29.789+0000 7f18e4f3d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-01T00:56:30.297 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:30 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:30.036+0000 7f18e4f3d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-01T00:56:30.297 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:30 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:30.173+0000 7f18e4f3d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-01T00:56:30.796 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:30 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:30.447+0000 7f18e4f3d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-01T00:56:31.796 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:31 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:31.490+0000 7f18e4f3d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-01T00:56:31.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:31 smithi026 ceph-mon[98801]: Active manager daemon x restarted 2023-12-01T00:56:31.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:31 smithi026 ceph-mon[98801]: Activating manager daemon x 2023-12-01T00:56:31.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:31 smithi026 ceph-mon[98801]: osdmap e2: 0 total, 0 up, 0 in 2023-12-01T00:56:31.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:31 smithi026 ceph-mon[98801]: mgrmap e6: x(active, starting, since 0.00359035s) 2023-12-01T00:56:31.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:31 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:56:31.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:31 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-01T00:56:31.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:31 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-01T00:56:31.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:31 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-01T00:56:31.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:31 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-01T00:56:31.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:31 smithi026 ceph-mon[98801]: Manager daemon x is now available 2023-12-01T00:56:31.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:31 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' 2023-12-01T00:56:31.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:31 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' 2023-12-01T00:56:31.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:31 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:56:31.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:31 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:56:32.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:32 smithi026 ceph-mon[98801]: Found migration_current of "None". Setting to last migration. 2023-12-01T00:56:32.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:32 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:56:32.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:32 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-01T00:56:32.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:32 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-01T00:56:32.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:32 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' 2023-12-01T00:56:32.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:32 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' 2023-12-01T00:56:32.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:32 smithi026 ceph-mon[98801]: mgrmap e7: x(active, since 1.00577s) 2023-12-01T00:56:32.819 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout { 2023-12-01T00:56:32.819 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-01T00:56:32.819 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-01T00:56:32.819 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout } 2023-12-01T00:56:32.819 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.548+0000 7ff6f3812700 1 Processor -- start 2023-12-01T00:56:32.819 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.549+0000 7ff6f3812700 1 -- start start 2023-12-01T00:56:32.819 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.549+0000 7ff6f3812700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6ec105ae0 0x7ff6ec105f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:32.819 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.549+0000 7ff6f3812700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec1064d0 con 0x7ff6ec105ae0 2023-12-01T00:56:32.819 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.549+0000 7ff6f15ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6ec105ae0 0x7ff6ec105f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:32.819 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.549+0000 7ff6f15ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6ec105ae0 0x7ff6ec105f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52252/0 (socket says 172.21.15.26:52252) 2023-12-01T00:56:32.819 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.549+0000 7ff6f15ae700 1 -- 172.21.15.26:0/1637152808 learned_addr learned my addr 172.21.15.26:0/1637152808 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:32.820 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.549+0000 7ff6f15ae700 1 -- 172.21.15.26:0/1637152808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec106800 con 0x7ff6ec105ae0 2023-12-01T00:56:32.820 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.549+0000 7ff6f15ae700 1 --2- 172.21.15.26:0/1637152808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6ec105ae0 0x7ff6ec105f00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80098a0 tx=0x7ff6e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37372a0f3078d2eb server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:32.820 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.550+0000 7ff6e3fff700 1 -- 172.21.15.26:0/1637152808 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6e8004160 con 0x7ff6ec105ae0 2023-12-01T00:56:32.820 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.550+0000 7ff6e3fff700 1 -- 172.21.15.26:0/1637152808 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7ff6e80042c0 con 0x7ff6ec105ae0 2023-12-01T00:56:32.820 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.550+0000 7ff6e3fff700 1 -- 172.21.15.26:0/1637152808 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6e8011ac0 con 0x7ff6ec105ae0 2023-12-01T00:56:32.820 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.550+0000 7ff6f3812700 1 -- 172.21.15.26:0/1637152808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6ec105ae0 msgr2=0x7ff6ec105f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:32.820 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.550+0000 7ff6f3812700 1 --2- 172.21.15.26:0/1637152808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6ec105ae0 0x7ff6ec105f00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80098a0 tx=0x7ff6e8009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:32.820 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.551+0000 7ff6f3812700 1 -- 172.21.15.26:0/1637152808 shutdown_connections 2023-12-01T00:56:32.820 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.551+0000 7ff6f3812700 1 --2- 172.21.15.26:0/1637152808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6ec105ae0 0x7ff6ec105f00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:32.820 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.551+0000 7ff6f3812700 1 -- 172.21.15.26:0/1637152808 >> 172.21.15.26:0/1637152808 conn(0x7ff6ec100300 msgr2=0x7ff6ec102740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:32.820 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.551+0000 7ff6f3812700 1 -- 172.21.15.26:0/1637152808 shutdown_connections 2023-12-01T00:56:32.820 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.551+0000 7ff6f3812700 1 -- 172.21.15.26:0/1637152808 wait complete. 2023-12-01T00:56:32.820 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.551+0000 7ff6f3812700 1 Processor -- start 2023-12-01T00:56:32.820 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.551+0000 7ff6f3812700 1 -- start start 2023-12-01T00:56:32.821 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.552+0000 7ff6f3812700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6ec105ae0 0x7ff6ec19d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:32.821 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.552+0000 7ff6f3812700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ec1053e0 con 0x7ff6ec105ae0 2023-12-01T00:56:32.821 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.552+0000 7ff6f15ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6ec105ae0 0x7ff6ec19d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:32.821 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.552+0000 7ff6f15ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6ec105ae0 0x7ff6ec19d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52254/0 (socket says 172.21.15.26:52254) 2023-12-01T00:56:32.821 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.552+0000 7ff6f15ae700 1 -- 172.21.15.26:0/415144596 learned_addr learned my addr 172.21.15.26:0/415144596 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:32.821 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.552+0000 7ff6f15ae700 1 -- 172.21.15.26:0/415144596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e8009550 con 0x7ff6ec105ae0 2023-12-01T00:56:32.821 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.552+0000 7ff6f15ae700 1 --2- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6ec105ae0 0x7ff6ec19d060 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8003f70 tx=0x7ff6e8011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:32.821 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.552+0000 7ff6e27fc700 1 -- 172.21.15.26:0/415144596 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6e8003b20 con 0x7ff6ec105ae0 2023-12-01T00:56:32.821 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.552+0000 7ff6e27fc700 1 -- 172.21.15.26:0/415144596 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7ff6e8003c80 con 0x7ff6ec105ae0 2023-12-01T00:56:32.821 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.552+0000 7ff6e27fc700 1 -- 172.21.15.26:0/415144596 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6e8024880 con 0x7ff6ec105ae0 2023-12-01T00:56:32.821 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.552+0000 7ff6f3812700 1 -- 172.21.15.26:0/415144596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ec19d5a0 con 0x7ff6ec105ae0 2023-12-01T00:56:32.821 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.553+0000 7ff6f3812700 1 -- 172.21.15.26:0/415144596 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ec19d900 con 0x7ff6ec105ae0 2023-12-01T00:56:32.821 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.553+0000 7ff6e27fc700 1 -- 172.21.15.26:0/415144596 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) v1 ==== 45268+0+0 (secure 0 0 0) 0x7ff6e802d3f0 con 0x7ff6ec105ae0 2023-12-01T00:56:32.821 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.554+0000 7ff6e27fc700 1 --2- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7ff6d8038350 0x7ff6d803a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:32.821 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.554+0000 7ff6e27fc700 1 -- 172.21.15.26:0/415144596 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff6e804c100 con 0x7ff6ec105ae0 2023-12-01T00:56:32.822 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.554+0000 7ff6f0dad700 1 -- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7ff6d8038350 msgr2=0x7ff6d803a810 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/4102663452 2023-12-01T00:56:32.822 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.554+0000 7ff6f0dad700 1 --2- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7ff6d8038350 0x7ff6d803a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T00:56:32.822 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.554+0000 7ff6f3812700 1 -- 172.21.15.26:0/415144596 --> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6ec067280 con 0x7ff6d8038350 2023-12-01T00:56:32.822 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.755+0000 7ff6f0dad700 1 -- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7ff6d8038350 msgr2=0x7ff6d803a810 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/4102663452 2023-12-01T00:56:32.822 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:25.755+0000 7ff6f0dad700 1 --2- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7ff6d8038350 0x7ff6d803a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-01T00:56:32.822 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:26.156+0000 7ff6f0dad700 1 -- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7ff6d8038350 msgr2=0x7ff6d803a810 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/4102663452 2023-12-01T00:56:32.822 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:26.156+0000 7ff6f0dad700 1 --2- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7ff6d8038350 0x7ff6d803a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-01T00:56:32.822 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:26.957+0000 7ff6f0dad700 1 -- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7ff6d8038350 msgr2=0x7ff6d803a810 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/4102663452 2023-12-01T00:56:32.822 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:26.957+0000 7ff6f0dad700 1 --2- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7ff6d8038350 0x7ff6d803a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-01T00:56:32.822 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:28.558+0000 7ff6f0dad700 1 -- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7ff6d8038350 msgr2=0x7ff6d803a810 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/4102663452 2023-12-01T00:56:32.822 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:28.558+0000 7ff6f0dad700 1 --2- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7ff6d8038350 0x7ff6d803a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-01T00:56:32.822 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:31.505+0000 7ff6e27fc700 1 -- 172.21.15.26:0/415144596 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mgrmap(e 6) v1 ==== 45035+0+0 (secure 0 0 0) 0x7ff6e8019460 con 0x7ff6ec105ae0 2023-12-01T00:56:32.822 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:31.505+0000 7ff6e27fc700 1 -- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7ff6d8038350 msgr2=0x7ff6d803a810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-01T00:56:32.823 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:31.505+0000 7ff6e27fc700 1 --2- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7ff6d8038350 0x7ff6d803a810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:32.823 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.506+0000 7ff6e27fc700 1 -- 172.21.15.26:0/415144596 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 7) v1 ==== 45162+0+0 (secure 0 0 0) 0x7ff6e804d670 con 0x7ff6ec105ae0 2023-12-01T00:56:32.823 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.506+0000 7ff6e27fc700 1 --2- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7ff6d803ba80 0x7ff6d803de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:32.823 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.506+0000 7ff6e27fc700 1 -- 172.21.15.26:0/415144596 --> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6ec067280 con 0x7ff6d803ba80 2023-12-01T00:56:32.823 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.507+0000 7ff6f0dad700 1 --2- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7ff6d803ba80 0x7ff6d803de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:32.823 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.507+0000 7ff6f0dad700 1 --2- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7ff6d803ba80 0x7ff6d803de70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc003a10 tx=0x7ff6dc0092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:32.823 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.508+0000 7ff6e27fc700 1 -- 172.21.15.26:0/415144596 <== mgr.14120 v2:172.21.15.26:6800/2565806966 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7ff6ec067280 con 0x7ff6d803ba80 2023-12-01T00:56:32.823 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.519+0000 7ff6f3812700 1 -- 172.21.15.26:0/415144596 --> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7ff6ec104da0 con 0x7ff6d803ba80 2023-12-01T00:56:32.823 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.519+0000 7ff6e27fc700 1 -- 172.21.15.26:0/415144596 <== mgr.14120 v2:172.21.15.26:6800/2565806966 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7ff6ec104da0 con 0x7ff6d803ba80 2023-12-01T00:56:32.823 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.519+0000 7ff6f3812700 1 -- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7ff6d803ba80 msgr2=0x7ff6d803de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:32.823 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.519+0000 7ff6f3812700 1 --2- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7ff6d803ba80 0x7ff6d803de70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc003a10 tx=0x7ff6dc0092b0 comp rx=0 tx=0).stop 2023-12-01T00:56:32.823 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.519+0000 7ff6f3812700 1 -- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6ec105ae0 msgr2=0x7ff6ec19d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:32.823 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.519+0000 7ff6f3812700 1 --2- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6ec105ae0 0x7ff6ec19d060 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8003f70 tx=0x7ff6e8011b40 comp rx=0 tx=0).stop 2023-12-01T00:56:32.823 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.519+0000 7ff6f3812700 1 -- 172.21.15.26:0/415144596 shutdown_connections 2023-12-01T00:56:32.823 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.519+0000 7ff6f3812700 1 --2- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7ff6d803ba80 0x7ff6d803de70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:32.824 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.519+0000 7ff6f3812700 1 --2- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff6ec105ae0 0x7ff6ec19d060 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:32.824 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.519+0000 7ff6f3812700 1 --2- 172.21.15.26:0/415144596 >> [v2:172.21.15.26:6800/4102663452,v1:172.21.15.26:6801/4102663452] conn(0x7ff6d8038350 0x7ff6d803a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:32.824 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.519+0000 7ff6f3812700 1 -- 172.21.15.26:0/415144596 >> 172.21.15.26:0/415144596 conn(0x7ff6ec100300 msgr2=0x7ff6ec1019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:32.824 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.519+0000 7ff6f3812700 1 -- 172.21.15.26:0/415144596 shutdown_connections 2023-12-01T00:56:32.824 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:32.519+0000 7ff6f3812700 1 -- 172.21.15.26:0/415144596 wait complete. 2023-12-01T00:56:32.824 INFO:teuthology.orchestra.run.smithi026.stdout:mgr epoch 5 is available 2023-12-01T00:56:32.824 INFO:teuthology.orchestra.run.smithi026.stdout:Setting orchestrator backend to cephadm... 2023-12-01T00:56:33.852 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:33 smithi026 ceph-mon[98801]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-01T00:56:33.852 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:33 smithi026 ceph-mon[98801]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-01T00:56:33.852 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:33 smithi026 ceph-mon[98801]: [01/Dec/2023:00:56:32] ENGINE Bus STARTING 2023-12-01T00:56:33.853 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:33 smithi026 ceph-mon[98801]: [01/Dec/2023:00:56:32] ENGINE Serving on https://172.21.15.26:7150 2023-12-01T00:56:33.853 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:33 smithi026 ceph-mon[98801]: [01/Dec/2023:00:56:32] ENGINE Serving on http://172.21.15.26:8765 2023-12-01T00:56:33.853 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:33 smithi026 ceph-mon[98801]: [01/Dec/2023:00:56:32] ENGINE Bus STARTED 2023-12-01T00:56:33.853 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:33 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:56:34.061 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.315+0000 7f8e771f5700 1 Processor -- start 2023-12-01T00:56:34.061 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.315+0000 7f8e771f5700 1 -- start start 2023-12-01T00:56:34.062 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.315+0000 7f8e771f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e701055e0 0x7f8e70105a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:34.062 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.315+0000 7f8e771f5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70105fd0 con 0x7f8e701055e0 2023-12-01T00:56:34.062 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.315+0000 7f8e74f91700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e701055e0 0x7f8e70105a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:34.062 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.316+0000 7f8e74f91700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e701055e0 0x7f8e70105a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52306/0 (socket says 172.21.15.26:52306) 2023-12-01T00:56:34.062 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.316+0000 7f8e74f91700 1 -- 172.21.15.26:0/2492169288 learned_addr learned my addr 172.21.15.26:0/2492169288 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:34.062 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.316+0000 7f8e74f91700 1 -- 172.21.15.26:0/2492169288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e701067e0 con 0x7f8e701055e0 2023-12-01T00:56:34.062 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.316+0000 7f8e74f91700 1 --2- 172.21.15.26:0/2492169288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e701055e0 0x7f8e70105a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8e640098a0 tx=0x7f8e64009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2297cea92ea2dea2 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:34.062 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.316+0000 7f8e6f7fe700 1 -- 172.21.15.26:0/2492169288 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e64004160 con 0x7f8e701055e0 2023-12-01T00:56:34.062 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.316+0000 7f8e6f7fe700 1 -- 172.21.15.26:0/2492169288 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f8e640042c0 con 0x7f8e701055e0 2023-12-01T00:56:34.062 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.316+0000 7f8e6f7fe700 1 -- 172.21.15.26:0/2492169288 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e64011ac0 con 0x7f8e701055e0 2023-12-01T00:56:34.062 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.317+0000 7f8e771f5700 1 -- 172.21.15.26:0/2492169288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e701055e0 msgr2=0x7f8e70105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:34.062 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.317+0000 7f8e771f5700 1 --2- 172.21.15.26:0/2492169288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e701055e0 0x7f8e70105a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8e640098a0 tx=0x7f8e64009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:34.063 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.317+0000 7f8e771f5700 1 -- 172.21.15.26:0/2492169288 shutdown_connections 2023-12-01T00:56:34.063 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.317+0000 7f8e771f5700 1 --2- 172.21.15.26:0/2492169288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e701055e0 0x7f8e70105a00 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:34.063 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.317+0000 7f8e771f5700 1 -- 172.21.15.26:0/2492169288 >> 172.21.15.26:0/2492169288 conn(0x7f8e70100b80 msgr2=0x7f8e70102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:34.063 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.317+0000 7f8e771f5700 1 -- 172.21.15.26:0/2492169288 shutdown_connections 2023-12-01T00:56:34.063 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.317+0000 7f8e771f5700 1 -- 172.21.15.26:0/2492169288 wait complete. 2023-12-01T00:56:34.063 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.317+0000 7f8e771f5700 1 Processor -- start 2023-12-01T00:56:34.063 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.318+0000 7f8e771f5700 1 -- start start 2023-12-01T00:56:34.063 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.318+0000 7f8e771f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e701055e0 0x7f8e7019d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:34.063 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.318+0000 7f8e771f5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e70079d80 con 0x7f8e701055e0 2023-12-01T00:56:34.063 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.318+0000 7f8e74f91700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e701055e0 0x7f8e7019d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:34.063 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.318+0000 7f8e74f91700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e701055e0 0x7f8e7019d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52308/0 (socket says 172.21.15.26:52308) 2023-12-01T00:56:34.063 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.318+0000 7f8e74f91700 1 -- 172.21.15.26:0/3343611835 learned_addr learned my addr 172.21.15.26:0/3343611835 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:34.063 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.318+0000 7f8e74f91700 1 -- 172.21.15.26:0/3343611835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e64009550 con 0x7f8e701055e0 2023-12-01T00:56:34.063 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.318+0000 7f8e74f91700 1 --2- 172.21.15.26:0/3343611835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e701055e0 0x7f8e7019d0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8e64003f70 tx=0x7f8e64011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:34.064 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.318+0000 7f8e6dffb700 1 -- 172.21.15.26:0/3343611835 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e64003b20 con 0x7f8e701055e0 2023-12-01T00:56:34.064 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.318+0000 7f8e6dffb700 1 -- 172.21.15.26:0/3343611835 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f8e64003c80 con 0x7f8e701055e0 2023-12-01T00:56:34.064 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.318+0000 7f8e771f5700 1 -- 172.21.15.26:0/3343611835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7019d600 con 0x7f8e701055e0 2023-12-01T00:56:34.064 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.318+0000 7f8e6dffb700 1 -- 172.21.15.26:0/3343611835 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8e64024860 con 0x7f8e701055e0 2023-12-01T00:56:34.064 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.319+0000 7f8e771f5700 1 -- 172.21.15.26:0/3343611835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7019d960 con 0x7f8e701055e0 2023-12-01T00:56:34.064 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.320+0000 7f8e6dffb700 1 -- 172.21.15.26:0/3343611835 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 7) v1 ==== 45162+0+0 (secure 0 0 0) 0x7f8e6402d3f0 con 0x7f8e701055e0 2023-12-01T00:56:34.064 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.320+0000 7f8e6dffb700 1 --2- 172.21.15.26:0/3343611835 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f8e60038220 0x7f8e6003a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:34.064 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.320+0000 7f8e6dffb700 1 -- 172.21.15.26:0/3343611835 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f8e6404c510 con 0x7f8e701055e0 2023-12-01T00:56:34.064 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.320+0000 7f8e771f5700 1 -- 172.21.15.26:0/3343611835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e70067280 con 0x7f8e701055e0 2023-12-01T00:56:34.064 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.320+0000 7f8e6ffff700 1 --2- 172.21.15.26:0/3343611835 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f8e60038220 0x7f8e6003a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:34.064 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.320+0000 7f8e6ffff700 1 --2- 172.21.15.26:0/3343611835 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f8e60038220 0x7f8e6003a6e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c006fd0 tx=0x7f8e5c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:34.064 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.325+0000 7f8e6dffb700 1 -- 172.21.15.26:0/3343611835 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8e64010970 con 0x7f8e701055e0 2023-12-01T00:56:34.064 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.557+0000 7f8e6dffb700 1 -- 172.21.15.26:0/3343611835 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7f8e6402d8d0 con 0x7f8e701055e0 2023-12-01T00:56:34.065 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.718+0000 7f8e771f5700 1 -- 172.21.15.26:0/3343611835 --> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e70102060 con 0x7f8e60038220 2023-12-01T00:56:34.065 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.725+0000 7f8e6dffb700 1 -- 172.21.15.26:0/3343611835 <== mgr.14120 v2:172.21.15.26:6800/2565806966 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8e70102060 con 0x7f8e60038220 2023-12-01T00:56:34.065 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.727+0000 7f8e771f5700 1 -- 172.21.15.26:0/3343611835 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f8e60038220 msgr2=0x7f8e6003a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:34.065 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.727+0000 7f8e771f5700 1 --2- 172.21.15.26:0/3343611835 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f8e60038220 0x7f8e6003a6e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c006fd0 tx=0x7f8e5c006e40 comp rx=0 tx=0).stop 2023-12-01T00:56:34.065 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.727+0000 7f8e771f5700 1 -- 172.21.15.26:0/3343611835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e701055e0 msgr2=0x7f8e7019d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:34.065 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.727+0000 7f8e771f5700 1 --2- 172.21.15.26:0/3343611835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e701055e0 0x7f8e7019d0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8e64003f70 tx=0x7f8e64011b40 comp rx=0 tx=0).stop 2023-12-01T00:56:34.065 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.727+0000 7f8e771f5700 1 -- 172.21.15.26:0/3343611835 shutdown_connections 2023-12-01T00:56:34.065 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.727+0000 7f8e771f5700 1 --2- 172.21.15.26:0/3343611835 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f8e60038220 0x7f8e6003a6e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:34.065 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.727+0000 7f8e771f5700 1 --2- 172.21.15.26:0/3343611835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8e701055e0 0x7f8e7019d0c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:34.065 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.727+0000 7f8e771f5700 1 -- 172.21.15.26:0/3343611835 >> 172.21.15.26:0/3343611835 conn(0x7f8e70100b80 msgr2=0x7f8e70101950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:34.065 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.728+0000 7f8e771f5700 1 -- 172.21.15.26:0/3343611835 shutdown_connections 2023-12-01T00:56:34.065 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:33.728+0000 7f8e771f5700 1 -- 172.21.15.26:0/3343611835 wait complete. 2023-12-01T00:56:34.960 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:34 smithi026 ceph-mon[98801]: mgrmap e8: x(active, since 2s) 2023-12-01T00:56:34.960 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:34 smithi026 ceph-mon[98801]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:56:34.960 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:34 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' 2023-12-01T00:56:34.960 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:34 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:56:35.306 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-01T00:56:35.306 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.553+0000 7fb647022700 1 Processor -- start 2023-12-01T00:56:35.306 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.553+0000 7fb647022700 1 -- start start 2023-12-01T00:56:35.306 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.553+0000 7fb647022700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb640107170 0x7fb640109560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:35.306 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.553+0000 7fb647022700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb640079e80 con 0x7fb640107170 2023-12-01T00:56:35.306 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.553+0000 7fb644dbe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb640107170 0x7fb640109560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:35.306 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.553+0000 7fb644dbe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb640107170 0x7fb640109560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52312/0 (socket says 172.21.15.26:52312) 2023-12-01T00:56:35.307 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.553+0000 7fb644dbe700 1 -- 172.21.15.26:0/3749462173 learned_addr learned my addr 172.21.15.26:0/3749462173 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:35.307 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.554+0000 7fb644dbe700 1 -- 172.21.15.26:0/3749462173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb640109aa0 con 0x7fb640107170 2023-12-01T00:56:35.307 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.554+0000 7fb644dbe700 1 --2- 172.21.15.26:0/3749462173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb640107170 0x7fb640109560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb6340098a0 tx=0x7fb634009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfd85db9cc9ab94 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:35.307 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.554+0000 7fb63f7fe700 1 -- 172.21.15.26:0/3749462173 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb634004160 con 0x7fb640107170 2023-12-01T00:56:35.307 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.554+0000 7fb63f7fe700 1 -- 172.21.15.26:0/3749462173 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fb6340042c0 con 0x7fb640107170 2023-12-01T00:56:35.307 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.554+0000 7fb63f7fe700 1 -- 172.21.15.26:0/3749462173 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb634011ac0 con 0x7fb640107170 2023-12-01T00:56:35.307 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.554+0000 7fb647022700 1 -- 172.21.15.26:0/3749462173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb640107170 msgr2=0x7fb640109560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:35.307 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.554+0000 7fb647022700 1 --2- 172.21.15.26:0/3749462173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb640107170 0x7fb640109560 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb6340098a0 tx=0x7fb634009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:35.307 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.555+0000 7fb647022700 1 -- 172.21.15.26:0/3749462173 shutdown_connections 2023-12-01T00:56:35.307 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.555+0000 7fb647022700 1 --2- 172.21.15.26:0/3749462173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb640107170 0x7fb640109560 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:35.307 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.555+0000 7fb647022700 1 -- 172.21.15.26:0/3749462173 >> 172.21.15.26:0/3749462173 conn(0x7fb640100b80 msgr2=0x7fb640102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:35.307 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.555+0000 7fb647022700 1 -- 172.21.15.26:0/3749462173 shutdown_connections 2023-12-01T00:56:35.307 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.555+0000 7fb647022700 1 -- 172.21.15.26:0/3749462173 wait complete. 2023-12-01T00:56:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.555+0000 7fb647022700 1 Processor -- start 2023-12-01T00:56:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.555+0000 7fb647022700 1 -- start start 2023-12-01T00:56:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.555+0000 7fb647022700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb640107170 0x7fb64019c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.555+0000 7fb647022700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64019caa0 con 0x7fb640107170 2023-12-01T00:56:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.556+0000 7fb644dbe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb640107170 0x7fb64019c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.556+0000 7fb644dbe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb640107170 0x7fb64019c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52314/0 (socket says 172.21.15.26:52314) 2023-12-01T00:56:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.556+0000 7fb644dbe700 1 -- 172.21.15.26:0/2572834143 learned_addr learned my addr 172.21.15.26:0/2572834143 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.556+0000 7fb644dbe700 1 -- 172.21.15.26:0/2572834143 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb634009550 con 0x7fb640107170 2023-12-01T00:56:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.556+0000 7fb644dbe700 1 --2- 172.21.15.26:0/2572834143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb640107170 0x7fb64019c560 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb634003f70 tx=0x7fb634011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.556+0000 7fb63dffb700 1 -- 172.21.15.26:0/2572834143 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb634003b20 con 0x7fb640107170 2023-12-01T00:56:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.556+0000 7fb63dffb700 1 -- 172.21.15.26:0/2572834143 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fb634003c80 con 0x7fb640107170 2023-12-01T00:56:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.556+0000 7fb647022700 1 -- 172.21.15.26:0/2572834143 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64019cca0 con 0x7fb640107170 2023-12-01T00:56:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.556+0000 7fb63dffb700 1 -- 172.21.15.26:0/2572834143 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb634024880 con 0x7fb640107170 2023-12-01T00:56:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.556+0000 7fb647022700 1 -- 172.21.15.26:0/2572834143 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64019d140 con 0x7fb640107170 2023-12-01T00:56:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.557+0000 7fb63dffb700 1 -- 172.21.15.26:0/2572834143 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7fb63402d3f0 con 0x7fb640107170 2023-12-01T00:56:35.308 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.557+0000 7fb647022700 1 -- 172.21.15.26:0/2572834143 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64010a8a0 con 0x7fb640107170 2023-12-01T00:56:35.309 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.557+0000 7fb63dffb700 1 --2- 172.21.15.26:0/2572834143 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fb630038350 0x7fb63003a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:35.309 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.558+0000 7fb63dffb700 1 -- 172.21.15.26:0/2572834143 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fb63404c4c0 con 0x7fb640107170 2023-12-01T00:56:35.309 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.558+0000 7fb63ffff700 1 --2- 172.21.15.26:0/2572834143 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fb630038350 0x7fb63003a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:35.309 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.558+0000 7fb63ffff700 1 --2- 172.21.15.26:0/2572834143 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fb630038350 0x7fb63003a810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb62c006fd0 tx=0x7fb62c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:35.309 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.563+0000 7fb63dffb700 1 -- 172.21.15.26:0/2572834143 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb634010970 con 0x7fb640107170 2023-12-01T00:56:35.309 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.932+0000 7fb647022700 1 -- 172.21.15.26:0/2572834143 --> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fb640102000 con 0x7fb630038350 2023-12-01T00:56:35.309 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.932+0000 7fb63dffb700 1 -- 172.21.15.26:0/2572834143 <== mgr.14120 v2:172.21.15.26:6800/2565806966 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fb640102000 con 0x7fb630038350 2023-12-01T00:56:35.309 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.935+0000 7fb647022700 1 -- 172.21.15.26:0/2572834143 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fb630038350 msgr2=0x7fb63003a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:35.309 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.935+0000 7fb647022700 1 --2- 172.21.15.26:0/2572834143 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fb630038350 0x7fb63003a810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb62c006fd0 tx=0x7fb62c006e40 comp rx=0 tx=0).stop 2023-12-01T00:56:35.309 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.935+0000 7fb647022700 1 -- 172.21.15.26:0/2572834143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb640107170 msgr2=0x7fb64019c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:35.309 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.935+0000 7fb647022700 1 --2- 172.21.15.26:0/2572834143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb640107170 0x7fb64019c560 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb634003f70 tx=0x7fb634011b40 comp rx=0 tx=0).stop 2023-12-01T00:56:35.309 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.935+0000 7fb647022700 1 -- 172.21.15.26:0/2572834143 shutdown_connections 2023-12-01T00:56:35.309 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.935+0000 7fb647022700 1 --2- 172.21.15.26:0/2572834143 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fb630038350 0x7fb63003a810 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:35.309 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.935+0000 7fb647022700 1 --2- 172.21.15.26:0/2572834143 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb640107170 0x7fb64019c560 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:35.309 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.935+0000 7fb647022700 1 -- 172.21.15.26:0/2572834143 >> 172.21.15.26:0/2572834143 conn(0x7fb640100b80 msgr2=0x7fb6401018f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:35.310 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.935+0000 7fb647022700 1 -- 172.21.15.26:0/2572834143 shutdown_connections 2023-12-01T00:56:35.310 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:34.935+0000 7fb647022700 1 -- 172.21.15.26:0/2572834143 wait complete. 2023-12-01T00:56:35.310 INFO:teuthology.orchestra.run.smithi026.stdout:Generating ssh key... 2023-12-01T00:56:36.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:35 smithi026 ceph-mon[98801]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:56:36.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-mon[98801]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:56:36.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-mon[98801]: Generating ssh key... 2023-12-01T00:56:36.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' 2023-12-01T00:56:36.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' 2023-12-01T00:56:36.796 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: Generating public/private rsa key pair. 2023-12-01T00:56:36.796 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: Your identification has been saved in /tmp/tmp205tbq0_/key. 2023-12-01T00:56:36.797 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: Your public key has been saved in /tmp/tmp205tbq0_/key.pub. 2023-12-01T00:56:36.797 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: The key fingerprint is: 2023-12-01T00:56:36.797 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: SHA256:7HsCqq/DwhRFodfELMa1Rw539XYUBhGfp/3xzowrgOs ceph-48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:56:36.797 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: The key's randomart image is: 2023-12-01T00:56:36.797 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: +---[RSA 3072]----+ 2023-12-01T00:56:36.797 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: | oo=+ o ... +++.| 2023-12-01T00:56:36.797 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: | .=oo* . . + .| 2023-12-01T00:56:36.797 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: | .o..o o o +.| 2023-12-01T00:56:36.797 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: | .. .. . .o.| 2023-12-01T00:56:36.797 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: | . S. ...| 2023-12-01T00:56:36.797 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: | . ... . +| 2023-12-01T00:56:36.797 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: |o. . ... . o| 2023-12-01T00:56:36.797 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: |..o . o.. . = | 2023-12-01T00:56:36.797 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: | .o=. .Eo .o.+| 2023-12-01T00:56:36.798 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: +----[SHA256]-----+ 2023-12-01T00:56:36.854 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.733+0000 7fbe58913700 1 Processor -- start 2023-12-01T00:56:36.854 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.734+0000 7fbe58913700 1 -- start start 2023-12-01T00:56:36.854 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.734+0000 7fbe58913700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe54107150 0x7fbe54109540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:36.855 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.734+0000 7fbe58913700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe54079ec0 con 0x7fbe54107150 2023-12-01T00:56:36.855 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.734+0000 7fbe5259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe54107150 0x7fbe54109540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:36.855 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.734+0000 7fbe5259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe54107150 0x7fbe54109540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52318/0 (socket says 172.21.15.26:52318) 2023-12-01T00:56:36.855 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.734+0000 7fbe5259c700 1 -- 172.21.15.26:0/455780183 learned_addr learned my addr 172.21.15.26:0/455780183 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:36.855 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.734+0000 7fbe5259c700 1 -- 172.21.15.26:0/455780183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe54109a80 con 0x7fbe54107150 2023-12-01T00:56:36.855 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.735+0000 7fbe5259c700 1 --2- 172.21.15.26:0/455780183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe54107150 0x7fbe54109540 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0098a0 tx=0x7fbe3c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fddb5a2ea0ab585 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:36.855 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.735+0000 7fbe5159a700 1 -- 172.21.15.26:0/455780183 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe3c004160 con 0x7fbe54107150 2023-12-01T00:56:36.855 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.735+0000 7fbe5159a700 1 -- 172.21.15.26:0/455780183 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fbe3c0042c0 con 0x7fbe54107150 2023-12-01T00:56:36.855 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.735+0000 7fbe5159a700 1 -- 172.21.15.26:0/455780183 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe3c011ac0 con 0x7fbe54107150 2023-12-01T00:56:36.855 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.735+0000 7fbe58913700 1 -- 172.21.15.26:0/455780183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe54107150 msgr2=0x7fbe54109540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:36.855 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.735+0000 7fbe58913700 1 --2- 172.21.15.26:0/455780183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe54107150 0x7fbe54109540 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0098a0 tx=0x7fbe3c009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:36.855 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.735+0000 7fbe58913700 1 -- 172.21.15.26:0/455780183 shutdown_connections 2023-12-01T00:56:36.855 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.735+0000 7fbe58913700 1 --2- 172.21.15.26:0/455780183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe54107150 0x7fbe54109540 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:36.856 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.735+0000 7fbe58913700 1 -- 172.21.15.26:0/455780183 >> 172.21.15.26:0/455780183 conn(0x7fbe54100b80 msgr2=0x7fbe54102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:36.856 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.736+0000 7fbe58913700 1 -- 172.21.15.26:0/455780183 shutdown_connections 2023-12-01T00:56:36.856 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.736+0000 7fbe58913700 1 -- 172.21.15.26:0/455780183 wait complete. 2023-12-01T00:56:36.856 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.736+0000 7fbe58913700 1 Processor -- start 2023-12-01T00:56:36.856 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.736+0000 7fbe58913700 1 -- start start 2023-12-01T00:56:36.856 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.737+0000 7fbe58913700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe54107150 0x7fbe54105100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:36.856 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.737+0000 7fbe58913700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe54106c90 con 0x7fbe54107150 2023-12-01T00:56:36.856 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.737+0000 7fbe5259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe54107150 0x7fbe54105100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:36.856 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.737+0000 7fbe5259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe54107150 0x7fbe54105100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52320/0 (socket says 172.21.15.26:52320) 2023-12-01T00:56:36.856 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.737+0000 7fbe5259c700 1 -- 172.21.15.26:0/3156313455 learned_addr learned my addr 172.21.15.26:0/3156313455 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:36.856 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.737+0000 7fbe5259c700 1 -- 172.21.15.26:0/3156313455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe3c009550 con 0x7fbe54107150 2023-12-01T00:56:36.857 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.737+0000 7fbe5259c700 1 --2- 172.21.15.26:0/3156313455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe54107150 0x7fbe54105100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c003f70 tx=0x7fbe3c011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:36.857 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.737+0000 7fbe4b7fe700 1 -- 172.21.15.26:0/3156313455 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe3c003b20 con 0x7fbe54107150 2023-12-01T00:56:36.857 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.737+0000 7fbe4b7fe700 1 -- 172.21.15.26:0/3156313455 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fbe3c003c80 con 0x7fbe54107150 2023-12-01T00:56:36.857 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.737+0000 7fbe4b7fe700 1 -- 172.21.15.26:0/3156313455 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe3c024880 con 0x7fbe54107150 2023-12-01T00:56:36.857 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.737+0000 7fbe58913700 1 -- 172.21.15.26:0/3156313455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe54106e90 con 0x7fbe54107150 2023-12-01T00:56:36.857 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.737+0000 7fbe58913700 1 -- 172.21.15.26:0/3156313455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe54105890 con 0x7fbe54107150 2023-12-01T00:56:36.857 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.739+0000 7fbe4b7fe700 1 -- 172.21.15.26:0/3156313455 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7fbe3c01abf0 con 0x7fbe54107150 2023-12-01T00:56:36.857 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.739+0000 7fbe58913700 1 -- 172.21.15.26:0/3156313455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe54062430 con 0x7fbe54107150 2023-12-01T00:56:36.857 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.739+0000 7fbe4b7fe700 1 --2- 172.21.15.26:0/3156313455 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fbe40038350 0x7fbe4003a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:36.857 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.739+0000 7fbe4b7fe700 1 -- 172.21.15.26:0/3156313455 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbe3c04c470 con 0x7fbe54107150 2023-12-01T00:56:36.857 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.739+0000 7fbe51d9b700 1 --2- 172.21.15.26:0/3156313455 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fbe40038350 0x7fbe4003a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:36.857 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.739+0000 7fbe51d9b700 1 --2- 172.21.15.26:0/3156313455 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fbe40038350 0x7fbe4003a810 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbe44006fd0 tx=0x7fbe44006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:36.857 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:35.744+0000 7fbe4b7fe700 1 -- 172.21.15.26:0/3156313455 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fbe54062430 con 0x7fbe54107150 2023-12-01T00:56:36.858 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:36.110+0000 7fbe58913700 1 -- 172.21.15.26:0/3156313455 --> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe54062430 con 0x7fbe40038350 2023-12-01T00:56:36.858 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:36.510+0000 7fbe4b7fe700 1 -- 172.21.15.26:0/3156313455 <== mgr.14120 v2:172.21.15.26:6800/2565806966 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fbe54062430 con 0x7fbe40038350 2023-12-01T00:56:36.858 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:36.512+0000 7fbe58913700 1 -- 172.21.15.26:0/3156313455 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fbe40038350 msgr2=0x7fbe4003a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:36.858 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:36.512+0000 7fbe58913700 1 --2- 172.21.15.26:0/3156313455 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fbe40038350 0x7fbe4003a810 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbe44006fd0 tx=0x7fbe44006e40 comp rx=0 tx=0).stop 2023-12-01T00:56:36.858 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:36.512+0000 7fbe58913700 1 -- 172.21.15.26:0/3156313455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe54107150 msgr2=0x7fbe54105100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:36.858 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:36.512+0000 7fbe58913700 1 --2- 172.21.15.26:0/3156313455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe54107150 0x7fbe54105100 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c003f70 tx=0x7fbe3c011b40 comp rx=0 tx=0).stop 2023-12-01T00:56:36.858 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:36.512+0000 7fbe58913700 1 -- 172.21.15.26:0/3156313455 shutdown_connections 2023-12-01T00:56:36.858 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:36.512+0000 7fbe58913700 1 --2- 172.21.15.26:0/3156313455 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fbe40038350 0x7fbe4003a810 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:36.858 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:36.512+0000 7fbe58913700 1 --2- 172.21.15.26:0/3156313455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe54107150 0x7fbe54105100 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:36.858 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:36.512+0000 7fbe58913700 1 -- 172.21.15.26:0/3156313455 >> 172.21.15.26:0/3156313455 conn(0x7fbe54100b80 msgr2=0x7fbe54101960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:36.858 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:36.512+0000 7fbe58913700 1 -- 172.21.15.26:0/3156313455 shutdown_connections 2023-12-01T00:56:36.858 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:36.512+0000 7fbe58913700 1 -- 172.21.15.26:0/3156313455 wait complete. 2023-12-01T00:56:38.095 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+gIuX2MV4eMEUHTYv4BHYcoUf6EsFayNYSeL5Jco2MNLzNTIBJrFx6caluKzSlr1Nop/Zp0PXZfndVAaJCW5iSAGTEeYVjb9DnhCnXPkcIrA9/711gd2/8Vgb25rgVYmJxMw1lwXcIkw2cdKWNsKSwsnhLHitg/1QIO0i4VoCk0Bnml389McLA6C578vl8PaA2C4XdoFGe5NjpwLZQCBaylWmCYD28Qp/EciraTdZmkXMOfGbHf+UuKYGQjOCWvnz4lpzDo1KRvSqaZqINVjjjpmalB3u6+AWjsnFZe6eM/Wqneq+Zl3Ls1vsYELFMbsrkdnYND86QpwDhnqAOGALsM6NBxRzPZyXIpuZTi0/Mzb2yCsN0d4689a3q2SG8/AABX2XxxS1t0RBA/mlVIwsw/DbUIIIkaXI/ThOSqxZbgqrU1MsgIILOfWkWwn2rNbwGNqWht3QL9RwxHpNDsZLKXAU0mdmbe5YJCbkmGB6+AmMysq2aYeZMOPpRy0c0/c= ceph-48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:56:38.095 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.354+0000 7f3136554700 1 Processor -- start 2023-12-01T00:56:38.095 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.354+0000 7f3136554700 1 -- start start 2023-12-01T00:56:38.095 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.355+0000 7f3136554700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31301055e0 0x7f3130105a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.355+0000 7f3136554700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3130105fd0 con 0x7f31301055e0 2023-12-01T00:56:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.355+0000 7f312ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31301055e0 0x7f3130105a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.355+0000 7f312ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31301055e0 0x7f3130105a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52324/0 (socket says 172.21.15.26:52324) 2023-12-01T00:56:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.355+0000 7f312ffff700 1 -- 172.21.15.26:0/3846267895 learned_addr learned my addr 172.21.15.26:0/3846267895 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.355+0000 7f312ffff700 1 -- 172.21.15.26:0/3846267895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31301067e0 con 0x7f31301055e0 2023-12-01T00:56:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.355+0000 7f312ffff700 1 --2- 172.21.15.26:0/3846267895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31301055e0 0x7f3130105a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f31200098a0 tx=0x7f3120009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ceb2e27d49b8788 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.355+0000 7f312effd700 1 -- 172.21.15.26:0/3846267895 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3120004160 con 0x7f31301055e0 2023-12-01T00:56:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.355+0000 7f312effd700 1 -- 172.21.15.26:0/3846267895 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f31200042c0 con 0x7f31301055e0 2023-12-01T00:56:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.355+0000 7f312effd700 1 -- 172.21.15.26:0/3846267895 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3120011ac0 con 0x7f31301055e0 2023-12-01T00:56:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.356+0000 7f3136554700 1 -- 172.21.15.26:0/3846267895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31301055e0 msgr2=0x7f3130105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.356+0000 7f3136554700 1 --2- 172.21.15.26:0/3846267895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31301055e0 0x7f3130105a00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f31200098a0 tx=0x7f3120009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.356+0000 7f3136554700 1 -- 172.21.15.26:0/3846267895 shutdown_connections 2023-12-01T00:56:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.356+0000 7f3136554700 1 --2- 172.21.15.26:0/3846267895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31301055e0 0x7f3130105a00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.356+0000 7f3136554700 1 -- 172.21.15.26:0/3846267895 >> 172.21.15.26:0/3846267895 conn(0x7f3130100b80 msgr2=0x7f3130102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:38.096 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.356+0000 7f3136554700 1 -- 172.21.15.26:0/3846267895 shutdown_connections 2023-12-01T00:56:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.356+0000 7f3136554700 1 -- 172.21.15.26:0/3846267895 wait complete. 2023-12-01T00:56:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.357+0000 7f3136554700 1 Processor -- start 2023-12-01T00:56:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.357+0000 7f3136554700 1 -- start start 2023-12-01T00:56:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.357+0000 7f3136554700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31301055e0 0x7f313018ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.357+0000 7f3136554700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3130190a10 con 0x7f31301055e0 2023-12-01T00:56:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.357+0000 7f312ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31301055e0 0x7f313018ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.357+0000 7f312ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31301055e0 0x7f313018ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52326/0 (socket says 172.21.15.26:52326) 2023-12-01T00:56:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.357+0000 7f312ffff700 1 -- 172.21.15.26:0/58982670 learned_addr learned my addr 172.21.15.26:0/58982670 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.358+0000 7f312ffff700 1 -- 172.21.15.26:0/58982670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3120009550 con 0x7f31301055e0 2023-12-01T00:56:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.358+0000 7f312ffff700 1 --2- 172.21.15.26:0/58982670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31301055e0 0x7f313018ee80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3120003f70 tx=0x7f3120011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.358+0000 7f312d7fa700 1 -- 172.21.15.26:0/58982670 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3120003af0 con 0x7f31301055e0 2023-12-01T00:56:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.358+0000 7f3136554700 1 -- 172.21.15.26:0/58982670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3130190c10 con 0x7f31301055e0 2023-12-01T00:56:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.358+0000 7f312d7fa700 1 -- 172.21.15.26:0/58982670 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f3120003c50 con 0x7f31301055e0 2023-12-01T00:56:38.097 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.358+0000 7f312d7fa700 1 -- 172.21.15.26:0/58982670 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3120024880 con 0x7f31301055e0 2023-12-01T00:56:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.358+0000 7f3136554700 1 -- 172.21.15.26:0/58982670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313018f610 con 0x7f31301055e0 2023-12-01T00:56:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.359+0000 7f312d7fa700 1 -- 172.21.15.26:0/58982670 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7f3120024af0 con 0x7f31301055e0 2023-12-01T00:56:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.359+0000 7f312d7fa700 1 --2- 172.21.15.26:0/58982670 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f3118038300 0x7f311803a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.359+0000 7f3136554700 1 -- 172.21.15.26:0/58982670 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3130062430 con 0x7f31301055e0 2023-12-01T00:56:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.359+0000 7f312d7fa700 1 -- 172.21.15.26:0/58982670 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f312004c430 con 0x7f31301055e0 2023-12-01T00:56:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.360+0000 7f312f7fe700 1 --2- 172.21.15.26:0/58982670 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f3118038300 0x7f311803a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.360+0000 7f312f7fe700 1 --2- 172.21.15.26:0/58982670 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f3118038300 0x7f311803a7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3124006fd0 tx=0x7f3124006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.364+0000 7f312d7fa700 1 -- 172.21.15.26:0/58982670 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3130062430 con 0x7f31301055e0 2023-12-01T00:56:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.731+0000 7f3136554700 1 -- 172.21.15.26:0/58982670 --> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f31300623c0 con 0x7f3118038300 2023-12-01T00:56:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.731+0000 7f312d7fa700 1 -- 172.21.15.26:0/58982670 <== mgr.14120 v2:172.21.15.26:6800/2565806966 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f31300623c0 con 0x7f3118038300 2023-12-01T00:56:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.734+0000 7f3136554700 1 -- 172.21.15.26:0/58982670 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f3118038300 msgr2=0x7f311803a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.734+0000 7f3136554700 1 --2- 172.21.15.26:0/58982670 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f3118038300 0x7f311803a7c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3124006fd0 tx=0x7f3124006e40 comp rx=0 tx=0).stop 2023-12-01T00:56:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.734+0000 7f3136554700 1 -- 172.21.15.26:0/58982670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31301055e0 msgr2=0x7f313018ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:38.098 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.734+0000 7f3136554700 1 --2- 172.21.15.26:0/58982670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31301055e0 0x7f313018ee80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3120003f70 tx=0x7f3120011a90 comp rx=0 tx=0).stop 2023-12-01T00:56:38.099 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.734+0000 7f3136554700 1 -- 172.21.15.26:0/58982670 shutdown_connections 2023-12-01T00:56:38.099 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.734+0000 7f3136554700 1 --2- 172.21.15.26:0/58982670 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f3118038300 0x7f311803a7c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:38.099 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.734+0000 7f3136554700 1 --2- 172.21.15.26:0/58982670 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31301055e0 0x7f313018ee80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:38.099 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.734+0000 7f3136554700 1 -- 172.21.15.26:0/58982670 >> 172.21.15.26:0/58982670 conn(0x7f3130100b80 msgr2=0x7f3130101970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:38.099 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.734+0000 7f3136554700 1 -- 172.21.15.26:0/58982670 shutdown_connections 2023-12-01T00:56:38.099 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:37.734+0000 7f3136554700 1 -- 172.21.15.26:0/58982670 wait complete. 2023-12-01T00:56:38.099 INFO:teuthology.orchestra.run.smithi026.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-01T00:56:38.099 INFO:teuthology.orchestra.run.smithi026.stdout:Adding key to root@localhost authorized_keys... 2023-12-01T00:56:38.099 INFO:teuthology.orchestra.run.smithi026.stdout:Adding host smithi026... 2023-12-01T00:56:38.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:38 smithi026 ceph-mon[98801]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:56:40.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:40 smithi026 ceph-mon[98801]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi026", "addr": "172.21.15.26", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:56:41.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:41 smithi026 ceph-mon[98801]: Deploying cephadm binary to smithi026 2023-12-01T00:56:42.148 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout Added host 'smithi026' with addr '172.21.15.26' 2023-12-01T00:56:42.149 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.567+0000 7fde9bfc2700 1 Processor -- start 2023-12-01T00:56:42.149 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.567+0000 7fde9bfc2700 1 -- start start 2023-12-01T00:56:42.149 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.567+0000 7fde9bfc2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde94105ae0 0x7fde94105f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:42.149 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.567+0000 7fde9bfc2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde941064d0 con 0x7fde94105ae0 2023-12-01T00:56:42.149 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.567+0000 7fde99d5e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde94105ae0 0x7fde94105f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:42.149 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.567+0000 7fde99d5e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde94105ae0 0x7fde94105f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52330/0 (socket says 172.21.15.26:52330) 2023-12-01T00:56:42.149 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.567+0000 7fde99d5e700 1 -- 172.21.15.26:0/3244922293 learned_addr learned my addr 172.21.15.26:0/3244922293 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:42.149 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.568+0000 7fde99d5e700 1 -- 172.21.15.26:0/3244922293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde94106800 con 0x7fde94105ae0 2023-12-01T00:56:42.149 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.568+0000 7fde99d5e700 1 --2- 172.21.15.26:0/3244922293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde94105ae0 0x7fde94105f00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde840098a0 tx=0x7fde84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60b4b8c46f03892 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:42.149 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.568+0000 7fde98d5c700 1 -- 172.21.15.26:0/3244922293 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde84004160 con 0x7fde94105ae0 2023-12-01T00:56:42.149 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.568+0000 7fde98d5c700 1 -- 172.21.15.26:0/3244922293 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fde840042c0 con 0x7fde94105ae0 2023-12-01T00:56:42.149 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.568+0000 7fde98d5c700 1 -- 172.21.15.26:0/3244922293 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde84011ac0 con 0x7fde94105ae0 2023-12-01T00:56:42.149 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.569+0000 7fde9bfc2700 1 -- 172.21.15.26:0/3244922293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde94105ae0 msgr2=0x7fde94105f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:42.149 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.569+0000 7fde9bfc2700 1 --2- 172.21.15.26:0/3244922293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde94105ae0 0x7fde94105f00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fde840098a0 tx=0x7fde84009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:42.150 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.569+0000 7fde9bfc2700 1 -- 172.21.15.26:0/3244922293 shutdown_connections 2023-12-01T00:56:42.150 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.569+0000 7fde9bfc2700 1 --2- 172.21.15.26:0/3244922293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde94105ae0 0x7fde94105f00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:42.150 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.569+0000 7fde9bfc2700 1 -- 172.21.15.26:0/3244922293 >> 172.21.15.26:0/3244922293 conn(0x7fde94100300 msgr2=0x7fde94102740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:42.150 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.569+0000 7fde9bfc2700 1 -- 172.21.15.26:0/3244922293 shutdown_connections 2023-12-01T00:56:42.150 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.569+0000 7fde9bfc2700 1 -- 172.21.15.26:0/3244922293 wait complete. 2023-12-01T00:56:42.150 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.569+0000 7fde9bfc2700 1 Processor -- start 2023-12-01T00:56:42.150 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.569+0000 7fde9bfc2700 1 -- start start 2023-12-01T00:56:42.150 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.569+0000 7fde9bfc2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde94105ae0 0x7fde9419f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:42.150 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.569+0000 7fde9bfc2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde9419aea0 con 0x7fde94105ae0 2023-12-01T00:56:42.150 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.570+0000 7fde99d5e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde94105ae0 0x7fde9419f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:42.150 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.570+0000 7fde99d5e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde94105ae0 0x7fde9419f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52332/0 (socket says 172.21.15.26:52332) 2023-12-01T00:56:42.150 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.570+0000 7fde99d5e700 1 -- 172.21.15.26:0/882344684 learned_addr learned my addr 172.21.15.26:0/882344684 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:42.150 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.570+0000 7fde99d5e700 1 -- 172.21.15.26:0/882344684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde84009550 con 0x7fde94105ae0 2023-12-01T00:56:42.151 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.570+0000 7fde99d5e700 1 --2- 172.21.15.26:0/882344684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde94105ae0 0x7fde9419f4b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fde84003f70 tx=0x7fde84011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:42.151 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.570+0000 7fde8affd700 1 -- 172.21.15.26:0/882344684 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde84003b20 con 0x7fde94105ae0 2023-12-01T00:56:42.151 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.570+0000 7fde8affd700 1 -- 172.21.15.26:0/882344684 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7fde84003c80 con 0x7fde94105ae0 2023-12-01T00:56:42.151 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.570+0000 7fde9bfc2700 1 -- 172.21.15.26:0/882344684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde94105380 con 0x7fde94105ae0 2023-12-01T00:56:42.151 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.570+0000 7fde8affd700 1 -- 172.21.15.26:0/882344684 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde840248c0 con 0x7fde94105ae0 2023-12-01T00:56:42.151 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.570+0000 7fde9bfc2700 1 -- 172.21.15.26:0/882344684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde9419fbc0 con 0x7fde94105ae0 2023-12-01T00:56:42.151 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.571+0000 7fde8affd700 1 -- 172.21.15.26:0/882344684 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7fde84024b80 con 0x7fde94105ae0 2023-12-01T00:56:42.151 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.571+0000 7fde8affd700 1 --2- 172.21.15.26:0/882344684 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fde800382b0 0x7fde8003a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:42.151 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.571+0000 7fde9bfc2700 1 -- 172.21.15.26:0/882344684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde94062430 con 0x7fde94105ae0 2023-12-01T00:56:42.151 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.571+0000 7fde8affd700 1 -- 172.21.15.26:0/882344684 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fde8404c580 con 0x7fde94105ae0 2023-12-01T00:56:42.151 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.571+0000 7fde9955d700 1 --2- 172.21.15.26:0/882344684 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fde800382b0 0x7fde8003a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:42.151 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.572+0000 7fde9955d700 1 --2- 172.21.15.26:0/882344684 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fde800382b0 0x7fde8003a770 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fde90006fd0 tx=0x7fde90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:42.151 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.576+0000 7fde8affd700 1 -- 172.21.15.26:0/882344684 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fde94062430 con 0x7fde94105ae0 2023-12-01T00:56:42.151 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:38.948+0000 7fde9bfc2700 1 -- 172.21.15.26:0/882344684 --> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi026", "addr": "172.21.15.26", "target": ["mon-mgr", ""]}) v1 -- 0x7fde94062430 con 0x7fde800382b0 2023-12-01T00:56:42.151 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:41.765+0000 7fde8affd700 1 -- 172.21.15.26:0/882344684 <== mgr.14120 v2:172.21.15.26:6800/2565806966 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fde94062430 con 0x7fde800382b0 2023-12-01T00:56:42.152 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:41.768+0000 7fde9bfc2700 1 -- 172.21.15.26:0/882344684 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fde800382b0 msgr2=0x7fde8003a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:42.152 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:41.768+0000 7fde9bfc2700 1 --2- 172.21.15.26:0/882344684 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fde800382b0 0x7fde8003a770 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fde90006fd0 tx=0x7fde90006e40 comp rx=0 tx=0).stop 2023-12-01T00:56:42.152 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:41.768+0000 7fde9bfc2700 1 -- 172.21.15.26:0/882344684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde94105ae0 msgr2=0x7fde9419f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:42.152 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:41.768+0000 7fde9bfc2700 1 --2- 172.21.15.26:0/882344684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde94105ae0 0x7fde9419f4b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fde84003f70 tx=0x7fde84011a90 comp rx=0 tx=0).stop 2023-12-01T00:56:42.152 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:41.768+0000 7fde9bfc2700 1 -- 172.21.15.26:0/882344684 shutdown_connections 2023-12-01T00:56:42.152 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:41.768+0000 7fde9bfc2700 1 --2- 172.21.15.26:0/882344684 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fde800382b0 0x7fde8003a770 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:42.152 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:41.768+0000 7fde9bfc2700 1 --2- 172.21.15.26:0/882344684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde94105ae0 0x7fde9419f4b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:42.152 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:41.768+0000 7fde9bfc2700 1 -- 172.21.15.26:0/882344684 >> 172.21.15.26:0/882344684 conn(0x7fde94100300 msgr2=0x7fde941010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:42.152 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:41.768+0000 7fde9bfc2700 1 -- 172.21.15.26:0/882344684 shutdown_connections 2023-12-01T00:56:42.152 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:41.768+0000 7fde9bfc2700 1 -- 172.21.15.26:0/882344684 wait complete. 2023-12-01T00:56:42.152 INFO:teuthology.orchestra.run.smithi026.stdout:Deploying unmanaged mon service... 2023-12-01T00:56:42.956 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:42 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' 2023-12-01T00:56:42.956 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:42 smithi026 ceph-mon[98801]: Added host smithi026 2023-12-01T00:56:42.956 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:42 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:56:43.698 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-01T00:56:43.699 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.640+0000 7f626049a700 1 Processor -- start 2023-12-01T00:56:43.699 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.640+0000 7f626049a700 1 -- start start 2023-12-01T00:56:43.699 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.640+0000 7f626049a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6258107190 0x7f6258109580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:43.699 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.640+0000 7f626049a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6258079e80 con 0x7f6258107190 2023-12-01T00:56:43.699 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.641+0000 7f625e236700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6258107190 0x7f6258109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:43.699 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.641+0000 7f625e236700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6258107190 0x7f6258109580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52356/0 (socket says 172.21.15.26:52356) 2023-12-01T00:56:43.699 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.641+0000 7f625e236700 1 -- 172.21.15.26:0/2891026853 learned_addr learned my addr 172.21.15.26:0/2891026853 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:43.699 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.641+0000 7f625e236700 1 -- 172.21.15.26:0/2891026853 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6258109ac0 con 0x7f6258107190 2023-12-01T00:56:43.699 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.641+0000 7f625e236700 1 --2- 172.21.15.26:0/2891026853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6258107190 0x7f6258109580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62540098a0 tx=0x7f6254009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02c7b094fd48136 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:43.699 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.641+0000 7f625d234700 1 -- 172.21.15.26:0/2891026853 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6254004160 con 0x7f6258107190 2023-12-01T00:56:43.699 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.641+0000 7f625d234700 1 -- 172.21.15.26:0/2891026853 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f62540042c0 con 0x7f6258107190 2023-12-01T00:56:43.699 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.641+0000 7f625d234700 1 -- 172.21.15.26:0/2891026853 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6254011ac0 con 0x7f6258107190 2023-12-01T00:56:43.700 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.642+0000 7f626049a700 1 -- 172.21.15.26:0/2891026853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6258107190 msgr2=0x7f6258109580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:43.700 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.642+0000 7f626049a700 1 --2- 172.21.15.26:0/2891026853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6258107190 0x7f6258109580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f62540098a0 tx=0x7f6254009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:43.700 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.642+0000 7f626049a700 1 -- 172.21.15.26:0/2891026853 shutdown_connections 2023-12-01T00:56:43.700 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.642+0000 7f626049a700 1 --2- 172.21.15.26:0/2891026853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6258107190 0x7f6258109580 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:43.700 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.642+0000 7f626049a700 1 -- 172.21.15.26:0/2891026853 >> 172.21.15.26:0/2891026853 conn(0x7f6258100b80 msgr2=0x7f6258102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:43.700 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.642+0000 7f626049a700 1 -- 172.21.15.26:0/2891026853 shutdown_connections 2023-12-01T00:56:43.700 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.642+0000 7f626049a700 1 -- 172.21.15.26:0/2891026853 wait complete. 2023-12-01T00:56:43.700 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.643+0000 7f626049a700 1 Processor -- start 2023-12-01T00:56:43.700 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.643+0000 7f626049a700 1 -- start start 2023-12-01T00:56:43.700 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.643+0000 7f626049a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6258107190 0x7f6258105140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:43.700 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.643+0000 7f626049a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6258106cd0 con 0x7f6258107190 2023-12-01T00:56:43.700 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.643+0000 7f625e236700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6258107190 0x7f6258105140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:43.700 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.643+0000 7f625e236700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6258107190 0x7f6258105140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52358/0 (socket says 172.21.15.26:52358) 2023-12-01T00:56:43.701 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.643+0000 7f625e236700 1 -- 172.21.15.26:0/862167732 learned_addr learned my addr 172.21.15.26:0/862167732 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:43.701 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.643+0000 7f625e236700 1 -- 172.21.15.26:0/862167732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6254009550 con 0x7f6258107190 2023-12-01T00:56:43.701 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.644+0000 7f625e236700 1 --2- 172.21.15.26:0/862167732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6258107190 0x7f6258105140 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6254003f70 tx=0x7f6254011b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:43.701 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.644+0000 7f624f7fe700 1 -- 172.21.15.26:0/862167732 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6254003b20 con 0x7f6258107190 2023-12-01T00:56:43.701 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.644+0000 7f624f7fe700 1 -- 172.21.15.26:0/862167732 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1108+0+0 (secure 0 0 0) 0x7f6254003c80 con 0x7f6258107190 2023-12-01T00:56:43.701 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.644+0000 7f626049a700 1 -- 172.21.15.26:0/862167732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6258106ed0 con 0x7f6258107190 2023-12-01T00:56:43.701 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.644+0000 7f624f7fe700 1 -- 172.21.15.26:0/862167732 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6254024880 con 0x7f6258107190 2023-12-01T00:56:43.701 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.644+0000 7f626049a700 1 -- 172.21.15.26:0/862167732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62581058d0 con 0x7f6258107190 2023-12-01T00:56:43.701 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.645+0000 7f624f7fe700 1 -- 172.21.15.26:0/862167732 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7f625402d3f0 con 0x7f6258107190 2023-12-01T00:56:43.701 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.645+0000 7f624f7fe700 1 --2- 172.21.15.26:0/862167732 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f6244038350 0x7f624403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:43.701 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.645+0000 7f624f7fe700 1 -- 172.21.15.26:0/862167732 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f625404c480 con 0x7f6258107190 2023-12-01T00:56:43.701 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.645+0000 7f626049a700 1 -- 172.21.15.26:0/862167732 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6258062430 con 0x7f6258107190 2023-12-01T00:56:43.701 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.645+0000 7f625da35700 1 --2- 172.21.15.26:0/862167732 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f6244038350 0x7f624403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:43.701 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.645+0000 7f625da35700 1 --2- 172.21.15.26:0/862167732 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f6244038350 0x7f624403a810 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6248006fd0 tx=0x7f6248006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:43.702 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:42.650+0000 7f624f7fe700 1 -- 172.21.15.26:0/862167732 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f6258062430 con 0x7f6258107190 2023-12-01T00:56:43.702 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:43.049+0000 7f626049a700 1 -- 172.21.15.26:0/862167732 --> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f62580623c0 con 0x7f6244038350 2023-12-01T00:56:43.702 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:43.054+0000 7f624f7fe700 1 -- 172.21.15.26:0/862167732 <== mgr.14120 v2:172.21.15.26:6800/2565806966 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f62580623c0 con 0x7f6244038350 2023-12-01T00:56:43.702 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:43.056+0000 7f626049a700 1 -- 172.21.15.26:0/862167732 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f6244038350 msgr2=0x7f624403a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:43.703 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:43.056+0000 7f626049a700 1 --2- 172.21.15.26:0/862167732 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f6244038350 0x7f624403a810 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6248006fd0 tx=0x7f6248006e40 comp rx=0 tx=0).stop 2023-12-01T00:56:43.703 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:43.056+0000 7f626049a700 1 -- 172.21.15.26:0/862167732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6258107190 msgr2=0x7f6258105140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:43.703 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:43.056+0000 7f626049a700 1 --2- 172.21.15.26:0/862167732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6258107190 0x7f6258105140 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6254003f70 tx=0x7f6254011b40 comp rx=0 tx=0).stop 2023-12-01T00:56:43.703 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:43.057+0000 7f626049a700 1 -- 172.21.15.26:0/862167732 shutdown_connections 2023-12-01T00:56:43.703 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:43.057+0000 7f626049a700 1 --2- 172.21.15.26:0/862167732 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f6244038350 0x7f624403a810 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:43.703 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:43.057+0000 7f626049a700 1 --2- 172.21.15.26:0/862167732 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6258107190 0x7f6258105140 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:43.703 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:43.057+0000 7f626049a700 1 -- 172.21.15.26:0/862167732 >> 172.21.15.26:0/862167732 conn(0x7f6258100b80 msgr2=0x7f6258101900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:43.704 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:43.057+0000 7f626049a700 1 -- 172.21.15.26:0/862167732 shutdown_connections 2023-12-01T00:56:43.704 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:43.057+0000 7f626049a700 1 -- 172.21.15.26:0/862167732 wait complete. 2023-12-01T00:56:43.704 INFO:teuthology.orchestra.run.smithi026.stdout:Deploying unmanaged mgr service... 2023-12-01T00:56:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:44 smithi026 ceph-mon[98801]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:56:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:44 smithi026 ceph-mon[98801]: Saving service mon spec with placement count:5 2023-12-01T00:56:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:44 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' 2023-12-01T00:56:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:44 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' 2023-12-01T00:56:45.050 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-01T00:56:45.050 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.196+0000 7f45cf72f700 1 Processor -- start 2023-12-01T00:56:45.050 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.196+0000 7f45cf72f700 1 -- start start 2023-12-01T00:56:45.050 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.196+0000 7f45cf72f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c81055e0 0x7f45c8105a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:45.050 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.196+0000 7f45cf72f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c8105fd0 con 0x7f45c81055e0 2023-12-01T00:56:45.050 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.196+0000 7f45cd4cb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c81055e0 0x7f45c8105a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:45.050 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.196+0000 7f45cd4cb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c81055e0 0x7f45c8105a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52362/0 (socket says 172.21.15.26:52362) 2023-12-01T00:56:45.050 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.196+0000 7f45cd4cb700 1 -- 172.21.15.26:0/44154266 learned_addr learned my addr 172.21.15.26:0/44154266 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:45.050 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.196+0000 7f45cd4cb700 1 -- 172.21.15.26:0/44154266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c81067e0 con 0x7f45c81055e0 2023-12-01T00:56:45.051 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.197+0000 7f45cd4cb700 1 --2- 172.21.15.26:0/44154266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c81055e0 0x7f45c8105a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f45c40098a0 tx=0x7f45c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27aeb869e0dff6ff server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:45.051 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.197+0000 7f45bffff700 1 -- 172.21.15.26:0/44154266 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45c4004160 con 0x7f45c81055e0 2023-12-01T00:56:45.051 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.197+0000 7f45bffff700 1 -- 172.21.15.26:0/44154266 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f45c40042c0 con 0x7f45c81055e0 2023-12-01T00:56:45.051 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.197+0000 7f45bffff700 1 -- 172.21.15.26:0/44154266 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45c4011a80 con 0x7f45c81055e0 2023-12-01T00:56:45.051 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.198+0000 7f45cf72f700 1 -- 172.21.15.26:0/44154266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c81055e0 msgr2=0x7f45c8105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:45.051 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.198+0000 7f45cf72f700 1 --2- 172.21.15.26:0/44154266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c81055e0 0x7f45c8105a00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f45c40098a0 tx=0x7f45c4009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:45.051 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.198+0000 7f45cf72f700 1 -- 172.21.15.26:0/44154266 shutdown_connections 2023-12-01T00:56:45.051 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.198+0000 7f45cf72f700 1 --2- 172.21.15.26:0/44154266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c81055e0 0x7f45c8105a00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:45.051 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.198+0000 7f45cf72f700 1 -- 172.21.15.26:0/44154266 >> 172.21.15.26:0/44154266 conn(0x7f45c8100b80 msgr2=0x7f45c8102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:45.051 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.198+0000 7f45cf72f700 1 -- 172.21.15.26:0/44154266 shutdown_connections 2023-12-01T00:56:45.051 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.198+0000 7f45cf72f700 1 -- 172.21.15.26:0/44154266 wait complete. 2023-12-01T00:56:45.051 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.198+0000 7f45cf72f700 1 Processor -- start 2023-12-01T00:56:45.051 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.198+0000 7f45cf72f700 1 -- start start 2023-12-01T00:56:45.051 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.199+0000 7f45cf72f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c81055e0 0x7f45c819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:45.051 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.199+0000 7f45cf72f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c819a9b0 con 0x7f45c81055e0 2023-12-01T00:56:45.052 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.199+0000 7f45cd4cb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c81055e0 0x7f45c819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:45.052 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.199+0000 7f45cd4cb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c81055e0 0x7f45c819a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52364/0 (socket says 172.21.15.26:52364) 2023-12-01T00:56:45.052 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.199+0000 7f45cd4cb700 1 -- 172.21.15.26:0/4028689122 learned_addr learned my addr 172.21.15.26:0/4028689122 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:45.052 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.199+0000 7f45cd4cb700 1 -- 172.21.15.26:0/4028689122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45c4009550 con 0x7f45c81055e0 2023-12-01T00:56:45.052 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.199+0000 7f45cd4cb700 1 --2- 172.21.15.26:0/4028689122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c81055e0 0x7f45c819a470 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f45c4006ba0 tx=0x7f45c4011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:45.052 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.199+0000 7f45be7fc700 1 -- 172.21.15.26:0/4028689122 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45c40038b0 con 0x7f45c81055e0 2023-12-01T00:56:45.052 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.199+0000 7f45be7fc700 1 -- 172.21.15.26:0/4028689122 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f45c4003a10 con 0x7f45c81055e0 2023-12-01T00:56:45.052 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.199+0000 7f45be7fc700 1 -- 172.21.15.26:0/4028689122 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f45c40196e0 con 0x7f45c81055e0 2023-12-01T00:56:45.052 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.199+0000 7f45cf72f700 1 -- 172.21.15.26:0/4028689122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c819abb0 con 0x7f45c81055e0 2023-12-01T00:56:45.052 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.199+0000 7f45cf72f700 1 -- 172.21.15.26:0/4028689122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c819b840 con 0x7f45c81055e0 2023-12-01T00:56:45.052 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.201+0000 7f45cf72f700 1 -- 172.21.15.26:0/4028689122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c819b050 con 0x7f45c81055e0 2023-12-01T00:56:45.052 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.201+0000 7f45be7fc700 1 -- 172.21.15.26:0/4028689122 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7f45c401aaa0 con 0x7f45c81055e0 2023-12-01T00:56:45.052 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.201+0000 7f45be7fc700 1 --2- 172.21.15.26:0/4028689122 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f45b4038300 0x7f45b403a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:45.052 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.201+0000 7f45be7fc700 1 -- 172.21.15.26:0/4028689122 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f45c404c340 con 0x7f45c81055e0 2023-12-01T00:56:45.052 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.201+0000 7f45cccca700 1 --2- 172.21.15.26:0/4028689122 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f45b4038300 0x7f45b403a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:45.053 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.202+0000 7f45cccca700 1 --2- 172.21.15.26:0/4028689122 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f45b4038300 0x7f45b403a7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f45b8006fd0 tx=0x7f45b8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:45.053 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.206+0000 7f45be7fc700 1 -- 172.21.15.26:0/4028689122 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f45c819b050 con 0x7f45c81055e0 2023-12-01T00:56:45.053 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.611+0000 7f45cf72f700 1 -- 172.21.15.26:0/4028689122 --> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f45c819b050 con 0x7f45b4038300 2023-12-01T00:56:45.053 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.616+0000 7f45be7fc700 1 -- 172.21.15.26:0/4028689122 <== mgr.14120 v2:172.21.15.26:6800/2565806966 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f45c819b050 con 0x7f45b4038300 2023-12-01T00:56:45.053 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.618+0000 7f45cf72f700 1 -- 172.21.15.26:0/4028689122 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f45b4038300 msgr2=0x7f45b403a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:45.053 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.618+0000 7f45cf72f700 1 --2- 172.21.15.26:0/4028689122 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f45b4038300 0x7f45b403a7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f45b8006fd0 tx=0x7f45b8006e40 comp rx=0 tx=0).stop 2023-12-01T00:56:45.053 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.618+0000 7f45cf72f700 1 -- 172.21.15.26:0/4028689122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c81055e0 msgr2=0x7f45c819a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:45.053 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.618+0000 7f45cf72f700 1 --2- 172.21.15.26:0/4028689122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c81055e0 0x7f45c819a470 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f45c4006ba0 tx=0x7f45c4011b00 comp rx=0 tx=0).stop 2023-12-01T00:56:45.053 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.618+0000 7f45cf72f700 1 -- 172.21.15.26:0/4028689122 shutdown_connections 2023-12-01T00:56:45.053 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.618+0000 7f45cf72f700 1 --2- 172.21.15.26:0/4028689122 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f45b4038300 0x7f45b403a7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:45.053 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.618+0000 7f45cf72f700 1 --2- 172.21.15.26:0/4028689122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f45c81055e0 0x7f45c819a470 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:45.053 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.618+0000 7f45cf72f700 1 -- 172.21.15.26:0/4028689122 >> 172.21.15.26:0/4028689122 conn(0x7f45c8100b80 msgr2=0x7f45c80798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:45.053 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.618+0000 7f45cf72f700 1 -- 172.21.15.26:0/4028689122 shutdown_connections 2023-12-01T00:56:45.053 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:44.618+0000 7f45cf72f700 1 -- 172.21.15.26:0/4028689122 wait complete. 2023-12-01T00:56:45.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:45 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' 2023-12-01T00:56:45.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:45 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' 2023-12-01T00:56:46.507 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:46 smithi026 ceph-mon[98801]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:56:46.508 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:46 smithi026 ceph-mon[98801]: Saving service mgr spec with placement count:2 2023-12-01T00:56:46.795 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.090+0000 7fc27c3a0700 1 Processor -- start 2023-12-01T00:56:46.796 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.090+0000 7fc27c3a0700 1 -- start start 2023-12-01T00:56:46.796 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.090+0000 7fc27c3a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc274107170 0x7fc274109560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:46.796 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.090+0000 7fc27c3a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc274079e80 con 0x7fc274107170 2023-12-01T00:56:46.796 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.091+0000 7fc27a13c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc274107170 0x7fc274109560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:46.796 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.091+0000 7fc27a13c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc274107170 0x7fc274109560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52368/0 (socket says 172.21.15.26:52368) 2023-12-01T00:56:46.796 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.091+0000 7fc27a13c700 1 -- 172.21.15.26:0/1656476037 learned_addr learned my addr 172.21.15.26:0/1656476037 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:46.796 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.091+0000 7fc27a13c700 1 -- 172.21.15.26:0/1656476037 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc274109aa0 con 0x7fc274107170 2023-12-01T00:56:46.796 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.091+0000 7fc27a13c700 1 --2- 172.21.15.26:0/1656476037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc274107170 0x7fc274109560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009e80 tx=0x7fc26c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd2578841988733 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:46.796 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.091+0000 7fc27913a700 1 -- 172.21.15.26:0/1656476037 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc26c00e070 con 0x7fc274107170 2023-12-01T00:56:46.796 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.091+0000 7fc27913a700 1 -- 172.21.15.26:0/1656476037 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc26c00b8c0 con 0x7fc274107170 2023-12-01T00:56:46.796 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.091+0000 7fc27913a700 1 -- 172.21.15.26:0/1656476037 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc26c0044a0 con 0x7fc274107170 2023-12-01T00:56:46.797 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.092+0000 7fc27c3a0700 1 -- 172.21.15.26:0/1656476037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc274107170 msgr2=0x7fc274109560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:46.797 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.092+0000 7fc27c3a0700 1 --2- 172.21.15.26:0/1656476037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc274107170 0x7fc274109560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc26c009e80 tx=0x7fc26c00b330 comp rx=0 tx=0).stop 2023-12-01T00:56:46.797 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.092+0000 7fc27c3a0700 1 -- 172.21.15.26:0/1656476037 shutdown_connections 2023-12-01T00:56:46.797 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.092+0000 7fc27c3a0700 1 --2- 172.21.15.26:0/1656476037 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc274107170 0x7fc274109560 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:46.797 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.092+0000 7fc27c3a0700 1 -- 172.21.15.26:0/1656476037 >> 172.21.15.26:0/1656476037 conn(0x7fc274100b80 msgr2=0x7fc274102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:46.797 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.092+0000 7fc27c3a0700 1 -- 172.21.15.26:0/1656476037 shutdown_connections 2023-12-01T00:56:46.797 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.092+0000 7fc27c3a0700 1 -- 172.21.15.26:0/1656476037 wait complete. 2023-12-01T00:56:46.797 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.093+0000 7fc27c3a0700 1 Processor -- start 2023-12-01T00:56:46.797 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.093+0000 7fc27c3a0700 1 -- start start 2023-12-01T00:56:46.797 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.093+0000 7fc27c3a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc274107170 0x7fc27419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:46.797 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.093+0000 7fc27c3a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27419a820 con 0x7fc274107170 2023-12-01T00:56:46.797 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.093+0000 7fc27a13c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc274107170 0x7fc27419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:46.797 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.093+0000 7fc27a13c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc274107170 0x7fc27419a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52370/0 (socket says 172.21.15.26:52370) 2023-12-01T00:56:46.797 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.093+0000 7fc27a13c700 1 -- 172.21.15.26:0/1911542754 learned_addr learned my addr 172.21.15.26:0/1911542754 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:46.797 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.093+0000 7fc27a13c700 1 -- 172.21.15.26:0/1911542754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c009b30 con 0x7fc274107170 2023-12-01T00:56:46.798 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.094+0000 7fc27a13c700 1 --2- 172.21.15.26:0/1911542754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc274107170 0x7fc27419a2e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc26c000f80 tx=0x7fc26c00bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:46.798 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.094+0000 7fc2737fe700 1 -- 172.21.15.26:0/1911542754 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc26c00e040 con 0x7fc274107170 2023-12-01T00:56:46.798 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.094+0000 7fc27c3a0700 1 -- 172.21.15.26:0/1911542754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27419aa20 con 0x7fc274107170 2023-12-01T00:56:46.798 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.094+0000 7fc2737fe700 1 -- 172.21.15.26:0/1911542754 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc26c003d60 con 0x7fc274107170 2023-12-01T00:56:46.798 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.094+0000 7fc2737fe700 1 -- 172.21.15.26:0/1911542754 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc26c01c870 con 0x7fc274107170 2023-12-01T00:56:46.798 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.094+0000 7fc27c3a0700 1 -- 172.21.15.26:0/1911542754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27419af20 con 0x7fc274107170 2023-12-01T00:56:46.798 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.095+0000 7fc2737fe700 1 -- 172.21.15.26:0/1911542754 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7fc26c01cb30 con 0x7fc274107170 2023-12-01T00:56:46.798 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.095+0000 7fc2737fe700 1 --2- 172.21.15.26:0/1911542754 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc25c038300 0x7fc25c03a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:46.798 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.095+0000 7fc2737fe700 1 -- 172.21.15.26:0/1911542754 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc26c012ba0 con 0x7fc274107170 2023-12-01T00:56:46.798 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.095+0000 7fc27993b700 1 --2- 172.21.15.26:0/1911542754 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc25c038300 0x7fc25c03a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:46.798 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.095+0000 7fc27c3a0700 1 -- 172.21.15.26:0/1911542754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27410a8e0 con 0x7fc274107170 2023-12-01T00:56:46.798 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.099+0000 7fc27993b700 1 --2- 172.21.15.26:0/1911542754 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc25c038300 0x7fc25c03a7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc268006fd0 tx=0x7fc268006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:46.798 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.100+0000 7fc2737fe700 1 -- 172.21.15.26:0/1911542754 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc26c017070 con 0x7fc274107170 2023-12-01T00:56:46.798 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.473+0000 7fc27c3a0700 1 -- 172.21.15.26:0/1911542754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fc27419dca0 con 0x7fc274107170 2023-12-01T00:56:46.799 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.476+0000 7fc2737fe700 1 -- 172.21.15.26:0/1911542754 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fc26c0200d0 con 0x7fc274107170 2023-12-01T00:56:46.799 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.478+0000 7fc27c3a0700 1 -- 172.21.15.26:0/1911542754 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc25c038300 msgr2=0x7fc25c03a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:46.799 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.478+0000 7fc27c3a0700 1 --2- 172.21.15.26:0/1911542754 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc25c038300 0x7fc25c03a7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc268006fd0 tx=0x7fc268006e40 comp rx=0 tx=0).stop 2023-12-01T00:56:46.799 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.478+0000 7fc27c3a0700 1 -- 172.21.15.26:0/1911542754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc274107170 msgr2=0x7fc27419a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:46.799 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.478+0000 7fc27c3a0700 1 --2- 172.21.15.26:0/1911542754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc274107170 0x7fc27419a2e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc26c000f80 tx=0x7fc26c00bd10 comp rx=0 tx=0).stop 2023-12-01T00:56:46.799 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.479+0000 7fc27c3a0700 1 -- 172.21.15.26:0/1911542754 shutdown_connections 2023-12-01T00:56:46.799 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.479+0000 7fc27c3a0700 1 --2- 172.21.15.26:0/1911542754 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc25c038300 0x7fc25c03a7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:46.799 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.479+0000 7fc27c3a0700 1 --2- 172.21.15.26:0/1911542754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc274107170 0x7fc27419a2e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:46.799 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.479+0000 7fc27c3a0700 1 -- 172.21.15.26:0/1911542754 >> 172.21.15.26:0/1911542754 conn(0x7fc274100b80 msgr2=0x7fc2741018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:46.799 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.479+0000 7fc27c3a0700 1 -- 172.21.15.26:0/1911542754 shutdown_connections 2023-12-01T00:56:46.799 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:46.479+0000 7fc27c3a0700 1 -- 172.21.15.26:0/1911542754 wait complete. 2023-12-01T00:56:47.736 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:47 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1911542754' entity='client.admin' 2023-12-01T00:56:47.736 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:47 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' 2023-12-01T00:56:48.040 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.314+0000 7f053a198700 1 Processor -- start 2023-12-01T00:56:48.040 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.315+0000 7f053a198700 1 -- start start 2023-12-01T00:56:48.040 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.315+0000 7f053a198700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05341055c0 0x7f05341059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:48.040 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.315+0000 7f053a198700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0534105fb0 con 0x7f05341055c0 2023-12-01T00:56:48.040 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.315+0000 7f05337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05341055c0 0x7f05341059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:48.040 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.315+0000 7f05337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05341055c0 0x7f05341059e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52374/0 (socket says 172.21.15.26:52374) 2023-12-01T00:56:48.040 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.315+0000 7f05337fe700 1 -- 172.21.15.26:0/1907999875 learned_addr learned my addr 172.21.15.26:0/1907999875 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:48.040 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.315+0000 7f05337fe700 1 -- 172.21.15.26:0/1907999875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05341067c0 con 0x7f05341055c0 2023-12-01T00:56:48.040 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.315+0000 7f05337fe700 1 --2- 172.21.15.26:0/1907999875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05341055c0 0x7f05341059e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05240098a0 tx=0x7f0524009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4325d03dc717d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:48.040 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.316+0000 7f05327fc700 1 -- 172.21.15.26:0/1907999875 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0524004160 con 0x7f05341055c0 2023-12-01T00:56:48.040 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.316+0000 7f05327fc700 1 -- 172.21.15.26:0/1907999875 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f05240042c0 con 0x7f05341055c0 2023-12-01T00:56:48.041 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.316+0000 7f05327fc700 1 -- 172.21.15.26:0/1907999875 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0524011a80 con 0x7f05341055c0 2023-12-01T00:56:48.041 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.316+0000 7f053a198700 1 -- 172.21.15.26:0/1907999875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05341055c0 msgr2=0x7f05341059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:48.041 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.316+0000 7f053a198700 1 --2- 172.21.15.26:0/1907999875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05341055c0 0x7f05341059e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f05240098a0 tx=0x7f0524009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:48.041 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.317+0000 7f053a198700 1 -- 172.21.15.26:0/1907999875 shutdown_connections 2023-12-01T00:56:48.041 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.317+0000 7f053a198700 1 --2- 172.21.15.26:0/1907999875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05341055c0 0x7f05341059e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:48.041 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.317+0000 7f053a198700 1 -- 172.21.15.26:0/1907999875 >> 172.21.15.26:0/1907999875 conn(0x7f0534100b80 msgr2=0x7f0534102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:48.041 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.317+0000 7f053a198700 1 -- 172.21.15.26:0/1907999875 shutdown_connections 2023-12-01T00:56:48.041 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.317+0000 7f053a198700 1 -- 172.21.15.26:0/1907999875 wait complete. 2023-12-01T00:56:48.041 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.317+0000 7f053a198700 1 Processor -- start 2023-12-01T00:56:48.041 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.318+0000 7f053a198700 1 -- start start 2023-12-01T00:56:48.041 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.318+0000 7f053a198700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05341055c0 0x7f053419a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:48.041 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.318+0000 7f053a198700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053419a8d0 con 0x7f05341055c0 2023-12-01T00:56:48.041 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.318+0000 7f05337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05341055c0 0x7f053419a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:48.041 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.318+0000 7f05337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05341055c0 0x7f053419a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52376/0 (socket says 172.21.15.26:52376) 2023-12-01T00:56:48.041 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.318+0000 7f05337fe700 1 -- 172.21.15.26:0/1640304262 learned_addr learned my addr 172.21.15.26:0/1640304262 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:48.042 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.318+0000 7f05337fe700 1 -- 172.21.15.26:0/1640304262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0524009550 con 0x7f05341055c0 2023-12-01T00:56:48.042 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.318+0000 7f05337fe700 1 --2- 172.21.15.26:0/1640304262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05341055c0 0x7f053419a390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0524006ba0 tx=0x7f0524011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:48.042 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.319+0000 7f0530ff9700 1 -- 172.21.15.26:0/1640304262 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05240039b0 con 0x7f05341055c0 2023-12-01T00:56:48.042 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.319+0000 7f0530ff9700 1 -- 172.21.15.26:0/1640304262 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0524003b10 con 0x7f05341055c0 2023-12-01T00:56:48.042 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.319+0000 7f0530ff9700 1 -- 172.21.15.26:0/1640304262 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05240197f0 con 0x7f05341055c0 2023-12-01T00:56:48.042 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.319+0000 7f053a198700 1 -- 172.21.15.26:0/1640304262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053419aad0 con 0x7f05341055c0 2023-12-01T00:56:48.042 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.319+0000 7f053a198700 1 -- 172.21.15.26:0/1640304262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053419af70 con 0x7f05341055c0 2023-12-01T00:56:48.042 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.320+0000 7f0530ff9700 1 -- 172.21.15.26:0/1640304262 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7f0524019ab0 con 0x7f05341055c0 2023-12-01T00:56:48.042 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.320+0000 7f0530ff9700 1 --2- 172.21.15.26:0/1640304262 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f051c038300 0x7f051c03a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:48.042 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.320+0000 7f0530ff9700 1 -- 172.21.15.26:0/1640304262 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f052404c4d0 con 0x7f05341055c0 2023-12-01T00:56:48.042 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.321+0000 7f0532ffd700 1 --2- 172.21.15.26:0/1640304262 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f051c038300 0x7f051c03a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:48.042 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.321+0000 7f053a198700 1 -- 172.21.15.26:0/1640304262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05341940c0 con 0x7f05341055c0 2023-12-01T00:56:48.042 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.321+0000 7f0532ffd700 1 --2- 172.21.15.26:0/1640304262 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f051c038300 0x7f051c03a7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0528006fd0 tx=0x7f0528006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:48.043 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.326+0000 7f0530ff9700 1 -- 172.21.15.26:0/1640304262 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f052402c3a0 con 0x7f05341055c0 2023-12-01T00:56:48.043 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.696+0000 7f053a198700 1 -- 172.21.15.26:0/1640304262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f053402cef0 con 0x7f05341055c0 2023-12-01T00:56:48.043 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.700+0000 7f0530ff9700 1 -- 172.21.15.26:0/1640304262 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f05240172b0 con 0x7f05341055c0 2023-12-01T00:56:48.043 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.702+0000 7f053a198700 1 -- 172.21.15.26:0/1640304262 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f051c038300 msgr2=0x7f051c03a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:48.043 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.702+0000 7f053a198700 1 --2- 172.21.15.26:0/1640304262 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f051c038300 0x7f051c03a7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0528006fd0 tx=0x7f0528006e40 comp rx=0 tx=0).stop 2023-12-01T00:56:48.043 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.702+0000 7f053a198700 1 -- 172.21.15.26:0/1640304262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05341055c0 msgr2=0x7f053419a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:48.043 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.702+0000 7f053a198700 1 --2- 172.21.15.26:0/1640304262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05341055c0 0x7f053419a390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0524006ba0 tx=0x7f0524011b00 comp rx=0 tx=0).stop 2023-12-01T00:56:48.043 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.702+0000 7f053a198700 1 -- 172.21.15.26:0/1640304262 shutdown_connections 2023-12-01T00:56:48.043 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.702+0000 7f053a198700 1 --2- 172.21.15.26:0/1640304262 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f051c038300 0x7f051c03a7c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:48.043 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.702+0000 7f053a198700 1 --2- 172.21.15.26:0/1640304262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05341055c0 0x7f053419a390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:48.043 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.702+0000 7f053a198700 1 -- 172.21.15.26:0/1640304262 >> 172.21.15.26:0/1640304262 conn(0x7f0534100b80 msgr2=0x7f05341017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:48.043 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.703+0000 7f053a198700 1 -- 172.21.15.26:0/1640304262 shutdown_connections 2023-12-01T00:56:48.043 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:47.703+0000 7f053a198700 1 -- 172.21.15.26:0/1640304262 wait complete. 2023-12-01T00:56:48.043 INFO:teuthology.orchestra.run.smithi026.stdout:Enabling the dashboard module... 2023-12-01T00:56:48.992 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:48 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1640304262' entity='client.admin' 2023-12-01T00:56:48.993 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:48 smithi026 ceph-mon[98801]: from='mgr.14120 172.21.15.26:0/1435455637' entity='mgr.x' 2023-12-01T00:56:50.016 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:49 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2898799240' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-01T00:56:50.016 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:49 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: ignoring --setuser ceph since I am not root 2023-12-01T00:56:50.016 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:49 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: ignoring --setgroup ceph since I am not root 2023-12-01T00:56:50.016 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:49 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:49.918+0000 7fb10e3f3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-01T00:56:50.016 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:50 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:50.014+0000 7fb10e3f3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-01T00:56:50.086 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.532+0000 7f403e871700 1 Processor -- start 2023-12-01T00:56:50.086 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.532+0000 7f403e871700 1 -- start start 2023-12-01T00:56:50.086 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.532+0000 7f403e871700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40381055e0 0x7f4038105a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:50.086 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.532+0000 7f403e871700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4038105fd0 con 0x7f40381055e0 2023-12-01T00:56:50.086 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.532+0000 7f4037fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40381055e0 0x7f4038105a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:50.086 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.532+0000 7f4037fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40381055e0 0x7f4038105a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52380/0 (socket says 172.21.15.26:52380) 2023-12-01T00:56:50.086 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.532+0000 7f4037fff700 1 -- 172.21.15.26:0/3468185017 learned_addr learned my addr 172.21.15.26:0/3468185017 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:50.086 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.533+0000 7f4037fff700 1 -- 172.21.15.26:0/3468185017 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40381067e0 con 0x7f40381055e0 2023-12-01T00:56:50.086 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.533+0000 7f4037fff700 1 --2- 172.21.15.26:0/3468185017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40381055e0 0x7f4038105a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f40280098a0 tx=0x7f4028009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ea5c9ee3259219 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:50.086 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.533+0000 7f4036ffd700 1 -- 172.21.15.26:0/3468185017 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4028004160 con 0x7f40381055e0 2023-12-01T00:56:50.086 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.533+0000 7f4036ffd700 1 -- 172.21.15.26:0/3468185017 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f40280042c0 con 0x7f40381055e0 2023-12-01T00:56:50.087 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.533+0000 7f4036ffd700 1 -- 172.21.15.26:0/3468185017 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4028011a80 con 0x7f40381055e0 2023-12-01T00:56:50.087 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.534+0000 7f403e871700 1 -- 172.21.15.26:0/3468185017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40381055e0 msgr2=0x7f4038105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:50.087 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.534+0000 7f403e871700 1 --2- 172.21.15.26:0/3468185017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40381055e0 0x7f4038105a00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f40280098a0 tx=0x7f4028009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:50.087 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.534+0000 7f403e871700 1 -- 172.21.15.26:0/3468185017 shutdown_connections 2023-12-01T00:56:50.087 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.534+0000 7f403e871700 1 --2- 172.21.15.26:0/3468185017 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40381055e0 0x7f4038105a00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:50.087 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.534+0000 7f403e871700 1 -- 172.21.15.26:0/3468185017 >> 172.21.15.26:0/3468185017 conn(0x7f4038100b80 msgr2=0x7f4038102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:50.087 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.534+0000 7f403e871700 1 -- 172.21.15.26:0/3468185017 shutdown_connections 2023-12-01T00:56:50.087 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.534+0000 7f403e871700 1 -- 172.21.15.26:0/3468185017 wait complete. 2023-12-01T00:56:50.087 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.535+0000 7f403e871700 1 Processor -- start 2023-12-01T00:56:50.087 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.535+0000 7f403e871700 1 -- start start 2023-12-01T00:56:50.087 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.535+0000 7f403e871700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40381055e0 0x7f403818ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:50.087 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.535+0000 7f403e871700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4038190a10 con 0x7f40381055e0 2023-12-01T00:56:50.087 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.535+0000 7f4037fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40381055e0 0x7f403818ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:50.087 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.535+0000 7f4037fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40381055e0 0x7f403818ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52382/0 (socket says 172.21.15.26:52382) 2023-12-01T00:56:50.088 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.535+0000 7f4037fff700 1 -- 172.21.15.26:0/2898799240 learned_addr learned my addr 172.21.15.26:0/2898799240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:50.088 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.535+0000 7f4037fff700 1 -- 172.21.15.26:0/2898799240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4028009550 con 0x7f40381055e0 2023-12-01T00:56:50.088 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.536+0000 7f4037fff700 1 --2- 172.21.15.26:0/2898799240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40381055e0 0x7f403818ee80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4028006ba0 tx=0x7f4028011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:50.088 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.536+0000 7f40357fa700 1 -- 172.21.15.26:0/2898799240 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40280038b0 con 0x7f40381055e0 2023-12-01T00:56:50.088 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.536+0000 7f40357fa700 1 -- 172.21.15.26:0/2898799240 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4028003a10 con 0x7f40381055e0 2023-12-01T00:56:50.088 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.536+0000 7f40357fa700 1 -- 172.21.15.26:0/2898799240 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40280196e0 con 0x7f40381055e0 2023-12-01T00:56:50.088 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.536+0000 7f403e871700 1 -- 172.21.15.26:0/2898799240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4038190c10 con 0x7f40381055e0 2023-12-01T00:56:50.088 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.536+0000 7f403e871700 1 -- 172.21.15.26:0/2898799240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403818f610 con 0x7f40381055e0 2023-12-01T00:56:50.088 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.537+0000 7f40357fa700 1 -- 172.21.15.26:0/2898799240 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 8) v1 ==== 45268+0+0 (secure 0 0 0) 0x7f402801a430 con 0x7f40381055e0 2023-12-01T00:56:50.088 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.537+0000 7f40357fa700 1 --2- 172.21.15.26:0/2898799240 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f4020038300 0x7f402003a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:50.088 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.537+0000 7f40357fa700 1 -- 172.21.15.26:0/2898799240 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f402804c2f0 con 0x7f40381055e0 2023-12-01T00:56:50.088 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.537+0000 7f403e871700 1 -- 172.21.15.26:0/2898799240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40380623c0 con 0x7f40381055e0 2023-12-01T00:56:50.089 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.537+0000 7f40377fe700 1 --2- 172.21.15.26:0/2898799240 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f4020038300 0x7f402003a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:50.089 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.537+0000 7f40377fe700 1 --2- 172.21.15.26:0/2898799240 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f4020038300 0x7f402003a7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f402c006fd0 tx=0x7f402c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:50.089 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:48.542+0000 7f40357fa700 1 -- 172.21.15.26:0/2898799240 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4028023b80 con 0x7f40381055e0 2023-12-01T00:56:50.089 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:49.033+0000 7f403e871700 1 -- 172.21.15.26:0/2898799240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f4038067280 con 0x7f40381055e0 2023-12-01T00:56:50.089 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:49.703+0000 7f40357fa700 1 -- 172.21.15.26:0/2898799240 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 9) v1 ==== 45281+0+0 (secure 0 0 0) 0x7f40280199a0 con 0x7f40381055e0 2023-12-01T00:56:50.089 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:49.704+0000 7f40357fa700 1 -- 172.21.15.26:0/2898799240 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f4028018350 con 0x7f40381055e0 2023-12-01T00:56:50.089 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:49.708+0000 7f403e871700 1 -- 172.21.15.26:0/2898799240 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f4020038300 msgr2=0x7f402003a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:50.089 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:49.708+0000 7f403e871700 1 --2- 172.21.15.26:0/2898799240 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f4020038300 0x7f402003a7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f402c006fd0 tx=0x7f402c006e40 comp rx=0 tx=0).stop 2023-12-01T00:56:50.089 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:49.708+0000 7f403e871700 1 -- 172.21.15.26:0/2898799240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40381055e0 msgr2=0x7f403818ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:50.089 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:49.708+0000 7f403e871700 1 --2- 172.21.15.26:0/2898799240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40381055e0 0x7f403818ee80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4028006ba0 tx=0x7f4028011b00 comp rx=0 tx=0).stop 2023-12-01T00:56:50.089 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:49.708+0000 7f403e871700 1 -- 172.21.15.26:0/2898799240 shutdown_connections 2023-12-01T00:56:50.089 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:49.708+0000 7f403e871700 1 --2- 172.21.15.26:0/2898799240 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7f4020038300 0x7f402003a7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:50.089 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:49.708+0000 7f403e871700 1 --2- 172.21.15.26:0/2898799240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40381055e0 0x7f403818ee80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:50.090 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:49.708+0000 7f403e871700 1 -- 172.21.15.26:0/2898799240 >> 172.21.15.26:0/2898799240 conn(0x7f4038100b80 msgr2=0x7f4038079930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:50.090 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:49.708+0000 7f403e871700 1 -- 172.21.15.26:0/2898799240 shutdown_connections 2023-12-01T00:56:50.090 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:49.709+0000 7f403e871700 1 -- 172.21.15.26:0/2898799240 wait complete. 2023-12-01T00:56:50.296 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:50 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:50.131+0000 7fb10e3f3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-01T00:56:50.296 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:50 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:50.245+0000 7fb10e3f3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-01T00:56:50.703 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:50 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:50.455+0000 7fb10e3f3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-01T00:56:51.046 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:50 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:50.936+0000 7fb10e3f3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-01T00:56:51.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:50 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2898799240' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-01T00:56:51.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:50 smithi026 ceph-mon[98801]: mgrmap e9: x(active, since 18s) 2023-12-01T00:56:51.399 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:51 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:51.089+0000 7fb10e3f3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-01T00:56:51.399 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:51 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:51.198+0000 7fb10e3f3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-01T00:56:51.399 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:51 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:51.316+0000 7fb10e3f3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-01T00:56:51.638 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout { 2023-12-01T00:56:51.638 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-01T00:56:51.638 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-01T00:56:51.638 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-12-01T00:56:51.638 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-01T00:56:51.638 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout } 2023-12-01T00:56:51.639 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.759+0000 7faac9373700 1 Processor -- start 2023-12-01T00:56:51.639 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.759+0000 7faac9373700 1 -- start start 2023-12-01T00:56:51.639 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.759+0000 7faac9373700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac41055e0 0x7faac4105a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:51.639 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.759+0000 7faac9373700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac4105fd0 con 0x7faac41055e0 2023-12-01T00:56:51.639 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.759+0000 7faac2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac41055e0 0x7faac4105a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:51.639 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.759+0000 7faac2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac41055e0 0x7faac4105a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52396/0 (socket says 172.21.15.26:52396) 2023-12-01T00:56:51.639 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.759+0000 7faac2ffd700 1 -- 172.21.15.26:0/1455630956 learned_addr learned my addr 172.21.15.26:0/1455630956 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:51.639 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.760+0000 7faac2ffd700 1 -- 172.21.15.26:0/1455630956 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac41067e0 con 0x7faac41055e0 2023-12-01T00:56:51.639 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.760+0000 7faac2ffd700 1 --2- 172.21.15.26:0/1455630956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac41055e0 0x7faac4105a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faab400bb40 tx=0x7faab400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195c10d5713a79e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:51.639 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.760+0000 7faac1ffb700 1 -- 172.21.15.26:0/1455630956 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faab400dbe0 con 0x7faac41055e0 2023-12-01T00:56:51.639 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.760+0000 7faac1ffb700 1 -- 172.21.15.26:0/1455630956 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faab4004510 con 0x7faac41055e0 2023-12-01T00:56:51.639 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.760+0000 7faac1ffb700 1 -- 172.21.15.26:0/1455630956 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faab4010470 con 0x7faac41055e0 2023-12-01T00:56:51.639 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.761+0000 7faac9373700 1 -- 172.21.15.26:0/1455630956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac41055e0 msgr2=0x7faac4105a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:51.639 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.761+0000 7faac9373700 1 --2- 172.21.15.26:0/1455630956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac41055e0 0x7faac4105a00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faab400bb40 tx=0x7faab400be50 comp rx=0 tx=0).stop 2023-12-01T00:56:51.640 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.761+0000 7faac9373700 1 -- 172.21.15.26:0/1455630956 shutdown_connections 2023-12-01T00:56:51.640 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.761+0000 7faac9373700 1 --2- 172.21.15.26:0/1455630956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac41055e0 0x7faac4105a00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:51.640 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.761+0000 7faac9373700 1 -- 172.21.15.26:0/1455630956 >> 172.21.15.26:0/1455630956 conn(0x7faac4100b80 msgr2=0x7faac4102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:51.640 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.761+0000 7faac9373700 1 -- 172.21.15.26:0/1455630956 shutdown_connections 2023-12-01T00:56:51.640 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.761+0000 7faac9373700 1 -- 172.21.15.26:0/1455630956 wait complete. 2023-12-01T00:56:51.640 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.761+0000 7faac9373700 1 Processor -- start 2023-12-01T00:56:51.640 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.762+0000 7faac9373700 1 -- start start 2023-12-01T00:56:51.640 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.762+0000 7faac9373700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac41055e0 0x7faac4198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:51.640 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.762+0000 7faac9373700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac4198840 con 0x7faac41055e0 2023-12-01T00:56:51.640 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.762+0000 7faac2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac41055e0 0x7faac4198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:51.640 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.762+0000 7faac2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac41055e0 0x7faac4198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52398/0 (socket says 172.21.15.26:52398) 2023-12-01T00:56:51.640 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.762+0000 7faac2ffd700 1 -- 172.21.15.26:0/2038801689 learned_addr learned my addr 172.21.15.26:0/2038801689 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:51.640 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.762+0000 7faac2ffd700 1 -- 172.21.15.26:0/2038801689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab400b7f0 con 0x7faac41055e0 2023-12-01T00:56:51.640 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.763+0000 7faac2ffd700 1 --2- 172.21.15.26:0/2038801689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac41055e0 0x7faac4198300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faab400b340 tx=0x7faab4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:51.640 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.763+0000 7faaabfff700 1 -- 172.21.15.26:0/2038801689 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faab401e070 con 0x7faac41055e0 2023-12-01T00:56:51.641 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.763+0000 7faaabfff700 1 -- 172.21.15.26:0/2038801689 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faab4004330 con 0x7faac41055e0 2023-12-01T00:56:51.641 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.763+0000 7faac9373700 1 -- 172.21.15.26:0/2038801689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac4198a40 con 0x7faac41055e0 2023-12-01T00:56:51.641 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.763+0000 7faaabfff700 1 -- 172.21.15.26:0/2038801689 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faab40229e0 con 0x7faac41055e0 2023-12-01T00:56:51.641 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.763+0000 7faac9373700 1 -- 172.21.15.26:0/2038801689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac41996d0 con 0x7faac41055e0 2023-12-01T00:56:51.641 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.764+0000 7faac9373700 1 -- 172.21.15.26:0/2038801689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac4198ee0 con 0x7faac41055e0 2023-12-01T00:56:51.641 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.764+0000 7faaabfff700 1 -- 172.21.15.26:0/2038801689 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 45281+0+0 (secure 0 0 0) 0x7faab4010730 con 0x7faac41055e0 2023-12-01T00:56:51.641 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.765+0000 7faaabfff700 1 --2- 172.21.15.26:0/2038801689 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7faaac038300 0x7faaac03a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:51.641 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.765+0000 7faaabfff700 1 -- 172.21.15.26:0/2038801689 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7faab404f270 con 0x7faac41055e0 2023-12-01T00:56:51.641 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.765+0000 7faac27fc700 1 -- 172.21.15.26:0/2038801689 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7faaac038300 msgr2=0x7faaac03a7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2565806966 2023-12-01T00:56:51.641 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.765+0000 7faac27fc700 1 --2- 172.21.15.26:0/2038801689 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7faaac038300 0x7faaac03a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T00:56:51.641 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.769+0000 7faaabfff700 1 -- 172.21.15.26:0/2038801689 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7faab4021590 con 0x7faac41055e0 2023-12-01T00:56:51.641 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.966+0000 7faac27fc700 1 -- 172.21.15.26:0/2038801689 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7faaac038300 msgr2=0x7faaac03a7c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2565806966 2023-12-01T00:56:51.641 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:50.966+0000 7faac27fc700 1 --2- 172.21.15.26:0/2038801689 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7faaac038300 0x7faaac03a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-01T00:56:51.641 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:51.246+0000 7faac9373700 1 -- 172.21.15.26:0/2038801689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7faac419a500 con 0x7faac41055e0 2023-12-01T00:56:51.642 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:51.247+0000 7faaabfff700 1 -- 172.21.15.26:0/2038801689 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7faab4027030 con 0x7faac41055e0 2023-12-01T00:56:51.642 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:51.249+0000 7faac9373700 1 -- 172.21.15.26:0/2038801689 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7faaac038300 msgr2=0x7faaac03a7c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-01T00:56:51.642 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:51.249+0000 7faac9373700 1 --2- 172.21.15.26:0/2038801689 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7faaac038300 0x7faaac03a7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:51.642 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:51.249+0000 7faac9373700 1 -- 172.21.15.26:0/2038801689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac41055e0 msgr2=0x7faac4198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:51.642 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:51.249+0000 7faac9373700 1 --2- 172.21.15.26:0/2038801689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac41055e0 0x7faac4198300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7faab400b340 tx=0x7faab4003d40 comp rx=0 tx=0).stop 2023-12-01T00:56:51.642 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:51.249+0000 7faac9373700 1 -- 172.21.15.26:0/2038801689 shutdown_connections 2023-12-01T00:56:51.642 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:51.249+0000 7faac9373700 1 --2- 172.21.15.26:0/2038801689 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7faaac038300 0x7faaac03a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:51.642 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:51.249+0000 7faac9373700 1 --2- 172.21.15.26:0/2038801689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faac41055e0 0x7faac4198300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:51.642 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:51.249+0000 7faac9373700 1 -- 172.21.15.26:0/2038801689 >> 172.21.15.26:0/2038801689 conn(0x7faac4100b80 msgr2=0x7faac418efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:51.642 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:51.250+0000 7faac9373700 1 -- 172.21.15.26:0/2038801689 shutdown_connections 2023-12-01T00:56:51.642 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:51.250+0000 7faac9373700 1 -- 172.21.15.26:0/2038801689 wait complete. 2023-12-01T00:56:51.643 INFO:teuthology.orchestra.run.smithi026.stdout:Waiting for the mgr to restart... 2023-12-01T00:56:51.643 INFO:teuthology.orchestra.run.smithi026.stdout:Waiting for mgr epoch 9... 2023-12-01T00:56:52.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:51 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2038801689' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-01T00:56:52.046 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:51 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:51.858+0000 7fb10e3f3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-01T00:56:53.046 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:52 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:52.648+0000 7fb10e3f3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-01T00:56:53.046 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:52 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:52.747+0000 7fb10e3f3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-01T00:56:54.046 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:53 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:53.721+0000 7fb10e3f3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-01T00:56:54.046 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:53 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:53.833+0000 7fb10e3f3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-01T00:56:54.407 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:54 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:54.054+0000 7fb10e3f3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-01T00:56:54.408 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:54 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:54.406+0000 7fb10e3f3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-01T00:56:55.046 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:54 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:54.660+0000 7fb10e3f3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-01T00:56:55.046 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:54 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:54.843+0000 7fb10e3f3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-01T00:56:55.546 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:55 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:55.175+0000 7fb10e3f3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-01T00:56:56.296 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:56 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:56.000+0000 7fb10e3f3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-01T00:56:56.296 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:56 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:56.159+0000 7fb10e3f3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-01T00:56:56.796 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:56 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:56.405+0000 7fb10e3f3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-01T00:56:56.797 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:56 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:56.543+0000 7fb10e3f3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-01T00:56:57.296 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:56 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:56.818+0000 7fb10e3f3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-01T00:56:58.296 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 00:56:57 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T00:56:57.866+0000 7fb10e3f3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-01T00:56:58.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:57 smithi026 ceph-mon[98801]: Active manager daemon x restarted 2023-12-01T00:56:58.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:57 smithi026 ceph-mon[98801]: Activating manager daemon x 2023-12-01T00:56:58.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:57 smithi026 ceph-mon[98801]: osdmap e3: 0 total, 0 up, 0 in 2023-12-01T00:56:58.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:57 smithi026 ceph-mon[98801]: mgrmap e10: x(active, starting, since 0.00339356s) 2023-12-01T00:56:58.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:56:58.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-01T00:56:58.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-01T00:56:58.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-01T00:56:58.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-01T00:56:58.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:57 smithi026 ceph-mon[98801]: Manager daemon x is now available 2023-12-01T00:56:58.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:56:58.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:56:59.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-01T00:56:59.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-01T00:56:59.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:58 smithi026 ceph-mon[98801]: [01/Dec/2023:00:56:58] ENGINE Bus STARTING 2023-12-01T00:56:59.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:58 smithi026 ceph-mon[98801]: [01/Dec/2023:00:56:58] ENGINE Serving on https://172.21.15.26:7150 2023-12-01T00:56:59.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:58 smithi026 ceph-mon[98801]: [01/Dec/2023:00:56:58] ENGINE Serving on http://172.21.15.26:8765 2023-12-01T00:56:59.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:58 smithi026 ceph-mon[98801]: [01/Dec/2023:00:56:58] ENGINE Bus STARTED 2023-12-01T00:56:59.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:56:58 smithi026 ceph-mon[98801]: mgrmap e11: x(active, since 1.00594s) 2023-12-01T00:56:59.511 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout { 2023-12-01T00:56:59.512 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-01T00:56:59.512 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-01T00:56:59.512 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout } 2023-12-01T00:56:59.512 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.163+0000 7fc9809df700 1 Processor -- start 2023-12-01T00:56:59.512 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.163+0000 7fc9809df700 1 -- start start 2023-12-01T00:56:59.517 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.163+0000 7fc9809df700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97c107190 0x7fc97c109580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:59.517 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.163+0000 7fc9809df700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c079e80 con 0x7fc97c107190 2023-12-01T00:56:59.517 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.163+0000 7fc97a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97c107190 0x7fc97c109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:59.517 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.163+0000 7fc97a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97c107190 0x7fc97c109580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52406/0 (socket says 172.21.15.26:52406) 2023-12-01T00:56:59.517 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.163+0000 7fc97a59c700 1 -- 172.21.15.26:0/2886561283 learned_addr learned my addr 172.21.15.26:0/2886561283 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:59.517 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.163+0000 7fc97a59c700 1 -- 172.21.15.26:0/2886561283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c109ac0 con 0x7fc97c107190 2023-12-01T00:56:59.517 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.164+0000 7fc97a59c700 1 --2- 172.21.15.26:0/2886561283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97c107190 0x7fc97c109580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0098a0 tx=0x7fc96c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148aa2e8e173fe9 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:59.518 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.164+0000 7fc97959a700 1 -- 172.21.15.26:0/2886561283 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc96c004160 con 0x7fc97c107190 2023-12-01T00:56:59.518 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.164+0000 7fc97959a700 1 -- 172.21.15.26:0/2886561283 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc96c0042c0 con 0x7fc97c107190 2023-12-01T00:56:59.518 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.164+0000 7fc97959a700 1 -- 172.21.15.26:0/2886561283 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc96c011a80 con 0x7fc97c107190 2023-12-01T00:56:59.518 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.164+0000 7fc9809df700 1 -- 172.21.15.26:0/2886561283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97c107190 msgr2=0x7fc97c109580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:59.518 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.164+0000 7fc9809df700 1 --2- 172.21.15.26:0/2886561283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97c107190 0x7fc97c109580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0098a0 tx=0x7fc96c009bb0 comp rx=0 tx=0).stop 2023-12-01T00:56:59.518 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.165+0000 7fc9809df700 1 -- 172.21.15.26:0/2886561283 shutdown_connections 2023-12-01T00:56:59.518 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.165+0000 7fc9809df700 1 --2- 172.21.15.26:0/2886561283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97c107190 0x7fc97c109580 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:59.518 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.165+0000 7fc9809df700 1 -- 172.21.15.26:0/2886561283 >> 172.21.15.26:0/2886561283 conn(0x7fc97c100b80 msgr2=0x7fc97c102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:59.518 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.165+0000 7fc9809df700 1 -- 172.21.15.26:0/2886561283 shutdown_connections 2023-12-01T00:56:59.518 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.165+0000 7fc9809df700 1 -- 172.21.15.26:0/2886561283 wait complete. 2023-12-01T00:56:59.518 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.166+0000 7fc9809df700 1 Processor -- start 2023-12-01T00:56:59.518 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.166+0000 7fc9809df700 1 -- start start 2023-12-01T00:56:59.518 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.166+0000 7fc9809df700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97c107190 0x7fc97c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:59.519 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.166+0000 7fc9809df700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97c19a920 con 0x7fc97c107190 2023-12-01T00:56:59.519 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.166+0000 7fc97a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97c107190 0x7fc97c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:59.519 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.166+0000 7fc97a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97c107190 0x7fc97c19a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52408/0 (socket says 172.21.15.26:52408) 2023-12-01T00:56:59.519 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.166+0000 7fc97a59c700 1 -- 172.21.15.26:0/1499907761 learned_addr learned my addr 172.21.15.26:0/1499907761 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:56:59.519 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.166+0000 7fc97a59c700 1 -- 172.21.15.26:0/1499907761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c009550 con 0x7fc97c107190 2023-12-01T00:56:59.519 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.166+0000 7fc97a59c700 1 --2- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97c107190 0x7fc97c19a3e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc96c011a80 tx=0x7fc96c011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:59.519 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.167+0000 7fc96b7fe700 1 -- 172.21.15.26:0/1499907761 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc96c003c20 con 0x7fc97c107190 2023-12-01T00:56:59.519 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.167+0000 7fc96b7fe700 1 -- 172.21.15.26:0/1499907761 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc96c01a910 con 0x7fc97c107190 2023-12-01T00:56:59.519 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.167+0000 7fc9809df700 1 -- 172.21.15.26:0/1499907761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97c19ab20 con 0x7fc97c107190 2023-12-01T00:56:59.519 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.167+0000 7fc96b7fe700 1 -- 172.21.15.26:0/1499907761 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc96c0199f0 con 0x7fc97c107190 2023-12-01T00:56:59.519 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.167+0000 7fc9809df700 1 -- 172.21.15.26:0/1499907761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97c19b7b0 con 0x7fc97c107190 2023-12-01T00:56:59.519 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.168+0000 7fc96b7fe700 1 -- 172.21.15.26:0/1499907761 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 9) v1 ==== 45281+0+0 (secure 0 0 0) 0x7fc96c019c60 con 0x7fc97c107190 2023-12-01T00:56:59.519 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.168+0000 7fc96b7fe700 1 --2- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc9640383a0 0x7fc96403a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:59.519 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.168+0000 7fc96b7fe700 1 -- 172.21.15.26:0/1499907761 --> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc96403af70 con 0x7fc9640383a0 2023-12-01T00:56:59.520 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.168+0000 7fc96b7fe700 1 -- 172.21.15.26:0/1499907761 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc96c04c290 con 0x7fc97c107190 2023-12-01T00:56:59.520 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.168+0000 7fc979d9b700 1 -- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc9640383a0 msgr2=0x7fc96403a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2565806966 2023-12-01T00:56:59.520 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.168+0000 7fc979d9b700 1 --2- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc9640383a0 0x7fc96403a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T00:56:59.520 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.369+0000 7fc979d9b700 1 -- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc9640383a0 msgr2=0x7fc96403a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2565806966 2023-12-01T00:56:59.520 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.369+0000 7fc979d9b700 1 --2- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc9640383a0 0x7fc96403a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-01T00:56:59.520 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.770+0000 7fc979d9b700 1 -- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc9640383a0 msgr2=0x7fc96403a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2565806966 2023-12-01T00:56:59.520 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:52.770+0000 7fc979d9b700 1 --2- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc9640383a0 0x7fc96403a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-01T00:56:59.520 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:53.571+0000 7fc979d9b700 1 -- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc9640383a0 msgr2=0x7fc96403a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2565806966 2023-12-01T00:56:59.520 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:53.571+0000 7fc979d9b700 1 --2- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc9640383a0 0x7fc96403a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-01T00:56:59.520 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:55.172+0000 7fc979d9b700 1 -- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc9640383a0 msgr2=0x7fc96403a860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.26:6800/2565806966 2023-12-01T00:56:59.520 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:55.172+0000 7fc979d9b700 1 --2- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc9640383a0 0x7fc96403a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-01T00:56:59.520 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:57.881+0000 7fc96b7fe700 1 -- 172.21.15.26:0/1499907761 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mgrmap(e 10) v1 ==== 45048+0+0 (secure 0 0 0) 0x7fc96c02ace0 con 0x7fc97c107190 2023-12-01T00:56:59.520 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:57.881+0000 7fc96b7fe700 1 -- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc9640383a0 msgr2=0x7fc96403a860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-01T00:56:59.520 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:57.881+0000 7fc96b7fe700 1 --2- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc9640383a0 0x7fc96403a860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:59.521 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.883+0000 7fc96b7fe700 1 -- 172.21.15.26:0/1499907761 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 11) v1 ==== 45175+0+0 (secure 0 0 0) 0x7fc96c00bc80 con 0x7fc97c107190 2023-12-01T00:56:59.521 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.883+0000 7fc96b7fe700 1 --2- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc96403be10 0x7fc96403e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:56:59.521 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.883+0000 7fc96b7fe700 1 -- 172.21.15.26:0/1499907761 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc96403af70 con 0x7fc96403be10 2023-12-01T00:56:59.521 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.883+0000 7fc979d9b700 1 --2- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc96403be10 0x7fc96403e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:56:59.521 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.884+0000 7fc979d9b700 1 --2- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc96403be10 0x7fc96403e200 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc970003a10 tx=0x7fc970009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:56:59.521 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.885+0000 7fc96b7fe700 1 -- 172.21.15.26:0/1499907761 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fc96403af70 con 0x7fc96403be10 2023-12-01T00:56:59.521 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.896+0000 7fc9809df700 1 -- 172.21.15.26:0/1499907761 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fc97c19b640 con 0x7fc96403be10 2023-12-01T00:56:59.521 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.896+0000 7fc96b7fe700 1 -- 172.21.15.26:0/1499907761 <== mgr.14152 v2:172.21.15.26:6800/4255346255 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fc97c19b640 con 0x7fc96403be10 2023-12-01T00:56:59.521 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.896+0000 7fc9809df700 1 -- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc96403be10 msgr2=0x7fc96403e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:59.521 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.896+0000 7fc9809df700 1 --2- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc96403be10 0x7fc96403e200 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc970003a10 tx=0x7fc970009270 comp rx=0 tx=0).stop 2023-12-01T00:56:59.521 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.896+0000 7fc9809df700 1 -- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97c107190 msgr2=0x7fc97c19a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:56:59.521 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.896+0000 7fc9809df700 1 --2- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97c107190 0x7fc97c19a3e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc96c011a80 tx=0x7fc96c011b60 comp rx=0 tx=0).stop 2023-12-01T00:56:59.521 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.896+0000 7fc9809df700 1 -- 172.21.15.26:0/1499907761 shutdown_connections 2023-12-01T00:56:59.521 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.896+0000 7fc9809df700 1 --2- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc96403be10 0x7fc96403e200 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:59.522 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.896+0000 7fc9809df700 1 --2- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc97c107190 0x7fc97c19a3e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:59.522 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.896+0000 7fc9809df700 1 --2- 172.21.15.26:0/1499907761 >> [v2:172.21.15.26:6800/2565806966,v1:172.21.15.26:6801/2565806966] conn(0x7fc9640383a0 0x7fc96403a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:56:59.522 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.896+0000 7fc9809df700 1 -- 172.21.15.26:0/1499907761 >> 172.21.15.26:0/1499907761 conn(0x7fc97c100b80 msgr2=0x7fc97c101910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:56:59.522 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.896+0000 7fc9809df700 1 -- 172.21.15.26:0/1499907761 shutdown_connections 2023-12-01T00:56:59.522 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:58.896+0000 7fc9809df700 1 -- 172.21.15.26:0/1499907761 wait complete. 2023-12-01T00:56:59.522 INFO:teuthology.orchestra.run.smithi026.stdout:mgr epoch 9 is available 2023-12-01T00:56:59.522 INFO:teuthology.orchestra.run.smithi026.stdout:Generating a dashboard self-signed certificate... 2023-12-01T00:57:00.741 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:00 smithi026 ceph-mon[98801]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-01T00:57:00.741 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:00 smithi026 ceph-mon[98801]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-01T00:57:00.741 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:00 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:00.741 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:00 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:00.741 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:00 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:00.741 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:00 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:00.765 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-01T00:57:00.765 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.994+0000 7fc977143700 1 Processor -- start 2023-12-01T00:57:00.765 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.994+0000 7fc977143700 1 -- start start 2023-12-01T00:57:00.765 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.994+0000 7fc977143700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc970107170 0x7fc970109560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:00.765 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.994+0000 7fc977143700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc970079e80 con 0x7fc970107170 2023-12-01T00:57:00.765 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.994+0000 7fc974edf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc970107170 0x7fc970109560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:00.765 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.994+0000 7fc974edf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc970107170 0x7fc970109560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52464/0 (socket says 172.21.15.26:52464) 2023-12-01T00:57:00.765 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.995+0000 7fc974edf700 1 -- 172.21.15.26:0/3552956745 learned_addr learned my addr 172.21.15.26:0/3552956745 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:00.766 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.995+0000 7fc974edf700 1 -- 172.21.15.26:0/3552956745 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc970109aa0 con 0x7fc970107170 2023-12-01T00:57:00.766 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.995+0000 7fc974edf700 1 --2- 172.21.15.26:0/3552956745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc970107170 0x7fc970109560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc9640098a0 tx=0x7fc964009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a7f5d6375adcd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:00.766 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.995+0000 7fc96f7fe700 1 -- 172.21.15.26:0/3552956745 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc964004160 con 0x7fc970107170 2023-12-01T00:57:00.766 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.995+0000 7fc96f7fe700 1 -- 172.21.15.26:0/3552956745 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc9640042c0 con 0x7fc970107170 2023-12-01T00:57:00.766 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.995+0000 7fc96f7fe700 1 -- 172.21.15.26:0/3552956745 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc964011a80 con 0x7fc970107170 2023-12-01T00:57:00.766 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.996+0000 7fc977143700 1 -- 172.21.15.26:0/3552956745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc970107170 msgr2=0x7fc970109560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:00.766 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.996+0000 7fc977143700 1 --2- 172.21.15.26:0/3552956745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc970107170 0x7fc970109560 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc9640098a0 tx=0x7fc964009bb0 comp rx=0 tx=0).stop 2023-12-01T00:57:00.766 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.996+0000 7fc977143700 1 -- 172.21.15.26:0/3552956745 shutdown_connections 2023-12-01T00:57:00.766 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.996+0000 7fc977143700 1 --2- 172.21.15.26:0/3552956745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc970107170 0x7fc970109560 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:00.766 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.996+0000 7fc977143700 1 -- 172.21.15.26:0/3552956745 >> 172.21.15.26:0/3552956745 conn(0x7fc970100b80 msgr2=0x7fc970102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:00.766 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.996+0000 7fc977143700 1 -- 172.21.15.26:0/3552956745 shutdown_connections 2023-12-01T00:57:00.766 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.996+0000 7fc977143700 1 -- 172.21.15.26:0/3552956745 wait complete. 2023-12-01T00:57:00.767 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.996+0000 7fc977143700 1 Processor -- start 2023-12-01T00:57:00.767 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.997+0000 7fc977143700 1 -- start start 2023-12-01T00:57:00.767 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.997+0000 7fc977143700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc970107170 0x7fc97019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:00.767 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.997+0000 7fc977143700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97019a830 con 0x7fc970107170 2023-12-01T00:57:00.767 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.997+0000 7fc974edf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc970107170 0x7fc97019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:00.767 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.997+0000 7fc974edf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc970107170 0x7fc97019a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52466/0 (socket says 172.21.15.26:52466) 2023-12-01T00:57:00.767 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.997+0000 7fc974edf700 1 -- 172.21.15.26:0/3782801592 learned_addr learned my addr 172.21.15.26:0/3782801592 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:00.767 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.997+0000 7fc974edf700 1 -- 172.21.15.26:0/3782801592 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc964009550 con 0x7fc970107170 2023-12-01T00:57:00.767 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.997+0000 7fc974edf700 1 --2- 172.21.15.26:0/3782801592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc970107170 0x7fc97019a2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc964011a80 tx=0x7fc964011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:00.767 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.997+0000 7fc96dffb700 1 -- 172.21.15.26:0/3782801592 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc964003c20 con 0x7fc970107170 2023-12-01T00:57:00.767 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.997+0000 7fc96dffb700 1 -- 172.21.15.26:0/3782801592 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc96401a910 con 0x7fc970107170 2023-12-01T00:57:00.767 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.997+0000 7fc977143700 1 -- 172.21.15.26:0/3782801592 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97019aa30 con 0x7fc970107170 2023-12-01T00:57:00.767 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.998+0000 7fc96dffb700 1 -- 172.21.15.26:0/3782801592 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9640199f0 con 0x7fc970107170 2023-12-01T00:57:00.767 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.998+0000 7fc977143700 1 -- 172.21.15.26:0/3782801592 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97019aed0 con 0x7fc970107170 2023-12-01T00:57:00.768 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.999+0000 7fc96dffb700 1 -- 172.21.15.26:0/3782801592 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 11) v1 ==== 45175+0+0 (secure 0 0 0) 0x7fc964019cb0 con 0x7fc970107170 2023-12-01T00:57:00.768 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.999+0000 7fc96dffb700 1 --2- 172.21.15.26:0/3782801592 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc960038220 0x7fc96003a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:00.768 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.999+0000 7fc96dffb700 1 -- 172.21.15.26:0/3782801592 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc96404c1b0 con 0x7fc970107170 2023-12-01T00:57:00.768 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.999+0000 7fc96ffff700 1 --2- 172.21.15.26:0/3782801592 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc960038220 0x7fc96003a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:00.768 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.999+0000 7fc977143700 1 -- 172.21.15.26:0/3782801592 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9700623c0 con 0x7fc970107170 2023-12-01T00:57:00.768 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:56:59.999+0000 7fc96ffff700 1 --2- 172.21.15.26:0/3782801592 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc960038220 0x7fc96003a6e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc95c006fd0 tx=0x7fc95c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:00.768 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:00.004+0000 7fc96dffb700 1 -- 172.21.15.26:0/3782801592 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc96402b300 con 0x7fc970107170 2023-12-01T00:57:00.768 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:00.379+0000 7fc977143700 1 -- 172.21.15.26:0/3782801592 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fc970101fb0 con 0x7fc960038220 2023-12-01T00:57:00.768 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:00.424+0000 7fc96dffb700 1 -- 172.21.15.26:0/3782801592 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fc970101fb0 con 0x7fc960038220 2023-12-01T00:57:00.768 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:00.427+0000 7fc977143700 1 -- 172.21.15.26:0/3782801592 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc960038220 msgr2=0x7fc96003a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:00.769 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:00.427+0000 7fc977143700 1 --2- 172.21.15.26:0/3782801592 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc960038220 0x7fc96003a6e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc95c006fd0 tx=0x7fc95c006e40 comp rx=0 tx=0).stop 2023-12-01T00:57:00.769 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:00.427+0000 7fc977143700 1 -- 172.21.15.26:0/3782801592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc970107170 msgr2=0x7fc97019a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:00.769 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:00.427+0000 7fc977143700 1 --2- 172.21.15.26:0/3782801592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc970107170 0x7fc97019a2f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc964011a80 tx=0x7fc964011b60 comp rx=0 tx=0).stop 2023-12-01T00:57:00.769 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:00.427+0000 7fc977143700 1 -- 172.21.15.26:0/3782801592 shutdown_connections 2023-12-01T00:57:00.769 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:00.427+0000 7fc977143700 1 --2- 172.21.15.26:0/3782801592 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc960038220 0x7fc96003a6e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:00.769 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:00.427+0000 7fc977143700 1 --2- 172.21.15.26:0/3782801592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc970107170 0x7fc97019a2f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:00.769 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:00.427+0000 7fc977143700 1 -- 172.21.15.26:0/3782801592 >> 172.21.15.26:0/3782801592 conn(0x7fc970100b80 msgr2=0x7fc9701018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:00.769 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:00.427+0000 7fc977143700 1 -- 172.21.15.26:0/3782801592 shutdown_connections 2023-12-01T00:57:00.769 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:00.427+0000 7fc977143700 1 -- 172.21.15.26:0/3782801592 wait complete. 2023-12-01T00:57:00.769 INFO:teuthology.orchestra.run.smithi026.stdout:Creating initial admin user... 2023-12-01T00:57:01.914 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:01 smithi026 ceph-mon[98801]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:57:01.914 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:01 smithi026 ceph-mon[98801]: mgrmap e12: x(active, since 2s) 2023-12-01T00:57:02.412 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$lAXdl80VE9S6ylFY2P4Ws.t7kToAjigMrsAJpbMT8q5gzPmWAjOU2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1701392221, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-01T00:57:02.412 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.256+0000 7f50ce7c5700 1 Processor -- start 2023-12-01T00:57:02.412 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.256+0000 7f50ce7c5700 1 -- start start 2023-12-01T00:57:02.413 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.256+0000 7f50ce7c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50c81049b0 0x7f50c8104dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:02.413 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.256+0000 7f50ce7c5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c81053a0 con 0x7f50c81049b0 2023-12-01T00:57:02.413 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.256+0000 7f50c7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50c81049b0 0x7f50c8104dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:02.413 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.256+0000 7f50c7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50c81049b0 0x7f50c8104dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52470/0 (socket says 172.21.15.26:52470) 2023-12-01T00:57:02.413 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.256+0000 7f50c7fff700 1 -- 172.21.15.26:0/948486266 learned_addr learned my addr 172.21.15.26:0/948486266 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:02.413 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.257+0000 7f50c7fff700 1 -- 172.21.15.26:0/948486266 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c81054e0 con 0x7f50c81049b0 2023-12-01T00:57:02.413 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.257+0000 7f50c7fff700 1 --2- 172.21.15.26:0/948486266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50c81049b0 0x7f50c8104dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f50b80098a0 tx=0x7f50b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b784f4169558db70 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:02.413 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.257+0000 7f50c6ffd700 1 -- 172.21.15.26:0/948486266 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50b8004160 con 0x7f50c81049b0 2023-12-01T00:57:02.413 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.257+0000 7f50c6ffd700 1 -- 172.21.15.26:0/948486266 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f50b80042c0 con 0x7f50c81049b0 2023-12-01T00:57:02.413 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.257+0000 7f50c6ffd700 1 -- 172.21.15.26:0/948486266 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50b8011a80 con 0x7f50c81049b0 2023-12-01T00:57:02.413 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.258+0000 7f50ce7c5700 1 -- 172.21.15.26:0/948486266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50c81049b0 msgr2=0x7f50c8104dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:02.413 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.258+0000 7f50ce7c5700 1 --2- 172.21.15.26:0/948486266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50c81049b0 0x7f50c8104dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f50b80098a0 tx=0x7f50b8009bb0 comp rx=0 tx=0).stop 2023-12-01T00:57:02.414 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.258+0000 7f50ce7c5700 1 -- 172.21.15.26:0/948486266 shutdown_connections 2023-12-01T00:57:02.414 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.258+0000 7f50ce7c5700 1 --2- 172.21.15.26:0/948486266 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50c81049b0 0x7f50c8104dd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:02.414 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.258+0000 7f50ce7c5700 1 -- 172.21.15.26:0/948486266 >> 172.21.15.26:0/948486266 conn(0x7f50c81002e0 msgr2=0x7f50c8102720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:02.414 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.258+0000 7f50ce7c5700 1 -- 172.21.15.26:0/948486266 shutdown_connections 2023-12-01T00:57:02.414 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.258+0000 7f50ce7c5700 1 -- 172.21.15.26:0/948486266 wait complete. 2023-12-01T00:57:02.414 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.258+0000 7f50ce7c5700 1 Processor -- start 2023-12-01T00:57:02.414 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.259+0000 7f50ce7c5700 1 -- start start 2023-12-01T00:57:02.414 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.259+0000 7f50ce7c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50c81049b0 0x7f50c8107340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:02.414 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.259+0000 7f50ce7c5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c8107880 con 0x7f50c81049b0 2023-12-01T00:57:02.414 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.259+0000 7f50c7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50c81049b0 0x7f50c8107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:02.414 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.259+0000 7f50c7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50c81049b0 0x7f50c8107340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52472/0 (socket says 172.21.15.26:52472) 2023-12-01T00:57:02.414 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.259+0000 7f50c7fff700 1 -- 172.21.15.26:0/2233424826 learned_addr learned my addr 172.21.15.26:0/2233424826 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:02.415 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.259+0000 7f50c7fff700 1 -- 172.21.15.26:0/2233424826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b8009550 con 0x7f50c81049b0 2023-12-01T00:57:02.415 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.260+0000 7f50c7fff700 1 --2- 172.21.15.26:0/2233424826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50c81049b0 0x7f50c8107340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f50b8006ba0 tx=0x7f50b8011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:02.415 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.260+0000 7f50c57fa700 1 -- 172.21.15.26:0/2233424826 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50b80039b0 con 0x7f50c81049b0 2023-12-01T00:57:02.415 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.260+0000 7f50c57fa700 1 -- 172.21.15.26:0/2233424826 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f50b8003b10 con 0x7f50c81049b0 2023-12-01T00:57:02.415 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.260+0000 7f50ce7c5700 1 -- 172.21.15.26:0/2233424826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c8105990 con 0x7f50c81049b0 2023-12-01T00:57:02.415 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.260+0000 7f50c57fa700 1 -- 172.21.15.26:0/2233424826 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50b80197f0 con 0x7f50c81049b0 2023-12-01T00:57:02.415 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.260+0000 7f50ce7c5700 1 -- 172.21.15.26:0/2233424826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c8105e30 con 0x7f50c81049b0 2023-12-01T00:57:02.415 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.261+0000 7f50c57fa700 1 -- 172.21.15.26:0/2233424826 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 45281+0+0 (secure 0 0 0) 0x7f50b8019a60 con 0x7f50c81049b0 2023-12-01T00:57:02.415 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.261+0000 7f50c57fa700 1 --2- 172.21.15.26:0/2233424826 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f50b0038350 0x7f50b003a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:02.415 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.261+0000 7f50c57fa700 1 -- 172.21.15.26:0/2233424826 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f50b804c4b0 con 0x7f50c81049b0 2023-12-01T00:57:02.415 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.261+0000 7f50c77fe700 1 --2- 172.21.15.26:0/2233424826 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f50b0038350 0x7f50b003a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:02.415 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.261+0000 7f50ce7c5700 1 -- 172.21.15.26:0/2233424826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c80623c0 con 0x7f50c81049b0 2023-12-01T00:57:02.415 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.262+0000 7f50c77fe700 1 --2- 172.21.15.26:0/2233424826 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f50b0038350 0x7f50b003a810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f50bc006fd0 tx=0x7f50bc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:02.415 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.266+0000 7f50c57fa700 1 -- 172.21.15.26:0/2233424826 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f50b802c3a0 con 0x7f50c81049b0 2023-12-01T00:57:02.416 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.665+0000 7f50ce7c5700 1 -- 172.21.15.26:0/2233424826 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f50c80621e0 con 0x7f50b0038350 2023-12-01T00:57:02.416 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.915+0000 7f50c57fa700 1 -- 172.21.15.26:0/2233424826 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f50c80621e0 con 0x7f50b0038350 2023-12-01T00:57:02.416 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.918+0000 7f50ce7c5700 1 -- 172.21.15.26:0/2233424826 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f50b0038350 msgr2=0x7f50b003a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:02.416 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.918+0000 7f50ce7c5700 1 --2- 172.21.15.26:0/2233424826 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f50b0038350 0x7f50b003a810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f50bc006fd0 tx=0x7f50bc006e40 comp rx=0 tx=0).stop 2023-12-01T00:57:02.416 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.918+0000 7f50ce7c5700 1 -- 172.21.15.26:0/2233424826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50c81049b0 msgr2=0x7f50c8107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:02.416 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.918+0000 7f50ce7c5700 1 --2- 172.21.15.26:0/2233424826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50c81049b0 0x7f50c8107340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f50b8006ba0 tx=0x7f50b8011b00 comp rx=0 tx=0).stop 2023-12-01T00:57:02.416 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.918+0000 7f50ce7c5700 1 -- 172.21.15.26:0/2233424826 shutdown_connections 2023-12-01T00:57:02.416 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.918+0000 7f50ce7c5700 1 --2- 172.21.15.26:0/2233424826 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f50b0038350 0x7f50b003a810 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:02.416 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.918+0000 7f50ce7c5700 1 --2- 172.21.15.26:0/2233424826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f50c81049b0 0x7f50c8107340 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:02.416 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.918+0000 7f50ce7c5700 1 -- 172.21.15.26:0/2233424826 >> 172.21.15.26:0/2233424826 conn(0x7f50c81002e0 msgr2=0x7f50c8101050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:02.416 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.918+0000 7f50ce7c5700 1 -- 172.21.15.26:0/2233424826 shutdown_connections 2023-12-01T00:57:02.416 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:01.918+0000 7f50ce7c5700 1 -- 172.21.15.26:0/2233424826 wait complete. 2023-12-01T00:57:02.417 INFO:teuthology.orchestra.run.smithi026.stdout:Fetching dashboard port number... 2023-12-01T00:57:02.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:02 smithi026 ceph-mon[98801]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:57:02.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:02 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:03.562 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stdout 8443 2023-12-01T00:57:03.562 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.910+0000 7f5c07820700 1 Processor -- start 2023-12-01T00:57:03.563 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.910+0000 7f5c07820700 1 -- start start 2023-12-01T00:57:03.563 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.910+0000 7f5c07820700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c00104fc0 0x7f5c001053e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:03.563 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.910+0000 7f5c07820700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c00079e20 con 0x7f5c00104fc0 2023-12-01T00:57:03.563 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.911+0000 7f5c055bc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c00104fc0 0x7f5c001053e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:03.563 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.911+0000 7f5c055bc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c00104fc0 0x7f5c001053e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52476/0 (socket says 172.21.15.26:52476) 2023-12-01T00:57:03.563 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.911+0000 7f5c055bc700 1 -- 172.21.15.26:0/3665878262 learned_addr learned my addr 172.21.15.26:0/3665878262 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:03.563 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.911+0000 7f5c055bc700 1 -- 172.21.15.26:0/3665878262 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c00079f60 con 0x7f5c00104fc0 2023-12-01T00:57:03.563 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.911+0000 7f5c055bc700 1 --2- 172.21.15.26:0/3665878262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c00104fc0 0x7f5c001053e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00098a0 tx=0x7f5bf0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e98ca9047d342c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:03.563 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.911+0000 7f5bf7fff700 1 -- 172.21.15.26:0/3665878262 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5bf0004160 con 0x7f5c00104fc0 2023-12-01T00:57:03.564 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.911+0000 7f5bf7fff700 1 -- 172.21.15.26:0/3665878262 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5bf00042c0 con 0x7f5c00104fc0 2023-12-01T00:57:03.564 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.911+0000 7f5bf7fff700 1 -- 172.21.15.26:0/3665878262 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5bf0011a80 con 0x7f5c00104fc0 2023-12-01T00:57:03.564 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.912+0000 7f5c07820700 1 -- 172.21.15.26:0/3665878262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c00104fc0 msgr2=0x7f5c001053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:03.564 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.912+0000 7f5c07820700 1 --2- 172.21.15.26:0/3665878262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c00104fc0 0x7f5c001053e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5bf00098a0 tx=0x7f5bf0009bb0 comp rx=0 tx=0).stop 2023-12-01T00:57:03.564 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.912+0000 7f5c07820700 1 -- 172.21.15.26:0/3665878262 shutdown_connections 2023-12-01T00:57:03.564 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.912+0000 7f5c07820700 1 --2- 172.21.15.26:0/3665878262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c00104fc0 0x7f5c001053e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:03.564 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.912+0000 7f5c07820700 1 -- 172.21.15.26:0/3665878262 >> 172.21.15.26:0/3665878262 conn(0x7f5c00100b80 msgr2=0x7f5c00102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:03.564 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.912+0000 7f5c07820700 1 -- 172.21.15.26:0/3665878262 shutdown_connections 2023-12-01T00:57:03.564 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.912+0000 7f5c07820700 1 -- 172.21.15.26:0/3665878262 wait complete. 2023-12-01T00:57:03.565 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.913+0000 7f5c07820700 1 Processor -- start 2023-12-01T00:57:03.565 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.913+0000 7f5c07820700 1 -- start start 2023-12-01T00:57:03.565 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.913+0000 7f5c07820700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c00104fc0 0x7f5c0019c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:03.565 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.913+0000 7f5c07820700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0019ca40 con 0x7f5c00104fc0 2023-12-01T00:57:03.565 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.913+0000 7f5c055bc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c00104fc0 0x7f5c0019c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:03.565 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.913+0000 7f5c055bc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c00104fc0 0x7f5c0019c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52478/0 (socket says 172.21.15.26:52478) 2023-12-01T00:57:03.565 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.913+0000 7f5c055bc700 1 -- 172.21.15.26:0/41795331 learned_addr learned my addr 172.21.15.26:0/41795331 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:03.565 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.913+0000 7f5c055bc700 1 -- 172.21.15.26:0/41795331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf0009550 con 0x7f5c00104fc0 2023-12-01T00:57:03.565 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.913+0000 7f5c055bc700 1 --2- 172.21.15.26:0/41795331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c00104fc0 0x7f5c0019c500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0011a80 tx=0x7f5bf0011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:03.566 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.913+0000 7f5bf67fc700 1 -- 172.21.15.26:0/41795331 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5bf0003c20 con 0x7f5c00104fc0 2023-12-01T00:57:03.566 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.914+0000 7f5bf67fc700 1 -- 172.21.15.26:0/41795331 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5bf001a910 con 0x7f5c00104fc0 2023-12-01T00:57:03.566 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.914+0000 7f5c07820700 1 -- 172.21.15.26:0/41795331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0019cc40 con 0x7f5c00104fc0 2023-12-01T00:57:03.566 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.914+0000 7f5bf67fc700 1 -- 172.21.15.26:0/41795331 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5bf00199f0 con 0x7f5c00104fc0 2023-12-01T00:57:03.566 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.914+0000 7f5c07820700 1 -- 172.21.15.26:0/41795331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0019d0e0 con 0x7f5c00104fc0 2023-12-01T00:57:03.566 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.914+0000 7f5bf67fc700 1 -- 172.21.15.26:0/41795331 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 45281+0+0 (secure 0 0 0) 0x7f5bf0019cb0 con 0x7f5c00104fc0 2023-12-01T00:57:03.566 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.915+0000 7f5bf67fc700 1 --2- 172.21.15.26:0/41795331 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5bec038350 0x7f5bec03a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:03.566 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.915+0000 7f5bf67fc700 1 -- 172.21.15.26:0/41795331 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5bf004c450 con 0x7f5c00104fc0 2023-12-01T00:57:03.566 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.915+0000 7f5c07820700 1 -- 172.21.15.26:0/41795331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c00195d70 con 0x7f5c00104fc0 2023-12-01T00:57:03.567 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.915+0000 7f5c04dbb700 1 --2- 172.21.15.26:0/41795331 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5bec038350 0x7f5bec03a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:03.567 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.915+0000 7f5c04dbb700 1 --2- 172.21.15.26:0/41795331 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5bec038350 0x7f5bec03a810 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc006fd0 tx=0x7f5bfc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:03.567 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:02.920+0000 7f5bf67fc700 1 -- 172.21.15.26:0/41795331 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5bf0018b00 con 0x7f5c00104fc0 2023-12-01T00:57:03.567 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:03.286+0000 7f5c07820700 1 -- 172.21.15.26:0/41795331 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f5c0002cc70 con 0x7f5c00104fc0 2023-12-01T00:57:03.567 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:03.287+0000 7f5bf67fc700 1 -- 172.21.15.26:0/41795331 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f5bf0018b00 con 0x7f5c00104fc0 2023-12-01T00:57:03.567 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:03.289+0000 7f5c07820700 1 -- 172.21.15.26:0/41795331 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5bec038350 msgr2=0x7f5bec03a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:03.567 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:03.289+0000 7f5c07820700 1 --2- 172.21.15.26:0/41795331 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5bec038350 0x7f5bec03a810 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc006fd0 tx=0x7f5bfc006e40 comp rx=0 tx=0).stop 2023-12-01T00:57:03.567 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:03.289+0000 7f5c07820700 1 -- 172.21.15.26:0/41795331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c00104fc0 msgr2=0x7f5c0019c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:03.567 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:03.289+0000 7f5c07820700 1 --2- 172.21.15.26:0/41795331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c00104fc0 0x7f5c0019c500 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0011a80 tx=0x7f5bf0011b60 comp rx=0 tx=0).stop 2023-12-01T00:57:03.568 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:03.289+0000 7f5c07820700 1 -- 172.21.15.26:0/41795331 shutdown_connections 2023-12-01T00:57:03.568 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:03.289+0000 7f5c07820700 1 --2- 172.21.15.26:0/41795331 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5bec038350 0x7f5bec03a810 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:03.568 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:03.289+0000 7f5c07820700 1 --2- 172.21.15.26:0/41795331 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c00104fc0 0x7f5c0019c500 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:03.568 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:03.289+0000 7f5c07820700 1 -- 172.21.15.26:0/41795331 >> 172.21.15.26:0/41795331 conn(0x7f5c00100b80 msgr2=0x7f5c00190b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:03.568 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:03.289+0000 7f5c07820700 1 -- 172.21.15.26:0/41795331 shutdown_connections 2023-12-01T00:57:03.568 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:03.289+0000 7f5c07820700 1 -- 172.21.15.26:0/41795331 wait complete. 2023-12-01T00:57:03.569 INFO:teuthology.orchestra.run.smithi026.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-01T00:57:03.569 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stdout disabled 2023-12-01T00:57:03.574 INFO:teuthology.orchestra.run.smithi026.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-01T00:57:03.574 INFO:teuthology.orchestra.run.smithi026.stdout:systemctl: stdout inactive 2023-12-01T00:57:03.574 INFO:teuthology.orchestra.run.smithi026.stdout:firewalld.service is not enabled 2023-12-01T00:57:03.574 INFO:teuthology.orchestra.run.smithi026.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-01T00:57:03.575 INFO:teuthology.orchestra.run.smithi026.stdout:Ceph Dashboard is now available at: 2023-12-01T00:57:03.575 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:57:03.576 INFO:teuthology.orchestra.run.smithi026.stdout: URL: https://smithi026.front.sepia.ceph.com:8443/ 2023-12-01T00:57:03.576 INFO:teuthology.orchestra.run.smithi026.stdout: User: admin 2023-12-01T00:57:03.576 INFO:teuthology.orchestra.run.smithi026.stdout: Password: tkjb7r7x6w 2023-12-01T00:57:03.576 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:57:03.577 INFO:teuthology.orchestra.run.smithi026.stdout:Saving cluster configuration to /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config directory 2023-12-01T00:57:03.577 INFO:teuthology.orchestra.run.smithi026.stdout:Enabling autotune for osd_memory_target 2023-12-01T00:57:03.836 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:03 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/41795331' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-01T00:57:04.825 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.069+0000 7fabb0bf9700 1 Processor -- start 2023-12-01T00:57:04.825 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.069+0000 7fabb0bf9700 1 -- start start 2023-12-01T00:57:04.825 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.070+0000 7fabb0bf9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabac107190 0x7fabac109580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:04.825 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.070+0000 7fabb0bf9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac079e80 con 0x7fabac107190 2023-12-01T00:57:04.825 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.070+0000 7fabaa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabac107190 0x7fabac109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:04.825 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.070+0000 7fabaa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabac107190 0x7fabac109580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52486/0 (socket says 172.21.15.26:52486) 2023-12-01T00:57:04.825 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.070+0000 7fabaa59c700 1 -- 172.21.15.26:0/4168454482 learned_addr learned my addr 172.21.15.26:0/4168454482 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:04.825 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.070+0000 7fabaa59c700 1 -- 172.21.15.26:0/4168454482 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac109ac0 con 0x7fabac107190 2023-12-01T00:57:04.826 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.070+0000 7fabaa59c700 1 --2- 172.21.15.26:0/4168454482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabac107190 0x7fabac109580 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faba00098a0 tx=0x7faba0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97eccb7716931cc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:04.826 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.070+0000 7faba959a700 1 -- 172.21.15.26:0/4168454482 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faba0004160 con 0x7fabac107190 2023-12-01T00:57:04.826 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.071+0000 7faba959a700 1 -- 172.21.15.26:0/4168454482 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faba00042c0 con 0x7fabac107190 2023-12-01T00:57:04.826 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.071+0000 7faba959a700 1 -- 172.21.15.26:0/4168454482 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faba0011a80 con 0x7fabac107190 2023-12-01T00:57:04.826 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.071+0000 7fabb0bf9700 1 -- 172.21.15.26:0/4168454482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabac107190 msgr2=0x7fabac109580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:04.826 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.071+0000 7fabb0bf9700 1 --2- 172.21.15.26:0/4168454482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabac107190 0x7fabac109580 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faba00098a0 tx=0x7faba0009bb0 comp rx=0 tx=0).stop 2023-12-01T00:57:04.826 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.071+0000 7fabb0bf9700 1 -- 172.21.15.26:0/4168454482 shutdown_connections 2023-12-01T00:57:04.826 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.071+0000 7fabb0bf9700 1 --2- 172.21.15.26:0/4168454482 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabac107190 0x7fabac109580 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:04.826 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.071+0000 7fabb0bf9700 1 -- 172.21.15.26:0/4168454482 >> 172.21.15.26:0/4168454482 conn(0x7fabac100b80 msgr2=0x7fabac102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:04.826 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.071+0000 7fabb0bf9700 1 -- 172.21.15.26:0/4168454482 shutdown_connections 2023-12-01T00:57:04.826 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.071+0000 7fabb0bf9700 1 -- 172.21.15.26:0/4168454482 wait complete. 2023-12-01T00:57:04.826 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.072+0000 7fabb0bf9700 1 Processor -- start 2023-12-01T00:57:04.826 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.072+0000 7fabb0bf9700 1 -- start start 2023-12-01T00:57:04.826 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.072+0000 7fabb0bf9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabac107190 0x7fabac19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:04.827 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.072+0000 7fabb0bf9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac19a940 con 0x7fabac107190 2023-12-01T00:57:04.827 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.072+0000 7fabaa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabac107190 0x7fabac19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:04.827 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.072+0000 7fabaa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabac107190 0x7fabac19a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52488/0 (socket says 172.21.15.26:52488) 2023-12-01T00:57:04.827 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.072+0000 7fabaa59c700 1 -- 172.21.15.26:0/1417606291 learned_addr learned my addr 172.21.15.26:0/1417606291 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:04.827 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.073+0000 7fabaa59c700 1 -- 172.21.15.26:0/1417606291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba0009550 con 0x7fabac107190 2023-12-01T00:57:04.827 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.073+0000 7fabaa59c700 1 --2- 172.21.15.26:0/1417606291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabac107190 0x7fabac19a400 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faba0011a80 tx=0x7faba0011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:04.827 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.073+0000 7fab9b7fe700 1 -- 172.21.15.26:0/1417606291 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faba0003c20 con 0x7fabac107190 2023-12-01T00:57:04.827 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.073+0000 7fabb0bf9700 1 -- 172.21.15.26:0/1417606291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabac19ab40 con 0x7fabac107190 2023-12-01T00:57:04.827 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.073+0000 7fab9b7fe700 1 -- 172.21.15.26:0/1417606291 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faba001a910 con 0x7fabac107190 2023-12-01T00:57:04.827 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.073+0000 7fab9b7fe700 1 -- 172.21.15.26:0/1417606291 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faba00199f0 con 0x7fabac107190 2023-12-01T00:57:04.827 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.073+0000 7fabb0bf9700 1 -- 172.21.15.26:0/1417606291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabac19b7d0 con 0x7fabac107190 2023-12-01T00:57:04.827 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.074+0000 7fab9b7fe700 1 -- 172.21.15.26:0/1417606291 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 12) v1 ==== 45281+0+0 (secure 0 0 0) 0x7faba0019cb0 con 0x7fabac107190 2023-12-01T00:57:04.827 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.074+0000 7fabb0bf9700 1 -- 172.21.15.26:0/1417606291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabac19afe0 con 0x7fabac107190 2023-12-01T00:57:04.827 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.074+0000 7fab9b7fe700 1 --2- 172.21.15.26:0/1417606291 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fab94038350 0x7fab9403a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:04.828 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.074+0000 7fab9b7fe700 1 -- 172.21.15.26:0/1417606291 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7faba004c3a0 con 0x7fabac107190 2023-12-01T00:57:04.828 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.074+0000 7faba9d9b700 1 --2- 172.21.15.26:0/1417606291 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fab94038350 0x7fab9403a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:04.828 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.075+0000 7faba9d9b700 1 --2- 172.21.15.26:0/1417606291 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fab94038350 0x7fab9403a810 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fab9c006fd0 tx=0x7fab9c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:04.828 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.079+0000 7fab9b7fe700 1 -- 172.21.15.26:0/1417606291 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fabac19afe0 con 0x7fabac107190 2023-12-01T00:57:04.828 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.438+0000 7fabb0bf9700 1 -- 172.21.15.26:0/1417606291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fabac19afe0 con 0x7fabac107190 2023-12-01T00:57:04.828 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.439+0000 7fab9b7fe700 1 -- 172.21.15.26:0/1417606291 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fabac19afe0 con 0x7fabac107190 2023-12-01T00:57:04.828 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.441+0000 7fabb0bf9700 1 -- 172.21.15.26:0/1417606291 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fab94038350 msgr2=0x7fab9403a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:04.828 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.441+0000 7fabb0bf9700 1 --2- 172.21.15.26:0/1417606291 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fab94038350 0x7fab9403a810 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fab9c006fd0 tx=0x7fab9c006e40 comp rx=0 tx=0).stop 2023-12-01T00:57:04.828 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.441+0000 7fabb0bf9700 1 -- 172.21.15.26:0/1417606291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabac107190 msgr2=0x7fabac19a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:04.828 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.441+0000 7fabb0bf9700 1 --2- 172.21.15.26:0/1417606291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabac107190 0x7fabac19a400 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faba0011a80 tx=0x7faba0011b60 comp rx=0 tx=0).stop 2023-12-01T00:57:04.828 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.441+0000 7fabb0bf9700 1 -- 172.21.15.26:0/1417606291 shutdown_connections 2023-12-01T00:57:04.828 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.441+0000 7fabb0bf9700 1 --2- 172.21.15.26:0/1417606291 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fab94038350 0x7fab9403a810 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:04.828 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.441+0000 7fabb0bf9700 1 --2- 172.21.15.26:0/1417606291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fabac107190 0x7fabac19a400 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:04.828 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.441+0000 7fabb0bf9700 1 -- 172.21.15.26:0/1417606291 >> 172.21.15.26:0/1417606291 conn(0x7fabac100b80 msgr2=0x7fabac101880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:04.828 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.441+0000 7fabb0bf9700 1 -- 172.21.15.26:0/1417606291 shutdown_connections 2023-12-01T00:57:04.829 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:04.441+0000 7fabb0bf9700 1 -- 172.21.15.26:0/1417606291 wait complete. 2023-12-01T00:57:06.022 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:05 smithi026 ceph-mon[98801]: mgrmap e13: x(active, since 6s) 2023-12-01T00:57:06.267 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.273+0000 7f5c0e786700 1 Processor -- start 2023-12-01T00:57:06.274 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.273+0000 7f5c0e786700 1 -- start start 2023-12-01T00:57:06.274 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.273+0000 7f5c0e786700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c081055c0 0x7f5c081059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:06.274 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.273+0000 7f5c0e786700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c08105fb0 con 0x7f5c081055c0 2023-12-01T00:57:06.274 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.273+0000 7f5c07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c081055c0 0x7f5c081059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:06.274 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.273+0000 7f5c07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c081055c0 0x7f5c081059e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52492/0 (socket says 172.21.15.26:52492) 2023-12-01T00:57:06.274 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.273+0000 7f5c07fff700 1 -- 172.21.15.26:0/1103128438 learned_addr learned my addr 172.21.15.26:0/1103128438 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:06.274 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.274+0000 7f5c07fff700 1 -- 172.21.15.26:0/1103128438 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c081067c0 con 0x7f5c081055c0 2023-12-01T00:57:06.274 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.274+0000 7f5c07fff700 1 --2- 172.21.15.26:0/1103128438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c081055c0 0x7f5c081059e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80098a0 tx=0x7f5bf8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515455adaa3a286 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:06.274 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.274+0000 7f5c06ffd700 1 -- 172.21.15.26:0/1103128438 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5bf8004160 con 0x7f5c081055c0 2023-12-01T00:57:06.275 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.274+0000 7f5c06ffd700 1 -- 172.21.15.26:0/1103128438 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5bf80042c0 con 0x7f5c081055c0 2023-12-01T00:57:06.275 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.274+0000 7f5c06ffd700 1 -- 172.21.15.26:0/1103128438 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5bf8011a80 con 0x7f5c081055c0 2023-12-01T00:57:06.275 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.274+0000 7f5c0e786700 1 -- 172.21.15.26:0/1103128438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c081055c0 msgr2=0x7f5c081059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:06.275 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.274+0000 7f5c0e786700 1 --2- 172.21.15.26:0/1103128438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c081055c0 0x7f5c081059e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5bf80098a0 tx=0x7f5bf8009bb0 comp rx=0 tx=0).stop 2023-12-01T00:57:06.275 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.275+0000 7f5c0e786700 1 -- 172.21.15.26:0/1103128438 shutdown_connections 2023-12-01T00:57:06.275 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.275+0000 7f5c0e786700 1 --2- 172.21.15.26:0/1103128438 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c081055c0 0x7f5c081059e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:06.275 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.275+0000 7f5c0e786700 1 -- 172.21.15.26:0/1103128438 >> 172.21.15.26:0/1103128438 conn(0x7f5c08100b80 msgr2=0x7f5c08102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:06.275 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.275+0000 7f5c0e786700 1 -- 172.21.15.26:0/1103128438 shutdown_connections 2023-12-01T00:57:06.275 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.275+0000 7f5c0e786700 1 -- 172.21.15.26:0/1103128438 wait complete. 2023-12-01T00:57:06.275 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.275+0000 7f5c0e786700 1 Processor -- start 2023-12-01T00:57:06.275 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.275+0000 7f5c0e786700 1 -- start start 2023-12-01T00:57:06.275 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.276+0000 7f5c0e786700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c081055c0 0x7f5c0819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:06.275 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.276+0000 7f5c0e786700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0819a8b0 con 0x7f5c081055c0 2023-12-01T00:57:06.276 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.276+0000 7f5c07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c081055c0 0x7f5c0819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:06.276 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.276+0000 7f5c07fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c081055c0 0x7f5c0819a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52494/0 (socket says 172.21.15.26:52494) 2023-12-01T00:57:06.276 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.276+0000 7f5c07fff700 1 -- 172.21.15.26:0/657737931 learned_addr learned my addr 172.21.15.26:0/657737931 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:06.276 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.276+0000 7f5c07fff700 1 -- 172.21.15.26:0/657737931 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf8009550 con 0x7f5c081055c0 2023-12-01T00:57:06.276 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.276+0000 7f5c07fff700 1 --2- 172.21.15.26:0/657737931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c081055c0 0x7f5c0819a370 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8000c00 tx=0x7f5bf8011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:06.276 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.276+0000 7f5c057fa700 1 -- 172.21.15.26:0/657737931 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5bf8003aa0 con 0x7f5c081055c0 2023-12-01T00:57:06.276 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.276+0000 7f5c057fa700 1 -- 172.21.15.26:0/657737931 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5bf8003c00 con 0x7f5c081055c0 2023-12-01T00:57:06.276 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.276+0000 7f5c0e786700 1 -- 172.21.15.26:0/657737931 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0819aab0 con 0x7f5c081055c0 2023-12-01T00:57:06.276 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.276+0000 7f5c057fa700 1 -- 172.21.15.26:0/657737931 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5bf80237d0 con 0x7f5c081055c0 2023-12-01T00:57:06.276 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.276+0000 7f5c0e786700 1 -- 172.21.15.26:0/657737931 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0819af50 con 0x7f5c081055c0 2023-12-01T00:57:06.276 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.277+0000 7f5c057fa700 1 -- 172.21.15.26:0/657737931 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 45324+0+0 (secure 0 0 0) 0x7f5bf8023a40 con 0x7f5c081055c0 2023-12-01T00:57:06.276 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.278+0000 7f5c057fa700 1 --2- 172.21.15.26:0/657737931 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5bf0038440 0x7f5bf003a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:06.276 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.278+0000 7f5c0e786700 1 -- 172.21.15.26:0/657737931 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c081099f0 con 0x7f5c081055c0 2023-12-01T00:57:06.276 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.278+0000 7f5c057fa700 1 -- 172.21.15.26:0/657737931 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5bf804c2a0 con 0x7f5c081055c0 2023-12-01T00:57:06.277 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.279+0000 7f5c077fe700 1 --2- 172.21.15.26:0/657737931 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5bf0038440 0x7f5bf003a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:06.277 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.279+0000 7f5c077fe700 1 --2- 172.21.15.26:0/657737931 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5bf0038440 0x7f5bf003a900 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc006fd0 tx=0x7f5bfc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:06.277 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.283+0000 7f5c057fa700 1 -- 172.21.15.26:0/657737931 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5bf80189a0 con 0x7f5c081055c0 2023-12-01T00:57:06.277 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.863+0000 7f5c0e786700 1 -- 172.21.15.26:0/657737931 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f5c0819dd30 con 0x7f5c081055c0 2023-12-01T00:57:06.277 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.865+0000 7f5c057fa700 1 -- 172.21.15.26:0/657737931 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f5bf8018350 con 0x7f5c081055c0 2023-12-01T00:57:06.277 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.867+0000 7f5c0e786700 1 -- 172.21.15.26:0/657737931 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5bf0038440 msgr2=0x7f5bf003a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:06.277 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.867+0000 7f5c0e786700 1 --2- 172.21.15.26:0/657737931 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5bf0038440 0x7f5bf003a900 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc006fd0 tx=0x7f5bfc006e40 comp rx=0 tx=0).stop 2023-12-01T00:57:06.277 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.867+0000 7f5c0e786700 1 -- 172.21.15.26:0/657737931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c081055c0 msgr2=0x7f5c0819a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:06.277 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.867+0000 7f5c0e786700 1 --2- 172.21.15.26:0/657737931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c081055c0 0x7f5c0819a370 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8000c00 tx=0x7f5bf8011b00 comp rx=0 tx=0).stop 2023-12-01T00:57:06.277 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.867+0000 7f5c0e786700 1 -- 172.21.15.26:0/657737931 shutdown_connections 2023-12-01T00:57:06.278 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.867+0000 7f5c0e786700 1 --2- 172.21.15.26:0/657737931 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5bf0038440 0x7f5bf003a900 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:06.278 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.867+0000 7f5c0e786700 1 --2- 172.21.15.26:0/657737931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c081055c0 0x7f5c0819a370 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:06.278 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.867+0000 7f5c0e786700 1 -- 172.21.15.26:0/657737931 >> 172.21.15.26:0/657737931 conn(0x7f5c08100b80 msgr2=0x7f5c08079120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:06.278 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.868+0000 7f5c0e786700 1 -- 172.21.15.26:0/657737931 shutdown_connections 2023-12-01T00:57:06.278 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr 2023-12-01T00:57:05.868+0000 7f5c0e786700 1 -- 172.21.15.26:0/657737931 wait complete. 2023-12-01T00:57:06.278 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-01T00:57:06.278 INFO:teuthology.orchestra.run.smithi026.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-01T00:57:06.278 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:57:06.278 INFO:teuthology.orchestra.run.smithi026.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-01T00:57:06.278 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:57:06.278 INFO:teuthology.orchestra.run.smithi026.stdout:Or, if you are only running a single cluster on this host: 2023-12-01T00:57:06.278 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:57:06.278 INFO:teuthology.orchestra.run.smithi026.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-01T00:57:06.278 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:57:06.279 INFO:teuthology.orchestra.run.smithi026.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-01T00:57:06.279 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:57:06.279 INFO:teuthology.orchestra.run.smithi026.stdout: ceph telemetry on 2023-12-01T00:57:06.279 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:57:06.279 INFO:teuthology.orchestra.run.smithi026.stdout:For more information see: 2023-12-01T00:57:06.279 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:57:06.279 INFO:teuthology.orchestra.run.smithi026.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-12-01T00:57:06.279 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:57:06.279 INFO:teuthology.orchestra.run.smithi026.stdout:Bootstrap complete. 2023-12-01T00:57:06.311 INFO:tasks.cephadm:Fetching config... 2023-12-01T00:57:06.311 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T00:57:06.311 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-01T00:57:06.329 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-01T00:57:06.329 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T00:57:06.329 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-01T00:57:06.387 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-01T00:57:06.387 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T00:57:06.387 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/keyring of=/dev/stdout 2023-12-01T00:57:06.456 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-01T00:57:06.456 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T00:57:06.456 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-01T00:57:06.513 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-01T00:57:06.513 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+gIuX2MV4eMEUHTYv4BHYcoUf6EsFayNYSeL5Jco2MNLzNTIBJrFx6caluKzSlr1Nop/Zp0PXZfndVAaJCW5iSAGTEeYVjb9DnhCnXPkcIrA9/711gd2/8Vgb25rgVYmJxMw1lwXcIkw2cdKWNsKSwsnhLHitg/1QIO0i4VoCk0Bnml389McLA6C578vl8PaA2C4XdoFGe5NjpwLZQCBaylWmCYD28Qp/EciraTdZmkXMOfGbHf+UuKYGQjOCWvnz4lpzDo1KRvSqaZqINVjjjpmalB3u6+AWjsnFZe6eM/Wqneq+Zl3Ls1vsYELFMbsrkdnYND86QpwDhnqAOGALsM6NBxRzPZyXIpuZTi0/Mzb2yCsN0d4689a3q2SG8/AABX2XxxS1t0RBA/mlVIwsw/DbUIIIkaXI/ThOSqxZbgqrU1MsgIILOfWkWwn2rNbwGNqWht3QL9RwxHpNDsZLKXAU0mdmbe5YJCbkmGB6+AmMysq2aYeZMOPpRy0c0/c= ceph-48bff570-8fe4-11ee-95a2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-01T00:57:06.593 INFO:teuthology.orchestra.run.smithi026.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+gIuX2MV4eMEUHTYv4BHYcoUf6EsFayNYSeL5Jco2MNLzNTIBJrFx6caluKzSlr1Nop/Zp0PXZfndVAaJCW5iSAGTEeYVjb9DnhCnXPkcIrA9/711gd2/8Vgb25rgVYmJxMw1lwXcIkw2cdKWNsKSwsnhLHitg/1QIO0i4VoCk0Bnml389McLA6C578vl8PaA2C4XdoFGe5NjpwLZQCBaylWmCYD28Qp/EciraTdZmkXMOfGbHf+UuKYGQjOCWvnz4lpzDo1KRvSqaZqINVjjjpmalB3u6+AWjsnFZe6eM/Wqneq+Zl3Ls1vsYELFMbsrkdnYND86QpwDhnqAOGALsM6NBxRzPZyXIpuZTi0/Mzb2yCsN0d4689a3q2SG8/AABX2XxxS1t0RBA/mlVIwsw/DbUIIIkaXI/ThOSqxZbgqrU1MsgIILOfWkWwn2rNbwGNqWht3QL9RwxHpNDsZLKXAU0mdmbe5YJCbkmGB6+AmMysq2aYeZMOPpRy0c0/c= ceph-48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:57:06.607 DEBUG:teuthology.orchestra.run.smithi093:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+gIuX2MV4eMEUHTYv4BHYcoUf6EsFayNYSeL5Jco2MNLzNTIBJrFx6caluKzSlr1Nop/Zp0PXZfndVAaJCW5iSAGTEeYVjb9DnhCnXPkcIrA9/711gd2/8Vgb25rgVYmJxMw1lwXcIkw2cdKWNsKSwsnhLHitg/1QIO0i4VoCk0Bnml389McLA6C578vl8PaA2C4XdoFGe5NjpwLZQCBaylWmCYD28Qp/EciraTdZmkXMOfGbHf+UuKYGQjOCWvnz4lpzDo1KRvSqaZqINVjjjpmalB3u6+AWjsnFZe6eM/Wqneq+Zl3Ls1vsYELFMbsrkdnYND86QpwDhnqAOGALsM6NBxRzPZyXIpuZTi0/Mzb2yCsN0d4689a3q2SG8/AABX2XxxS1t0RBA/mlVIwsw/DbUIIIkaXI/ThOSqxZbgqrU1MsgIILOfWkWwn2rNbwGNqWht3QL9RwxHpNDsZLKXAU0mdmbe5YJCbkmGB6+AmMysq2aYeZMOPpRy0c0/c= ceph-48bff570-8fe4-11ee-95a2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-01T00:57:06.652 INFO:teuthology.orchestra.run.smithi093.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+gIuX2MV4eMEUHTYv4BHYcoUf6EsFayNYSeL5Jco2MNLzNTIBJrFx6caluKzSlr1Nop/Zp0PXZfndVAaJCW5iSAGTEeYVjb9DnhCnXPkcIrA9/711gd2/8Vgb25rgVYmJxMw1lwXcIkw2cdKWNsKSwsnhLHitg/1QIO0i4VoCk0Bnml389McLA6C578vl8PaA2C4XdoFGe5NjpwLZQCBaylWmCYD28Qp/EciraTdZmkXMOfGbHf+UuKYGQjOCWvnz4lpzDo1KRvSqaZqINVjjjpmalB3u6+AWjsnFZe6eM/Wqneq+Zl3Ls1vsYELFMbsrkdnYND86QpwDhnqAOGALsM6NBxRzPZyXIpuZTi0/Mzb2yCsN0d4689a3q2SG8/AABX2XxxS1t0RBA/mlVIwsw/DbUIIIkaXI/ThOSqxZbgqrU1MsgIILOfWkWwn2rNbwGNqWht3QL9RwxHpNDsZLKXAU0mdmbe5YJCbkmGB6+AmMysq2aYeZMOPpRy0c0/c= ceph-48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:57:06.665 DEBUG:teuthology.orchestra.run.smithi116:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+gIuX2MV4eMEUHTYv4BHYcoUf6EsFayNYSeL5Jco2MNLzNTIBJrFx6caluKzSlr1Nop/Zp0PXZfndVAaJCW5iSAGTEeYVjb9DnhCnXPkcIrA9/711gd2/8Vgb25rgVYmJxMw1lwXcIkw2cdKWNsKSwsnhLHitg/1QIO0i4VoCk0Bnml389McLA6C578vl8PaA2C4XdoFGe5NjpwLZQCBaylWmCYD28Qp/EciraTdZmkXMOfGbHf+UuKYGQjOCWvnz4lpzDo1KRvSqaZqINVjjjpmalB3u6+AWjsnFZe6eM/Wqneq+Zl3Ls1vsYELFMbsrkdnYND86QpwDhnqAOGALsM6NBxRzPZyXIpuZTi0/Mzb2yCsN0d4689a3q2SG8/AABX2XxxS1t0RBA/mlVIwsw/DbUIIIkaXI/ThOSqxZbgqrU1MsgIILOfWkWwn2rNbwGNqWht3QL9RwxHpNDsZLKXAU0mdmbe5YJCbkmGB6+AmMysq2aYeZMOPpRy0c0/c= ceph-48bff570-8fe4-11ee-95a2-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-01T00:57:06.711 INFO:teuthology.orchestra.run.smithi116.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+gIuX2MV4eMEUHTYv4BHYcoUf6EsFayNYSeL5Jco2MNLzNTIBJrFx6caluKzSlr1Nop/Zp0PXZfndVAaJCW5iSAGTEeYVjb9DnhCnXPkcIrA9/711gd2/8Vgb25rgVYmJxMw1lwXcIkw2cdKWNsKSwsnhLHitg/1QIO0i4VoCk0Bnml389McLA6C578vl8PaA2C4XdoFGe5NjpwLZQCBaylWmCYD28Qp/EciraTdZmkXMOfGbHf+UuKYGQjOCWvnz4lpzDo1KRvSqaZqINVjjjpmalB3u6+AWjsnFZe6eM/Wqneq+Zl3Ls1vsYELFMbsrkdnYND86QpwDhnqAOGALsM6NBxRzPZyXIpuZTi0/Mzb2yCsN0d4689a3q2SG8/AABX2XxxS1t0RBA/mlVIwsw/DbUIIIkaXI/ThOSqxZbgqrU1MsgIILOfWkWwn2rNbwGNqWht3QL9RwxHpNDsZLKXAU0mdmbe5YJCbkmGB6+AmMysq2aYeZMOPpRy0c0/c= ceph-48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:57:06.724 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-01T00:57:07.289 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T00:57:07.295 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:06 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/657737931' entity='client.admin' 2023-12-01T00:57:08.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.735+0000 7fcb091a3700 1 -- 172.21.15.26:0/1415900816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb04101350 msgr2=0x7fcb04103740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:08.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.735+0000 7fcb091a3700 1 --2- 172.21.15.26:0/1415900816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb04101350 0x7fcb04103740 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009910 tx=0x7fcaf4009c20 comp rx=0 tx=0).stop 2023-12-01T00:57:08.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.736+0000 7fcb091a3700 1 -- 172.21.15.26:0/1415900816 shutdown_connections 2023-12-01T00:57:08.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.736+0000 7fcb091a3700 1 --2- 172.21.15.26:0/1415900816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb04101350 0x7fcb04103740 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:08.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.736+0000 7fcb091a3700 1 -- 172.21.15.26:0/1415900816 >> 172.21.15.26:0/1415900816 conn(0x7fcb040fad20 msgr2=0x7fcb040fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:08.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.736+0000 7fcb091a3700 1 -- 172.21.15.26:0/1415900816 shutdown_connections 2023-12-01T00:57:08.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.736+0000 7fcb091a3700 1 -- 172.21.15.26:0/1415900816 wait complete. 2023-12-01T00:57:08.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.736+0000 7fcb091a3700 1 Processor -- start 2023-12-01T00:57:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.737+0000 7fcb091a3700 1 -- start start 2023-12-01T00:57:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.737+0000 7fcb091a3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb04101350 0x7fcb04195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.737+0000 7fcb091a3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb04195f80 con 0x7fcb04101350 2023-12-01T00:57:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.737+0000 7fcb02d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb04101350 0x7fcb04195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.737+0000 7fcb02d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb04101350 0x7fcb04195a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52500/0 (socket says 172.21.15.26:52500) 2023-12-01T00:57:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.737+0000 7fcb02d9d700 1 -- 172.21.15.26:0/1104418920 learned_addr learned my addr 172.21.15.26:0/1104418920 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:08.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.737+0000 7fcb02d9d700 1 -- 172.21.15.26:0/1104418920 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf40095f0 con 0x7fcb04101350 2023-12-01T00:57:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.737+0000 7fcb02d9d700 1 --2- 172.21.15.26:0/1104418920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb04101350 0x7fcb04195a40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4006010 tx=0x7fcaf4004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.737+0000 7fcb00d99700 1 -- 172.21.15.26:0/1104418920 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcaf401d070 con 0x7fcb04101350 2023-12-01T00:57:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.737+0000 7fcb091a3700 1 -- 172.21.15.26:0/1104418920 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb04196180 con 0x7fcb04101350 2023-12-01T00:57:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.737+0000 7fcb00d99700 1 -- 172.21.15.26:0/1104418920 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcaf4004500 con 0x7fcb04101350 2023-12-01T00:57:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.737+0000 7fcb00d99700 1 -- 172.21.15.26:0/1104418920 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcaf4003b10 con 0x7fcb04101350 2023-12-01T00:57:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.738+0000 7fcb091a3700 1 -- 172.21.15.26:0/1104418920 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb041965c0 con 0x7fcb04101350 2023-12-01T00:57:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.738+0000 7fcb00d99700 1 -- 172.21.15.26:0/1104418920 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 45324+0+0 (secure 0 0 0) 0x7fcaf400f460 con 0x7fcb04101350 2023-12-01T00:57:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.738+0000 7fcb091a3700 1 -- 172.21.15.26:0/1104418920 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0418f4d0 con 0x7fcb04101350 2023-12-01T00:57:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.739+0000 7fcb00d99700 1 --2- 172.21.15.26:0/1104418920 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcaf00383f0 0x7fcaf003a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:08.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.739+0000 7fcb00d99700 1 -- 172.21.15.26:0/1104418920 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcaf404c310 con 0x7fcb04101350 2023-12-01T00:57:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.739+0000 7fcafa59c700 1 --2- 172.21.15.26:0/1104418920 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcaf00383f0 0x7fcaf003a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:08.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.739+0000 7fcafa59c700 1 --2- 172.21.15.26:0/1104418920 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcaf00383f0 0x7fcaf003a8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcaec006fd0 tx=0x7fcaec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:08.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.743+0000 7fcb00d99700 1 -- 172.21.15.26:0/1104418920 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fcaf4020960 con 0x7fcb04101350 2023-12-01T00:57:08.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.946+0000 7fcb091a3700 1 -- 172.21.15.26:0/1104418920 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fcb0402cc70 con 0x7fcb04101350 2023-12-01T00:57:08.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.949+0000 7fcb00d99700 1 -- 172.21.15.26:0/1104418920 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fcaf4020370 con 0x7fcb04101350 2023-12-01T00:57:08.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.952+0000 7fcb091a3700 1 -- 172.21.15.26:0/1104418920 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcaf00383f0 msgr2=0x7fcaf003a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:08.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.952+0000 7fcb091a3700 1 --2- 172.21.15.26:0/1104418920 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcaf00383f0 0x7fcaf003a8b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcaec006fd0 tx=0x7fcaec006e40 comp rx=0 tx=0).stop 2023-12-01T00:57:08.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.952+0000 7fcb091a3700 1 -- 172.21.15.26:0/1104418920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb04101350 msgr2=0x7fcb04195a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:08.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.952+0000 7fcb091a3700 1 --2- 172.21.15.26:0/1104418920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb04101350 0x7fcb04195a40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4006010 tx=0x7fcaf4004ff0 comp rx=0 tx=0).stop 2023-12-01T00:57:08.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.952+0000 7fcb091a3700 1 -- 172.21.15.26:0/1104418920 shutdown_connections 2023-12-01T00:57:08.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.952+0000 7fcb091a3700 1 --2- 172.21.15.26:0/1104418920 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcaf00383f0 0x7fcaf003a8b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:08.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.952+0000 7fcb091a3700 1 --2- 172.21.15.26:0/1104418920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb04101350 0x7fcb04195a40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:08.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.952+0000 7fcb091a3700 1 -- 172.21.15.26:0/1104418920 >> 172.21.15.26:0/1104418920 conn(0x7fcb040fad20 msgr2=0x7fcb040fba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:08.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.952+0000 7fcb091a3700 1 -- 172.21.15.26:0/1104418920 shutdown_connections 2023-12-01T00:57:08.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:08.952+0000 7fcb091a3700 1 -- 172.21.15.26:0/1104418920 wait complete. 2023-12-01T00:57:09.369 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-01T00:57:09.370 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-01T00:57:10.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:09 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1104418920' entity='client.admin' 2023-12-01T00:57:10.142 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T00:57:11.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.391+0000 7f5f68e8a700 1 -- 172.21.15.26:0/1803333819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f64101370 msgr2=0x7f5f64103760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:11.395 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.391+0000 7f5f68e8a700 1 --2- 172.21.15.26:0/1803333819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f64101370 0x7f5f64103760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009910 tx=0x7f5f54009c20 comp rx=0 tx=0).stop 2023-12-01T00:57:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.391+0000 7f5f68e8a700 1 -- 172.21.15.26:0/1803333819 shutdown_connections 2023-12-01T00:57:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.391+0000 7f5f68e8a700 1 --2- 172.21.15.26:0/1803333819 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f64101370 0x7f5f64103760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.391+0000 7f5f68e8a700 1 -- 172.21.15.26:0/1803333819 >> 172.21.15.26:0/1803333819 conn(0x7f5f640fad20 msgr2=0x7f5f640fd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.391+0000 7f5f68e8a700 1 -- 172.21.15.26:0/1803333819 shutdown_connections 2023-12-01T00:57:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.391+0000 7f5f68e8a700 1 -- 172.21.15.26:0/1803333819 wait complete. 2023-12-01T00:57:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.392+0000 7f5f68e8a700 1 Processor -- start 2023-12-01T00:57:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.392+0000 7f5f68e8a700 1 -- start start 2023-12-01T00:57:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.392+0000 7f5f68e8a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f64101370 0x7f5f64197c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.392+0000 7f5f68e8a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f64198190 con 0x7f5f64101370 2023-12-01T00:57:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.392+0000 7f5f6259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f64101370 0x7f5f64197c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.393+0000 7f5f6259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f64101370 0x7f5f64197c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52506/0 (socket says 172.21.15.26:52506) 2023-12-01T00:57:11.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.393+0000 7f5f6259c700 1 -- 172.21.15.26:0/4287697861 learned_addr learned my addr 172.21.15.26:0/4287697861 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.393+0000 7f5f6259c700 1 -- 172.21.15.26:0/4287697861 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f540095f0 con 0x7f5f64101370 2023-12-01T00:57:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.393+0000 7f5f6259c700 1 --2- 172.21.15.26:0/4287697861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f64101370 0x7f5f64197c50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f54006010 tx=0x7f5f54004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.393+0000 7f5f5b7fe700 1 -- 172.21.15.26:0/4287697861 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f5401d070 con 0x7f5f64101370 2023-12-01T00:57:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.393+0000 7f5f5b7fe700 1 -- 172.21.15.26:0/4287697861 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5f54004500 con 0x7f5f64101370 2023-12-01T00:57:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.393+0000 7f5f68e8a700 1 -- 172.21.15.26:0/4287697861 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f64198390 con 0x7f5f64101370 2023-12-01T00:57:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.393+0000 7f5f5b7fe700 1 -- 172.21.15.26:0/4287697861 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5f54003b10 con 0x7f5f64101370 2023-12-01T00:57:11.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.393+0000 7f5f68e8a700 1 -- 172.21.15.26:0/4287697861 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f641987d0 con 0x7f5f64101370 2023-12-01T00:57:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.394+0000 7f5f5b7fe700 1 -- 172.21.15.26:0/4287697861 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 45324+0+0 (secure 0 0 0) 0x7f5f5400f460 con 0x7f5f64101370 2023-12-01T00:57:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.394+0000 7f5f68e8a700 1 -- 172.21.15.26:0/4287697861 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f641918d0 con 0x7f5f64101370 2023-12-01T00:57:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.394+0000 7f5f5b7fe700 1 --2- 172.21.15.26:0/4287697861 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5f500383a0 0x7f5f5003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.394+0000 7f5f5b7fe700 1 -- 172.21.15.26:0/4287697861 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5f5404c260 con 0x7f5f64101370 2023-12-01T00:57:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.394+0000 7f5f61d9b700 1 --2- 172.21.15.26:0/4287697861 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5f500383a0 0x7f5f5003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:11.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.395+0000 7f5f61d9b700 1 --2- 172.21.15.26:0/4287697861 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5f500383a0 0x7f5f5003a860 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c006fd0 tx=0x7f5f4c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:11.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.399+0000 7f5f5b7fe700 1 -- 172.21.15.26:0/4287697861 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5f54020550 con 0x7f5f64101370 2023-12-01T00:57:11.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:11 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:11.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:11 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:11.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:11 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi026", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:57:11.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:11 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:11.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:11 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:11.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:11 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:11.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.603+0000 7f5f68e8a700 1 -- 172.21.15.26:0/4287697861 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f64061260 con 0x7f5f500383a0 2023-12-01T00:57:11.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.606+0000 7f5f5b7fe700 1 -- 172.21.15.26:0/4287697861 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f5f64061260 con 0x7f5f500383a0 2023-12-01T00:57:11.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.608+0000 7f5f68e8a700 1 -- 172.21.15.26:0/4287697861 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5f500383a0 msgr2=0x7f5f5003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:11.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.608+0000 7f5f68e8a700 1 --2- 172.21.15.26:0/4287697861 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5f500383a0 0x7f5f5003a860 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c006fd0 tx=0x7f5f4c006e40 comp rx=0 tx=0).stop 2023-12-01T00:57:11.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.608+0000 7f5f68e8a700 1 -- 172.21.15.26:0/4287697861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f64101370 msgr2=0x7f5f64197c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:11.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.608+0000 7f5f68e8a700 1 --2- 172.21.15.26:0/4287697861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f64101370 0x7f5f64197c50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5f54006010 tx=0x7f5f54004ff0 comp rx=0 tx=0).stop 2023-12-01T00:57:11.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.608+0000 7f5f68e8a700 1 -- 172.21.15.26:0/4287697861 shutdown_connections 2023-12-01T00:57:11.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.608+0000 7f5f68e8a700 1 --2- 172.21.15.26:0/4287697861 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5f500383a0 0x7f5f5003a860 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:11.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.608+0000 7f5f68e8a700 1 --2- 172.21.15.26:0/4287697861 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5f64101370 0x7f5f64197c50 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:11.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.608+0000 7f5f68e8a700 1 -- 172.21.15.26:0/4287697861 >> 172.21.15.26:0/4287697861 conn(0x7f5f640fad20 msgr2=0x7f5f640fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:11.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.608+0000 7f5f68e8a700 1 -- 172.21.15.26:0/4287697861 shutdown_connections 2023-12-01T00:57:11.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:11.608+0000 7f5f68e8a700 1 -- 172.21.15.26:0/4287697861 wait complete. 2023-12-01T00:57:12.110 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi093 2023-12-01T00:57:12.111 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-01T00:57:12.111 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/etc/ceph/ceph.conf 2023-12-01T00:57:12.131 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-01T00:57:12.132 DEBUG:teuthology.orchestra.run.smithi093:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-01T00:57:12.191 INFO:tasks.cephadm:Adding host smithi093 to orchestrator... 2023-12-01T00:57:12.192 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch host add smithi093 2023-12-01T00:57:12.764 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T00:57:12.977 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:12 smithi026 ceph-mon[98801]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:57:12.977 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:12 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:12.977 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:12 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:12.977 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:12 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:12.977 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:12 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:57:12.977 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:12 smithi026 ceph-mon[98801]: Updating smithi026:/etc/ceph/ceph.conf 2023-12-01T00:57:13.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.929+0000 7f7c5c17f700 1 -- 172.21.15.26:0/1979914051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c54105780 msgr2=0x7f7c54105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:13.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.929+0000 7f7c5c17f700 1 --2- 172.21.15.26:0/1979914051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c54105780 0x7f7c54105b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009910 tx=0x7f7c44009c20 comp rx=0 tx=0).stop 2023-12-01T00:57:13.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.929+0000 7f7c5c17f700 1 -- 172.21.15.26:0/1979914051 shutdown_connections 2023-12-01T00:57:13.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.929+0000 7f7c5c17f700 1 --2- 172.21.15.26:0/1979914051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c54105780 0x7f7c54105b60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:13.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.929+0000 7f7c5c17f700 1 -- 172.21.15.26:0/1979914051 >> 172.21.15.26:0/1979914051 conn(0x7f7c54075290 msgr2=0x7f7c540756a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:13.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.929+0000 7f7c5c17f700 1 -- 172.21.15.26:0/1979914051 shutdown_connections 2023-12-01T00:57:13.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.929+0000 7f7c5c17f700 1 -- 172.21.15.26:0/1979914051 wait complete. 2023-12-01T00:57:13.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.930+0000 7f7c5c17f700 1 Processor -- start 2023-12-01T00:57:13.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.930+0000 7f7c5c17f700 1 -- start start 2023-12-01T00:57:13.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.930+0000 7f7c5c17f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c54105780 0x7f7c540fc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:13.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.930+0000 7f7c5c17f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c540fe760 con 0x7f7c54105780 2023-12-01T00:57:13.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.930+0000 7f7c59f1b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c54105780 0x7f7c540fc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:13.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.930+0000 7f7c59f1b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c54105780 0x7f7c540fc7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52512/0 (socket says 172.21.15.26:52512) 2023-12-01T00:57:13.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.930+0000 7f7c59f1b700 1 -- 172.21.15.26:0/1960905559 learned_addr learned my addr 172.21.15.26:0/1960905559 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:13.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.931+0000 7f7c59f1b700 1 -- 172.21.15.26:0/1960905559 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c440095f0 con 0x7f7c54105780 2023-12-01T00:57:13.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.931+0000 7f7c59f1b700 1 --2- 172.21.15.26:0/1960905559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c54105780 0x7f7c540fc7e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c44005b40 tx=0x7f7c44005010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.931+0000 7f7c4affd700 1 -- 172.21.15.26:0/1960905559 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c4401d070 con 0x7f7c54105780 2023-12-01T00:57:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.931+0000 7f7c4affd700 1 -- 172.21.15.26:0/1960905559 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7c44004500 con 0x7f7c54105780 2023-12-01T00:57:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.931+0000 7f7c5c17f700 1 -- 172.21.15.26:0/1960905559 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c540fcd20 con 0x7f7c54105780 2023-12-01T00:57:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.931+0000 7f7c4affd700 1 -- 172.21.15.26:0/1960905559 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7c44003ac0 con 0x7f7c54105780 2023-12-01T00:57:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.931+0000 7f7c5c17f700 1 -- 172.21.15.26:0/1960905559 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c540fd1a0 con 0x7f7c54105780 2023-12-01T00:57:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.932+0000 7f7c4affd700 1 -- 172.21.15.26:0/1960905559 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 45324+0+0 (secure 0 0 0) 0x7f7c44003d80 con 0x7f7c54105780 2023-12-01T00:57:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.932+0000 7f7c5c17f700 1 -- 172.21.15.26:0/1960905559 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c540623c0 con 0x7f7c54105780 2023-12-01T00:57:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.932+0000 7f7c4affd700 1 --2- 172.21.15.26:0/1960905559 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7c400383a0 0x7f7c4003a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.932+0000 7f7c4affd700 1 -- 172.21.15.26:0/1960905559 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7c4404c1a0 con 0x7f7c54105780 2023-12-01T00:57:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.932+0000 7f7c5971a700 1 --2- 172.21.15.26:0/1960905559 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7c400383a0 0x7f7c4003a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:13.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.933+0000 7f7c5971a700 1 --2- 172.21.15.26:0/1960905559 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7c400383a0 0x7f7c4003a860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7c50006fd0 tx=0x7f7c50006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:13.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:13.937+0000 7f7c4affd700 1 -- 172.21.15.26:0/1960905559 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7c4402a540 con 0x7f7c54105780 2023-12-01T00:57:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:13 smithi026 ceph-mon[98801]: Updating smithi026:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:13 smithi026 ceph-mon[98801]: Updating smithi026:/etc/ceph/ceph.client.admin.keyring 2023-12-01T00:57:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:13 smithi026 ceph-mon[98801]: Updating smithi026:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-01T00:57:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:13 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:13 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:13 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:14.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:14.141+0000 7f7c5c17f700 1 -- 172.21.15.26:0/1960905559 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi093", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c540fd5b0 con 0x7f7c400383a0 2023-12-01T00:57:15.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:15 smithi026 ceph-mon[98801]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi093", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:57:16.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:16 smithi026 ceph-mon[98801]: Deploying cephadm binary to smithi093 2023-12-01T00:57:17.201 INFO:teuthology.orchestra.run.smithi026.stdout:Added host 'smithi093' with addr '172.21.15.93' 2023-12-01T00:57:17.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:17.199+0000 7f7c4affd700 1 -- 172.21.15.26:0/1960905559 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f7c540fd5b0 con 0x7f7c400383a0 2023-12-01T00:57:17.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:17.202+0000 7f7c5c17f700 1 -- 172.21.15.26:0/1960905559 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7c400383a0 msgr2=0x7f7c4003a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:17.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:17.202+0000 7f7c5c17f700 1 --2- 172.21.15.26:0/1960905559 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7c400383a0 0x7f7c4003a860 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7c50006fd0 tx=0x7f7c50006e40 comp rx=0 tx=0).stop 2023-12-01T00:57:17.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:17.202+0000 7f7c5c17f700 1 -- 172.21.15.26:0/1960905559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c54105780 msgr2=0x7f7c540fc7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:17.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:17.202+0000 7f7c5c17f700 1 --2- 172.21.15.26:0/1960905559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c54105780 0x7f7c540fc7e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c44005b40 tx=0x7f7c44005010 comp rx=0 tx=0).stop 2023-12-01T00:57:17.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:17.202+0000 7f7c5c17f700 1 -- 172.21.15.26:0/1960905559 shutdown_connections 2023-12-01T00:57:17.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:17.202+0000 7f7c5c17f700 1 --2- 172.21.15.26:0/1960905559 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7c400383a0 0x7f7c4003a860 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:17.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:17.202+0000 7f7c5c17f700 1 --2- 172.21.15.26:0/1960905559 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c54105780 0x7f7c540fc7e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:17.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:17.202+0000 7f7c5c17f700 1 -- 172.21.15.26:0/1960905559 >> 172.21.15.26:0/1960905559 conn(0x7f7c54075290 msgr2=0x7f7c54067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:17.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:17.202+0000 7f7c5c17f700 1 -- 172.21.15.26:0/1960905559 shutdown_connections 2023-12-01T00:57:17.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:17.202+0000 7f7c5c17f700 1 -- 172.21.15.26:0/1960905559 wait complete. 2023-12-01T00:57:17.619 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch host ls --format=json 2023-12-01T00:57:18.181 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T00:57:18.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:18 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:18.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:18 smithi026 ceph-mon[98801]: Added host smithi093 2023-12-01T00:57:18.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:18 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:18.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:18 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:19.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.450+0000 7fca06076700 1 -- 172.21.15.26:0/1371204833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca00106820 msgr2=0x7fca00106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:19.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.450+0000 7fca06076700 1 --2- 172.21.15.26:0/1371204833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca00106820 0x7fca00106c00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009910 tx=0x7fc9f0009c20 comp rx=0 tx=0).stop 2023-12-01T00:57:19.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.450+0000 7fca06076700 1 -- 172.21.15.26:0/1371204833 shutdown_connections 2023-12-01T00:57:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.450+0000 7fca06076700 1 --2- 172.21.15.26:0/1371204833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca00106820 0x7fca00106c00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.450+0000 7fca06076700 1 -- 172.21.15.26:0/1371204833 >> 172.21.15.26:0/1371204833 conn(0x7fca00075290 msgr2=0x7fca000756a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.450+0000 7fca06076700 1 -- 172.21.15.26:0/1371204833 shutdown_connections 2023-12-01T00:57:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.450+0000 7fca06076700 1 -- 172.21.15.26:0/1371204833 wait complete. 2023-12-01T00:57:19.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.450+0000 7fca06076700 1 Processor -- start 2023-12-01T00:57:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.451+0000 7fca06076700 1 -- start start 2023-12-01T00:57:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.451+0000 7fca06076700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca00106820 0x7fca00195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.451+0000 7fca06076700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca001962d0 con 0x7fca00106820 2023-12-01T00:57:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.451+0000 7fc9ff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca00106820 0x7fca00195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:19.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.451+0000 7fc9ff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca00106820 0x7fca00195d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52538/0 (socket says 172.21.15.26:52538) 2023-12-01T00:57:19.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.451+0000 7fc9ff7fe700 1 -- 172.21.15.26:0/2792312646 learned_addr learned my addr 172.21.15.26:0/2792312646 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:19.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.451+0000 7fc9ff7fe700 1 -- 172.21.15.26:0/2792312646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f00095f0 con 0x7fca00106820 2023-12-01T00:57:19.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.451+0000 7fc9ff7fe700 1 --2- 172.21.15.26:0/2792312646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca00106820 0x7fca00195d90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0005f50 tx=0x7fc9f0004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:19.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.452+0000 7fc9fcff9700 1 -- 172.21.15.26:0/2792312646 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9f001d070 con 0x7fca00106820 2023-12-01T00:57:19.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.452+0000 7fc9fcff9700 1 -- 172.21.15.26:0/2792312646 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc9f000bbd0 con 0x7fca00106820 2023-12-01T00:57:19.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.452+0000 7fca06076700 1 -- 172.21.15.26:0/2792312646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca00196530 con 0x7fca00106820 2023-12-01T00:57:19.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.452+0000 7fc9fcff9700 1 -- 172.21.15.26:0/2792312646 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9f0003a40 con 0x7fca00106820 2023-12-01T00:57:19.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.452+0000 7fca06076700 1 -- 172.21.15.26:0/2792312646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca001969b0 con 0x7fca00106820 2023-12-01T00:57:19.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.452+0000 7fc9fcff9700 1 -- 172.21.15.26:0/2792312646 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 45324+0+0 (secure 0 0 0) 0x7fc9f0003ba0 con 0x7fca00106820 2023-12-01T00:57:19.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.453+0000 7fc9fcff9700 1 --2- 172.21.15.26:0/2792312646 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc9ec0383f0 0x7fc9ec03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:19.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.453+0000 7fc9fcff9700 1 -- 172.21.15.26:0/2792312646 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc9f004cf50 con 0x7fca00106820 2023-12-01T00:57:19.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.453+0000 7fc9feffd700 1 --2- 172.21.15.26:0/2792312646 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc9ec0383f0 0x7fc9ec03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:19.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.453+0000 7fca06076700 1 -- 172.21.15.26:0/2792312646 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca000623c0 con 0x7fca00106820 2023-12-01T00:57:19.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.453+0000 7fc9feffd700 1 --2- 172.21.15.26:0/2792312646 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc9ec0383f0 0x7fc9ec03a8b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8006fd0 tx=0x7fc9e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:19.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.458+0000 7fc9fcff9700 1 -- 172.21.15.26:0/2792312646 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc9f0026020 con 0x7fca00106820 2023-12-01T00:57:19.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:19 smithi026 ceph-mon[98801]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:19.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:19 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:19.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.663+0000 7fca06076700 1 -- 172.21.15.26:0/2792312646 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca0019a740 con 0x7fc9ec0383f0 2023-12-01T00:57:19.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.664+0000 7fc9fcff9700 1 -- 172.21.15.26:0/2792312646 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7fca0019a740 con 0x7fc9ec0383f0 2023-12-01T00:57:19.666 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:57:19.666 INFO:teuthology.orchestra.run.smithi026.stdout:[{"addr": "172.21.15.26", "hostname": "smithi026", "labels": [], "status": ""}, {"addr": "172.21.15.93", "hostname": "smithi093", "labels": [], "status": ""}] 2023-12-01T00:57:19.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.666+0000 7fca06076700 1 -- 172.21.15.26:0/2792312646 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc9ec0383f0 msgr2=0x7fc9ec03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:19.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.666+0000 7fca06076700 1 --2- 172.21.15.26:0/2792312646 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc9ec0383f0 0x7fc9ec03a8b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8006fd0 tx=0x7fc9e8006e40 comp rx=0 tx=0).stop 2023-12-01T00:57:19.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.666+0000 7fca06076700 1 -- 172.21.15.26:0/2792312646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca00106820 msgr2=0x7fca00195d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:19.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.666+0000 7fca06076700 1 --2- 172.21.15.26:0/2792312646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca00106820 0x7fca00195d90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0005f50 tx=0x7fc9f0004ff0 comp rx=0 tx=0).stop 2023-12-01T00:57:19.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.666+0000 7fca06076700 1 -- 172.21.15.26:0/2792312646 shutdown_connections 2023-12-01T00:57:19.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.666+0000 7fca06076700 1 --2- 172.21.15.26:0/2792312646 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc9ec0383f0 0x7fc9ec03a8b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:19.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.666+0000 7fca06076700 1 --2- 172.21.15.26:0/2792312646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca00106820 0x7fca00195d90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:19.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.666+0000 7fca06076700 1 -- 172.21.15.26:0/2792312646 >> 172.21.15.26:0/2792312646 conn(0x7fca00075290 msgr2=0x7fca000fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:19.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.666+0000 7fca06076700 1 -- 172.21.15.26:0/2792312646 shutdown_connections 2023-12-01T00:57:19.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:19.666+0000 7fca06076700 1 -- 172.21.15.26:0/2792312646 wait complete. 2023-12-01T00:57:20.028 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi116 2023-12-01T00:57:20.028 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-12-01T00:57:20.028 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/etc/ceph/ceph.conf 2023-12-01T00:57:20.049 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-12-01T00:57:20.049 DEBUG:teuthology.orchestra.run.smithi116:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-01T00:57:20.109 INFO:tasks.cephadm:Adding host smithi116 to orchestrator... 2023-12-01T00:57:20.109 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch host add smithi116 2023-12-01T00:57:20.666 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T00:57:20.869 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:20 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:20.869 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:20 smithi026 ceph-mon[98801]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T00:57:21.894 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.892+0000 7fd5309e0700 1 -- 172.21.15.26:0/1355623265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c106820 msgr2=0x7fd52c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:21.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.892+0000 7fd5309e0700 1 --2- 172.21.15.26:0/1355623265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c106820 0x7fd52c106c00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009910 tx=0x7fd51c009c20 comp rx=0 tx=0).stop 2023-12-01T00:57:21.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.892+0000 7fd5309e0700 1 -- 172.21.15.26:0/1355623265 shutdown_connections 2023-12-01T00:57:21.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.892+0000 7fd5309e0700 1 --2- 172.21.15.26:0/1355623265 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c106820 0x7fd52c106c00 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:21.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.892+0000 7fd5309e0700 1 -- 172.21.15.26:0/1355623265 >> 172.21.15.26:0/1355623265 conn(0x7fd52c075290 msgr2=0x7fd52c0756a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:21.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.892+0000 7fd5309e0700 1 -- 172.21.15.26:0/1355623265 shutdown_connections 2023-12-01T00:57:21.895 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.892+0000 7fd5309e0700 1 -- 172.21.15.26:0/1355623265 wait complete. 2023-12-01T00:57:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.893+0000 7fd5309e0700 1 Processor -- start 2023-12-01T00:57:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.893+0000 7fd5309e0700 1 -- start start 2023-12-01T00:57:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.893+0000 7fd5309e0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c106820 0x7fd52c195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.893+0000 7fd5309e0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52c1962d0 con 0x7fd52c106820 2023-12-01T00:57:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.893+0000 7fd52a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c106820 0x7fd52c195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.893+0000 7fd52a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c106820 0x7fd52c195d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52544/0 (socket says 172.21.15.26:52544) 2023-12-01T00:57:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.893+0000 7fd52a59c700 1 -- 172.21.15.26:0/3513649739 learned_addr learned my addr 172.21.15.26:0/3513649739 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.894+0000 7fd52a59c700 1 -- 172.21.15.26:0/3513649739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c0095f0 con 0x7fd52c106820 2023-12-01T00:57:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.894+0000 7fd52a59c700 1 --2- 172.21.15.26:0/3513649739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c106820 0x7fd52c195d90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd51c005850 tx=0x7fd51c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.894+0000 7fd51b7fe700 1 -- 172.21.15.26:0/3513649739 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd51c01d070 con 0x7fd52c106820 2023-12-01T00:57:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.894+0000 7fd51b7fe700 1 -- 172.21.15.26:0/3513649739 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd51c004500 con 0x7fd52c106820 2023-12-01T00:57:21.897 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.894+0000 7fd5309e0700 1 -- 172.21.15.26:0/3513649739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52c1964d0 con 0x7fd52c106820 2023-12-01T00:57:21.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.894+0000 7fd51b7fe700 1 -- 172.21.15.26:0/3513649739 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd51c0039f0 con 0x7fd52c106820 2023-12-01T00:57:21.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.894+0000 7fd5309e0700 1 -- 172.21.15.26:0/3513649739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52c196950 con 0x7fd52c106820 2023-12-01T00:57:21.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.895+0000 7fd5309e0700 1 -- 172.21.15.26:0/3513649739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd52c0623c0 con 0x7fd52c106820 2023-12-01T00:57:21.898 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.895+0000 7fd51b7fe700 1 -- 172.21.15.26:0/3513649739 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 45324+0+0 (secure 0 0 0) 0x7fd51c00b960 con 0x7fd52c106820 2023-12-01T00:57:21.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.896+0000 7fd51b7fe700 1 --2- 172.21.15.26:0/3513649739 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd5140383f0 0x7fd51403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:21.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.896+0000 7fd51b7fe700 1 -- 172.21.15.26:0/3513649739 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd51c04c5a0 con 0x7fd52c106820 2023-12-01T00:57:21.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.896+0000 7fd529d9b700 1 --2- 172.21.15.26:0/3513649739 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd5140383f0 0x7fd51403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:21.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.896+0000 7fd529d9b700 1 --2- 172.21.15.26:0/3513649739 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd5140383f0 0x7fd51403a8b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd520006fd0 tx=0x7fd520006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:21.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:21.900+0000 7fd51b7fe700 1 -- 172.21.15.26:0/3513649739 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd51c02b7a0 con 0x7fd52c106820 2023-12-01T00:57:22.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:21 smithi026 ceph-mon[98801]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:22.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:22.105+0000 7fd5309e0700 1 -- 172.21.15.26:0/3513649739 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi116", "target": ["mon-mgr", ""]}) v1 -- 0x7fd52c105640 con 0x7fd5140383f0 2023-12-01T00:57:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:23 smithi026 ceph-mon[98801]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:23 smithi026 ceph-mon[98801]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi116", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:57:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi093", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:57:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:57:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:23 smithi026 ceph-mon[98801]: Updating smithi093:/etc/ceph/ceph.conf 2023-12-01T00:57:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:23 smithi026 ceph-mon[98801]: Deploying cephadm binary to smithi116 2023-12-01T00:57:23.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:23 smithi026 ceph-mon[98801]: Updating smithi093:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:24 smithi026 ceph-mon[98801]: Updating smithi093:/etc/ceph/ceph.client.admin.keyring 2023-12-01T00:57:24.912 INFO:teuthology.orchestra.run.smithi026.stdout:Added host 'smithi116' with addr '172.21.15.116' 2023-12-01T00:57:24.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:24.911+0000 7fd51b7fe700 1 -- 172.21.15.26:0/3513649739 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd52c105640 con 0x7fd5140383f0 2023-12-01T00:57:24.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:24.913+0000 7fd5309e0700 1 -- 172.21.15.26:0/3513649739 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd5140383f0 msgr2=0x7fd51403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:24.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:24.913+0000 7fd5309e0700 1 --2- 172.21.15.26:0/3513649739 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd5140383f0 0x7fd51403a8b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd520006fd0 tx=0x7fd520006e40 comp rx=0 tx=0).stop 2023-12-01T00:57:24.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:24.913+0000 7fd5309e0700 1 -- 172.21.15.26:0/3513649739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c106820 msgr2=0x7fd52c195d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:24.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:24.913+0000 7fd5309e0700 1 --2- 172.21.15.26:0/3513649739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c106820 0x7fd52c195d90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd51c005850 tx=0x7fd51c004ff0 comp rx=0 tx=0).stop 2023-12-01T00:57:24.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:24.913+0000 7fd5309e0700 1 -- 172.21.15.26:0/3513649739 shutdown_connections 2023-12-01T00:57:24.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:24.913+0000 7fd5309e0700 1 --2- 172.21.15.26:0/3513649739 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd5140383f0 0x7fd51403a8b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:24.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:24.913+0000 7fd5309e0700 1 --2- 172.21.15.26:0/3513649739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd52c106820 0x7fd52c195d90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:24.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:24.913+0000 7fd5309e0700 1 -- 172.21.15.26:0/3513649739 >> 172.21.15.26:0/3513649739 conn(0x7fd52c075290 msgr2=0x7fd52c0fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:24.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:24.913+0000 7fd5309e0700 1 -- 172.21.15.26:0/3513649739 shutdown_connections 2023-12-01T00:57:24.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:24.914+0000 7fd5309e0700 1 -- 172.21.15.26:0/3513649739 wait complete. 2023-12-01T00:57:25.332 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch host ls --format=json 2023-12-01T00:57:25.891 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T00:57:26.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:25 smithi026 ceph-mon[98801]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:26.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:25 smithi026 ceph-mon[98801]: Updating smithi093:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-01T00:57:26.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:26.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:26.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:26.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:26.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:26.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:26.904 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:26 smithi026 ceph-mon[98801]: Added host smithi116 2023-12-01T00:57:26.904 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:26 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:27.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.083+0000 7f81d01f1700 1 -- 172.21.15.26:0/94114743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81c8105780 msgr2=0x7f81c8105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:27.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.083+0000 7f81d01f1700 1 --2- 172.21.15.26:0/94114743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81c8105780 0x7f81c8105b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009910 tx=0x7f81c4009c20 comp rx=0 tx=0).stop 2023-12-01T00:57:27.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.083+0000 7f81d01f1700 1 -- 172.21.15.26:0/94114743 shutdown_connections 2023-12-01T00:57:27.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.083+0000 7f81d01f1700 1 --2- 172.21.15.26:0/94114743 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81c8105780 0x7f81c8105b60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:27.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.083+0000 7f81d01f1700 1 -- 172.21.15.26:0/94114743 >> 172.21.15.26:0/94114743 conn(0x7f81c8075290 msgr2=0x7f81c80756a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:27.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.083+0000 7f81d01f1700 1 -- 172.21.15.26:0/94114743 shutdown_connections 2023-12-01T00:57:27.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.083+0000 7f81d01f1700 1 -- 172.21.15.26:0/94114743 wait complete. 2023-12-01T00:57:27.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.084+0000 7f81d01f1700 1 Processor -- start 2023-12-01T00:57:27.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.084+0000 7f81d01f1700 1 -- start start 2023-12-01T00:57:27.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.084+0000 7f81d01f1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81c8105780 0x7f81c8196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:27.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.084+0000 7f81d01f1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8197230 con 0x7f81c8105780 2023-12-01T00:57:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.084+0000 7f81cdf8d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81c8105780 0x7f81c8196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.084+0000 7f81cdf8d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81c8105780 0x7f81c8196cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52570/0 (socket says 172.21.15.26:52570) 2023-12-01T00:57:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.084+0000 7f81cdf8d700 1 -- 172.21.15.26:0/2473395496 learned_addr learned my addr 172.21.15.26:0/2473395496 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.084+0000 7f81cdf8d700 1 -- 172.21.15.26:0/2473395496 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c40095f0 con 0x7f81c8105780 2023-12-01T00:57:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.084+0000 7f81cdf8d700 1 --2- 172.21.15.26:0/2473395496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81c8105780 0x7f81c8196cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f81c40092e0 tx=0x7f81c4005010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.084+0000 7f81beffd700 1 -- 172.21.15.26:0/2473395496 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81c401d070 con 0x7f81c8105780 2023-12-01T00:57:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.085+0000 7f81beffd700 1 -- 172.21.15.26:0/2473395496 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f81c400bc30 con 0x7f81c8105780 2023-12-01T00:57:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.085+0000 7f81d01f1700 1 -- 172.21.15.26:0/2473395496 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c8197430 con 0x7f81c8105780 2023-12-01T00:57:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.085+0000 7f81beffd700 1 -- 172.21.15.26:0/2473395496 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81c40039e0 con 0x7f81c8105780 2023-12-01T00:57:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.085+0000 7f81d01f1700 1 -- 172.21.15.26:0/2473395496 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c8197850 con 0x7f81c8105780 2023-12-01T00:57:27.088 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.085+0000 7f81beffd700 1 -- 172.21.15.26:0/2473395496 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 45324+0+0 (secure 0 0 0) 0x7f81c4003c50 con 0x7f81c8105780 2023-12-01T00:57:27.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.085+0000 7f81d01f1700 1 -- 172.21.15.26:0/2473395496 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c81039c0 con 0x7f81c8105780 2023-12-01T00:57:27.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.086+0000 7f81beffd700 1 --2- 172.21.15.26:0/2473395496 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81b40383f0 0x7f81b403a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:27.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.086+0000 7f81beffd700 1 -- 172.21.15.26:0/2473395496 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f81c404c030 con 0x7f81c8105780 2023-12-01T00:57:27.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.086+0000 7f81cd78c700 1 --2- 172.21.15.26:0/2473395496 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81b40383f0 0x7f81b403a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:27.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.086+0000 7f81cd78c700 1 --2- 172.21.15.26:0/2473395496 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81b40383f0 0x7f81b403a8b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f81b8006fd0 tx=0x7f81b8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:27.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.090+0000 7f81beffd700 1 -- 172.21.15.26:0/2473395496 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f81c407f0e0 con 0x7f81c8105780 2023-12-01T00:57:27.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.295+0000 7f81d01f1700 1 -- 172.21.15.26:0/2473395496 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81c80685f0 con 0x7f81b40383f0 2023-12-01T00:57:27.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.297+0000 7f81beffd700 1 -- 172.21.15.26:0/2473395496 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+239 (secure 0 0 0) 0x7f81c80685f0 con 0x7f81b40383f0 2023-12-01T00:57:27.298 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T00:57:27.298 INFO:teuthology.orchestra.run.smithi026.stdout:[{"addr": "172.21.15.26", "hostname": "smithi026", "labels": [], "status": ""}, {"addr": "172.21.15.93", "hostname": "smithi093", "labels": [], "status": ""}, {"addr": "172.21.15.116", "hostname": "smithi116", "labels": [], "status": ""}] 2023-12-01T00:57:27.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.299+0000 7f81d01f1700 1 -- 172.21.15.26:0/2473395496 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81b40383f0 msgr2=0x7f81b403a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:27.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.299+0000 7f81d01f1700 1 --2- 172.21.15.26:0/2473395496 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81b40383f0 0x7f81b403a8b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f81b8006fd0 tx=0x7f81b8006e40 comp rx=0 tx=0).stop 2023-12-01T00:57:27.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.299+0000 7f81d01f1700 1 -- 172.21.15.26:0/2473395496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81c8105780 msgr2=0x7f81c8196cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:27.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.299+0000 7f81d01f1700 1 --2- 172.21.15.26:0/2473395496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81c8105780 0x7f81c8196cf0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f81c40092e0 tx=0x7f81c4005010 comp rx=0 tx=0).stop 2023-12-01T00:57:27.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.299+0000 7f81d01f1700 1 -- 172.21.15.26:0/2473395496 shutdown_connections 2023-12-01T00:57:27.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.299+0000 7f81d01f1700 1 --2- 172.21.15.26:0/2473395496 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81b40383f0 0x7f81b403a8b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:27.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.299+0000 7f81d01f1700 1 --2- 172.21.15.26:0/2473395496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81c8105780 0x7f81c8196cf0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:27.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.299+0000 7f81d01f1700 1 -- 172.21.15.26:0/2473395496 >> 172.21.15.26:0/2473395496 conn(0x7f81c8075290 msgr2=0x7f81c80fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:27.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.299+0000 7f81d01f1700 1 -- 172.21.15.26:0/2473395496 shutdown_connections 2023-12-01T00:57:27.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:27.299+0000 7f81d01f1700 1 -- 172.21.15.26:0/2473395496 wait complete. 2023-12-01T00:57:27.639 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-01T00:57:27.639 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd crush tunables default 2023-12-01T00:57:28.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:27 smithi026 ceph-mon[98801]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:28.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:27 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:28.200 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T00:57:29.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:28 smithi026 ceph-mon[98801]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T00:57:29.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.375+0000 7f81b5048700 1 -- 172.21.15.26:0/571054778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81b0105780 msgr2=0x7f81b0105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:29.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.375+0000 7f81b5048700 1 --2- 172.21.15.26:0/571054778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81b0105780 0x7f81b0105b60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009910 tx=0x7f81a0009c20 comp rx=0 tx=0).stop 2023-12-01T00:57:29.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.375+0000 7f81b5048700 1 -- 172.21.15.26:0/571054778 shutdown_connections 2023-12-01T00:57:29.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.375+0000 7f81b5048700 1 --2- 172.21.15.26:0/571054778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81b0105780 0x7f81b0105b60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:29.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.375+0000 7f81b5048700 1 -- 172.21.15.26:0/571054778 >> 172.21.15.26:0/571054778 conn(0x7f81b0075290 msgr2=0x7f81b00756a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:29.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.375+0000 7f81b5048700 1 -- 172.21.15.26:0/571054778 shutdown_connections 2023-12-01T00:57:29.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.375+0000 7f81b5048700 1 -- 172.21.15.26:0/571054778 wait complete. 2023-12-01T00:57:29.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.376+0000 7f81b5048700 1 Processor -- start 2023-12-01T00:57:29.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.376+0000 7f81b5048700 1 -- start start 2023-12-01T00:57:29.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.377+0000 7f81b5048700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81b0105780 0x7f81b0196cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:29.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.377+0000 7f81b5048700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b0197230 con 0x7f81b0105780 2023-12-01T00:57:29.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.377+0000 7f81aed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81b0105780 0x7f81b0196cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:29.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.377+0000 7f81aed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81b0105780 0x7f81b0196cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52576/0 (socket says 172.21.15.26:52576) 2023-12-01T00:57:29.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.377+0000 7f81aed9d700 1 -- 172.21.15.26:0/499216760 learned_addr learned my addr 172.21.15.26:0/499216760 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:29.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.377+0000 7f81aed9d700 1 -- 172.21.15.26:0/499216760 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a00095f0 con 0x7f81b0105780 2023-12-01T00:57:29.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.377+0000 7f81aed9d700 1 --2- 172.21.15.26:0/499216760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81b0105780 0x7f81b0196cf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f81a00092e0 tx=0x7f81a0005010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:29.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.377+0000 7f8197fff700 1 -- 172.21.15.26:0/499216760 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81a001d070 con 0x7f81b0105780 2023-12-01T00:57:29.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.377+0000 7f8197fff700 1 -- 172.21.15.26:0/499216760 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f81a000bc30 con 0x7f81b0105780 2023-12-01T00:57:29.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.377+0000 7f81b5048700 1 -- 172.21.15.26:0/499216760 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b0197430 con 0x7f81b0105780 2023-12-01T00:57:29.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.377+0000 7f8197fff700 1 -- 172.21.15.26:0/499216760 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81a00039e0 con 0x7f81b0105780 2023-12-01T00:57:29.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.377+0000 7f81b5048700 1 -- 172.21.15.26:0/499216760 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b0197850 con 0x7f81b0105780 2023-12-01T00:57:29.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.378+0000 7f8197fff700 1 -- 172.21.15.26:0/499216760 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 45324+0+0 (secure 0 0 0) 0x7f81a0003ca0 con 0x7f81b0105780 2023-12-01T00:57:29.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.378+0000 7f81b5048700 1 -- 172.21.15.26:0/499216760 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b01039c0 con 0x7f81b0105780 2023-12-01T00:57:29.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.378+0000 7f8197fff700 1 --2- 172.21.15.26:0/499216760 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81980383a0 0x7f819803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:29.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.378+0000 7f8197fff700 1 -- 172.21.15.26:0/499216760 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f81a004c0b0 con 0x7f81b0105780 2023-12-01T00:57:29.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.379+0000 7f81ae59c700 1 --2- 172.21.15.26:0/499216760 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81980383a0 0x7f819803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:29.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.379+0000 7f81ae59c700 1 --2- 172.21.15.26:0/499216760 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81980383a0 0x7f819803a860 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f81a4006fd0 tx=0x7f81a4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:29.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.383+0000 7f8197fff700 1 -- 172.21.15.26:0/499216760 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f81a0029950 con 0x7f81b0105780 2023-12-01T00:57:29.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:29.592+0000 7f81b5048700 1 -- 172.21.15.26:0/499216760 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f81b0197b00 con 0x7f81b0105780 2023-12-01T00:57:30.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:29 smithi026 ceph-mon[98801]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:30.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:29 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/499216760' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-01T00:57:30.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:30.232+0000 7f8197fff700 1 -- 172.21.15.26:0/499216760 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f81a0026020 con 0x7f81b0105780 2023-12-01T00:57:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:30.235+0000 7f81b5048700 1 -- 172.21.15.26:0/499216760 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81980383a0 msgr2=0x7f819803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:30.235+0000 7f81b5048700 1 --2- 172.21.15.26:0/499216760 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81980383a0 0x7f819803a860 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f81a4006fd0 tx=0x7f81a4006e40 comp rx=0 tx=0).stop 2023-12-01T00:57:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:30.235+0000 7f81b5048700 1 -- 172.21.15.26:0/499216760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81b0105780 msgr2=0x7f81b0196cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:30.235+0000 7f81b5048700 1 --2- 172.21.15.26:0/499216760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81b0105780 0x7f81b0196cf0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f81a00092e0 tx=0x7f81a0005010 comp rx=0 tx=0).stop 2023-12-01T00:57:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:30.235+0000 7f81b5048700 1 -- 172.21.15.26:0/499216760 shutdown_connections 2023-12-01T00:57:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:30.235+0000 7f81b5048700 1 --2- 172.21.15.26:0/499216760 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81980383a0 0x7f819803a860 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:30.235+0000 7f81b5048700 1 --2- 172.21.15.26:0/499216760 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81b0105780 0x7f81b0196cf0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:30.235+0000 7f81b5048700 1 -- 172.21.15.26:0/499216760 >> 172.21.15.26:0/499216760 conn(0x7f81b0075290 msgr2=0x7f81b00fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:30.235+0000 7f81b5048700 1 -- 172.21.15.26:0/499216760 shutdown_connections 2023-12-01T00:57:30.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:30.235+0000 7f81b5048700 1 -- 172.21.15.26:0/499216760 wait complete. 2023-12-01T00:57:30.237 INFO:teuthology.orchestra.run.smithi026.stderr:adjusted tunables profile to default 2023-12-01T00:57:30.651 INFO:tasks.cephadm:Adding mon.a on smithi026 2023-12-01T00:57:30.651 INFO:tasks.cephadm:Adding mon.b on smithi093 2023-12-01T00:57:30.651 INFO:tasks.cephadm:Adding mon.c on smithi116 2023-12-01T00:57:30.651 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch apply mon '3;smithi026:172.21.15.26=a;smithi093:172.21.15.93=b;smithi116:172.21.15.116=c' 2023-12-01T00:57:31.242 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:31.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:31 smithi026 ceph-mon[98801]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:31.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:31 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/499216760' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-01T00:57:31.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:31 smithi026 ceph-mon[98801]: osdmap e4: 0 total, 0 up, 0 in 2023-12-01T00:57:31.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:31 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:31.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:31 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:31.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:31 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:31.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:31 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:31.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:31 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi116", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:57:31.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:31 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:31.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:31 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:57:31.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:31 smithi026 ceph-mon[98801]: Updating smithi116:/etc/ceph/ceph.conf 2023-12-01T00:57:31.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:31 smithi026 ceph-mon[98801]: Updating smithi116:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:32.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.450+0000 7f1ad61c3700 1 -- 172.21.15.116:0/2759812646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad0106820 msgr2=0x7f1ad0106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:32.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.450+0000 7f1ad61c3700 1 --2- 172.21.15.116:0/2759812646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad0106820 0x7f1ad0106c00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4009910 tx=0x7f1ac4009c20 comp rx=0 tx=0).stop 2023-12-01T00:57:32.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.450+0000 7f1ad61c3700 1 -- 172.21.15.116:0/2759812646 shutdown_connections 2023-12-01T00:57:32.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.450+0000 7f1ad61c3700 1 --2- 172.21.15.116:0/2759812646 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad0106820 0x7f1ad0106c00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:32.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.450+0000 7f1ad61c3700 1 -- 172.21.15.116:0/2759812646 >> 172.21.15.116:0/2759812646 conn(0x7f1ad0075290 msgr2=0x7f1ad00756a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:32.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.450+0000 7f1ad61c3700 1 -- 172.21.15.116:0/2759812646 shutdown_connections 2023-12-01T00:57:32.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.450+0000 7f1ad61c3700 1 -- 172.21.15.116:0/2759812646 wait complete. 2023-12-01T00:57:32.452 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.451+0000 7f1ad61c3700 1 Processor -- start 2023-12-01T00:57:32.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.451+0000 7f1ad61c3700 1 -- start start 2023-12-01T00:57:32.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.451+0000 7f1ad61c3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad0106820 0x7f1ad00ff800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:32.453 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.451+0000 7f1ad61c3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad0101780 con 0x7f1ad0106820 2023-12-01T00:57:32.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.451+0000 7f1acf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad0106820 0x7f1ad00ff800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:32.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.451+0000 7f1acf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad0106820 0x7f1ad00ff800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.116:38818/0 (socket says 172.21.15.116:38818) 2023-12-01T00:57:32.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.451+0000 7f1acf7fe700 1 -- 172.21.15.116:0/2672924261 learned_addr learned my addr 172.21.15.116:0/2672924261 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-12-01T00:57:32.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.452+0000 7f1acf7fe700 1 -- 172.21.15.116:0/2672924261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac40095f0 con 0x7f1ad0106820 2023-12-01T00:57:32.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.452+0000 7f1acf7fe700 1 --2- 172.21.15.116:0/2672924261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad0106820 0x7f1ad00ff800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4005850 tx=0x7f1ac4004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:32.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.452+0000 7f1accff9700 1 -- 172.21.15.116:0/2672924261 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac401d070 con 0x7f1ad0106820 2023-12-01T00:57:32.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.452+0000 7f1ad61c3700 1 -- 172.21.15.116:0/2672924261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad00ffd40 con 0x7f1ad0106820 2023-12-01T00:57:32.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.452+0000 7f1accff9700 1 -- 172.21.15.116:0/2672924261 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1ac4004500 con 0x7f1ad0106820 2023-12-01T00:57:32.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.452+0000 7f1accff9700 1 -- 172.21.15.116:0/2672924261 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1ac40039f0 con 0x7f1ad0106820 2023-12-01T00:57:32.454 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.452+0000 7f1ad61c3700 1 -- 172.21.15.116:0/2672924261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad01001c0 con 0x7f1ad0106820 2023-12-01T00:57:32.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.453+0000 7f1ad61c3700 1 -- 172.21.15.116:0/2672924261 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad0105ad0 con 0x7f1ad0106820 2023-12-01T00:57:32.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.453+0000 7f1accff9700 1 -- 172.21.15.116:0/2672924261 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 45324+0+0 (secure 0 0 0) 0x7f1ac4003cb0 con 0x7f1ad0106820 2023-12-01T00:57:32.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.453+0000 7f1accff9700 1 --2- 172.21.15.116:0/2672924261 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ab80383a0 0x7f1ab803a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:32.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.453+0000 7f1accff9700 1 -- 172.21.15.116:0/2672924261 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1ac404c190 con 0x7f1ad0106820 2023-12-01T00:57:32.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.453+0000 7f1aceffd700 1 --2- 172.21.15.116:0/2672924261 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ab80383a0 0x7f1ab803a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:32.455 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.454+0000 7f1aceffd700 1 --2- 172.21.15.116:0/2672924261 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ab80383a0 0x7f1ab803a860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0006fd0 tx=0x7f1ac0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:32.459 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.458+0000 7f1accff9700 1 -- 172.21.15.116:0/2672924261 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1ac402a540 con 0x7f1ad0106820 2023-12-01T00:57:32.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:32 smithi026 ceph-mon[98801]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2023-12-01T00:57:32.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:32 smithi026 ceph-mon[98801]: Updating smithi116:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-01T00:57:32.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:32 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:32.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:32 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:32.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:32 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:32.655 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.653+0000 7f1ad61c3700 1 -- 172.21.15.116:0/2672924261 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi026:172.21.15.26=a;smithi093:172.21.15.93=b;smithi116:172.21.15.116=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ad0100570 con 0x7f1ab80383a0 2023-12-01T00:57:32.663 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.661+0000 7f1accff9700 1 -- 172.21.15.116:0/2672924261 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f1ad0100570 con 0x7f1ab80383a0 2023-12-01T00:57:32.663 INFO:teuthology.orchestra.run.smithi116.stdout:Scheduled mon update... 2023-12-01T00:57:32.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.662+0000 7f1ad61c3700 1 -- 172.21.15.116:0/2672924261 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ab80383a0 msgr2=0x7f1ab803a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:32.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.662+0000 7f1ad61c3700 1 --2- 172.21.15.116:0/2672924261 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ab80383a0 0x7f1ab803a860 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0006fd0 tx=0x7f1ac0006e40 comp rx=0 tx=0).stop 2023-12-01T00:57:32.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.663+0000 7f1ad61c3700 1 -- 172.21.15.116:0/2672924261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad0106820 msgr2=0x7f1ad00ff800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:32.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.663+0000 7f1ad61c3700 1 --2- 172.21.15.116:0/2672924261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad0106820 0x7f1ad00ff800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1ac4005850 tx=0x7f1ac4004ff0 comp rx=0 tx=0).stop 2023-12-01T00:57:32.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.663+0000 7f1ad61c3700 1 -- 172.21.15.116:0/2672924261 shutdown_connections 2023-12-01T00:57:32.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.663+0000 7f1ad61c3700 1 --2- 172.21.15.116:0/2672924261 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ab80383a0 0x7f1ab803a860 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:32.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.663+0000 7f1ad61c3700 1 --2- 172.21.15.116:0/2672924261 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ad0106820 0x7f1ad00ff800 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:32.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.663+0000 7f1ad61c3700 1 -- 172.21.15.116:0/2672924261 >> 172.21.15.116:0/2672924261 conn(0x7f1ad0075290 msgr2=0x7f1ad00fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:32.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.663+0000 7f1ad61c3700 1 -- 172.21.15.116:0/2672924261 shutdown_connections 2023-12-01T00:57:32.665 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:32.663+0000 7f1ad61c3700 1 -- 172.21.15.116:0/2672924261 wait complete. 2023-12-01T00:57:33.015 DEBUG:teuthology.orchestra.run.smithi093:mon.b> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mon.b.service 2023-12-01T00:57:33.018 DEBUG:teuthology.orchestra.run.smithi116:mon.c> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mon.c.service 2023-12-01T00:57:33.019 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-12-01T00:57:33.020 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-01T00:57:33.049 INFO:journalctl@ceph.mon.c.smithi116.stdout:-- Logs begin at Fri 2023-12-01 00:41:59 UTC. -- 2023-12-01T00:57:33.054 INFO:journalctl@ceph.mon.b.smithi093.stdout:-- Logs begin at Fri 2023-12-01 00:42:14 UTC. -- 2023-12-01T00:57:33.900 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:34.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:33 smithi026 ceph-mon[98801]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:34.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:33 smithi026 ceph-mon[98801]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi026:172.21.15.26=a;smithi093:172.21.15.93=b;smithi116:172.21.15.116=c", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:57:34.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:33 smithi026 ceph-mon[98801]: Saving service mon spec with placement smithi026:172.21.15.26=a;smithi093:172.21.15.93=b;smithi116:172.21.15.116=c;count:3 2023-12-01T00:57:34.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:33 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:34.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:33 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:34.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:33 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:34.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:33 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:57:34.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:33 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:34.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:33 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-01T00:57:34.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:33 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:34.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:33 smithi026 ceph-mon[98801]: Deploying daemon mon.c on smithi116 2023-12-01T00:57:35.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.499+0000 7fd8e93fb700 1 -- 172.21.15.116:0/1495579958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8e4105700 msgr2=0x7fd8e4105ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:35.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.499+0000 7fd8e93fb700 1 --2- 172.21.15.116:0/1495579958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8e4105700 0x7fd8e4105ae0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4009910 tx=0x7fd8d4009c20 comp rx=0 tx=0).stop 2023-12-01T00:57:35.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.499+0000 7fd8e93fb700 1 -- 172.21.15.116:0/1495579958 shutdown_connections 2023-12-01T00:57:35.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.499+0000 7fd8e93fb700 1 --2- 172.21.15.116:0/1495579958 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8e4105700 0x7fd8e4105ae0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:35.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.499+0000 7fd8e93fb700 1 -- 172.21.15.116:0/1495579958 >> 172.21.15.116:0/1495579958 conn(0x7fd8e40fb210 msgr2=0x7fd8e40fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:35.503 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.499+0000 7fd8e93fb700 1 -- 172.21.15.116:0/1495579958 shutdown_connections 2023-12-01T00:57:35.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.499+0000 7fd8e93fb700 1 -- 172.21.15.116:0/1495579958 wait complete. 2023-12-01T00:57:35.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.500+0000 7fd8e93fb700 1 Processor -- start 2023-12-01T00:57:35.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.500+0000 7fd8e93fb700 1 -- start start 2023-12-01T00:57:35.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.500+0000 7fd8e93fb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8e4105700 0x7fd8e40fb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:35.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.500+0000 7fd8e93fb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e40fd640 con 0x7fd8e4105700 2023-12-01T00:57:35.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.501+0000 7fd8e2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8e4105700 0x7fd8e40fb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:35.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.501+0000 7fd8e2ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8e4105700 0x7fd8e40fb6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.116:38824/0 (socket says 172.21.15.116:38824) 2023-12-01T00:57:35.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.501+0000 7fd8e2ffd700 1 -- 172.21.15.116:0/3219920510 learned_addr learned my addr 172.21.15.116:0/3219920510 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-12-01T00:57:35.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.501+0000 7fd8e2ffd700 1 -- 172.21.15.116:0/3219920510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d40095f0 con 0x7fd8e4105700 2023-12-01T00:57:35.504 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.501+0000 7fd8e2ffd700 1 --2- 172.21.15.116:0/3219920510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8e4105700 0x7fd8e40fb6c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4005850 tx=0x7fd8d4004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:35.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.502+0000 7fd8cbfff700 1 -- 172.21.15.116:0/3219920510 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8d401d070 con 0x7fd8e4105700 2023-12-01T00:57:35.508 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.502+0000 7fd8cbfff700 1 -- 172.21.15.116:0/3219920510 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd8d4004500 con 0x7fd8e4105700 2023-12-01T00:57:35.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.502+0000 7fd8cbfff700 1 -- 172.21.15.116:0/3219920510 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd8d40039f0 con 0x7fd8e4105700 2023-12-01T00:57:35.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.504+0000 7fd8e93fb700 1 -- 172.21.15.116:0/3219920510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e40fbc00 con 0x7fd8e4105700 2023-12-01T00:57:35.509 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.504+0000 7fd8e93fb700 1 -- 172.21.15.116:0/3219920510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8e40fc080 con 0x7fd8e4105700 2023-12-01T00:57:35.510 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.508+0000 7fd8cbfff700 1 -- 172.21.15.116:0/3219920510 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 45324+0+0 (secure 0 0 0) 0x7fd8d400b960 con 0x7fd8e4105700 2023-12-01T00:57:35.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.508+0000 7fd8cbfff700 1 --2- 172.21.15.116:0/3219920510 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd8cc0383f0 0x7fd8cc03a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:35.511 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.508+0000 7fd8cbfff700 1 -- 172.21.15.116:0/3219920510 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd8d404c330 con 0x7fd8e4105700 2023-12-01T00:57:35.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.510+0000 7fd8e93fb700 1 -- 172.21.15.116:0/3219920510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8e40623c0 con 0x7fd8e4105700 2023-12-01T00:57:35.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.510+0000 7fd8e27fc700 1 --2- 172.21.15.116:0/3219920510 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd8cc0383f0 0x7fd8cc03a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:35.513 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.510+0000 7fd8e27fc700 1 --2- 172.21.15.116:0/3219920510 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd8cc0383f0 0x7fd8cc03a8b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8006fd0 tx=0x7fd8d8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:35.520 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.518+0000 7fd8cbfff700 1 -- 172.21.15.116:0/3219920510 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd8d400e9d0 con 0x7fd8e4105700 2023-12-01T00:57:35.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.808+0000 7fd8e93fb700 1 -- 172.21.15.116:0/3219920510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd8e40fcbf0 con 0x7fd8e4105700 2023-12-01T00:57:35.812 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.809+0000 7fd8cbfff700 1 -- 172.21.15.116:0/3219920510 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+736 (secure 0 0 0) 0x7fd8d400e3e0 con 0x7fd8e4105700 2023-12-01T00:57:35.812 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-01T00:57:35.813 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":1,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","modified":"2023-12-01T00:55:54.937861Z","created":"2023-12-01T00:55:54.937861Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-01T00:57:35.813 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.811+0000 7fd8e93fb700 1 -- 172.21.15.116:0/3219920510 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd8cc0383f0 msgr2=0x7fd8cc03a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:35.813 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.811+0000 7fd8e93fb700 1 --2- 172.21.15.116:0/3219920510 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd8cc0383f0 0x7fd8cc03a8b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8006fd0 tx=0x7fd8d8006e40 comp rx=0 tx=0).stop 2023-12-01T00:57:35.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.811+0000 7fd8e93fb700 1 -- 172.21.15.116:0/3219920510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8e4105700 msgr2=0x7fd8e40fb6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:35.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.811+0000 7fd8e93fb700 1 --2- 172.21.15.116:0/3219920510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8e4105700 0x7fd8e40fb6c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4005850 tx=0x7fd8d4004ff0 comp rx=0 tx=0).stop 2023-12-01T00:57:35.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.811+0000 7fd8e93fb700 1 -- 172.21.15.116:0/3219920510 shutdown_connections 2023-12-01T00:57:35.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.811+0000 7fd8e93fb700 1 --2- 172.21.15.116:0/3219920510 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd8cc0383f0 0x7fd8cc03a8b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:35.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.811+0000 7fd8e93fb700 1 --2- 172.21.15.116:0/3219920510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd8e4105700 0x7fd8e40fb6c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:35.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.811+0000 7fd8e93fb700 1 -- 172.21.15.116:0/3219920510 >> 172.21.15.116:0/3219920510 conn(0x7fd8e40fb210 msgr2=0x7fd8e4107b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:35.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.811+0000 7fd8e93fb700 1 -- 172.21.15.116:0/3219920510 shutdown_connections 2023-12-01T00:57:35.814 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:35.811+0000 7fd8e93fb700 1 -- 172.21.15.116:0/3219920510 wait complete. 2023-12-01T00:57:35.814 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 1 2023-12-01T00:57:35.839 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:35 smithi116 systemd[1]: Starting Ceph mon.c for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T00:57:36.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:35 smithi026 ceph-mon[98801]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:36.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:35 smithi116 podman[103488]: 2023-12-01T00:57:36.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: set uid:gid to 167:167 (ceph:ceph) 2023-12-01T00:57:36.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: ceph version 18.2.0-1249-ga6f82997 (a6f82997ac57b70a895455dfed6256360a1e4c32) reef (stable), process ceph-mon, pid 7 2023-12-01T00:57:36.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 bash[103488]: 3740ceadb663dd89586c08fefd379e70e35213ae49fb63da3ccd8c1734102cf0 2023-12-01T00:57:36.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: pidfile_write: ignore empty --pid-file 2023-12-01T00:57:36.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: load: jerasure load: lrc 2023-12-01T00:57:36.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: RocksDB version: 7.9.2 2023-12-01T00:57:36.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Git sha 0 2023-12-01T00:57:36.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Compile date 2023-11-30 20:12:29 2023-12-01T00:57:36.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: DB SUMMARY 2023-12-01T00:57:36.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: DB Session ID: 4NEU2DS9PW7IYSRMAI17 2023-12-01T00:57:36.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: CURRENT file: CURRENT 2023-12-01T00:57:36.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: IDENTITY file: IDENTITY 2023-12-01T00:57:36.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-12-01T00:57:36.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-12-01T00:57:36.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-12-01T00:57:36.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.error_if_exists: 0 2023-12-01T00:57:36.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.create_if_missing: 0 2023-12-01T00:57:36.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.paranoid_checks: 1 2023-12-01T00:57:36.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-01T00:57:36.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-01T00:57:36.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-01T00:57:36.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.env: 0x55f5c9187720 2023-12-01T00:57:36.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.fs: PosixFileSystem 2023-12-01T00:57:36.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.info_log: 0x55f5cbdfb440 2023-12-01T00:57:36.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_file_opening_threads: 16 2023-12-01T00:57:36.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.statistics: (nil) 2023-12-01T00:57:36.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.use_fsync: 0 2023-12-01T00:57:36.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_log_file_size: 0 2023-12-01T00:57:36.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-01T00:57:36.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-01T00:57:36.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.keep_log_file_num: 1000 2023-12-01T00:57:36.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.recycle_log_file_num: 0 2023-12-01T00:57:36.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.allow_fallocate: 1 2023-12-01T00:57:36.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.allow_mmap_reads: 0 2023-12-01T00:57:36.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.allow_mmap_writes: 0 2023-12-01T00:57:36.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.use_direct_reads: 0 2023-12-01T00:57:36.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-01T00:57:36.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.create_missing_column_families: 0 2023-12-01T00:57:36.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.db_log_dir: 2023-12-01T00:57:36.684 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.wal_dir: 2023-12-01T00:57:36.685 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-01T00:57:36.685 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-01T00:57:36.685 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-01T00:57:36.685 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-01T00:57:36.686 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-01T00:57:36.686 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-01T00:57:36.686 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.advise_random_on_open: 1 2023-12-01T00:57:36.686 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.db_write_buffer_size: 0 2023-12-01T00:57:36.686 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.write_buffer_manager: 0x55f5cb08c320 2023-12-01T00:57:36.686 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-01T00:57:36.686 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-01T00:57:36.686 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-01T00:57:36.686 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.rate_limiter: (nil) 2023-12-01T00:57:36.686 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-01T00:57:36.686 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.wal_recovery_mode: 2 2023-12-01T00:57:36.686 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.enable_thread_tracking: 0 2023-12-01T00:57:36.686 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.enable_pipelined_write: 0 2023-12-01T00:57:36.686 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.unordered_write: 0 2023-12-01T00:57:36.686 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-01T00:57:36.687 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-01T00:57:36.687 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-01T00:57:36.687 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-01T00:57:36.687 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.row_cache: None 2023-12-01T00:57:36.687 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.wal_filter: None 2023-12-01T00:57:36.687 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-01T00:57:36.687 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.allow_ingest_behind: 0 2023-12-01T00:57:36.687 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.two_write_queues: 0 2023-12-01T00:57:36.687 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.manual_wal_flush: 0 2023-12-01T00:57:36.687 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.wal_compression: 0 2023-12-01T00:57:36.687 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.atomic_flush: 0 2023-12-01T00:57:36.687 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-01T00:57:36.687 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-01T00:57:36.687 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-01T00:57:36.688 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.log_readahead_size: 0 2023-12-01T00:57:36.688 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-01T00:57:36.688 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.best_efforts_recovery: 0 2023-12-01T00:57:36.688 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-01T00:57:36.688 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-01T00:57:36.688 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.allow_data_in_errors: 0 2023-12-01T00:57:36.688 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.db_host_id: __hostname__ 2023-12-01T00:57:36.688 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-01T00:57:36.688 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_background_jobs: 2 2023-12-01T00:57:36.688 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_background_compactions: -1 2023-12-01T00:57:36.688 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_subcompactions: 1 2023-12-01T00:57:36.688 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-01T00:57:36.688 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-01T00:57:36.688 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-01T00:57:36.689 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_total_wal_size: 0 2023-12-01T00:57:36.689 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-01T00:57:36.689 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-01T00:57:36.689 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-01T00:57:36.689 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-01T00:57:36.689 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_open_files: -1 2023-12-01T00:57:36.689 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.bytes_per_sync: 0 2023-12-01T00:57:36.689 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-01T00:57:36.689 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-01T00:57:36.689 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compaction_readahead_size: 0 2023-12-01T00:57:36.689 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_background_flushes: -1 2023-12-01T00:57:36.689 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Compression algorithms supported: 2023-12-01T00:57:36.689 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-01T00:57:36.689 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: kZSTD supported: 0 2023-12-01T00:57:36.689 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: kXpressCompression supported: 0 2023-12-01T00:57:36.690 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: kLZ4HCCompression supported: 1 2023-12-01T00:57:36.690 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: kZlibCompression supported: 1 2023-12-01T00:57:36.690 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: kSnappyCompression supported: 1 2023-12-01T00:57:36.690 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: kLZ4Compression supported: 1 2023-12-01T00:57:36.690 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: kBZip2Compression supported: 0 2023-12-01T00:57:36.690 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-01T00:57:36.690 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-01T00:57:36.690 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-12-01T00:57:36.690 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-01T00:57:36.690 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-01T00:57:36.690 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.merge_operator: 2023-12-01T00:57:36.690 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compaction_filter: None 2023-12-01T00:57:36.690 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compaction_filter_factory: None 2023-12-01T00:57:36.690 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.sst_partitioner_factory: None 2023-12-01T00:57:36.691 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-01T00:57:36.691 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-01T00:57:36.691 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f5cbdfb540) 2023-12-01T00:57:36.691 INFO:journalctl@ceph.mon.c.smithi116.stdout: cache_index_and_filter_blocks: 1 2023-12-01T00:57:36.691 INFO:journalctl@ceph.mon.c.smithi116.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-01T00:57:36.691 INFO:journalctl@ceph.mon.c.smithi116.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-01T00:57:36.691 INFO:journalctl@ceph.mon.c.smithi116.stdout: pin_top_level_index_and_filter: 1 2023-12-01T00:57:36.691 INFO:journalctl@ceph.mon.c.smithi116.stdout: index_type: 0 2023-12-01T00:57:36.691 INFO:journalctl@ceph.mon.c.smithi116.stdout: data_block_index_type: 0 2023-12-01T00:57:36.691 INFO:journalctl@ceph.mon.c.smithi116.stdout: index_shortening: 1 2023-12-01T00:57:36.691 INFO:journalctl@ceph.mon.c.smithi116.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-01T00:57:36.691 INFO:journalctl@ceph.mon.c.smithi116.stdout: checksum: 4 2023-12-01T00:57:36.691 INFO:journalctl@ceph.mon.c.smithi116.stdout: no_block_cache: 0 2023-12-01T00:57:36.691 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_cache: 0x55f5cb10d350 2023-12-01T00:57:36.691 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_cache_name: BinnedLRUCache 2023-12-01T00:57:36.692 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_cache_options: 2023-12-01T00:57:36.692 INFO:journalctl@ceph.mon.c.smithi116.stdout: capacity : 536870912 2023-12-01T00:57:36.692 INFO:journalctl@ceph.mon.c.smithi116.stdout: num_shard_bits : 4 2023-12-01T00:57:36.692 INFO:journalctl@ceph.mon.c.smithi116.stdout: strict_capacity_limit : 0 2023-12-01T00:57:36.692 INFO:journalctl@ceph.mon.c.smithi116.stdout: high_pri_pool_ratio: 0.000 2023-12-01T00:57:36.692 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_cache_compressed: (nil) 2023-12-01T00:57:36.692 INFO:journalctl@ceph.mon.c.smithi116.stdout: persistent_cache: (nil) 2023-12-01T00:57:36.692 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_size: 4096 2023-12-01T00:57:36.692 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_size_deviation: 10 2023-12-01T00:57:36.692 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_restart_interval: 16 2023-12-01T00:57:36.692 INFO:journalctl@ceph.mon.c.smithi116.stdout: index_block_restart_interval: 1 2023-12-01T00:57:36.692 INFO:journalctl@ceph.mon.c.smithi116.stdout: metadata_block_size: 4096 2023-12-01T00:57:36.692 INFO:journalctl@ceph.mon.c.smithi116.stdout: partition_filters: 0 2023-12-01T00:57:36.692 INFO:journalctl@ceph.mon.c.smithi116.stdout: use_delta_encoding: 1 2023-12-01T00:57:36.692 INFO:journalctl@ceph.mon.c.smithi116.stdout: filter_policy: bloomfilter 2023-12-01T00:57:36.693 INFO:journalctl@ceph.mon.c.smithi116.stdout: whole_key_filtering: 1 2023-12-01T00:57:36.693 INFO:journalctl@ceph.mon.c.smithi116.stdout: verify_compression: 0 2023-12-01T00:57:36.693 INFO:journalctl@ceph.mon.c.smithi116.stdout: read_amp_bytes_per_bit: 0 2023-12-01T00:57:36.693 INFO:journalctl@ceph.mon.c.smithi116.stdout: format_version: 5 2023-12-01T00:57:36.693 INFO:journalctl@ceph.mon.c.smithi116.stdout: enable_index_compression: 1 2023-12-01T00:57:36.693 INFO:journalctl@ceph.mon.c.smithi116.stdout: block_align: 0 2023-12-01T00:57:36.693 INFO:journalctl@ceph.mon.c.smithi116.stdout: max_auto_readahead_size: 262144 2023-12-01T00:57:36.693 INFO:journalctl@ceph.mon.c.smithi116.stdout: prepopulate_block_cache: 0 2023-12-01T00:57:36.693 INFO:journalctl@ceph.mon.c.smithi116.stdout: initial_auto_readahead_size: 8192 2023-12-01T00:57:36.693 INFO:journalctl@ceph.mon.c.smithi116.stdout: num_file_reads_for_auto_readahead: 2 2023-12-01T00:57:36.693 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.write_buffer_size: 33554432 2023-12-01T00:57:36.693 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_write_buffer_number: 2 2023-12-01T00:57:36.693 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compression: NoCompression 2023-12-01T00:57:36.693 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.bottommost_compression: Disabled 2023-12-01T00:57:36.693 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.prefix_extractor: nullptr 2023-12-01T00:57:36.694 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-01T00:57:36.694 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.num_levels: 7 2023-12-01T00:57:36.694 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-01T00:57:36.694 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-01T00:57:36.694 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-01T00:57:36.694 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-01T00:57:36.694 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-01T00:57:36.694 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-01T00:57:36.694 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-01T00:57:36.694 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-01T00:57:36.694 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-01T00:57:36.694 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-01T00:57:36.694 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-01T00:57:36.694 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-01T00:57:36.695 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-01T00:57:36.695 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compression_opts.level: 32767 2023-12-01T00:57:36.695 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compression_opts.strategy: 0 2023-12-01T00:57:36.695 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-01T00:57:36.695 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-01T00:57:36.695 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-01T00:57:36.695 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-01T00:57:36.695 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compression_opts.enabled: false 2023-12-01T00:57:36.695 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-01T00:57:36.695 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-01T00:57:36.695 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-01T00:57:36.695 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-01T00:57:36.695 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.target_file_size_base: 67108864 2023-12-01T00:57:36.695 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-01T00:57:36.695 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-01T00:57:36.695 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-01T00:57:36.696 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-01T00:57:36.696 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-01T00:57:36.696 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-01T00:57:36.696 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-01T00:57:36.696 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-01T00:57:36.696 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-01T00:57:36.696 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-01T00:57:36.696 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-01T00:57:36.696 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-01T00:57:36.696 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-01T00:57:36.696 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-01T00:57:36.696 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.arena_block_size: 1048576 2023-12-01T00:57:36.696 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-01T00:57:36.696 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-01T00:57:36.696 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.disable_auto_compactions: 0 2023-12-01T00:57:36.697 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-01T00:57:36.697 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-01T00:57:36.697 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-01T00:57:36.697 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-01T00:57:36.697 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-01T00:57:36.697 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-01T00:57:36.697 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-01T00:57:36.697 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-01T00:57:36.697 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-01T00:57:36.697 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-01T00:57:36.697 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.table_properties_collectors: 2023-12-01T00:57:36.697 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.inplace_update_support: 0 2023-12-01T00:57:36.697 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-01T00:57:36.697 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-01T00:57:36.697 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-01T00:57:36.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-01T00:57:36.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.bloom_locality: 0 2023-12-01T00:57:36.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.max_successive_merges: 0 2023-12-01T00:57:36.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-01T00:57:36.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.paranoid_file_checks: 0 2023-12-01T00:57:36.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.force_consistency_checks: 1 2023-12-01T00:57:36.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.report_bg_io_stats: 0 2023-12-01T00:57:36.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.ttl: 2592000 2023-12-01T00:57:36.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-01T00:57:36.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-01T00:57:36.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-01T00:57:36.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.enable_blob_files: false 2023-12-01T00:57:36.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.min_blob_size: 0 2023-12-01T00:57:36.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.blob_file_size: 268435456 2023-12-01T00:57:36.698 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-01T00:57:36.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-01T00:57:36.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-01T00:57:36.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-01T00:57:36.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-01T00:57:36.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.blob_file_starting_level: 0 2023-12-01T00:57:36.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-01T00:57:36.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-01T00:57:36.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-12-01T00:57:36.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b63be147-8530-4a50-9bb6-27b31dc35014 2023-12-01T00:57:36.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701392256365562, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-01T00:57:36.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-12-01T00:57:36.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701392256365981, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1701392256, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b63be147-8530-4a50-9bb6-27b31dc35014", "db_session_id": "4NEU2DS9PW7IYSRMAI17", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-12-01T00:57:36.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701392256366047, "job": 1, "event": "recovery_finished"} 2023-12-01T00:57:36.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-12-01T00:57:36.699 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-01T00:57:36.700 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f5cb1aa000 2023-12-01T00:57:36.700 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: DB pointer 0x55f5cb196000 2023-12-01T00:57:36.700 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-01T00:57:36.700 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-01T00:57:36.700 INFO:journalctl@ceph.mon.c.smithi116.stdout: ** DB Stats ** 2023-12-01T00:57:36.700 INFO:journalctl@ceph.mon.c.smithi116.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-01T00:57:36.700 INFO:journalctl@ceph.mon.c.smithi116.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-01T00:57:36.700 INFO:journalctl@ceph.mon.c.smithi116.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-01T00:57:36.700 INFO:journalctl@ceph.mon.c.smithi116.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-01T00:57:36.700 INFO:journalctl@ceph.mon.c.smithi116.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-01T00:57:36.700 INFO:journalctl@ceph.mon.c.smithi116.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-01T00:57:36.700 INFO:journalctl@ceph.mon.c.smithi116.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-01T00:57:36.700 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2023-12-01T00:57:36.700 INFO:journalctl@ceph.mon.c.smithi116.stdout: ** Compaction Stats [default] ** 2023-12-01T00:57:36.700 INFO:journalctl@ceph.mon.c.smithi116.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-01T00:57:36.701 INFO:journalctl@ceph.mon.c.smithi116.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-01T00:57:36.701 INFO:journalctl@ceph.mon.c.smithi116.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-12-01T00:57:36.701 INFO:journalctl@ceph.mon.c.smithi116.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-12-01T00:57:36.701 INFO:journalctl@ceph.mon.c.smithi116.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-12-01T00:57:36.701 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2023-12-01T00:57:36.701 INFO:journalctl@ceph.mon.c.smithi116.stdout: ** Compaction Stats [default] ** 2023-12-01T00:57:36.701 INFO:journalctl@ceph.mon.c.smithi116.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-01T00:57:36.701 INFO:journalctl@ceph.mon.c.smithi116.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-01T00:57:36.701 INFO:journalctl@ceph.mon.c.smithi116.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.8 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-12-01T00:57:36.701 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2023-12-01T00:57:36.701 INFO:journalctl@ceph.mon.c.smithi116.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-01T00:57:36.701 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2023-12-01T00:57:36.701 INFO:journalctl@ceph.mon.c.smithi116.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-01T00:57:36.701 INFO:journalctl@ceph.mon.c.smithi116.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-01T00:57:36.702 INFO:journalctl@ceph.mon.c.smithi116.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-01T00:57:36.702 INFO:journalctl@ceph.mon.c.smithi116.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-01T00:57:36.702 INFO:journalctl@ceph.mon.c.smithi116.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-01T00:57:36.702 INFO:journalctl@ceph.mon.c.smithi116.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-01T00:57:36.702 INFO:journalctl@ceph.mon.c.smithi116.stdout: Cumulative compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-01T00:57:36.702 INFO:journalctl@ceph.mon.c.smithi116.stdout: Interval compaction: 0.00 GB write, 0.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-01T00:57:36.702 INFO:journalctl@ceph.mon.c.smithi116.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-01T00:57:36.702 INFO:journalctl@ceph.mon.c.smithi116.stdout: Block cache BinnedLRUCache@0x55f5cb10d350#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-12-01T00:57:36.702 INFO:journalctl@ceph.mon.c.smithi116.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-12-01T00:57:36.702 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2023-12-01T00:57:36.702 INFO:journalctl@ceph.mon.c.smithi116.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-01T00:57:36.702 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-12-01T00:57:36.702 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: using public_addr v2:172.21.15.116:0/0 -> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2023-12-01T00:57:36.702 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: starting mon.c rank -1 at public addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] at bind addrs [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:57:36.703 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: mon.c@-1(???) e0 preinit fsid 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:57:36.703 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 systemd[1]: Started Ceph mon.c for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T00:57:36.703 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: mon.c@-1(synchronizing).mds e1 new map 2023-12-01T00:57:36.703 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: mon.c@-1(synchronizing).mds e1 print_map 2023-12-01T00:57:36.703 INFO:journalctl@ceph.mon.c.smithi116.stdout: e1 2023-12-01T00:57:36.703 INFO:journalctl@ceph.mon.c.smithi116.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-01T00:57:36.703 INFO:journalctl@ceph.mon.c.smithi116.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-01T00:57:36.703 INFO:journalctl@ceph.mon.c.smithi116.stdout: legacy client fscid: -1 2023-12-01T00:57:36.703 INFO:journalctl@ceph.mon.c.smithi116.stdout: 2023-12-01T00:57:36.703 INFO:journalctl@ceph.mon.c.smithi116.stdout: No filesystems configured 2023-12-01T00:57:36.703 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-01T00:57:36.703 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-01T00:57:36.703 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-01T00:57:36.703 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-01T00:57:36.703 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-01T00:57:36.704 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-01T00:57:36.704 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-01T00:57:36.704 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-01T00:57:36.704 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-01T00:57:36.704 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-01T00:57:36.704 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.704 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T00:57:36.704 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:36.704 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:36.704 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi116", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:57:36.704 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.704 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.704 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.704 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.705 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi093", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:57:36.705 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:36.705 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:57:36.705 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: Updating smithi093:/etc/ceph/ceph.conf 2023-12-01T00:57:36.705 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: Deploying cephadm binary to smithi116 2023-12-01T00:57:36.705 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: Updating smithi093:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:36.705 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: Updating smithi093:/etc/ceph/ceph.client.admin.keyring 2023-12-01T00:57:36.705 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:36.705 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: Updating smithi093:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-01T00:57:36.705 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.705 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.705 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.705 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.705 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:36.705 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.706 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: Added host smithi116 2023-12-01T00:57:36.706 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.706 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:36.706 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.706 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T00:57:36.706 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:36.706 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/499216760' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-01T00:57:36.706 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:36.706 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/499216760' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-01T00:57:36.706 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: osdmap e4: 0 total, 0 up, 0 in 2023-12-01T00:57:36.706 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.706 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.706 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.706 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.706 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi116", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:57:36.707 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:36.707 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:57:36.707 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: Updating smithi116:/etc/ceph/ceph.conf 2023-12-01T00:57:36.707 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: Updating smithi116:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:36.707 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2023-12-01T00:57:36.707 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: Updating smithi116:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-01T00:57:36.707 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.707 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.707 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.707 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:36.707 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi026:172.21.15.26=a;smithi093:172.21.15.93=b;smithi116:172.21.15.116=c", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:57:36.707 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: Saving service mon spec with placement smithi026:172.21.15.26=a;smithi093:172.21.15.93=b;smithi116:172.21.15.116=c;count:3 2023-12-01T00:57:36.707 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.707 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:36.707 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:36.708 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:57:36.708 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:36.708 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-01T00:57:36.708 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:36.708 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: Deploying daemon mon.c on smithi116 2023-12-01T00:57:36.708 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:36.708 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-12-01T00:57:36.708 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:36 smithi116 ceph-mon[103554]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-12-01T00:57:37.217 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-12-01T00:57:37.217 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-01T00:57:37.780 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.c/config 2023-12-01T00:57:41.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:41.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:57:41.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: mon.a calling monitor election 2023-12-01T00:57:41.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:41.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:41.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:41.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:41.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: mon.c calling monitor election 2023-12-01T00:57:41.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:41.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:41.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:41.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:41.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-01T00:57:41.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: monmap e2: 2 mons at {a=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-01T00:57:41.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: fsmap 2023-12-01T00:57:41.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: osdmap e4: 0 total, 0 up, 0 in 2023-12-01T00:57:41.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: mgrmap e13: x(active, since 43s) 2023-12-01T00:57:41.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: overall HEALTH_OK 2023-12-01T00:57:41.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:41.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:41.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.856+0000 7fab8c4e1700 1 -- 172.21.15.116:0/3303552569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab700035c0 msgr2=0x7fab70005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:41.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.856+0000 7fab8c4e1700 1 --2- 172.21.15.116:0/3303552569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab700035c0 0x7fab70005a50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fab84100870 tx=0x7fab8000feb0 comp rx=0 tx=0).stop 2023-12-01T00:57:41.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.856+0000 7fab8c4e1700 1 -- 172.21.15.116:0/3303552569 shutdown_connections 2023-12-01T00:57:41.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.856+0000 7fab8c4e1700 1 --2- 172.21.15.116:0/3303552569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab700035c0 0x7fab70005a50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:41.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.856+0000 7fab8c4e1700 1 -- 172.21.15.116:0/3303552569 >> 172.21.15.116:0/3303552569 conn(0x7fab840fc430 msgr2=0x7fab840fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:41.857 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.856+0000 7fab8c4e1700 1 -- 172.21.15.116:0/3303552569 shutdown_connections 2023-12-01T00:57:41.858 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.856+0000 7fab8c4e1700 1 -- 172.21.15.116:0/3303552569 wait complete. 2023-12-01T00:57:41.859 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.857+0000 7fab8c4e1700 1 Processor -- start 2023-12-01T00:57:41.859 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.857+0000 7fab8c4e1700 1 -- start start 2023-12-01T00:57:41.859 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.857+0000 7fab8c4e1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab700035c0 0x7fab84073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:41.859 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.857+0000 7fab8c4e1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab840735d0 0x7fab84073a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:41.859 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.857+0000 7fab8c4e1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab84075010 con 0x7fab700035c0 2023-12-01T00:57:41.859 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.857+0000 7fab8c4e1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab841a2130 con 0x7fab840735d0 2023-12-01T00:57:41.859 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.857+0000 7fab89a7c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab840735d0 0x7fab84073a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:41.859 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.857+0000 7fab89a7c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab840735d0 0x7fab84073a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54090/0 (socket says 172.21.15.116:54090) 2023-12-01T00:57:41.859 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.857+0000 7fab89a7c700 1 -- 172.21.15.116:0/2143698681 learned_addr learned my addr 172.21.15.116:0/2143698681 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-12-01T00:57:41.859 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.857+0000 7fab8a27d700 1 --2- 172.21.15.116:0/2143698681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab700035c0 0x7fab84073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:41.860 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.857+0000 7fab89a7c700 1 -- 172.21.15.116:0/2143698681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab840735d0 msgr2=0x7fab84073a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-01T00:57:41.860 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.857+0000 7fab89a7c700 1 -- 172.21.15.116:0/2143698681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab840735d0 msgr2=0x7fab84073a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-01T00:57:41.860 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.857+0000 7fab89a7c700 1 --2- 172.21.15.116:0/2143698681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab840735d0 0x7fab84073a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T00:57:41.860 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.857+0000 7fab89a7c700 1 --2- 172.21.15.116:0/2143698681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab840735d0 0x7fab84073a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T00:57:41.860 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.858+0000 7fab8a27d700 1 -- 172.21.15.116:0/2143698681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab840735d0 msgr2=0x7fab84073a50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-01T00:57:41.860 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.858+0000 7fab8a27d700 1 --2- 172.21.15.116:0/2143698681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab840735d0 0x7fab84073a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:41.860 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.858+0000 7fab8a27d700 1 -- 172.21.15.116:0/2143698681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8000f900 con 0x7fab700035c0 2023-12-01T00:57:41.860 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.858+0000 7fab8a27d700 1 --2- 172.21.15.116:0/2143698681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab700035c0 0x7fab84073090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fab8000f800 tx=0x7fab800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:41.861 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.858+0000 7fab7b7fe700 1 -- 172.21.15.116:0/2143698681 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fab80013960 con 0x7fab700035c0 2023-12-01T00:57:41.861 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.858+0000 7fab7b7fe700 1 -- 172.21.15.116:0/2143698681 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fab80004030 con 0x7fab700035c0 2023-12-01T00:57:41.861 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.858+0000 7fab8c4e1700 1 -- 172.21.15.116:0/2143698681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab841a2330 con 0x7fab700035c0 2023-12-01T00:57:41.861 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.858+0000 7fab7b7fe700 1 -- 172.21.15.116:0/2143698681 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fab80011b90 con 0x7fab700035c0 2023-12-01T00:57:41.861 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.858+0000 7fab8c4e1700 1 -- 172.21.15.116:0/2143698681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab841a2850 con 0x7fab700035c0 2023-12-01T00:57:41.861 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.859+0000 7fab7b7fe700 1 -- 172.21.15.116:0/2143698681 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 45324+0+0 (secure 0 0 0) 0x7fab80003680 con 0x7fab700035c0 2023-12-01T00:57:41.861 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.859+0000 7fab8c4e1700 1 -- 172.21.15.116:0/2143698681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab840623c0 con 0x7fab700035c0 2023-12-01T00:57:41.861 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.860+0000 7fab7b7fe700 1 --2- 172.21.15.116:0/2143698681 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fab680381e0 0x7fab6803a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:41.862 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.860+0000 7fab7b7fe700 1 -- 172.21.15.116:0/2143698681 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fab8004d960 con 0x7fab700035c0 2023-12-01T00:57:41.862 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.860+0000 7fab89a7c700 1 --2- 172.21.15.116:0/2143698681 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fab680381e0 0x7fab6803a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:41.862 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.860+0000 7fab89a7c700 1 --2- 172.21.15.116:0/2143698681 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fab680381e0 0x7fab6803a6a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab74009180 tx=0x7fab74008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:41.866 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:41.865+0000 7fab7b7fe700 1 -- 172.21.15.116:0/2143698681 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fab80024400 con 0x7fab700035c0 2023-12-01T00:57:41.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:41.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:57:41.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: mon.a calling monitor election 2023-12-01T00:57:41.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:41.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:41.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:41.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:41.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: mon.c calling monitor election 2023-12-01T00:57:41.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:41.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:41.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:41.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:41.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-01T00:57:41.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: monmap e2: 2 mons at {a=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-01T00:57:41.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: fsmap 2023-12-01T00:57:41.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: osdmap e4: 0 total, 0 up, 0 in 2023-12-01T00:57:41.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: mgrmap e13: x(active, since 43s) 2023-12-01T00:57:41.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: overall HEALTH_OK 2023-12-01T00:57:41.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:41.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:42.136 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:42.135+0000 7fab8c4e1700 1 -- 172.21.15.116:0/2143698681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fab841a2c00 con 0x7fab700035c0 2023-12-01T00:57:42.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:42.136+0000 7fab7b7fe700 1 -- 172.21.15.116:0/2143698681 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1006 (secure 0 0 0) 0x7fab800103d0 con 0x7fab700035c0 2023-12-01T00:57:42.137 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-01T00:57:42.137 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":2,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","modified":"2023-12-01T00:57:36.394772Z","created":"2023-12-01T00:55:54.937861Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:3300","nonce":0},{"type":"v1","addr":"172.21.15.116:6789","nonce":0}]},"addr":"172.21.15.116:6789/0","public_addr":"172.21.15.116:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-01T00:57:42.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:42.138+0000 7fab8c4e1700 1 -- 172.21.15.116:0/2143698681 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fab680381e0 msgr2=0x7fab6803a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:42.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:42.138+0000 7fab8c4e1700 1 --2- 172.21.15.116:0/2143698681 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fab680381e0 0x7fab6803a6a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fab74009180 tx=0x7fab74008040 comp rx=0 tx=0).stop 2023-12-01T00:57:42.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:42.138+0000 7fab8c4e1700 1 -- 172.21.15.116:0/2143698681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab700035c0 msgr2=0x7fab84073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:42.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:42.138+0000 7fab8c4e1700 1 --2- 172.21.15.116:0/2143698681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab700035c0 0x7fab84073090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fab8000f800 tx=0x7fab800057f0 comp rx=0 tx=0).stop 2023-12-01T00:57:42.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:42.138+0000 7fab8c4e1700 1 -- 172.21.15.116:0/2143698681 shutdown_connections 2023-12-01T00:57:42.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:42.138+0000 7fab8c4e1700 1 --2- 172.21.15.116:0/2143698681 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fab680381e0 0x7fab6803a6a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:42.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:42.138+0000 7fab8c4e1700 1 --2- 172.21.15.116:0/2143698681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab700035c0 0x7fab84073090 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:42.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:42.138+0000 7fab8c4e1700 1 --2- 172.21.15.116:0/2143698681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fab840735d0 0x7fab84073a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:42.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:42.138+0000 7fab8c4e1700 1 -- 172.21.15.116:0/2143698681 >> 172.21.15.116:0/2143698681 conn(0x7fab840fc430 msgr2=0x7fab8418e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:42.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:42.138+0000 7fab8c4e1700 1 -- 172.21.15.116:0/2143698681 shutdown_connections 2023-12-01T00:57:42.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:42.138+0000 7fab8c4e1700 1 -- 172.21.15.116:0/2143698681 wait complete. 2023-12-01T00:57:42.140 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 2 2023-12-01T00:57:42.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:42 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:42.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:42 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-01T00:57:42.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:42 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:42.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:42 smithi026 ceph-mon[98801]: Deploying daemon mon.b on smithi093 2023-12-01T00:57:42.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:42 smithi026 ceph-mon[98801]: from='client.? 172.21.15.116:0/2143698681' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-01T00:57:42.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:42 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:42.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:42 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:42.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:42 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-01T00:57:42.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:42 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:42.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:42 smithi116 ceph-mon[103554]: Deploying daemon mon.b on smithi093 2023-12-01T00:57:42.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:42 smithi116 ceph-mon[103554]: from='client.? 172.21.15.116:0/2143698681' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-01T00:57:42.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:42 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:43.544 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-12-01T00:57:43.544 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph mon dump -f json 2023-12-01T00:57:43.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:43 smithi026 ceph-mon[98801]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:43.933 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:43 smithi116 ceph-mon[103554]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:44.105 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.c/config 2023-12-01T00:57:44.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 systemd[1]: Starting Ceph mon.b for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T00:57:44.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 podman[103287]: 2023-12-01T00:57:44.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 bash[103287]: 1afe908b974b92dca978da8365d0ebde131aeaf0e85deec302b9e03e1904cb11 2023-12-01T00:57:44.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: set uid:gid to 167:167 (ceph:ceph) 2023-12-01T00:57:44.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: ceph version 18.2.0-1249-ga6f82997 (a6f82997ac57b70a895455dfed6256360a1e4c32) reef (stable), process ceph-mon, pid 7 2023-12-01T00:57:44.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: pidfile_write: ignore empty --pid-file 2023-12-01T00:57:44.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: load: jerasure load: lrc 2023-12-01T00:57:44.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: RocksDB version: 7.9.2 2023-12-01T00:57:44.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Git sha 0 2023-12-01T00:57:44.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Compile date 2023-11-30 20:12:29 2023-12-01T00:57:44.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: DB SUMMARY 2023-12-01T00:57:44.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: DB Session ID: QULJN4D9EJ4S3GJ3K1F2 2023-12-01T00:57:44.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: CURRENT file: CURRENT 2023-12-01T00:57:44.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: IDENTITY file: IDENTITY 2023-12-01T00:57:44.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-12-01T00:57:44.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-12-01T00:57:44.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-12-01T00:57:44.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.error_if_exists: 0 2023-12-01T00:57:44.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.create_if_missing: 0 2023-12-01T00:57:44.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.paranoid_checks: 1 2023-12-01T00:57:44.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-01T00:57:44.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-01T00:57:44.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-01T00:57:44.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.env: 0x55e55fb07720 2023-12-01T00:57:44.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.fs: PosixFileSystem 2023-12-01T00:57:44.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.info_log: 0x55e561653440 2023-12-01T00:57:44.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_file_opening_threads: 16 2023-12-01T00:57:44.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.statistics: (nil) 2023-12-01T00:57:44.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.use_fsync: 0 2023-12-01T00:57:44.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_log_file_size: 0 2023-12-01T00:57:44.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-01T00:57:44.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-01T00:57:44.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.keep_log_file_num: 1000 2023-12-01T00:57:44.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.recycle_log_file_num: 0 2023-12-01T00:57:44.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.allow_fallocate: 1 2023-12-01T00:57:44.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.allow_mmap_reads: 0 2023-12-01T00:57:44.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.allow_mmap_writes: 0 2023-12-01T00:57:44.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.use_direct_reads: 0 2023-12-01T00:57:44.719 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-01T00:57:44.719 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.create_missing_column_families: 0 2023-12-01T00:57:44.719 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.db_log_dir: 2023-12-01T00:57:44.720 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.wal_dir: 2023-12-01T00:57:44.720 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-01T00:57:44.720 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-01T00:57:44.721 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-01T00:57:44.721 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-01T00:57:44.721 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-01T00:57:44.721 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-01T00:57:44.721 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.advise_random_on_open: 1 2023-12-01T00:57:44.721 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.db_write_buffer_size: 0 2023-12-01T00:57:44.721 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.write_buffer_manager: 0x55e5608e4320 2023-12-01T00:57:44.721 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-01T00:57:44.721 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-01T00:57:44.721 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-01T00:57:44.721 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.rate_limiter: (nil) 2023-12-01T00:57:44.721 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-01T00:57:44.721 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.wal_recovery_mode: 2 2023-12-01T00:57:44.721 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.enable_thread_tracking: 0 2023-12-01T00:57:44.722 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.enable_pipelined_write: 0 2023-12-01T00:57:44.722 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.unordered_write: 0 2023-12-01T00:57:44.722 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-01T00:57:44.722 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-01T00:57:44.722 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-01T00:57:44.722 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-01T00:57:44.722 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.row_cache: None 2023-12-01T00:57:44.722 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.wal_filter: None 2023-12-01T00:57:44.722 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-01T00:57:44.722 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.allow_ingest_behind: 0 2023-12-01T00:57:44.722 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.two_write_queues: 0 2023-12-01T00:57:44.722 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.manual_wal_flush: 0 2023-12-01T00:57:44.722 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.wal_compression: 0 2023-12-01T00:57:44.722 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.atomic_flush: 0 2023-12-01T00:57:44.723 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-01T00:57:44.723 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-01T00:57:44.723 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-01T00:57:44.723 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.log_readahead_size: 0 2023-12-01T00:57:44.723 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-01T00:57:44.723 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.best_efforts_recovery: 0 2023-12-01T00:57:44.723 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-01T00:57:44.723 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-01T00:57:44.723 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.allow_data_in_errors: 0 2023-12-01T00:57:44.723 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.db_host_id: __hostname__ 2023-12-01T00:57:44.723 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-01T00:57:44.723 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_background_jobs: 2 2023-12-01T00:57:44.723 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_background_compactions: -1 2023-12-01T00:57:44.723 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_subcompactions: 1 2023-12-01T00:57:44.723 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-01T00:57:44.724 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-01T00:57:44.724 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-01T00:57:44.724 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_total_wal_size: 0 2023-12-01T00:57:44.724 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-01T00:57:44.724 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-01T00:57:44.724 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-01T00:57:44.724 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-01T00:57:44.724 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_open_files: -1 2023-12-01T00:57:44.724 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.bytes_per_sync: 0 2023-12-01T00:57:44.724 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-01T00:57:44.724 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-01T00:57:44.724 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compaction_readahead_size: 0 2023-12-01T00:57:44.724 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_background_flushes: -1 2023-12-01T00:57:44.724 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Compression algorithms supported: 2023-12-01T00:57:44.725 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-01T00:57:44.725 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: kZSTD supported: 0 2023-12-01T00:57:44.725 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: kXpressCompression supported: 0 2023-12-01T00:57:44.725 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: kLZ4HCCompression supported: 1 2023-12-01T00:57:44.725 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: kZlibCompression supported: 1 2023-12-01T00:57:44.725 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: kSnappyCompression supported: 1 2023-12-01T00:57:44.725 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: kLZ4Compression supported: 1 2023-12-01T00:57:44.725 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: kBZip2Compression supported: 0 2023-12-01T00:57:44.725 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-01T00:57:44.725 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-01T00:57:44.725 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-12-01T00:57:44.725 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-01T00:57:44.725 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-01T00:57:44.725 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.merge_operator: 2023-12-01T00:57:44.725 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compaction_filter: None 2023-12-01T00:57:44.726 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compaction_filter_factory: None 2023-12-01T00:57:44.726 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.sst_partitioner_factory: None 2023-12-01T00:57:44.726 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-01T00:57:44.726 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-01T00:57:44.726 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e561653540) 2023-12-01T00:57:44.726 INFO:journalctl@ceph.mon.b.smithi093.stdout: cache_index_and_filter_blocks: 1 2023-12-01T00:57:44.726 INFO:journalctl@ceph.mon.b.smithi093.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-01T00:57:44.726 INFO:journalctl@ceph.mon.b.smithi093.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-01T00:57:44.726 INFO:journalctl@ceph.mon.b.smithi093.stdout: pin_top_level_index_and_filter: 1 2023-12-01T00:57:44.726 INFO:journalctl@ceph.mon.b.smithi093.stdout: index_type: 0 2023-12-01T00:57:44.726 INFO:journalctl@ceph.mon.b.smithi093.stdout: data_block_index_type: 0 2023-12-01T00:57:44.726 INFO:journalctl@ceph.mon.b.smithi093.stdout: index_shortening: 1 2023-12-01T00:57:44.726 INFO:journalctl@ceph.mon.b.smithi093.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-01T00:57:44.726 INFO:journalctl@ceph.mon.b.smithi093.stdout: checksum: 4 2023-12-01T00:57:44.727 INFO:journalctl@ceph.mon.b.smithi093.stdout: no_block_cache: 0 2023-12-01T00:57:44.727 INFO:journalctl@ceph.mon.b.smithi093.stdout: block_cache: 0x55e560965350 2023-12-01T00:57:44.727 INFO:journalctl@ceph.mon.b.smithi093.stdout: block_cache_name: BinnedLRUCache 2023-12-01T00:57:44.727 INFO:journalctl@ceph.mon.b.smithi093.stdout: block_cache_options: 2023-12-01T00:57:44.727 INFO:journalctl@ceph.mon.b.smithi093.stdout: capacity : 536870912 2023-12-01T00:57:44.727 INFO:journalctl@ceph.mon.b.smithi093.stdout: num_shard_bits : 4 2023-12-01T00:57:44.727 INFO:journalctl@ceph.mon.b.smithi093.stdout: strict_capacity_limit : 0 2023-12-01T00:57:44.727 INFO:journalctl@ceph.mon.b.smithi093.stdout: high_pri_pool_ratio: 0.000 2023-12-01T00:57:44.727 INFO:journalctl@ceph.mon.b.smithi093.stdout: block_cache_compressed: (nil) 2023-12-01T00:57:44.727 INFO:journalctl@ceph.mon.b.smithi093.stdout: persistent_cache: (nil) 2023-12-01T00:57:44.727 INFO:journalctl@ceph.mon.b.smithi093.stdout: block_size: 4096 2023-12-01T00:57:44.727 INFO:journalctl@ceph.mon.b.smithi093.stdout: block_size_deviation: 10 2023-12-01T00:57:44.727 INFO:journalctl@ceph.mon.b.smithi093.stdout: block_restart_interval: 16 2023-12-01T00:57:44.727 INFO:journalctl@ceph.mon.b.smithi093.stdout: index_block_restart_interval: 1 2023-12-01T00:57:44.728 INFO:journalctl@ceph.mon.b.smithi093.stdout: metadata_block_size: 4096 2023-12-01T00:57:44.728 INFO:journalctl@ceph.mon.b.smithi093.stdout: partition_filters: 0 2023-12-01T00:57:44.728 INFO:journalctl@ceph.mon.b.smithi093.stdout: use_delta_encoding: 1 2023-12-01T00:57:44.728 INFO:journalctl@ceph.mon.b.smithi093.stdout: filter_policy: bloomfilter 2023-12-01T00:57:44.728 INFO:journalctl@ceph.mon.b.smithi093.stdout: whole_key_filtering: 1 2023-12-01T00:57:44.728 INFO:journalctl@ceph.mon.b.smithi093.stdout: verify_compression: 0 2023-12-01T00:57:44.728 INFO:journalctl@ceph.mon.b.smithi093.stdout: read_amp_bytes_per_bit: 0 2023-12-01T00:57:44.728 INFO:journalctl@ceph.mon.b.smithi093.stdout: format_version: 5 2023-12-01T00:57:44.728 INFO:journalctl@ceph.mon.b.smithi093.stdout: enable_index_compression: 1 2023-12-01T00:57:44.728 INFO:journalctl@ceph.mon.b.smithi093.stdout: block_align: 0 2023-12-01T00:57:44.728 INFO:journalctl@ceph.mon.b.smithi093.stdout: max_auto_readahead_size: 262144 2023-12-01T00:57:44.728 INFO:journalctl@ceph.mon.b.smithi093.stdout: prepopulate_block_cache: 0 2023-12-01T00:57:44.728 INFO:journalctl@ceph.mon.b.smithi093.stdout: initial_auto_readahead_size: 8192 2023-12-01T00:57:44.728 INFO:journalctl@ceph.mon.b.smithi093.stdout: num_file_reads_for_auto_readahead: 2 2023-12-01T00:57:44.728 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.write_buffer_size: 33554432 2023-12-01T00:57:44.729 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_write_buffer_number: 2 2023-12-01T00:57:44.729 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compression: NoCompression 2023-12-01T00:57:44.729 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.bottommost_compression: Disabled 2023-12-01T00:57:44.729 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.prefix_extractor: nullptr 2023-12-01T00:57:44.729 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-01T00:57:44.729 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.num_levels: 7 2023-12-01T00:57:44.729 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-01T00:57:44.729 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-01T00:57:44.729 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-01T00:57:44.729 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-01T00:57:44.729 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-01T00:57:44.729 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-01T00:57:44.729 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-01T00:57:44.729 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-01T00:57:44.729 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-01T00:57:44.729 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-01T00:57:44.730 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-01T00:57:44.730 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-01T00:57:44.730 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-01T00:57:44.730 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compression_opts.level: 32767 2023-12-01T00:57:44.730 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compression_opts.strategy: 0 2023-12-01T00:57:44.730 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-01T00:57:44.730 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-01T00:57:44.730 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-01T00:57:44.730 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-01T00:57:44.730 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compression_opts.enabled: false 2023-12-01T00:57:44.730 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-01T00:57:44.730 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-01T00:57:44.730 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-01T00:57:44.730 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-01T00:57:44.731 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.target_file_size_base: 67108864 2023-12-01T00:57:44.731 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-01T00:57:44.731 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-01T00:57:44.731 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-01T00:57:44.731 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-01T00:57:44.731 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-01T00:57:44.731 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-01T00:57:44.731 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-01T00:57:44.731 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-01T00:57:44.731 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-01T00:57:44.731 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-01T00:57:44.731 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-01T00:57:44.731 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-01T00:57:44.731 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-01T00:57:44.732 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-01T00:57:44.732 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.arena_block_size: 1048576 2023-12-01T00:57:44.732 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-01T00:57:44.732 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-01T00:57:44.732 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.disable_auto_compactions: 0 2023-12-01T00:57:44.732 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-01T00:57:44.732 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-01T00:57:44.732 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-01T00:57:44.732 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-01T00:57:44.732 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-01T00:57:44.732 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-01T00:57:44.732 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-01T00:57:44.732 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-01T00:57:44.733 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-01T00:57:44.733 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-01T00:57:44.733 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.table_properties_collectors: 2023-12-01T00:57:44.733 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.inplace_update_support: 0 2023-12-01T00:57:44.733 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-01T00:57:44.733 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-01T00:57:44.733 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-01T00:57:44.733 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-01T00:57:44.733 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.bloom_locality: 0 2023-12-01T00:57:44.733 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.max_successive_merges: 0 2023-12-01T00:57:44.733 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-01T00:57:44.733 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.paranoid_file_checks: 0 2023-12-01T00:57:44.733 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.force_consistency_checks: 1 2023-12-01T00:57:44.733 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.report_bg_io_stats: 0 2023-12-01T00:57:44.733 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.ttl: 2592000 2023-12-01T00:57:44.734 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-01T00:57:44.734 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-01T00:57:44.734 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-01T00:57:44.734 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.enable_blob_files: false 2023-12-01T00:57:44.734 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.min_blob_size: 0 2023-12-01T00:57:44.734 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.blob_file_size: 268435456 2023-12-01T00:57:44.734 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-01T00:57:44.734 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-01T00:57:44.734 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-01T00:57:44.734 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-01T00:57:44.734 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-01T00:57:44.734 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.blob_file_starting_level: 0 2023-12-01T00:57:44.734 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-01T00:57:44.734 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-01T00:57:44.735 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-12-01T00:57:44.735 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5e1f871e-43cc-4095-bdf9-edc6f8c04194 2023-12-01T00:57:44.735 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701392264530407, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-01T00:57:44.735 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-12-01T00:57:44.735 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701392264530808, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1701392264, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5e1f871e-43cc-4095-bdf9-edc6f8c04194", "db_session_id": "QULJN4D9EJ4S3GJ3K1F2", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-12-01T00:57:44.735 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: EVENT_LOG_v1 {"time_micros": 1701392264530873, "job": 1, "event": "recovery_finished"} 2023-12-01T00:57:44.735 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-12-01T00:57:44.735 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-01T00:57:44.735 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55e560a02000 2023-12-01T00:57:44.735 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: DB pointer 0x55e5609ee000 2023-12-01T00:57:44.735 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-01T00:57:44.735 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-01T00:57:44.735 INFO:journalctl@ceph.mon.b.smithi093.stdout: ** DB Stats ** 2023-12-01T00:57:44.735 INFO:journalctl@ceph.mon.b.smithi093.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-01T00:57:44.735 INFO:journalctl@ceph.mon.b.smithi093.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-01T00:57:44.735 INFO:journalctl@ceph.mon.b.smithi093.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-01T00:57:44.736 INFO:journalctl@ceph.mon.b.smithi093.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-01T00:57:44.736 INFO:journalctl@ceph.mon.b.smithi093.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-01T00:57:44.736 INFO:journalctl@ceph.mon.b.smithi093.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-01T00:57:44.736 INFO:journalctl@ceph.mon.b.smithi093.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-01T00:57:44.736 INFO:journalctl@ceph.mon.b.smithi093.stdout: 2023-12-01T00:57:44.736 INFO:journalctl@ceph.mon.b.smithi093.stdout: ** Compaction Stats [default] ** 2023-12-01T00:57:44.736 INFO:journalctl@ceph.mon.b.smithi093.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-01T00:57:44.736 INFO:journalctl@ceph.mon.b.smithi093.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-01T00:57:44.736 INFO:journalctl@ceph.mon.b.smithi093.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-12-01T00:57:44.736 INFO:journalctl@ceph.mon.b.smithi093.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-12-01T00:57:44.736 INFO:journalctl@ceph.mon.b.smithi093.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-12-01T00:57:44.736 INFO:journalctl@ceph.mon.b.smithi093.stdout: 2023-12-01T00:57:44.736 INFO:journalctl@ceph.mon.b.smithi093.stdout: ** Compaction Stats [default] ** 2023-12-01T00:57:44.736 INFO:journalctl@ceph.mon.b.smithi093.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-01T00:57:44.736 INFO:journalctl@ceph.mon.b.smithi093.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-01T00:57:44.737 INFO:journalctl@ceph.mon.b.smithi093.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.4 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-12-01T00:57:44.737 INFO:journalctl@ceph.mon.b.smithi093.stdout: 2023-12-01T00:57:44.737 INFO:journalctl@ceph.mon.b.smithi093.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-01T00:57:44.737 INFO:journalctl@ceph.mon.b.smithi093.stdout: 2023-12-01T00:57:44.737 INFO:journalctl@ceph.mon.b.smithi093.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-01T00:57:44.737 INFO:journalctl@ceph.mon.b.smithi093.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-01T00:57:44.737 INFO:journalctl@ceph.mon.b.smithi093.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-01T00:57:44.737 INFO:journalctl@ceph.mon.b.smithi093.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-01T00:57:44.737 INFO:journalctl@ceph.mon.b.smithi093.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-01T00:57:44.737 INFO:journalctl@ceph.mon.b.smithi093.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-01T00:57:44.737 INFO:journalctl@ceph.mon.b.smithi093.stdout: Cumulative compaction: 0.00 GB write, 0.72 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-01T00:57:44.737 INFO:journalctl@ceph.mon.b.smithi093.stdout: Interval compaction: 0.00 GB write, 0.72 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-01T00:57:44.737 INFO:journalctl@ceph.mon.b.smithi093.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-01T00:57:44.737 INFO:journalctl@ceph.mon.b.smithi093.stdout: Block cache BinnedLRUCache@0x55e560965350#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-12-01T00:57:44.737 INFO:journalctl@ceph.mon.b.smithi093.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-12-01T00:57:44.738 INFO:journalctl@ceph.mon.b.smithi093.stdout: 2023-12-01T00:57:44.738 INFO:journalctl@ceph.mon.b.smithi093.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-01T00:57:44.738 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-12-01T00:57:44.738 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: using public_addr v2:172.21.15.93:0/0 -> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] 2023-12-01T00:57:44.738 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: starting mon.b rank -1 at public addrs [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] at bind addrs [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:57:44.738 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.b@-1(???) e0 preinit fsid 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:57:44.738 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 systemd[1]: Started Ceph mon.b for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T00:57:44.738 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.b@-1(synchronizing).mds e1 new map 2023-12-01T00:57:44.738 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.b@-1(synchronizing).mds e1 print_map 2023-12-01T00:57:44.738 INFO:journalctl@ceph.mon.b.smithi093.stdout: e1 2023-12-01T00:57:44.738 INFO:journalctl@ceph.mon.b.smithi093.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-01T00:57:44.738 INFO:journalctl@ceph.mon.b.smithi093.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-01T00:57:44.738 INFO:journalctl@ceph.mon.b.smithi093.stdout: legacy client fscid: -1 2023-12-01T00:57:44.738 INFO:journalctl@ceph.mon.b.smithi093.stdout: 2023-12-01T00:57:44.739 INFO:journalctl@ceph.mon.b.smithi093.stdout: No filesystems configured 2023-12-01T00:57:44.739 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-01T00:57:44.739 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-01T00:57:44.739 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-01T00:57:44.739 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-01T00:57:44.739 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-01T00:57:44.739 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-01T00:57:44.739 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-01T00:57:44.739 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-01T00:57:44.739 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-01T00:57:44.739 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-01T00:57:44.739 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.739 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T00:57:44.739 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:44.739 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:44.740 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi116", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:57:44.740 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.740 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.740 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.740 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.740 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi093", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:57:44.740 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:44.740 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:57:44.740 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: Updating smithi093:/etc/ceph/ceph.conf 2023-12-01T00:57:44.740 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: Deploying cephadm binary to smithi116 2023-12-01T00:57:44.740 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: Updating smithi093:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:44.740 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: Updating smithi093:/etc/ceph/ceph.client.admin.keyring 2023-12-01T00:57:44.740 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:44.740 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: Updating smithi093:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-01T00:57:44.740 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.741 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.741 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.741 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.741 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:44.741 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.741 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: Added host smithi116 2023-12-01T00:57:44.741 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.741 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:44.741 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.741 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T00:57:44.741 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:44.741 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/499216760' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-01T00:57:44.741 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:44.741 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/499216760' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-01T00:57:44.741 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: osdmap e4: 0 total, 0 up, 0 in 2023-12-01T00:57:44.742 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.742 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.742 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.742 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.742 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi116", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:57:44.742 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:44.742 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:57:44.742 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: Updating smithi116:/etc/ceph/ceph.conf 2023-12-01T00:57:44.742 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: Updating smithi116:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:44.742 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: Updating smithi116:/etc/ceph/ceph.client.admin.keyring 2023-12-01T00:57:44.742 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: Updating smithi116:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.client.admin.keyring 2023-12-01T00:57:44.742 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.742 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.742 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.743 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:44.743 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi026:172.21.15.26=a;smithi093:172.21.15.93=b;smithi116:172.21.15.116=c", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:57:44.743 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: Saving service mon spec with placement smithi026:172.21.15.26=a;smithi093:172.21.15.93=b;smithi116:172.21.15.116=c;count:3 2023-12-01T00:57:44.743 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.743 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:44.743 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:44.743 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:57:44.743 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.743 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-01T00:57:44.743 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:44.743 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: Deploying daemon mon.c on smithi116 2023-12-01T00:57:44.743 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:44.743 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:44.743 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:57:44.743 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.a calling monitor election 2023-12-01T00:57:44.744 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:44.744 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:44.744 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:44.744 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:44.744 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.c calling monitor election 2023-12-01T00:57:44.744 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:44.744 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:44.744 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:44.744 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:44.744 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-01T00:57:44.744 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: monmap e2: 2 mons at {a=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-01T00:57:44.744 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: fsmap 2023-12-01T00:57:44.744 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: osdmap e4: 0 total, 0 up, 0 in 2023-12-01T00:57:44.744 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mgrmap e13: x(active, since 43s) 2023-12-01T00:57:44.744 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: overall HEALTH_OK 2023-12-01T00:57:44.745 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.745 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.745 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:44.745 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-01T00:57:44.745 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:44.745 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: Deploying daemon mon.b on smithi093 2023-12-01T00:57:44.745 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='client.? 172.21.15.116:0/2143698681' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-01T00:57:44.745 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:44.745 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:44.745 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-12-01T00:57:44.745 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-12-01T00:57:44.745 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: expand_channel_meta expand map: {default=false} 2023-12-01T00:57:44.745 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: expand_channel_meta from 'false' to 'false' 2023-12-01T00:57:44.745 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: expand_channel_meta expanded map: {default=false} 2023-12-01T00:57:44.746 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: expand_channel_meta expand map: {default=info} 2023-12-01T00:57:44.746 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: expand_channel_meta from 'info' to 'info' 2023-12-01T00:57:44.746 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: expand_channel_meta expanded map: {default=info} 2023-12-01T00:57:44.746 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: expand_channel_meta expand map: {default=daemon} 2023-12-01T00:57:44.746 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: expand_channel_meta from 'daemon' to 'daemon' 2023-12-01T00:57:44.746 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: expand_channel_meta expanded map: {default=daemon} 2023-12-01T00:57:44.746 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: expand_channel_meta expand map: {default=debug} 2023-12-01T00:57:44.746 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: expand_channel_meta from 'debug' to 'debug' 2023-12-01T00:57:44.746 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:44 smithi093 ceph-mon[103327]: expand_channel_meta expanded map: {default=debug} 2023-12-01T00:57:49.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:49.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:57:49.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: mon.a calling monitor election 2023-12-01T00:57:49.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: mon.c calling monitor election 2023-12-01T00:57:49.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:49.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:49.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:49.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:49.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:49.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:49.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:49.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:49.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:49.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-01T00:57:49.932 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: monmap e3: 3 mons at {a=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],b=[v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-01T00:57:49.932 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: fsmap 2023-12-01T00:57:49.932 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: osdmap e4: 0 total, 0 up, 0 in 2023-12-01T00:57:49.932 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: mgrmap e13: x(active, since 51s) 2023-12-01T00:57:49.932 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-12-01T00:57:49.932 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-12-01T00:57:49.932 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-12-01T00:57:49.932 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: mon.b (rank 2) addr [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] is down (out of quorum) 2023-12-01T00:57:49.932 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:49.932 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:49.932 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:49.932 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:49 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:50.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:50.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:57:50.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: mon.a calling monitor election 2023-12-01T00:57:50.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: mon.c calling monitor election 2023-12-01T00:57:50.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:50.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:50.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:50.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:50.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:50.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:50.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:50.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:50.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:50.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-01T00:57:50.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: monmap e3: 3 mons at {a=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],b=[v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-01T00:57:50.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: fsmap 2023-12-01T00:57:50.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: osdmap e4: 0 total, 0 up, 0 in 2023-12-01T00:57:50.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: mgrmap e13: x(active, since 51s) 2023-12-01T00:57:50.048 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-12-01T00:57:50.048 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-12-01T00:57:50.048 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-12-01T00:57:50.048 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: mon.b (rank 2) addr [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] is down (out of quorum) 2023-12-01T00:57:50.048 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:50.048 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:50.048 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:50.048 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:49 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:50.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:50 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:50.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:50 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:51.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:50 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:51.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:50 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:51.135 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.133+0000 7f3ce359c700 1 -- 172.21.15.116:0/3782875888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cc80062a0 msgr2=0x7f3cc8008710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:51.135 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.133+0000 7f3ce359c700 1 --2- 172.21.15.116:0/3782875888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cc80062a0 0x7f3cc8008710 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc100900 tx=0x7f3cd800fe90 comp rx=0 tx=0).stop 2023-12-01T00:57:51.135 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.133+0000 7f3ce359c700 1 -- 172.21.15.116:0/3782875888 shutdown_connections 2023-12-01T00:57:51.135 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.133+0000 7f3ce359c700 1 --2- 172.21.15.116:0/3782875888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cc80062a0 0x7f3cc8008710 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:51.135 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.133+0000 7f3ce359c700 1 -- 172.21.15.116:0/3782875888 >> 172.21.15.116:0/3782875888 conn(0x7f3cdc0fb350 msgr2=0x7f3cdc0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:51.135 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.134+0000 7f3ce359c700 1 -- 172.21.15.116:0/3782875888 shutdown_connections 2023-12-01T00:57:51.135 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.134+0000 7f3ce359c700 1 -- 172.21.15.116:0/3782875888 wait complete. 2023-12-01T00:57:51.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.134+0000 7f3ce359c700 1 Processor -- start 2023-12-01T00:57:51.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.134+0000 7f3ce359c700 1 -- start start 2023-12-01T00:57:51.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce359c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc80062a0 0x7f3cdc195100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:51.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce359c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cdc195640 0x7f3cdc199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:51.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce359c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cdc199f50 0x7f3cdc19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:51.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce359c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc195d30 con 0x7f3cdc199f50 2023-12-01T00:57:51.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce359c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc1a1cc0 con 0x7f3cdc195640 2023-12-01T00:57:51.137 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce359c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cdc1a1e00 con 0x7f3cc80062a0 2023-12-01T00:57:51.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce1338700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc80062a0 0x7f3cdc195100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:51.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce1338700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc80062a0 0x7f3cdc195100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54118/0 (socket says 172.21.15.116:54118) 2023-12-01T00:57:51.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce1338700 1 -- 172.21.15.116:0/1427758348 learned_addr learned my addr 172.21.15.116:0/1427758348 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-12-01T00:57:51.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce1b39700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cdc199f50 0x7f3cdc19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:51.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce0b37700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cdc195640 0x7f3cdc199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:51.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce1338700 1 -- 172.21.15.116:0/1427758348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc80062a0 msgr2=0x7f3cdc195100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-01T00:57:51.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce0b37700 1 -- 172.21.15.116:0/1427758348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cdc195640 msgr2=0x7f3cdc199a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-12-01T00:57:51.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce1338700 1 -- 172.21.15.116:0/1427758348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc80062a0 msgr2=0x7f3cdc195100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-01T00:57:51.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce0b37700 1 -- 172.21.15.116:0/1427758348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cdc195640 msgr2=0x7f3cdc199a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-01T00:57:51.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce1338700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc80062a0 0x7f3cdc195100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T00:57:51.138 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce0b37700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cdc195640 0x7f3cdc199a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-01T00:57:51.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce0b37700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cdc195640 0x7f3cdc199a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T00:57:51.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce1338700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc80062a0 0x7f3cdc195100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-01T00:57:51.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce1b39700 1 -- 172.21.15.116:0/1427758348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc80062a0 msgr2=0x7f3cdc195100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-01T00:57:51.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce1b39700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc80062a0 0x7f3cdc195100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:51.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce1b39700 1 -- 172.21.15.116:0/1427758348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cdc195640 msgr2=0x7f3cdc199a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-01T00:57:51.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce1b39700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cdc195640 0x7f3cdc199a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:51.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce1b39700 1 -- 172.21.15.116:0/1427758348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd800f8e0 con 0x7f3cdc199f50 2023-12-01T00:57:51.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3ce1b39700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cdc199f50 0x7f3cdc19a400 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400bd50 tx=0x7f3cd400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:51.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.135+0000 7f3cd27fc700 1 -- 172.21.15.116:0/1427758348 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd400cd10 con 0x7f3cdc199f50 2023-12-01T00:57:51.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.136+0000 7f3cd27fc700 1 -- 172.21.15.116:0/1427758348 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3cd400ce70 con 0x7f3cdc199f50 2023-12-01T00:57:51.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.136+0000 7f3ce359c700 1 -- 172.21.15.116:0/1427758348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cdc068de0 con 0x7f3cdc199f50 2023-12-01T00:57:51.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.136+0000 7f3cd27fc700 1 -- 172.21.15.116:0/1427758348 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40128e0 con 0x7f3cdc199f50 2023-12-01T00:57:51.139 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.136+0000 7f3ce359c700 1 -- 172.21.15.116:0/1427758348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cdc0692e0 con 0x7f3cdc199f50 2023-12-01T00:57:51.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.136+0000 7f3ce359c700 1 -- 172.21.15.116:0/1427758348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cdc0623c0 con 0x7f3cdc199f50 2023-12-01T00:57:51.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.137+0000 7f3cd27fc700 1 -- 172.21.15.116:0/1427758348 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 45324+0+0 (secure 0 0 0) 0x7f3cd4014440 con 0x7f3cdc199f50 2023-12-01T00:57:51.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.137+0000 7f3cd27fc700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3cc0038870 0x7f3cc003ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:51.140 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.137+0000 7f3cd27fc700 1 -- 172.21.15.116:0/1427758348 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3cd404a780 con 0x7f3cdc199f50 2023-12-01T00:57:51.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.137+0000 7f3ce1338700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3cc0038870 0x7f3cc003ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:51.141 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.138+0000 7f3ce1338700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3cc0038870 0x7f3cc003ad30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8015040 tx=0x7f3cd8028040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:51.143 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.142+0000 7f3cd27fc700 1 -- 172.21.15.116:0/1427758348 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3cd40146f0 con 0x7f3cdc199f50 2023-12-01T00:57:51.428 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.427+0000 7f3ce359c700 1 -- 172.21.15.116:0/1427758348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3cdc069660 con 0x7f3cdc199f50 2023-12-01T00:57:51.428 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.427+0000 7f3cd27fc700 1 -- 172.21.15.116:0/1427758348 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1270 (secure 0 0 0) 0x7f3cd401b8d0 con 0x7f3cdc199f50 2023-12-01T00:57:51.429 INFO:teuthology.orchestra.run.smithi116.stdout: 2023-12-01T00:57:51.429 INFO:teuthology.orchestra.run.smithi116.stdout:{"epoch":3,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","modified":"2023-12-01T00:57:44.559488Z","created":"2023-12-01T00:55:54.937861Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:3300","nonce":0},{"type":"v1","addr":"172.21.15.26:6789","nonce":0}]},"addr":"172.21.15.26:6789/0","public_addr":"172.21.15.26:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:3300","nonce":0},{"type":"v1","addr":"172.21.15.116:6789","nonce":0}]},"addr":"172.21.15.116:6789/0","public_addr":"172.21.15.116:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:3300","nonce":0},{"type":"v1","addr":"172.21.15.93:6789","nonce":0}]},"addr":"172.21.15.93:6789/0","public_addr":"172.21.15.93:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-01T00:57:51.430 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.429+0000 7f3ce359c700 1 -- 172.21.15.116:0/1427758348 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3cc0038870 msgr2=0x7f3cc003ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:51.430 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.429+0000 7f3ce359c700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3cc0038870 0x7f3cc003ad30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8015040 tx=0x7f3cd8028040 comp rx=0 tx=0).stop 2023-12-01T00:57:51.430 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.429+0000 7f3ce359c700 1 -- 172.21.15.116:0/1427758348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cdc199f50 msgr2=0x7f3cdc19a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:51.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.429+0000 7f3ce359c700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cdc199f50 0x7f3cdc19a400 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400bd50 tx=0x7f3cd400be30 comp rx=0 tx=0).stop 2023-12-01T00:57:51.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.429+0000 7f3ce359c700 1 -- 172.21.15.116:0/1427758348 shutdown_connections 2023-12-01T00:57:51.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.429+0000 7f3ce359c700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3cc0038870 0x7f3cc003ad30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:51.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.429+0000 7f3ce359c700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cdc199f50 0x7f3cdc19a400 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:51.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.429+0000 7f3ce359c700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc80062a0 0x7f3cdc195100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:51.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.429+0000 7f3ce359c700 1 --2- 172.21.15.116:0/1427758348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cdc195640 0x7f3cdc199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:51.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.429+0000 7f3ce359c700 1 -- 172.21.15.116:0/1427758348 >> 172.21.15.116:0/1427758348 conn(0x7f3cdc0fb350 msgr2=0x7f3cdc101440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:51.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.429+0000 7f3ce359c700 1 -- 172.21.15.116:0/1427758348 shutdown_connections 2023-12-01T00:57:51.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:51.429+0000 7f3ce359c700 1 -- 172.21.15.116:0/1427758348 wait complete. 2023-12-01T00:57:51.431 INFO:teuthology.orchestra.run.smithi116.stderr:dumped monmap epoch 3 2023-12-01T00:57:51.764 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-01T00:57:51.764 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph config generate-minimal-conf 2023-12-01T00:57:51.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:51.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:57:51.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: mon.a calling monitor election 2023-12-01T00:57:51.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: mon.c calling monitor election 2023-12-01T00:57:51.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:51.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:57:51.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:51.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:51.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:51.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:51.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:51.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:51.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:51.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-01T00:57:51.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: monmap e3: 3 mons at {a=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],b=[v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-01T00:57:51.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: fsmap 2023-12-01T00:57:51.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: osdmap e4: 0 total, 0 up, 0 in 2023-12-01T00:57:51.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: mgrmap e13: x(active, since 51s) 2023-12-01T00:57:51.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-12-01T00:57:51.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-12-01T00:57:51.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-12-01T00:57:51.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: mon.b (rank 2) addr [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] is down (out of quorum) 2023-12-01T00:57:51.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:51.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:51.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:51.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:51.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:51.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:52.228 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T00:57:52.628 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: mon.b calling monitor election 2023-12-01T00:57:52.628 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: Updating smithi026:/etc/ceph/ceph.conf 2023-12-01T00:57:52.628 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: Updating smithi093:/etc/ceph/ceph.conf 2023-12-01T00:57:52.628 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: Updating smithi116:/etc/ceph/ceph.conf 2023-12-01T00:57:52.628 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: Updating smithi026:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:52.628 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: Updating smithi093:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:52.629 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: Updating smithi116:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:52.629 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: mon.b calling monitor election 2023-12-01T00:57:52.629 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: mon.c calling monitor election 2023-12-01T00:57:52.629 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: mon.a calling monitor election 2023-12-01T00:57:52.629 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-12-01T00:57:52.629 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: monmap e3: 3 mons at {a=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],b=[v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-01T00:57:52.629 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: fsmap 2023-12-01T00:57:52.629 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: osdmap e4: 0 total, 0 up, 0 in 2023-12-01T00:57:52.629 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: mgrmap e13: x(active, since 53s) 2023-12-01T00:57:52.629 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-12-01T00:57:52.629 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: Cluster is now healthy 2023-12-01T00:57:52.629 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: overall HEALTH_OK 2023-12-01T00:57:52.629 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.629 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.629 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.630 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.630 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.630 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.630 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.630 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.630 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.630 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.630 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.630 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-01T00:57:52.630 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-01T00:57:52.630 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:52.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: mon.b calling monitor election 2023-12-01T00:57:52.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: Updating smithi026:/etc/ceph/ceph.conf 2023-12-01T00:57:52.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: Updating smithi093:/etc/ceph/ceph.conf 2023-12-01T00:57:52.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: Updating smithi116:/etc/ceph/ceph.conf 2023-12-01T00:57:52.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: Updating smithi026:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:52.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: Updating smithi093:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:52.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: Updating smithi116:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:52.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: mon.b calling monitor election 2023-12-01T00:57:52.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: mon.c calling monitor election 2023-12-01T00:57:52.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: mon.a calling monitor election 2023-12-01T00:57:52.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-12-01T00:57:52.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: monmap e3: 3 mons at {a=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],b=[v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-01T00:57:52.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: fsmap 2023-12-01T00:57:52.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: osdmap e4: 0 total, 0 up, 0 in 2023-12-01T00:57:52.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: mgrmap e13: x(active, since 53s) 2023-12-01T00:57:52.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-12-01T00:57:52.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: Cluster is now healthy 2023-12-01T00:57:52.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: overall HEALTH_OK 2023-12-01T00:57:52.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-01T00:57:52.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-01T00:57:52.683 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:52.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: mon.b calling monitor election 2023-12-01T00:57:52.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: Updating smithi026:/etc/ceph/ceph.conf 2023-12-01T00:57:52.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: Updating smithi093:/etc/ceph/ceph.conf 2023-12-01T00:57:52.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: Updating smithi116:/etc/ceph/ceph.conf 2023-12-01T00:57:52.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: Updating smithi026:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:52.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: Updating smithi093:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:52.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: Updating smithi116:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/config/ceph.conf 2023-12-01T00:57:52.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: mon.b calling monitor election 2023-12-01T00:57:52.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: mon.c calling monitor election 2023-12-01T00:57:52.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: mon.a calling monitor election 2023-12-01T00:57:52.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-12-01T00:57:52.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: monmap e3: 3 mons at {a=[v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0],b=[v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0],c=[v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-01T00:57:52.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: fsmap 2023-12-01T00:57:52.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: osdmap e4: 0 total, 0 up, 0 in 2023-12-01T00:57:52.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: mgrmap e13: x(active, since 53s) 2023-12-01T00:57:52.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-12-01T00:57:52.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: Cluster is now healthy 2023-12-01T00:57:52.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: overall HEALTH_OK 2023-12-01T00:57:52.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:52.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-01T00:57:52.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-01T00:57:52.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:53.592 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:53 smithi026 ceph-mon[98801]: Reconfiguring mon.a (unknown last config time)... 2023-12-01T00:57:53.592 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:53 smithi026 ceph-mon[98801]: Reconfiguring daemon mon.a on smithi026 2023-12-01T00:57:53.592 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:53 smithi026 ceph-mon[98801]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:53.592 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:53 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:53.592 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:53 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:53.592 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:53 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:53.592 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:53 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:53.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:53 smithi116 ceph-mon[103554]: Reconfiguring mon.a (unknown last config time)... 2023-12-01T00:57:53.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:53 smithi116 ceph-mon[103554]: Reconfiguring daemon mon.a on smithi026 2023-12-01T00:57:53.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:53 smithi116 ceph-mon[103554]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:53.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:53 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:53.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:53 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:53.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:53 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:53.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:53 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:53 smithi093 ceph-mon[103327]: Reconfiguring mon.a (unknown last config time)... 2023-12-01T00:57:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:53 smithi093 ceph-mon[103327]: Reconfiguring daemon mon.a on smithi026 2023-12-01T00:57:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:53 smithi093 ceph-mon[103327]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:53 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:57:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:53 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:53 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:53 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:53.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.736+0000 7fcd4da3f700 1 -- 172.21.15.26:0/995750542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd4810b410 msgr2=0x7fcd4810d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:53.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.736+0000 7fcd4da3f700 1 --2- 172.21.15.26:0/995750542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd4810b410 0x7fcd4810d860 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000b0a0 tx=0x7fcd4000b3b0 comp rx=0 tx=0).stop 2023-12-01T00:57:53.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.736+0000 7fcd4da3f700 1 -- 172.21.15.26:0/995750542 shutdown_connections 2023-12-01T00:57:53.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.736+0000 7fcd4da3f700 1 --2- 172.21.15.26:0/995750542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd4810b410 0x7fcd4810d860 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:53.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.736+0000 7fcd4da3f700 1 --2- 172.21.15.26:0/995750542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd48102030 0x7fcd48102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:53.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.736+0000 7fcd4da3f700 1 --2- 172.21.15.26:0/995750542 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd48102950 0x7fcd4810ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:53.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.736+0000 7fcd4da3f700 1 -- 172.21.15.26:0/995750542 >> 172.21.15.26:0/995750542 conn(0x7fcd480fb800 msgr2=0x7fcd480fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:53.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.736+0000 7fcd4da3f700 1 -- 172.21.15.26:0/995750542 shutdown_connections 2023-12-01T00:57:53.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.736+0000 7fcd4da3f700 1 -- 172.21.15.26:0/995750542 wait complete. 2023-12-01T00:57:53.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd4da3f700 1 Processor -- start 2023-12-01T00:57:53.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd4da3f700 1 -- start start 2023-12-01T00:57:53.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd4da3f700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd48102030 0x7fcd480ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:53.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd4da3f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd48102950 0x7fcd481001d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:53.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd4da3f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd4810b410 0x7fcd48100750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:53.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd4da3f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd481a5510 con 0x7fcd48102950 2023-12-01T00:57:53.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd4da3f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd481a5680 con 0x7fcd4810b410 2023-12-01T00:57:53.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd4da3f700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd481a5840 con 0x7fcd48102030 2023-12-01T00:57:53.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd467fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd48102950 0x7fcd481001d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:53.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd467fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd48102950 0x7fcd481001d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52588/0 (socket says 172.21.15.26:52588) 2023-12-01T00:57:53.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd467fc700 1 -- 172.21.15.26:0/721044172 learned_addr learned my addr 172.21.15.26:0/721044172 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:57:53.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd477fe700 1 --2- 172.21.15.26:0/721044172 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd4810b410 0x7fcd48100750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:53.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd46ffd700 1 --2- 172.21.15.26:0/721044172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd48102030 0x7fcd480ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd467fc700 1 -- 172.21.15.26:0/721044172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd48102030 msgr2=0x7fcd480ffc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd467fc700 1 --2- 172.21.15.26:0/721044172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd48102030 0x7fcd480ffc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd467fc700 1 -- 172.21.15.26:0/721044172 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd4810b410 msgr2=0x7fcd48100750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd467fc700 1 --2- 172.21.15.26:0/721044172 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd4810b410 0x7fcd48100750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.737+0000 7fcd467fc700 1 -- 172.21.15.26:0/721044172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd40009d00 con 0x7fcd48102950 2023-12-01T00:57:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.738+0000 7fcd46ffd700 1 --2- 172.21.15.26:0/721044172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd48102030 0x7fcd480ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T00:57:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.738+0000 7fcd467fc700 1 --2- 172.21.15.26:0/721044172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd48102950 0x7fcd481001d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800e970 tx=0x7fcd3800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.738+0000 7fcd4ca3d700 1 -- 172.21.15.26:0/721044172 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38009790 con 0x7fcd48102950 2023-12-01T00:57:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.738+0000 7fcd4ca3d700 1 -- 172.21.15.26:0/721044172 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcd3800eec0 con 0x7fcd48102950 2023-12-01T00:57:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.738+0000 7fcd4da3f700 1 -- 172.21.15.26:0/721044172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd481a5b20 con 0x7fcd48102950 2023-12-01T00:57:53.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.738+0000 7fcd4ca3d700 1 -- 172.21.15.26:0/721044172 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38005690 con 0x7fcd48102950 2023-12-01T00:57:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.738+0000 7fcd4da3f700 1 -- 172.21.15.26:0/721044172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd481a6020 con 0x7fcd48102950 2023-12-01T00:57:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.739+0000 7fcd4ca3d700 1 -- 172.21.15.26:0/721044172 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 45324+0+0 (secure 0 0 0) 0x7fcd38021440 con 0x7fcd48102950 2023-12-01T00:57:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.739+0000 7fcd4da3f700 1 -- 172.21.15.26:0/721044172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd48105ca0 con 0x7fcd48102950 2023-12-01T00:57:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.739+0000 7fcd4ca3d700 1 --2- 172.21.15.26:0/721044172 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcd340385d0 0x7fcd3403aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.739+0000 7fcd4ca3d700 1 -- 172.21.15.26:0/721044172 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcd38014070 con 0x7fcd48102950 2023-12-01T00:57:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.739+0000 7fcd46ffd700 1 --2- 172.21.15.26:0/721044172 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcd340385d0 0x7fcd3403aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:53.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.740+0000 7fcd46ffd700 1 --2- 172.21.15.26:0/721044172 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcd340385d0 0x7fcd3403aa90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcd30005950 tx=0x7fcd300058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:53.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.744+0000 7fcd4ca3d700 1 -- 172.21.15.26:0/721044172 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fcd3801f990 con 0x7fcd48102950 2023-12-01T00:57:53.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.947+0000 7fcd4da3f700 1 -- 172.21.15.26:0/721044172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fcd4804ea90 con 0x7fcd48102950 2023-12-01T00:57:53.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.948+0000 7fcd4ca3d700 1 -- 172.21.15.26:0/721044172 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+273 (secure 0 0 0) 0x7fcd38026130 con 0x7fcd48102950 2023-12-01T00:57:53.949 INFO:teuthology.orchestra.run.smithi026.stdout:# minimal ceph.conf for 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:57:53.949 INFO:teuthology.orchestra.run.smithi026.stdout:[global] 2023-12-01T00:57:53.949 INFO:teuthology.orchestra.run.smithi026.stdout: fsid = 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T00:57:53.949 INFO:teuthology.orchestra.run.smithi026.stdout: mon_host = [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] 2023-12-01T00:57:53.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.950+0000 7fcd4da3f700 1 -- 172.21.15.26:0/721044172 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcd340385d0 msgr2=0x7fcd3403aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:53.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.950+0000 7fcd4da3f700 1 --2- 172.21.15.26:0/721044172 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcd340385d0 0x7fcd3403aa90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcd30005950 tx=0x7fcd300058e0 comp rx=0 tx=0).stop 2023-12-01T00:57:53.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.950+0000 7fcd4da3f700 1 -- 172.21.15.26:0/721044172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd48102950 msgr2=0x7fcd481001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:53.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.950+0000 7fcd4da3f700 1 --2- 172.21.15.26:0/721044172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd48102950 0x7fcd481001d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800e970 tx=0x7fcd3800ec80 comp rx=0 tx=0).stop 2023-12-01T00:57:53.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.950+0000 7fcd4da3f700 1 -- 172.21.15.26:0/721044172 shutdown_connections 2023-12-01T00:57:53.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.950+0000 7fcd4da3f700 1 --2- 172.21.15.26:0/721044172 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcd340385d0 0x7fcd3403aa90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:53.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.950+0000 7fcd4da3f700 1 --2- 172.21.15.26:0/721044172 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcd4810b410 0x7fcd48100750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:53.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.950+0000 7fcd4da3f700 1 --2- 172.21.15.26:0/721044172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcd48102030 0x7fcd480ffc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:53.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.950+0000 7fcd4da3f700 1 --2- 172.21.15.26:0/721044172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd48102950 0x7fcd481001d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:53.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.950+0000 7fcd4da3f700 1 -- 172.21.15.26:0/721044172 >> 172.21.15.26:0/721044172 conn(0x7fcd480fb800 msgr2=0x7fcd48102de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:53.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.950+0000 7fcd4da3f700 1 -- 172.21.15.26:0/721044172 shutdown_connections 2023-12-01T00:57:53.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:57:53.950+0000 7fcd4da3f700 1 -- 172.21.15.26:0/721044172 wait complete. 2023-12-01T00:57:54.295 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-01T00:57:54.295 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T00:57:54.295 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.conf 2023-12-01T00:57:54.326 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T00:57:54.326 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-01T00:57:54.398 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-01T00:57:54.398 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/ceph/ceph.conf 2023-12-01T00:57:54.429 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-01T00:57:54.429 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-01T00:57:54.495 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:54 smithi093 ceph-mon[103327]: Reconfiguring mon.b (monmap changed)... 2023-12-01T00:57:54.495 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:54 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-01T00:57:54.495 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:54 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-01T00:57:54.495 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:54 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:54.495 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:54 smithi093 ceph-mon[103327]: Reconfiguring daemon mon.b on smithi093 2023-12-01T00:57:54.495 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:54 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/721044172' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:54.498 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-12-01T00:57:54.499 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.conf 2023-12-01T00:57:54.534 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-12-01T00:57:54.534 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-01T00:57:54.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:54 smithi026 ceph-mon[98801]: Reconfiguring mon.b (monmap changed)... 2023-12-01T00:57:54.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:54 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-01T00:57:54.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:54 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-01T00:57:54.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:54 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:54.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:54 smithi026 ceph-mon[98801]: Reconfiguring daemon mon.b on smithi093 2023-12-01T00:57:54.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:54 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/721044172' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:54.603 INFO:tasks.cephadm:Adding mgr.x on smithi026 2023-12-01T00:57:54.603 INFO:tasks.cephadm:Adding mgr.y on smithi093 2023-12-01T00:57:54.603 INFO:tasks.cephadm:Adding mgr.z on smithi116 2023-12-01T00:57:54.604 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch apply mgr '3;smithi026=x;smithi093=y;smithi116=z' 2023-12-01T00:57:54.666 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:54 smithi116 ceph-mon[103554]: Reconfiguring mon.b (monmap changed)... 2023-12-01T00:57:54.667 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:54 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-01T00:57:54.667 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:54 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-01T00:57:54.667 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:54 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:54.667 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:54 smithi116 ceph-mon[103554]: Reconfiguring daemon mon.b on smithi093 2023-12-01T00:57:54.667 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:54 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/721044172' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:55.358 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.c/config 2023-12-01T00:57:55.646 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:55 smithi116 ceph-mon[103554]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:55.647 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:55 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:55.647 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:55 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:55.647 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:55 smithi116 ceph-mon[103554]: Reconfiguring mon.c (monmap changed)... 2023-12-01T00:57:55.647 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:55 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-01T00:57:55.647 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:55 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-01T00:57:55.647 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:55 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:55.647 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:55 smithi116 ceph-mon[103554]: Reconfiguring daemon mon.c on smithi116 2023-12-01T00:57:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:55 smithi026 ceph-mon[98801]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:55 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:55 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:55 smithi026 ceph-mon[98801]: Reconfiguring mon.c (monmap changed)... 2023-12-01T00:57:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:55 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-01T00:57:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:55 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-01T00:57:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:55 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:55 smithi026 ceph-mon[98801]: Reconfiguring daemon mon.c on smithi116 2023-12-01T00:57:55.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:55 smithi093 ceph-mon[103327]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:55.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:55 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:55.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:55 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:55.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:55 smithi093 ceph-mon[103327]: Reconfiguring mon.c (monmap changed)... 2023-12-01T00:57:55.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:55 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-01T00:57:55.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:55 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-01T00:57:55.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:55 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:55.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:55 smithi093 ceph-mon[103327]: Reconfiguring daemon mon.c on smithi116 2023-12-01T00:57:56.529 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.526+0000 7fa7b7739700 1 -- 172.21.15.116:0/1667762702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7b00feea0 msgr2=0x7fa7b00ff320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:56.529 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.526+0000 7fa7b7739700 1 --2- 172.21.15.116:0/1667762702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7b00feea0 0x7fa7b00ff320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac009990 tx=0x7fa7ac009ca0 comp rx=0 tx=0).stop 2023-12-01T00:57:56.529 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.526+0000 7fa7b7739700 1 -- 172.21.15.116:0/1667762702 shutdown_connections 2023-12-01T00:57:56.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.526+0000 7fa7b7739700 1 --2- 172.21.15.116:0/1667762702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b00ff860 0x7fa7b00ffd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:56.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.526+0000 7fa7b7739700 1 --2- 172.21.15.116:0/1667762702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7b01013a0 0x7fa7b01017c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:56.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.526+0000 7fa7b7739700 1 --2- 172.21.15.116:0/1667762702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7b00feea0 0x7fa7b00ff320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:56.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.526+0000 7fa7b7739700 1 -- 172.21.15.116:0/1667762702 >> 172.21.15.116:0/1667762702 conn(0x7fa7b00faa40 msgr2=0x7fa7b00fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:56.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.526+0000 7fa7b7739700 1 -- 172.21.15.116:0/1667762702 shutdown_connections 2023-12-01T00:57:56.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.526+0000 7fa7b7739700 1 -- 172.21.15.116:0/1667762702 wait complete. 2023-12-01T00:57:56.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.527+0000 7fa7b7739700 1 Processor -- start 2023-12-01T00:57:56.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.527+0000 7fa7b7739700 1 -- start start 2023-12-01T00:57:56.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.527+0000 7fa7b7739700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7b00feea0 0x7fa7b0198e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:56.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.527+0000 7fa7b7739700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7b00ff860 0x7fa7b01993a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:56.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.527+0000 7fa7b7739700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b01013a0 0x7fa7b01a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:56.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.527+0000 7fa7b7739700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b01a09f0 con 0x7fa7b01013a0 2023-12-01T00:57:56.530 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.527+0000 7fa7b7739700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b01a0b30 con 0x7fa7b00feea0 2023-12-01T00:57:56.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.527+0000 7fa7b7739700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b01a0cc0 con 0x7fa7b00ff860 2023-12-01T00:57:56.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.527+0000 7fa7b4cd4700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7b00ff860 0x7fa7b01993a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:56.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.527+0000 7fa7b4cd4700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7b00ff860 0x7fa7b01993a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54132/0 (socket says 172.21.15.116:54132) 2023-12-01T00:57:56.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.527+0000 7fa7b4cd4700 1 -- 172.21.15.116:0/2600806013 learned_addr learned my addr 172.21.15.116:0/2600806013 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-12-01T00:57:56.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.527+0000 7fa7b54d5700 1 --2- 172.21.15.116:0/2600806013 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7b00feea0 0x7fa7b0198e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:56.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.527+0000 7fa7b5cd6700 1 --2- 172.21.15.116:0/2600806013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b01013a0 0x7fa7b01a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:56.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.528+0000 7fa7b4cd4700 1 -- 172.21.15.116:0/2600806013 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7b00feea0 msgr2=0x7fa7b0198e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:56.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.528+0000 7fa7b4cd4700 1 --2- 172.21.15.116:0/2600806013 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7b00feea0 0x7fa7b0198e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:56.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.528+0000 7fa7b4cd4700 1 -- 172.21.15.116:0/2600806013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b01013a0 msgr2=0x7fa7b01a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:56.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.528+0000 7fa7b4cd4700 1 --2- 172.21.15.116:0/2600806013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b01013a0 0x7fa7b01a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:56.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.528+0000 7fa7b4cd4700 1 -- 172.21.15.116:0/2600806013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac0095f0 con 0x7fa7b00ff860 2023-12-01T00:57:56.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.528+0000 7fa7b5cd6700 1 --2- 172.21.15.116:0/2600806013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b01013a0 0x7fa7b01a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T00:57:56.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.528+0000 7fa7b4cd4700 1 --2- 172.21.15.116:0/2600806013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7b00ff860 0x7fa7b01993a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac003790 tx=0x7fa7ac00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:56.531 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.528+0000 7fa7a67fc700 1 -- 172.21.15.116:0/2600806013 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac01d070 con 0x7fa7b00ff860 2023-12-01T00:57:56.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.528+0000 7fa7a67fc700 1 -- 172.21.15.116:0/2600806013 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa7ac00fb40 con 0x7fa7b00ff860 2023-12-01T00:57:56.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.528+0000 7fa7b7739700 1 -- 172.21.15.116:0/2600806013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b01a0f40 con 0x7fa7b00ff860 2023-12-01T00:57:56.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.528+0000 7fa7a67fc700 1 -- 172.21.15.116:0/2600806013 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac017650 con 0x7fa7b00ff860 2023-12-01T00:57:56.532 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.528+0000 7fa7b7739700 1 -- 172.21.15.116:0/2600806013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b01a13d0 con 0x7fa7b00ff860 2023-12-01T00:57:56.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.529+0000 7fa7a67fc700 1 -- 172.21.15.116:0/2600806013 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 13) v1 ==== 45324+0+0 (secure 0 0 0) 0x7fa7ac0177b0 con 0x7fa7b00ff860 2023-12-01T00:57:56.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.529+0000 7fa7a67fc700 1 --2- 172.21.15.116:0/2600806013 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa79c0385d0 0x7fa79c03aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:57:56.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.529+0000 7fa7b7739700 1 -- 172.21.15.116:0/2600806013 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b010ad50 con 0x7fa7b00ff860 2023-12-01T00:57:56.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.529+0000 7fa7a67fc700 1 -- 172.21.15.116:0/2600806013 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa7ac04c380 con 0x7fa7b00ff860 2023-12-01T00:57:56.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.529+0000 7fa7b54d5700 1 --2- 172.21.15.116:0/2600806013 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa79c0385d0 0x7fa79c03aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:57:56.533 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.530+0000 7fa7b54d5700 1 --2- 172.21.15.116:0/2600806013 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa79c0385d0 0x7fa79c03aa90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009a10 tx=0x7fa7a0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:57:56.535 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.534+0000 7fa7a67fc700 1 -- 172.21.15.116:0/2600806013 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa7ac027030 con 0x7fa7b00ff860 2023-12-01T00:57:56.738 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.737+0000 7fa7b7739700 1 -- 172.21.15.116:0/2600806013 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi026=x;smithi093=y;smithi116=z", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7b0061260 con 0x7fa79c0385d0 2023-12-01T00:57:56.744 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.743+0000 7fa7a67fc700 1 -- 172.21.15.116:0/2600806013 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fa7b0061260 con 0x7fa79c0385d0 2023-12-01T00:57:56.745 INFO:teuthology.orchestra.run.smithi116.stdout:Scheduled mgr update... 2023-12-01T00:57:56.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.745+0000 7fa7b7739700 1 -- 172.21.15.116:0/2600806013 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa79c0385d0 msgr2=0x7fa79c03aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:56.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.745+0000 7fa7b7739700 1 --2- 172.21.15.116:0/2600806013 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa79c0385d0 0x7fa79c03aa90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0009a10 tx=0x7fa7a0009190 comp rx=0 tx=0).stop 2023-12-01T00:57:56.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.745+0000 7fa7b7739700 1 -- 172.21.15.116:0/2600806013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7b00ff860 msgr2=0x7fa7b01993a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:57:56.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.745+0000 7fa7b7739700 1 --2- 172.21.15.116:0/2600806013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7b00ff860 0x7fa7b01993a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac003790 tx=0x7fa7ac00f690 comp rx=0 tx=0).stop 2023-12-01T00:57:56.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.745+0000 7fa7b7739700 1 -- 172.21.15.116:0/2600806013 shutdown_connections 2023-12-01T00:57:56.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.745+0000 7fa7b7739700 1 --2- 172.21.15.116:0/2600806013 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa79c0385d0 0x7fa79c03aa90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:56.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.745+0000 7fa7b7739700 1 --2- 172.21.15.116:0/2600806013 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7b01013a0 0x7fa7b01a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:56.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.746+0000 7fa7b7739700 1 --2- 172.21.15.116:0/2600806013 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7b00feea0 0x7fa7b0198e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:56.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.746+0000 7fa7b7739700 1 --2- 172.21.15.116:0/2600806013 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa7b00ff860 0x7fa7b01993a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:57:56.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.746+0000 7fa7b7739700 1 -- 172.21.15.116:0/2600806013 >> 172.21.15.116:0/2600806013 conn(0x7fa7b00faa40 msgr2=0x7fa7b00fc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:57:56.747 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.746+0000 7fa7b7739700 1 -- 172.21.15.116:0/2600806013 shutdown_connections 2023-12-01T00:57:56.748 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:57:56.746+0000 7fa7b7739700 1 -- 172.21.15.116:0/2600806013 wait complete. 2023-12-01T00:57:56.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:56 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:56.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:56 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:56.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:56 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:56.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:56 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:56.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:56 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:57:56.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:56 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:57.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:56 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:57.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:56 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:57.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:56 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:57.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:56 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:57.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:56 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:57:57.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:56 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:57.062 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:56 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:57.062 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:56 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:57.062 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:56 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:57.062 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:56 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:57.062 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:56 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:57:57.062 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:56 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:57.119 DEBUG:teuthology.orchestra.run.smithi093:mgr.y> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mgr.y.service 2023-12-01T00:57:57.122 DEBUG:teuthology.orchestra.run.smithi116:mgr.z> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mgr.z.service 2023-12-01T00:57:57.154 INFO:journalctl@ceph.mgr.y.smithi093.stdout:-- Logs begin at Fri 2023-12-01 00:42:14 UTC. -- 2023-12-01T00:57:57.161 INFO:tasks.cephadm:Deploying OSDs... 2023-12-01T00:57:57.161 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T00:57:57.161 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/scratch_devs of=/dev/stdout 2023-12-01T00:57:57.183 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-01T00:57:57.183 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 2023-12-01T00:57:57.191 INFO:journalctl@ceph.mgr.z.smithi116.stdout:-- Logs begin at Fri 2023-12-01 00:41:59 UTC. -- 2023-12-01T00:57:57.244 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-01T00:57:57.244 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T00:57:57.244 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 389826 Links: 1 2023-12-01T00:57:57.245 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T00:57:57.245 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T00:57:57.245 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-12-01 00:57:09.228892992 +0000 2023-12-01T00:57:57.245 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-12-01 00:51:59.407893191 +0000 2023-12-01T00:57:57.245 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-12-01 00:51:59.407893191 +0000 2023-12-01T00:57:57.245 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-12-01T00:57:57.245 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-01T00:57:57.316 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-12-01T00:57:57.316 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-12-01T00:57:57.316 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000132767 s, 3.9 MB/s 2023-12-01T00:57:57.317 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-01T00:57:57.379 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 2023-12-01T00:57:57.438 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-01T00:57:57.438 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T00:57:57.439 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 388410 Links: 1 2023-12-01T00:57:57.439 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T00:57:57.439 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T00:57:57.439 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-12-01 00:57:09.287892115 +0000 2023-12-01T00:57:57.439 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-12-01 00:51:59.934885278 +0000 2023-12-01T00:57:57.439 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-12-01 00:51:59.934885278 +0000 2023-12-01T00:57:57.439 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-12-01T00:57:57.439 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-01T00:57:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-12-01T00:57:57.508 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-12-01T00:57:57.508 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.00012435 s, 4.1 MB/s 2023-12-01T00:57:57.509 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-01T00:57:57.568 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 2023-12-01T00:57:57.627 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-01T00:57:57.627 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T00:57:57.627 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 392433 Links: 1 2023-12-01T00:57:57.627 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T00:57:57.627 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T00:57:57.628 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-12-01 00:57:09.349891195 +0000 2023-12-01T00:57:57.628 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-12-01 00:52:00.464877321 +0000 2023-12-01T00:57:57.628 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-12-01 00:52:00.464877321 +0000 2023-12-01T00:57:57.628 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-12-01T00:57:57.628 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-01T00:57:57.694 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-12-01T00:57:57.695 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-12-01T00:57:57.695 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000106883 s, 4.8 MB/s 2023-12-01T00:57:57.696 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-01T00:57:57.755 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 2023-12-01T00:57:57.813 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-01T00:57:57.813 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T00:57:57.813 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 6h/6d Inode: 390081 Links: 1 2023-12-01T00:57:57.814 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T00:57:57.814 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T00:57:57.814 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-12-01 00:57:09.421890126 +0000 2023-12-01T00:57:57.814 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-12-01 00:52:00.993869378 +0000 2023-12-01T00:57:57.814 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-12-01 00:52:00.993869378 +0000 2023-12-01T00:57:57.814 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2023-12-01T00:57:57.814 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-01T00:57:57.880 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2023-12-01T00:57:57.880 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2023-12-01T00:57:57.880 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000116072 s, 4.4 MB/s 2023-12-01T00:57:57.881 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-01T00:57:57.940 DEBUG:teuthology.orchestra.run.smithi093:> set -ex 2023-12-01T00:57:57.941 DEBUG:teuthology.orchestra.run.smithi093:> dd if=/scratch_devs of=/dev/stdout 2023-12-01T00:57:57.962 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-01T00:57:57.962 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_1 2023-12-01T00:57:58.022 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-01T00:57:58.022 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T00:57:58.022 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 6h/6d Inode: 378861 Links: 1 2023-12-01T00:57:58.022 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T00:57:58.022 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T00:57:58.023 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-12-01 00:57:44.010356803 +0000 2023-12-01T00:57:58.023 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-12-01 00:51:50.753424545 +0000 2023-12-01T00:57:58.023 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-12-01 00:51:50.753424545 +0000 2023-12-01T00:57:58.023 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2023-12-01T00:57:58.023 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-01T00:57:58.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:57 smithi026 ceph-mon[98801]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:58.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:57 smithi026 ceph-mon[98801]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi026=x;smithi093=y;smithi116=z", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:57:58.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:57 smithi026 ceph-mon[98801]: Saving service mgr spec with placement smithi026=x;smithi093=y;smithi116=z;count:3 2023-12-01T00:57:58.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:58.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:58.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:58.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:57:58.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:58.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-01T00:57:58.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-01T00:57:58.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-01T00:57:58.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:58.092 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:57 smithi093 ceph-mon[103327]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:58.092 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:57 smithi093 ceph-mon[103327]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi026=x;smithi093=y;smithi116=z", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:57:58.092 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:57 smithi093 ceph-mon[103327]: Saving service mgr spec with placement smithi026=x;smithi093=y;smithi116=z;count:3 2023-12-01T00:57:58.092 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:57 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:58.092 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:57 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:58.092 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:57 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:58.092 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:57 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:57:58.092 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:57 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:58.092 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:57 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-01T00:57:58.092 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:57 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-01T00:57:58.093 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:57 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-01T00:57:58.093 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:57 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:58.094 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-12-01T00:57:58.095 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-12-01T00:57:58.095 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.0002825 s, 1.8 MB/s 2023-12-01T00:57:58.097 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-01T00:57:58.099 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:57 smithi116 ceph-mon[103554]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:58.099 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:57 smithi116 ceph-mon[103554]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi026=x;smithi093=y;smithi116=z", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:57:58.099 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:57 smithi116 ceph-mon[103554]: Saving service mgr spec with placement smithi026=x;smithi093=y;smithi116=z;count:3 2023-12-01T00:57:58.099 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:57 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:58.099 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:57 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:57:58.099 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:57 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:58.099 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:57 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:57:58.099 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:57 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:58.099 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:57 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-01T00:57:58.100 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:57 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-01T00:57:58.100 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:57 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-01T00:57:58.100 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:57 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:57:58.159 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_2 2023-12-01T00:57:58.221 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-01T00:57:58.221 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T00:57:58.221 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 6h/6d Inode: 386505 Links: 1 2023-12-01T00:57:58.221 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T00:57:58.221 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T00:57:58.221 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-12-01 00:57:44.010356803 +0000 2023-12-01T00:57:58.222 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-12-01 00:51:51.272413110 +0000 2023-12-01T00:57:58.222 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-12-01 00:51:51.272413110 +0000 2023-12-01T00:57:58.222 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2023-12-01T00:57:58.222 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-01T00:57:58.292 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-12-01T00:57:58.293 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-12-01T00:57:58.293 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.00027545 s, 1.9 MB/s 2023-12-01T00:57:58.294 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-01T00:57:58.356 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_3 2023-12-01T00:57:58.417 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-01T00:57:58.417 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T00:57:58.417 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 6h/6d Inode: 386558 Links: 1 2023-12-01T00:57:58.417 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T00:57:58.417 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T00:57:58.417 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-12-01 00:57:44.010356803 +0000 2023-12-01T00:57:58.417 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-12-01 00:51:51.792401652 +0000 2023-12-01T00:57:58.417 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-12-01 00:51:51.792401652 +0000 2023-12-01T00:57:58.418 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2023-12-01T00:57:58.418 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-01T00:57:58.430 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:57:58 smithi116 systemd[1]: Starting Ceph mgr.z for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T00:57:58.488 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-12-01T00:57:58.488 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-12-01T00:57:58.488 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000237496 s, 2.2 MB/s 2023-12-01T00:57:58.490 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-01T00:57:58.552 DEBUG:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_4 2023-12-01T00:57:58.613 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-01T00:57:58.613 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T00:57:58.613 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 6h/6d Inode: 394341 Links: 1 2023-12-01T00:57:58.613 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T00:57:58.614 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T00:57:58.614 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2023-12-01 00:57:44.010356803 +0000 2023-12-01T00:57:58.614 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2023-12-01 00:51:52.315390129 +0000 2023-12-01T00:57:58.614 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2023-12-01 00:51:52.315390129 +0000 2023-12-01T00:57:58.614 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2023-12-01T00:57:58.614 DEBUG:teuthology.orchestra.run.smithi093:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-01T00:57:58.682 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2023-12-01T00:57:58.682 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2023-12-01T00:57:58.682 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000209951 s, 2.4 MB/s 2023-12-01T00:57:58.683 DEBUG:teuthology.orchestra.run.smithi093:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-01T00:57:58.743 DEBUG:teuthology.orchestra.run.smithi116:> set -ex 2023-12-01T00:57:58.743 DEBUG:teuthology.orchestra.run.smithi116:> dd if=/scratch_devs of=/dev/stdout 2023-12-01T00:57:58.750 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:57:58 smithi116 podman[105418]: 2023-12-01T00:57:58.761 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-01T00:57:58.761 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_1 2023-12-01T00:57:58.822 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-01T00:57:58.822 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T00:57:58.822 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 385667 Links: 1 2023-12-01T00:57:58.822 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T00:57:58.822 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T00:57:58.822 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2023-12-01 00:57:58.145579402 +0000 2023-12-01T00:57:58.822 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2023-12-01 00:51:50.774853488 +0000 2023-12-01T00:57:58.822 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2023-12-01 00:51:50.774853488 +0000 2023-12-01T00:57:58.822 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2023-12-01T00:57:58.823 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-01T00:57:58.891 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2023-12-01T00:57:58.891 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2023-12-01T00:57:58.891 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000250658 s, 2.0 MB/s 2023-12-01T00:57:58.893 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-01T00:57:58.951 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_2 2023-12-01T00:57:59.008 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-01T00:57:59.008 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T00:57:59.008 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 391301 Links: 1 2023-12-01T00:57:59.008 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T00:57:59.008 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T00:57:59.008 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2023-12-01 00:57:58.145579402 +0000 2023-12-01T00:57:59.009 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2023-12-01 00:51:51.270845264 +0000 2023-12-01T00:57:59.009 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2023-12-01 00:51:51.270845264 +0000 2023-12-01T00:57:59.009 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2023-12-01T00:57:59.009 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-01T00:57:59.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:58 smithi026 ceph-mon[98801]: Deploying daemon mgr.z on smithi116 2023-12-01T00:57:59.071 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:58 smithi116 ceph-mon[103554]: Deploying daemon mgr.z on smithi116 2023-12-01T00:57:59.071 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:57:58 smithi116 bash[105418]: 746bac22f9397e3c905b6545923be6071d5afed8b5fcf8d718ad4036cb71d0f5 2023-12-01T00:57:59.071 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:57:58 smithi116 ceph-mgr[105463]: -- 172.21.15.116:0/2503355467 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55631a11d1e0 con 0x55631a0f3000 2023-12-01T00:57:59.072 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:57:58 smithi116 systemd[1]: Started Ceph mgr.z for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T00:57:59.072 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:57:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:57:58.903+0000 7f214cba0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-01T00:57:59.072 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:57:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:57:58.984+0000 7f214cba0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-01T00:57:59.073 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2023-12-01T00:57:59.074 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2023-12-01T00:57:59.074 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000226798 s, 2.3 MB/s 2023-12-01T00:57:59.075 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-01T00:57:59.132 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_3 2023-12-01T00:57:59.190 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-01T00:57:59.190 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T00:57:59.190 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 386778 Links: 1 2023-12-01T00:57:59.190 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T00:57:59.190 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T00:57:59.190 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2023-12-01 00:57:58.145579402 +0000 2023-12-01T00:57:59.190 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2023-12-01 00:51:51.768837005 +0000 2023-12-01T00:57:59.190 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2023-12-01 00:51:51.768837005 +0000 2023-12-01T00:57:59.191 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2023-12-01T00:57:59.191 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-01T00:57:59.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:58 smithi093 ceph-mon[103327]: Deploying daemon mgr.z on smithi116 2023-12-01T00:57:59.255 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2023-12-01T00:57:59.255 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2023-12-01T00:57:59.255 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000239335 s, 2.1 MB/s 2023-12-01T00:57:59.256 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-01T00:57:59.318 DEBUG:teuthology.orchestra.run.smithi116:> stat /dev/vg_nvme/lv_4 2023-12-01T00:57:59.349 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:57:59 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:57:59.077+0000 7f214cba0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-01T00:57:59.349 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:57:59 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:57:59.172+0000 7f214cba0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-01T00:57:59.349 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:57:59 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:57:59.348+0000 7f214cba0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-01T00:57:59.366 INFO:teuthology.orchestra.run.smithi116.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-01T00:57:59.366 INFO:teuthology.orchestra.run.smithi116.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-01T00:57:59.366 INFO:teuthology.orchestra.run.smithi116.stdout:Device: 6h/6d Inode: 393580 Links: 1 2023-12-01T00:57:59.366 INFO:teuthology.orchestra.run.smithi116.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T00:57:59.366 INFO:teuthology.orchestra.run.smithi116.stdout:Context: system_u:object_r:device_t:s0 2023-12-01T00:57:59.367 INFO:teuthology.orchestra.run.smithi116.stdout:Access: 2023-12-01 00:57:58.145579402 +0000 2023-12-01T00:57:59.367 INFO:teuthology.orchestra.run.smithi116.stdout:Modify: 2023-12-01 00:51:52.307828066 +0000 2023-12-01T00:57:59.367 INFO:teuthology.orchestra.run.smithi116.stdout:Change: 2023-12-01 00:51:52.307828066 +0000 2023-12-01T00:57:59.367 INFO:teuthology.orchestra.run.smithi116.stdout: Birth: - 2023-12-01T00:57:59.367 DEBUG:teuthology.orchestra.run.smithi116:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-01T00:57:59.431 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records in 2023-12-01T00:57:59.431 INFO:teuthology.orchestra.run.smithi116.stderr:1+0 records out 2023-12-01T00:57:59.432 INFO:teuthology.orchestra.run.smithi116.stderr:512 bytes copied, 0.000211167 s, 2.4 MB/s 2023-12-01T00:57:59.433 DEBUG:teuthology.orchestra.run.smithi116:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-01T00:57:59.491 INFO:tasks.cephadm:Deploying osd.0 on smithi026 with /dev/vg_nvme/lv_4... 2023-12-01T00:57:59.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-01T00:57:59.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:59 smithi026 ceph-mon[98801]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:57:59.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:59.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:59.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:57:59.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-01T00:57:59.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-01T00:57:59.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-01T00:57:59.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:57:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:00.004 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:59 smithi093 ceph-mon[103327]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:00.004 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:00.004 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:00.004 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:00.005 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-01T00:58:00.005 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-01T00:58:00.005 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-01T00:58:00.005 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:57:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:00.031 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:59 smithi116 ceph-mon[103554]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:00.031 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:00.031 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:00.032 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:00.032 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-01T00:58:00.032 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-01T00:58:00.032 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-01T00:58:00.032 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:57:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:00.032 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:57:59 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:57:59.721+0000 7f214cba0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-01T00:58:00.032 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:57:59 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:57:59.850+0000 7f214cba0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-01T00:58:00.032 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:57:59 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:57:59.937+0000 7f214cba0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-01T00:58:00.032 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:00 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:00.030+0000 7f214cba0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-01T00:58:00.062 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T00:58:00.466 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:00 smithi093 systemd[1]: Starting Ceph mgr.y for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T00:58:00.753 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:00 smithi093 podman[104785]: 2023-12-01T00:58:00.753 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:00 smithi093 bash[104785]: f2a97e82b346cbd457702d25e66539cb18ad22724fa03248ca6490d2f786bd6e 2023-12-01T00:58:00.753 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:00 smithi093 ceph-mgr[104825]: -- 172.21.15.93:0/1414158148 <== mon.2 v2:172.21.15.93:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558b35b4f1e0 con 0x558b35b25000 2023-12-01T00:58:00.754 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:00 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:00.446+0000 7f214cba0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-01T00:58:00.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:00 smithi026 ceph-mon[98801]: Deploying daemon mgr.y on smithi093 2023-12-01T00:58:01.023 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:00 smithi093 ceph-mon[103327]: Deploying daemon mgr.y on smithi093 2023-12-01T00:58:01.024 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:00 smithi093 systemd[1]: Started Ceph mgr.y for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T00:58:01.024 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:00 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:00.847+0000 7f006d64b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-01T00:58:01.024 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:00 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:00.931+0000 7f006d64b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-01T00:58:01.024 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:01.021+0000 7f006d64b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-01T00:58:01.111 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:00 smithi116 ceph-mon[103554]: Deploying daemon mgr.y on smithi093 2023-12-01T00:58:01.301 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:01.116+0000 7f006d64b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-01T00:58:01.430 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:01 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:01.110+0000 7f214cba0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-01T00:58:01.430 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:01 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:01.195+0000 7f214cba0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-01T00:58:01.599 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-01T00:58:01.599 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-01T00:58:01.600 INFO:teuthology.orchestra.run.smithi026.stderr: stderr: 10+0 records in 2023-12-01T00:58:01.600 INFO:teuthology.orchestra.run.smithi026.stderr:10+0 records out 2023-12-01T00:58:01.600 INFO:teuthology.orchestra.run.smithi026.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00840405 s, 1.2 GB/s 2023-12-01T00:58:01.600 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping successful for: 2023-12-01T00:58:01.684 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:01.299+0000 7f006d64b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-01T00:58:01.684 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:01.682+0000 7f006d64b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-01T00:58:01.965 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:01.817+0000 7f006d64b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-01T00:58:01.965 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:01.909+0000 7f006d64b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-01T00:58:01.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:01 smithi093 ceph-mon[103327]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:01.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:01 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:01.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:01 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:01.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:01 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:01.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:01 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:01.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:01 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:02.021 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:01 smithi026 ceph-mon[98801]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:02.021 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:01 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:02.021 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:01 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:02.021 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:01 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:02.021 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:01 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:02.021 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:01 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:02.022 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi026:vg_nvme/lv_4 2023-12-01T00:58:02.104 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:02 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:02.001+0000 7f214cba0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-01T00:58:02.104 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:01 smithi116 ceph-mon[103554]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:02.104 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:01 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:02.104 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:01 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:02.104 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:01 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:02.104 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:01 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:02.104 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:01 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:02.430 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:02 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:02.102+0000 7f214cba0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-01T00:58:02.430 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:02 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:02.283+0000 7f214cba0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-01T00:58:02.448 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:02 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:02.005+0000 7f006d64b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-01T00:58:02.580 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T00:58:02.715 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:02 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:02.445+0000 7f006d64b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-01T00:58:02.930 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:02 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:02.572+0000 7f214cba0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-01T00:58:02.930 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:02 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:02.798+0000 7f214cba0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-01T00:58:03.204 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:02 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:02.944+0000 7f214cba0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-01T00:58:03.204 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:03 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:03.203+0000 7f214cba0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-01T00:58:03.465 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:03.111+0000 7f006d64b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-01T00:58:03.465 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:03.193+0000 7f006d64b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-01T00:58:03.747 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:03 smithi026 ceph-mon[98801]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:03.747 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.747 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.747 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.747 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.747 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:03.747 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:03.747 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.747 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:03 smithi026 ceph-mon[98801]: Reconfiguring mgr.x (unknown last config time)... 2023-12-01T00:58:03.748 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-01T00:58:03.748 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-01T00:58:03.748 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:03.748 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:03 smithi026 ceph-mon[98801]: Reconfiguring daemon mgr.x on smithi026 2023-12-01T00:58:03.748 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.896 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:03 smithi116 ceph-mon[103554]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:03.896 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.896 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.896 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.896 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.896 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:03.896 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:03.896 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.897 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:03 smithi116 ceph-mon[103554]: Reconfiguring mgr.x (unknown last config time)... 2023-12-01T00:58:03.897 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-01T00:58:03.897 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-01T00:58:03.897 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:03.897 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:03 smithi116 ceph-mon[103554]: Reconfiguring daemon mgr.x on smithi026 2023-12-01T00:58:03.897 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.945+0000 7fc6cbaee700 1 -- 172.21.15.26:0/1088820318 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6c40ffd20 msgr2=0x7fc6c4100140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:58:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.945+0000 7fc6cbaee700 1 --2- 172.21.15.26:0/1088820318 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6c40ffd20 0x7fc6c4100140 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00099c0 tx=0x7fc6c0009cd0 comp rx=0 tx=0).stop 2023-12-01T00:58:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.945+0000 7fc6cbaee700 1 -- 172.21.15.26:0/1088820318 shutdown_connections 2023-12-01T00:58:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.945+0000 7fc6cbaee700 1 --2- 172.21.15.26:0/1088820318 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6c41018c0 0x7fc6c4108170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.945+0000 7fc6cbaee700 1 --2- 172.21.15.26:0/1088820318 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6c40ffd20 0x7fc6c4100140 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.945+0000 7fc6cbaee700 1 --2- 172.21.15.26:0/1088820318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6c4100f20 0x7fc6c4101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.945+0000 7fc6cbaee700 1 -- 172.21.15.26:0/1088820318 >> 172.21.15.26:0/1088820318 conn(0x7fc6c40fb2a0 msgr2=0x7fc6c40fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:58:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.945+0000 7fc6cbaee700 1 -- 172.21.15.26:0/1088820318 shutdown_connections 2023-12-01T00:58:03.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.945+0000 7fc6cbaee700 1 -- 172.21.15.26:0/1088820318 wait complete. 2023-12-01T00:58:03.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.945+0000 7fc6cbaee700 1 Processor -- start 2023-12-01T00:58:03.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.945+0000 7fc6cbaee700 1 -- start start 2023-12-01T00:58:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6cbaee700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6c40ffd20 0x7fc6c4195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:58:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6cbaee700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6c4100f20 0x7fc6c4196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:58:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6cbaee700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6c41018c0 0x7fc6c419d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:58:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6cbaee700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c419d660 con 0x7fc6c4100f20 2023-12-01T00:58:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6cbaee700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c419d7a0 con 0x7fc6c41018c0 2023-12-01T00:58:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6cbaee700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c4069290 con 0x7fc6c40ffd20 2023-12-01T00:58:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6c9089700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6c4100f20 0x7fc6c4196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:58:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6c9089700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6c4100f20 0x7fc6c4196010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52602/0 (socket says 172.21.15.26:52602) 2023-12-01T00:58:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6c9089700 1 -- 172.21.15.26:0/3615670748 learned_addr learned my addr 172.21.15.26:0/3615670748 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:58:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6c988a700 1 --2- 172.21.15.26:0/3615670748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6c40ffd20 0x7fc6c4195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:58:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6ca08b700 1 --2- 172.21.15.26:0/3615670748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6c41018c0 0x7fc6c419d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:58:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6c9089700 1 -- 172.21.15.26:0/3615670748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6c40ffd20 msgr2=0x7fc6c4195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:58:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6c9089700 1 --2- 172.21.15.26:0/3615670748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6c40ffd20 0x7fc6c4195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6c9089700 1 -- 172.21.15.26:0/3615670748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6c41018c0 msgr2=0x7fc6c419d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:58:03.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6c9089700 1 --2- 172.21.15.26:0/3615670748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6c41018c0 0x7fc6c419d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:03.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6c9089700 1 -- 172.21.15.26:0/3615670748 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c00095f0 con 0x7fc6c4100f20 2023-12-01T00:58:03.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6c9089700 1 --2- 172.21.15.26:0/3615670748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6c4100f20 0x7fc6c4196010 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400d950 tx=0x7fc6b400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:58:03.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6baffd700 1 -- 172.21.15.26:0/3615670748 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b400f890 con 0x7fc6c4100f20 2023-12-01T00:58:03.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6baffd700 1 -- 172.21.15.26:0/3615670748 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc6b4010460 con 0x7fc6c4100f20 2023-12-01T00:58:03.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6cbaee700 1 -- 172.21.15.26:0/3615670748 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c4069570 con 0x7fc6c4100f20 2023-12-01T00:58:03.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6baffd700 1 -- 172.21.15.26:0/3615670748 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b400e610 con 0x7fc6c4100f20 2023-12-01T00:58:03.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.946+0000 7fc6cbaee700 1 -- 172.21.15.26:0/3615670748 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c4069ac0 con 0x7fc6c4100f20 2023-12-01T00:58:03.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.947+0000 7fc6cbaee700 1 -- 172.21.15.26:0/3615670748 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c41072c0 con 0x7fc6c4100f20 2023-12-01T00:58:03.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.948+0000 7fc6baffd700 1 -- 172.21.15.26:0/3615670748 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 13) v1 ==== 45324+0+0 (secure 0 0 0) 0x7fc6b4010960 con 0x7fc6c4100f20 2023-12-01T00:58:03.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.948+0000 7fc6baffd700 1 --2- 172.21.15.26:0/3615670748 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc6b00385d0 0x7fc6b003aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:58:03.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.948+0000 7fc6baffd700 1 -- 172.21.15.26:0/3615670748 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc6b404a710 con 0x7fc6c4100f20 2023-12-01T00:58:03.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.948+0000 7fc6c988a700 1 --2- 172.21.15.26:0/3615670748 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc6b00385d0 0x7fc6b003aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:58:03.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.948+0000 7fc6c988a700 1 --2- 172.21.15.26:0/3615670748 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc6b00385d0 0x7fc6b003aa90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0009990 tx=0x7fc6c0003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:58:03.952 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:03.950+0000 7f006d64b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-01T00:58:03.952 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-mon[103327]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:03.952 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.952 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.952 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.952 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.952 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:03.953 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:03.953 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.953 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-mon[103327]: Reconfiguring mgr.x (unknown last config time)... 2023-12-01T00:58:03.953 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-01T00:58:03.953 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-01T00:58:03.953 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:03.953 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-mon[103327]: Reconfiguring daemon mgr.x on smithi026 2023-12-01T00:58:03.953 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:03.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:03.953+0000 7fc6baffd700 1 -- 172.21.15.26:0/3615670748 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc6b4009930 con 0x7fc6c4100f20 2023-12-01T00:58:04.167 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:04.166+0000 7fc6cbaee700 1 -- 172.21.15.26:0/3615670748 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6c402cce0 con 0x7fc6b00385d0 2023-12-01T00:58:04.180 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:03 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:03.894+0000 7f214cba0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-01T00:58:04.180 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:04 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:04.025+0000 7f214cba0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-01T00:58:04.211 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:04 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:04.039+0000 7f006d64b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-01T00:58:04.465 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:04 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:04.209+0000 7f006d64b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-01T00:58:04.551 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:04 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:04.216+0000 7f214cba0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-01T00:58:04.551 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:04 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:04.330+0000 7f214cba0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-01T00:58:04.860 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:04 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:04.488+0000 7f006d64b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-01T00:58:04.860 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:04 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:04.710+0000 7f006d64b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-01T00:58:04.860 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:04 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:04.858+0000 7f006d64b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-01T00:58:04.860 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:58:04.860 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:58:04.860 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:04.861 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:04.861 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:04.861 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:04.861 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:04.861 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:04.861 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:04.930 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:04 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:04.549+0000 7f214cba0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-01T00:58:04.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:58:04.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:58:04.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:04.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:04.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:04.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:04.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:04.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:04.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:04.977 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:58:04.977 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:58:04.977 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:04.978 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:04.978 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:04.978 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:04.978 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:04.978 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:04.978 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:05.465 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:05 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:05.120+0000 7f006d64b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-01T00:58:05.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:05.565+0000 7fc6baffd700 1 -- 172.21.15.26:0/3615670748 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 14) v1 ==== 90169+0+0 (secure 0 0 0) 0x7fc6b4005030 con 0x7fc6c4100f20 2023-12-01T00:58:05.681 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 00:58:05 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z[105434]: 2023-12-01T00:58:05.400+0000 7f214cba0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-01T00:58:05.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:05 smithi116 ceph-mon[103554]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:05.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:05 smithi116 ceph-mon[103554]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:58:05.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:05 smithi116 ceph-mon[103554]: Standby manager daemon z started 2023-12-01T00:58:05.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:05 smithi116 ceph-mon[103554]: from='mgr.? 172.21.15.116:0/2552953435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-01T00:58:05.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:05 smithi116 ceph-mon[103554]: from='mgr.? 172.21.15.116:0/2552953435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-01T00:58:05.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:05 smithi116 ceph-mon[103554]: from='mgr.? 172.21.15.116:0/2552953435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-01T00:58:05.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:05 smithi116 ceph-mon[103554]: from='mgr.? 172.21.15.116:0/2552953435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-01T00:58:05.814 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:05 smithi093 ceph-mon[103327]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:05.814 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:05 smithi093 ceph-mon[103327]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:58:05.814 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:05 smithi093 ceph-mon[103327]: Standby manager daemon z started 2023-12-01T00:58:05.814 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:05 smithi093 ceph-mon[103327]: from='mgr.? 172.21.15.116:0/2552953435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-01T00:58:05.815 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:05 smithi093 ceph-mon[103327]: from='mgr.? 172.21.15.116:0/2552953435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-01T00:58:05.815 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:05 smithi093 ceph-mon[103327]: from='mgr.? 172.21.15.116:0/2552953435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-01T00:58:05.815 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:05 smithi093 ceph-mon[103327]: from='mgr.? 172.21.15.116:0/2552953435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-01T00:58:05.826 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:05 smithi026 ceph-mon[98801]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:05.826 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:05 smithi026 ceph-mon[98801]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:58:05.826 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:05 smithi026 ceph-mon[98801]: Standby manager daemon z started 2023-12-01T00:58:05.826 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:05 smithi026 ceph-mon[98801]: from='mgr.? 172.21.15.116:0/2552953435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-01T00:58:05.826 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:05 smithi026 ceph-mon[98801]: from='mgr.? 172.21.15.116:0/2552953435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-01T00:58:05.826 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:05 smithi026 ceph-mon[98801]: from='mgr.? 172.21.15.116:0/2552953435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-01T00:58:05.827 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:05 smithi026 ceph-mon[98801]: from='mgr.? 172.21.15.116:0/2552953435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-01T00:58:06.136 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:05 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:05.812+0000 7f006d64b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-01T00:58:06.137 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:05 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:05.942+0000 7f006d64b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-01T00:58:06.465 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:06 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:06.135+0000 7f006d64b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-01T00:58:06.465 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:06 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:06.248+0000 7f006d64b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-01T00:58:06.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:06 smithi116 ceph-mon[103554]: mgrmap e14: x(active, since 67s), standbys: z 2023-12-01T00:58:06.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:06 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-01T00:58:06.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:06 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1001471394' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b914664-c721-4904-8454-92092f5ea9d1"}]: dispatch 2023-12-01T00:58:06.965 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:06 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:06.464+0000 7f006d64b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-01T00:58:06.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:06 smithi093 ceph-mon[103327]: mgrmap e14: x(active, since 67s), standbys: z 2023-12-01T00:58:06.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:06 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-01T00:58:06.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:06 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1001471394' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b914664-c721-4904-8454-92092f5ea9d1"}]: dispatch 2023-12-01T00:58:07.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:06 smithi026 ceph-mon[98801]: mgrmap e14: x(active, since 67s), standbys: z 2023-12-01T00:58:07.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:06 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-01T00:58:07.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:06 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1001471394' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4b914664-c721-4904-8454-92092f5ea9d1"}]: dispatch 2023-12-01T00:58:07.567 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 00:58:07 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y[104801]: 2023-12-01T00:58:07.314+0000 7f006d64b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-01T00:58:07.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:07.577+0000 7fc6baffd700 1 -- 172.21.15.26:0/3615670748 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mgrmap(e 15) v1 ==== 135014+0+0 (secure 0 0 0) 0x7fc6b400f9f0 con 0x7fc6c4100f20 2023-12-01T00:58:07.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:07 smithi116 ceph-mon[103554]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:07.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:07 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1001471394' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b914664-c721-4904-8454-92092f5ea9d1"}]': finished 2023-12-01T00:58:07.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:07 smithi116 ceph-mon[103554]: osdmap e5: 1 total, 0 up, 1 in 2023-12-01T00:58:07.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:07 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:07.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:07 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/294968287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:58:07.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:07 smithi116 ceph-mon[103554]: Standby manager daemon y started 2023-12-01T00:58:07.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:07 smithi116 ceph-mon[103554]: from='mgr.? 172.21.15.93:0/377029044' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-01T00:58:07.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:07 smithi116 ceph-mon[103554]: from='mgr.? 172.21.15.93:0/377029044' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-01T00:58:07.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:07 smithi116 ceph-mon[103554]: from='mgr.? 172.21.15.93:0/377029044' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-01T00:58:07.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:07 smithi116 ceph-mon[103554]: from='mgr.? 172.21.15.93:0/377029044' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-01T00:58:07.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:07 smithi093 ceph-mon[103327]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:07.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:07 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1001471394' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b914664-c721-4904-8454-92092f5ea9d1"}]': finished 2023-12-01T00:58:07.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:07 smithi093 ceph-mon[103327]: osdmap e5: 1 total, 0 up, 1 in 2023-12-01T00:58:07.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:07 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:07.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:07 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/294968287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:58:07.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:07 smithi093 ceph-mon[103327]: Standby manager daemon y started 2023-12-01T00:58:07.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:07 smithi093 ceph-mon[103327]: from='mgr.? 172.21.15.93:0/377029044' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-01T00:58:07.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:07 smithi093 ceph-mon[103327]: from='mgr.? 172.21.15.93:0/377029044' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-01T00:58:07.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:07 smithi093 ceph-mon[103327]: from='mgr.? 172.21.15.93:0/377029044' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-01T00:58:07.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:07 smithi093 ceph-mon[103327]: from='mgr.? 172.21.15.93:0/377029044' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-01T00:58:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:07 smithi026 ceph-mon[98801]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:07 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1001471394' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4b914664-c721-4904-8454-92092f5ea9d1"}]': finished 2023-12-01T00:58:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:07 smithi026 ceph-mon[98801]: osdmap e5: 1 total, 0 up, 1 in 2023-12-01T00:58:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:07 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:07 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/294968287' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:58:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:07 smithi026 ceph-mon[98801]: Standby manager daemon y started 2023-12-01T00:58:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:07 smithi026 ceph-mon[98801]: from='mgr.? 172.21.15.93:0/377029044' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-01T00:58:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:07 smithi026 ceph-mon[98801]: from='mgr.? 172.21.15.93:0/377029044' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-01T00:58:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:07 smithi026 ceph-mon[98801]: from='mgr.? 172.21.15.93:0/377029044' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-01T00:58:08.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:07 smithi026 ceph-mon[98801]: from='mgr.? 172.21.15.93:0/377029044' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-01T00:58:08.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:08 smithi116 ceph-mon[103554]: mgrmap e15: x(active, since 69s), standbys: z, y 2023-12-01T00:58:08.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:08 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-01T00:58:08.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:08 smithi093 ceph-mon[103327]: mgrmap e15: x(active, since 69s), standbys: z, y 2023-12-01T00:58:08.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:08 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-01T00:58:09.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:08 smithi026 ceph-mon[98801]: mgrmap e15: x(active, since 69s), standbys: z, y 2023-12-01T00:58:09.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:08 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-01T00:58:09.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:09 smithi116 ceph-mon[103554]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:09.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:09 smithi093 ceph-mon[103327]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:10.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:09 smithi026 ceph-mon[98801]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:11.770 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:11 smithi026 ceph-mon[98801]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:11.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:11 smithi116 ceph-mon[103554]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:11.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:11 smithi093 ceph-mon[103327]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:13.877 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:13 smithi026 ceph-mon[98801]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:13.877 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:13 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-01T00:58:13.877 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:13 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:13.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:13 smithi116 ceph-mon[103554]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:13.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:13 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-01T00:58:13.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:13 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:13.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:13 smithi093 ceph-mon[103327]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:13.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:13 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-01T00:58:13.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:13 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:14.925 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:14 smithi026 ceph-mon[98801]: Deploying daemon osd.0 on smithi026 2023-12-01T00:58:14.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:14 smithi116 ceph-mon[103554]: Deploying daemon osd.0 on smithi026 2023-12-01T00:58:14.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:14 smithi093 ceph-mon[103327]: Deploying daemon osd.0 on smithi026 2023-12-01T00:58:15.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:15 smithi116 ceph-mon[103554]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:15.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:15 smithi093 ceph-mon[103327]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:16.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:15 smithi026 ceph-mon[98801]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:17.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:17 smithi026 ceph-mon[98801]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:17.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:17 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:17.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:17 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:17.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:17 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:17.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:17 smithi116 ceph-mon[103554]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:17.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:17 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:17.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:17 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:17.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:17 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:17.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:17 smithi093 ceph-mon[103327]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:17.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:17 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:17.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:17 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:17.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:17 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:19.875 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:19 smithi026 ceph-mon[98801]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:19.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:19 smithi116 ceph-mon[103554]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:19.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:19 smithi093 ceph-mon[103327]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:20.270 INFO:teuthology.orchestra.run.smithi026.stdout:Created osd(s) 0 on host 'smithi026' 2023-12-01T00:58:20.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:20.267+0000 7fc6baffd700 1 -- 172.21.15.26:0/3615670748 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc6c402cce0 con 0x7fc6b00385d0 2023-12-01T00:58:20.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:20.269+0000 7fc6cbaee700 1 -- 172.21.15.26:0/3615670748 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc6b00385d0 msgr2=0x7fc6b003aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:58:20.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:20.269+0000 7fc6cbaee700 1 --2- 172.21.15.26:0/3615670748 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc6b00385d0 0x7fc6b003aa90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0009990 tx=0x7fc6c0003680 comp rx=0 tx=0).stop 2023-12-01T00:58:20.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:20.270+0000 7fc6cbaee700 1 -- 172.21.15.26:0/3615670748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6c4100f20 msgr2=0x7fc6c4196010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:58:20.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:20.270+0000 7fc6cbaee700 1 --2- 172.21.15.26:0/3615670748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6c4100f20 0x7fc6c4196010 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400d950 tx=0x7fc6b400dc60 comp rx=0 tx=0).stop 2023-12-01T00:58:20.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:20.270+0000 7fc6cbaee700 1 -- 172.21.15.26:0/3615670748 shutdown_connections 2023-12-01T00:58:20.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:20.270+0000 7fc6cbaee700 1 --2- 172.21.15.26:0/3615670748 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc6b00385d0 0x7fc6b003aa90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:20.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:20.270+0000 7fc6cbaee700 1 --2- 172.21.15.26:0/3615670748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc6c41018c0 0x7fc6c419d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:20.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:20.270+0000 7fc6cbaee700 1 --2- 172.21.15.26:0/3615670748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc6c40ffd20 0x7fc6c4195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:20.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:20.270+0000 7fc6cbaee700 1 --2- 172.21.15.26:0/3615670748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc6c4100f20 0x7fc6c4196010 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:20.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:20.270+0000 7fc6cbaee700 1 -- 172.21.15.26:0/3615670748 >> 172.21.15.26:0/3615670748 conn(0x7fc6c40fb2a0 msgr2=0x7fc6c4104400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:58:20.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:20.270+0000 7fc6cbaee700 1 -- 172.21.15.26:0/3615670748 shutdown_connections 2023-12-01T00:58:20.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:58:20.270+0000 7fc6cbaee700 1 -- 172.21.15.26:0/3615670748 wait complete. 2023-12-01T00:58:20.671 DEBUG:teuthology.orchestra.run.smithi026:osd.0> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.0.service 2023-12-01T00:58:20.674 INFO:tasks.cephadm:Deploying osd.1 on smithi093 with /dev/vg_nvme/lv_4... 2023-12-01T00:58:20.674 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-01T00:58:20.704 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:20 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:20.704 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:20 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:20.704 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:20 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:20.704 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:20 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:20.704 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:20 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:20.704 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:20 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:20.704 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:20 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:20.704 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:20 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:20.711 INFO:journalctl@ceph.osd.0.smithi026.stdout:-- Logs begin at Fri 2023-12-01 00:41:45 UTC. -- 2023-12-01T00:58:20.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:20 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:20.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:20 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:20.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:20 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:20.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:20 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:20.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:20 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:20.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:20 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:20.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:20 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:20.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:20 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:20.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:20 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:20.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:20 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:20.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:20 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:20.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:20 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:20.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:20 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:20.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:20 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:20.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:20 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:20.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:20 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:21.219 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.b/config 2023-12-01T00:58:21.758 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:21 smithi026 ceph-mon[98801]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:21.758 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:21 smithi026 ceph-mon[98801]: from='osd.0 [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-01T00:58:21.759 INFO:journalctl@ceph.osd.0.smithi026.stdout:Dec 01 00:58:21 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-0[117435]: 2023-12-01T00:58:21.470+0000 7f3a89d2e640 -1 osd.0 0 log_to_monitors true 2023-12-01T00:58:21.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:21 smithi116 ceph-mon[103554]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:21.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:21 smithi116 ceph-mon[103554]: from='osd.0 [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-01T00:58:21.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:21 smithi093 ceph-mon[103327]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:21.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:21 smithi093 ceph-mon[103327]: from='osd.0 [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-01T00:58:22.591 INFO:teuthology.orchestra.run.smithi093.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-01T00:58:22.592 INFO:teuthology.orchestra.run.smithi093.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-01T00:58:22.592 INFO:teuthology.orchestra.run.smithi093.stderr: stderr: 10+0 records in 2023-12-01T00:58:22.592 INFO:teuthology.orchestra.run.smithi093.stderr:10+0 records out 2023-12-01T00:58:22.592 INFO:teuthology.orchestra.run.smithi093.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109113 s, 961 MB/s 2023-12-01T00:58:22.592 INFO:teuthology.orchestra.run.smithi093.stderr:--> Zapping successful for: 2023-12-01T00:58:22.941 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:22 smithi093 ceph-mon[103327]: from='osd.0 [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-01T00:58:22.941 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:22 smithi093 ceph-mon[103327]: osdmap e6: 1 total, 0 up, 1 in 2023-12-01T00:58:22.941 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:22 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:22.941 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:22 smithi093 ceph-mon[103327]: from='osd.0 [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2023-12-01T00:58:22.941 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:22 smithi093 ceph-mon[103327]: from='osd.0 [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2023-12-01T00:58:22.941 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:22 smithi093 ceph-mon[103327]: osdmap e7: 1 total, 0 up, 1 in 2023-12-01T00:58:22.941 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:22 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:22.959 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi093:vg_nvme/lv_4 2023-12-01T00:58:23.001 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:22 smithi026 ceph-mon[98801]: from='osd.0 [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-01T00:58:23.002 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:22 smithi026 ceph-mon[98801]: osdmap e6: 1 total, 0 up, 1 in 2023-12-01T00:58:23.002 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:22 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:23.002 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:22 smithi026 ceph-mon[98801]: from='osd.0 [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2023-12-01T00:58:23.002 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:22 smithi026 ceph-mon[98801]: from='osd.0 [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2023-12-01T00:58:23.002 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:22 smithi026 ceph-mon[98801]: osdmap e7: 1 total, 0 up, 1 in 2023-12-01T00:58:23.002 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:22 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:23.002 INFO:journalctl@ceph.osd.0.smithi026.stdout:Dec 01 00:58:22 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-0[117435]: 2023-12-01T00:58:22.677+0000 7f3a7f3a5700 -1 osd.0 0 waiting for initial osdmap 2023-12-01T00:58:23.002 INFO:journalctl@ceph.osd.0.smithi026.stdout:Dec 01 00:58:22 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-0[117435]: 2023-12-01T00:58:22.681+0000 7f3a77192700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T00:58:23.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:22 smithi116 ceph-mon[103554]: from='osd.0 [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-01T00:58:23.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:22 smithi116 ceph-mon[103554]: osdmap e6: 1 total, 0 up, 1 in 2023-12-01T00:58:23.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:22 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:23.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:22 smithi116 ceph-mon[103554]: from='osd.0 [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2023-12-01T00:58:23.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:22 smithi116 ceph-mon[103554]: from='osd.0 [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2023-12-01T00:58:23.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:22 smithi116 ceph-mon[103554]: osdmap e7: 1 total, 0 up, 1 in 2023-12-01T00:58:23.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:22 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:23.508 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.b/config 2023-12-01T00:58:23.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:23 smithi093 ceph-mon[103327]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:23.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:23 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:23.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:23 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:23.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:23 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:23.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:23 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:58:23.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:23 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:23.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:23 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:23.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:23 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:23.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:23 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:23.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:23 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:24.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:23 smithi026 ceph-mon[98801]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:24.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:24.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:24.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:24.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:58:24.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:24.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:24.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:24.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:24.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:24.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:23 smithi116 ceph-mon[103554]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:24.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:23 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:24.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:23 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:24.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:23 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:24.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:23 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:58:24.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:23 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:24.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:23 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:24.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:23 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:24.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:23 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:24.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:23 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:24.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.689+0000 7f2c789ca700 1 -- 172.21.15.93:0/1581788542 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c74102180 msgr2=0x7f2c741025e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:58:24.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.689+0000 7f2c789ca700 1 --2- 172.21.15.93:0/1581788542 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c74102180 0x7f2c741025e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009990 tx=0x7f2c64009ca0 comp rx=0 tx=0).stop 2023-12-01T00:58:24.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.689+0000 7f2c789ca700 1 -- 172.21.15.93:0/1581788542 shutdown_connections 2023-12-01T00:58:24.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.689+0000 7f2c789ca700 1 --2- 172.21.15.93:0/1581788542 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74102b20 0x7f2c741093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:24.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.689+0000 7f2c789ca700 1 --2- 172.21.15.93:0/1581788542 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c740ff100 0x7f2c740ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:24.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.689+0000 7f2c789ca700 1 --2- 172.21.15.93:0/1581788542 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c74102180 0x7f2c741025e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:24.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.689+0000 7f2c789ca700 1 -- 172.21.15.93:0/1581788542 >> 172.21.15.93:0/1581788542 conn(0x7f2c740faa40 msgr2=0x7f2c740fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:58:24.691 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.689+0000 7f2c789ca700 1 -- 172.21.15.93:0/1581788542 shutdown_connections 2023-12-01T00:58:24.692 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.689+0000 7f2c789ca700 1 -- 172.21.15.93:0/1581788542 wait complete. 2023-12-01T00:58:24.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.690+0000 7f2c789ca700 1 Processor -- start 2023-12-01T00:58:24.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.690+0000 7f2c789ca700 1 -- start start 2023-12-01T00:58:24.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.690+0000 7f2c789ca700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c740ff100 0x7f2c74196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:58:24.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.690+0000 7f2c789ca700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c74102180 0x7f2c74197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:58:24.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.690+0000 7f2c789ca700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74102b20 0x7f2c7419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:58:24.693 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.690+0000 7f2c789ca700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7419e770 con 0x7f2c74102b20 2023-12-01T00:58:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.690+0000 7f2c789ca700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7419e8b0 con 0x7f2c740ff100 2023-12-01T00:58:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.690+0000 7f2c789ca700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7419ea70 con 0x7f2c74102180 2023-12-01T00:58:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.690+0000 7f2c7259c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c740ff100 0x7f2c74196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:58:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.690+0000 7f2c7259c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c740ff100 0x7f2c74196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:49398/0 (socket says 172.21.15.93:49398) 2023-12-01T00:58:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.690+0000 7f2c7259c700 1 -- 172.21.15.93:0/2928932836 learned_addr learned my addr 172.21.15.93:0/2928932836 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-01T00:58:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.691+0000 7f2c7259c700 1 -- 172.21.15.93:0/2928932836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c74102180 msgr2=0x7f2c74197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:58:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.691+0000 7f2c7259c700 1 --2- 172.21.15.93:0/2928932836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c74102180 0x7f2c74197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.691+0000 7f2c72d9d700 1 --2- 172.21.15.93:0/2928932836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74102b20 0x7f2c7419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:58:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.691+0000 7f2c7259c700 1 -- 172.21.15.93:0/2928932836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74102b20 msgr2=0x7f2c7419e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:58:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.691+0000 7f2c7259c700 1 --2- 172.21.15.93:0/2928932836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74102b20 0x7f2c7419e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.691+0000 7f2c7259c700 1 -- 172.21.15.93:0/2928932836 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c640095f0 con 0x7f2c740ff100 2023-12-01T00:58:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.691+0000 7f2c7259c700 1 --2- 172.21.15.93:0/2928932836 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c740ff100 0x7f2c74196c20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800c970 tx=0x7f2c6800cd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:58:24.694 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.691+0000 7f2c637fe700 1 -- 172.21.15.93:0/2928932836 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68004220 con 0x7f2c740ff100 2023-12-01T00:58:24.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.691+0000 7f2c637fe700 1 -- 172.21.15.93:0/2928932836 <== mon.2 v2:172.21.15.93:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2c68007d80 con 0x7f2c740ff100 2023-12-01T00:58:24.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.691+0000 7f2c789ca700 1 -- 172.21.15.93:0/2928932836 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c7419ed50 con 0x7f2c740ff100 2023-12-01T00:58:24.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.691+0000 7f2c637fe700 1 -- 172.21.15.93:0/2928932836 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68003d70 con 0x7f2c740ff100 2023-12-01T00:58:24.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.691+0000 7f2c789ca700 1 -- 172.21.15.93:0/2928932836 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c7419f1a0 con 0x7f2c740ff100 2023-12-01T00:58:24.695 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.692+0000 7f2c789ca700 1 -- 172.21.15.93:0/2928932836 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c74108530 con 0x7f2c740ff100 2023-12-01T00:58:24.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.693+0000 7f2c637fe700 1 -- 172.21.15.93:0/2928932836 <== mon.2 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 15) v1 ==== 135014+0+0 (secure 0 0 0) 0x7f2c68004380 con 0x7f2c740ff100 2023-12-01T00:58:24.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.694+0000 7f2c637fe700 1 --2- 172.21.15.93:0/2928932836 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2c5c0a0490 0x7f2c5c0a2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:58:24.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.694+0000 7f2c637fe700 1 -- 172.21.15.93:0/2928932836 <== mon.2 v2:172.21.15.93:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f2c680c9f40 con 0x7f2c740ff100 2023-12-01T00:58:24.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.694+0000 7f2c71d9b700 1 --2- 172.21.15.93:0/2928932836 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2c5c0a0490 0x7f2c5c0a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:58:24.696 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.694+0000 7f2c71d9b700 1 --2- 172.21.15.93:0/2928932836 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2c5c0a0490 0x7f2c5c0a2950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2c640095c0 tx=0x7f2c64009510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:58:24.699 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.697+0000 7f2c637fe700 1 -- 172.21.15.93:0/2928932836 <== mon.2 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2c68095550 con 0x7f2c740ff100 2023-12-01T00:58:24.892 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:24.891+0000 7f2c789ca700 1 -- 172.21.15.93:0/2928932836 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f2c740611d0 con 0x7f2c5c0a0490 2023-12-01T00:58:24.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:24 smithi093 ceph-mon[103327]: purged_snaps scrub starts 2023-12-01T00:58:24.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:24 smithi093 ceph-mon[103327]: purged_snaps scrub ok 2023-12-01T00:58:24.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:24 smithi093 ceph-mon[103327]: Detected new or changed devices on smithi026 2023-12-01T00:58:24.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:24 smithi093 ceph-mon[103327]: Adjusting osd_memory_target on smithi026 to 17173M 2023-12-01T00:58:24.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:24 smithi093 ceph-mon[103327]: osd.0 [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148] boot 2023-12-01T00:58:24.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:24 smithi093 ceph-mon[103327]: osdmap e8: 1 total, 1 up, 1 in 2023-12-01T00:58:24.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:25.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:24 smithi026 ceph-mon[98801]: purged_snaps scrub starts 2023-12-01T00:58:25.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:24 smithi026 ceph-mon[98801]: purged_snaps scrub ok 2023-12-01T00:58:25.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:24 smithi026 ceph-mon[98801]: Detected new or changed devices on smithi026 2023-12-01T00:58:25.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:24 smithi026 ceph-mon[98801]: Adjusting osd_memory_target on smithi026 to 17173M 2023-12-01T00:58:25.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:24 smithi026 ceph-mon[98801]: osd.0 [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148] boot 2023-12-01T00:58:25.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:24 smithi026 ceph-mon[98801]: osdmap e8: 1 total, 1 up, 1 in 2023-12-01T00:58:25.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:25.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:24 smithi116 ceph-mon[103554]: purged_snaps scrub starts 2023-12-01T00:58:25.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:24 smithi116 ceph-mon[103554]: purged_snaps scrub ok 2023-12-01T00:58:25.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:24 smithi116 ceph-mon[103554]: Detected new or changed devices on smithi026 2023-12-01T00:58:25.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:24 smithi116 ceph-mon[103554]: Adjusting osd_memory_target on smithi026 to 17173M 2023-12-01T00:58:25.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:24 smithi116 ceph-mon[103554]: osd.0 [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148] boot 2023-12-01T00:58:25.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:24 smithi116 ceph-mon[103554]: osdmap e8: 1 total, 1 up, 1 in 2023-12-01T00:58:25.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-01T00:58:25.953 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:25 smithi093 ceph-mon[103327]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:25.954 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:58:25.954 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:58:25.954 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:25.954 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:25 smithi093 ceph-mon[103327]: osdmap e9: 1 total, 1 up, 1 in 2023-12-01T00:58:26.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:25 smithi026 ceph-mon[98801]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:26.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:58:26.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:58:26.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:26.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:25 smithi026 ceph-mon[98801]: osdmap e9: 1 total, 1 up, 1 in 2023-12-01T00:58:26.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:25 smithi116 ceph-mon[103554]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-01T00:58:26.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:58:26.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:58:26.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:26.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:25 smithi116 ceph-mon[103554]: osdmap e9: 1 total, 1 up, 1 in 2023-12-01T00:58:26.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:26 smithi093 ceph-mon[103327]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:58:27.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:26 smithi026 ceph-mon[98801]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:58:27.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:26 smithi116 ceph-mon[103554]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:58:27.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:27 smithi093 ceph-mon[103327]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:27.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:27 smithi093 ceph-mon[103327]: from='client.? 172.21.15.93:0/1165195833' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b539f82-17c1-4f64-8246-fcd50237089c"}]: dispatch 2023-12-01T00:58:27.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:27 smithi093 ceph-mon[103327]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b539f82-17c1-4f64-8246-fcd50237089c"}]: dispatch 2023-12-01T00:58:27.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:27 smithi093 ceph-mon[103327]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b539f82-17c1-4f64-8246-fcd50237089c"}]': finished 2023-12-01T00:58:27.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:27 smithi093 ceph-mon[103327]: osdmap e10: 2 total, 1 up, 2 in 2023-12-01T00:58:27.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:27 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-01T00:58:28.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:27 smithi026 ceph-mon[98801]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:28.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:27 smithi026 ceph-mon[98801]: from='client.? 172.21.15.93:0/1165195833' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b539f82-17c1-4f64-8246-fcd50237089c"}]: dispatch 2023-12-01T00:58:28.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:27 smithi026 ceph-mon[98801]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b539f82-17c1-4f64-8246-fcd50237089c"}]: dispatch 2023-12-01T00:58:28.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:27 smithi026 ceph-mon[98801]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b539f82-17c1-4f64-8246-fcd50237089c"}]': finished 2023-12-01T00:58:28.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:27 smithi026 ceph-mon[98801]: osdmap e10: 2 total, 1 up, 2 in 2023-12-01T00:58:28.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:27 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-01T00:58:28.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:27 smithi116 ceph-mon[103554]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:28.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:27 smithi116 ceph-mon[103554]: from='client.? 172.21.15.93:0/1165195833' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b539f82-17c1-4f64-8246-fcd50237089c"}]: dispatch 2023-12-01T00:58:28.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:27 smithi116 ceph-mon[103554]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0b539f82-17c1-4f64-8246-fcd50237089c"}]: dispatch 2023-12-01T00:58:28.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:27 smithi116 ceph-mon[103554]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0b539f82-17c1-4f64-8246-fcd50237089c"}]': finished 2023-12-01T00:58:28.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:27 smithi116 ceph-mon[103554]: osdmap e10: 2 total, 1 up, 2 in 2023-12-01T00:58:28.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:27 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-01T00:58:29.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:28 smithi026 ceph-mon[98801]: from='client.? 172.21.15.93:0/1165558633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:58:29.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:28 smithi116 ceph-mon[103554]: from='client.? 172.21.15.93:0/1165558633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:58:29.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:28 smithi093 ceph-mon[103327]: from='client.? 172.21.15.93:0/1165558633' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:58:30.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:29 smithi026 ceph-mon[98801]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:30.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:29 smithi116 ceph-mon[103554]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:30.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:29 smithi093 ceph-mon[103327]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:32.042 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:31 smithi093 ceph-mon[103327]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:32.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:31 smithi026 ceph-mon[98801]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:32.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:31 smithi116 ceph-mon[103554]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:33.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:33 smithi093 ceph-mon[103327]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:33.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:33 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-01T00:58:33.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:33 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:34.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:33 smithi026 ceph-mon[98801]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:34.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:33 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-01T00:58:34.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:33 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:34.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:33 smithi116 ceph-mon[103554]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:34.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:33 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-01T00:58:34.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:33 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:34.984 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:34 smithi093 ceph-mon[103327]: Deploying daemon osd.1 on smithi093 2023-12-01T00:58:35.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:34 smithi026 ceph-mon[98801]: Deploying daemon osd.1 on smithi093 2023-12-01T00:58:35.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:34 smithi116 ceph-mon[103554]: Deploying daemon osd.1 on smithi093 2023-12-01T00:58:35.934 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:35 smithi093 ceph-mon[103327]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:36.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:35 smithi026 ceph-mon[98801]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:36.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:35 smithi116 ceph-mon[103554]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:37.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:37 smithi093 ceph-mon[103327]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:37.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:37 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:38.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:37 smithi026 ceph-mon[98801]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:38.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:37 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:38.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:37 smithi116 ceph-mon[103554]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:38.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:37 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:38.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:38 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:38.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:38 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:39.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:38 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:39.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:38 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:39.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:38 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:39.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:38 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:39.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:39 smithi093 ceph-mon[103327]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:40.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:39 smithi026 ceph-mon[98801]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:40.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:39 smithi116 ceph-mon[103554]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:40.507 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:40.506+0000 7f2c637fe700 1 -- 172.21.15.93:0/2928932836 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2c740611d0 con 0x7f2c5c0a0490 2023-12-01T00:58:40.508 INFO:teuthology.orchestra.run.smithi093.stdout:Created osd(s) 1 on host 'smithi093' 2023-12-01T00:58:40.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:40.508+0000 7f2c789ca700 1 -- 172.21.15.93:0/2928932836 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2c5c0a0490 msgr2=0x7f2c5c0a2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:58:40.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:40.508+0000 7f2c789ca700 1 --2- 172.21.15.93:0/2928932836 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2c5c0a0490 0x7f2c5c0a2950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2c640095c0 tx=0x7f2c64009510 comp rx=0 tx=0).stop 2023-12-01T00:58:40.509 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:40.508+0000 7f2c789ca700 1 -- 172.21.15.93:0/2928932836 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c740ff100 msgr2=0x7f2c74196c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:58:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:40.508+0000 7f2c789ca700 1 --2- 172.21.15.93:0/2928932836 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c740ff100 0x7f2c74196c20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2c6800c970 tx=0x7f2c6800cd30 comp rx=0 tx=0).stop 2023-12-01T00:58:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:40.509+0000 7f2c789ca700 1 -- 172.21.15.93:0/2928932836 shutdown_connections 2023-12-01T00:58:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:40.509+0000 7f2c789ca700 1 --2- 172.21.15.93:0/2928932836 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2c5c0a0490 0x7f2c5c0a2950 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:40.509+0000 7f2c789ca700 1 --2- 172.21.15.93:0/2928932836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2c74102b20 0x7f2c7419e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:40.509+0000 7f2c789ca700 1 --2- 172.21.15.93:0/2928932836 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2c740ff100 0x7f2c74196c20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:40.509+0000 7f2c789ca700 1 --2- 172.21.15.93:0/2928932836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2c74102180 0x7f2c74197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:40.509+0000 7f2c789ca700 1 -- 172.21.15.93:0/2928932836 >> 172.21.15.93:0/2928932836 conn(0x7f2c740faa40 msgr2=0x7f2c74105670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:58:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:40.509+0000 7f2c789ca700 1 -- 172.21.15.93:0/2928932836 shutdown_connections 2023-12-01T00:58:40.510 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:58:40.509+0000 7f2c789ca700 1 -- 172.21.15.93:0/2928932836 wait complete. 2023-12-01T00:58:40.898 DEBUG:teuthology.orchestra.run.smithi093:osd.1> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.1.service 2023-12-01T00:58:40.900 INFO:tasks.cephadm:Deploying osd.2 on smithi116 with /dev/vg_nvme/lv_4... 2023-12-01T00:58:40.901 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-01T00:58:40.930 INFO:journalctl@ceph.osd.1.smithi093.stdout:-- Logs begin at Fri 2023-12-01 00:42:14 UTC. -- 2023-12-01T00:58:41.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:40 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:41.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:40 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:41.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:40 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:41.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:40 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:41.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:40 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:41.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:40 smithi116 ceph-mon[103554]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:41.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:40 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:41.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:40 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:41.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:40 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:41.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:40 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:41.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:40 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:41.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:40 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:41.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:40 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:41.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:40 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:41.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:40 smithi093 ceph-mon[103327]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:41.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:40 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:41.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:40 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:41.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:40 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:41.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:40 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:41.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:40 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:41.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:40 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:41.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:40 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:41.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:40 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:41.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:40 smithi026 ceph-mon[98801]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:41.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:40 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:41.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:40 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:41.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:40 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:41.461 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.c/config 2023-12-01T00:58:41.893 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:41 smithi116 ceph-mon[103554]: from='osd.1 [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-01T00:58:41.893 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:41 smithi116 ceph-mon[103554]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-01T00:58:41.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:41 smithi093 ceph-mon[103327]: from='osd.1 [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-01T00:58:41.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:41 smithi093 ceph-mon[103327]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-01T00:58:41.966 INFO:journalctl@ceph.osd.1.smithi093.stdout:Dec 01 00:58:41 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-1[108412]: 2023-12-01T00:58:41.761+0000 7ffab010b640 -1 osd.1 0 log_to_monitors true 2023-12-01T00:58:42.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:41 smithi026 ceph-mon[98801]: from='osd.1 [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-01T00:58:42.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:41 smithi026 ceph-mon[98801]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-01T00:58:42.834 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-01T00:58:42.834 INFO:teuthology.orchestra.run.smithi116.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-01T00:58:42.834 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10+0 records in 2023-12-01T00:58:42.835 INFO:teuthology.orchestra.run.smithi116.stderr:10+0 records out 2023-12-01T00:58:42.835 INFO:teuthology.orchestra.run.smithi116.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123982 s, 846 MB/s 2023-12-01T00:58:42.835 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping successful for: 2023-12-01T00:58:43.134 INFO:journalctl@ceph.osd.1.smithi093.stdout:Dec 01 00:58:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-1[108412]: 2023-12-01T00:58:42.829+0000 7ffaa5782700 -1 osd.1 0 waiting for initial osdmap 2023-12-01T00:58:43.134 INFO:journalctl@ceph.osd.1.smithi093.stdout:Dec 01 00:58:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-1[108412]: 2023-12-01T00:58:42.833+0000 7ffaa0d76700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T00:58:43.135 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:42 smithi093 ceph-mon[103327]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-01T00:58:43.135 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:42 smithi093 ceph-mon[103327]: osdmap e11: 2 total, 1 up, 2 in 2023-12-01T00:58:43.135 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:42 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-01T00:58:43.135 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:42 smithi093 ceph-mon[103327]: from='osd.1 [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T00:58:43.135 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:42 smithi093 ceph-mon[103327]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T00:58:43.135 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:42 smithi093 ceph-mon[103327]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:43.157 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:42 smithi116 ceph-mon[103554]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-01T00:58:43.157 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:42 smithi116 ceph-mon[103554]: osdmap e11: 2 total, 1 up, 2 in 2023-12-01T00:58:43.157 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:42 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-01T00:58:43.157 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:42 smithi116 ceph-mon[103554]: from='osd.1 [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T00:58:43.157 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:42 smithi116 ceph-mon[103554]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T00:58:43.157 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:42 smithi116 ceph-mon[103554]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:43.201 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi116:vg_nvme/lv_4 2023-12-01T00:58:43.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:42 smithi026 ceph-mon[98801]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-01T00:58:43.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:42 smithi026 ceph-mon[98801]: osdmap e11: 2 total, 1 up, 2 in 2023-12-01T00:58:43.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:42 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-01T00:58:43.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:42 smithi026 ceph-mon[98801]: from='osd.1 [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T00:58:43.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:42 smithi026 ceph-mon[98801]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T00:58:43.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:42 smithi026 ceph-mon[98801]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:43.748 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.c/config 2023-12-01T00:58:44.089 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:43 smithi116 ceph-mon[103554]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-01T00:58:44.090 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:43 smithi116 ceph-mon[103554]: osdmap e12: 2 total, 1 up, 2 in 2023-12-01T00:58:44.090 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:43 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-01T00:58:44.090 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:43 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-01T00:58:44.090 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:43 smithi116 ceph-mon[103554]: Detected new or changed devices on smithi093 2023-12-01T00:58:44.090 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:43 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:44.090 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:43 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:44.090 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:43 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:58:44.090 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:43 smithi116 ceph-mon[103554]: Adjusting osd_memory_target on smithi093 to 17168M 2023-12-01T00:58:44.090 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:43 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:44.090 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:43 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:44.090 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:43 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:44.090 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:43 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:44.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:43 smithi093 ceph-mon[103327]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-01T00:58:44.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:43 smithi093 ceph-mon[103327]: osdmap e12: 2 total, 1 up, 2 in 2023-12-01T00:58:44.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:43 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-01T00:58:44.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:43 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-01T00:58:44.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:43 smithi093 ceph-mon[103327]: Detected new or changed devices on smithi093 2023-12-01T00:58:44.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:43 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:44.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:43 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:44.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:43 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:58:44.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:43 smithi093 ceph-mon[103327]: Adjusting osd_memory_target on smithi093 to 17168M 2023-12-01T00:58:44.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:43 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:44.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:43 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:44.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:43 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:44.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:43 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:43 smithi026 ceph-mon[98801]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-01T00:58:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:43 smithi026 ceph-mon[98801]: osdmap e12: 2 total, 1 up, 2 in 2023-12-01T00:58:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:43 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-01T00:58:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:43 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-01T00:58:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:43 smithi026 ceph-mon[98801]: Detected new or changed devices on smithi093 2023-12-01T00:58:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:43 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:43 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:43 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:58:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:43 smithi026 ceph-mon[98801]: Adjusting osd_memory_target on smithi093 to 17168M 2023-12-01T00:58:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:43 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:43 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:44.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:43 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:44.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:43 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:44.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.836+0000 7f14351f5700 1 -- 172.21.15.116:0/1977764178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14301018c0 msgr2=0x7f1430108170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:58:44.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.836+0000 7f14351f5700 1 --2- 172.21.15.116:0/1977764178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14301018c0 0x7f1430108170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f142800b0a0 tx=0x7f142800b3b0 comp rx=0 tx=0).stop 2023-12-01T00:58:44.837 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.836+0000 7f14351f5700 1 -- 172.21.15.116:0/1977764178 shutdown_connections 2023-12-01T00:58:44.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.836+0000 7f14351f5700 1 --2- 172.21.15.116:0/1977764178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f14301018c0 0x7f1430108170 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:44.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.836+0000 7f14351f5700 1 --2- 172.21.15.116:0/1977764178 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14300ffd20 0x7f1430100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:44.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.836+0000 7f14351f5700 1 --2- 172.21.15.116:0/1977764178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1430100f20 0x7f1430101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:44.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.836+0000 7f14351f5700 1 -- 172.21.15.116:0/1977764178 >> 172.21.15.116:0/1977764178 conn(0x7f14300fb2a0 msgr2=0x7f14300fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:58:44.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.836+0000 7f14351f5700 1 -- 172.21.15.116:0/1977764178 shutdown_connections 2023-12-01T00:58:44.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.836+0000 7f14351f5700 1 -- 172.21.15.116:0/1977764178 wait complete. 2023-12-01T00:58:44.838 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.836+0000 7f14351f5700 1 Processor -- start 2023-12-01T00:58:44.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f14351f5700 1 -- start start 2023-12-01T00:58:44.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f14351f5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14300ffd20 0x7f14300693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:58:44.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f14351f5700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1430100f20 0x7f143019b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:58:44.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f14351f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14301018c0 0x7f143019e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:58:44.839 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f14351f5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143019e7d0 con 0x7f14301018c0 2023-12-01T00:58:44.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f14351f5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143019e940 con 0x7f14300ffd20 2023-12-01T00:58:44.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f14351f5700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143019eb00 con 0x7f1430100f20 2023-12-01T00:58:44.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f142e59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1430100f20 0x7f143019b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:58:44.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f142e59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1430100f20 0x7f143019b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54166/0 (socket says 172.21.15.116:54166) 2023-12-01T00:58:44.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f142e59c700 1 -- 172.21.15.116:0/832003509 learned_addr learned my addr 172.21.15.116:0/832003509 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-12-01T00:58:44.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f142f59e700 1 --2- 172.21.15.116:0/832003509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14301018c0 0x7f143019e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:58:44.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f142ed9d700 1 --2- 172.21.15.116:0/832003509 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14300ffd20 0x7f14300693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:58:44.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f142e59c700 1 -- 172.21.15.116:0/832003509 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14300ffd20 msgr2=0x7f14300693b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:58:44.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f142e59c700 1 --2- 172.21.15.116:0/832003509 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14300ffd20 0x7f14300693b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:44.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f142e59c700 1 -- 172.21.15.116:0/832003509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14301018c0 msgr2=0x7f143019e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:58:44.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f142e59c700 1 --2- 172.21.15.116:0/832003509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14301018c0 0x7f143019e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:58:44.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.837+0000 7f142e59c700 1 -- 172.21.15.116:0/832003509 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1428009d00 con 0x7f1430100f20 2023-12-01T00:58:44.840 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.838+0000 7f142e59c700 1 --2- 172.21.15.116:0/832003509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1430100f20 0x7f143019b9f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f142400e9a0 tx=0x7f142400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:58:44.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.839+0000 7f1417fff700 1 -- 172.21.15.116:0/832003509 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424009790 con 0x7f1430100f20 2023-12-01T00:58:44.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.839+0000 7f1417fff700 1 -- 172.21.15.116:0/832003509 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f142400cbd0 con 0x7f1430100f20 2023-12-01T00:58:44.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.839+0000 7f14351f5700 1 -- 172.21.15.116:0/832003509 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143019ede0 con 0x7f1430100f20 2023-12-01T00:58:44.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.839+0000 7f1417fff700 1 -- 172.21.15.116:0/832003509 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424018680 con 0x7f1430100f20 2023-12-01T00:58:44.841 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.839+0000 7f14351f5700 1 -- 172.21.15.116:0/832003509 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143019f260 con 0x7f1430100f20 2023-12-01T00:58:44.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.840+0000 7f14351f5700 1 -- 172.21.15.116:0/832003509 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1430107230 con 0x7f1430100f20 2023-12-01T00:58:44.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.841+0000 7f1417fff700 1 -- 172.21.15.116:0/832003509 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 15) v1 ==== 135014+0+0 (secure 0 0 0) 0x7f14240188a0 con 0x7f1430100f20 2023-12-01T00:58:44.842 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.841+0000 7f1417fff700 1 --2- 172.21.15.116:0/832003509 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f14180a0510 0x7f14180a29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:58:44.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.842+0000 7f1417fff700 1 -- 172.21.15.116:0/832003509 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2309+0+0 (secure 0 0 0) 0x7f1424014070 con 0x7f1430100f20 2023-12-01T00:58:44.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.842+0000 7f142ed9d700 1 --2- 172.21.15.116:0/832003509 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f14180a0510 0x7f14180a29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:58:44.843 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.842+0000 7f142ed9d700 1 --2- 172.21.15.116:0/832003509 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f14180a0510 0x7f14180a29d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1420005950 tx=0x7f14200058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:58:44.847 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:44.846+0000 7f1417fff700 1 -- 172.21.15.116:0/832003509 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f14240520e0 con 0x7f1430100f20 2023-12-01T00:58:44.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:44 smithi116 ceph-mon[103554]: purged_snaps scrub starts 2023-12-01T00:58:44.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:44 smithi116 ceph-mon[103554]: purged_snaps scrub ok 2023-12-01T00:58:44.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:44 smithi116 ceph-mon[103554]: osd.1 [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045] boot 2023-12-01T00:58:44.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:44 smithi116 ceph-mon[103554]: osdmap e13: 2 total, 2 up, 2 in 2023-12-01T00:58:44.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-01T00:58:44.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:44 smithi116 ceph-mon[103554]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:45.044 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:58:45.043+0000 7f14351f5700 1 -- 172.21.15.116:0/832003509 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f14300611d0 con 0x7f14180a0510 2023-12-01T00:58:45.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:44 smithi093 ceph-mon[103327]: purged_snaps scrub starts 2023-12-01T00:58:45.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:44 smithi093 ceph-mon[103327]: purged_snaps scrub ok 2023-12-01T00:58:45.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:44 smithi093 ceph-mon[103327]: osd.1 [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045] boot 2023-12-01T00:58:45.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:44 smithi093 ceph-mon[103327]: osdmap e13: 2 total, 2 up, 2 in 2023-12-01T00:58:45.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-01T00:58:45.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:44 smithi093 ceph-mon[103327]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:45.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:44 smithi026 ceph-mon[98801]: purged_snaps scrub starts 2023-12-01T00:58:45.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:44 smithi026 ceph-mon[98801]: purged_snaps scrub ok 2023-12-01T00:58:45.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:44 smithi026 ceph-mon[98801]: osd.1 [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045] boot 2023-12-01T00:58:45.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:44 smithi026 ceph-mon[98801]: osdmap e13: 2 total, 2 up, 2 in 2023-12-01T00:58:45.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-01T00:58:45.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:44 smithi026 ceph-mon[98801]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-01T00:58:46.109 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:45 smithi116 ceph-mon[103554]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:58:46.109 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:45 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:58:46.109 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:45 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:58:46.109 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:45 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:46.109 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:45 smithi116 ceph-mon[103554]: osdmap e14: 2 total, 2 up, 2 in 2023-12-01T00:58:46.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:45 smithi093 ceph-mon[103327]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:58:46.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:45 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:58:46.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:45 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:58:46.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:45 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:46.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:45 smithi093 ceph-mon[103327]: osdmap e14: 2 total, 2 up, 2 in 2023-12-01T00:58:46.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:45 smithi026 ceph-mon[98801]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:58:46.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:45 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:58:46.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:45 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:58:46.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:45 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:46.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:45 smithi026 ceph-mon[98801]: osdmap e14: 2 total, 2 up, 2 in 2023-12-01T00:58:47.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:46 smithi116 ceph-mon[103554]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:47.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:46 smithi093 ceph-mon[103327]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:47.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:46 smithi026 ceph-mon[98801]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:48.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:47 smithi116 ceph-mon[103554]: from='client.? 172.21.15.116:0/1787441173' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c20d1850-e656-46c4-a25c-cf114bf23377"}]: dispatch 2023-12-01T00:58:48.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:47 smithi116 ceph-mon[103554]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c20d1850-e656-46c4-a25c-cf114bf23377"}]: dispatch 2023-12-01T00:58:48.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:47 smithi116 ceph-mon[103554]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c20d1850-e656-46c4-a25c-cf114bf23377"}]': finished 2023-12-01T00:58:48.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:47 smithi116 ceph-mon[103554]: osdmap e15: 3 total, 2 up, 3 in 2023-12-01T00:58:48.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:58:48.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:47 smithi093 ceph-mon[103327]: from='client.? 172.21.15.116:0/1787441173' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c20d1850-e656-46c4-a25c-cf114bf23377"}]: dispatch 2023-12-01T00:58:48.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:47 smithi093 ceph-mon[103327]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c20d1850-e656-46c4-a25c-cf114bf23377"}]: dispatch 2023-12-01T00:58:48.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:47 smithi093 ceph-mon[103327]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c20d1850-e656-46c4-a25c-cf114bf23377"}]': finished 2023-12-01T00:58:48.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:47 smithi093 ceph-mon[103327]: osdmap e15: 3 total, 2 up, 3 in 2023-12-01T00:58:48.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:58:48.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:47 smithi026 ceph-mon[98801]: from='client.? 172.21.15.116:0/1787441173' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c20d1850-e656-46c4-a25c-cf114bf23377"}]: dispatch 2023-12-01T00:58:48.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:47 smithi026 ceph-mon[98801]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c20d1850-e656-46c4-a25c-cf114bf23377"}]: dispatch 2023-12-01T00:58:48.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:47 smithi026 ceph-mon[98801]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c20d1850-e656-46c4-a25c-cf114bf23377"}]': finished 2023-12-01T00:58:48.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:47 smithi026 ceph-mon[98801]: osdmap e15: 3 total, 2 up, 3 in 2023-12-01T00:58:48.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:58:49.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:48 smithi116 ceph-mon[103554]: from='client.? 172.21.15.116:0/2205251254' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:58:49.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:48 smithi116 ceph-mon[103554]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:49.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:48 smithi093 ceph-mon[103327]: from='client.? 172.21.15.116:0/2205251254' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:58:49.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:48 smithi093 ceph-mon[103327]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:49.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:48 smithi026 ceph-mon[98801]: from='client.? 172.21.15.116:0/2205251254' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:58:49.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:48 smithi026 ceph-mon[98801]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:51.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:51 smithi026 ceph-mon[98801]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:51.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:51 smithi116 ceph-mon[103554]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:51.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:51 smithi093 ceph-mon[103327]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:53.445 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:53 smithi116 ceph-mon[103554]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:53.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:53 smithi026 ceph-mon[98801]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:53 smithi093 ceph-mon[103327]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:54.399 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:54 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-01T00:58:54.399 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:54 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:54.399 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:54 smithi116 ceph-mon[103554]: Deploying daemon osd.2 on smithi116 2023-12-01T00:58:54.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:54 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-01T00:58:54.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:54 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:54.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:54 smithi026 ceph-mon[98801]: Deploying daemon osd.2 on smithi116 2023-12-01T00:58:54.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:54 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-01T00:58:54.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:54 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:54.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:54 smithi093 ceph-mon[103327]: Deploying daemon osd.2 on smithi116 2023-12-01T00:58:55.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:55 smithi116 ceph-mon[103554]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:55.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:55 smithi026 ceph-mon[98801]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:55.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:55 smithi093 ceph-mon[103327]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:57.521 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:57 smithi116 ceph-mon[103554]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:57.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:57 smithi026 ceph-mon[98801]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:57.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:57 smithi093 ceph-mon[103327]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:58.640 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:58.640 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:58.640 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:58.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:58.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:58.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:59.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:59.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:59.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:58:59.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:59 smithi116 ceph-mon[103554]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:59.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:59.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:59.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:59.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:59.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:58:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:59.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:59 smithi093 ceph-mon[103327]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:58:59.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:59.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:58:59.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:58:59.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:58:59.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:58:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:00.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:59 smithi026 ceph-mon[98801]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:59:00.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:00.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:00.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:00.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:00.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:58:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:00.055 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:00.053+0000 7f1417fff700 1 -- 172.21.15.116:0/832003509 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f14300611d0 con 0x7f14180a0510 2023-12-01T00:59:00.055 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 2 on host 'smithi116' 2023-12-01T00:59:00.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:00.056+0000 7f14351f5700 1 -- 172.21.15.116:0/832003509 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f14180a0510 msgr2=0x7f14180a29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:59:00.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:00.056+0000 7f14351f5700 1 --2- 172.21.15.116:0/832003509 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f14180a0510 0x7f14180a29d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1420005950 tx=0x7f14200058e0 comp rx=0 tx=0).stop 2023-12-01T00:59:00.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:00.056+0000 7f14351f5700 1 -- 172.21.15.116:0/832003509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1430100f20 msgr2=0x7f143019b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:59:00.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:00.056+0000 7f14351f5700 1 --2- 172.21.15.116:0/832003509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1430100f20 0x7f143019b9f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f142400e9a0 tx=0x7f142400ecb0 comp rx=0 tx=0).stop 2023-12-01T00:59:00.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:00.056+0000 7f14351f5700 1 -- 172.21.15.116:0/832003509 shutdown_connections 2023-12-01T00:59:00.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:00.056+0000 7f14351f5700 1 --2- 172.21.15.116:0/832003509 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f14180a0510 0x7f14180a29d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:00.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:00.056+0000 7f14351f5700 1 --2- 172.21.15.116:0/832003509 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14301018c0 0x7f143019e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:00.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:00.056+0000 7f14351f5700 1 --2- 172.21.15.116:0/832003509 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f14300ffd20 0x7f14300693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:00.057 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:00.056+0000 7f14351f5700 1 --2- 172.21.15.116:0/832003509 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1430100f20 0x7f143019b9f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:00.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:00.056+0000 7f14351f5700 1 -- 172.21.15.116:0/832003509 >> 172.21.15.116:0/832003509 conn(0x7f14300fb2a0 msgr2=0x7f1430104370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:59:00.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:00.056+0000 7f14351f5700 1 -- 172.21.15.116:0/832003509 shutdown_connections 2023-12-01T00:59:00.058 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:00.056+0000 7f14351f5700 1 -- 172.21.15.116:0/832003509 wait complete. 2023-12-01T00:59:00.437 DEBUG:teuthology.orchestra.run.smithi116:osd.2> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.2.service 2023-12-01T00:59:00.439 INFO:tasks.cephadm:Deploying osd.3 on smithi026 with /dev/vg_nvme/lv_3... 2023-12-01T00:59:00.439 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-01T00:59:00.471 INFO:journalctl@ceph.osd.2.smithi116.stdout:-- Logs begin at Fri 2023-12-01 00:41:59 UTC. -- 2023-12-01T00:59:01.016 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T00:59:01.131 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:01 smithi116 ceph-mon[103554]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:59:01.132 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:01 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:01.132 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:01 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:01.132 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:01 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:01.278 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:01 smithi026 ceph-mon[98801]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:59:01.278 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:01 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:01.278 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:01 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:01.278 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:01 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:01.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:01 smithi093 ceph-mon[103327]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:59:01.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:01 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:01.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:01 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:01.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:01 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:01.796 INFO:journalctl@ceph.osd.2.smithi116.stdout:Dec 01 00:59:01 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-2[109406]: 2023-12-01T00:59:01.570+0000 7f73f3885640 -1 osd.2 0 log_to_monitors true 2023-12-01T00:59:02.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:02 smithi116 ceph-mon[103554]: from='osd.2 [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-01T00:59:02.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:02 smithi026 ceph-mon[98801]: from='osd.2 [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-01T00:59:02.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:02 smithi093 ceph-mon[103327]: from='osd.2 [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-01T00:59:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-01T00:59:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-01T00:59:02.528 INFO:teuthology.orchestra.run.smithi026.stderr: stderr: 10+0 records in 2023-12-01T00:59:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:10+0 records out 2023-12-01T00:59:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00810808 s, 1.3 GB/s 2023-12-01T00:59:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping successful for: 2023-12-01T00:59:02.879 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi026:vg_nvme/lv_3 2023-12-01T00:59:03.180 INFO:journalctl@ceph.osd.2.smithi116.stdout:Dec 01 00:59:03 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-2[109406]: 2023-12-01T00:59:03.038+0000 7f73e8efc700 -1 osd.2 0 waiting for initial osdmap 2023-12-01T00:59:03.180 INFO:journalctl@ceph.osd.2.smithi116.stdout:Dec 01 00:59:03 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-2[109406]: 2023-12-01T00:59:03.045+0000 7f73e0ce9700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T00:59:03.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:03 smithi116 ceph-mon[103554]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:59:03.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:03 smithi116 ceph-mon[103554]: from='osd.2 [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-01T00:59:03.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:03 smithi116 ceph-mon[103554]: osdmap e16: 3 total, 2 up, 3 in 2023-12-01T00:59:03.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:59:03.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:03 smithi116 ceph-mon[103554]: from='osd.2 [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T00:59:03.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:03.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:03.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:59:03.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:03.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:03.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:03.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:03.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:03 smithi026 ceph-mon[98801]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:59:03.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:03 smithi026 ceph-mon[98801]: from='osd.2 [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-01T00:59:03.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:03 smithi026 ceph-mon[98801]: osdmap e16: 3 total, 2 up, 3 in 2023-12-01T00:59:03.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:59:03.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:03 smithi026 ceph-mon[98801]: from='osd.2 [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T00:59:03.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:03.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:03.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:59:03.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:03.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:03.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:03.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:03.446 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T00:59:03.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:03 smithi093 ceph-mon[103327]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:59:03.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:03 smithi093 ceph-mon[103327]: from='osd.2 [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-01T00:59:03.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:03 smithi093 ceph-mon[103327]: osdmap e16: 3 total, 2 up, 3 in 2023-12-01T00:59:03.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:59:03.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:03 smithi093 ceph-mon[103327]: from='osd.2 [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T00:59:03.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:03.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:03.467 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:59:03.467 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:03.467 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:03.467 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:03.467 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:04.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:04 smithi116 ceph-mon[103554]: Detected new or changed devices on smithi116 2023-12-01T00:59:04.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:04 smithi116 ceph-mon[103554]: Adjusting osd_memory_target on smithi116 to 17168M 2023-12-01T00:59:04.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:04 smithi116 ceph-mon[103554]: from='osd.2 [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2023-12-01T00:59:04.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:04 smithi116 ceph-mon[103554]: osdmap e17: 3 total, 2 up, 3 in 2023-12-01T00:59:04.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:59:04.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:59:04.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:59:04.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:04 smithi093 ceph-mon[103327]: Detected new or changed devices on smithi116 2023-12-01T00:59:04.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:04 smithi093 ceph-mon[103327]: Adjusting osd_memory_target on smithi116 to 17168M 2023-12-01T00:59:04.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:04 smithi093 ceph-mon[103327]: from='osd.2 [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2023-12-01T00:59:04.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:04 smithi093 ceph-mon[103327]: osdmap e17: 3 total, 2 up, 3 in 2023-12-01T00:59:04.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:59:04.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:59:04.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:59:04.502 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:04 smithi026 ceph-mon[98801]: Detected new or changed devices on smithi116 2023-12-01T00:59:04.502 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:04 smithi026 ceph-mon[98801]: Adjusting osd_memory_target on smithi116 to 17168M 2023-12-01T00:59:04.502 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:04 smithi026 ceph-mon[98801]: from='osd.2 [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2023-12-01T00:59:04.502 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:04 smithi026 ceph-mon[98801]: osdmap e17: 3 total, 2 up, 3 in 2023-12-01T00:59:04.502 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:59:04.502 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:59:04.503 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:59:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.685+0000 7f3474bb7700 1 -- 172.21.15.26:0/176771797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34701018b0 msgr2=0x7f3470103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:59:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.685+0000 7f3474bb7700 1 --2- 172.21.15.26:0/176771797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34701018b0 0x7f3470103ca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3460009990 tx=0x7f3460009ca0 comp rx=0 tx=0).stop 2023-12-01T00:59:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.685+0000 7f3474bb7700 1 -- 172.21.15.26:0/176771797 shutdown_connections 2023-12-01T00:59:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.685+0000 7f3474bb7700 1 --2- 172.21.15.26:0/176771797 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3470106b10 0x7f3470108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.685+0000 7f3474bb7700 1 --2- 172.21.15.26:0/176771797 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34701018b0 0x7f3470103ca0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.685+0000 7f3474bb7700 1 --2- 172.21.15.26:0/176771797 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f34701041e0 0x7f34701065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.685+0000 7f3474bb7700 1 -- 172.21.15.26:0/176771797 >> 172.21.15.26:0/176771797 conn(0x7f34700fb2a0 msgr2=0x7f34700fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:59:04.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.685+0000 7f3474bb7700 1 -- 172.21.15.26:0/176771797 shutdown_connections 2023-12-01T00:59:04.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.685+0000 7f3474bb7700 1 -- 172.21.15.26:0/176771797 wait complete. 2023-12-01T00:59:04.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.686+0000 7f3474bb7700 1 Processor -- start 2023-12-01T00:59:04.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.686+0000 7f3474bb7700 1 -- start start 2023-12-01T00:59:04.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.686+0000 7f3474bb7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34701018b0 0x7f3470101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:59:04.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.686+0000 7f3474bb7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34701041e0 0x7f34700ff860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:59:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.686+0000 7f3474bb7700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3470106b10 0x7f34700ffda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:59:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.686+0000 7f3474bb7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3470100520 con 0x7f34701041e0 2023-12-01T00:59:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.686+0000 7f3474bb7700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3470100690 con 0x7f34701018b0 2023-12-01T00:59:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.686+0000 7f3474bb7700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34701a0b90 con 0x7f3470106b10 2023-12-01T00:59:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.686+0000 7f346dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34701041e0 0x7f34700ff860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:59:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.686+0000 7f346dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34701041e0 0x7f34700ff860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52672/0 (socket says 172.21.15.26:52672) 2023-12-01T00:59:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.686+0000 7f346dd9b700 1 -- 172.21.15.26:0/593217877 learned_addr learned my addr 172.21.15.26:0/593217877 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T00:59:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.686+0000 7f346e59c700 1 --2- 172.21.15.26:0/593217877 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34701018b0 0x7f3470101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:59:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.687+0000 7f346ed9d700 1 --2- 172.21.15.26:0/593217877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3470106b10 0x7f34700ffda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:59:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.687+0000 7f346dd9b700 1 -- 172.21.15.26:0/593217877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3470106b10 msgr2=0x7f34700ffda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:59:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.687+0000 7f346dd9b700 1 --2- 172.21.15.26:0/593217877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3470106b10 0x7f34700ffda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.687+0000 7f346dd9b700 1 -- 172.21.15.26:0/593217877 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34701018b0 msgr2=0x7f3470101210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:59:04.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.687+0000 7f346dd9b700 1 --2- 172.21.15.26:0/593217877 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34701018b0 0x7f3470101210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.687+0000 7f346dd9b700 1 -- 172.21.15.26:0/593217877 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34600095f0 con 0x7f34701041e0 2023-12-01T00:59:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.687+0000 7f346ed9d700 1 --2- 172.21.15.26:0/593217877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3470106b10 0x7f34700ffda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T00:59:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.687+0000 7f346dd9b700 1 --2- 172.21.15.26:0/593217877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34701041e0 0x7f34700ff860 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f346400c9b0 tx=0x7f346400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:59:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.687+0000 7f345f7fe700 1 -- 172.21.15.26:0/593217877 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464007b00 con 0x7f34701041e0 2023-12-01T00:59:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.687+0000 7f3474bb7700 1 -- 172.21.15.26:0/593217877 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34701a0e70 con 0x7f34701041e0 2023-12-01T00:59:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.687+0000 7f345f7fe700 1 -- 172.21.15.26:0/593217877 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3464007c60 con 0x7f34701041e0 2023-12-01T00:59:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.687+0000 7f345f7fe700 1 -- 172.21.15.26:0/593217877 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3464018660 con 0x7f34701041e0 2023-12-01T00:59:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.687+0000 7f3474bb7700 1 -- 172.21.15.26:0/593217877 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34701a12e0 con 0x7f34701041e0 2023-12-01T00:59:04.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.688+0000 7f3474bb7700 1 -- 172.21.15.26:0/593217877 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34700fce20 con 0x7f34701041e0 2023-12-01T00:59:04.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.689+0000 7f345f7fe700 1 -- 172.21.15.26:0/593217877 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 15) v1 ==== 135014+0+0 (secure 0 0 0) 0x7f346400f450 con 0x7f34701041e0 2023-12-01T00:59:04.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.690+0000 7f345f7fe700 1 --2- 172.21.15.26:0/593217877 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f34580a0490 0x7f34580a2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:59:04.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.690+0000 7f346e59c700 1 --2- 172.21.15.26:0/593217877 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f34580a0490 0x7f34580a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:59:04.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.690+0000 7f345f7fe700 1 -- 172.21.15.26:0/593217877 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 2851+0+0 (secure 0 0 0) 0x7f34640ca2e0 con 0x7f34701041e0 2023-12-01T00:59:04.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.690+0000 7f346e59c700 1 --2- 172.21.15.26:0/593217877 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f34580a0490 0x7f34580a2950 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3460003790 tx=0x7f3460005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:59:04.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.694+0000 7f345f7fe700 1 -- 172.21.15.26:0/593217877 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f34640954b0 con 0x7f34701041e0 2023-12-01T00:59:04.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:04.902+0000 7f3474bb7700 1 -- 172.21.15.26:0/593217877 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f34700611d0 con 0x7f34580a0490 2023-12-01T00:59:05.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:05 smithi116 ceph-mon[103554]: purged_snaps scrub starts 2023-12-01T00:59:05.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:05 smithi116 ceph-mon[103554]: purged_snaps scrub ok 2023-12-01T00:59:05.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:05 smithi116 ceph-mon[103554]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:59:05.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:05 smithi116 ceph-mon[103554]: osd.2 [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820] boot 2023-12-01T00:59:05.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:05 smithi116 ceph-mon[103554]: osdmap e18: 3 total, 3 up, 3 in 2023-12-01T00:59:05.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:59:05.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:59:05.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:59:05.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:05.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:05 smithi093 ceph-mon[103327]: purged_snaps scrub starts 2023-12-01T00:59:05.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:05 smithi093 ceph-mon[103327]: purged_snaps scrub ok 2023-12-01T00:59:05.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:05 smithi093 ceph-mon[103327]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:59:05.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:05 smithi093 ceph-mon[103327]: osd.2 [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820] boot 2023-12-01T00:59:05.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:05 smithi093 ceph-mon[103327]: osdmap e18: 3 total, 3 up, 3 in 2023-12-01T00:59:05.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:59:05.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:59:05.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:59:05.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:05.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:05 smithi026 ceph-mon[98801]: purged_snaps scrub starts 2023-12-01T00:59:05.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:05 smithi026 ceph-mon[98801]: purged_snaps scrub ok 2023-12-01T00:59:05.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:05 smithi026 ceph-mon[98801]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-01T00:59:05.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:05 smithi026 ceph-mon[98801]: osd.2 [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820] boot 2023-12-01T00:59:05.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:05 smithi026 ceph-mon[98801]: osdmap e18: 3 total, 3 up, 3 in 2023-12-01T00:59:05.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-01T00:59:05.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:59:05.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:59:05.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:06.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:06 smithi116 ceph-mon[103554]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:59:06.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:06 smithi116 ceph-mon[103554]: osdmap e19: 3 total, 3 up, 3 in 2023-12-01T00:59:06.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:06 smithi093 ceph-mon[103327]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:59:06.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:06 smithi093 ceph-mon[103327]: osdmap e19: 3 total, 3 up, 3 in 2023-12-01T00:59:06.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:06 smithi026 ceph-mon[98801]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:59:06.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:06 smithi026 ceph-mon[98801]: osdmap e19: 3 total, 3 up, 3 in 2023-12-01T00:59:07.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:07 smithi116 ceph-mon[103554]: pgmap v73: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:07.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:07 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-12-01T00:59:07.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:07 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-12-01T00:59:07.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:07 smithi116 ceph-mon[103554]: osdmap e20: 3 total, 3 up, 3 in 2023-12-01T00:59:07.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:07 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-01T00:59:07.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:07 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1288658423' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12dbd39e-b304-4d90-b9bc-a277f9a774e0"}]: dispatch 2023-12-01T00:59:07.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:07 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-01T00:59:07.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:07 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1288658423' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12dbd39e-b304-4d90-b9bc-a277f9a774e0"}]': finished 2023-12-01T00:59:07.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:07 smithi116 ceph-mon[103554]: osdmap e21: 4 total, 3 up, 4 in 2023-12-01T00:59:07.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:07 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:07.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:07 smithi093 ceph-mon[103327]: pgmap v73: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:07.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:07 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-12-01T00:59:07.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:07 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-12-01T00:59:07.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:07 smithi093 ceph-mon[103327]: osdmap e20: 3 total, 3 up, 3 in 2023-12-01T00:59:07.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:07 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-01T00:59:07.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:07 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1288658423' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12dbd39e-b304-4d90-b9bc-a277f9a774e0"}]: dispatch 2023-12-01T00:59:07.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:07 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-01T00:59:07.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:07 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1288658423' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12dbd39e-b304-4d90-b9bc-a277f9a774e0"}]': finished 2023-12-01T00:59:07.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:07 smithi093 ceph-mon[103327]: osdmap e21: 4 total, 3 up, 4 in 2023-12-01T00:59:07.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:07 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:07.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:07 smithi026 ceph-mon[98801]: pgmap v73: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:07.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:07 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-12-01T00:59:07.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:07 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-12-01T00:59:07.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:07 smithi026 ceph-mon[98801]: osdmap e20: 3 total, 3 up, 3 in 2023-12-01T00:59:07.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:07 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-01T00:59:07.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:07 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1288658423' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12dbd39e-b304-4d90-b9bc-a277f9a774e0"}]: dispatch 2023-12-01T00:59:07.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:07 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-01T00:59:07.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:07 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1288658423' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12dbd39e-b304-4d90-b9bc-a277f9a774e0"}]': finished 2023-12-01T00:59:07.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:07 smithi026 ceph-mon[98801]: osdmap e21: 4 total, 3 up, 4 in 2023-12-01T00:59:07.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:07 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:08.296 INFO:journalctl@ceph.osd.0.smithi026.stdout:Dec 01 00:59:07 smithi026 sudo[123065]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-01T00:59:08.296 INFO:journalctl@ceph.osd.0.smithi026.stdout:Dec 01 00:59:07 smithi026 sudo[123065]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-01T00:59:08.296 INFO:journalctl@ceph.osd.0.smithi026.stdout:Dec 01 00:59:07 smithi026 sudo[123065]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-01T00:59:08.296 INFO:journalctl@ceph.osd.0.smithi026.stdout:Dec 01 00:59:07 smithi026 sudo[123065]: pam_unix(sudo:session): session closed for user root 2023-12-01T00:59:08.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:08 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2102018059' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:59:08.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:08 smithi116 ceph-mon[103554]: osdmap e22: 4 total, 3 up, 4 in 2023-12-01T00:59:08.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:08 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:08.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:08 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:08.715 INFO:journalctl@ceph.osd.1.smithi093.stdout:Dec 01 00:59:08 smithi093 sudo[113908]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-01T00:59:08.715 INFO:journalctl@ceph.osd.1.smithi093.stdout:Dec 01 00:59:08 smithi093 sudo[113908]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-01T00:59:08.715 INFO:journalctl@ceph.osd.1.smithi093.stdout:Dec 01 00:59:08 smithi093 sudo[113908]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-01T00:59:08.715 INFO:journalctl@ceph.osd.1.smithi093.stdout:Dec 01 00:59:08 smithi093 sudo[113908]: pam_unix(sudo:session): session closed for user root 2023-12-01T00:59:08.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:08 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2102018059' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:59:08.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:08 smithi093 ceph-mon[103327]: osdmap e22: 4 total, 3 up, 4 in 2023-12-01T00:59:08.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:08 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:08.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:08 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:08.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:08 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2102018059' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:59:08.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:08 smithi026 ceph-mon[98801]: osdmap e22: 4 total, 3 up, 4 in 2023-12-01T00:59:08.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:08 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:08.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:08 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:08.796 INFO:journalctl@ceph.osd.0.smithi026.stdout:Dec 01 00:59:08 smithi026 sudo[123118]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-01T00:59:08.796 INFO:journalctl@ceph.osd.0.smithi026.stdout:Dec 01 00:59:08 smithi026 sudo[123118]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-01T00:59:08.797 INFO:journalctl@ceph.osd.0.smithi026.stdout:Dec 01 00:59:08 smithi026 sudo[123118]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-01T00:59:08.797 INFO:journalctl@ceph.osd.0.smithi026.stdout:Dec 01 00:59:08 smithi026 sudo[123118]: pam_unix(sudo:session): session closed for user root 2023-12-01T00:59:09.215 INFO:journalctl@ceph.osd.1.smithi093.stdout:Dec 01 00:59:08 smithi093 sudo[113911]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-01T00:59:09.215 INFO:journalctl@ceph.osd.1.smithi093.stdout:Dec 01 00:59:08 smithi093 sudo[113911]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-01T00:59:09.215 INFO:journalctl@ceph.osd.1.smithi093.stdout:Dec 01 00:59:08 smithi093 sudo[113911]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-01T00:59:09.215 INFO:journalctl@ceph.osd.1.smithi093.stdout:Dec 01 00:59:08 smithi093 sudo[113911]: pam_unix(sudo:session): session closed for user root 2023-12-01T00:59:09.408 INFO:journalctl@ceph.osd.2.smithi116.stdout:Dec 01 00:59:09 smithi116 sudo[114696]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-01T00:59:09.409 INFO:journalctl@ceph.osd.2.smithi116.stdout:Dec 01 00:59:09 smithi116 sudo[114696]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-01T00:59:09.409 INFO:journalctl@ceph.osd.2.smithi116.stdout:Dec 01 00:59:09 smithi116 sudo[114696]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-01T00:59:09.409 INFO:journalctl@ceph.osd.2.smithi116.stdout:Dec 01 00:59:09 smithi116 sudo[114696]: pam_unix(sudo:session): session closed for user root 2023-12-01T00:59:09.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:09.430+0000 7f345f7fe700 1 -- 172.21.15.26:0/593217877 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f3464095880 con 0x7f34701041e0 2023-12-01T00:59:09.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:09 smithi116 ceph-mon[103554]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:09.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:09 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:09.681 INFO:journalctl@ceph.osd.2.smithi116.stdout:Dec 01 00:59:09 smithi116 sudo[114699]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-01T00:59:09.681 INFO:journalctl@ceph.osd.2.smithi116.stdout:Dec 01 00:59:09 smithi116 sudo[114699]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-01T00:59:09.681 INFO:journalctl@ceph.osd.2.smithi116.stdout:Dec 01 00:59:09 smithi116 sudo[114699]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-01T00:59:09.681 INFO:journalctl@ceph.osd.2.smithi116.stdout:Dec 01 00:59:09 smithi116 sudo[114699]: pam_unix(sudo:session): session closed for user root 2023-12-01T00:59:09.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:09 smithi093 ceph-mon[103327]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:09.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:09 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:09.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:09 smithi026 ceph-mon[98801]: pgmap v76: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:09.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:09 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:10.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:09 smithi026 sudo[123864]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-01T00:59:10.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:09 smithi026 sudo[123864]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-01T00:59:10.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:09 smithi026 sudo[123864]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-01T00:59:10.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:09 smithi026 sudo[123864]: pam_unix(sudo:session): session closed for user root 2023-12-01T00:59:10.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:10 smithi026 sudo[124054]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-01T00:59:10.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:10 smithi026 sudo[124054]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-01T00:59:10.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:10 smithi026 sudo[124054]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-01T00:59:10.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:10 smithi026 sudo[124054]: pam_unix(sudo:session): session closed for user root 2023-12-01T00:59:10.831 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 sudo[114702]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-01T00:59:10.831 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 sudo[114702]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-01T00:59:10.831 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 sudo[114702]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-01T00:59:10.831 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 sudo[114702]: pam_unix(sudo:session): session closed for user root 2023-12-01T00:59:11.089 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:10 smithi093 ceph-mon[103327]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-12-01T00:59:11.089 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:10 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:11.090 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:10 smithi093 ceph-mon[103327]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-01T00:59:11.090 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:10 smithi093 ceph-mon[103327]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-01T00:59:11.090 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:10 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:59:11.090 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:10 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:59:11.090 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:10 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:59:11.090 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:10 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:59:11.090 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:10 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:59:11.090 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:10 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:59:11.090 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:11 smithi093 sudo[113914]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-01T00:59:11.090 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:11 smithi093 sudo[113914]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-01T00:59:11.090 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:11 smithi093 sudo[113914]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-01T00:59:11.090 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:11 smithi093 sudo[113914]: pam_unix(sudo:session): session closed for user root 2023-12-01T00:59:11.178 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:10 smithi026 ceph-mon[98801]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-12-01T00:59:11.178 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:10 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:11.178 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:10 smithi026 ceph-mon[98801]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-01T00:59:11.178 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:10 smithi026 ceph-mon[98801]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-01T00:59:11.178 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:10 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:59:11.178 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:10 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:59:11.179 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:10 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:59:11.179 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:10 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:59:11.179 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:10 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:59:11.179 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:10 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:59:11.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 sudo[114705]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-01T00:59:11.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 sudo[114705]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-01T00:59:11.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 sudo[114705]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-01T00:59:11.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 sudo[114705]: pam_unix(sudo:session): session closed for user root 2023-12-01T00:59:11.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 ceph-mon[103554]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-12-01T00:59:11.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:11.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 ceph-mon[103554]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-01T00:59:11.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 ceph-mon[103554]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-01T00:59:11.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:59:11.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:59:11.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:59:11.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:59:11.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:59:11.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:10 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:59:11.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:11 smithi093 sudo[113917]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-01T00:59:11.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:11 smithi093 sudo[113917]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-01T00:59:11.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:11 smithi093 sudo[113917]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-01T00:59:11.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:11 smithi093 sudo[113917]: pam_unix(sudo:session): session closed for user root 2023-12-01T00:59:12.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:11 smithi116 ceph-mon[103554]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:12.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:11 smithi116 ceph-mon[103554]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-01T00:59:12.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:11 smithi116 ceph-mon[103554]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-01T00:59:12.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:11 smithi116 ceph-mon[103554]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-01T00:59:12.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:11 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:59:12.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:11 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:59:12.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:11 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:59:12.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:11 smithi116 ceph-mon[103554]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-01T00:59:12.183 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:11 smithi026 ceph-mon[98801]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:12.183 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:11 smithi026 ceph-mon[98801]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-01T00:59:12.183 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:11 smithi026 ceph-mon[98801]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-01T00:59:12.184 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:11 smithi026 ceph-mon[98801]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-01T00:59:12.184 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:11 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:59:12.184 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:11 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:59:12.184 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:11 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:59:12.184 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:11 smithi026 ceph-mon[98801]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-01T00:59:12.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:11 smithi093 ceph-mon[103327]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:12.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:11 smithi093 ceph-mon[103327]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-01T00:59:12.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:11 smithi093 ceph-mon[103327]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-01T00:59:12.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:11 smithi093 ceph-mon[103327]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-01T00:59:12.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:11 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-01T00:59:12.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:11 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-01T00:59:12.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:11 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-01T00:59:12.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:11 smithi093 ceph-mon[103327]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-01T00:59:13.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:12 smithi116 ceph-mon[103554]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:13.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:12 smithi093 ceph-mon[103327]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:13.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:12 smithi026 ceph-mon[98801]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:13 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-01T00:59:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:13 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:13 smithi026 ceph-mon[98801]: Deploying daemon osd.3 on smithi026 2023-12-01T00:59:14.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:13 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-01T00:59:14.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:13 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:14.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:13 smithi116 ceph-mon[103554]: Deploying daemon osd.3 on smithi026 2023-12-01T00:59:14.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:13 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-01T00:59:14.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:13 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:14.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:13 smithi093 ceph-mon[103327]: Deploying daemon osd.3 on smithi026 2023-12-01T00:59:15.494 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:15 smithi026 ceph-mon[98801]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:15.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:15 smithi116 ceph-mon[103554]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:15.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:15 smithi093 ceph-mon[103327]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:17.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:17 smithi026 ceph-mon[98801]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2023-12-01T00:59:17.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:17 smithi116 ceph-mon[103554]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2023-12-01T00:59:17.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:17 smithi093 ceph-mon[103327]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 44 KiB/s wr, 3 op/s 2023-12-01T00:59:19.159 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:19 smithi026 ceph-mon[98801]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2023-12-01T00:59:19.159 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:19 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:19.159 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:19 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:19.160 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:19 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:19.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:19 smithi116 ceph-mon[103554]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2023-12-01T00:59:19.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:19 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:19.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:19 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:19.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:19 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:19.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:19 smithi093 ceph-mon[103327]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.1 KiB/s rd, 33 KiB/s wr, 2 op/s 2023-12-01T00:59:19.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:19 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:19.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:19 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:19.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:19 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:20.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:20.699+0000 7f345f7fe700 1 -- 172.21.15.26:0/593217877 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f34700611d0 con 0x7f34580a0490 2023-12-01T00:59:20.701 INFO:teuthology.orchestra.run.smithi026.stdout:Created osd(s) 3 on host 'smithi026' 2023-12-01T00:59:20.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:20.701+0000 7f3474bb7700 1 -- 172.21.15.26:0/593217877 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f34580a0490 msgr2=0x7f34580a2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:59:20.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:20.701+0000 7f3474bb7700 1 --2- 172.21.15.26:0/593217877 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f34580a0490 0x7f34580a2950 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3460003790 tx=0x7f3460005fd0 comp rx=0 tx=0).stop 2023-12-01T00:59:20.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:20.701+0000 7f3474bb7700 1 -- 172.21.15.26:0/593217877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34701041e0 msgr2=0x7f34700ff860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:59:20.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:20.701+0000 7f3474bb7700 1 --2- 172.21.15.26:0/593217877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34701041e0 0x7f34700ff860 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f346400c9b0 tx=0x7f346400ccc0 comp rx=0 tx=0).stop 2023-12-01T00:59:20.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:20.701+0000 7f3474bb7700 1 -- 172.21.15.26:0/593217877 shutdown_connections 2023-12-01T00:59:20.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:20.701+0000 7f3474bb7700 1 --2- 172.21.15.26:0/593217877 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f34580a0490 0x7f34580a2950 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:20.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:20.701+0000 7f3474bb7700 1 --2- 172.21.15.26:0/593217877 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3470106b10 0x7f34700ffda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:20.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:20.701+0000 7f3474bb7700 1 --2- 172.21.15.26:0/593217877 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f34701018b0 0x7f3470101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:20.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:20.701+0000 7f3474bb7700 1 --2- 172.21.15.26:0/593217877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34701041e0 0x7f34700ff860 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:20.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:20.701+0000 7f3474bb7700 1 -- 172.21.15.26:0/593217877 >> 172.21.15.26:0/593217877 conn(0x7f34700fb2a0 msgr2=0x7f3470102520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:59:20.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:20.701+0000 7f3474bb7700 1 -- 172.21.15.26:0/593217877 shutdown_connections 2023-12-01T00:59:20.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T00:59:20.701+0000 7f3474bb7700 1 -- 172.21.15.26:0/593217877 wait complete. 2023-12-01T00:59:21.141 DEBUG:teuthology.orchestra.run.smithi026:osd.3> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.3.service 2023-12-01T00:59:21.144 INFO:tasks.cephadm:Deploying osd.4 on smithi093 with /dev/vg_nvme/lv_3... 2023-12-01T00:59:21.144 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-01T00:59:21.175 INFO:journalctl@ceph.osd.3.smithi026.stdout:-- Logs begin at Fri 2023-12-01 00:41:45 UTC. -- 2023-12-01T00:59:21.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:21 smithi093 ceph-mon[103327]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-01T00:59:21.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:21.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:21.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:21.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:21.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:21 smithi116 ceph-mon[103554]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-01T00:59:21.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:21.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:21.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:21.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:21.709 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.b/config 2023-12-01T00:59:21.757 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:21 smithi026 ceph-mon[98801]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-01T00:59:21.757 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:21.757 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:21.758 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:21.758 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:22.046 INFO:journalctl@ceph.osd.3.smithi026.stdout:Dec 01 00:59:21 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-3[125295]: 2023-12-01T00:59:21.976+0000 7fa4410fa640 -1 osd.3 0 log_to_monitors true 2023-12-01T00:59:22.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:22 smithi093 ceph-mon[103327]: from='osd.3 [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-01T00:59:22.581 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:22 smithi026 ceph-mon[98801]: from='osd.3 [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-01T00:59:22.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:22 smithi116 ceph-mon[103554]: from='osd.3 [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-01T00:59:23.088 INFO:teuthology.orchestra.run.smithi093.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-01T00:59:23.089 INFO:teuthology.orchestra.run.smithi093.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-01T00:59:23.089 INFO:teuthology.orchestra.run.smithi093.stderr: stderr: 10+0 records in 2023-12-01T00:59:23.089 INFO:teuthology.orchestra.run.smithi093.stderr:10+0 records out 2023-12-01T00:59:23.089 INFO:teuthology.orchestra.run.smithi093.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111212 s, 943 MB/s 2023-12-01T00:59:23.089 INFO:teuthology.orchestra.run.smithi093.stderr:--> Zapping successful for: 2023-12-01T00:59:23.460 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:23 smithi093 ceph-mon[103327]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-12-01T00:59:23.460 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:23 smithi093 ceph-mon[103327]: from='osd.3 [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-01T00:59:23.460 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:23 smithi093 ceph-mon[103327]: osdmap e23: 4 total, 3 up, 4 in 2023-12-01T00:59:23.461 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:23 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:23.461 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:23 smithi093 ceph-mon[103327]: from='osd.3 [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2023-12-01T00:59:23.462 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi093:vg_nvme/lv_3 2023-12-01T00:59:23.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:23 smithi116 ceph-mon[103554]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-12-01T00:59:23.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:23 smithi116 ceph-mon[103554]: from='osd.3 [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-01T00:59:23.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:23 smithi116 ceph-mon[103554]: osdmap e23: 4 total, 3 up, 4 in 2023-12-01T00:59:23.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:23 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:23.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:23 smithi116 ceph-mon[103554]: from='osd.3 [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2023-12-01T00:59:23.796 INFO:journalctl@ceph.osd.3.smithi026.stdout:Dec 01 00:59:23 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-3[125295]: 2023-12-01T00:59:23.339+0000 7fa436771700 -1 osd.3 0 waiting for initial osdmap 2023-12-01T00:59:23.796 INFO:journalctl@ceph.osd.3.smithi026.stdout:Dec 01 00:59:23 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-3[125295]: 2023-12-01T00:59:23.345+0000 7fa42e55e700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T00:59:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:23 smithi026 ceph-mon[98801]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 767 B/s rd, 22 KiB/s wr, 1 op/s 2023-12-01T00:59:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:23 smithi026 ceph-mon[98801]: from='osd.3 [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-01T00:59:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:23 smithi026 ceph-mon[98801]: osdmap e23: 4 total, 3 up, 4 in 2023-12-01T00:59:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:23 smithi026 ceph-mon[98801]: from='osd.3 [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2023-12-01T00:59:24.010 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.b/config 2023-12-01T00:59:24.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:24 smithi093 ceph-mon[103327]: from='osd.3 [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2023-12-01T00:59:24.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:24 smithi093 ceph-mon[103327]: osdmap e24: 4 total, 3 up, 4 in 2023-12-01T00:59:24.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:24.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:24.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:24.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:24.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:59:24.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:59:24.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:24.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:24.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:24.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:24.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:24.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:24 smithi093 ceph-mon[103327]: osd.3 [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137] boot 2023-12-01T00:59:24.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:24 smithi093 ceph-mon[103327]: osdmap e25: 4 total, 4 up, 4 in 2023-12-01T00:59:24.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:24.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:24 smithi116 ceph-mon[103554]: from='osd.3 [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2023-12-01T00:59:24.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:24 smithi116 ceph-mon[103554]: osdmap e24: 4 total, 3 up, 4 in 2023-12-01T00:59:24.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:24.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:24.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:24.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:59:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:59:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:24 smithi116 ceph-mon[103554]: osd.3 [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137] boot 2023-12-01T00:59:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:24 smithi116 ceph-mon[103554]: osdmap e25: 4 total, 4 up, 4 in 2023-12-01T00:59:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:24 smithi026 ceph-mon[98801]: from='osd.3 [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2023-12-01T00:59:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:24 smithi026 ceph-mon[98801]: osdmap e24: 4 total, 3 up, 4 in 2023-12-01T00:59:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:59:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:59:24.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:24.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:24.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:24.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:24.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:24.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:24 smithi026 ceph-mon[98801]: osd.3 [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137] boot 2023-12-01T00:59:24.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:24 smithi026 ceph-mon[98801]: osdmap e25: 4 total, 4 up, 4 in 2023-12-01T00:59:24.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-01T00:59:25.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.092+0000 7fbe50220700 1 -- 172.21.15.93:0/2365668872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe480fffd0 msgr2=0x7fbe48100450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:59:25.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.092+0000 7fbe50220700 1 --2- 172.21.15.93:0/2365668872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe480fffd0 0x7fbe48100450 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbe38009990 tx=0x7fbe38009ca0 comp rx=0 tx=0).stop 2023-12-01T00:59:25.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.092+0000 7fbe50220700 1 -- 172.21.15.93:0/2365668872 shutdown_connections 2023-12-01T00:59:25.096 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.092+0000 7fbe50220700 1 --2- 172.21.15.93:0/2365668872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe48100990 0x7fbe48108230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:25.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.092+0000 7fbe50220700 1 --2- 172.21.15.93:0/2365668872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe48101400 0x7fbe48101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:25.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.092+0000 7fbe50220700 1 --2- 172.21.15.93:0/2365668872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe480fffd0 0x7fbe48100450 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:25.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.092+0000 7fbe50220700 1 -- 172.21.15.93:0/2365668872 >> 172.21.15.93:0/2365668872 conn(0x7fbe480faaa0 msgr2=0x7fbe480fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:59:25.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.092+0000 7fbe50220700 1 -- 172.21.15.93:0/2365668872 shutdown_connections 2023-12-01T00:59:25.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.092+0000 7fbe50220700 1 -- 172.21.15.93:0/2365668872 wait complete. 2023-12-01T00:59:25.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.092+0000 7fbe50220700 1 Processor -- start 2023-12-01T00:59:25.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.092+0000 7fbe50220700 1 -- start start 2023-12-01T00:59:25.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe50220700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe480fffd0 0x7fbe4810a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:59:25.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe50220700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe48100990 0x7fbe48108da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:59:25.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe50220700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe48101400 0x7fbe481092e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:59:25.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe50220700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe48109a60 con 0x7fbe48101400 2023-12-01T00:59:25.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe50220700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe48109bd0 con 0x7fbe480fffd0 2023-12-01T00:59:25.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe50220700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe481a0b60 con 0x7fbe48100990 2023-12-01T00:59:25.097 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe4dfbc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe480fffd0 0x7fbe4810a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:59:25.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe4dfbc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe480fffd0 0x7fbe4810a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:49476/0 (socket says 172.21.15.93:49476) 2023-12-01T00:59:25.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe4dfbc700 1 -- 172.21.15.93:0/4080736450 learned_addr learned my addr 172.21.15.93:0/4080736450 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-01T00:59:25.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe4e7bd700 1 --2- 172.21.15.93:0/4080736450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe48101400 0x7fbe481092e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:59:25.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe4d7bb700 1 --2- 172.21.15.93:0/4080736450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe48100990 0x7fbe48108da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:59:25.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe4dfbc700 1 -- 172.21.15.93:0/4080736450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe48100990 msgr2=0x7fbe48108da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:59:25.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe4dfbc700 1 --2- 172.21.15.93:0/4080736450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe48100990 0x7fbe48108da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:25.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe4dfbc700 1 -- 172.21.15.93:0/4080736450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe48101400 msgr2=0x7fbe481092e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:59:25.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe4dfbc700 1 --2- 172.21.15.93:0/4080736450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe48101400 0x7fbe481092e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:25.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe4dfbc700 1 -- 172.21.15.93:0/4080736450 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe380095f0 con 0x7fbe480fffd0 2023-12-01T00:59:25.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe4d7bb700 1 --2- 172.21.15.93:0/4080736450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe48100990 0x7fbe48108da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T00:59:25.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe4dfbc700 1 --2- 172.21.15.93:0/4080736450 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe480fffd0 0x7fbe4810a750 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400c9b0 tx=0x7fbe4400ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:59:25.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe3effd700 1 -- 172.21.15.93:0/4080736450 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44007b00 con 0x7fbe480fffd0 2023-12-01T00:59:25.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe3effd700 1 -- 172.21.15.93:0/4080736450 <== mon.2 v2:172.21.15.93:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbe44007c60 con 0x7fbe480fffd0 2023-12-01T00:59:25.098 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe50220700 1 -- 172.21.15.93:0/4080736450 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe481a0e40 con 0x7fbe480fffd0 2023-12-01T00:59:25.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe3effd700 1 -- 172.21.15.93:0/4080736450 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44018660 con 0x7fbe480fffd0 2023-12-01T00:59:25.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.093+0000 7fbe50220700 1 -- 172.21.15.93:0/4080736450 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe481a1250 con 0x7fbe480fffd0 2023-12-01T00:59:25.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.094+0000 7fbe50220700 1 -- 172.21.15.93:0/4080736450 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe48106be0 con 0x7fbe480fffd0 2023-12-01T00:59:25.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.095+0000 7fbe3effd700 1 -- 172.21.15.93:0/4080736450 <== mon.2 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fbe4400f450 con 0x7fbe480fffd0 2023-12-01T00:59:25.099 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.096+0000 7fbe3effd700 1 --2- 172.21.15.93:0/4080736450 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe340a0520 0x7fbe340a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:59:25.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.096+0000 7fbe3effd700 1 -- 172.21.15.93:0/4080736450 <== mon.2 v2:172.21.15.93:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3702+0+0 (secure 0 0 0) 0x7fbe440ca6c0 con 0x7fbe480fffd0 2023-12-01T00:59:25.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.096+0000 7fbe4d7bb700 1 --2- 172.21.15.93:0/4080736450 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe340a0520 0x7fbe340a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:59:25.100 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.097+0000 7fbe4d7bb700 1 --2- 172.21.15.93:0/4080736450 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe340a0520 0x7fbe340a29e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbe380095c0 tx=0x7fbe38009510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:59:25.101 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.101+0000 7fbe3effd700 1 -- 172.21.15.93:0/4080736450 <== mon.2 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fbe44095460 con 0x7fbe480fffd0 2023-12-01T00:59:25.298 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:25.298+0000 7fbe50220700 1 -- 172.21.15.93:0/4080736450 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fbe480611d0 con 0x7fbe340a0520 2023-12-01T00:59:25.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:25 smithi116 ceph-mon[103554]: purged_snaps scrub starts 2023-12-01T00:59:25.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:25 smithi116 ceph-mon[103554]: purged_snaps scrub ok 2023-12-01T00:59:25.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:25 smithi116 ceph-mon[103554]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:25.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:25 smithi116 ceph-mon[103554]: Detected new or changed devices on smithi026 2023-12-01T00:59:25.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:25 smithi116 ceph-mon[103554]: Adjusting osd_memory_target on smithi026 to 8586M 2023-12-01T00:59:25.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:25.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:25.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:25.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:25 smithi116 ceph-mon[103554]: osdmap e26: 4 total, 4 up, 4 in 2023-12-01T00:59:25.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:59:25.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:59:25.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:25.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:25 smithi093 ceph-mon[103327]: purged_snaps scrub starts 2023-12-01T00:59:25.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:25 smithi093 ceph-mon[103327]: purged_snaps scrub ok 2023-12-01T00:59:25.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:25 smithi093 ceph-mon[103327]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:25.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:25 smithi093 ceph-mon[103327]: Detected new or changed devices on smithi026 2023-12-01T00:59:25.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:25 smithi093 ceph-mon[103327]: Adjusting osd_memory_target on smithi026 to 8586M 2023-12-01T00:59:25.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:25.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:25.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:25.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:25 smithi093 ceph-mon[103327]: osdmap e26: 4 total, 4 up, 4 in 2023-12-01T00:59:25.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:59:25.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:59:25.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:25.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:25 smithi026 ceph-mon[98801]: purged_snaps scrub starts 2023-12-01T00:59:25.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:25 smithi026 ceph-mon[98801]: purged_snaps scrub ok 2023-12-01T00:59:25.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:25 smithi026 ceph-mon[98801]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-01T00:59:25.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:25 smithi026 ceph-mon[98801]: Detected new or changed devices on smithi026 2023-12-01T00:59:25.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:25 smithi026 ceph-mon[98801]: Adjusting osd_memory_target on smithi026 to 8586M 2023-12-01T00:59:25.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:25.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:25.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:25.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:25 smithi026 ceph-mon[98801]: osdmap e26: 4 total, 4 up, 4 in 2023-12-01T00:59:25.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:59:25.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:59:25.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:26.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:26 smithi116 ceph-mon[103554]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:59:26.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:26 smithi116 ceph-mon[103554]: osdmap e27: 4 total, 4 up, 4 in 2023-12-01T00:59:26.681 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:26 smithi093 ceph-mon[103327]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:59:26.681 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:26 smithi093 ceph-mon[103327]: osdmap e27: 4 total, 4 up, 4 in 2023-12-01T00:59:26.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:26 smithi026 ceph-mon[98801]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:59:26.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:26 smithi026 ceph-mon[98801]: osdmap e27: 4 total, 4 up, 4 in 2023-12-01T00:59:27.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:27 smithi116 ceph-mon[103554]: pgmap v90: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-12-01T00:59:27.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:27 smithi093 ceph-mon[103327]: pgmap v90: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-12-01T00:59:27.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:27 smithi026 ceph-mon[98801]: pgmap v90: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-12-01T00:59:28.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:28 smithi116 ceph-mon[103554]: osdmap e28: 4 total, 4 up, 4 in 2023-12-01T00:59:28.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:28 smithi116 ceph-mon[103554]: from='client.? 172.21.15.93:0/656925969' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d18c3e93-6ffc-4ef6-94d6-99fb3753ded3"}]: dispatch 2023-12-01T00:59:28.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:28 smithi116 ceph-mon[103554]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d18c3e93-6ffc-4ef6-94d6-99fb3753ded3"}]: dispatch 2023-12-01T00:59:28.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:28 smithi116 ceph-mon[103554]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d18c3e93-6ffc-4ef6-94d6-99fb3753ded3"}]': finished 2023-12-01T00:59:28.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:28 smithi116 ceph-mon[103554]: osdmap e29: 5 total, 4 up, 5 in 2023-12-01T00:59:28.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:28 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-01T00:59:28.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:28 smithi116 ceph-mon[103554]: from='client.? 172.21.15.93:0/3984560304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:59:28.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:28 smithi093 ceph-mon[103327]: osdmap e28: 4 total, 4 up, 4 in 2023-12-01T00:59:28.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:28 smithi093 ceph-mon[103327]: from='client.? 172.21.15.93:0/656925969' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d18c3e93-6ffc-4ef6-94d6-99fb3753ded3"}]: dispatch 2023-12-01T00:59:28.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:28 smithi093 ceph-mon[103327]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d18c3e93-6ffc-4ef6-94d6-99fb3753ded3"}]: dispatch 2023-12-01T00:59:28.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:28 smithi093 ceph-mon[103327]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d18c3e93-6ffc-4ef6-94d6-99fb3753ded3"}]': finished 2023-12-01T00:59:28.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:28 smithi093 ceph-mon[103327]: osdmap e29: 5 total, 4 up, 5 in 2023-12-01T00:59:28.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:28 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-01T00:59:28.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:28 smithi093 ceph-mon[103327]: from='client.? 172.21.15.93:0/3984560304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:59:28.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:28 smithi026 ceph-mon[98801]: osdmap e28: 4 total, 4 up, 4 in 2023-12-01T00:59:28.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:28 smithi026 ceph-mon[98801]: from='client.? 172.21.15.93:0/656925969' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d18c3e93-6ffc-4ef6-94d6-99fb3753ded3"}]: dispatch 2023-12-01T00:59:28.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:28 smithi026 ceph-mon[98801]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d18c3e93-6ffc-4ef6-94d6-99fb3753ded3"}]: dispatch 2023-12-01T00:59:28.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:28 smithi026 ceph-mon[98801]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d18c3e93-6ffc-4ef6-94d6-99fb3753ded3"}]': finished 2023-12-01T00:59:28.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:28 smithi026 ceph-mon[98801]: osdmap e29: 5 total, 4 up, 5 in 2023-12-01T00:59:28.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:28 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-01T00:59:28.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:28 smithi026 ceph-mon[98801]: from='client.? 172.21.15.93:0/3984560304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:59:29.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:29 smithi116 ceph-mon[103554]: pgmap v94: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-12-01T00:59:29.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:29 smithi093 ceph-mon[103327]: pgmap v94: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-12-01T00:59:30.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:29 smithi026 ceph-mon[98801]: pgmap v94: 1 pgs: 1 remapped+peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-12-01T00:59:31.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:31 smithi116 ceph-mon[103554]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-12-01T00:59:31.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:31 smithi093 ceph-mon[103327]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-12-01T00:59:32.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:31 smithi026 ceph-mon[98801]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-12-01T00:59:33.877 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:33 smithi093 ceph-mon[103327]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-01T00:59:33.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:33 smithi116 ceph-mon[103554]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-01T00:59:34.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:33 smithi026 ceph-mon[98801]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-01T00:59:34.776 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:34 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-01T00:59:34.777 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:34 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:34.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:34 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-01T00:59:34.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:34 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:35.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:34 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-01T00:59:35.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:34 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:35.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:35 smithi116 ceph-mon[103554]: Deploying daemon osd.4 on smithi093 2023-12-01T00:59:35.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:35 smithi116 ceph-mon[103554]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-12-01T00:59:35.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:35 smithi093 ceph-mon[103327]: Deploying daemon osd.4 on smithi093 2023-12-01T00:59:35.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:35 smithi093 ceph-mon[103327]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-12-01T00:59:36.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:35 smithi026 ceph-mon[98801]: Deploying daemon osd.4 on smithi093 2023-12-01T00:59:36.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:35 smithi026 ceph-mon[98801]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-12-01T00:59:37.909 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:37 smithi093 ceph-mon[103327]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2023-12-01T00:59:37.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:37 smithi116 ceph-mon[103554]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2023-12-01T00:59:38.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:37 smithi026 ceph-mon[98801]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 67 KiB/s, 0 objects/s recovering 2023-12-01T00:59:39.110 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:39 smithi093 ceph-mon[103327]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-12-01T00:59:39.110 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:39 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:39.110 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:39 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:39.110 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:39 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:39.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:39 smithi116 ceph-mon[103554]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-12-01T00:59:39.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:39 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:39.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:39 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:39.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:39 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:39.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:39 smithi026 ceph-mon[98801]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 56 KiB/s, 0 objects/s recovering 2023-12-01T00:59:39.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:39 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:39.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:39 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:39.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:39 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:40.607 INFO:teuthology.orchestra.run.smithi093.stdout:Created osd(s) 4 on host 'smithi093' 2023-12-01T00:59:40.608 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:40.605+0000 7fbe3effd700 1 -- 172.21.15.93:0/4080736450 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fbe480611d0 con 0x7fbe340a0520 2023-12-01T00:59:40.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:40.608+0000 7fbe50220700 1 -- 172.21.15.93:0/4080736450 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe340a0520 msgr2=0x7fbe340a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:59:40.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:40.608+0000 7fbe50220700 1 --2- 172.21.15.93:0/4080736450 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe340a0520 0x7fbe340a29e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbe380095c0 tx=0x7fbe38009510 comp rx=0 tx=0).stop 2023-12-01T00:59:40.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:40.608+0000 7fbe50220700 1 -- 172.21.15.93:0/4080736450 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe480fffd0 msgr2=0x7fbe4810a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:59:40.609 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:40.608+0000 7fbe50220700 1 --2- 172.21.15.93:0/4080736450 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe480fffd0 0x7fbe4810a750 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbe4400c9b0 tx=0x7fbe4400ccc0 comp rx=0 tx=0).stop 2023-12-01T00:59:40.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:40.608+0000 7fbe50220700 1 -- 172.21.15.93:0/4080736450 shutdown_connections 2023-12-01T00:59:40.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:40.608+0000 7fbe50220700 1 --2- 172.21.15.93:0/4080736450 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe340a0520 0x7fbe340a29e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:40.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:40.608+0000 7fbe50220700 1 --2- 172.21.15.93:0/4080736450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe48101400 0x7fbe481092e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:40.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:40.608+0000 7fbe50220700 1 --2- 172.21.15.93:0/4080736450 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe480fffd0 0x7fbe4810a750 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:40.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:40.608+0000 7fbe50220700 1 --2- 172.21.15.93:0/4080736450 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe48100990 0x7fbe48108da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:40.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:40.608+0000 7fbe50220700 1 -- 172.21.15.93:0/4080736450 >> 172.21.15.93:0/4080736450 conn(0x7fbe480faaa0 msgr2=0x7fbe480fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:59:40.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:40.608+0000 7fbe50220700 1 -- 172.21.15.93:0/4080736450 shutdown_connections 2023-12-01T00:59:40.610 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T00:59:40.608+0000 7fbe50220700 1 -- 172.21.15.93:0/4080736450 wait complete. 2023-12-01T00:59:40.997 DEBUG:teuthology.orchestra.run.smithi093:osd.4> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.4.service 2023-12-01T00:59:40.999 INFO:tasks.cephadm:Deploying osd.5 on smithi116 with /dev/vg_nvme/lv_3... 2023-12-01T00:59:40.999 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-01T00:59:41.031 INFO:journalctl@ceph.osd.4.smithi093.stdout:-- Logs begin at Fri 2023-12-01 00:42:14 UTC. -- 2023-12-01T00:59:41.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:41 smithi116 ceph-mon[103554]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-01T00:59:41.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:41.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:41.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:41.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:41.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:41.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:41.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:41.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:41.464 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:41 smithi093 ceph-mon[103327]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-01T00:59:41.464 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:41.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:41.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:41.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:41.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:41.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:41.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:41.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:41.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:41 smithi026 ceph-mon[98801]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-01T00:59:41.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:41.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:41.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:41.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:41.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:41.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:41.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:41.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:41.550 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.c/config 2023-12-01T00:59:42.381 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:42 smithi116 ceph-mon[103554]: from='osd.4 [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-01T00:59:42.381 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:42 smithi116 ceph-mon[103554]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-01T00:59:42.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:42 smithi093 ceph-mon[103327]: from='osd.4 [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-01T00:59:42.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:42 smithi093 ceph-mon[103327]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-01T00:59:42.466 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 01 00:59:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-4[117133]: 2023-12-01T00:59:42.020+0000 7fdfc050e640 -1 osd.4 0 log_to_monitors true 2023-12-01T00:59:42.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:42 smithi026 ceph-mon[98801]: from='osd.4 [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-01T00:59:42.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:42 smithi026 ceph-mon[98801]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-01T00:59:42.856 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-01T00:59:42.856 INFO:teuthology.orchestra.run.smithi116.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-01T00:59:42.856 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10+0 records in 2023-12-01T00:59:42.856 INFO:teuthology.orchestra.run.smithi116.stderr:10+0 records out 2023-12-01T00:59:42.856 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109907 s, 954 MB/s 2023-12-01T00:59:42.856 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping successful for: 2023-12-01T00:59:43.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:43 smithi116 ceph-mon[103554]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-12-01T00:59:43.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:43 smithi116 ceph-mon[103554]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-01T00:59:43.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:43 smithi116 ceph-mon[103554]: osdmap e30: 5 total, 4 up, 5 in 2023-12-01T00:59:43.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:43 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-01T00:59:43.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:43 smithi116 ceph-mon[103554]: from='osd.4 [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T00:59:43.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:43 smithi116 ceph-mon[103554]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T00:59:43.188 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi116:vg_nvme/lv_3 2023-12-01T00:59:43.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:43 smithi093 ceph-mon[103327]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-12-01T00:59:43.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:43 smithi093 ceph-mon[103327]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-01T00:59:43.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:43 smithi093 ceph-mon[103327]: osdmap e30: 5 total, 4 up, 5 in 2023-12-01T00:59:43.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:43 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-01T00:59:43.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:43 smithi093 ceph-mon[103327]: from='osd.4 [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T00:59:43.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:43 smithi093 ceph-mon[103327]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T00:59:43.216 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 01 00:59:43 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-4[117133]: 2023-12-01T00:59:43.139+0000 7fdfb5b85700 -1 osd.4 0 waiting for initial osdmap 2023-12-01T00:59:43.216 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 01 00:59:43 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-4[117133]: 2023-12-01T00:59:43.144+0000 7fdfad972700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T00:59:43.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:43 smithi026 ceph-mon[98801]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-12-01T00:59:43.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:43 smithi026 ceph-mon[98801]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-01T00:59:43.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:43 smithi026 ceph-mon[98801]: osdmap e30: 5 total, 4 up, 5 in 2023-12-01T00:59:43.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:43 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-01T00:59:43.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:43 smithi026 ceph-mon[98801]: from='osd.4 [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T00:59:43.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:43 smithi026 ceph-mon[98801]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T00:59:43.737 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.c/config 2023-12-01T00:59:44.150 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:44 smithi116 ceph-mon[103554]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-01T00:59:44.150 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:44 smithi116 ceph-mon[103554]: osdmap e31: 5 total, 4 up, 5 in 2023-12-01T00:59:44.150 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-01T00:59:44.150 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-01T00:59:44.150 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:44 smithi116 ceph-mon[103554]: Detected new or changed devices on smithi093 2023-12-01T00:59:44.150 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:44.150 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:44.150 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:59:44.151 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:59:44.151 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:44 smithi116 ceph-mon[103554]: Adjusting osd_memory_target on smithi093 to 8584M 2023-12-01T00:59:44.151 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:44.151 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:44.151 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:44.151 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:44.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:44 smithi093 ceph-mon[103327]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-01T00:59:44.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:44 smithi093 ceph-mon[103327]: osdmap e31: 5 total, 4 up, 5 in 2023-12-01T00:59:44.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-01T00:59:44.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-01T00:59:44.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:44 smithi093 ceph-mon[103327]: Detected new or changed devices on smithi093 2023-12-01T00:59:44.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:44.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:44.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:59:44.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:59:44.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:44 smithi093 ceph-mon[103327]: Adjusting osd_memory_target on smithi093 to 8584M 2023-12-01T00:59:44.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:44.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:44.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:44.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:44.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:44 smithi026 ceph-mon[98801]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-01T00:59:44.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:44 smithi026 ceph-mon[98801]: osdmap e31: 5 total, 4 up, 5 in 2023-12-01T00:59:44.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-01T00:59:44.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-01T00:59:44.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:44 smithi026 ceph-mon[98801]: Detected new or changed devices on smithi093 2023-12-01T00:59:44.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:44.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:44.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:59:44.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-01T00:59:44.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:44 smithi026 ceph-mon[98801]: Adjusting osd_memory_target on smithi093 to 8584M 2023-12-01T00:59:44.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:44.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:44.548 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:44.548 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:44.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.798+0000 7f9b85982700 1 -- 172.21.15.116:0/2164983289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b801041e0 msgr2=0x7f9b801065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:59:44.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.798+0000 7f9b85982700 1 --2- 172.21.15.116:0/2164983289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b801041e0 0x7f9b801065d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009990 tx=0x7f9b70009ca0 comp rx=0 tx=0).stop 2023-12-01T00:59:44.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.798+0000 7f9b85982700 1 -- 172.21.15.116:0/2164983289 shutdown_connections 2023-12-01T00:59:44.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.798+0000 7f9b85982700 1 --2- 172.21.15.116:0/2164983289 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b80106b10 0x7f9b80108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:44.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.798+0000 7f9b85982700 1 --2- 172.21.15.116:0/2164983289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b801018b0 0x7f9b80103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:44.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.798+0000 7f9b85982700 1 --2- 172.21.15.116:0/2164983289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b801041e0 0x7f9b801065d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:44.800 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.798+0000 7f9b85982700 1 -- 172.21.15.116:0/2164983289 >> 172.21.15.116:0/2164983289 conn(0x7f9b800fb2a0 msgr2=0x7f9b800fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T00:59:44.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.798+0000 7f9b85982700 1 -- 172.21.15.116:0/2164983289 shutdown_connections 2023-12-01T00:59:44.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.798+0000 7f9b85982700 1 -- 172.21.15.116:0/2164983289 wait complete. 2023-12-01T00:59:44.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.799+0000 7f9b85982700 1 Processor -- start 2023-12-01T00:59:44.801 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.799+0000 7f9b85982700 1 -- start start 2023-12-01T00:59:44.802 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.799+0000 7f9b85982700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b801018b0 0x7f9b80196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:59:44.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.799+0000 7f9b85982700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b801041e0 0x7f9b801971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:59:44.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.799+0000 7f9b85982700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b80106b10 0x7f9b8019e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:59:44.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.799+0000 7f9b85982700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8019e820 con 0x7f9b80106b10 2023-12-01T00:59:44.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.799+0000 7f9b85982700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8019e960 con 0x7f9b801018b0 2023-12-01T00:59:44.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.799+0000 7f9b85982700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8019eb20 con 0x7f9b801041e0 2023-12-01T00:59:44.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.799+0000 7f9b7e7fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b801041e0 0x7f9b801971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:59:44.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.799+0000 7f9b7e7fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b801041e0 0x7f9b801971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54240/0 (socket says 172.21.15.116:54240) 2023-12-01T00:59:44.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.799+0000 7f9b7e7fc700 1 -- 172.21.15.116:0/2406249182 learned_addr learned my addr 172.21.15.116:0/2406249182 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-12-01T00:59:44.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.800+0000 7f9b7effd700 1 --2- 172.21.15.116:0/2406249182 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b801018b0 0x7f9b80196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:59:44.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.800+0000 7f9b7f7fe700 1 --2- 172.21.15.116:0/2406249182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b80106b10 0x7f9b8019e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:59:44.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.800+0000 7f9b7e7fc700 1 -- 172.21.15.116:0/2406249182 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b801018b0 msgr2=0x7f9b80196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:59:44.803 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.800+0000 7f9b7e7fc700 1 --2- 172.21.15.116:0/2406249182 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b801018b0 0x7f9b80196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:44.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.800+0000 7f9b7e7fc700 1 -- 172.21.15.116:0/2406249182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b80106b10 msgr2=0x7f9b8019e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T00:59:44.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.800+0000 7f9b7e7fc700 1 --2- 172.21.15.116:0/2406249182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b80106b10 0x7f9b8019e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T00:59:44.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.800+0000 7f9b7e7fc700 1 -- 172.21.15.116:0/2406249182 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b700095f0 con 0x7f9b801041e0 2023-12-01T00:59:44.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.800+0000 7f9b7e7fc700 1 --2- 172.21.15.116:0/2406249182 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b801041e0 0x7f9b801971e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9b70006010 tx=0x7f9b7000f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:59:44.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.800+0000 7f9b84980700 1 -- 172.21.15.116:0/2406249182 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7001d070 con 0x7f9b801041e0 2023-12-01T00:59:44.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.800+0000 7f9b84980700 1 -- 172.21.15.116:0/2406249182 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9b7000fc30 con 0x7f9b801041e0 2023-12-01T00:59:44.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.800+0000 7f9b85982700 1 -- 172.21.15.116:0/2406249182 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8019eda0 con 0x7f9b801041e0 2023-12-01T00:59:44.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.800+0000 7f9b84980700 1 -- 172.21.15.116:0/2406249182 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70017720 con 0x7f9b801041e0 2023-12-01T00:59:44.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.800+0000 7f9b85982700 1 -- 172.21.15.116:0/2406249182 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8019f240 con 0x7f9b801041e0 2023-12-01T00:59:44.804 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.801+0000 7f9b85982700 1 -- 172.21.15.116:0/2406249182 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b800fce20 con 0x7f9b801041e0 2023-12-01T00:59:44.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.802+0000 7f9b84980700 1 -- 172.21.15.116:0/2406249182 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f9b70017880 con 0x7f9b801041e0 2023-12-01T00:59:44.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.803+0000 7f9b84980700 1 --2- 172.21.15.116:0/2406249182 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9b680a05a0 0x7f9b680a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T00:59:44.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.803+0000 7f9b84980700 1 -- 172.21.15.116:0/2406249182 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f9b700cc090 con 0x7f9b801041e0 2023-12-01T00:59:44.805 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.803+0000 7f9b7effd700 1 --2- 172.21.15.116:0/2406249182 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9b680a05a0 0x7f9b680a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T00:59:44.806 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.804+0000 7f9b7effd700 1 --2- 172.21.15.116:0/2406249182 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9b680a05a0 0x7f9b680a2a60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b74006fd0 tx=0x7f9b74008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T00:59:44.809 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:44.807+0000 7f9b84980700 1 -- 172.21.15.116:0/2406249182 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9b70096d30 con 0x7f9b801041e0 2023-12-01T00:59:45.004 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T00:59:45.003+0000 7f9b85982700 1 -- 172.21.15.116:0/2406249182 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b800611d0 con 0x7f9b680a05a0 2023-12-01T00:59:45.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:45 smithi116 ceph-mon[103554]: purged_snaps scrub starts 2023-12-01T00:59:45.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:45 smithi116 ceph-mon[103554]: purged_snaps scrub ok 2023-12-01T00:59:45.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:45 smithi116 ceph-mon[103554]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-12-01T00:59:45.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:45 smithi116 ceph-mon[103554]: osd.4 [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363] boot 2023-12-01T00:59:45.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:45 smithi116 ceph-mon[103554]: osdmap e32: 5 total, 5 up, 5 in 2023-12-01T00:59:45.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:45 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-01T00:59:45.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:45 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:59:45.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:45 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:59:45.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:45 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:45.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:45 smithi093 ceph-mon[103327]: purged_snaps scrub starts 2023-12-01T00:59:45.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:45 smithi093 ceph-mon[103327]: purged_snaps scrub ok 2023-12-01T00:59:45.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:45 smithi093 ceph-mon[103327]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-12-01T00:59:45.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:45 smithi093 ceph-mon[103327]: osd.4 [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363] boot 2023-12-01T00:59:45.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:45 smithi093 ceph-mon[103327]: osdmap e32: 5 total, 5 up, 5 in 2023-12-01T00:59:45.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:45 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-01T00:59:45.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:45 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:59:45.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:45 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:59:45.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:45 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:45.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:45 smithi026 ceph-mon[98801]: purged_snaps scrub starts 2023-12-01T00:59:45.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:45 smithi026 ceph-mon[98801]: purged_snaps scrub ok 2023-12-01T00:59:45.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:45 smithi026 ceph-mon[98801]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-12-01T00:59:45.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:45 smithi026 ceph-mon[98801]: osd.4 [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363] boot 2023-12-01T00:59:45.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:45 smithi026 ceph-mon[98801]: osdmap e32: 5 total, 5 up, 5 in 2023-12-01T00:59:45.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:45 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-01T00:59:45.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:45 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T00:59:45.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:45 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T00:59:45.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:45 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:46.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:46 smithi116 ceph-mon[103554]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:59:46.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:46 smithi116 ceph-mon[103554]: osdmap e33: 5 total, 5 up, 5 in 2023-12-01T00:59:46.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:46 smithi093 ceph-mon[103327]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:59:46.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:46 smithi093 ceph-mon[103327]: osdmap e33: 5 total, 5 up, 5 in 2023-12-01T00:59:46.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:46 smithi026 ceph-mon[98801]: from='client.24220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T00:59:46.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:46 smithi026 ceph-mon[98801]: osdmap e33: 5 total, 5 up, 5 in 2023-12-01T00:59:47.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:47 smithi116 ceph-mon[103554]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:47.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:47 smithi116 ceph-mon[103554]: from='client.? 172.21.15.116:0/2008361064' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32151c1a-3530-4ae9-a9e0-a71e47ad5a57"}]: dispatch 2023-12-01T00:59:47.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:47 smithi116 ceph-mon[103554]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32151c1a-3530-4ae9-a9e0-a71e47ad5a57"}]: dispatch 2023-12-01T00:59:47.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:47 smithi116 ceph-mon[103554]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32151c1a-3530-4ae9-a9e0-a71e47ad5a57"}]': finished 2023-12-01T00:59:47.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:47 smithi116 ceph-mon[103554]: osdmap e34: 6 total, 5 up, 6 in 2023-12-01T00:59:47.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T00:59:47.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:47 smithi093 ceph-mon[103327]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:47.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:47 smithi093 ceph-mon[103327]: from='client.? 172.21.15.116:0/2008361064' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32151c1a-3530-4ae9-a9e0-a71e47ad5a57"}]: dispatch 2023-12-01T00:59:47.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:47 smithi093 ceph-mon[103327]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32151c1a-3530-4ae9-a9e0-a71e47ad5a57"}]: dispatch 2023-12-01T00:59:47.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:47 smithi093 ceph-mon[103327]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32151c1a-3530-4ae9-a9e0-a71e47ad5a57"}]': finished 2023-12-01T00:59:47.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:47 smithi093 ceph-mon[103327]: osdmap e34: 6 total, 5 up, 6 in 2023-12-01T00:59:47.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T00:59:47.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:47 smithi026 ceph-mon[98801]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:47.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:47 smithi026 ceph-mon[98801]: from='client.? 172.21.15.116:0/2008361064' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32151c1a-3530-4ae9-a9e0-a71e47ad5a57"}]: dispatch 2023-12-01T00:59:47.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:47 smithi026 ceph-mon[98801]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "32151c1a-3530-4ae9-a9e0-a71e47ad5a57"}]: dispatch 2023-12-01T00:59:47.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:47 smithi026 ceph-mon[98801]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "32151c1a-3530-4ae9-a9e0-a71e47ad5a57"}]': finished 2023-12-01T00:59:47.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:47 smithi026 ceph-mon[98801]: osdmap e34: 6 total, 5 up, 6 in 2023-12-01T00:59:47.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T00:59:48.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:48 smithi116 ceph-mon[103554]: from='client.? 172.21.15.116:0/1173919979' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:59:48.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:48 smithi093 ceph-mon[103327]: from='client.? 172.21.15.116:0/1173919979' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:59:48.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:48 smithi026 ceph-mon[98801]: from='client.? 172.21.15.116:0/1173919979' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T00:59:49.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:49 smithi116 ceph-mon[103554]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:49.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:49 smithi093 ceph-mon[103327]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:49.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:49 smithi026 ceph-mon[98801]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:51.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:51 smithi116 ceph-mon[103554]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:51.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:51 smithi093 ceph-mon[103327]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:51.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:51 smithi026 ceph-mon[98801]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:53.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:53 smithi116 ceph-mon[103554]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:53 smithi093 ceph-mon[103327]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:53.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:53 smithi026 ceph-mon[98801]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:54.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:54 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-01T00:59:54.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:54 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:54.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:54 smithi116 ceph-mon[103554]: Deploying daemon osd.5 on smithi116 2023-12-01T00:59:54.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:54 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-01T00:59:54.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:54 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:54.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:54 smithi093 ceph-mon[103327]: Deploying daemon osd.5 on smithi116 2023-12-01T00:59:54.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:54 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-01T00:59:54.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:54 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:54.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:54 smithi026 ceph-mon[98801]: Deploying daemon osd.5 on smithi116 2023-12-01T00:59:55.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:55 smithi116 ceph-mon[103554]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:55.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:55 smithi093 ceph-mon[103327]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:55 smithi026 ceph-mon[98801]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:57.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:57 smithi116 ceph-mon[103554]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:57.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:57 smithi093 ceph-mon[103327]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:57.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:57 smithi026 ceph-mon[98801]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:58.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:58.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:58.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:58.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:58.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:58.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:58.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:58.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:58.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T00:59:59.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:59 smithi116 ceph-mon[103554]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:59.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:59.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:59.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:59.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:59.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 00:59:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:59.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:59 smithi093 ceph-mon[103327]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T00:59:59.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:59.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T00:59:59.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T00:59:59.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T00:59:59.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 00:59:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:00.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:59 smithi026 ceph-mon[98801]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T01:00:00.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:00.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:00.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:00.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:00:00.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 00:59:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:00.265 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:00.264+0000 7f9b84980700 1 -- 172.21.15.116:0/2406249182 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f9b800611d0 con 0x7f9b680a05a0 2023-12-01T01:00:00.265 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 5 on host 'smithi116' 2023-12-01T01:00:00.267 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:00.266+0000 7f9b85982700 1 -- 172.21.15.116:0/2406249182 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9b680a05a0 msgr2=0x7f9b680a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:00:00.267 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:00.266+0000 7f9b85982700 1 --2- 172.21.15.116:0/2406249182 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9b680a05a0 0x7f9b680a2a60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9b74006fd0 tx=0x7f9b74008040 comp rx=0 tx=0).stop 2023-12-01T01:00:00.267 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:00.266+0000 7f9b85982700 1 -- 172.21.15.116:0/2406249182 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b801041e0 msgr2=0x7f9b801971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:00:00.267 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:00.266+0000 7f9b85982700 1 --2- 172.21.15.116:0/2406249182 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b801041e0 0x7f9b801971e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9b70006010 tx=0x7f9b7000f740 comp rx=0 tx=0).stop 2023-12-01T01:00:00.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:00.266+0000 7f9b85982700 1 -- 172.21.15.116:0/2406249182 shutdown_connections 2023-12-01T01:00:00.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:00.266+0000 7f9b85982700 1 --2- 172.21.15.116:0/2406249182 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9b680a05a0 0x7f9b680a2a60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:00.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:00.266+0000 7f9b85982700 1 --2- 172.21.15.116:0/2406249182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b80106b10 0x7f9b8019e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:00.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:00.266+0000 7f9b85982700 1 --2- 172.21.15.116:0/2406249182 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b801018b0 0x7f9b80196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:00.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:00.266+0000 7f9b85982700 1 --2- 172.21.15.116:0/2406249182 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b801041e0 0x7f9b801971e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:00.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:00.266+0000 7f9b85982700 1 -- 172.21.15.116:0/2406249182 >> 172.21.15.116:0/2406249182 conn(0x7f9b800fb2a0 msgr2=0x7f9b80102520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:00:00.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:00.266+0000 7f9b85982700 1 -- 172.21.15.116:0/2406249182 shutdown_connections 2023-12-01T01:00:00.268 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:00.266+0000 7f9b85982700 1 -- 172.21.15.116:0/2406249182 wait complete. 2023-12-01T01:00:00.621 DEBUG:teuthology.orchestra.run.smithi116:osd.5> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.5.service 2023-12-01T01:00:00.623 INFO:tasks.cephadm:Deploying osd.6 on smithi026 with /dev/vg_nvme/lv_2... 2023-12-01T01:00:00.623 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-01T01:00:00.655 INFO:journalctl@ceph.osd.5.smithi116.stdout:-- Logs begin at Fri 2023-12-01 00:41:59 UTC. -- 2023-12-01T01:00:00.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:00 smithi116 ceph-mon[103554]: overall HEALTH_OK 2023-12-01T01:00:00.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:00 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:00.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:00 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:00.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:00 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:00.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:00 smithi093 ceph-mon[103327]: overall HEALTH_OK 2023-12-01T01:00:00.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:00 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:00.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:00 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:00.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:00 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:01.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:00 smithi026 ceph-mon[98801]: overall HEALTH_OK 2023-12-01T01:00:01.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:00 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:01.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:00 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:01.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:00 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:01.202 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:00:01.615 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:01 smithi116 ceph-mon[103554]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T01:00:01.615 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:01 smithi116 ceph-mon[103554]: from='osd.5 [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-01T01:00:01.615 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:01 smithi116 ceph-mon[103554]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-01T01:00:01.615 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:00:01 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:00:01.530+0000 7f6f7f98f640 -1 osd.5 0 log_to_monitors true 2023-12-01T01:00:01.710 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:01 smithi026 ceph-mon[98801]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T01:00:01.710 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:01 smithi026 ceph-mon[98801]: from='osd.5 [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-01T01:00:01.710 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:01 smithi026 ceph-mon[98801]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-01T01:00:01.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:01 smithi093 ceph-mon[103327]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T01:00:01.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:01 smithi093 ceph-mon[103327]: from='osd.5 [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-01T01:00:01.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:01 smithi093 ceph-mon[103327]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-01T01:00:02.667 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-01T01:00:02.667 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-01T01:00:02.667 INFO:teuthology.orchestra.run.smithi026.stderr: stderr: 10+0 records in 2023-12-01T01:00:02.667 INFO:teuthology.orchestra.run.smithi026.stderr:10+0 records out 2023-12-01T01:00:02.667 INFO:teuthology.orchestra.run.smithi026.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00810084 s, 1.3 GB/s 2023-12-01T01:00:02.667 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping successful for: 2023-12-01T01:00:02.852 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:02 smithi026 ceph-mon[98801]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-01T01:00:02.852 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:02 smithi026 ceph-mon[98801]: osdmap e35: 6 total, 5 up, 6 in 2023-12-01T01:00:02.852 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:02 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T01:00:02.852 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:02 smithi026 ceph-mon[98801]: from='osd.5 [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:00:02.852 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:02 smithi026 ceph-mon[98801]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:00:02.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:00:02 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:00:02.569+0000 7f6f75006700 -1 osd.5 0 waiting for initial osdmap 2023-12-01T01:00:02.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:00:02 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:00:02.577+0000 7f6f70dfb700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T01:00:02.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:02 smithi116 ceph-mon[103554]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-01T01:00:02.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:02 smithi116 ceph-mon[103554]: osdmap e35: 6 total, 5 up, 6 in 2023-12-01T01:00:02.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:02 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T01:00:02.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:02 smithi116 ceph-mon[103554]: from='osd.5 [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:00:02.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:02 smithi116 ceph-mon[103554]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:00:02.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:02 smithi093 ceph-mon[103327]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-01T01:00:02.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:02 smithi093 ceph-mon[103327]: osdmap e35: 6 total, 5 up, 6 in 2023-12-01T01:00:02.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:02 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T01:00:02.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:02 smithi093 ceph-mon[103327]: from='osd.5 [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:00:02.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:02 smithi093 ceph-mon[103327]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:00:03.061 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi026:vg_nvme/lv_2 2023-12-01T01:00:03.627 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:00:03.822 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:03 smithi026 ceph-mon[98801]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T01:00:03.823 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:03 smithi026 ceph-mon[98801]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2023-12-01T01:00:03.823 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:03 smithi026 ceph-mon[98801]: osdmap e36: 6 total, 5 up, 6 in 2023-12-01T01:00:03.823 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T01:00:03.823 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T01:00:03.823 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:03.823 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:03.824 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:03.824 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:03.824 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:03.824 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:03.824 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:00:03.824 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:03.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:03 smithi116 ceph-mon[103554]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T01:00:03.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:03 smithi116 ceph-mon[103554]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2023-12-01T01:00:03.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:03 smithi116 ceph-mon[103554]: osdmap e36: 6 total, 5 up, 6 in 2023-12-01T01:00:03.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T01:00:03.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T01:00:03.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:03.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:03.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:03.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:03.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:03.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:03.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:00:03.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:03.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:03 smithi093 ceph-mon[103327]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T01:00:03.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:03 smithi093 ceph-mon[103327]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2023-12-01T01:00:03.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:03 smithi093 ceph-mon[103327]: osdmap e36: 6 total, 5 up, 6 in 2023-12-01T01:00:03.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T01:00:03.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T01:00:03.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:03.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:03.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:03.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:03.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:03.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:03.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:00:03.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:04.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.743+0000 7f052f53b700 1 -- 172.21.15.26:0/1104195366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05281018c0 msgr2=0x7f0528108170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:00:04.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.743+0000 7f052f53b700 1 --2- 172.21.15.26:0/1104195366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05281018c0 0x7f0528108170 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f052000b0d0 tx=0x7f052000b3e0 comp rx=0 tx=0).stop 2023-12-01T01:00:04.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.743+0000 7f052f53b700 1 -- 172.21.15.26:0/1104195366 shutdown_connections 2023-12-01T01:00:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.743+0000 7f052f53b700 1 --2- 172.21.15.26:0/1104195366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05281018c0 0x7f0528108170 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.743+0000 7f052f53b700 1 --2- 172.21.15.26:0/1104195366 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f05280ffd20 0x7f0528100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.743+0000 7f052f53b700 1 --2- 172.21.15.26:0/1104195366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0528100f20 0x7f0528101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.743+0000 7f052f53b700 1 -- 172.21.15.26:0/1104195366 >> 172.21.15.26:0/1104195366 conn(0x7f05280fb2a0 msgr2=0x7f05280fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:00:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.743+0000 7f052f53b700 1 -- 172.21.15.26:0/1104195366 shutdown_connections 2023-12-01T01:00:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.743+0000 7f052f53b700 1 -- 172.21.15.26:0/1104195366 wait complete. 2023-12-01T01:00:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.743+0000 7f052f53b700 1 Processor -- start 2023-12-01T01:00:04.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.743+0000 7f052f53b700 1 -- start start 2023-12-01T01:00:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.743+0000 7f052f53b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05280ffd20 0x7f0528103cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:00:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052f53b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0528100f20 0x7f0528102300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:00:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052f53b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05281018c0 0x7f0528102840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:00:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052f53b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0528102fc0 con 0x7f05280ffd20 2023-12-01T01:00:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052f53b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0528103130 con 0x7f0528100f20 2023-12-01T01:00:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052f53b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05281a0c40 con 0x7f05281018c0 2023-12-01T01:00:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052d2d7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05280ffd20 0x7f0528103cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:00:04.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052d2d7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05280ffd20 0x7f0528103cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52812/0 (socket says 172.21.15.26:52812) 2023-12-01T01:00:04.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052d2d7700 1 -- 172.21.15.26:0/2106754676 learned_addr learned my addr 172.21.15.26:0/2106754676 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:00:04.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052dad8700 1 --2- 172.21.15.26:0/2106754676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05281018c0 0x7f0528102840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:00:04.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052cad6700 1 --2- 172.21.15.26:0/2106754676 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0528100f20 0x7f0528102300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:00:04.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052d2d7700 1 -- 172.21.15.26:0/2106754676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05281018c0 msgr2=0x7f0528102840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:00:04.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052d2d7700 1 --2- 172.21.15.26:0/2106754676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05281018c0 0x7f0528102840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:04.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052d2d7700 1 -- 172.21.15.26:0/2106754676 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0528100f20 msgr2=0x7f0528102300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:00:04.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052d2d7700 1 --2- 172.21.15.26:0/2106754676 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0528100f20 0x7f0528102300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:04.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052d2d7700 1 -- 172.21.15.26:0/2106754676 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0520009d00 con 0x7f05280ffd20 2023-12-01T01:00:04.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052d2d7700 1 --2- 172.21.15.26:0/2106754676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05280ffd20 0x7f0528103cb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f052400c990 tx=0x7f052400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:00:04.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f051e7fc700 1 -- 172.21.15.26:0/2106754676 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524007b00 con 0x7f05280ffd20 2023-12-01T01:00:04.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f051e7fc700 1 -- 172.21.15.26:0/2106754676 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0524007c60 con 0x7f05280ffd20 2023-12-01T01:00:04.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052f53b700 1 -- 172.21.15.26:0/2106754676 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05281a0f20 con 0x7f05280ffd20 2023-12-01T01:00:04.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f051e7fc700 1 -- 172.21.15.26:0/2106754676 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524018660 con 0x7f05280ffd20 2023-12-01T01:00:04.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.744+0000 7f052f53b700 1 -- 172.21.15.26:0/2106754676 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05281a1340 con 0x7f05280ffd20 2023-12-01T01:00:04.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.745+0000 7f052f53b700 1 -- 172.21.15.26:0/2106754676 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052810b670 con 0x7f05280ffd20 2023-12-01T01:00:04.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.746+0000 7f051e7fc700 1 -- 172.21.15.26:0/2106754676 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f0524004020 con 0x7f05280ffd20 2023-12-01T01:00:04.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.747+0000 7f051e7fc700 1 --2- 172.21.15.26:0/2106754676 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f05140a05a0 0x7f05140a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:00:04.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.747+0000 7f052cad6700 1 --2- 172.21.15.26:0/2106754676 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f05140a05a0 0x7f05140a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:00:04.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.747+0000 7f051e7fc700 1 -- 172.21.15.26:0/2106754676 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4562+0+0 (secure 0 0 0) 0x7f05240caaf0 con 0x7f05280ffd20 2023-12-01T01:00:04.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.748+0000 7f052cad6700 1 --2- 172.21.15.26:0/2106754676 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f05140a05a0 0x7f05140a2a60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0518005fd0 tx=0x7f051800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:00:04.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.751+0000 7f051e7fc700 1 -- 172.21.15.26:0/2106754676 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0524095640 con 0x7f05280ffd20 2023-12-01T01:00:04.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:04 smithi026 ceph-mon[98801]: purged_snaps scrub starts 2023-12-01T01:00:04.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:04 smithi026 ceph-mon[98801]: purged_snaps scrub ok 2023-12-01T01:00:04.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:04 smithi026 ceph-mon[98801]: Detected new or changed devices on smithi116 2023-12-01T01:00:04.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:04 smithi026 ceph-mon[98801]: Adjusting osd_memory_target on smithi116 to 8584M 2023-12-01T01:00:04.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T01:00:04.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:04 smithi026 ceph-mon[98801]: osd.5 [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413] boot 2023-12-01T01:00:04.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:04 smithi026 ceph-mon[98801]: osdmap e37: 6 total, 6 up, 6 in 2023-12-01T01:00:04.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T01:00:04.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:04 smithi026 ceph-mon[98801]: osdmap e38: 6 total, 6 up, 6 in 2023-12-01T01:00:04.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:04 smithi116 ceph-mon[103554]: purged_snaps scrub starts 2023-12-01T01:00:04.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:04 smithi116 ceph-mon[103554]: purged_snaps scrub ok 2023-12-01T01:00:04.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:04 smithi116 ceph-mon[103554]: Detected new or changed devices on smithi116 2023-12-01T01:00:04.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:04 smithi116 ceph-mon[103554]: Adjusting osd_memory_target on smithi116 to 8584M 2023-12-01T01:00:04.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T01:00:04.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:04 smithi116 ceph-mon[103554]: osd.5 [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413] boot 2023-12-01T01:00:04.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:04 smithi116 ceph-mon[103554]: osdmap e37: 6 total, 6 up, 6 in 2023-12-01T01:00:04.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T01:00:04.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:04 smithi116 ceph-mon[103554]: osdmap e38: 6 total, 6 up, 6 in 2023-12-01T01:00:04.961 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:04.959+0000 7f052f53b700 1 -- 172.21.15.26:0/2106754676 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f0528068fe0 con 0x7f05140a05a0 2023-12-01T01:00:04.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:04 smithi093 ceph-mon[103327]: purged_snaps scrub starts 2023-12-01T01:00:04.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:04 smithi093 ceph-mon[103327]: purged_snaps scrub ok 2023-12-01T01:00:04.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:04 smithi093 ceph-mon[103327]: Detected new or changed devices on smithi116 2023-12-01T01:00:04.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:04 smithi093 ceph-mon[103327]: Adjusting osd_memory_target on smithi116 to 8584M 2023-12-01T01:00:04.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T01:00:04.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:04 smithi093 ceph-mon[103327]: osd.5 [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413] boot 2023-12-01T01:00:04.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:04 smithi093 ceph-mon[103327]: osdmap e37: 6 total, 6 up, 6 in 2023-12-01T01:00:04.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-01T01:00:04.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:04 smithi093 ceph-mon[103327]: osdmap e38: 6 total, 6 up, 6 in 2023-12-01T01:00:05.850 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:05 smithi026 ceph-mon[98801]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T01:00:05.850 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:00:05.850 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:00:05.850 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:05.851 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:05 smithi026 ceph-mon[98801]: osdmap e39: 6 total, 6 up, 6 in 2023-12-01T01:00:05.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:05 smithi116 ceph-mon[103554]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T01:00:05.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:00:05.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:00:05.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:05.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:05 smithi116 ceph-mon[103554]: osdmap e39: 6 total, 6 up, 6 in 2023-12-01T01:00:05.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:05 smithi093 ceph-mon[103327]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-01T01:00:05.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:00:05.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:00:05.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:05.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:05 smithi093 ceph-mon[103327]: osdmap e39: 6 total, 6 up, 6 in 2023-12-01T01:00:06.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:06 smithi116 ceph-mon[103554]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:00:06.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:06 smithi116 ceph-mon[103554]: osdmap e40: 6 total, 6 up, 6 in 2023-12-01T01:00:06.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:06 smithi093 ceph-mon[103327]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:00:06.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:06 smithi093 ceph-mon[103327]: osdmap e40: 6 total, 6 up, 6 in 2023-12-01T01:00:07.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:06 smithi026 ceph-mon[98801]: from='client.14352 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:00:07.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:06 smithi026 ceph-mon[98801]: osdmap e40: 6 total, 6 up, 6 in 2023-12-01T01:00:07.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:07 smithi116 ceph-mon[103554]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-01T01:00:07.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:07 smithi116 ceph-mon[103554]: osdmap e41: 6 total, 6 up, 6 in 2023-12-01T01:00:07.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:07 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2050320795' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "684e9975-f289-494d-b861-2411c8a3c7a1"}]: dispatch 2023-12-01T01:00:07.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:07 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2050320795' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "684e9975-f289-494d-b861-2411c8a3c7a1"}]': finished 2023-12-01T01:00:07.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:07 smithi116 ceph-mon[103554]: osdmap e42: 7 total, 6 up, 7 in 2023-12-01T01:00:07.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:07 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:07.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:07 smithi093 ceph-mon[103327]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-01T01:00:07.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:07 smithi093 ceph-mon[103327]: osdmap e41: 6 total, 6 up, 6 in 2023-12-01T01:00:07.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:07 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2050320795' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "684e9975-f289-494d-b861-2411c8a3c7a1"}]: dispatch 2023-12-01T01:00:07.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:07 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2050320795' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "684e9975-f289-494d-b861-2411c8a3c7a1"}]': finished 2023-12-01T01:00:07.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:07 smithi093 ceph-mon[103327]: osdmap e42: 7 total, 6 up, 7 in 2023-12-01T01:00:07.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:07 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:07 smithi026 ceph-mon[98801]: pgmap v123: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-01T01:00:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:07 smithi026 ceph-mon[98801]: osdmap e41: 6 total, 6 up, 6 in 2023-12-01T01:00:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:07 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2050320795' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "684e9975-f289-494d-b861-2411c8a3c7a1"}]: dispatch 2023-12-01T01:00:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:07 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2050320795' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "684e9975-f289-494d-b861-2411c8a3c7a1"}]': finished 2023-12-01T01:00:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:07 smithi026 ceph-mon[98801]: osdmap e42: 7 total, 6 up, 7 in 2023-12-01T01:00:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:07 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:08.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:08 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1665226713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:00:08.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:08 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1665226713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:00:09.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:08 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1665226713' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:00:09.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:09 smithi116 ceph-mon[103554]: pgmap v127: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-01T01:00:09.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:09 smithi093 ceph-mon[103327]: pgmap v127: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-01T01:00:10.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:09 smithi026 ceph-mon[98801]: pgmap v127: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-01T01:00:11.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:11 smithi026 ceph-mon[98801]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-12-01T01:00:11.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:11 smithi116 ceph-mon[103554]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-12-01T01:00:11.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:11 smithi093 ceph-mon[103327]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-12-01T01:00:13.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:13 smithi116 ceph-mon[103554]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-01T01:00:13.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:13 smithi093 ceph-mon[103327]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-01T01:00:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:13 smithi026 ceph-mon[98801]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-01T01:00:14.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:14 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-12-01T01:00:14.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:14 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:14.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:14 smithi116 ceph-mon[103554]: Deploying daemon osd.6 on smithi026 2023-12-01T01:00:14.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:14 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-12-01T01:00:14.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:14 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:14.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:14 smithi093 ceph-mon[103327]: Deploying daemon osd.6 on smithi026 2023-12-01T01:00:15.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:14 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-12-01T01:00:15.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:14 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:15.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:14 smithi026 ceph-mon[98801]: Deploying daemon osd.6 on smithi026 2023-12-01T01:00:15.739 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:15 smithi026 ceph-mon[98801]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-12-01T01:00:15.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:15 smithi116 ceph-mon[103554]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-12-01T01:00:15.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:15 smithi093 ceph-mon[103327]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-12-01T01:00:17.883 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:17 smithi026 ceph-mon[98801]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2023-12-01T01:00:17.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:17 smithi116 ceph-mon[103554]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2023-12-01T01:00:17.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:17 smithi093 ceph-mon[103327]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 67 KiB/s, 0 objects/s recovering 2023-12-01T01:00:19.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:19 smithi026 ceph-mon[98801]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-12-01T01:00:19.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:19 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:19.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:19 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:19.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:19 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:19.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:19 smithi116 ceph-mon[103554]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-12-01T01:00:19.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:19 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:19.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:19 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:19.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:19 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:19.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:19 smithi093 ceph-mon[103327]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-12-01T01:00:19.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:19 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:19.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:19 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:19.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:19 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:20.913 INFO:teuthology.orchestra.run.smithi026.stdout:Created osd(s) 6 on host 'smithi026' 2023-12-01T01:00:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:20.912+0000 7f051e7fc700 1 -- 172.21.15.26:0/2106754676 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0528068fe0 con 0x7f05140a05a0 2023-12-01T01:00:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:20.914+0000 7f052f53b700 1 -- 172.21.15.26:0/2106754676 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f05140a05a0 msgr2=0x7f05140a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:00:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:20.914+0000 7f052f53b700 1 --2- 172.21.15.26:0/2106754676 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f05140a05a0 0x7f05140a2a60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0518005fd0 tx=0x7f051800a560 comp rx=0 tx=0).stop 2023-12-01T01:00:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:20.914+0000 7f052f53b700 1 -- 172.21.15.26:0/2106754676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05280ffd20 msgr2=0x7f0528103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:00:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:20.914+0000 7f052f53b700 1 --2- 172.21.15.26:0/2106754676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05280ffd20 0x7f0528103cb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f052400c990 tx=0x7f052400cca0 comp rx=0 tx=0).stop 2023-12-01T01:00:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:20.914+0000 7f052f53b700 1 -- 172.21.15.26:0/2106754676 shutdown_connections 2023-12-01T01:00:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:20.914+0000 7f052f53b700 1 --2- 172.21.15.26:0/2106754676 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f05140a05a0 0x7f05140a2a60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:20.914+0000 7f052f53b700 1 --2- 172.21.15.26:0/2106754676 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f05281018c0 0x7f0528102840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:20.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:20.914+0000 7f052f53b700 1 --2- 172.21.15.26:0/2106754676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f05280ffd20 0x7f0528103cb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:20.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:20.914+0000 7f052f53b700 1 --2- 172.21.15.26:0/2106754676 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0528100f20 0x7f0528102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:20.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:20.914+0000 7f052f53b700 1 -- 172.21.15.26:0/2106754676 >> 172.21.15.26:0/2106754676 conn(0x7f05280fb2a0 msgr2=0x7f05280688d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:00:20.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:20.914+0000 7f052f53b700 1 -- 172.21.15.26:0/2106754676 shutdown_connections 2023-12-01T01:00:20.916 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:00:20.914+0000 7f052f53b700 1 -- 172.21.15.26:0/2106754676 wait complete. 2023-12-01T01:00:21.321 DEBUG:teuthology.orchestra.run.smithi026:osd.6> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.6.service 2023-12-01T01:00:21.324 INFO:tasks.cephadm:Deploying osd.7 on smithi093 with /dev/vg_nvme/lv_2... 2023-12-01T01:00:21.324 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-01T01:00:21.368 INFO:journalctl@ceph.osd.6.smithi026.stdout:-- Logs begin at Fri 2023-12-01 00:41:45 UTC. -- 2023-12-01T01:00:21.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:21 smithi116 ceph-mon[103554]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-01T01:00:21.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:21.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:21.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:21.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:00:21.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:21.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:21.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:21.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:21.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:21 smithi093 ceph-mon[103327]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-01T01:00:21.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:21.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:21.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:21.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:00:21.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:21.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:21.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:21.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:21.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:21 smithi026 ceph-mon[98801]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-01T01:00:21.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:21.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:21.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:21.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:00:21.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:21.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:21.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:21.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:21.903 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.b/config 2023-12-01T01:00:22.091 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:00:21 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:00:21.968+0000 7fbc174d7640 -1 osd.6 0 log_to_monitors true 2023-12-01T01:00:22.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:22 smithi116 ceph-mon[103554]: from='osd.6 [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-12-01T01:00:22.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:22 smithi093 ceph-mon[103327]: from='osd.6 [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-12-01T01:00:22.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:22 smithi026 ceph-mon[98801]: from='osd.6 [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-12-01T01:00:23.278 INFO:teuthology.orchestra.run.smithi093.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-01T01:00:23.278 INFO:teuthology.orchestra.run.smithi093.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-01T01:00:23.278 INFO:teuthology.orchestra.run.smithi093.stderr: stderr: 10+0 records in 2023-12-01T01:00:23.278 INFO:teuthology.orchestra.run.smithi093.stderr:10+0 records out 2023-12-01T01:00:23.279 INFO:teuthology.orchestra.run.smithi093.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0157814 s, 664 MB/s 2023-12-01T01:00:23.279 INFO:teuthology.orchestra.run.smithi093.stderr:--> Zapping successful for: 2023-12-01T01:00:23.581 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:23 smithi093 ceph-mon[103327]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-01T01:00:23.582 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:23 smithi093 ceph-mon[103327]: from='osd.6 [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-12-01T01:00:23.582 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:23 smithi093 ceph-mon[103327]: osdmap e43: 7 total, 6 up, 7 in 2023-12-01T01:00:23.582 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:23 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:23.582 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:23 smithi093 ceph-mon[103327]: from='osd.6 [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2023-12-01T01:00:23.657 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi093:vg_nvme/lv_2 2023-12-01T01:00:23.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:23 smithi116 ceph-mon[103554]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-01T01:00:23.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:23 smithi116 ceph-mon[103554]: from='osd.6 [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-12-01T01:00:23.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:23 smithi116 ceph-mon[103554]: osdmap e43: 7 total, 6 up, 7 in 2023-12-01T01:00:23.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:23 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:23.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:23 smithi116 ceph-mon[103554]: from='osd.6 [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2023-12-01T01:00:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:23 smithi026 ceph-mon[98801]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-01T01:00:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:23 smithi026 ceph-mon[98801]: from='osd.6 [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-12-01T01:00:23.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:23 smithi026 ceph-mon[98801]: osdmap e43: 7 total, 6 up, 7 in 2023-12-01T01:00:23.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:23 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:23.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:23 smithi026 ceph-mon[98801]: from='osd.6 [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2023-12-01T01:00:23.797 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:00:23 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:00:23.416+0000 7fbc0cb4e700 -1 osd.6 0 waiting for initial osdmap 2023-12-01T01:00:23.797 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:00:23 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:00:23.429+0000 7fbc0693f700 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T01:00:24.209 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.b/config 2023-12-01T01:00:24.645 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:24 smithi093 ceph-mon[103327]: from='osd.6 [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2023-12-01T01:00:24.645 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:24 smithi093 ceph-mon[103327]: osdmap e44: 7 total, 6 up, 7 in 2023-12-01T01:00:24.645 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:24.645 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:24.645 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:24.645 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:24.645 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:24.645 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:24.645 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:24.645 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:24.645 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:24.646 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:00:24.646 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:24.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:24 smithi116 ceph-mon[103554]: from='osd.6 [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2023-12-01T01:00:24.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:24 smithi116 ceph-mon[103554]: osdmap e44: 7 total, 6 up, 7 in 2023-12-01T01:00:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:00:24.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:24 smithi026 ceph-mon[98801]: from='osd.6 [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2023-12-01T01:00:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:24 smithi026 ceph-mon[98801]: osdmap e44: 7 total, 6 up, 7 in 2023-12-01T01:00:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:24.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:24.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:24.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:24.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:24.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:00:24.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:25.275 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.271+0000 7f42fbecc700 1 -- 172.21.15.93:0/893114326 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42f4102970 msgr2=0x7f42f4109290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:00:25.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.271+0000 7f42fbecc700 1 --2- 172.21.15.93:0/893114326 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42f4102970 0x7f42f4109290 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00b0a0 tx=0x7f42ec00b3b0 comp rx=0 tx=0).stop 2023-12-01T01:00:25.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.271+0000 7f42fbecc700 1 -- 172.21.15.93:0/893114326 shutdown_connections 2023-12-01T01:00:25.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.271+0000 7f42fbecc700 1 --2- 172.21.15.93:0/893114326 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42f4102970 0x7f42f4109290 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:25.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.271+0000 7f42fbecc700 1 --2- 172.21.15.93:0/893114326 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42f4100e50 0x7f42f4101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:25.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.271+0000 7f42fbecc700 1 --2- 172.21.15.93:0/893114326 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42f4101fb0 0x7f42f4102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:25.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.271+0000 7f42fbecc700 1 -- 172.21.15.93:0/893114326 >> 172.21.15.93:0/893114326 conn(0x7f42f40fc410 msgr2=0x7f42f40fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:00:25.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.271+0000 7f42fbecc700 1 -- 172.21.15.93:0/893114326 shutdown_connections 2023-12-01T01:00:25.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.271+0000 7f42fbecc700 1 -- 172.21.15.93:0/893114326 wait complete. 2023-12-01T01:00:25.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.272+0000 7f42fbecc700 1 Processor -- start 2023-12-01T01:00:25.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.272+0000 7f42fbecc700 1 -- start start 2023-12-01T01:00:25.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.272+0000 7f42fbecc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42f4100e50 0x7f42f4074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:00:25.276 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.272+0000 7f42fbecc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42f4101fb0 0x7f42f4073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:00:25.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.272+0000 7f42fbecc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42f4102970 0x7f42f40736c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:00:25.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.272+0000 7f42fbecc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f4073e40 con 0x7f42f4102970 2023-12-01T01:00:25.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.272+0000 7f42fbecc700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f4073fb0 con 0x7f42f4101fb0 2023-12-01T01:00:25.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.272+0000 7f42fbecc700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f41a0e80 con 0x7f42f4100e50 2023-12-01T01:00:25.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.272+0000 7f42f9467700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42f4101fb0 0x7f42f4073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:00:25.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.272+0000 7f42f9467700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42f4101fb0 0x7f42f4073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:49588/0 (socket says 172.21.15.93:49588) 2023-12-01T01:00:25.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.272+0000 7f42f9467700 1 -- 172.21.15.93:0/3313608711 learned_addr learned my addr 172.21.15.93:0/3313608711 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-01T01:00:25.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.272+0000 7f42f9c68700 1 --2- 172.21.15.93:0/3313608711 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42f4100e50 0x7f42f4074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:00:25.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.273+0000 7f42f9467700 1 -- 172.21.15.93:0/3313608711 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42f4100e50 msgr2=0x7f42f4074b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:00:25.277 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.273+0000 7f42f9467700 1 --2- 172.21.15.93:0/3313608711 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42f4100e50 0x7f42f4074b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:25.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.273+0000 7f42f9467700 1 -- 172.21.15.93:0/3313608711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42f4102970 msgr2=0x7f42f40736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:00:25.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.273+0000 7f42f9467700 1 --2- 172.21.15.93:0/3313608711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42f4102970 0x7f42f40736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:25.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.273+0000 7f42f9467700 1 -- 172.21.15.93:0/3313608711 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec009d00 con 0x7f42f4101fb0 2023-12-01T01:00:25.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.273+0000 7f42f9c68700 1 --2- 172.21.15.93:0/3313608711 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42f4100e50 0x7f42f4074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:00:25.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.273+0000 7f42f9467700 1 --2- 172.21.15.93:0/3313608711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42f4101fb0 0x7f42f4073180 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f42f000b530 tx=0x7f42f000b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:00:25.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.273+0000 7f42eaffd700 1 -- 172.21.15.93:0/3313608711 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0011830 con 0x7f42f4101fb0 2023-12-01T01:00:25.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.273+0000 7f42fbecc700 1 -- 172.21.15.93:0/3313608711 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f41a1160 con 0x7f42f4101fb0 2023-12-01T01:00:25.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.273+0000 7f42eaffd700 1 -- 172.21.15.93:0/3313608711 <== mon.2 v2:172.21.15.93:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f42f0011e70 con 0x7f42f4101fb0 2023-12-01T01:00:25.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.273+0000 7f42eaffd700 1 -- 172.21.15.93:0/3313608711 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f000f2e0 con 0x7f42f4101fb0 2023-12-01T01:00:25.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.273+0000 7f42fbecc700 1 -- 172.21.15.93:0/3313608711 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f41a16e0 con 0x7f42f4101fb0 2023-12-01T01:00:25.278 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.274+0000 7f42fbecc700 1 -- 172.21.15.93:0/3313608711 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f410c8a0 con 0x7f42f4101fb0 2023-12-01T01:00:25.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.275+0000 7f42eaffd700 1 -- 172.21.15.93:0/3313608711 <== mon.2 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f42f00105f0 con 0x7f42f4101fb0 2023-12-01T01:00:25.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.275+0000 7f42eaffd700 1 --2- 172.21.15.93:0/3313608711 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f42e00a0520 0x7f42e00a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:00:25.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.276+0000 7f42eaffd700 1 -- 172.21.15.93:0/3313608711 <== mon.2 v2:172.21.15.93:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f42f00ca7a0 con 0x7f42f4101fb0 2023-12-01T01:00:25.279 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.276+0000 7f42f9c68700 1 --2- 172.21.15.93:0/3313608711 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f42e00a0520 0x7f42e00a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:00:25.280 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.276+0000 7f42f9c68700 1 --2- 172.21.15.93:0/3313608711 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f42e00a0520 0x7f42e00a29e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42e4007900 tx=0x7f42e4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:00:25.281 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.280+0000 7f42eaffd700 1 -- 172.21.15.93:0/3313608711 <== mon.2 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f42f0095050 con 0x7f42f4101fb0 2023-12-01T01:00:25.481 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:25.479+0000 7f42fbecc700 1 -- 172.21.15.93:0/3313608711 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f42f40611d0 con 0x7f42e00a0520 2023-12-01T01:00:25.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:25 smithi116 ceph-mon[103554]: purged_snaps scrub starts 2023-12-01T01:00:25.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:25 smithi116 ceph-mon[103554]: purged_snaps scrub ok 2023-12-01T01:00:25.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:25 smithi116 ceph-mon[103554]: Detected new or changed devices on smithi026 2023-12-01T01:00:25.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:25 smithi116 ceph-mon[103554]: Adjusting osd_memory_target on smithi026 to 5724M 2023-12-01T01:00:25.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:25 smithi116 ceph-mon[103554]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-01T01:00:25.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:25.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:25 smithi116 ceph-mon[103554]: osd.6 [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002] boot 2023-12-01T01:00:25.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:25 smithi116 ceph-mon[103554]: osdmap e45: 7 total, 7 up, 7 in 2023-12-01T01:00:25.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:25.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:25 smithi093 ceph-mon[103327]: purged_snaps scrub starts 2023-12-01T01:00:25.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:25 smithi093 ceph-mon[103327]: purged_snaps scrub ok 2023-12-01T01:00:25.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:25 smithi093 ceph-mon[103327]: Detected new or changed devices on smithi026 2023-12-01T01:00:25.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:25 smithi093 ceph-mon[103327]: Adjusting osd_memory_target on smithi026 to 5724M 2023-12-01T01:00:25.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:25 smithi093 ceph-mon[103327]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-01T01:00:25.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:25.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:25 smithi093 ceph-mon[103327]: osd.6 [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002] boot 2023-12-01T01:00:25.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:25 smithi093 ceph-mon[103327]: osdmap e45: 7 total, 7 up, 7 in 2023-12-01T01:00:25.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:25.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:25 smithi026 ceph-mon[98801]: purged_snaps scrub starts 2023-12-01T01:00:25.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:25 smithi026 ceph-mon[98801]: purged_snaps scrub ok 2023-12-01T01:00:25.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:25 smithi026 ceph-mon[98801]: Detected new or changed devices on smithi026 2023-12-01T01:00:25.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:25 smithi026 ceph-mon[98801]: Adjusting osd_memory_target on smithi026 to 5724M 2023-12-01T01:00:25.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:25 smithi026 ceph-mon[98801]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-01T01:00:25.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:25.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:25 smithi026 ceph-mon[98801]: osd.6 [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002] boot 2023-12-01T01:00:25.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:25 smithi026 ceph-mon[98801]: osdmap e45: 7 total, 7 up, 7 in 2023-12-01T01:00:25.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-01T01:00:26.561 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:26 smithi093 ceph-mon[103327]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:00:26.561 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:26 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:00:26.561 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:26 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:00:26.561 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:26 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:26.561 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:26 smithi093 ceph-mon[103327]: osdmap e46: 7 total, 7 up, 7 in 2023-12-01T01:00:26.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:26 smithi116 ceph-mon[103554]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:00:26.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:26 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:00:26.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:26 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:00:26.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:26 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:26.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:26 smithi116 ceph-mon[103554]: osdmap e46: 7 total, 7 up, 7 in 2023-12-01T01:00:26.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:26 smithi026 ceph-mon[98801]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:00:26.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:26 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:00:26.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:26 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:00:26.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:26 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:26.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:26 smithi026 ceph-mon[98801]: osdmap e46: 7 total, 7 up, 7 in 2023-12-01T01:00:27.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:27 smithi116 ceph-mon[103554]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:27.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:27 smithi093 ceph-mon[103327]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:27.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:27 smithi026 ceph-mon[98801]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:28.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:28 smithi116 ceph-mon[103554]: from='client.? 172.21.15.93:0/3880968454' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f2745f6-611e-4176-8022-85d5e1942478"}]: dispatch 2023-12-01T01:00:28.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:28 smithi116 ceph-mon[103554]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f2745f6-611e-4176-8022-85d5e1942478"}]: dispatch 2023-12-01T01:00:28.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:28 smithi116 ceph-mon[103554]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f2745f6-611e-4176-8022-85d5e1942478"}]': finished 2023-12-01T01:00:28.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:28 smithi116 ceph-mon[103554]: osdmap e47: 8 total, 7 up, 8 in 2023-12-01T01:00:28.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:28 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-01T01:00:28.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:28 smithi093 ceph-mon[103327]: from='client.? 172.21.15.93:0/3880968454' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f2745f6-611e-4176-8022-85d5e1942478"}]: dispatch 2023-12-01T01:00:28.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:28 smithi093 ceph-mon[103327]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f2745f6-611e-4176-8022-85d5e1942478"}]: dispatch 2023-12-01T01:00:28.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:28 smithi093 ceph-mon[103327]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f2745f6-611e-4176-8022-85d5e1942478"}]': finished 2023-12-01T01:00:28.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:28 smithi093 ceph-mon[103327]: osdmap e47: 8 total, 7 up, 8 in 2023-12-01T01:00:28.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:28 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-01T01:00:28.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:28 smithi026 ceph-mon[98801]: from='client.? 172.21.15.93:0/3880968454' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f2745f6-611e-4176-8022-85d5e1942478"}]: dispatch 2023-12-01T01:00:28.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:28 smithi026 ceph-mon[98801]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0f2745f6-611e-4176-8022-85d5e1942478"}]: dispatch 2023-12-01T01:00:28.798 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:28 smithi026 ceph-mon[98801]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0f2745f6-611e-4176-8022-85d5e1942478"}]': finished 2023-12-01T01:00:28.798 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:28 smithi026 ceph-mon[98801]: osdmap e47: 8 total, 7 up, 8 in 2023-12-01T01:00:28.798 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:28 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-01T01:00:29.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:29 smithi116 ceph-mon[103554]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:29.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:29 smithi116 ceph-mon[103554]: from='client.? 172.21.15.93:0/337630855' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:00:29.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:29 smithi093 ceph-mon[103327]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:29.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:29 smithi093 ceph-mon[103327]: from='client.? 172.21.15.93:0/337630855' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:00:29.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:29 smithi026 ceph-mon[98801]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:29.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:29 smithi026 ceph-mon[98801]: from='client.? 172.21.15.93:0/337630855' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:00:31.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:31 smithi093 ceph-mon[103327]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:31.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:31 smithi026 ceph-mon[98801]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:31.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:31 smithi116 ceph-mon[103554]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:33.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:33 smithi093 ceph-mon[103327]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:33.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:33 smithi026 ceph-mon[98801]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:33.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:33 smithi116 ceph-mon[103554]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:34.698 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:34 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-12-01T01:00:34.698 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:34 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:34.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:34 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-12-01T01:00:34.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:34 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:34.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:34 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-12-01T01:00:34.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:34 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:35.698 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:35 smithi093 ceph-mon[103327]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:35.698 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:35 smithi093 ceph-mon[103327]: Deploying daemon osd.7 on smithi093 2023-12-01T01:00:35.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:35 smithi026 ceph-mon[98801]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:35.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:35 smithi026 ceph-mon[98801]: Deploying daemon osd.7 on smithi093 2023-12-01T01:00:35.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:35 smithi116 ceph-mon[103554]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:35.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:35 smithi116 ceph-mon[103554]: Deploying daemon osd.7 on smithi093 2023-12-01T01:00:37.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:37 smithi093 ceph-mon[103327]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:37.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:37 smithi026 ceph-mon[98801]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:37.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:37 smithi116 ceph-mon[103554]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:39.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:39 smithi116 ceph-mon[103554]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:39.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:39 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:39.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:39 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:39.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:39 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:39.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:39 smithi093 ceph-mon[103327]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:39.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:39 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:39.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:39 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:39.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:39 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:39.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:39 smithi026 ceph-mon[98801]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:39.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:39 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:39.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:39 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:39.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:39 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:40.742 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:40.740+0000 7f42eaffd700 1 -- 172.21.15.93:0/3313608711 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f42f40611d0 con 0x7f42e00a0520 2023-12-01T01:00:40.742 INFO:teuthology.orchestra.run.smithi093.stdout:Created osd(s) 7 on host 'smithi093' 2023-12-01T01:00:40.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:40.742+0000 7f42fbecc700 1 -- 172.21.15.93:0/3313608711 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f42e00a0520 msgr2=0x7f42e00a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:00:40.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:40.742+0000 7f42fbecc700 1 --2- 172.21.15.93:0/3313608711 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f42e00a0520 0x7f42e00a29e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f42e4007900 tx=0x7f42e4008040 comp rx=0 tx=0).stop 2023-12-01T01:00:40.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:40.742+0000 7f42fbecc700 1 -- 172.21.15.93:0/3313608711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42f4101fb0 msgr2=0x7f42f4073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:00:40.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:40.742+0000 7f42fbecc700 1 --2- 172.21.15.93:0/3313608711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42f4101fb0 0x7f42f4073180 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f42f000b530 tx=0x7f42f000b8f0 comp rx=0 tx=0).stop 2023-12-01T01:00:40.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:40.742+0000 7f42fbecc700 1 -- 172.21.15.93:0/3313608711 shutdown_connections 2023-12-01T01:00:40.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:40.742+0000 7f42fbecc700 1 --2- 172.21.15.93:0/3313608711 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f42e00a0520 0x7f42e00a29e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:40.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:40.742+0000 7f42fbecc700 1 --2- 172.21.15.93:0/3313608711 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42f4102970 0x7f42f40736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:40.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:40.742+0000 7f42fbecc700 1 --2- 172.21.15.93:0/3313608711 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f42f4100e50 0x7f42f4074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:40.744 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:40.742+0000 7f42fbecc700 1 --2- 172.21.15.93:0/3313608711 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f42f4101fb0 0x7f42f4073180 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:40.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:40.742+0000 7f42fbecc700 1 -- 172.21.15.93:0/3313608711 >> 172.21.15.93:0/3313608711 conn(0x7f42f40fc410 msgr2=0x7f42f40fe5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:00:40.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:40.742+0000 7f42fbecc700 1 -- 172.21.15.93:0/3313608711 shutdown_connections 2023-12-01T01:00:40.745 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:00:40.742+0000 7f42fbecc700 1 -- 172.21.15.93:0/3313608711 wait complete. 2023-12-01T01:00:41.096 DEBUG:teuthology.orchestra.run.smithi093:osd.7> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.7.service 2023-12-01T01:00:41.098 INFO:tasks.cephadm:Deploying osd.8 on smithi116 with /dev/vg_nvme/lv_2... 2023-12-01T01:00:41.098 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-01T01:00:41.129 INFO:journalctl@ceph.osd.7.smithi093.stdout:-- Logs begin at Fri 2023-12-01 00:42:14 UTC. -- 2023-12-01T01:00:41.677 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.c/config 2023-12-01T01:00:41.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:41 smithi093 ceph-mon[103327]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:41.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:41.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:41.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:41.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:41.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:41 smithi026 ceph-mon[98801]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:41.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:41.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:41.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:41.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:41.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:41 smithi116 ceph-mon[103554]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:41.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:41.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:41.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:41.864 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:42.425 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:00:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:00:42.138+0000 7f44de1a9640 -1 osd.7 0 log_to_monitors true 2023-12-01T01:00:42.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:42 smithi093 ceph-mon[103327]: from='osd.7 [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-01T01:00:42.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:42 smithi093 ceph-mon[103327]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-01T01:00:42.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:42 smithi026 ceph-mon[98801]: from='osd.7 [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-01T01:00:42.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:42 smithi026 ceph-mon[98801]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-01T01:00:42.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:42 smithi116 ceph-mon[103554]: from='osd.7 [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-01T01:00:42.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:42 smithi116 ceph-mon[103554]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-01T01:00:42.999 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-01T01:00:42.999 INFO:teuthology.orchestra.run.smithi116.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-01T01:00:42.999 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10+0 records in 2023-12-01T01:00:42.999 INFO:teuthology.orchestra.run.smithi116.stderr:10+0 records out 2023-12-01T01:00:42.999 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110734 s, 947 MB/s 2023-12-01T01:00:42.999 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping successful for: 2023-12-01T01:00:43.319 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi116:vg_nvme/lv_2 2023-12-01T01:00:43.568 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:00:43 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:00:43.480+0000 7f44d3820700 -1 osd.7 0 waiting for initial osdmap 2023-12-01T01:00:43.568 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:00:43 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:00:43.492+0000 7f44cb60d700 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T01:00:43.568 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:43 smithi093 ceph-mon[103327]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:43.568 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:43 smithi093 ceph-mon[103327]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-12-01T01:00:43.569 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:43 smithi093 ceph-mon[103327]: osdmap e48: 8 total, 7 up, 8 in 2023-12-01T01:00:43.569 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:43 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-01T01:00:43.569 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:43 smithi093 ceph-mon[103327]: from='osd.7 [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T01:00:43.569 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:43 smithi093 ceph-mon[103327]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T01:00:43.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:43 smithi116 ceph-mon[103554]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:43.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:43 smithi116 ceph-mon[103554]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-12-01T01:00:43.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:43 smithi116 ceph-mon[103554]: osdmap e48: 8 total, 7 up, 8 in 2023-12-01T01:00:43.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:43 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-01T01:00:43.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:43 smithi116 ceph-mon[103554]: from='osd.7 [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T01:00:43.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:43 smithi116 ceph-mon[103554]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T01:00:43.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:43 smithi026 ceph-mon[98801]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:43.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:43 smithi026 ceph-mon[98801]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-12-01T01:00:43.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:43 smithi026 ceph-mon[98801]: osdmap e48: 8 total, 7 up, 8 in 2023-12-01T01:00:43.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:43 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-01T01:00:43.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:43 smithi026 ceph-mon[98801]: from='osd.7 [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T01:00:43.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:43 smithi026 ceph-mon[98801]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T01:00:43.871 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.c/config 2023-12-01T01:00:44.621 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-01T01:00:44.621 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: osdmap e49: 8 total, 7 up, 8 in 2023-12-01T01:00:44.621 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-01T01:00:44.621 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-01T01:00:44.621 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: Detected new or changed devices on smithi093 2023-12-01T01:00:44.621 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:44.621 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:44.621 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:44.621 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:44.621 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:44.622 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: Adjusting osd_memory_target on smithi093 to 5722M 2023-12-01T01:00:44.622 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:44.622 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:44.622 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:00:44.622 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:44.622 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:44.622 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: osd.7 [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702] boot 2023-12-01T01:00:44.622 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: osdmap e50: 8 total, 8 up, 8 in 2023-12-01T01:00:44.622 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-01T01:00:44.622 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:44.622 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:00:44.622 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:44.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-01T01:00:44.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: osdmap e49: 8 total, 7 up, 8 in 2023-12-01T01:00:44.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-01T01:00:44.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-01T01:00:44.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: Detected new or changed devices on smithi093 2023-12-01T01:00:44.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:44.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:44.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:44.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:44.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:44.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: Adjusting osd_memory_target on smithi093 to 5722M 2023-12-01T01:00:44.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:44.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:44.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:00:44.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:44.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:44.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: osd.7 [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702] boot 2023-12-01T01:00:44.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: osdmap e50: 8 total, 8 up, 8 in 2023-12-01T01:00:44.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-01T01:00:44.798 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:44.798 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:00:44.798 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:44.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-01T01:00:44.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: osdmap e49: 8 total, 7 up, 8 in 2023-12-01T01:00:44.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-01T01:00:44.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-01T01:00:44.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: Detected new or changed devices on smithi093 2023-12-01T01:00:44.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:44.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:44.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:44.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:44.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:00:44.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: Adjusting osd_memory_target on smithi093 to 5722M 2023-12-01T01:00:44.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:44.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:44.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:00:44.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:44.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:44.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: osd.7 [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702] boot 2023-12-01T01:00:44.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: osdmap e50: 8 total, 8 up, 8 in 2023-12-01T01:00:44.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-01T01:00:44.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:44.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:00:44.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:45.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.044+0000 7f715d245700 1 -- 172.21.15.116:0/938708838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7158100e20 msgr2=0x7f7158101240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:00:45.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.044+0000 7f715d245700 1 --2- 172.21.15.116:0/938708838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7158100e20 0x7f7158101240 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f714c009990 tx=0x7f714c009ca0 comp rx=0 tx=0).stop 2023-12-01T01:00:45.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.044+0000 7f715d245700 1 -- 172.21.15.116:0/938708838 shutdown_connections 2023-12-01T01:00:45.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.044+0000 7f715d245700 1 --2- 172.21.15.116:0/938708838 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7158102940 0x7f7158109260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:45.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.044+0000 7f715d245700 1 --2- 172.21.15.116:0/938708838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7158100e20 0x7f7158101240 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:45.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.044+0000 7f715d245700 1 --2- 172.21.15.116:0/938708838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7158101f80 0x7f7158102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:45.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.044+0000 7f715d245700 1 -- 172.21.15.116:0/938708838 >> 172.21.15.116:0/938708838 conn(0x7f71580fc380 msgr2=0x7f71580fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:00:45.045 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.044+0000 7f715d245700 1 -- 172.21.15.116:0/938708838 shutdown_connections 2023-12-01T01:00:45.046 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.044+0000 7f715d245700 1 -- 172.21.15.116:0/938708838 wait complete. 2023-12-01T01:00:45.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f715d245700 1 Processor -- start 2023-12-01T01:00:45.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f715d245700 1 -- start start 2023-12-01T01:00:45.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f715d245700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7158100e20 0x7f7158196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:00:45.050 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f715d245700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7158101f80 0x7f7158197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:00:45.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f715d245700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7158102940 0x7f715819e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:00:45.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f715d245700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715819e6d0 con 0x7f7158101f80 2023-12-01T01:00:45.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f715d245700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715819e810 con 0x7f7158102940 2023-12-01T01:00:45.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f715d245700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f715819e9a0 con 0x7f7158100e20 2023-12-01T01:00:45.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f7156d9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7158100e20 0x7f7158196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:00:45.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f7156d9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7158100e20 0x7f7158196b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54362/0 (socket says 172.21.15.116:54362) 2023-12-01T01:00:45.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f7156d9d700 1 -- 172.21.15.116:0/1540817992 learned_addr learned my addr 172.21.15.116:0/1540817992 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-12-01T01:00:45.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f715759e700 1 --2- 172.21.15.116:0/1540817992 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7158102940 0x7f715819e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:00:45.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f715659c700 1 --2- 172.21.15.116:0/1540817992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7158101f80 0x7f7158197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:00:45.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f7156d9d700 1 -- 172.21.15.116:0/1540817992 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7158102940 msgr2=0x7f715819e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:00:45.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f7156d9d700 1 --2- 172.21.15.116:0/1540817992 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7158102940 0x7f715819e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:45.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f7156d9d700 1 -- 172.21.15.116:0/1540817992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7158101f80 msgr2=0x7f7158197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:00:45.051 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.045+0000 7f7156d9d700 1 --2- 172.21.15.116:0/1540817992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7158101f80 0x7f7158197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:00:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.046+0000 7f7156d9d700 1 -- 172.21.15.116:0/1540817992 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c0095f0 con 0x7f7158100e20 2023-12-01T01:00:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.046+0000 7f715659c700 1 --2- 172.21.15.116:0/1540817992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7158101f80 0x7f7158197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:00:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.046+0000 7f7156d9d700 1 --2- 172.21.15.116:0/1540817992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7158100e20 0x7f7158196b40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f714c003790 tx=0x7f714c00f670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:00:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.046+0000 7f713ffff700 1 -- 172.21.15.116:0/1540817992 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c01d070 con 0x7f7158100e20 2023-12-01T01:00:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.046+0000 7f715d245700 1 -- 172.21.15.116:0/1540817992 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715819ec20 con 0x7f7158100e20 2023-12-01T01:00:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.046+0000 7f713ffff700 1 -- 172.21.15.116:0/1540817992 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f714c022470 con 0x7f7158100e20 2023-12-01T01:00:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.046+0000 7f713ffff700 1 -- 172.21.15.116:0/1540817992 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c017650 con 0x7f7158100e20 2023-12-01T01:00:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.046+0000 7f715d245700 1 -- 172.21.15.116:0/1540817992 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f715819f090 con 0x7f7158100e20 2023-12-01T01:00:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.047+0000 7f715d245700 1 -- 172.21.15.116:0/1540817992 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7158108360 con 0x7f7158100e20 2023-12-01T01:00:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.048+0000 7f713ffff700 1 -- 172.21.15.116:0/1540817992 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f714c022990 con 0x7f7158100e20 2023-12-01T01:00:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.048+0000 7f713ffff700 1 --2- 172.21.15.116:0/1540817992 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f71400a0520 0x7f71400a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:00:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.049+0000 7f713ffff700 1 -- 172.21.15.116:0/1540817992 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5430+0+0 (secure 0 0 0) 0x7f714c0cc190 con 0x7f7158100e20 2023-12-01T01:00:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.049+0000 7f715659c700 1 --2- 172.21.15.116:0/1540817992 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f71400a0520 0x7f71400a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:00:45.052 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.049+0000 7f715659c700 1 --2- 172.21.15.116:0/1540817992 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f71400a0520 0x7f71400a29e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7148005fd0 tx=0x7f7148005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:00:45.054 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.053+0000 7f713ffff700 1 -- 172.21.15.116:0/1540817992 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f714c05d0e0 con 0x7f7158100e20 2023-12-01T01:00:45.249 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:00:45.247+0000 7f715d245700 1 -- 172.21.15.116:0/1540817992 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f71580611d0 con 0x7f71400a0520 2023-12-01T01:00:45.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:45 smithi116 ceph-mon[103554]: purged_snaps scrub starts 2023-12-01T01:00:45.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:45 smithi116 ceph-mon[103554]: purged_snaps scrub ok 2023-12-01T01:00:45.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:45 smithi116 ceph-mon[103554]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:45.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:45 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:00:45.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:45 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:00:45.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:45 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:45.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:45 smithi116 ceph-mon[103554]: osdmap e51: 8 total, 8 up, 8 in 2023-12-01T01:00:45.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:45 smithi093 ceph-mon[103327]: purged_snaps scrub starts 2023-12-01T01:00:45.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:45 smithi093 ceph-mon[103327]: purged_snaps scrub ok 2023-12-01T01:00:45.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:45 smithi093 ceph-mon[103327]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:45.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:45 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:00:45.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:45 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:00:45.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:45 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:45.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:45 smithi093 ceph-mon[103327]: osdmap e51: 8 total, 8 up, 8 in 2023-12-01T01:00:46.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:45 smithi026 ceph-mon[98801]: purged_snaps scrub starts 2023-12-01T01:00:46.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:45 smithi026 ceph-mon[98801]: purged_snaps scrub ok 2023-12-01T01:00:46.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:45 smithi026 ceph-mon[98801]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-12-01T01:00:46.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:45 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:00:46.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:45 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:00:46.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:45 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:46.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:45 smithi026 ceph-mon[98801]: osdmap e51: 8 total, 8 up, 8 in 2023-12-01T01:00:46.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:46 smithi116 ceph-mon[103554]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:00:46.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:46 smithi116 ceph-mon[103554]: osdmap e52: 8 total, 8 up, 8 in 2023-12-01T01:00:46.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:46 smithi093 ceph-mon[103327]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:00:46.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:46 smithi093 ceph-mon[103327]: osdmap e52: 8 total, 8 up, 8 in 2023-12-01T01:00:47.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:46 smithi026 ceph-mon[98801]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:00:47.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:46 smithi026 ceph-mon[98801]: osdmap e52: 8 total, 8 up, 8 in 2023-12-01T01:00:47.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:47 smithi116 ceph-mon[103554]: pgmap v155: 1 pgs: 1 remapped; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:47.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:47 smithi116 ceph-mon[103554]: osdmap e53: 8 total, 8 up, 8 in 2023-12-01T01:00:47.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:47 smithi116 ceph-mon[103554]: from='client.? 172.21.15.116:0/2429806089' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c25114ab-8b08-4a55-a459-57b4f63a31d2"}]: dispatch 2023-12-01T01:00:47.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:47 smithi116 ceph-mon[103554]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c25114ab-8b08-4a55-a459-57b4f63a31d2"}]: dispatch 2023-12-01T01:00:47.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:47 smithi116 ceph-mon[103554]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c25114ab-8b08-4a55-a459-57b4f63a31d2"}]': finished 2023-12-01T01:00:47.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:47 smithi116 ceph-mon[103554]: osdmap e54: 9 total, 8 up, 9 in 2023-12-01T01:00:47.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-01T01:00:47.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:47 smithi093 ceph-mon[103327]: pgmap v155: 1 pgs: 1 remapped; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:47.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:47 smithi093 ceph-mon[103327]: osdmap e53: 8 total, 8 up, 8 in 2023-12-01T01:00:47.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:47 smithi093 ceph-mon[103327]: from='client.? 172.21.15.116:0/2429806089' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c25114ab-8b08-4a55-a459-57b4f63a31d2"}]: dispatch 2023-12-01T01:00:47.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:47 smithi093 ceph-mon[103327]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c25114ab-8b08-4a55-a459-57b4f63a31d2"}]: dispatch 2023-12-01T01:00:47.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:47 smithi093 ceph-mon[103327]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c25114ab-8b08-4a55-a459-57b4f63a31d2"}]': finished 2023-12-01T01:00:47.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:47 smithi093 ceph-mon[103327]: osdmap e54: 9 total, 8 up, 9 in 2023-12-01T01:00:47.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-01T01:00:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:47 smithi026 ceph-mon[98801]: pgmap v155: 1 pgs: 1 remapped; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:47 smithi026 ceph-mon[98801]: osdmap e53: 8 total, 8 up, 8 in 2023-12-01T01:00:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:47 smithi026 ceph-mon[98801]: from='client.? 172.21.15.116:0/2429806089' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c25114ab-8b08-4a55-a459-57b4f63a31d2"}]: dispatch 2023-12-01T01:00:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:47 smithi026 ceph-mon[98801]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c25114ab-8b08-4a55-a459-57b4f63a31d2"}]: dispatch 2023-12-01T01:00:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:47 smithi026 ceph-mon[98801]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c25114ab-8b08-4a55-a459-57b4f63a31d2"}]': finished 2023-12-01T01:00:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:47 smithi026 ceph-mon[98801]: osdmap e54: 9 total, 8 up, 9 in 2023-12-01T01:00:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-01T01:00:48.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:48 smithi116 ceph-mon[103554]: from='client.? 172.21.15.116:0/395837360' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:00:48.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:48 smithi093 ceph-mon[103327]: from='client.? 172.21.15.116:0/395837360' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:00:49.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:48 smithi026 ceph-mon[98801]: from='client.? 172.21.15.116:0/395837360' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:00:49.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:49 smithi116 ceph-mon[103554]: pgmap v159: 1 pgs: 1 remapped; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:49.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:49 smithi093 ceph-mon[103327]: pgmap v159: 1 pgs: 1 remapped; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:50.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:49 smithi026 ceph-mon[98801]: pgmap v159: 1 pgs: 1 remapped; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:51.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:51 smithi116 ceph-mon[103554]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:51.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:51 smithi093 ceph-mon[103327]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:52.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:51 smithi026 ceph-mon[98801]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:53.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:53 smithi116 ceph-mon[103554]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:53.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:53 smithi093 ceph-mon[103327]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:54.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:53 smithi026 ceph-mon[98801]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:54.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:54 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-12-01T01:00:54.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:54 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:54.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:54 smithi116 ceph-mon[103554]: Deploying daemon osd.8 on smithi116 2023-12-01T01:00:54.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:54 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-12-01T01:00:54.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:54 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:54.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:54 smithi093 ceph-mon[103327]: Deploying daemon osd.8 on smithi116 2023-12-01T01:00:55.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:54 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-12-01T01:00:55.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:54 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:00:55.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:54 smithi026 ceph-mon[98801]: Deploying daemon osd.8 on smithi116 2023-12-01T01:00:55.743 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:55 smithi116 ceph-mon[103554]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:55.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:55 smithi093 ceph-mon[103327]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:56.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:55 smithi026 ceph-mon[98801]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:57.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:57 smithi116 ceph-mon[103554]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:57.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:57 smithi093 ceph-mon[103327]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:58.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:57 smithi026 ceph-mon[98801]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:59.130 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:58 smithi116 ceph-mon[103554]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:59.130 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:59.130 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:59.130 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:00:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:59.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:58 smithi026 ceph-mon[98801]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:59.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:59.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:59.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:00:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:00:59.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:58 smithi093 ceph-mon[103327]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:00:59.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:59.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:00:59.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:00:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:01:00.610 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 8 on host 'smithi116' 2023-12-01T01:01:00.610 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:00.607+0000 7f713ffff700 1 -- 172.21.15.116:0/1540817992 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f71580611d0 con 0x7f71400a0520 2023-12-01T01:01:00.611 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:00.610+0000 7f715d245700 1 -- 172.21.15.116:0/1540817992 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f71400a0520 msgr2=0x7f71400a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:01:00.612 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:00.610+0000 7f715d245700 1 --2- 172.21.15.116:0/1540817992 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f71400a0520 0x7f71400a29e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7148005fd0 tx=0x7f7148005f60 comp rx=0 tx=0).stop 2023-12-01T01:01:00.612 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:00.610+0000 7f715d245700 1 -- 172.21.15.116:0/1540817992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7158100e20 msgr2=0x7f7158196b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:01:00.612 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:00.610+0000 7f715d245700 1 --2- 172.21.15.116:0/1540817992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7158100e20 0x7f7158196b40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f714c003790 tx=0x7f714c00f670 comp rx=0 tx=0).stop 2023-12-01T01:01:00.612 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:00.610+0000 7f715d245700 1 -- 172.21.15.116:0/1540817992 shutdown_connections 2023-12-01T01:01:00.612 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:00.610+0000 7f715d245700 1 --2- 172.21.15.116:0/1540817992 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f71400a0520 0x7f71400a29e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:00.612 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:00.610+0000 7f715d245700 1 --2- 172.21.15.116:0/1540817992 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7158102940 0x7f715819e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:00.612 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:00.610+0000 7f715d245700 1 --2- 172.21.15.116:0/1540817992 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7158100e20 0x7f7158196b40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:00.612 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:00.610+0000 7f715d245700 1 --2- 172.21.15.116:0/1540817992 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7158101f80 0x7f7158197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:00.613 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:00.610+0000 7f715d245700 1 -- 172.21.15.116:0/1540817992 >> 172.21.15.116:0/1540817992 conn(0x7f71580fc380 msgr2=0x7f71581054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:01:00.613 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:00.610+0000 7f715d245700 1 -- 172.21.15.116:0/1540817992 shutdown_connections 2023-12-01T01:01:00.613 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:00.610+0000 7f715d245700 1 -- 172.21.15.116:0/1540817992 wait complete. 2023-12-01T01:01:00.959 DEBUG:teuthology.orchestra.run.smithi116:osd.8> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.8.service 2023-12-01T01:01:00.962 INFO:tasks.cephadm:Deploying osd.9 on smithi026 with /dev/vg_nvme/lv_1... 2023-12-01T01:01:00.962 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-12-01T01:01:00.990 INFO:journalctl@ceph.osd.8.smithi116.stdout:-- Logs begin at Fri 2023-12-01 00:41:59 UTC. -- 2023-12-01T01:01:01.538 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:01:01.656 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:01 smithi116 ceph-mon[103554]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:01:01.656 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:01 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:01.656 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:01 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:01.656 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:01 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:01.656 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:01 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:01.656 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:01 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:01.657 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:01 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:01.657 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:01 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:01.657 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:01 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:01:01.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:01 smithi093 ceph-mon[103327]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:01:01.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:01 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:01.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:01 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:01.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:01 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:01.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:01 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:01.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:01 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:01.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:01 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:01.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:01 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:01.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:01 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:01:01.741 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:01 smithi026 ceph-mon[98801]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:01:01.741 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:01 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:01.742 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:01 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:01.742 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:01 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:01.742 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:01 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:01.742 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:01 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:01.742 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:01 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:01.742 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:01 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:01.743 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:01 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:01:02.252 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:01:01 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:01:01.959+0000 7f7d8891b640 -1 osd.8 0 log_to_monitors true 2023-12-01T01:01:02.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:02 smithi116 ceph-mon[103554]: from='osd.8 [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-01T01:01:02.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:02 smithi116 ceph-mon[103554]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-01T01:01:02.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:02 smithi093 ceph-mon[103327]: from='osd.8 [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-01T01:01:02.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:02 smithi093 ceph-mon[103327]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-01T01:01:02.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:02 smithi026 ceph-mon[98801]: from='osd.8 [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-01T01:01:02.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:02 smithi026 ceph-mon[98801]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-01T01:01:03.055 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-12-01T01:01:03.055 INFO:teuthology.orchestra.run.smithi026.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-12-01T01:01:03.056 INFO:teuthology.orchestra.run.smithi026.stderr: stderr: 10+0 records in 2023-12-01T01:01:03.056 INFO:teuthology.orchestra.run.smithi026.stderr:10+0 records out 2023-12-01T01:01:03.056 INFO:teuthology.orchestra.run.smithi026.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00829319 s, 1.3 GB/s 2023-12-01T01:01:03.056 INFO:teuthology.orchestra.run.smithi026.stderr:--> Zapping successful for: 2023-12-01T01:01:03.362 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:01:03 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:01:03.339+0000 7f7d7df92700 -1 osd.8 0 waiting for initial osdmap 2023-12-01T01:01:03.362 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:01:03 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:01:03.350+0000 7f7d77d83700 -1 osd.8 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T01:01:03.362 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:03 smithi116 ceph-mon[103554]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:01:03.363 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:03 smithi116 ceph-mon[103554]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-12-01T01:01:03.363 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:03 smithi116 ceph-mon[103554]: osdmap e55: 9 total, 8 up, 9 in 2023-12-01T01:01:03.363 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:03 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-01T01:01:03.363 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:03 smithi116 ceph-mon[103554]: from='osd.8 [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:01:03.363 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:03 smithi116 ceph-mon[103554]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:01:03.366 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:03 smithi026 ceph-mon[98801]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:01:03.366 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:03 smithi026 ceph-mon[98801]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-12-01T01:01:03.366 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:03 smithi026 ceph-mon[98801]: osdmap e55: 9 total, 8 up, 9 in 2023-12-01T01:01:03.366 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:03 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-01T01:01:03.367 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:03 smithi026 ceph-mon[98801]: from='osd.8 [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:01:03.367 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:03 smithi026 ceph-mon[98801]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:01:03.402 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi026:vg_nvme/lv_1 2023-12-01T01:01:03.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:03 smithi093 ceph-mon[103327]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:01:03.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:03 smithi093 ceph-mon[103327]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-12-01T01:01:03.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:03 smithi093 ceph-mon[103327]: osdmap e55: 9 total, 8 up, 9 in 2023-12-01T01:01:03.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:03 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-01T01:01:03.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:03 smithi093 ceph-mon[103327]: from='osd.8 [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:01:03.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:03 smithi093 ceph-mon[103327]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:01:03.968 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:01:04.459 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2023-12-01T01:01:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: osdmap e56: 9 total, 8 up, 9 in 2023-12-01T01:01:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-01T01:01:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-01T01:01:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: Detected new or changed devices on smithi116 2023-12-01T01:01:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: Adjusting osd_memory_target on smithi116 to 5722M 2023-12-01T01:01:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:04.460 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: osd.8 [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980] boot 2023-12-01T01:01:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: osdmap e57: 9 total, 9 up, 9 in 2023-12-01T01:01:04.461 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-01T01:01:04.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2023-12-01T01:01:04.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: osdmap e56: 9 total, 8 up, 9 in 2023-12-01T01:01:04.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-01T01:01:04.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-01T01:01:04.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: Detected new or changed devices on smithi116 2023-12-01T01:01:04.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:04.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:04.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:04.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:04.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:04.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: Adjusting osd_memory_target on smithi116 to 5722M 2023-12-01T01:01:04.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:04.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:04.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:04.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:04.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: osd.8 [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980] boot 2023-12-01T01:01:04.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: osdmap e57: 9 total, 9 up, 9 in 2023-12-01T01:01:04.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-01T01:01:04.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2023-12-01T01:01:04.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: osdmap e56: 9 total, 8 up, 9 in 2023-12-01T01:01:04.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-01T01:01:04.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-01T01:01:04.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: Detected new or changed devices on smithi116 2023-12-01T01:01:04.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:04.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:04.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:04.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:04.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:04.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: Adjusting osd_memory_target on smithi116 to 5722M 2023-12-01T01:01:04.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:04.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:04.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:04.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:04.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: osd.8 [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980] boot 2023-12-01T01:01:04.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: osdmap e57: 9 total, 9 up, 9 in 2023-12-01T01:01:04.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-01T01:01:05.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.291+0000 7f381906d700 1 -- 172.21.15.26:0/3377270320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38141018c0 msgr2=0x7f3814108170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:01:05.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.291+0000 7f381906d700 1 --2- 172.21.15.26:0/3377270320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38141018c0 0x7f3814108170 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f380c00b0d0 tx=0x7f380c00b3e0 comp rx=0 tx=0).stop 2023-12-01T01:01:05.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.291+0000 7f381906d700 1 -- 172.21.15.26:0/3377270320 shutdown_connections 2023-12-01T01:01:05.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.291+0000 7f381906d700 1 --2- 172.21.15.26:0/3377270320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38141018c0 0x7f3814108170 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:05.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.291+0000 7f381906d700 1 --2- 172.21.15.26:0/3377270320 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38140ffd20 0x7f3814100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:05.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.291+0000 7f381906d700 1 --2- 172.21.15.26:0/3377270320 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3814100f20 0x7f3814101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:05.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.292+0000 7f381906d700 1 -- 172.21.15.26:0/3377270320 >> 172.21.15.26:0/3377270320 conn(0x7f38140fb2a0 msgr2=0x7f38140fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:01:05.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.292+0000 7f381906d700 1 -- 172.21.15.26:0/3377270320 shutdown_connections 2023-12-01T01:01:05.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.292+0000 7f381906d700 1 -- 172.21.15.26:0/3377270320 wait complete. 2023-12-01T01:01:05.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f381906d700 1 Processor -- start 2023-12-01T01:01:05.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f381906d700 1 -- start start 2023-12-01T01:01:05.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f381906d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38140ffd20 0x7f381410a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:01:05.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f381906d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3814100f20 0x7f3814108c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:01:05.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f381906d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38141018c0 0x7f38141091c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:01:05.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f381906d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3814109940 con 0x7f38140ffd20 2023-12-01T01:01:05.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f381906d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3814109ab0 con 0x7f3814100f20 2023-12-01T01:01:05.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f381906d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38141a0d20 con 0x7f38141018c0 2023-12-01T01:01:05.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f3812d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38140ffd20 0x7f381410a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:01:05.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f3812d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38140ffd20 0x7f381410a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:52954/0 (socket says 172.21.15.26:52954) 2023-12-01T01:01:05.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f3812d9d700 1 -- 172.21.15.26:0/2038484120 learned_addr learned my addr 172.21.15.26:0/2038484120 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:01:05.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f381259c700 1 --2- 172.21.15.26:0/2038484120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3814100f20 0x7f3814108c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:01:05.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f381359e700 1 --2- 172.21.15.26:0/2038484120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38141018c0 0x7f38141091c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:01:05.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f3812d9d700 1 -- 172.21.15.26:0/2038484120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38141018c0 msgr2=0x7f38141091c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:01:05.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f3812d9d700 1 --2- 172.21.15.26:0/2038484120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38141018c0 0x7f38141091c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:05.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f3812d9d700 1 -- 172.21.15.26:0/2038484120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3814100f20 msgr2=0x7f3814108c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:01:05.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f3812d9d700 1 --2- 172.21.15.26:0/2038484120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3814100f20 0x7f3814108c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:05.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.293+0000 7f3812d9d700 1 -- 172.21.15.26:0/2038484120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c009d00 con 0x7f38140ffd20 2023-12-01T01:01:05.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.294+0000 7f3812d9d700 1 --2- 172.21.15.26:0/2038484120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38140ffd20 0x7f381410a630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f380400d980 tx=0x7f380400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:01:05.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.294+0000 7f37fbfff700 1 -- 172.21.15.26:0/2038484120 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3804004020 con 0x7f38140ffd20 2023-12-01T01:01:05.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.294+0000 7f381906d700 1 -- 172.21.15.26:0/2038484120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38141a0fa0 con 0x7f38140ffd20 2023-12-01T01:01:05.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.294+0000 7f37fbfff700 1 -- 172.21.15.26:0/2038484120 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f380400f690 con 0x7f38140ffd20 2023-12-01T01:01:05.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.294+0000 7f37fbfff700 1 -- 172.21.15.26:0/2038484120 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3804003b40 con 0x7f38140ffd20 2023-12-01T01:01:05.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.294+0000 7f381906d700 1 -- 172.21.15.26:0/2038484120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38141a1460 con 0x7f38140ffd20 2023-12-01T01:01:05.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.295+0000 7f381906d700 1 -- 172.21.15.26:0/2038484120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38141071e0 con 0x7f38140ffd20 2023-12-01T01:01:05.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.296+0000 7f37fbfff700 1 -- 172.21.15.26:0/2038484120 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f380400fb20 con 0x7f38140ffd20 2023-12-01T01:01:05.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.297+0000 7f37fbfff700 1 --2- 172.21.15.26:0/2038484120 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f37fc0a0520 0x7f37fc0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:01:05.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.297+0000 7f381259c700 1 --2- 172.21.15.26:0/2038484120 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f37fc0a0520 0x7f37fc0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:01:05.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.297+0000 7f37fbfff700 1 -- 172.21.15.26:0/2038484120 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5858+0+0 (secure 0 0 0) 0x7f38040cab90 con 0x7f38140ffd20 2023-12-01T01:01:05.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.297+0000 7f381259c700 1 --2- 172.21.15.26:0/2038484120 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f37fc0a0520 0x7f37fc0a29e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3808007be0 tx=0x7f38080073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:01:05.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.301+0000 7f37fbfff700 1 -- 172.21.15.26:0/2038484120 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f38040950c0 con 0x7f38140ffd20 2023-12-01T01:01:05.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:05.511+0000 7f381906d700 1 -- 172.21.15.26:0/2038484120 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f38140611d0 con 0x7f37fc0a0520 2023-12-01T01:01:05.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:05 smithi026 ceph-mon[98801]: purged_snaps scrub starts 2023-12-01T01:01:05.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:05 smithi026 ceph-mon[98801]: purged_snaps scrub ok 2023-12-01T01:01:05.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:05 smithi026 ceph-mon[98801]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:01:05.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:05 smithi026 ceph-mon[98801]: osdmap e58: 9 total, 9 up, 9 in 2023-12-01T01:01:05.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:05 smithi116 ceph-mon[103554]: purged_snaps scrub starts 2023-12-01T01:01:05.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:05 smithi116 ceph-mon[103554]: purged_snaps scrub ok 2023-12-01T01:01:05.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:05 smithi116 ceph-mon[103554]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:01:05.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:05 smithi116 ceph-mon[103554]: osdmap e58: 9 total, 9 up, 9 in 2023-12-01T01:01:05.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:05 smithi093 ceph-mon[103327]: purged_snaps scrub starts 2023-12-01T01:01:05.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:05 smithi093 ceph-mon[103327]: purged_snaps scrub ok 2023-12-01T01:01:05.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:05 smithi093 ceph-mon[103327]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-01T01:01:05.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:05 smithi093 ceph-mon[103327]: osdmap e58: 9 total, 9 up, 9 in 2023-12-01T01:01:06.600 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:06 smithi026 ceph-mon[98801]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:01:06.600 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:06 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:01:06.600 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:06 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:01:06.600 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:06 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:06.600 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:06 smithi026 ceph-mon[98801]: osdmap e59: 9 total, 9 up, 9 in 2023-12-01T01:01:06.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:06 smithi116 ceph-mon[103554]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:01:06.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:06 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:01:06.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:06 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:01:06.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:06 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:06.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:06 smithi116 ceph-mon[103554]: osdmap e59: 9 total, 9 up, 9 in 2023-12-01T01:01:06.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:06 smithi093 ceph-mon[103327]: from='client.14415 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi026:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:01:06.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:06 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:01:06.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:06 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:01:06.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:06 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:06.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:06 smithi093 ceph-mon[103327]: osdmap e59: 9 total, 9 up, 9 in 2023-12-01T01:01:07.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:07 smithi026 ceph-mon[98801]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-01T01:01:07.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:07 smithi026 ceph-mon[98801]: osdmap e60: 9 total, 9 up, 9 in 2023-12-01T01:01:07.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:07 smithi116 ceph-mon[103554]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-01T01:01:07.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:07 smithi116 ceph-mon[103554]: osdmap e60: 9 total, 9 up, 9 in 2023-12-01T01:01:07.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:07 smithi093 ceph-mon[103327]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-01T01:01:07.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:07 smithi093 ceph-mon[103327]: osdmap e60: 9 total, 9 up, 9 in 2023-12-01T01:01:08.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:08 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/4170710517' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37"}]: dispatch 2023-12-01T01:01:08.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:08 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/4170710517' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37"}]': finished 2023-12-01T01:01:08.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:08 smithi026 ceph-mon[98801]: osdmap e61: 10 total, 9 up, 10 in 2023-12-01T01:01:08.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:08 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:08.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:08 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/4170710517' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37"}]: dispatch 2023-12-01T01:01:08.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:08 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/4170710517' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37"}]': finished 2023-12-01T01:01:08.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:08 smithi116 ceph-mon[103554]: osdmap e61: 10 total, 9 up, 10 in 2023-12-01T01:01:08.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:08 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:08.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:08 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/4170710517' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37"}]: dispatch 2023-12-01T01:01:08.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:08 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/4170710517' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37"}]': finished 2023-12-01T01:01:08.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:08 smithi093 ceph-mon[103327]: osdmap e61: 10 total, 9 up, 10 in 2023-12-01T01:01:08.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:08 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:09.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:09 smithi026 ceph-mon[98801]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-01T01:01:09.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:09 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2120182415' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:01:09.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:09 smithi116 ceph-mon[103554]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-01T01:01:09.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:09 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2120182415' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:01:09.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:09 smithi093 ceph-mon[103327]: pgmap v176: 1 pgs: 1 remapped+peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-01T01:01:09.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:09 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2120182415' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:01:11.758 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:11 smithi026 ceph-mon[98801]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-12-01T01:01:11.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:11 smithi116 ceph-mon[103554]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-12-01T01:01:11.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:11 smithi093 ceph-mon[103327]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-12-01T01:01:13.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:13 smithi026 ceph-mon[98801]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-01T01:01:13.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:13 smithi116 ceph-mon[103554]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-01T01:01:13.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:13 smithi093 ceph-mon[103327]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-01T01:01:15.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:15 smithi026 ceph-mon[98801]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-12-01T01:01:15.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:15 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-12-01T01:01:15.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:15 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:15.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:15 smithi026 ceph-mon[98801]: Deploying daemon osd.9 on smithi026 2023-12-01T01:01:15.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:15 smithi116 ceph-mon[103554]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-12-01T01:01:15.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:15 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-12-01T01:01:15.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:15 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:15.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:15 smithi116 ceph-mon[103554]: Deploying daemon osd.9 on smithi026 2023-12-01T01:01:15.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:15 smithi093 ceph-mon[103327]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-12-01T01:01:15.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:15 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-12-01T01:01:15.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:15 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:15.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:15 smithi093 ceph-mon[103327]: Deploying daemon osd.9 on smithi026 2023-12-01T01:01:17.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:17 smithi026 ceph-mon[98801]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2023-12-01T01:01:17.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:17 smithi116 ceph-mon[103554]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2023-12-01T01:01:17.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:17 smithi093 ceph-mon[103327]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2023-12-01T01:01:19.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:19 smithi026 ceph-mon[98801]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-12-01T01:01:19.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:19 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:19.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:19 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:19.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:19 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:01:19.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:19 smithi116 ceph-mon[103554]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-12-01T01:01:19.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:19 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:19.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:19 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:19.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:19 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:01:19.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:19 smithi093 ceph-mon[103327]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-12-01T01:01:19.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:19 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:19.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:19 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:19.718 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:19 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:01:21.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:21 smithi026 ceph-mon[98801]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-01T01:01:21.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:21.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:21.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:21.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:21.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:21.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:21 smithi116 ceph-mon[103554]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-01T01:01:21.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:21.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:21.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:21.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:21.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:21.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:21 smithi093 ceph-mon[103327]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-01T01:01:21.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:21.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:21.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:21.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:21.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:21.763 INFO:teuthology.orchestra.run.smithi026.stdout:Created osd(s) 9 on host 'smithi026' 2023-12-01T01:01:21.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:21.761+0000 7f37fbfff700 1 -- 172.21.15.26:0/2038484120 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f38140611d0 con 0x7f37fc0a0520 2023-12-01T01:01:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:21.763+0000 7f381906d700 1 -- 172.21.15.26:0/2038484120 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f37fc0a0520 msgr2=0x7f37fc0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:01:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:21.764+0000 7f381906d700 1 --2- 172.21.15.26:0/2038484120 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f37fc0a0520 0x7f37fc0a29e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3808007be0 tx=0x7f38080073d0 comp rx=0 tx=0).stop 2023-12-01T01:01:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:21.764+0000 7f381906d700 1 -- 172.21.15.26:0/2038484120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38140ffd20 msgr2=0x7f381410a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:01:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:21.764+0000 7f381906d700 1 --2- 172.21.15.26:0/2038484120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38140ffd20 0x7f381410a630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f380400d980 tx=0x7f380400dc90 comp rx=0 tx=0).stop 2023-12-01T01:01:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:21.764+0000 7f381906d700 1 -- 172.21.15.26:0/2038484120 shutdown_connections 2023-12-01T01:01:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:21.764+0000 7f381906d700 1 --2- 172.21.15.26:0/2038484120 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f37fc0a0520 0x7f37fc0a29e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:21.764+0000 7f381906d700 1 --2- 172.21.15.26:0/2038484120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f38141018c0 0x7f38141091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:21.764+0000 7f381906d700 1 --2- 172.21.15.26:0/2038484120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f38140ffd20 0x7f381410a630 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:21.764+0000 7f381906d700 1 --2- 172.21.15.26:0/2038484120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3814100f20 0x7f3814108c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:21.764+0000 7f381906d700 1 -- 172.21.15.26:0/2038484120 >> 172.21.15.26:0/2038484120 conn(0x7f38140fb2a0 msgr2=0x7f3814104320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:01:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:21.764+0000 7f381906d700 1 -- 172.21.15.26:0/2038484120 shutdown_connections 2023-12-01T01:01:21.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:01:21.764+0000 7f381906d700 1 -- 172.21.15.26:0/2038484120 wait complete. 2023-12-01T01:01:22.166 DEBUG:teuthology.orchestra.run.smithi026:osd.9> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.9.service 2023-12-01T01:01:22.168 INFO:tasks.cephadm:Deploying osd.10 on smithi093 with /dev/vg_nvme/lv_1... 2023-12-01T01:01:22.168 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-12-01T01:01:22.199 INFO:journalctl@ceph.osd.9.smithi026.stdout:-- Logs begin at Fri 2023-12-01 00:41:45 UTC. -- 2023-12-01T01:01:22.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:22 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:01:22.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:22 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:22.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:22 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:22.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:22 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:01:22.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:22 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:22.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:22 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:22.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:22 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:01:22.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:22 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:22.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:22 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:22.745 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.b/config 2023-12-01T01:01:23.235 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:01:23 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:01:23.049+0000 7ffa3ecbc640 -1 osd.9 0 log_to_monitors true 2023-12-01T01:01:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:23 smithi026 ceph-mon[98801]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-01T01:01:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:23 smithi026 ceph-mon[98801]: from='osd.9 [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-12-01T01:01:23.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:23 smithi093 ceph-mon[103327]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-01T01:01:23.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:23 smithi093 ceph-mon[103327]: from='osd.9 [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-12-01T01:01:24.132 INFO:teuthology.orchestra.run.smithi093.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-12-01T01:01:24.133 INFO:teuthology.orchestra.run.smithi093.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-12-01T01:01:24.133 INFO:teuthology.orchestra.run.smithi093.stderr: stderr: 10+0 records in 2023-12-01T01:01:24.133 INFO:teuthology.orchestra.run.smithi093.stderr:10+0 records out 2023-12-01T01:01:24.133 INFO:teuthology.orchestra.run.smithi093.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111416 s, 941 MB/s 2023-12-01T01:01:24.133 INFO:teuthology.orchestra.run.smithi093.stderr:--> Zapping successful for: 2023-12-01T01:01:24.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:23 smithi116 ceph-mon[103554]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-01T01:01:24.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:23 smithi116 ceph-mon[103554]: from='osd.9 [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-12-01T01:01:24.588 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi093:vg_nvme/lv_1 2023-12-01T01:01:24.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:01:24 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:01:24.740+0000 7ffa34333700 -1 osd.9 0 waiting for initial osdmap 2023-12-01T01:01:24.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:01:24 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:01:24.758+0000 7ffa30128700 -1 osd.9 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T01:01:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:24 smithi026 ceph-mon[98801]: from='osd.9 [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-12-01T01:01:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:24 smithi026 ceph-mon[98801]: osdmap e62: 10 total, 9 up, 10 in 2023-12-01T01:01:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:24.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:24 smithi026 ceph-mon[98801]: from='osd.9 [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2023-12-01T01:01:25.142 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.b/config 2023-12-01T01:01:25.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:24 smithi116 ceph-mon[103554]: from='osd.9 [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-12-01T01:01:25.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:24 smithi116 ceph-mon[103554]: osdmap e62: 10 total, 9 up, 10 in 2023-12-01T01:01:25.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:25.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:24 smithi116 ceph-mon[103554]: from='osd.9 [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2023-12-01T01:01:25.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:24 smithi093 ceph-mon[103327]: from='osd.9 [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-12-01T01:01:25.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:24 smithi093 ceph-mon[103327]: osdmap e62: 10 total, 9 up, 10 in 2023-12-01T01:01:25.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:25.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:24 smithi093 ceph-mon[103327]: from='osd.9 [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]: dispatch 2023-12-01T01:01:25.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:25 smithi093 ceph-mon[103327]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-01T01:01:25.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:25 smithi093 ceph-mon[103327]: from='osd.9 [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2023-12-01T01:01:25.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:25 smithi093 ceph-mon[103327]: osdmap e63: 10 total, 9 up, 10 in 2023-12-01T01:01:25.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:25.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:25.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:25.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:25.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:25.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:25.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:25.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:25.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:25.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:25.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:25.967 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:25 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:26.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:25 smithi026 ceph-mon[98801]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-01T01:01:26.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:25 smithi026 ceph-mon[98801]: from='osd.9 [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2023-12-01T01:01:26.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:25 smithi026 ceph-mon[98801]: osdmap e63: 10 total, 9 up, 10 in 2023-12-01T01:01:26.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:26.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:26.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:26.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:26.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:26.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:26.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:26.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:26.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:26.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:26.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:26.048 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:25 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:25 smithi116 ceph-mon[103554]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-01T01:01:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:25 smithi116 ceph-mon[103554]: from='osd.9 [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi026", "root=default"]}]': finished 2023-12-01T01:01:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:25 smithi116 ceph-mon[103554]: osdmap e63: 10 total, 9 up, 10 in 2023-12-01T01:01:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:26.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:26.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:26.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:26.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:26.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:26.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:26.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:26.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:26.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:26.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:25 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:26.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.196+0000 7effe0fa3700 1 -- 172.21.15.93:0/1002023561 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effdc1018c0 msgr2=0x7effdc108170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:01:26.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.196+0000 7effe0fa3700 1 --2- 172.21.15.93:0/1002023561 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effdc1018c0 0x7effdc108170 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7effd400b0d0 tx=0x7effd400b3e0 comp rx=0 tx=0).stop 2023-12-01T01:01:26.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.196+0000 7effe0fa3700 1 -- 172.21.15.93:0/1002023561 shutdown_connections 2023-12-01T01:01:26.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.196+0000 7effe0fa3700 1 --2- 172.21.15.93:0/1002023561 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effdc1018c0 0x7effdc108170 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:26.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.196+0000 7effe0fa3700 1 --2- 172.21.15.93:0/1002023561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effdc0ffd20 0x7effdc100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:26.198 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.196+0000 7effe0fa3700 1 --2- 172.21.15.93:0/1002023561 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7effdc100f20 0x7effdc101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:26.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.196+0000 7effe0fa3700 1 -- 172.21.15.93:0/1002023561 >> 172.21.15.93:0/1002023561 conn(0x7effdc0fb2a0 msgr2=0x7effdc0fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:01:26.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.196+0000 7effe0fa3700 1 -- 172.21.15.93:0/1002023561 shutdown_connections 2023-12-01T01:01:26.199 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.196+0000 7effe0fa3700 1 -- 172.21.15.93:0/1002023561 wait complete. 2023-12-01T01:01:26.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.197+0000 7effe0fa3700 1 Processor -- start 2023-12-01T01:01:26.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.197+0000 7effe0fa3700 1 -- start start 2023-12-01T01:01:26.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.197+0000 7effe0fa3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7effdc0ffd20 0x7effdc103ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:01:26.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.197+0000 7effe0fa3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effdc100f20 0x7effdc102530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:01:26.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.197+0000 7effe0fa3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effdc1018c0 0x7effdc102a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:01:26.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.197+0000 7effe0fa3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effdc1031f0 con 0x7effdc1018c0 2023-12-01T01:01:26.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.197+0000 7effe0fa3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effdc103360 con 0x7effdc100f20 2023-12-01T01:01:26.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.197+0000 7effe0fa3700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effdc1a0cf0 con 0x7effdc0ffd20 2023-12-01T01:01:26.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.197+0000 7effd9d9b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effdc100f20 0x7effdc102530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:01:26.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.198+0000 7effd9d9b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effdc100f20 0x7effdc102530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:49730/0 (socket says 172.21.15.93:49730) 2023-12-01T01:01:26.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.198+0000 7effd9d9b700 1 -- 172.21.15.93:0/836667285 learned_addr learned my addr 172.21.15.93:0/836667285 (peer_addr_for_me v2:172.21.15.93:0/0) 2023-12-01T01:01:26.201 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.198+0000 7effda59c700 1 --2- 172.21.15.93:0/836667285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7effdc0ffd20 0x7effdc103ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:01:26.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.198+0000 7effd9d9b700 1 -- 172.21.15.93:0/836667285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7effdc0ffd20 msgr2=0x7effdc103ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:01:26.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.198+0000 7effd9d9b700 1 --2- 172.21.15.93:0/836667285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7effdc0ffd20 0x7effdc103ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:26.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.198+0000 7effd9d9b700 1 -- 172.21.15.93:0/836667285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effdc1018c0 msgr2=0x7effdc102a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:01:26.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.198+0000 7effd9d9b700 1 --2- 172.21.15.93:0/836667285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effdc1018c0 0x7effdc102a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:26.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.198+0000 7effd9d9b700 1 -- 172.21.15.93:0/836667285 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd4009d00 con 0x7effdc100f20 2023-12-01T01:01:26.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.198+0000 7effd9d9b700 1 --2- 172.21.15.93:0/836667285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effdc100f20 0x7effdc102530 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7effcc00d950 tx=0x7effcc00dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:01:26.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.198+0000 7effcb7fe700 1 -- 172.21.15.93:0/836667285 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc009b40 con 0x7effdc100f20 2023-12-01T01:01:26.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.198+0000 7effcb7fe700 1 -- 172.21.15.93:0/836667285 <== mon.2 v2:172.21.15.93:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7effcc009ca0 con 0x7effdc100f20 2023-12-01T01:01:26.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.198+0000 7effe0fa3700 1 -- 172.21.15.93:0/836667285 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effdc1a0fd0 con 0x7effdc100f20 2023-12-01T01:01:26.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.198+0000 7effcb7fe700 1 -- 172.21.15.93:0/836667285 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc00f6b0 con 0x7effdc100f20 2023-12-01T01:01:26.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.198+0000 7effe0fa3700 1 -- 172.21.15.93:0/836667285 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effdc1a1490 con 0x7effdc100f20 2023-12-01T01:01:26.202 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.199+0000 7effe0fa3700 1 -- 172.21.15.93:0/836667285 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effdc107d30 con 0x7effdc100f20 2023-12-01T01:01:26.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.200+0000 7effcb7fe700 1 -- 172.21.15.93:0/836667285 <== mon.2 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7effcc010460 con 0x7effdc100f20 2023-12-01T01:01:26.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.200+0000 7effcb7fe700 1 --2- 172.21.15.93:0/836667285 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7effc40a05a0 0x7effc40a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:01:26.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.201+0000 7effcb7fe700 1 -- 172.21.15.93:0/836667285 <== mon.2 v2:172.21.15.93:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6261+0+0 (secure 0 0 0) 0x7effcc0cb490 con 0x7effdc100f20 2023-12-01T01:01:26.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.201+0000 7effda59c700 1 --2- 172.21.15.93:0/836667285 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7effc40a05a0 0x7effc40a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:01:26.203 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.201+0000 7effda59c700 1 --2- 172.21.15.93:0/836667285 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7effc40a05a0 0x7effc40a2a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7effd0005950 tx=0x7effd00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:01:26.206 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.205+0000 7effcb7fe700 1 -- 172.21.15.93:0/836667285 <== mon.2 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7effcc095830 con 0x7effdc100f20 2023-12-01T01:01:26.406 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:26.404+0000 7effe0fa3700 1 -- 172.21.15.93:0/836667285 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7effdc0611d0 con 0x7effc40a05a0 2023-12-01T01:01:27.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:26 smithi026 ceph-mon[98801]: purged_snaps scrub starts 2023-12-01T01:01:27.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:26 smithi026 ceph-mon[98801]: purged_snaps scrub ok 2023-12-01T01:01:27.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:26 smithi026 ceph-mon[98801]: Detected new or changed devices on smithi026 2023-12-01T01:01:27.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:26 smithi026 ceph-mon[98801]: Adjusting osd_memory_target on smithi026 to 4293M 2023-12-01T01:01:27.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:26 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:27.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:26 smithi026 ceph-mon[98801]: osd.9 [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189] boot 2023-12-01T01:01:27.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:26 smithi026 ceph-mon[98801]: osdmap e64: 10 total, 10 up, 10 in 2023-12-01T01:01:27.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:26 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:27.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:26 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:01:27.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:26 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:01:27.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:26 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:27.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:26 smithi116 ceph-mon[103554]: purged_snaps scrub starts 2023-12-01T01:01:27.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:26 smithi116 ceph-mon[103554]: purged_snaps scrub ok 2023-12-01T01:01:27.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:26 smithi116 ceph-mon[103554]: Detected new or changed devices on smithi026 2023-12-01T01:01:27.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:26 smithi116 ceph-mon[103554]: Adjusting osd_memory_target on smithi026 to 4293M 2023-12-01T01:01:27.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:26 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:27.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:26 smithi116 ceph-mon[103554]: osd.9 [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189] boot 2023-12-01T01:01:27.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:26 smithi116 ceph-mon[103554]: osdmap e64: 10 total, 10 up, 10 in 2023-12-01T01:01:27.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:26 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:27.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:26 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:01:27.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:26 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:01:27.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:26 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:27.207 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:26 smithi093 ceph-mon[103327]: purged_snaps scrub starts 2023-12-01T01:01:27.208 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:26 smithi093 ceph-mon[103327]: purged_snaps scrub ok 2023-12-01T01:01:27.208 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:26 smithi093 ceph-mon[103327]: Detected new or changed devices on smithi026 2023-12-01T01:01:27.208 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:26 smithi093 ceph-mon[103327]: Adjusting osd_memory_target on smithi026 to 4293M 2023-12-01T01:01:27.208 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:26 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:27.208 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:26 smithi093 ceph-mon[103327]: osd.9 [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189] boot 2023-12-01T01:01:27.208 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:26 smithi093 ceph-mon[103327]: osdmap e64: 10 total, 10 up, 10 in 2023-12-01T01:01:27.208 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:26 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-01T01:01:27.208 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:26 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:01:27.208 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:26 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:01:27.208 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:26 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:28.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:27 smithi026 ceph-mon[98801]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-01T01:01:28.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:27 smithi026 ceph-mon[98801]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:01:28.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:27 smithi026 ceph-mon[98801]: osdmap e65: 10 total, 10 up, 10 in 2023-12-01T01:01:28.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:27 smithi116 ceph-mon[103554]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-01T01:01:28.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:27 smithi116 ceph-mon[103554]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:01:28.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:27 smithi116 ceph-mon[103554]: osdmap e65: 10 total, 10 up, 10 in 2023-12-01T01:01:28.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:27 smithi093 ceph-mon[103327]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-01T01:01:28.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:27 smithi093 ceph-mon[103327]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi093:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:01:28.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:27 smithi093 ceph-mon[103327]: osdmap e65: 10 total, 10 up, 10 in 2023-12-01T01:01:29.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:28 smithi026 ceph-mon[98801]: from='client.? 172.21.15.93:0/1835290449' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28902f77-02c2-43ec-b419-476eecd5aa77"}]: dispatch 2023-12-01T01:01:29.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:28 smithi026 ceph-mon[98801]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28902f77-02c2-43ec-b419-476eecd5aa77"}]: dispatch 2023-12-01T01:01:29.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:28 smithi026 ceph-mon[98801]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28902f77-02c2-43ec-b419-476eecd5aa77"}]': finished 2023-12-01T01:01:29.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:28 smithi026 ceph-mon[98801]: osdmap e66: 11 total, 10 up, 11 in 2023-12-01T01:01:29.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:28 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:29.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:28 smithi116 ceph-mon[103554]: from='client.? 172.21.15.93:0/1835290449' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28902f77-02c2-43ec-b419-476eecd5aa77"}]: dispatch 2023-12-01T01:01:29.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:28 smithi116 ceph-mon[103554]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28902f77-02c2-43ec-b419-476eecd5aa77"}]: dispatch 2023-12-01T01:01:29.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:28 smithi116 ceph-mon[103554]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28902f77-02c2-43ec-b419-476eecd5aa77"}]': finished 2023-12-01T01:01:29.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:28 smithi116 ceph-mon[103554]: osdmap e66: 11 total, 10 up, 11 in 2023-12-01T01:01:29.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:28 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:29.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:28 smithi093 ceph-mon[103327]: from='client.? 172.21.15.93:0/1835290449' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28902f77-02c2-43ec-b419-476eecd5aa77"}]: dispatch 2023-12-01T01:01:29.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:28 smithi093 ceph-mon[103327]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "28902f77-02c2-43ec-b419-476eecd5aa77"}]: dispatch 2023-12-01T01:01:29.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:28 smithi093 ceph-mon[103327]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "28902f77-02c2-43ec-b419-476eecd5aa77"}]': finished 2023-12-01T01:01:29.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:28 smithi093 ceph-mon[103327]: osdmap e66: 11 total, 10 up, 11 in 2023-12-01T01:01:29.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:28 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:30.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:29 smithi026 ceph-mon[98801]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:30.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:29 smithi026 ceph-mon[98801]: from='client.? 172.21.15.93:0/1439213033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:01:30.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:29 smithi116 ceph-mon[103554]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:30.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:29 smithi116 ceph-mon[103554]: from='client.? 172.21.15.93:0/1439213033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:01:30.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:29 smithi093 ceph-mon[103327]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:30.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:29 smithi093 ceph-mon[103327]: from='client.? 172.21.15.93:0/1439213033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:01:32.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:31 smithi026 ceph-mon[98801]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:32.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:31 smithi116 ceph-mon[103554]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:32.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:31 smithi093 ceph-mon[103327]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:34.034 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:33 smithi093 ceph-mon[103327]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:34.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:33 smithi026 ceph-mon[98801]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:34.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:33 smithi116 ceph-mon[103554]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:36.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:35 smithi026 ceph-mon[98801]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:36.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:35 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-12-01T01:01:36.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:35 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:36.075 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:35 smithi093 ceph-mon[103327]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:36.075 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:35 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-12-01T01:01:36.075 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:35 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:36.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:35 smithi116 ceph-mon[103554]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:36.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:35 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-12-01T01:01:36.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:35 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:36.910 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:36 smithi093 ceph-mon[103327]: Deploying daemon osd.10 on smithi093 2023-12-01T01:01:37.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:36 smithi026 ceph-mon[98801]: Deploying daemon osd.10 on smithi093 2023-12-01T01:01:37.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:36 smithi116 ceph-mon[103554]: Deploying daemon osd.10 on smithi093 2023-12-01T01:01:37.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:37 smithi093 ceph-mon[103327]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:38.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:37 smithi026 ceph-mon[98801]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:38.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:37 smithi116 ceph-mon[103554]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:40.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:39 smithi026 ceph-mon[98801]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:40.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:39 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:40.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:39 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:40.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:39 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:01:40.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:39 smithi116 ceph-mon[103554]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:40.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:39 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:40.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:39 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:40.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:39 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:01:40.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:39 smithi093 ceph-mon[103327]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:40.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:39 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:40.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:39 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:40.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:39 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:01:41.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:41 smithi093 ceph-mon[103327]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:42.024 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:42.023+0000 7effcb7fe700 1 -- 172.21.15.93:0/836667285 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7effdc0611d0 con 0x7effc40a05a0 2023-12-01T01:01:42.024 INFO:teuthology.orchestra.run.smithi093.stdout:Created osd(s) 10 on host 'smithi093' 2023-12-01T01:01:42.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:42.025+0000 7effe0fa3700 1 -- 172.21.15.93:0/836667285 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7effc40a05a0 msgr2=0x7effc40a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:01:42.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:42.025+0000 7effe0fa3700 1 --2- 172.21.15.93:0/836667285 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7effc40a05a0 0x7effc40a2a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7effd0005950 tx=0x7effd00058e0 comp rx=0 tx=0).stop 2023-12-01T01:01:42.026 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:42.025+0000 7effe0fa3700 1 -- 172.21.15.93:0/836667285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effdc100f20 msgr2=0x7effdc102530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:01:42.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:42.025+0000 7effe0fa3700 1 --2- 172.21.15.93:0/836667285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effdc100f20 0x7effdc102530 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7effcc00d950 tx=0x7effcc00dd10 comp rx=0 tx=0).stop 2023-12-01T01:01:42.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:42.025+0000 7effe0fa3700 1 -- 172.21.15.93:0/836667285 shutdown_connections 2023-12-01T01:01:42.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:42.025+0000 7effe0fa3700 1 --2- 172.21.15.93:0/836667285 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7effc40a05a0 0x7effc40a2a60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:42.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:42.025+0000 7effe0fa3700 1 --2- 172.21.15.93:0/836667285 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7effdc1018c0 0x7effdc102a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:42.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:42.025+0000 7effe0fa3700 1 --2- 172.21.15.93:0/836667285 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7effdc0ffd20 0x7effdc103ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:42.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:42.025+0000 7effe0fa3700 1 --2- 172.21.15.93:0/836667285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7effdc100f20 0x7effdc102530 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:42.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:42.025+0000 7effe0fa3700 1 -- 172.21.15.93:0/836667285 >> 172.21.15.93:0/836667285 conn(0x7effdc0fb2a0 msgr2=0x7effdc0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:01:42.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:42.025+0000 7effe0fa3700 1 -- 172.21.15.93:0/836667285 shutdown_connections 2023-12-01T01:01:42.027 INFO:teuthology.orchestra.run.smithi093.stderr:2023-12-01T01:01:42.025+0000 7effe0fa3700 1 -- 172.21.15.93:0/836667285 wait complete. 2023-12-01T01:01:42.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:41 smithi026 ceph-mon[98801]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:42.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:41 smithi116 ceph-mon[103554]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:42.417 DEBUG:teuthology.orchestra.run.smithi093:osd.10> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.10.service 2023-12-01T01:01:42.419 INFO:tasks.cephadm:Deploying osd.11 on smithi116 with /dev/vg_nvme/lv_1... 2023-12-01T01:01:42.420 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-12-01T01:01:42.450 INFO:journalctl@ceph.osd.10.smithi093.stdout:-- Logs begin at Fri 2023-12-01 00:42:14 UTC. -- 2023-12-01T01:01:42.988 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.c/config 2023-12-01T01:01:43.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:43 smithi026 ceph-mon[98801]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:43.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:43 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:43.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:43 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:43.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:43 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:43.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:43 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:43.344 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:43 smithi116 ceph-mon[103554]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:43.344 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:43 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:43.344 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:43 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:43.344 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:43 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:43.344 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:43 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:43.409 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:43 smithi093 ceph-mon[103327]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:43.409 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:43 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:43.409 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:43 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:43.409 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:43 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:43.409 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:43 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:43.691 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:01:43 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:01:43.499+0000 7fb4e4910640 -1 osd.10 0 log_to_monitors true 2023-12-01T01:01:44.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:44 smithi116 ceph-mon[103554]: from='osd.10 [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-01T01:01:44.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:44 smithi116 ceph-mon[103554]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-01T01:01:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:44 smithi026 ceph-mon[98801]: from='osd.10 [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-01T01:01:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:44 smithi026 ceph-mon[98801]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-01T01:01:44.370 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-12-01T01:01:44.370 INFO:teuthology.orchestra.run.smithi116.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-12-01T01:01:44.370 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10+0 records in 2023-12-01T01:01:44.370 INFO:teuthology.orchestra.run.smithi116.stderr:10+0 records out 2023-12-01T01:01:44.371 INFO:teuthology.orchestra.run.smithi116.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111493 s, 940 MB/s 2023-12-01T01:01:44.371 INFO:teuthology.orchestra.run.smithi116.stderr:--> Zapping successful for: 2023-12-01T01:01:44.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:44 smithi093 ceph-mon[103327]: from='osd.10 [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-01T01:01:44.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:44 smithi093 ceph-mon[103327]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-01T01:01:44.740 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch daemon add osd smithi116:vg_nvme/lv_1 2023-12-01T01:01:45.279 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:01:45 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:01:45.020+0000 7fb4d9f87700 -1 osd.10 0 waiting for initial osdmap 2023-12-01T01:01:45.279 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:01:45 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:01:45.035+0000 7fb4d5d7c700 -1 osd.10 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T01:01:45.280 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:45 smithi093 ceph-mon[103327]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:45.280 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:45 smithi093 ceph-mon[103327]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-12-01T01:01:45.280 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:45 smithi093 ceph-mon[103327]: osdmap e67: 11 total, 10 up, 11 in 2023-12-01T01:01:45.280 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:45 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:45.280 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:45 smithi093 ceph-mon[103327]: from='osd.10 [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T01:01:45.280 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:45 smithi093 ceph-mon[103327]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T01:01:45.289 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.c/config 2023-12-01T01:01:45.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:45 smithi026 ceph-mon[98801]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:45.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:45 smithi026 ceph-mon[98801]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-12-01T01:01:45.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:45 smithi026 ceph-mon[98801]: osdmap e67: 11 total, 10 up, 11 in 2023-12-01T01:01:45.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:45 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:45.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:45 smithi026 ceph-mon[98801]: from='osd.10 [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T01:01:45.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:45 smithi026 ceph-mon[98801]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T01:01:45.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:45 smithi116 ceph-mon[103554]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:45.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:45 smithi116 ceph-mon[103554]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-12-01T01:01:45.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:45 smithi116 ceph-mon[103554]: osdmap e67: 11 total, 10 up, 11 in 2023-12-01T01:01:45.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:45 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:45.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:45 smithi116 ceph-mon[103554]: from='osd.10 [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T01:01:45.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:45 smithi116 ceph-mon[103554]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]: dispatch 2023-12-01T01:01:46.060 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-01T01:01:46.060 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: osdmap e68: 11 total, 10 up, 11 in 2023-12-01T01:01:46.060 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:46.060 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:46.060 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: Detected new or changed devices on smithi093 2023-12-01T01:01:46.060 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:46.060 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:46.061 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:46.061 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:46.061 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:46.061 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:46.061 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: Adjusting osd_memory_target on smithi093 to 4292M 2023-12-01T01:01:46.061 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:46.061 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:46.061 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:46.061 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:46.061 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:46 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:01:46.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-01T01:01:46.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: osdmap e68: 11 total, 10 up, 11 in 2023-12-01T01:01:46.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:46.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:46.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: Detected new or changed devices on smithi093 2023-12-01T01:01:46.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:46.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:46.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:46.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:46.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:46.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:46.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: Adjusting osd_memory_target on smithi093 to 4292M 2023-12-01T01:01:46.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:46.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:46.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:46.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:46.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:46 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:01:46.438 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.437+0000 7fcc24fe8700 1 -- 172.21.15.116:0/1581162838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc20101040 msgr2=0x7fcc201078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:01:46.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.437+0000 7fcc24fe8700 1 --2- 172.21.15.116:0/1581162838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc20101040 0x7fcc201078f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcc1800b0a0 tx=0x7fcc1800b3b0 comp rx=0 tx=0).stop 2023-12-01T01:01:46.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.437+0000 7fcc24fe8700 1 -- 172.21.15.116:0/1581162838 shutdown_connections 2023-12-01T01:01:46.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.437+0000 7fcc24fe8700 1 --2- 172.21.15.116:0/1581162838 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc20101040 0x7fcc201078f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:46.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.437+0000 7fcc24fe8700 1 --2- 172.21.15.116:0/1581162838 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcc200ff4a0 0x7fcc200ff8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:46.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.437+0000 7fcc24fe8700 1 --2- 172.21.15.116:0/1581162838 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc201006a0 0x7fcc20100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:46.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.437+0000 7fcc24fe8700 1 -- 172.21.15.116:0/1581162838 >> 172.21.15.116:0/1581162838 conn(0x7fcc200faa40 msgr2=0x7fcc200fce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:01:46.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.437+0000 7fcc24fe8700 1 -- 172.21.15.116:0/1581162838 shutdown_connections 2023-12-01T01:01:46.439 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.437+0000 7fcc24fe8700 1 -- 172.21.15.116:0/1581162838 wait complete. 2023-12-01T01:01:46.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.438+0000 7fcc24fe8700 1 Processor -- start 2023-12-01T01:01:46.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.438+0000 7fcc24fe8700 1 -- start start 2023-12-01T01:01:46.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.438+0000 7fcc24fe8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc200ff4a0 0x7fcc200fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:01:46.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.438+0000 7fcc24fe8700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc201006a0 0x7fcc2019ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:01:46.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.438+0000 7fcc24fe8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcc20101040 0x7fcc2019e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:01:46.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.438+0000 7fcc24fe8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2019e830 con 0x7fcc200ff4a0 2023-12-01T01:01:46.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.438+0000 7fcc24fe8700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2019e9a0 con 0x7fcc20101040 2023-12-01T01:01:46.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.438+0000 7fcc24fe8700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2019eb60 con 0x7fcc201006a0 2023-12-01T01:01:46.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.438+0000 7fcc1dd9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc201006a0 0x7fcc2019ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:01:46.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.438+0000 7fcc1e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc200ff4a0 0x7fcc200fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:01:46.442 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.438+0000 7fcc1dd9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc201006a0 0x7fcc2019ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54502/0 (socket says 172.21.15.116:54502) 2023-12-01T01:01:46.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.438+0000 7fcc1dd9b700 1 -- 172.21.15.116:0/3923310769 learned_addr learned my addr 172.21.15.116:0/3923310769 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-12-01T01:01:46.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.438+0000 7fcc1ed9d700 1 --2- 172.21.15.116:0/3923310769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcc20101040 0x7fcc2019e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:01:46.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.439+0000 7fcc1dd9b700 1 -- 172.21.15.116:0/3923310769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcc20101040 msgr2=0x7fcc2019e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:01:46.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.439+0000 7fcc1dd9b700 1 --2- 172.21.15.116:0/3923310769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcc20101040 0x7fcc2019e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:46.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.439+0000 7fcc1dd9b700 1 -- 172.21.15.116:0/3923310769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc200ff4a0 msgr2=0x7fcc200fcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:01:46.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.439+0000 7fcc1dd9b700 1 --2- 172.21.15.116:0/3923310769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc200ff4a0 0x7fcc200fcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:01:46.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.439+0000 7fcc1dd9b700 1 -- 172.21.15.116:0/3923310769 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc18009d00 con 0x7fcc201006a0 2023-12-01T01:01:46.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.439+0000 7fcc1e59c700 1 --2- 172.21.15.116:0/3923310769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc200ff4a0 0x7fcc200fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:01:46.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.439+0000 7fcc1dd9b700 1 --2- 172.21.15.116:0/3923310769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc201006a0 0x7fcc2019ba40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000e9a0 tx=0x7fcc1000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:01:46.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.439+0000 7fcc0f7fe700 1 -- 172.21.15.116:0/3923310769 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10009790 con 0x7fcc201006a0 2023-12-01T01:01:46.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.439+0000 7fcc24fe8700 1 -- 172.21.15.116:0/3923310769 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2019ee40 con 0x7fcc201006a0 2023-12-01T01:01:46.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.439+0000 7fcc0f7fe700 1 -- 172.21.15.116:0/3923310769 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcc10010430 con 0x7fcc201006a0 2023-12-01T01:01:46.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.439+0000 7fcc0f7fe700 1 -- 172.21.15.116:0/3923310769 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc10018680 con 0x7fcc201006a0 2023-12-01T01:01:46.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.439+0000 7fcc24fe8700 1 -- 172.21.15.116:0/3923310769 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2019f330 con 0x7fcc201006a0 2023-12-01T01:01:46.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.440+0000 7fcc24fe8700 1 -- 172.21.15.116:0/3923310769 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc20107020 con 0x7fcc201006a0 2023-12-01T01:01:46.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.441+0000 7fcc0f7fe700 1 -- 172.21.15.116:0/3923310769 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fcc10010910 con 0x7fcc201006a0 2023-12-01T01:01:46.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.442+0000 7fcc0f7fe700 1 --2- 172.21.15.116:0/3923310769 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcc080a0520 0x7fcc080a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:01:46.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.442+0000 7fcc0f7fe700 1 -- 172.21.15.116:0/3923310769 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6727+0+0 (secure 0 0 0) 0x7fcc10014070 con 0x7fcc201006a0 2023-12-01T01:01:46.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.442+0000 7fcc1e59c700 1 --2- 172.21.15.116:0/3923310769 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcc080a0520 0x7fcc080a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:01:46.445 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.442+0000 7fcc1e59c700 1 --2- 172.21.15.116:0/3923310769 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcc080a0520 0x7fcc080a29e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcc20100500 tx=0x7fcc14009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:01:46.446 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.445+0000 7fcc0f7fe700 1 -- 172.21.15.116:0/3923310769 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fcc10095bd0 con 0x7fcc201006a0 2023-12-01T01:01:46.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi093", "root=default"]}]': finished 2023-12-01T01:01:46.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: osdmap e68: 11 total, 10 up, 11 in 2023-12-01T01:01:46.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:46.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:46.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: Detected new or changed devices on smithi093 2023-12-01T01:01:46.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:46.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:46.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:46.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:46.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:46.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:01:46.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: Adjusting osd_memory_target on smithi093 to 4292M 2023-12-01T01:01:46.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:46.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:46.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:46.467 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:46.467 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:46 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:01:46.643 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:01:46.642+0000 7fcc24fe8700 1 -- 172.21.15.116:0/3923310769 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc200611d0 con 0x7fcc080a0520 2023-12-01T01:01:47.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:47 smithi026 ceph-mon[98801]: purged_snaps scrub starts 2023-12-01T01:01:47.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:47 smithi026 ceph-mon[98801]: purged_snaps scrub ok 2023-12-01T01:01:47.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:47 smithi026 ceph-mon[98801]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:47.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:47.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:47 smithi026 ceph-mon[98801]: osd.10 [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175] boot 2023-12-01T01:01:47.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:47 smithi026 ceph-mon[98801]: osdmap e69: 11 total, 11 up, 11 in 2023-12-01T01:01:47.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:47.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:47.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:47.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:47.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:47 smithi026 ceph-mon[98801]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:01:47.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:01:47.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:01:47.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:47.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:47 smithi116 ceph-mon[103554]: purged_snaps scrub starts 2023-12-01T01:01:47.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:47 smithi116 ceph-mon[103554]: purged_snaps scrub ok 2023-12-01T01:01:47.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:47 smithi116 ceph-mon[103554]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:47.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:47.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:47 smithi116 ceph-mon[103554]: osd.10 [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175] boot 2023-12-01T01:01:47.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:47 smithi116 ceph-mon[103554]: osdmap e69: 11 total, 11 up, 11 in 2023-12-01T01:01:47.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:47.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:47.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:47.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:47.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:47 smithi116 ceph-mon[103554]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:01:47.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:01:47.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:01:47.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:47.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:47 smithi093 ceph-mon[103327]: purged_snaps scrub starts 2023-12-01T01:01:47.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:47 smithi093 ceph-mon[103327]: purged_snaps scrub ok 2023-12-01T01:01:47.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:47 smithi093 ceph-mon[103327]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-01T01:01:47.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:47.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:47 smithi093 ceph-mon[103327]: osd.10 [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175] boot 2023-12-01T01:01:47.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:47 smithi093 ceph-mon[103327]: osdmap e69: 11 total, 11 up, 11 in 2023-12-01T01:01:47.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-01T01:01:47.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:47.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:01:47.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:01:47.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:47 smithi093 ceph-mon[103327]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi116:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:01:47.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-01T01:01:47.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-01T01:01:47.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:48.039 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:48 smithi116 ceph-mon[103554]: osdmap e70: 11 total, 11 up, 11 in 2023-12-01T01:01:48.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:48 smithi026 ceph-mon[98801]: osdmap e70: 11 total, 11 up, 11 in 2023-12-01T01:01:48.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:48 smithi093 ceph-mon[103327]: osdmap e70: 11 total, 11 up, 11 in 2023-12-01T01:01:49.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:49 smithi026 ceph-mon[98801]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail 2023-12-01T01:01:49.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:49 smithi026 ceph-mon[98801]: osdmap e71: 11 total, 11 up, 11 in 2023-12-01T01:01:49.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:49 smithi026 ceph-mon[98801]: from='client.? 172.21.15.116:0/3169694164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "114b3337-37f0-41e0-b0ab-5b77682584c4"}]: dispatch 2023-12-01T01:01:49.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:49 smithi026 ceph-mon[98801]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "114b3337-37f0-41e0-b0ab-5b77682584c4"}]: dispatch 2023-12-01T01:01:49.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:49 smithi026 ceph-mon[98801]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "114b3337-37f0-41e0-b0ab-5b77682584c4"}]': finished 2023-12-01T01:01:49.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:49 smithi026 ceph-mon[98801]: osdmap e72: 12 total, 11 up, 12 in 2023-12-01T01:01:49.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:49 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:01:49.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:49 smithi116 ceph-mon[103554]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail 2023-12-01T01:01:49.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:49 smithi116 ceph-mon[103554]: osdmap e71: 11 total, 11 up, 11 in 2023-12-01T01:01:49.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:49 smithi116 ceph-mon[103554]: from='client.? 172.21.15.116:0/3169694164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "114b3337-37f0-41e0-b0ab-5b77682584c4"}]: dispatch 2023-12-01T01:01:49.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:49 smithi116 ceph-mon[103554]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "114b3337-37f0-41e0-b0ab-5b77682584c4"}]: dispatch 2023-12-01T01:01:49.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:49 smithi116 ceph-mon[103554]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "114b3337-37f0-41e0-b0ab-5b77682584c4"}]': finished 2023-12-01T01:01:49.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:49 smithi116 ceph-mon[103554]: osdmap e72: 12 total, 11 up, 12 in 2023-12-01T01:01:49.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:49 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:01:49.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:49 smithi093 ceph-mon[103327]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail 2023-12-01T01:01:49.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:49 smithi093 ceph-mon[103327]: osdmap e71: 11 total, 11 up, 11 in 2023-12-01T01:01:49.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:49 smithi093 ceph-mon[103327]: from='client.? 172.21.15.116:0/3169694164' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "114b3337-37f0-41e0-b0ab-5b77682584c4"}]: dispatch 2023-12-01T01:01:49.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:49 smithi093 ceph-mon[103327]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "114b3337-37f0-41e0-b0ab-5b77682584c4"}]: dispatch 2023-12-01T01:01:49.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:49 smithi093 ceph-mon[103327]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "114b3337-37f0-41e0-b0ab-5b77682584c4"}]': finished 2023-12-01T01:01:49.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:49 smithi093 ceph-mon[103327]: osdmap e72: 12 total, 11 up, 12 in 2023-12-01T01:01:49.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:49 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:01:50.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:50 smithi116 ceph-mon[103554]: from='client.? 172.21.15.116:0/1222924090' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:01:50.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:50 smithi116 ceph-mon[103554]: osdmap e73: 12 total, 11 up, 12 in 2023-12-01T01:01:50.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:50 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:01:50.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:50 smithi093 ceph-mon[103327]: from='client.? 172.21.15.116:0/1222924090' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:01:50.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:50 smithi093 ceph-mon[103327]: osdmap e73: 12 total, 11 up, 12 in 2023-12-01T01:01:50.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:50 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:01:50.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:50 smithi026 ceph-mon[98801]: from='client.? 172.21.15.116:0/1222924090' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-01T01:01:50.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:50 smithi026 ceph-mon[98801]: osdmap e73: 12 total, 11 up, 12 in 2023-12-01T01:01:50.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:50 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:01:51.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:51 smithi116 ceph-mon[103554]: pgmap v208: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-01T01:01:51.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:51 smithi093 ceph-mon[103327]: pgmap v208: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-01T01:01:51.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:51 smithi026 ceph-mon[98801]: pgmap v208: 1 pgs: 1 peering; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-01T01:01:53.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:53 smithi116 ceph-mon[103554]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2023-12-01T01:01:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:53 smithi093 ceph-mon[103327]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2023-12-01T01:01:53.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:53 smithi026 ceph-mon[98801]: pgmap v210: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 117 KiB/s, 0 objects/s recovering 2023-12-01T01:01:55.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:55 smithi116 ceph-mon[103554]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-01T01:01:55.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:55 smithi093 ceph-mon[103327]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-01T01:01:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:55 smithi026 ceph-mon[98801]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-01T01:01:56.678 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:56 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-12-01T01:01:56.678 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:56 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:56.678 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:56 smithi116 ceph-mon[103554]: Deploying daemon osd.11 on smithi116 2023-12-01T01:01:56.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:56 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-12-01T01:01:56.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:56 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:56.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:56 smithi093 ceph-mon[103327]: Deploying daemon osd.11 on smithi116 2023-12-01T01:01:56.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:56 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-12-01T01:01:56.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:56 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:01:56.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:56 smithi026 ceph-mon[98801]: Deploying daemon osd.11 on smithi116 2023-12-01T01:01:57.611 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:57 smithi116 ceph-mon[103554]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-12-01T01:01:57.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:57 smithi093 ceph-mon[103327]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-12-01T01:01:57.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:57 smithi026 ceph-mon[98801]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2023-12-01T01:01:59.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:01:59 smithi116 ceph-mon[103554]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-12-01T01:01:59.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:01:59 smithi093 ceph-mon[103327]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-12-01T01:01:59.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:01:59 smithi026 ceph-mon[98801]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 64 KiB/s, 0 objects/s recovering 2023-12-01T01:02:00.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:00 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:00.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:00 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:00.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:00 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:02:00.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:00 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:00.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:00 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:00.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:00 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:02:00.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:00 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:00.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:00 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:00.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:00 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:02:01.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:01 smithi116 ceph-mon[103554]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-01T01:02:01.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:01 smithi093 ceph-mon[103327]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-01T01:02:01.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:01 smithi026 ceph-mon[98801]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-01T01:02:02.104 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:02.102+0000 7fcc0f7fe700 1 -- 172.21.15.116:0/3923310769 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fcc200611d0 con 0x7fcc080a0520 2023-12-01T01:02:02.104 INFO:teuthology.orchestra.run.smithi116.stdout:Created osd(s) 11 on host 'smithi116' 2023-12-01T01:02:02.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:02.104+0000 7fcc24fe8700 1 -- 172.21.15.116:0/3923310769 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcc080a0520 msgr2=0x7fcc080a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:02.105 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:02.104+0000 7fcc24fe8700 1 --2- 172.21.15.116:0/3923310769 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcc080a0520 0x7fcc080a29e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcc20100500 tx=0x7fcc14009190 comp rx=0 tx=0).stop 2023-12-01T01:02:02.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:02.104+0000 7fcc24fe8700 1 -- 172.21.15.116:0/3923310769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc201006a0 msgr2=0x7fcc2019ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:02.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:02.104+0000 7fcc24fe8700 1 --2- 172.21.15.116:0/3923310769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc201006a0 0x7fcc2019ba40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcc1000e9a0 tx=0x7fcc1000ecb0 comp rx=0 tx=0).stop 2023-12-01T01:02:02.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:02.104+0000 7fcc24fe8700 1 -- 172.21.15.116:0/3923310769 shutdown_connections 2023-12-01T01:02:02.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:02.104+0000 7fcc24fe8700 1 --2- 172.21.15.116:0/3923310769 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcc080a0520 0x7fcc080a29e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:02.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:02.104+0000 7fcc24fe8700 1 --2- 172.21.15.116:0/3923310769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcc20101040 0x7fcc2019e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:02.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:02.104+0000 7fcc24fe8700 1 --2- 172.21.15.116:0/3923310769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc200ff4a0 0x7fcc200fcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:02.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:02.104+0000 7fcc24fe8700 1 --2- 172.21.15.116:0/3923310769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcc201006a0 0x7fcc2019ba40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:02.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:02.104+0000 7fcc24fe8700 1 -- 172.21.15.116:0/3923310769 >> 172.21.15.116:0/3923310769 conn(0x7fcc200faa40 msgr2=0x7fcc20104160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:02.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:02.104+0000 7fcc24fe8700 1 -- 172.21.15.116:0/3923310769 shutdown_connections 2023-12-01T01:02:02.106 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:02.104+0000 7fcc24fe8700 1 -- 172.21.15.116:0/3923310769 wait complete. 2023-12-01T01:02:02.467 DEBUG:teuthology.orchestra.run.smithi116:osd.11> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.11.service 2023-12-01T01:02:02.469 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-12-01T01:02:02.469 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd stat -f json 2023-12-01T01:02:02.499 INFO:journalctl@ceph.osd.11.smithi116.stdout:-- Logs begin at Fri 2023-12-01 00:41:59 UTC. -- 2023-12-01T01:02:02.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:02 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:02.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:02 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:02.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:02 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:02.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:02 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:02:02.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:02 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:02.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:02 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:02.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:02 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:02.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:02 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:02:02.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:02 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:02.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:02 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:02.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:02 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:02.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:02 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:02:02.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:02 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:02.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:02 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:02.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:02 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:02.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:02 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:02:02.972 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:02 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:02.972 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:02 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:02.972 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:02 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:02.972 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:02 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:02:02.972 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:02 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:02.972 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:02 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:02.972 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:02 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:02.973 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:02 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:02:03.044 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:02:03.680 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:02:03 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:02:03.430+0000 7feb13f2b640 -1 osd.11 0 log_to_monitors true 2023-12-01T01:02:04.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:03 smithi026 ceph-mon[98801]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-01T01:02:04.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:03 smithi026 ceph-mon[98801]: from='osd.11 [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-01T01:02:04.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:03 smithi026 ceph-mon[98801]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-01T01:02:04.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:03 smithi116 ceph-mon[103554]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-01T01:02:04.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:03 smithi116 ceph-mon[103554]: from='osd.11 [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-01T01:02:04.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:03 smithi116 ceph-mon[103554]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-01T01:02:04.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:03 smithi093 ceph-mon[103327]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-01T01:02:04.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:03 smithi093 ceph-mon[103327]: from='osd.11 [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-01T01:02:04.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:03 smithi093 ceph-mon[103327]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-01T01:02:04.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.430+0000 7ff5ea76c700 1 -- 172.21.15.26:0/2419391887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5e4101910 msgr2=0x7ff5e4103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:04.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.430+0000 7ff5ea76c700 1 --2- 172.21.15.26:0/2419391887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5e4101910 0x7ff5e4103d00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff5d4009990 tx=0x7ff5d4009ca0 comp rx=0 tx=0).stop 2023-12-01T01:02:04.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.430+0000 7ff5ea76c700 1 -- 172.21.15.26:0/2419391887 shutdown_connections 2023-12-01T01:02:04.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.430+0000 7ff5ea76c700 1 --2- 172.21.15.26:0/2419391887 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5e4106b70 0x7ff5e4108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:04.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.430+0000 7ff5ea76c700 1 --2- 172.21.15.26:0/2419391887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5e4101910 0x7ff5e4103d00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:04.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.430+0000 7ff5ea76c700 1 --2- 172.21.15.26:0/2419391887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e4104240 0x7ff5e4106630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:04.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.430+0000 7ff5ea76c700 1 -- 172.21.15.26:0/2419391887 >> 172.21.15.26:0/2419391887 conn(0x7ff5e40fb2a0 msgr2=0x7ff5e40fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:04.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.430+0000 7ff5ea76c700 1 -- 172.21.15.26:0/2419391887 shutdown_connections 2023-12-01T01:02:04.432 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.430+0000 7ff5ea76c700 1 -- 172.21.15.26:0/2419391887 wait complete. 2023-12-01T01:02:04.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.431+0000 7ff5ea76c700 1 Processor -- start 2023-12-01T01:02:04.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.431+0000 7ff5ea76c700 1 -- start start 2023-12-01T01:02:04.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.431+0000 7ff5ea76c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5e4101910 0x7ff5e4196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:04.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.431+0000 7ff5ea76c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5e4104240 0x7ff5e41970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:04.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.431+0000 7ff5ea76c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e4106b70 0x7ff5e419e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:04.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.431+0000 7ff5ea76c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e419e710 con 0x7ff5e4104240 2023-12-01T01:02:04.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.431+0000 7ff5ea76c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e419e850 con 0x7ff5e4101910 2023-12-01T01:02:04.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.431+0000 7ff5ea76c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e419e9e0 con 0x7ff5e4106b70 2023-12-01T01:02:04.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.431+0000 7ff5dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5e4104240 0x7ff5e41970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:04.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.431+0000 7ff5dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5e4104240 0x7ff5e41970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53116/0 (socket says 172.21.15.26:53116) 2023-12-01T01:02:04.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.431+0000 7ff5dbfff700 1 -- 172.21.15.26:0/1581903462 learned_addr learned my addr 172.21.15.26:0/1581903462 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:04.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.431+0000 7ff5e8d09700 1 --2- 172.21.15.26:0/1581903462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e4106b70 0x7ff5e419e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:04.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.431+0000 7ff5e3fff700 1 --2- 172.21.15.26:0/1581903462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5e4101910 0x7ff5e4196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:04.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.432+0000 7ff5dbfff700 1 -- 172.21.15.26:0/1581903462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e4106b70 msgr2=0x7ff5e419e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:04.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.432+0000 7ff5dbfff700 1 --2- 172.21.15.26:0/1581903462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e4106b70 0x7ff5e419e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:04.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.432+0000 7ff5dbfff700 1 -- 172.21.15.26:0/1581903462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5e4101910 msgr2=0x7ff5e4196b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:04.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.432+0000 7ff5dbfff700 1 --2- 172.21.15.26:0/1581903462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5e4101910 0x7ff5e4196b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:04.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.432+0000 7ff5dbfff700 1 -- 172.21.15.26:0/1581903462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d40095f0 con 0x7ff5e4104240 2023-12-01T01:02:04.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.432+0000 7ff5e3fff700 1 --2- 172.21.15.26:0/1581903462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5e4101910 0x7ff5e4196b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:02:04.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.432+0000 7ff5dbfff700 1 --2- 172.21.15.26:0/1581903462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5e4104240 0x7ff5e41970c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc00e9d0 tx=0x7ff5cc00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:04.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.432+0000 7ff5e1ffb700 1 -- 172.21.15.26:0/1581903462 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc009790 con 0x7ff5e4104240 2023-12-01T01:02:04.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.432+0000 7ff5e1ffb700 1 -- 172.21.15.26:0/1581903462 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff5cc00cbd0 con 0x7ff5e4104240 2023-12-01T01:02:04.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.432+0000 7ff5e1ffb700 1 -- 172.21.15.26:0/1581903462 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc018680 con 0x7ff5e4104240 2023-12-01T01:02:04.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.432+0000 7ff5ea76c700 1 -- 172.21.15.26:0/1581903462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e419ecc0 con 0x7ff5e4104240 2023-12-01T01:02:04.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.432+0000 7ff5ea76c700 1 -- 172.21.15.26:0/1581903462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e419f1c0 con 0x7ff5e4104240 2023-12-01T01:02:04.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.433+0000 7ff5ea76c700 1 -- 172.21.15.26:0/1581903462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e40fce20 con 0x7ff5e4104240 2023-12-01T01:02:04.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.434+0000 7ff5e1ffb700 1 -- 172.21.15.26:0/1581903462 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7ff5cc00cd40 con 0x7ff5e4104240 2023-12-01T01:02:04.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.435+0000 7ff5e1ffb700 1 --2- 172.21.15.26:0/1581903462 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff5d00a05a0 0x7ff5d00a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:04.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.435+0000 7ff5e3fff700 1 --2- 172.21.15.26:0/1581903462 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff5d00a05a0 0x7ff5d00a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:04.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.435+0000 7ff5e1ffb700 1 -- 172.21.15.26:0/1581903462 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6831+0+0 (secure 0 0 0) 0x7ff5cc014070 con 0x7ff5e4104240 2023-12-01T01:02:04.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.435+0000 7ff5e3fff700 1 --2- 172.21.15.26:0/1581903462 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff5d00a05a0 0x7ff5d00a2a60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400b2e0 tx=0x7ff5d4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:04.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.439+0000 7ff5e1ffb700 1 -- 172.21.15.26:0/1581903462 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff5cc0520e0 con 0x7ff5e4104240 2023-12-01T01:02:04.638 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.637+0000 7ff5ea76c700 1 -- 172.21.15.26:0/1581903462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ff5e402cec0 con 0x7ff5e4104240 2023-12-01T01:02:04.639 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.638+0000 7ff5e1ffb700 1 -- 172.21.15.26:0/1581903462 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v74) v1 ==== 74+0+133 (secure 0 0 0) 0x7ff5cc0956e0 con 0x7ff5e4104240 2023-12-01T01:02:04.639 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:04.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.640+0000 7ff5ea76c700 1 -- 172.21.15.26:0/1581903462 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff5d00a05a0 msgr2=0x7ff5d00a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:04.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.640+0000 7ff5ea76c700 1 --2- 172.21.15.26:0/1581903462 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff5d00a05a0 0x7ff5d00a2a60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400b2e0 tx=0x7ff5d4005fb0 comp rx=0 tx=0).stop 2023-12-01T01:02:04.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.640+0000 7ff5ea76c700 1 -- 172.21.15.26:0/1581903462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5e4104240 msgr2=0x7ff5e41970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:04.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.640+0000 7ff5ea76c700 1 --2- 172.21.15.26:0/1581903462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5e4104240 0x7ff5e41970c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc00e9d0 tx=0x7ff5cc00ece0 comp rx=0 tx=0).stop 2023-12-01T01:02:04.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.640+0000 7ff5ea76c700 1 -- 172.21.15.26:0/1581903462 shutdown_connections 2023-12-01T01:02:04.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.640+0000 7ff5ea76c700 1 --2- 172.21.15.26:0/1581903462 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff5d00a05a0 0x7ff5d00a2a60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:04.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.640+0000 7ff5ea76c700 1 --2- 172.21.15.26:0/1581903462 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff5e4106b70 0x7ff5e419e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:04.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.640+0000 7ff5ea76c700 1 --2- 172.21.15.26:0/1581903462 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff5e4101910 0x7ff5e4196b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:04.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.640+0000 7ff5ea76c700 1 --2- 172.21.15.26:0/1581903462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5e4104240 0x7ff5e41970c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:04.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.640+0000 7ff5ea76c700 1 -- 172.21.15.26:0/1581903462 >> 172.21.15.26:0/1581903462 conn(0x7ff5e40fb2a0 msgr2=0x7ff5e4102580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:04.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.640+0000 7ff5ea76c700 1 -- 172.21.15.26:0/1581903462 shutdown_connections 2023-12-01T01:02:04.641 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:04.640+0000 7ff5ea76c700 1 -- 172.21.15.26:0/1581903462 wait complete. 2023-12-01T01:02:04.840 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:02:04 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:02:04.750+0000 7feb095a2700 -1 osd.11 0 waiting for initial osdmap 2023-12-01T01:02:04.840 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:02:04 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:02:04.763+0000 7feb04395700 -1 osd.11 75 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-01T01:02:04.840 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:04 smithi116 ceph-mon[103554]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-12-01T01:02:04.841 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:04 smithi116 ceph-mon[103554]: osdmap e74: 12 total, 11 up, 12 in 2023-12-01T01:02:04.841 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:04 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:02:04.841 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:04 smithi116 ceph-mon[103554]: from='osd.11 [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:02:04.841 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:04 smithi116 ceph-mon[103554]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:02:04.841 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:04 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1581903462' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-01T01:02:04.952 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:04 smithi026 ceph-mon[98801]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-12-01T01:02:04.952 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:04 smithi026 ceph-mon[98801]: osdmap e74: 12 total, 11 up, 12 in 2023-12-01T01:02:04.952 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:04 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:02:04.952 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:04 smithi026 ceph-mon[98801]: from='osd.11 [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:02:04.952 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:04 smithi026 ceph-mon[98801]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:02:04.952 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:04 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1581903462' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-01T01:02:04.992 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":74,"num_osds":12,"num_up_osds":11,"osd_up_since":1701392506,"num_in_osds":12,"osd_in_since":1701392508,"num_remapped_pgs":0} 2023-12-01T01:02:05.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:04 smithi093 ceph-mon[103327]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-12-01T01:02:05.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:04 smithi093 ceph-mon[103327]: osdmap e74: 12 total, 11 up, 12 in 2023-12-01T01:02:05.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:04 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:02:05.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:04 smithi093 ceph-mon[103327]: from='osd.11 [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:02:05.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:04 smithi093 ceph-mon[103327]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]: dispatch 2023-12-01T01:02:05.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:04 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1581903462' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-01T01:02:05.993 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd stat -f json 2023-12-01T01:02:06.025 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:05 smithi026 ceph-mon[98801]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-01T01:02:06.025 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:05 smithi026 ceph-mon[98801]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2023-12-01T01:02:06.025 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:05 smithi026 ceph-mon[98801]: osdmap e75: 12 total, 11 up, 12 in 2023-12-01T01:02:06.025 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:02:06.026 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:02:06.026 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:06.026 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:06.026 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:02:06.026 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:02:06.026 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:02:06.026 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:02:06.026 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:06.026 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:06.026 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:02:06.026 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:05 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:06.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:05 smithi116 ceph-mon[103554]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-01T01:02:06.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:05 smithi116 ceph-mon[103554]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2023-12-01T01:02:06.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:05 smithi116 ceph-mon[103554]: osdmap e75: 12 total, 11 up, 12 in 2023-12-01T01:02:06.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:02:06.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:02:06.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:06.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:06.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:02:06.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:02:06.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:02:06.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:02:06.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:06.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:06.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:02:06.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:05 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:06.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:05 smithi093 ceph-mon[103327]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-01T01:02:06.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:05 smithi093 ceph-mon[103327]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi116", "root=default"]}]': finished 2023-12-01T01:02:06.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:05 smithi093 ceph-mon[103327]: osdmap e75: 12 total, 11 up, 12 in 2023-12-01T01:02:06.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:02:06.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:02:06.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:06.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:06.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:02:06.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:02:06.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:02:06.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-01T01:02:06.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:06.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:06.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:02:06.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:05 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:06.571 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:02:07.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:06 smithi026 ceph-mon[98801]: purged_snaps scrub starts 2023-12-01T01:02:07.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:06 smithi026 ceph-mon[98801]: purged_snaps scrub ok 2023-12-01T01:02:07.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:06 smithi026 ceph-mon[98801]: Detected new or changed devices on smithi116 2023-12-01T01:02:07.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:06 smithi026 ceph-mon[98801]: Adjusting osd_memory_target on smithi116 to 4292M 2023-12-01T01:02:07.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:06 smithi026 ceph-mon[98801]: osd.11 [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198] boot 2023-12-01T01:02:07.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:06 smithi026 ceph-mon[98801]: osdmap e76: 12 total, 12 up, 12 in 2023-12-01T01:02:07.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:06 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:02:07.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:06 smithi116 ceph-mon[103554]: purged_snaps scrub starts 2023-12-01T01:02:07.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:06 smithi116 ceph-mon[103554]: purged_snaps scrub ok 2023-12-01T01:02:07.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:06 smithi116 ceph-mon[103554]: Detected new or changed devices on smithi116 2023-12-01T01:02:07.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:06 smithi116 ceph-mon[103554]: Adjusting osd_memory_target on smithi116 to 4292M 2023-12-01T01:02:07.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:06 smithi116 ceph-mon[103554]: osd.11 [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198] boot 2023-12-01T01:02:07.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:06 smithi116 ceph-mon[103554]: osdmap e76: 12 total, 12 up, 12 in 2023-12-01T01:02:07.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:06 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:02:07.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:06 smithi093 ceph-mon[103327]: purged_snaps scrub starts 2023-12-01T01:02:07.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:06 smithi093 ceph-mon[103327]: purged_snaps scrub ok 2023-12-01T01:02:07.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:06 smithi093 ceph-mon[103327]: Detected new or changed devices on smithi116 2023-12-01T01:02:07.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:06 smithi093 ceph-mon[103327]: Adjusting osd_memory_target on smithi116 to 4292M 2023-12-01T01:02:07.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:06 smithi093 ceph-mon[103327]: osd.11 [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198] boot 2023-12-01T01:02:07.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:06 smithi093 ceph-mon[103327]: osdmap e76: 12 total, 12 up, 12 in 2023-12-01T01:02:07.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:06 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-01T01:02:07.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.931+0000 7f964a2a1700 1 -- 172.21.15.26:0/3616146605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9644102970 msgr2=0x7f9644109290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.931+0000 7f964a2a1700 1 --2- 172.21.15.26:0/3616146605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9644102970 0x7f9644109290 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f963c00b0a0 tx=0x7f963c00b3b0 comp rx=0 tx=0).stop 2023-12-01T01:02:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.931+0000 7f964a2a1700 1 -- 172.21.15.26:0/3616146605 shutdown_connections 2023-12-01T01:02:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.931+0000 7f964a2a1700 1 --2- 172.21.15.26:0/3616146605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9644102970 0x7f9644109290 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.931+0000 7f964a2a1700 1 --2- 172.21.15.26:0/3616146605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9644100e50 0x7f9644101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.931+0000 7f964a2a1700 1 --2- 172.21.15.26:0/3616146605 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9644101fb0 0x7f9644102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.931+0000 7f964a2a1700 1 -- 172.21.15.26:0/3616146605 >> 172.21.15.26:0/3616146605 conn(0x7f96440fc3b0 msgr2=0x7f96440fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.931+0000 7f964a2a1700 1 -- 172.21.15.26:0/3616146605 shutdown_connections 2023-12-01T01:02:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.931+0000 7f964a2a1700 1 -- 172.21.15.26:0/3616146605 wait complete. 2023-12-01T01:02:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.932+0000 7f964a2a1700 1 Processor -- start 2023-12-01T01:02:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.932+0000 7f964a2a1700 1 -- start start 2023-12-01T01:02:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.932+0000 7f964a2a1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9644100e50 0x7f9644196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.932+0000 7f964a2a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9644101fb0 0x7f9644197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.932+0000 7f964a2a1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9644102970 0x7f964419e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:07.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.932+0000 7f964a2a1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964419e860 con 0x7f9644101fb0 2023-12-01T01:02:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.932+0000 7f964a2a1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964419e9a0 con 0x7f9644102970 2023-12-01T01:02:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.932+0000 7f964a2a1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964419eb60 con 0x7f9644100e50 2023-12-01T01:02:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.932+0000 7f96437fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9644101fb0 0x7f9644197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.932+0000 7f96437fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9644101fb0 0x7f9644197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53140/0 (socket says 172.21.15.26:53140) 2023-12-01T01:02:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.932+0000 7f96437fe700 1 -- 172.21.15.26:0/566596403 learned_addr learned my addr 172.21.15.26:0/566596403 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.932+0000 7f9643fff700 1 --2- 172.21.15.26:0/566596403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9644100e50 0x7f9644196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.933+0000 7f964883e700 1 --2- 172.21.15.26:0/566596403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9644102970 0x7f964419e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.933+0000 7f96437fe700 1 -- 172.21.15.26:0/566596403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9644100e50 msgr2=0x7f9644196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.933+0000 7f96437fe700 1 --2- 172.21.15.26:0/566596403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9644100e50 0x7f9644196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.933+0000 7f96437fe700 1 -- 172.21.15.26:0/566596403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9644102970 msgr2=0x7f964419e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.933+0000 7f96437fe700 1 --2- 172.21.15.26:0/566596403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9644102970 0x7f964419e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.933+0000 7f96437fe700 1 -- 172.21.15.26:0/566596403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f963c009d00 con 0x7f9644101fb0 2023-12-01T01:02:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.933+0000 7f96437fe700 1 --2- 172.21.15.26:0/566596403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9644101fb0 0x7f9644197250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f962c00c920 tx=0x7f962c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.933+0000 7f96417fa700 1 -- 172.21.15.26:0/566596403 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c004a30 con 0x7f9644101fb0 2023-12-01T01:02:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.933+0000 7f96417fa700 1 -- 172.21.15.26:0/566596403 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f962c005500 con 0x7f9644101fb0 2023-12-01T01:02:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.933+0000 7f964a2a1700 1 -- 172.21.15.26:0/566596403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964419ee40 con 0x7f9644101fb0 2023-12-01T01:02:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.933+0000 7f96417fa700 1 -- 172.21.15.26:0/566596403 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962c007cd0 con 0x7f9644101fb0 2023-12-01T01:02:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.933+0000 7f964a2a1700 1 -- 172.21.15.26:0/566596403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964419f250 con 0x7f9644101fb0 2023-12-01T01:02:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.934+0000 7f964a2a1700 1 -- 172.21.15.26:0/566596403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96441083a0 con 0x7f9644101fb0 2023-12-01T01:02:07.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.935+0000 7f96417fa700 1 -- 172.21.15.26:0/566596403 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f962c005000 con 0x7f9644101fb0 2023-12-01T01:02:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.936+0000 7f96417fa700 1 --2- 172.21.15.26:0/566596403 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f96300a0520 0x7f96300a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.936+0000 7f9643fff700 1 --2- 172.21.15.26:0/566596403 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f96300a0520 0x7f96300a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.936+0000 7f96417fa700 1 -- 172.21.15.26:0/566596403 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f962c0cb420 con 0x7f9644101fb0 2023-12-01T01:02:07.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.936+0000 7f9643fff700 1 --2- 172.21.15.26:0/566596403 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f96300a0520 0x7f96300a29e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9634005950 tx=0x7f963400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:07.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:07.940+0000 7f96417fa700 1 -- 172.21.15.26:0/566596403 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f962c0953c0 con 0x7f9644101fb0 2023-12-01T01:02:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:07 smithi026 ceph-mon[98801]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-01T01:02:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:07 smithi026 ceph-mon[98801]: osdmap e77: 12 total, 12 up, 12 in 2023-12-01T01:02:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:08.143+0000 7f964a2a1700 1 -- 172.21.15.26:0/566596403 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f964402cc70 con 0x7f9644101fb0 2023-12-01T01:02:08.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:08.143+0000 7f96417fa700 1 -- 172.21.15.26:0/566596403 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v77) v1 ==== 74+0+133 (secure 0 0 0) 0x7f962c0989e0 con 0x7f9644101fb0 2023-12-01T01:02:08.144 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:08.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:08.145+0000 7f964a2a1700 1 -- 172.21.15.26:0/566596403 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f96300a0520 msgr2=0x7f96300a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:08.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:08.145+0000 7f964a2a1700 1 --2- 172.21.15.26:0/566596403 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f96300a0520 0x7f96300a29e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9634005950 tx=0x7f963400a300 comp rx=0 tx=0).stop 2023-12-01T01:02:08.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:08.145+0000 7f964a2a1700 1 -- 172.21.15.26:0/566596403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9644101fb0 msgr2=0x7f9644197250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:08.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:08.145+0000 7f964a2a1700 1 --2- 172.21.15.26:0/566596403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9644101fb0 0x7f9644197250 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f962c00c920 tx=0x7f962c00cc30 comp rx=0 tx=0).stop 2023-12-01T01:02:08.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:08.145+0000 7f964a2a1700 1 -- 172.21.15.26:0/566596403 shutdown_connections 2023-12-01T01:02:08.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:08.145+0000 7f964a2a1700 1 --2- 172.21.15.26:0/566596403 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f96300a0520 0x7f96300a29e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:08.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:08.145+0000 7f964a2a1700 1 --2- 172.21.15.26:0/566596403 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9644102970 0x7f964419e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:08.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:08.145+0000 7f964a2a1700 1 --2- 172.21.15.26:0/566596403 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9644100e50 0x7f9644196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:08.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:08.145+0000 7f964a2a1700 1 --2- 172.21.15.26:0/566596403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9644101fb0 0x7f9644197250 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:08.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:08.145+0000 7f964a2a1700 1 -- 172.21.15.26:0/566596403 >> 172.21.15.26:0/566596403 conn(0x7f96440fc3b0 msgr2=0x7f96441054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:08.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:08.145+0000 7f964a2a1700 1 -- 172.21.15.26:0/566596403 shutdown_connections 2023-12-01T01:02:08.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:08.145+0000 7f964a2a1700 1 -- 172.21.15.26:0/566596403 wait complete. 2023-12-01T01:02:08.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:07 smithi116 ceph-mon[103554]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-01T01:02:08.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:07 smithi116 ceph-mon[103554]: osdmap e77: 12 total, 12 up, 12 in 2023-12-01T01:02:08.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:07 smithi093 ceph-mon[103327]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-01T01:02:08.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:07 smithi093 ceph-mon[103327]: osdmap e77: 12 total, 12 up, 12 in 2023-12-01T01:02:08.618 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":77,"num_osds":12,"num_up_osds":12,"osd_up_since":1701392525,"num_in_osds":12,"osd_in_since":1701392508,"num_remapped_pgs":0} 2023-12-01T01:02:08.619 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-01T01:02:09.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:08 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/566596403' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-01T01:02:09.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:08 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/566596403' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-01T01:02:09.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:08 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/566596403' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-01T01:02:09.218 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:02:10.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:09 smithi026 ceph-mon[98801]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:10.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:09 smithi116 ceph-mon[103554]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:10.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:09 smithi093 ceph-mon[103327]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.411+0000 7f9b11456700 1 -- 172.21.15.26:0/714685814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b0c1060e0 msgr2=0x7f9b0c10dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.411+0000 7f9b11456700 1 --2- 172.21.15.26:0/714685814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b0c1060e0 0x7f9b0c10dcb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400b0a0 tx=0x7f9b0400b3b0 comp rx=0 tx=0).stop 2023-12-01T01:02:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.411+0000 7f9b11456700 1 -- 172.21.15.26:0/714685814 shutdown_connections 2023-12-01T01:02:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.411+0000 7f9b11456700 1 --2- 172.21.15.26:0/714685814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b0c1060e0 0x7f9b0c10dcb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.411+0000 7f9b11456700 1 --2- 172.21.15.26:0/714685814 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b0c101000 0x7f9b0c1013e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.411+0000 7f9b11456700 1 --2- 172.21.15.26:0/714685814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b0c1019b0 0x7f9b0c105a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.411+0000 7f9b11456700 1 -- 172.21.15.26:0/714685814 >> 172.21.15.26:0/714685814 conn(0x7f9b0c0fc890 msgr2=0x7f9b0c0fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.411+0000 7f9b11456700 1 -- 172.21.15.26:0/714685814 shutdown_connections 2023-12-01T01:02:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.411+0000 7f9b11456700 1 -- 172.21.15.26:0/714685814 wait complete. 2023-12-01T01:02:10.413 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.412+0000 7f9b11456700 1 Processor -- start 2023-12-01T01:02:10.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.412+0000 7f9b11456700 1 -- start start 2023-12-01T01:02:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.412+0000 7f9b11456700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b0c101000 0x7f9b0c073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.412+0000 7f9b11456700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b0c1019b0 0x7f9b0c0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.412+0000 7f9b11456700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b0c1060e0 0x7f9b0c1a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:10.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.412+0000 7f9b11456700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c073ec0 con 0x7f9b0c1019b0 2023-12-01T01:02:10.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.412+0000 7f9b11456700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c1a57a0 con 0x7f9b0c101000 2023-12-01T01:02:10.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.412+0000 7f9b11456700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c1a5910 con 0x7f9b0c1060e0 2023-12-01T01:02:10.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.412+0000 7f9b0a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b0c1019b0 0x7f9b0c0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:10.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.412+0000 7f9b0a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b0c1019b0 0x7f9b0c0735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53152/0 (socket says 172.21.15.26:53152) 2023-12-01T01:02:10.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.412+0000 7f9b0a7fc700 1 -- 172.21.15.26:0/2051365913 learned_addr learned my addr 172.21.15.26:0/2051365913 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:10.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.413+0000 7f9b0affd700 1 --2- 172.21.15.26:0/2051365913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b0c101000 0x7f9b0c073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:10.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.413+0000 7f9b0b7fe700 1 --2- 172.21.15.26:0/2051365913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b0c1060e0 0x7f9b0c1a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:10.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.413+0000 7f9b0a7fc700 1 -- 172.21.15.26:0/2051365913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b0c1060e0 msgr2=0x7f9b0c1a5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:10.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.413+0000 7f9b0a7fc700 1 --2- 172.21.15.26:0/2051365913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b0c1060e0 0x7f9b0c1a5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:10.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.413+0000 7f9b0a7fc700 1 -- 172.21.15.26:0/2051365913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b0c101000 msgr2=0x7f9b0c073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:10.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.413+0000 7f9b0a7fc700 1 --2- 172.21.15.26:0/2051365913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b0c101000 0x7f9b0c073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.413+0000 7f9b0a7fc700 1 -- 172.21.15.26:0/2051365913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b04009d00 con 0x7f9b0c1019b0 2023-12-01T01:02:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.413+0000 7f9b0affd700 1 --2- 172.21.15.26:0/2051365913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b0c101000 0x7f9b0c073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:02:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.413+0000 7f9b0b7fe700 1 --2- 172.21.15.26:0/2051365913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b0c1060e0 0x7f9b0c1a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:02:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.413+0000 7f9b0a7fc700 1 --2- 172.21.15.26:0/2051365913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b0c1019b0 0x7f9b0c0735d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00d950 tx=0x7f9afc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.413+0000 7f9b03fff700 1 -- 172.21.15.26:0/2051365913 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc009b40 con 0x7f9b0c1019b0 2023-12-01T01:02:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.413+0000 7f9b11456700 1 -- 172.21.15.26:0/2051365913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0c1a5b90 con 0x7f9b0c1019b0 2023-12-01T01:02:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.413+0000 7f9b03fff700 1 -- 172.21.15.26:0/2051365913 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9afc00de30 con 0x7f9b0c1019b0 2023-12-01T01:02:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.413+0000 7f9b03fff700 1 -- 172.21.15.26:0/2051365913 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc005680 con 0x7f9b0c1019b0 2023-12-01T01:02:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.413+0000 7f9b11456700 1 -- 172.21.15.26:0/2051365913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0c1a6040 con 0x7f9b0c1019b0 2023-12-01T01:02:10.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.414+0000 7f9b11456700 1 -- 172.21.15.26:0/2051365913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0c04ea90 con 0x7f9b0c1019b0 2023-12-01T01:02:10.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.415+0000 7f9b03fff700 1 -- 172.21.15.26:0/2051365913 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f9afc009ca0 con 0x7f9b0c1019b0 2023-12-01T01:02:10.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.416+0000 7f9b03fff700 1 --2- 172.21.15.26:0/2051365913 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9af80a0520 0x7f9af80a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:10.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.416+0000 7f9b0affd700 1 --2- 172.21.15.26:0/2051365913 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9af80a0520 0x7f9af80a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:10.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.417+0000 7f9b03fff700 1 -- 172.21.15.26:0/2051365913 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9afc0cb1e0 con 0x7f9b0c1019b0 2023-12-01T01:02:10.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.417+0000 7f9b0affd700 1 --2- 172.21.15.26:0/2051365913 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9af80a0520 0x7f9af80a29e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9af4005fd0 tx=0x7f9af4005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:10.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.420+0000 7f9b03fff700 1 -- 172.21.15.26:0/2051365913 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9afc095220 con 0x7f9b0c1019b0 2023-12-01T01:02:10.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.618+0000 7f9b11456700 1 -- 172.21.15.26:0/2051365913 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b0c1a6300 con 0x7f9b0c1019b0 2023-12-01T01:02:10.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.619+0000 7f9b03fff700 1 -- 172.21.15.26:0/2051365913 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f9afc020090 con 0x7f9b0c1019b0 2023-12-01T01:02:10.621 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:10.621 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":77,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:06.752812+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:02:10.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.621+0000 7f9b11456700 1 -- 172.21.15.26:0/2051365913 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9af80a0520 msgr2=0x7f9af80a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:10.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.621+0000 7f9b11456700 1 --2- 172.21.15.26:0/2051365913 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9af80a0520 0x7f9af80a29e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9af4005fd0 tx=0x7f9af4005dc0 comp rx=0 tx=0).stop 2023-12-01T01:02:10.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.621+0000 7f9b11456700 1 -- 172.21.15.26:0/2051365913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b0c1019b0 msgr2=0x7f9b0c0735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:10.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.621+0000 7f9b11456700 1 --2- 172.21.15.26:0/2051365913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b0c1019b0 0x7f9b0c0735d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9afc00d950 tx=0x7f9afc00dd10 comp rx=0 tx=0).stop 2023-12-01T01:02:10.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.621+0000 7f9b11456700 1 -- 172.21.15.26:0/2051365913 shutdown_connections 2023-12-01T01:02:10.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.621+0000 7f9b11456700 1 --2- 172.21.15.26:0/2051365913 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9af80a0520 0x7f9af80a29e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:10.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.621+0000 7f9b11456700 1 --2- 172.21.15.26:0/2051365913 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b0c1060e0 0x7f9b0c1a5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:10.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.621+0000 7f9b11456700 1 --2- 172.21.15.26:0/2051365913 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b0c101000 0x7f9b0c073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:10.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.621+0000 7f9b11456700 1 --2- 172.21.15.26:0/2051365913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b0c1019b0 0x7f9b0c0735d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:10.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.621+0000 7f9b11456700 1 -- 172.21.15.26:0/2051365913 >> 172.21.15.26:0/2051365913 conn(0x7f9b0c0fc890 msgr2=0x7f9b0c0fd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:10.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.621+0000 7f9b11456700 1 -- 172.21.15.26:0/2051365913 shutdown_connections 2023-12-01T01:02:10.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:10.622+0000 7f9b11456700 1 -- 172.21.15.26:0/2051365913 wait complete. 2023-12-01T01:02:11.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:10 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2051365913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:11.077 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T00:59:06.411348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T01:02:11.077 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-01T01:02:11.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:10 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2051365913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:11.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:10 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2051365913' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:11.635 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:02:12.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:11 smithi026 ceph-mon[98801]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:12.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:11 smithi116 ceph-mon[103554]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:12.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:11 smithi093 ceph-mon[103327]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:12.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.860+0000 7ff270191700 1 -- 172.21.15.26:0/3201655004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff268105d90 msgr2=0x7ff268106170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:12.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.860+0000 7ff270191700 1 --2- 172.21.15.26:0/3201655004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff268105d90 0x7ff268106170 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff264009990 tx=0x7ff264009ca0 comp rx=0 tx=0).stop 2023-12-01T01:02:12.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.860+0000 7ff270191700 1 -- 172.21.15.26:0/3201655004 shutdown_connections 2023-12-01T01:02:12.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.860+0000 7ff270191700 1 --2- 172.21.15.26:0/3201655004 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2680ffc80 0x7ff26810dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:12.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.860+0000 7ff270191700 1 --2- 172.21.15.26:0/3201655004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff268105d90 0x7ff268106170 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:12.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.860+0000 7ff270191700 1 --2- 172.21.15.26:0/3201655004 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2680ff2c0 0x7ff2680ff740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:12.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.860+0000 7ff270191700 1 -- 172.21.15.26:0/3201655004 >> 172.21.15.26:0/3201655004 conn(0x7ff268076200 msgr2=0x7ff2680fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.860+0000 7ff270191700 1 -- 172.21.15.26:0/3201655004 shutdown_connections 2023-12-01T01:02:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.860+0000 7ff270191700 1 -- 172.21.15.26:0/3201655004 wait complete. 2023-12-01T01:02:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.860+0000 7ff270191700 1 Processor -- start 2023-12-01T01:02:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.860+0000 7ff270191700 1 -- start start 2023-12-01T01:02:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff270191700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2680ff2c0 0x7ff268196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff270191700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2680ffc80 0x7ff268197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff270191700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff268105d90 0x7ff26819b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff270191700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26819bfb0 con 0x7ff268105d90 2023-12-01T01:02:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff270191700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26819c120 con 0x7ff2680ff2c0 2023-12-01T01:02:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff270191700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26819c2e0 con 0x7ff2680ffc80 2023-12-01T01:02:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff26e72e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff268105d90 0x7ff26819b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff26e72e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff268105d90 0x7ff26819b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53168/0 (socket says 172.21.15.26:53168) 2023-12-01T01:02:12.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff26e72e700 1 -- 172.21.15.26:0/3265636645 learned_addr learned my addr 172.21.15.26:0/3265636645 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:12.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff26df2d700 1 --2- 172.21.15.26:0/3265636645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2680ff2c0 0x7ff268196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:12.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff26d72c700 1 --2- 172.21.15.26:0/3265636645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2680ffc80 0x7ff268197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:12.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff26e72e700 1 -- 172.21.15.26:0/3265636645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2680ffc80 msgr2=0x7ff268197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:12.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff26e72e700 1 --2- 172.21.15.26:0/3265636645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2680ffc80 0x7ff268197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:12.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff26e72e700 1 -- 172.21.15.26:0/3265636645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2680ff2c0 msgr2=0x7ff268196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:12.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff26e72e700 1 --2- 172.21.15.26:0/3265636645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2680ff2c0 0x7ff268196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:12.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff26e72e700 1 -- 172.21.15.26:0/3265636645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2640095f0 con 0x7ff268105d90 2023-12-01T01:02:12.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff26d72c700 1 --2- 172.21.15.26:0/3265636645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2680ffc80 0x7ff268197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:02:12.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff26e72e700 1 --2- 172.21.15.26:0/3265636645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff268105d90 0x7ff26819b9a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff26000ef30 tx=0x7ff26000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:12.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff25effd700 1 -- 172.21.15.26:0/3265636645 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff260018070 con 0x7ff268105d90 2023-12-01T01:02:12.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff25effd700 1 -- 172.21.15.26:0/3265636645 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff26000f040 con 0x7ff268105d90 2023-12-01T01:02:12.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff270191700 1 -- 172.21.15.26:0/3265636645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26819c560 con 0x7ff268105d90 2023-12-01T01:02:12.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.861+0000 7ff25effd700 1 -- 172.21.15.26:0/3265636645 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26000ce00 con 0x7ff268105d90 2023-12-01T01:02:12.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.862+0000 7ff270191700 1 -- 172.21.15.26:0/3265636645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2681a3e20 con 0x7ff268105d90 2023-12-01T01:02:12.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.863+0000 7ff270191700 1 -- 172.21.15.26:0/3265636645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26804ea90 con 0x7ff268105d90 2023-12-01T01:02:12.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.864+0000 7ff25effd700 1 -- 172.21.15.26:0/3265636645 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7ff260003a00 con 0x7ff268105d90 2023-12-01T01:02:12.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.864+0000 7ff25effd700 1 --2- 172.21.15.26:0/3265636645 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff2540a0520 0x7ff2540a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:12.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.864+0000 7ff25effd700 1 -- 172.21.15.26:0/3265636645 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff2600cbae0 con 0x7ff268105d90 2023-12-01T01:02:12.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.864+0000 7ff26df2d700 1 --2- 172.21.15.26:0/3265636645 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff2540a0520 0x7ff2540a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:12.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.865+0000 7ff26df2d700 1 --2- 172.21.15.26:0/3265636645 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff2540a0520 0x7ff2540a29e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff26400b2e0 tx=0x7ff264005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:12.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:12.868+0000 7ff25effd700 1 -- 172.21.15.26:0/3265636645 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff260095bb0 con 0x7ff268105d90 2023-12-01T01:02:13.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:13.067+0000 7ff270191700 1 -- 172.21.15.26:0/3265636645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2681a3fe0 con 0x7ff268105d90 2023-12-01T01:02:13.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:13.067+0000 7ff25effd700 1 -- 172.21.15.26:0/3265636645 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2600991d0 con 0x7ff268105d90 2023-12-01T01:02:13.068 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-12-01T01:02:13.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:13.069+0000 7ff270191700 1 -- 172.21.15.26:0/3265636645 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff2540a0520 msgr2=0x7ff2540a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:13.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:13.069+0000 7ff270191700 1 --2- 172.21.15.26:0/3265636645 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff2540a0520 0x7ff2540a29e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff26400b2e0 tx=0x7ff264005fb0 comp rx=0 tx=0).stop 2023-12-01T01:02:13.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:13.069+0000 7ff270191700 1 -- 172.21.15.26:0/3265636645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff268105d90 msgr2=0x7ff26819b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:13.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:13.069+0000 7ff270191700 1 --2- 172.21.15.26:0/3265636645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff268105d90 0x7ff26819b9a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff26000ef30 tx=0x7ff26000c3a0 comp rx=0 tx=0).stop 2023-12-01T01:02:13.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:13.069+0000 7ff270191700 1 -- 172.21.15.26:0/3265636645 shutdown_connections 2023-12-01T01:02:13.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:13.069+0000 7ff270191700 1 --2- 172.21.15.26:0/3265636645 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff2540a0520 0x7ff2540a29e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:13.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:13.069+0000 7ff270191700 1 --2- 172.21.15.26:0/3265636645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff268105d90 0x7ff26819b9a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:13.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:13.069+0000 7ff270191700 1 --2- 172.21.15.26:0/3265636645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2680ff2c0 0x7ff268196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:13.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:13.069+0000 7ff270191700 1 --2- 172.21.15.26:0/3265636645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2680ffc80 0x7ff268197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:13.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:13.069+0000 7ff270191700 1 -- 172.21.15.26:0/3265636645 >> 172.21.15.26:0/3265636645 conn(0x7ff268076200 msgr2=0x7ff268103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:13.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:13.069+0000 7ff270191700 1 -- 172.21.15.26:0/3265636645 shutdown_connections 2023-12-01T01:02:13.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:13.069+0000 7ff270191700 1 -- 172.21.15.26:0/3265636645 wait complete. 2023-12-01T01:02:13.482 INFO:tasks.cephadm:Adding mds.a on smithi026 2023-12-01T01:02:13.482 INFO:tasks.cephadm:Adding mds.d on smithi026 2023-12-01T01:02:13.482 INFO:tasks.cephadm:Adding mds.g on smithi026 2023-12-01T01:02:13.482 INFO:tasks.cephadm:Adding mds.j on smithi026 2023-12-01T01:02:13.483 INFO:tasks.cephadm:Adding mds.b on smithi093 2023-12-01T01:02:13.483 INFO:tasks.cephadm:Adding mds.e on smithi093 2023-12-01T01:02:13.483 INFO:tasks.cephadm:Adding mds.h on smithi093 2023-12-01T01:02:13.483 INFO:tasks.cephadm:Adding mds.k on smithi093 2023-12-01T01:02:13.483 INFO:tasks.cephadm:Adding mds.c on smithi116 2023-12-01T01:02:13.483 INFO:tasks.cephadm:Adding mds.f on smithi116 2023-12-01T01:02:13.483 INFO:tasks.cephadm:Adding mds.i on smithi116 2023-12-01T01:02:13.483 INFO:tasks.cephadm:Adding mds.l on smithi116 2023-12-01T01:02:13.483 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph orch apply mds all '12;smithi026=a;smithi026=d;smithi026=g;smithi026=j;smithi093=b;smithi093=e;smithi093=h;smithi093=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l' 2023-12-01T01:02:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:13 smithi026 ceph-mon[98801]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:13 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3265636645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:02:14.048 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.c/config 2023-12-01T01:02:14.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:13 smithi116 ceph-mon[103554]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:14.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:13 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3265636645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:02:14.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:13 smithi093 ceph-mon[103327]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:14.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:13 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3265636645' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:02:15.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.224+0000 7feadc5e8700 1 -- 172.21.15.116:0/2673892986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fead4100f20 msgr2=0x7fead4101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:15.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.224+0000 7feadc5e8700 1 --2- 172.21.15.116:0/2673892986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fead4100f20 0x7fead4101380 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feac4009990 tx=0x7feac4009ca0 comp rx=0 tx=0).stop 2023-12-01T01:02:15.227 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.224+0000 7feadc5e8700 1 -- 172.21.15.116:0/2673892986 shutdown_connections 2023-12-01T01:02:15.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.224+0000 7feadc5e8700 1 --2- 172.21.15.116:0/2673892986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead41018c0 0x7fead4108170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:15.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.224+0000 7feadc5e8700 1 --2- 172.21.15.116:0/2673892986 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fead40ffd20 0x7fead4100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:15.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.224+0000 7feadc5e8700 1 --2- 172.21.15.116:0/2673892986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fead4100f20 0x7fead4101380 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:15.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.224+0000 7feadc5e8700 1 -- 172.21.15.116:0/2673892986 >> 172.21.15.116:0/2673892986 conn(0x7fead40fb2a0 msgr2=0x7fead40fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:15.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.224+0000 7feadc5e8700 1 -- 172.21.15.116:0/2673892986 shutdown_connections 2023-12-01T01:02:15.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.224+0000 7feadc5e8700 1 -- 172.21.15.116:0/2673892986 wait complete. 2023-12-01T01:02:15.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.224+0000 7feadc5e8700 1 Processor -- start 2023-12-01T01:02:15.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.224+0000 7feadc5e8700 1 -- start start 2023-12-01T01:02:15.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.224+0000 7feadc5e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead40ffd20 0x7fead4195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:15.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.224+0000 7feadc5e8700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fead4100f20 0x7fead4196050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:15.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.224+0000 7feadc5e8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fead41018c0 0x7fead419d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:15.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7feadc5e8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead419d6a0 con 0x7fead40ffd20 2023-12-01T01:02:15.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7feadc5e8700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead419d7e0 con 0x7fead41018c0 2023-12-01T01:02:15.228 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7feadc5e8700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead419d970 con 0x7fead4100f20 2023-12-01T01:02:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7fead9b83700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fead4100f20 0x7fead4196050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7fead9b83700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fead4100f20 0x7fead4196050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.116:54626/0 (socket says 172.21.15.116:54626) 2023-12-01T01:02:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7fead9b83700 1 -- 172.21.15.116:0/3063506669 learned_addr learned my addr 172.21.15.116:0/3063506669 (peer_addr_for_me v2:172.21.15.116:0/0) 2023-12-01T01:02:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7feada384700 1 --2- 172.21.15.116:0/3063506669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead40ffd20 0x7fead4195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7feadab85700 1 --2- 172.21.15.116:0/3063506669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fead41018c0 0x7fead419d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7fead9b83700 1 -- 172.21.15.116:0/3063506669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fead41018c0 msgr2=0x7fead419d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7fead9b83700 1 --2- 172.21.15.116:0/3063506669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fead41018c0 0x7fead419d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7fead9b83700 1 -- 172.21.15.116:0/3063506669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead40ffd20 msgr2=0x7fead4195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7fead9b83700 1 --2- 172.21.15.116:0/3063506669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead40ffd20 0x7fead4195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7fead9b83700 1 -- 172.21.15.116:0/3063506669 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac40095f0 con 0x7fead4100f20 2023-12-01T01:02:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7feadab85700 1 --2- 172.21.15.116:0/3063506669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fead41018c0 0x7fead419d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:02:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7feada384700 1 --2- 172.21.15.116:0/3063506669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead40ffd20 0x7fead4195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:02:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7fead9b83700 1 --2- 172.21.15.116:0/3063506669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fead4100f20 0x7fead4196050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feac4006010 tx=0x7feac400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7feacb7fe700 1 -- 172.21.15.116:0/3063506669 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac401d070 con 0x7fead4100f20 2023-12-01T01:02:15.229 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7feadc5e8700 1 -- 172.21.15.116:0/3063506669 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead419dbf0 con 0x7fead4100f20 2023-12-01T01:02:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7feacb7fe700 1 -- 172.21.15.116:0/3063506669 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7feac400fb40 con 0x7fead4100f20 2023-12-01T01:02:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7feacb7fe700 1 -- 172.21.15.116:0/3063506669 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4017650 con 0x7fead4100f20 2023-12-01T01:02:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.225+0000 7feadc5e8700 1 -- 172.21.15.116:0/3063506669 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead419e060 con 0x7fead4100f20 2023-12-01T01:02:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.226+0000 7feadc5e8700 1 -- 172.21.15.116:0/3063506669 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead410b680 con 0x7fead4100f20 2023-12-01T01:02:15.230 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.227+0000 7feacb7fe700 1 -- 172.21.15.116:0/3063506669 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7feac400fcb0 con 0x7fead4100f20 2023-12-01T01:02:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.228+0000 7feacb7fe700 1 --2- 172.21.15.116:0/3063506669 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7feac00a05a0 0x7feac00a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.228+0000 7feacb7fe700 1 -- 172.21.15.116:0/3063506669 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7feac40cc480 con 0x7fead4100f20 2023-12-01T01:02:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.228+0000 7feada384700 1 --2- 172.21.15.116:0/3063506669 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7feac00a05a0 0x7feac00a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:15.231 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.229+0000 7feada384700 1 --2- 172.21.15.116:0/3063506669 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7feac00a05a0 0x7feac00a2a60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fead0005950 tx=0x7fead0005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:15.234 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.233+0000 7feacb7fe700 1 -- 172.21.15.116:0/3063506669 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7feac40964b0 con 0x7fead4100f20 2023-12-01T01:02:15.431 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.430+0000 7feadc5e8700 1 -- 172.21.15.116:0/3063506669 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi026=a;smithi026=d;smithi026=g;smithi026=j;smithi093=b;smithi093=e;smithi093=h;smithi093=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fead40691e0 con 0x7feac00a05a0 2023-12-01T01:02:15.441 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.439+0000 7feacb7fe700 1 -- 172.21.15.116:0/3063506669 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fead40691e0 con 0x7feac00a05a0 2023-12-01T01:02:15.441 INFO:teuthology.orchestra.run.smithi116.stdout:Scheduled mds.all update... 2023-12-01T01:02:15.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.442+0000 7feadc5e8700 1 -- 172.21.15.116:0/3063506669 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7feac00a05a0 msgr2=0x7feac00a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:15.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.442+0000 7feadc5e8700 1 --2- 172.21.15.116:0/3063506669 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7feac00a05a0 0x7feac00a2a60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fead0005950 tx=0x7fead0005f50 comp rx=0 tx=0).stop 2023-12-01T01:02:15.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.442+0000 7feadc5e8700 1 -- 172.21.15.116:0/3063506669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fead4100f20 msgr2=0x7fead4196050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:15.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.442+0000 7feadc5e8700 1 --2- 172.21.15.116:0/3063506669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fead4100f20 0x7fead4196050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feac4006010 tx=0x7feac400f690 comp rx=0 tx=0).stop 2023-12-01T01:02:15.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.442+0000 7feadc5e8700 1 -- 172.21.15.116:0/3063506669 shutdown_connections 2023-12-01T01:02:15.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.442+0000 7feadc5e8700 1 --2- 172.21.15.116:0/3063506669 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7feac00a05a0 0x7feac00a2a60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:15.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.442+0000 7feadc5e8700 1 --2- 172.21.15.116:0/3063506669 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fead41018c0 0x7fead419d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:15.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.442+0000 7feadc5e8700 1 --2- 172.21.15.116:0/3063506669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead40ffd20 0x7fead4195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:15.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.442+0000 7feadc5e8700 1 --2- 172.21.15.116:0/3063506669 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fead4100f20 0x7fead4196050 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:15.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.442+0000 7feadc5e8700 1 -- 172.21.15.116:0/3063506669 >> 172.21.15.116:0/3063506669 conn(0x7fead40fb2a0 msgr2=0x7fead4104460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:15.443 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.442+0000 7feadc5e8700 1 -- 172.21.15.116:0/3063506669 shutdown_connections 2023-12-01T01:02:15.444 INFO:teuthology.orchestra.run.smithi116.stderr:2023-12-01T01:02:15.442+0000 7feadc5e8700 1 -- 172.21.15.116:0/3063506669 wait complete. 2023-12-01T01:02:15.778 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:15 smithi116 ceph-mon[103554]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:15.778 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:15 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:15.778 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:15 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:02:15.779 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:15 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:15.779 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:15 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:02:15.779 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:15 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:15.779 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:15 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:15.779 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:15 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:15.779 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:15 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:15.805 DEBUG:teuthology.orchestra.run.smithi026:mds.a> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.a.service 2023-12-01T01:02:15.808 DEBUG:teuthology.orchestra.run.smithi026:mds.d> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.d.service 2023-12-01T01:02:15.846 INFO:journalctl@ceph.mds.a.smithi026.stdout:-- Logs begin at Fri 2023-12-01 00:41:45 UTC. -- 2023-12-01T01:02:15.848 DEBUG:teuthology.orchestra.run.smithi026:mds.g> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.g.service 2023-12-01T01:02:15.878 INFO:journalctl@ceph.mds.d.smithi026.stdout:-- Logs begin at Fri 2023-12-01 00:41:45 UTC. -- 2023-12-01T01:02:15.879 DEBUG:teuthology.orchestra.run.smithi026:mds.j> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.j.service 2023-12-01T01:02:15.907 INFO:journalctl@ceph.mds.g.smithi026.stdout:-- Logs begin at Fri 2023-12-01 00:41:45 UTC. -- 2023-12-01T01:02:15.908 DEBUG:teuthology.orchestra.run.smithi093:mds.b> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.b.service 2023-12-01T01:02:15.911 DEBUG:teuthology.orchestra.run.smithi093:mds.e> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.e.service 2023-12-01T01:02:15.936 INFO:journalctl@ceph.mds.j.smithi026.stdout:-- Logs begin at Fri 2023-12-01 00:41:45 UTC. -- 2023-12-01T01:02:15.949 INFO:journalctl@ceph.mds.b.smithi093.stdout:-- Logs begin at Fri 2023-12-01 00:42:14 UTC. -- 2023-12-01T01:02:15.950 DEBUG:teuthology.orchestra.run.smithi093:mds.h> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.h.service 2023-12-01T01:02:15.983 INFO:journalctl@ceph.mds.e.smithi093.stdout:-- Logs begin at Fri 2023-12-01 00:42:14 UTC. -- 2023-12-01T01:02:15.984 DEBUG:teuthology.orchestra.run.smithi093:mds.k> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.k.service 2023-12-01T01:02:16.015 INFO:journalctl@ceph.mds.h.smithi093.stdout:-- Logs begin at Fri 2023-12-01 00:42:14 UTC. -- 2023-12-01T01:02:16.016 DEBUG:teuthology.orchestra.run.smithi116:mds.c> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.c.service 2023-12-01T01:02:16.018 DEBUG:teuthology.orchestra.run.smithi116:mds.f> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.f.service 2023-12-01T01:02:16.040 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:15 smithi093 ceph-mon[103327]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:16.040 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:15 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:16.040 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:15 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:02:16.040 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:15 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:16.040 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:15 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:02:16.041 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:15 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:16.041 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:15 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:16.041 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:15 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:16.041 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:15 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:16.045 INFO:journalctl@ceph.mds.k.smithi093.stdout:-- Logs begin at Fri 2023-12-01 00:42:14 UTC. -- 2023-12-01T01:02:16.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:15 smithi026 ceph-mon[98801]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:16.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:15 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:16.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:15 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:02:16.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:15 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:16.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:15 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:02:16.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:15 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:16.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:15 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:16.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:15 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:16.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:15 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:16.047 INFO:journalctl@ceph.mds.c.smithi116.stdout:-- Logs begin at Fri 2023-12-01 00:41:59 UTC. -- 2023-12-01T01:02:16.048 DEBUG:teuthology.orchestra.run.smithi116:mds.i> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.i.service 2023-12-01T01:02:16.073 INFO:journalctl@ceph.mds.f.smithi116.stdout:-- Logs begin at Fri 2023-12-01 00:41:59 UTC. -- 2023-12-01T01:02:16.073 DEBUG:teuthology.orchestra.run.smithi116:mds.l> sudo journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.l.service 2023-12-01T01:02:16.099 INFO:journalctl@ceph.mds.i.smithi116.stdout:-- Logs begin at Fri 2023-12-01 00:41:59 UTC. -- 2023-12-01T01:02:16.100 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-12-01T01:02:16.100 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:02:16.126 INFO:journalctl@ceph.mds.l.smithi116.stdout:-- Logs begin at Fri 2023-12-01 00:41:59 UTC. -- 2023-12-01T01:02:16.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.238+0000 7f9add05a700 1 -- 172.21.15.26:0/2343280465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ad80ffc70 msgr2=0x7f9ad8100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:16.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.238+0000 7f9add05a700 1 --2- 172.21.15.26:0/2343280465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ad80ffc70 0x7f9ad8100090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80099c0 tx=0x7f9ac8009cd0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.238+0000 7f9add05a700 1 -- 172.21.15.26:0/2343280465 shutdown_connections 2023-12-01T01:02:16.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.238+0000 7f9add05a700 1 --2- 172.21.15.26:0/2343280465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad8101800 0x7f9ad81080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.238+0000 7f9add05a700 1 --2- 172.21.15.26:0/2343280465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ad80ffc70 0x7f9ad8100090 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.238+0000 7f9add05a700 1 --2- 172.21.15.26:0/2343280465 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ad8100e60 0x7f9ad81012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.238+0000 7f9add05a700 1 -- 172.21.15.26:0/2343280465 >> 172.21.15.26:0/2343280465 conn(0x7f9ad80fb1c0 msgr2=0x7f9ad80fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:16.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.238+0000 7f9add05a700 1 -- 172.21.15.26:0/2343280465 shutdown_connections 2023-12-01T01:02:16.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.238+0000 7f9add05a700 1 -- 172.21.15.26:0/2343280465 wait complete. 2023-12-01T01:02:16.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9add05a700 1 Processor -- start 2023-12-01T01:02:16.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9add05a700 1 -- start start 2023-12-01T01:02:16.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9add05a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad80ffc70 0x7f9ad8103c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:16.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9add05a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ad8100e60 0x7f9ad8102240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:16.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9add05a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ad8101800 0x7f9ad8102780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:16.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9add05a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8102f20 con 0x7f9ad8101800 2023-12-01T01:02:16.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9add05a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8103090 con 0x7f9ad8100e60 2023-12-01T01:02:16.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9add05a700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad81a0c00 con 0x7f9ad80ffc70 2023-12-01T01:02:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9ad759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ad8101800 0x7f9ad8102780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9ad759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ad8101800 0x7f9ad8102780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53182/0 (socket says 172.21.15.26:53182) 2023-12-01T01:02:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9ad759e700 1 -- 172.21.15.26:0/3088068050 learned_addr learned my addr 172.21.15.26:0/3088068050 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9ad6d9d700 1 --2- 172.21.15.26:0/3088068050 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad80ffc70 0x7f9ad8103c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9ad659c700 1 --2- 172.21.15.26:0/3088068050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ad8100e60 0x7f9ad8102240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9ad759e700 1 -- 172.21.15.26:0/3088068050 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad80ffc70 msgr2=0x7f9ad8103c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9ad759e700 1 --2- 172.21.15.26:0/3088068050 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad80ffc70 0x7f9ad8103c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9ad759e700 1 -- 172.21.15.26:0/3088068050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ad8100e60 msgr2=0x7f9ad8102240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9ad759e700 1 --2- 172.21.15.26:0/3088068050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ad8100e60 0x7f9ad8102240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9ad759e700 1 -- 172.21.15.26:0/3088068050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac80095f0 con 0x7f9ad8101800 2023-12-01T01:02:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.239+0000 7f9ad6d9d700 1 --2- 172.21.15.26:0/3088068050 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad80ffc70 0x7f9ad8103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:02:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.240+0000 7f9ad759e700 1 --2- 172.21.15.26:0/3088068050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ad8101800 0x7f9ad8102780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000ef30 tx=0x7f9ad000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.240+0000 7f9abffff700 1 -- 172.21.15.26:0/3088068050 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad0018070 con 0x7f9ad8101800 2023-12-01T01:02:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.240+0000 7f9add05a700 1 -- 172.21.15.26:0/3088068050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad81a0e80 con 0x7f9ad8101800 2023-12-01T01:02:16.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.240+0000 7f9abffff700 1 -- 172.21.15.26:0/3088068050 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9ad000f040 con 0x7f9ad8101800 2023-12-01T01:02:16.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.240+0000 7f9abffff700 1 -- 172.21.15.26:0/3088068050 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad000ce00 con 0x7f9ad8101800 2023-12-01T01:02:16.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.240+0000 7f9add05a700 1 -- 172.21.15.26:0/3088068050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad81a12b0 con 0x7f9ad8101800 2023-12-01T01:02:16.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.241+0000 7f9add05a700 1 -- 172.21.15.26:0/3088068050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad810b640 con 0x7f9ad8101800 2023-12-01T01:02:16.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.242+0000 7f9abffff700 1 -- 172.21.15.26:0/3088068050 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f9ad0003a00 con 0x7f9ad8101800 2023-12-01T01:02:16.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.242+0000 7f9abffff700 1 --2- 172.21.15.26:0/3088068050 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9ac00a0570 0x7f9ac00a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:16.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.243+0000 7f9abffff700 1 -- 172.21.15.26:0/3088068050 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9ad00cb0e0 con 0x7f9ad8101800 2023-12-01T01:02:16.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.243+0000 7f9ad6d9d700 1 --2- 172.21.15.26:0/3088068050 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9ac00a0570 0x7f9ac00a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:16.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.243+0000 7f9ad6d9d700 1 --2- 172.21.15.26:0/3088068050 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9ac00a0570 0x7f9ac00a2a30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800b580 tx=0x7f9ac8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:16.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.247+0000 7f9abffff700 1 -- 172.21.15.26:0/3088068050 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9ad00951b0 con 0x7f9ad8101800 2023-12-01T01:02:16.456 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.455+0000 7f9add05a700 1 -- 172.21.15.26:0/3088068050 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ad81a18c0 con 0x7f9ad8101800 2023-12-01T01:02:16.457 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.456+0000 7f9abffff700 1 -- 172.21.15.26:0/3088068050 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f9ad00987d0 con 0x7f9ad8101800 2023-12-01T01:02:16.457 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:16.458 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":77,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:06.752812+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:02:16.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.458+0000 7f9add05a700 1 -- 172.21.15.26:0/3088068050 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9ac00a0570 msgr2=0x7f9ac00a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:16.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.458+0000 7f9add05a700 1 --2- 172.21.15.26:0/3088068050 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9ac00a0570 0x7f9ac00a2a30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9ac800b580 tx=0x7f9ac8005fb0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.458+0000 7f9add05a700 1 -- 172.21.15.26:0/3088068050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ad8101800 msgr2=0x7f9ad8102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:16.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.458+0000 7f9add05a700 1 --2- 172.21.15.26:0/3088068050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ad8101800 0x7f9ad8102780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9ad000ef30 tx=0x7f9ad000c3a0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.458+0000 7f9add05a700 1 -- 172.21.15.26:0/3088068050 shutdown_connections 2023-12-01T01:02:16.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.458+0000 7f9add05a700 1 --2- 172.21.15.26:0/3088068050 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9ac00a0570 0x7f9ac00a2a30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.458+0000 7f9add05a700 1 --2- 172.21.15.26:0/3088068050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9ad8101800 0x7f9ad8102780 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.458+0000 7f9add05a700 1 --2- 172.21.15.26:0/3088068050 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9ad80ffc70 0x7f9ad8103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.458+0000 7f9add05a700 1 --2- 172.21.15.26:0/3088068050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9ad8100e60 0x7f9ad8102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.458+0000 7f9add05a700 1 -- 172.21.15.26:0/3088068050 >> 172.21.15.26:0/3088068050 conn(0x7f9ad80fb1c0 msgr2=0x7f9ad8067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:16.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.458+0000 7f9add05a700 1 -- 172.21.15.26:0/3088068050 shutdown_connections 2023-12-01T01:02:16.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.458+0000 7f9add05a700 1 -- 172.21.15.26:0/3088068050 wait complete. 2023-12-01T01:02:16.472 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T00:59:06.411348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T01:02:16.473 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T01:02:16.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.600+0000 7f76b37b9700 1 -- 172.21.15.26:0/3770330748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76ac102950 msgr2=0x7f76ac109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:16.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.600+0000 7f76b37b9700 1 --2- 172.21.15.26:0/3770330748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76ac102950 0x7f76ac109200 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f76a400b0d0 tx=0x7f76a400b3e0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.600+0000 7f76b37b9700 1 -- 172.21.15.26:0/3770330748 shutdown_connections 2023-12-01T01:02:16.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.600+0000 7f76b37b9700 1 --2- 172.21.15.26:0/3770330748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76ac102950 0x7f76ac109200 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.600+0000 7f76b37b9700 1 --2- 172.21.15.26:0/3770330748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f76ac100dc0 0x7f76ac1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.600+0000 7f76b37b9700 1 --2- 172.21.15.26:0/3770330748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76ac101fb0 0x7f76ac102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.600+0000 7f76b37b9700 1 -- 172.21.15.26:0/3770330748 >> 172.21.15.26:0/3770330748 conn(0x7f76ac0fc310 msgr2=0x7f76ac0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:16.605 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.600+0000 7f76b37b9700 1 -- 172.21.15.26:0/3770330748 shutdown_connections 2023-12-01T01:02:16.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.600+0000 7f76b37b9700 1 -- 172.21.15.26:0/3770330748 wait complete. 2023-12-01T01:02:16.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.601+0000 7f76b37b9700 1 Processor -- start 2023-12-01T01:02:16.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.601+0000 7f76b37b9700 1 -- start start 2023-12-01T01:02:16.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.601+0000 7f76b37b9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f76ac100dc0 0x7f76ac196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:16.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.601+0000 7f76b37b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76ac101fb0 0x7f76ac1971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:16.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.601+0000 7f76b37b9700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76ac102950 0x7f76ac19e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:16.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.601+0000 7f76b37b9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac19e7e0 con 0x7f76ac101fb0 2023-12-01T01:02:16.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.601+0000 7f76b37b9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac19e950 con 0x7f76ac100dc0 2023-12-01T01:02:16.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.601+0000 7f76b37b9700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac19eb10 con 0x7f76ac102950 2023-12-01T01:02:16.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.601+0000 7f76b0d54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76ac101fb0 0x7f76ac1971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:16.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.601+0000 7f76b0d54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76ac101fb0 0x7f76ac1971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53194/0 (socket says 172.21.15.26:53194) 2023-12-01T01:02:16.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.601+0000 7f76b0d54700 1 -- 172.21.15.26:0/719714929 learned_addr learned my addr 172.21.15.26:0/719714929 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:16.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.601+0000 7f76b1555700 1 --2- 172.21.15.26:0/719714929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f76ac100dc0 0x7f76ac196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:16.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.601+0000 7f76b1d56700 1 --2- 172.21.15.26:0/719714929 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76ac102950 0x7f76ac19e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:16.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.602+0000 7f76b0d54700 1 -- 172.21.15.26:0/719714929 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76ac102950 msgr2=0x7f76ac19e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:16.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.602+0000 7f76b0d54700 1 --2- 172.21.15.26:0/719714929 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76ac102950 0x7f76ac19e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.602+0000 7f76b0d54700 1 -- 172.21.15.26:0/719714929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f76ac100dc0 msgr2=0x7f76ac196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:16.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.602+0000 7f76b0d54700 1 --2- 172.21.15.26:0/719714929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f76ac100dc0 0x7f76ac196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.602+0000 7f76b0d54700 1 -- 172.21.15.26:0/719714929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a4009d00 con 0x7f76ac101fb0 2023-12-01T01:02:16.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.602+0000 7f76b0d54700 1 --2- 172.21.15.26:0/719714929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76ac101fb0 0x7f76ac1971b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f76a000d950 tx=0x7f76a000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:16.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.602+0000 7f769e7fc700 1 -- 172.21.15.26:0/719714929 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a000f890 con 0x7f76ac101fb0 2023-12-01T01:02:16.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.602+0000 7f769e7fc700 1 -- 172.21.15.26:0/719714929 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f76a0010460 con 0x7f76ac101fb0 2023-12-01T01:02:16.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.602+0000 7f76b37b9700 1 -- 172.21.15.26:0/719714929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ac19edf0 con 0x7f76ac101fb0 2023-12-01T01:02:16.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.602+0000 7f769e7fc700 1 -- 172.21.15.26:0/719714929 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a000e610 con 0x7f76ac101fb0 2023-12-01T01:02:16.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.602+0000 7f76b37b9700 1 -- 172.21.15.26:0/719714929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ac19f270 con 0x7f76ac101fb0 2023-12-01T01:02:16.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.603+0000 7f76b37b9700 1 -- 172.21.15.26:0/719714929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ac1082b0 con 0x7f76ac101fb0 2023-12-01T01:02:16.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.604+0000 7f769e7fc700 1 -- 172.21.15.26:0/719714929 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f76a0010960 con 0x7f76ac101fb0 2023-12-01T01:02:16.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.605+0000 7f769e7fc700 1 --2- 172.21.15.26:0/719714929 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f76980a0520 0x7f76980a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:16.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.605+0000 7f76b1555700 1 --2- 172.21.15.26:0/719714929 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f76980a0520 0x7f76980a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:16.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.605+0000 7f769e7fc700 1 -- 172.21.15.26:0/719714929 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f76a00cb2a0 con 0x7f76ac101fb0 2023-12-01T01:02:16.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.606+0000 7f76b1555700 1 --2- 172.21.15.26:0/719714929 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f76980a0520 0x7f76980a29e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f76ac197b40 tx=0x7f76a800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:16.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.609+0000 7f769e7fc700 1 -- 172.21.15.26:0/719714929 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f76a00952e0 con 0x7f76ac101fb0 2023-12-01T01:02:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.811+0000 7f76b37b9700 1 -- 172.21.15.26:0/719714929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76ac02ce00 con 0x7f76ac101fb0 2023-12-01T01:02:16.812 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.811+0000 7f769e7fc700 1 -- 172.21.15.26:0/719714929 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76a0098900 con 0x7f76ac101fb0 2023-12-01T01:02:16.812 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-12-01T01:02:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.814+0000 7f76b37b9700 1 -- 172.21.15.26:0/719714929 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f76980a0520 msgr2=0x7f76980a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.814+0000 7f76b37b9700 1 --2- 172.21.15.26:0/719714929 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f76980a0520 0x7f76980a29e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f76ac197b40 tx=0x7f76a800b410 comp rx=0 tx=0).stop 2023-12-01T01:02:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.814+0000 7f76b37b9700 1 -- 172.21.15.26:0/719714929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76ac101fb0 msgr2=0x7f76ac1971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.814+0000 7f76b37b9700 1 --2- 172.21.15.26:0/719714929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76ac101fb0 0x7f76ac1971b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f76a000d950 tx=0x7f76a000dc60 comp rx=0 tx=0).stop 2023-12-01T01:02:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.814+0000 7f76b37b9700 1 -- 172.21.15.26:0/719714929 shutdown_connections 2023-12-01T01:02:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.814+0000 7f76b37b9700 1 --2- 172.21.15.26:0/719714929 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f76980a0520 0x7f76980a29e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.814+0000 7f76b37b9700 1 --2- 172.21.15.26:0/719714929 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76ac102950 0x7f76ac19e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.814+0000 7f76b37b9700 1 --2- 172.21.15.26:0/719714929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f76ac100dc0 0x7f76ac196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.814+0000 7f76b37b9700 1 --2- 172.21.15.26:0/719714929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76ac101fb0 0x7f76ac1971b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.814+0000 7f76b37b9700 1 -- 172.21.15.26:0/719714929 >> 172.21.15.26:0/719714929 conn(0x7f76ac0fc310 msgr2=0x7f76ac1053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.814+0000 7f76b37b9700 1 -- 172.21.15.26:0/719714929 shutdown_connections 2023-12-01T01:02:16.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.814+0000 7f76b37b9700 1 -- 172.21.15.26:0/719714929 wait complete. 2023-12-01T01:02:16.827 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:02:16.889 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:16 smithi116 ceph-mon[103554]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi026=a;smithi026=d;smithi026=g;smithi026=j;smithi093=b;smithi093=e;smithi093=h;smithi093=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:02:16.890 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:16 smithi116 ceph-mon[103554]: Saving service mds.all spec with placement smithi026=a;smithi026=d;smithi026=g;smithi026=j;smithi093=b;smithi093=e;smithi093=h;smithi093=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l;count:12 2023-12-01T01:02:16.890 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:16 smithi116 ceph-mon[103554]: Deploying daemon mds.l on smithi116 2023-12-01T01:02:16.890 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:16 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3088068050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.950+0000 7f973caf8700 1 -- 172.21.15.26:0/2073958411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9738101800 msgr2=0x7f9738103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.950+0000 7f973caf8700 1 --2- 172.21.15.26:0/2073958411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9738101800 0x7f9738103bf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9728009990 tx=0x7f9728009ca0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.950+0000 7f973caf8700 1 -- 172.21.15.26:0/2073958411 shutdown_connections 2023-12-01T01:02:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.951+0000 7f973caf8700 1 --2- 172.21.15.26:0/2073958411 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9738106a60 0x7f9738108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.951+0000 7f973caf8700 1 --2- 172.21.15.26:0/2073958411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9738101800 0x7f9738103bf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.951+0000 7f973caf8700 1 --2- 172.21.15.26:0/2073958411 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9738104130 0x7f9738106520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.951+0000 7f973caf8700 1 -- 172.21.15.26:0/2073958411 >> 172.21.15.26:0/2073958411 conn(0x7f97380fb1b0 msgr2=0x7f97380fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.951+0000 7f973caf8700 1 -- 172.21.15.26:0/2073958411 shutdown_connections 2023-12-01T01:02:16.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.951+0000 7f973caf8700 1 -- 172.21.15.26:0/2073958411 wait complete. 2023-12-01T01:02:16.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.951+0000 7f973caf8700 1 Processor -- start 2023-12-01T01:02:16.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.951+0000 7f973caf8700 1 -- start start 2023-12-01T01:02:16.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.951+0000 7f973caf8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9738101800 0x7f9738196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:16.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.951+0000 7f973caf8700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9738104130 0x7f9738196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:16.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.951+0000 7f973caf8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9738106a60 0x7f973819e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:16.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.951+0000 7f973caf8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973819e5f0 con 0x7f9738106a60 2023-12-01T01:02:16.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f973caf8700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973819e730 con 0x7f9738101800 2023-12-01T01:02:16.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f973caf8700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973819e8c0 con 0x7f9738104130 2023-12-01T01:02:16.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f9736d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9738106a60 0x7f973819e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:16.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f9736d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9738106a60 0x7f973819e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53210/0 (socket says 172.21.15.26:53210) 2023-12-01T01:02:16.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f9736d9d700 1 -- 172.21.15.26:0/2353509316 learned_addr learned my addr 172.21.15.26:0/2353509316 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:16.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f9735d9b700 1 --2- 172.21.15.26:0/2353509316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9738104130 0x7f9738196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:16.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f973659c700 1 --2- 172.21.15.26:0/2353509316 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9738101800 0x7f9738196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:16.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f9736d9d700 1 -- 172.21.15.26:0/2353509316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9738104130 msgr2=0x7f9738196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:16.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f9736d9d700 1 --2- 172.21.15.26:0/2353509316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9738104130 0x7f9738196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f9736d9d700 1 -- 172.21.15.26:0/2353509316 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9738101800 msgr2=0x7f9738196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:16.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f9736d9d700 1 --2- 172.21.15.26:0/2353509316 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9738101800 0x7f9738196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:16.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f9736d9d700 1 -- 172.21.15.26:0/2353509316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97280095f0 con 0x7f9738106a60 2023-12-01T01:02:16.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f973659c700 1 --2- 172.21.15.26:0/2353509316 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9738101800 0x7f9738196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:02:16.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f9736d9d700 1 --2- 172.21.15.26:0/2353509316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9738106a60 0x7f973819e020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f973000ef30 tx=0x7f973000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:16.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f97277fe700 1 -- 172.21.15.26:0/2353509316 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730018070 con 0x7f9738106a60 2023-12-01T01:02:16.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f973caf8700 1 -- 172.21.15.26:0/2353509316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973819eb40 con 0x7f9738106a60 2023-12-01T01:02:16.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f97277fe700 1 -- 172.21.15.26:0/2353509316 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f973000f040 con 0x7f9738106a60 2023-12-01T01:02:16.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f97277fe700 1 -- 172.21.15.26:0/2353509316 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973000ce00 con 0x7f9738106a60 2023-12-01T01:02:16.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.952+0000 7f973caf8700 1 -- 172.21.15.26:0/2353509316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973819f050 con 0x7f9738106a60 2023-12-01T01:02:16.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.953+0000 7f973caf8700 1 -- 172.21.15.26:0/2353509316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97380fcd30 con 0x7f9738106a60 2023-12-01T01:02:16.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.955+0000 7f97277fe700 1 -- 172.21.15.26:0/2353509316 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f9730003a00 con 0x7f9738106a60 2023-12-01T01:02:16.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.956+0000 7f97277fe700 1 --2- 172.21.15.26:0/2353509316 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f97200a0570 0x7f97200a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:16.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.956+0000 7f973659c700 1 --2- 172.21.15.26:0/2353509316 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f97200a0570 0x7f97200a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:16.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.956+0000 7f97277fe700 1 -- 172.21.15.26:0/2353509316 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f97300cba80 con 0x7f9738106a60 2023-12-01T01:02:16.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.956+0000 7f973659c700 1 --2- 172.21.15.26:0/2353509316 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f97200a0570 0x7f97200a2a30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f972800b2e0 tx=0x7f9728000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:16.960 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:16.959+0000 7f97277fe700 1 -- 172.21.15.26:0/2353509316 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9730095b50 con 0x7f9738106a60 2023-12-01T01:02:17.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:16 smithi026 ceph-mon[98801]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi026=a;smithi026=d;smithi026=g;smithi026=j;smithi093=b;smithi093=e;smithi093=h;smithi093=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:02:17.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:16 smithi026 ceph-mon[98801]: Saving service mds.all spec with placement smithi026=a;smithi026=d;smithi026=g;smithi026=j;smithi093=b;smithi093=e;smithi093=h;smithi093=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l;count:12 2023-12-01T01:02:17.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:16 smithi026 ceph-mon[98801]: Deploying daemon mds.l on smithi116 2023-12-01T01:02:17.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:16 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3088068050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:17.180 INFO:journalctl@ceph.mds.l.smithi116.stdout:Dec 01 01:02:16 smithi116 systemd[1]: Starting Ceph mds.l for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:02:17.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:17.212+0000 7f973caf8700 1 -- 172.21.15.26:0/2353509316 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f973802cc70 con 0x7f9738106a60 2023-12-01T01:02:17.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:17.212+0000 7f97277fe700 1 -- 172.21.15.26:0/2353509316 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f9730099170 con 0x7f9738106a60 2023-12-01T01:02:17.213 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:17.213 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-12-01T01:02:17.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:16 smithi093 ceph-mon[103327]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi026=a;smithi026=d;smithi026=g;smithi026=j;smithi093=b;smithi093=e;smithi093=h;smithi093=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:02:17.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:16 smithi093 ceph-mon[103327]: Saving service mds.all spec with placement smithi026=a;smithi026=d;smithi026=g;smithi026=j;smithi093=b;smithi093=e;smithi093=h;smithi093=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l;count:12 2023-12-01T01:02:17.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:16 smithi093 ceph-mon[103327]: Deploying daemon mds.l on smithi116 2023-12-01T01:02:17.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:16 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3088068050' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:17.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:17.214+0000 7f973caf8700 1 -- 172.21.15.26:0/2353509316 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f97200a0570 msgr2=0x7f97200a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:17.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:17.214+0000 7f973caf8700 1 --2- 172.21.15.26:0/2353509316 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f97200a0570 0x7f97200a2a30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f972800b2e0 tx=0x7f9728000bc0 comp rx=0 tx=0).stop 2023-12-01T01:02:17.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:17.214+0000 7f973caf8700 1 -- 172.21.15.26:0/2353509316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9738106a60 msgr2=0x7f973819e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:17.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:17.214+0000 7f973caf8700 1 --2- 172.21.15.26:0/2353509316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9738106a60 0x7f973819e020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f973000ef30 tx=0x7f973000c3a0 comp rx=0 tx=0).stop 2023-12-01T01:02:17.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:17.214+0000 7f973caf8700 1 -- 172.21.15.26:0/2353509316 shutdown_connections 2023-12-01T01:02:17.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:17.214+0000 7f973caf8700 1 --2- 172.21.15.26:0/2353509316 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f97200a0570 0x7f97200a2a30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:17.214+0000 7f973caf8700 1 --2- 172.21.15.26:0/2353509316 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9738106a60 0x7f973819e020 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:17.214+0000 7f973caf8700 1 --2- 172.21.15.26:0/2353509316 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9738101800 0x7f9738196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:17.214+0000 7f973caf8700 1 --2- 172.21.15.26:0/2353509316 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9738104130 0x7f9738196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:17.214+0000 7f973caf8700 1 -- 172.21.15.26:0/2353509316 >> 172.21.15.26:0/2353509316 conn(0x7f97380fb1b0 msgr2=0x7f9738102470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:17.215+0000 7f973caf8700 1 -- 172.21.15.26:0/2353509316 shutdown_connections 2023-12-01T01:02:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:17.215+0000 7f973caf8700 1 -- 172.21.15.26:0/2353509316 wait complete. 2023-12-01T01:02:17.218 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 1 2023-12-01T01:02:17.474 INFO:journalctl@ceph.mds.l.smithi116.stdout:Dec 01 01:02:17 smithi116 podman[140943]: 2023-12-01T01:02:17.474 INFO:journalctl@ceph.mds.l.smithi116.stdout:Dec 01 01:02:17 smithi116 bash[140943]: 845bc277ee729422045a4d6d2e02b8e02399deb718629bbc418038df787dcc33 2023-12-01T01:02:17.474 INFO:journalctl@ceph.mds.l.smithi116.stdout:Dec 01 01:02:17 smithi116 ceph-mds[140983]: -- 172.21.15.116:0/1929653393 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d8a69311e0 con 0x55d8a6906c00 2023-12-01T01:02:17.474 INFO:journalctl@ceph.mds.l.smithi116.stdout:Dec 01 01:02:17 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-l[140959]: starting mds.l at 2023-12-01T01:02:17.783 INFO:journalctl@ceph.mds.l.smithi116.stdout:Dec 01 01:02:17 smithi116 systemd[1]: Started Ceph mds.l for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T01:02:18.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:17 smithi026 ceph-mon[98801]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:18.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:17 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/719714929' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:02:18.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:17 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2353509316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:18.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:17 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.116:6832/2596033158,v1:172.21.15.116:6833/2596033158] up:boot 2023-12-01T01:02:18.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:17 smithi026 ceph-mon[98801]: fsmap 1 up:standby 2023-12-01T01:02:18.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:17 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-01T01:02:18.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:17 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:18.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:17 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:18.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:17 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:18.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:17 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:18.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:17 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:18.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:17 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:18.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:17 smithi116 ceph-mon[103554]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:18.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:17 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/719714929' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:02:18.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:17 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2353509316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:18.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:17 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.116:6832/2596033158,v1:172.21.15.116:6833/2596033158] up:boot 2023-12-01T01:02:18.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:17 smithi116 ceph-mon[103554]: fsmap 1 up:standby 2023-12-01T01:02:18.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:17 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-01T01:02:18.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:17 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:18.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:17 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:18.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:17 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:18.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:17 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:18.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:17 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:18.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:17 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:18.183 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:17 smithi093 ceph-mon[103327]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:18.184 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:17 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/719714929' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:02:18.184 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:17 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2353509316' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:18.184 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:17 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.116:6832/2596033158,v1:172.21.15.116:6833/2596033158] up:boot 2023-12-01T01:02:18.184 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:17 smithi093 ceph-mon[103327]: fsmap 1 up:standby 2023-12-01T01:02:18.184 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:17 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-01T01:02:18.184 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:17 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:18.184 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:17 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:18.184 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:17 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:18.184 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:17 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:18.184 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:17 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:18.184 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:17 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:19.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:18 smithi026 ceph-mon[98801]: Deploying daemon mds.k on smithi093 2023-12-01T01:02:19.070 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:18 smithi093 ceph-mon[103327]: Deploying daemon mds.k on smithi093 2023-12-01T01:02:19.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:18 smithi116 ceph-mon[103554]: Deploying daemon mds.k on smithi093 2023-12-01T01:02:19.228 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:02:19.344 INFO:journalctl@ceph.mds.k.smithi093.stdout:Dec 01 01:02:19 smithi093 systemd[1]: Starting Ceph mds.k for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:02:19.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.368+0000 7f46525c1700 1 -- 172.21.15.26:0/1399354603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c101800 msgr2=0x7f464c1080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.368+0000 7f46525c1700 1 --2- 172.21.15.26:0/1399354603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c101800 0x7f464c1080b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f464400b0d0 tx=0x7f464400b3e0 comp rx=0 tx=0).stop 2023-12-01T01:02:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.368+0000 7f46525c1700 1 -- 172.21.15.26:0/1399354603 shutdown_connections 2023-12-01T01:02:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.368+0000 7f46525c1700 1 --2- 172.21.15.26:0/1399354603 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c101800 0x7f464c1080b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.368+0000 7f46525c1700 1 --2- 172.21.15.26:0/1399354603 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f464c0ffc70 0x7f464c100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.368+0000 7f46525c1700 1 --2- 172.21.15.26:0/1399354603 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f464c100e60 0x7f464c1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.368+0000 7f46525c1700 1 -- 172.21.15.26:0/1399354603 >> 172.21.15.26:0/1399354603 conn(0x7f464c0fb1c0 msgr2=0x7f464c0fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.368+0000 7f46525c1700 1 -- 172.21.15.26:0/1399354603 shutdown_connections 2023-12-01T01:02:19.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.368+0000 7f46525c1700 1 -- 172.21.15.26:0/1399354603 wait complete. 2023-12-01T01:02:19.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.369+0000 7f46525c1700 1 Processor -- start 2023-12-01T01:02:19.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.369+0000 7f46525c1700 1 -- start start 2023-12-01T01:02:19.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f46525c1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0ffc70 0x7f464c068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:19.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f46525c1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f464c100e60 0x7f464c19b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:19.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f46525c1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f464c101800 0x7f464c19df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:19.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f46525c1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c19e720 con 0x7f464c0ffc70 2023-12-01T01:02:19.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f46525c1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c19e890 con 0x7f464c101800 2023-12-01T01:02:19.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f46525c1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c19ea50 con 0x7f464c100e60 2023-12-01T01:02:19.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f464bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0ffc70 0x7f464c068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:19.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f464bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0ffc70 0x7f464c068ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53220/0 (socket says 172.21.15.26:53220) 2023-12-01T01:02:19.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f464bfff700 1 -- 172.21.15.26:0/233784924 learned_addr learned my addr 172.21.15.26:0/233784924 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:19.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f4650b5e700 1 --2- 172.21.15.26:0/233784924 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f464c101800 0x7f464c19df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:19.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f464b7fe700 1 --2- 172.21.15.26:0/233784924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f464c100e60 0x7f464c19b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:19.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f464bfff700 1 -- 172.21.15.26:0/233784924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f464c100e60 msgr2=0x7f464c19b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:19.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f464bfff700 1 --2- 172.21.15.26:0/233784924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f464c100e60 0x7f464c19b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:19.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f464bfff700 1 -- 172.21.15.26:0/233784924 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f464c101800 msgr2=0x7f464c19df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:19.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f464bfff700 1 --2- 172.21.15.26:0/233784924 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f464c101800 0x7f464c19df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:19.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f464bfff700 1 -- 172.21.15.26:0/233784924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c009520 con 0x7f464c0ffc70 2023-12-01T01:02:19.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f464b7fe700 1 --2- 172.21.15.26:0/233784924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f464c100e60 0x7f464c19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:02:19.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f464bfff700 1 --2- 172.21.15.26:0/233784924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0ffc70 0x7f464c068ac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f463c00ea50 tx=0x7f463c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:19.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f46497fa700 1 -- 172.21.15.26:0/233784924 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c00cbd0 con 0x7f464c0ffc70 2023-12-01T01:02:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f46525c1700 1 -- 172.21.15.26:0/233784924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4644009d00 con 0x7f464c0ffc70 2023-12-01T01:02:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f46497fa700 1 -- 172.21.15.26:0/233784924 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f463c00cd30 con 0x7f464c0ffc70 2023-12-01T01:02:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f46497fa700 1 -- 172.21.15.26:0/233784924 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c0187a0 con 0x7f464c0ffc70 2023-12-01T01:02:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.370+0000 7f46525c1700 1 -- 172.21.15.26:0/233784924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c19f0b0 con 0x7f464c0ffc70 2023-12-01T01:02:19.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.371+0000 7f46525c1700 1 -- 172.21.15.26:0/233784924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464c1070c0 con 0x7f464c0ffc70 2023-12-01T01:02:19.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.373+0000 7f46497fa700 1 -- 172.21.15.26:0/233784924 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f463c010430 con 0x7f464c0ffc70 2023-12-01T01:02:19.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.373+0000 7f46497fa700 1 --2- 172.21.15.26:0/233784924 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f46340a0570 0x7f46340a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:19.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.373+0000 7f464b7fe700 1 --2- 172.21.15.26:0/233784924 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f46340a0570 0x7f46340a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:19.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.373+0000 7f46497fa700 1 -- 172.21.15.26:0/233784924 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f463c014070 con 0x7f464c0ffc70 2023-12-01T01:02:19.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.374+0000 7f464b7fe700 1 --2- 172.21.15.26:0/233784924 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f46340a0570 0x7f46340a2a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4640005950 tx=0x7f46400058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:19.388 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.377+0000 7f46497fa700 1 -- 172.21.15.26:0/233784924 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f463c096000 con 0x7f464c0ffc70 2023-12-01T01:02:19.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.627+0000 7f46525c1700 1 -- 172.21.15.26:0/233784924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f464c02cf20 con 0x7f464c0ffc70 2023-12-01T01:02:19.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.627+0000 7f46497fa700 1 -- 172.21.15.26:0/233784924 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f463c099620 con 0x7f464c0ffc70 2023-12-01T01:02:19.629 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:19.629 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-12-01T01:02:19.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.630+0000 7f46525c1700 1 -- 172.21.15.26:0/233784924 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f46340a0570 msgr2=0x7f46340a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:19.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.630+0000 7f46525c1700 1 --2- 172.21.15.26:0/233784924 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f46340a0570 0x7f46340a2a30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4640005950 tx=0x7f46400058e0 comp rx=0 tx=0).stop 2023-12-01T01:02:19.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.630+0000 7f46525c1700 1 -- 172.21.15.26:0/233784924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0ffc70 msgr2=0x7f464c068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:19.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.630+0000 7f46525c1700 1 --2- 172.21.15.26:0/233784924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0ffc70 0x7f464c068ac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f463c00ea50 tx=0x7f463c00ed60 comp rx=0 tx=0).stop 2023-12-01T01:02:19.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.630+0000 7f46525c1700 1 -- 172.21.15.26:0/233784924 shutdown_connections 2023-12-01T01:02:19.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.630+0000 7f46525c1700 1 --2- 172.21.15.26:0/233784924 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f46340a0570 0x7f46340a2a30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:19.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.630+0000 7f46525c1700 1 --2- 172.21.15.26:0/233784924 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f464c101800 0x7f464c19df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:19.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.630+0000 7f46525c1700 1 --2- 172.21.15.26:0/233784924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f464c0ffc70 0x7f464c068ac0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:19.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.630+0000 7f46525c1700 1 --2- 172.21.15.26:0/233784924 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f464c100e60 0x7f464c19b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:19.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.630+0000 7f46525c1700 1 -- 172.21.15.26:0/233784924 >> 172.21.15.26:0/233784924 conn(0x7f464c0fb1c0 msgr2=0x7f464c104200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:19.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.630+0000 7f46525c1700 1 -- 172.21.15.26:0/233784924 shutdown_connections 2023-12-01T01:02:19.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:19.630+0000 7f46525c1700 1 -- 172.21.15.26:0/233784924 wait complete. 2023-12-01T01:02:19.632 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 2 2023-12-01T01:02:19.715 INFO:journalctl@ceph.mds.k.smithi093.stdout:Dec 01 01:02:19 smithi093 podman[138333]: 2023-12-01T01:02:19.715 INFO:journalctl@ceph.mds.k.smithi093.stdout:Dec 01 01:02:19 smithi093 bash[138333]: 0570ad131f7e72f4edc440461c89ce56e00fe229abcb48a2fde8cbc5a1faff8a 2023-12-01T01:02:19.715 INFO:journalctl@ceph.mds.k.smithi093.stdout:Dec 01 01:02:19 smithi093 systemd[1]: Started Ceph mds.k for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T01:02:19.715 INFO:journalctl@ceph.mds.k.smithi093.stdout:Dec 01 01:02:19 smithi093 ceph-mds[138373]: -- 172.21.15.93:0/798891347 <== mon.2 v2:172.21.15.93:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fd561ef1e0 con 0x55fd561c5000 2023-12-01T01:02:19.715 INFO:journalctl@ceph.mds.k.smithi093.stdout:Dec 01 01:02:19 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-k[138349]: starting mds.k at 2023-12-01T01:02:20.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:19 smithi026 ceph-mon[98801]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:20.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:19 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:20.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:19 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:20.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:19 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:20.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:19 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/233784924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:20.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:19 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:20.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:19 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:20.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:19 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:20.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:19 smithi116 ceph-mon[103554]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:20.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:19 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:20.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:19 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:20.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:19 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:20.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:19 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/233784924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:20.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:19 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:20.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:19 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:20.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:19 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:20.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:19 smithi093 ceph-mon[103327]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:20.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:19 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:20.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:19 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:20.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:19 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:20.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:19 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/233784924' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:20.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:19 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:20.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:19 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:20.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:19 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:21.048 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:20 smithi026 ceph-mon[98801]: Deploying daemon mds.j on smithi026 2023-12-01T01:02:21.048 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:20 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.93:6832/2298418641,v1:172.21.15.93:6833/2298418641] up:boot 2023-12-01T01:02:21.048 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:20 smithi026 ceph-mon[98801]: fsmap 2 up:standby 2023-12-01T01:02:21.048 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:20 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-01T01:02:21.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:20 smithi116 ceph-mon[103554]: Deploying daemon mds.j on smithi026 2023-12-01T01:02:21.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:20 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.93:6832/2298418641,v1:172.21.15.93:6833/2298418641] up:boot 2023-12-01T01:02:21.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:20 smithi116 ceph-mon[103554]: fsmap 2 up:standby 2023-12-01T01:02:21.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:20 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-01T01:02:21.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:20 smithi093 ceph-mon[103327]: Deploying daemon mds.j on smithi026 2023-12-01T01:02:21.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:20 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.93:6832/2298418641,v1:172.21.15.93:6833/2298418641] up:boot 2023-12-01T01:02:21.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:20 smithi093 ceph-mon[103327]: fsmap 2 up:standby 2023-12-01T01:02:21.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:20 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-01T01:02:21.394 INFO:journalctl@ceph.mds.j.smithi026.stdout:Dec 01 01:02:21 smithi026 systemd[1]: Starting Ceph mds.j for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:02:21.646 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:02:21.673 INFO:journalctl@ceph.mds.j.smithi026.stdout:Dec 01 01:02:21 smithi026 podman[148593]: 2023-12-01T01:02:21.673 INFO:journalctl@ceph.mds.j.smithi026.stdout:Dec 01 01:02:21 smithi026 bash[148593]: 0e14b5c6defdf5d39b66806e21d94d537578731a7c8f5f2bc8889d51d081b3b6 2023-12-01T01:02:21.674 INFO:journalctl@ceph.mds.j.smithi026.stdout:Dec 01 01:02:21 smithi026 ceph-mds[148633]: -- 172.21.15.26:0/1258329014 <== mon.0 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5585454e91e0 con 0x5585454be800 2023-12-01T01:02:21.674 INFO:journalctl@ceph.mds.j.smithi026.stdout:Dec 01 01:02:21 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-j[148609]: starting mds.j at 2023-12-01T01:02:21.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.783+0000 7f1f0ae35700 1 -- 172.21.15.26:0/570569128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f04106a50 msgr2=0x7f1f04108ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:21.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.783+0000 7f1f0ae35700 1 --2- 172.21.15.26:0/570569128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f04106a50 0x7f1f04108ec0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00b0a0 tx=0x7f1efc00b3b0 comp rx=0 tx=0).stop 2023-12-01T01:02:21.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.783+0000 7f1f0ae35700 1 -- 172.21.15.26:0/570569128 shutdown_connections 2023-12-01T01:02:21.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.783+0000 7f1f0ae35700 1 --2- 172.21.15.26:0/570569128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f04106a50 0x7f1f04108ec0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:21.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.783+0000 7f1f0ae35700 1 --2- 172.21.15.26:0/570569128 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f041017f0 0x7f1f04103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:21.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.783+0000 7f1f0ae35700 1 --2- 172.21.15.26:0/570569128 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f04104120 0x7f1f04106510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:21.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.783+0000 7f1f0ae35700 1 -- 172.21.15.26:0/570569128 >> 172.21.15.26:0/570569128 conn(0x7f1f040fb1c0 msgr2=0x7f1f040fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:21.786 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.783+0000 7f1f0ae35700 1 -- 172.21.15.26:0/570569128 shutdown_connections 2023-12-01T01:02:21.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.783+0000 7f1f0ae35700 1 -- 172.21.15.26:0/570569128 wait complete. 2023-12-01T01:02:21.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.783+0000 7f1f0ae35700 1 Processor -- start 2023-12-01T01:02:21.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f0ae35700 1 -- start start 2023-12-01T01:02:21.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f0ae35700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f041017f0 0x7f1f04196bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:21.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f0ae35700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f04104120 0x7f1f04197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:21.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f0ae35700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f04106a50 0x7f1f0419e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:21.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f0ae35700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0419e770 con 0x7f1f04104120 2023-12-01T01:02:21.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f0ae35700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0419e8b0 con 0x7f1f04106a50 2023-12-01T01:02:21.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f0ae35700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0419ea40 con 0x7f1f041017f0 2023-12-01T01:02:21.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f03fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f04104120 0x7f1f04197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:21.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f03fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f04104120 0x7f1f04197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53244/0 (socket says 172.21.15.26:53244) 2023-12-01T01:02:21.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f03fff700 1 -- 172.21.15.26:0/1028491463 learned_addr learned my addr 172.21.15.26:0/1028491463 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:21.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f08bd1700 1 --2- 172.21.15.26:0/1028491463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f041017f0 0x7f1f04196bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:21.787 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f093d2700 1 --2- 172.21.15.26:0/1028491463 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f04106a50 0x7f1f0419e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:21.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f03fff700 1 -- 172.21.15.26:0/1028491463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f041017f0 msgr2=0x7f1f04196bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:21.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f03fff700 1 --2- 172.21.15.26:0/1028491463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f041017f0 0x7f1f04196bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:21.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f03fff700 1 -- 172.21.15.26:0/1028491463 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f04106a50 msgr2=0x7f1f0419e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:21.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f03fff700 1 --2- 172.21.15.26:0/1028491463 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f04106a50 0x7f1f0419e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:21.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f03fff700 1 -- 172.21.15.26:0/1028491463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1efc009d00 con 0x7f1f04104120 2023-12-01T01:02:21.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f03fff700 1 --2- 172.21.15.26:0/1028491463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f04104120 0x7f1f04197130 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000c920 tx=0x7f1ef000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:21.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f01ffb700 1 -- 172.21.15.26:0/1028491463 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0004a30 con 0x7f1f04104120 2023-12-01T01:02:21.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f01ffb700 1 -- 172.21.15.26:0/1028491463 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1ef0005500 con 0x7f1f04104120 2023-12-01T01:02:21.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f0ae35700 1 -- 172.21.15.26:0/1028491463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f0419ed20 con 0x7f1f04104120 2023-12-01T01:02:21.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.784+0000 7f1f01ffb700 1 -- 172.21.15.26:0/1028491463 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef0007cd0 con 0x7f1f04104120 2023-12-01T01:02:21.788 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.785+0000 7f1f0ae35700 1 -- 172.21.15.26:0/1028491463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0419f1d0 con 0x7f1f04104120 2023-12-01T01:02:21.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.786+0000 7f1f0ae35700 1 -- 172.21.15.26:0/1028491463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f040fcd40 con 0x7f1f04104120 2023-12-01T01:02:21.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.786+0000 7f1f01ffb700 1 -- 172.21.15.26:0/1028491463 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f1ef0005000 con 0x7f1f04104120 2023-12-01T01:02:21.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.787+0000 7f1f01ffb700 1 --2- 172.21.15.26:0/1028491463 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ef40a0570 0x7f1ef40a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:21.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.787+0000 7f1f01ffb700 1 -- 172.21.15.26:0/1028491463 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1ef00cb340 con 0x7f1f04104120 2023-12-01T01:02:21.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.787+0000 7f1f08bd1700 1 --2- 172.21.15.26:0/1028491463 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ef40a0570 0x7f1ef40a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:21.790 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.788+0000 7f1f08bd1700 1 --2- 172.21.15.26:0/1028491463 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ef40a0570 0x7f1ef40a2a30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8007c60 tx=0x7f1ef80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:21.792 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:21.792+0000 7f1f01ffb700 1 -- 172.21.15.26:0/1028491463 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1ef0095380 con 0x7f1f04104120 2023-12-01T01:02:22.046 INFO:journalctl@ceph.mds.j.smithi026.stdout:Dec 01 01:02:21 smithi026 systemd[1]: Started Ceph mds.j for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T01:02:22.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:21 smithi026 ceph-mon[98801]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:22.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:22.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:21 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:22.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:22.049+0000 7f1f0ae35700 1 -- 172.21.15.26:0/1028491463 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f0402ce40 con 0x7f1f04104120 2023-12-01T01:02:22.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:22.049+0000 7f1f01ffb700 1 -- 172.21.15.26:0/1028491463 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2774 (secure 0 0 0) 0x7f1ef001daf0 con 0x7f1f04104120 2023-12-01T01:02:22.050 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:22.051 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-01T01:02:22.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:22.052+0000 7f1f0ae35700 1 -- 172.21.15.26:0/1028491463 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ef40a0570 msgr2=0x7f1ef40a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:22.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:22.052+0000 7f1f0ae35700 1 --2- 172.21.15.26:0/1028491463 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ef40a0570 0x7f1ef40a2a30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8007c60 tx=0x7f1ef80073d0 comp rx=0 tx=0).stop 2023-12-01T01:02:22.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:22.052+0000 7f1f0ae35700 1 -- 172.21.15.26:0/1028491463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f04104120 msgr2=0x7f1f04197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:22.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:22.052+0000 7f1f0ae35700 1 --2- 172.21.15.26:0/1028491463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f04104120 0x7f1f04197130 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000c920 tx=0x7f1ef000cc30 comp rx=0 tx=0).stop 2023-12-01T01:02:22.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:22.052+0000 7f1f0ae35700 1 -- 172.21.15.26:0/1028491463 shutdown_connections 2023-12-01T01:02:22.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:22.052+0000 7f1f0ae35700 1 --2- 172.21.15.26:0/1028491463 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ef40a0570 0x7f1ef40a2a30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:22.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:22.052+0000 7f1f0ae35700 1 --2- 172.21.15.26:0/1028491463 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f04106a50 0x7f1f0419e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:22.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:22.052+0000 7f1f0ae35700 1 --2- 172.21.15.26:0/1028491463 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f041017f0 0x7f1f04196bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:22.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:22.052+0000 7f1f0ae35700 1 --2- 172.21.15.26:0/1028491463 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f04104120 0x7f1f04197130 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:22.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:22.052+0000 7f1f0ae35700 1 -- 172.21.15.26:0/1028491463 >> 172.21.15.26:0/1028491463 conn(0x7f1f040fb1c0 msgr2=0x7f1f04102460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:22.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:22.052+0000 7f1f0ae35700 1 -- 172.21.15.26:0/1028491463 shutdown_connections 2023-12-01T01:02:22.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:22.052+0000 7f1f0ae35700 1 -- 172.21.15.26:0/1028491463 wait complete. 2023-12-01T01:02:22.055 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 4 2023-12-01T01:02:22.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:21 smithi116 ceph-mon[103554]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:22.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:22.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:21 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:22.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:21 smithi093 ceph-mon[103327]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:22.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:22.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:21 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:23.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:22 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.26:6834/3831137706,v1:172.21.15.26:6835/3831137706] up:boot 2023-12-01T01:02:23.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:22 smithi026 ceph-mon[98801]: fsmap 3 up:standby 2023-12-01T01:02:23.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:22 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-01T01:02:23.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:22 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:23.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:22 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:23.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:22 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:23.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:22 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:23.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:22 smithi026 ceph-mon[98801]: Deploying daemon mds.d on smithi026 2023-12-01T01:02:23.048 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:22 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1028491463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:23.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:22 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.26:6834/3831137706,v1:172.21.15.26:6835/3831137706] up:boot 2023-12-01T01:02:23.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:22 smithi116 ceph-mon[103554]: fsmap 3 up:standby 2023-12-01T01:02:23.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:22 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-01T01:02:23.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:22 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:23.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:22 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:23.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:22 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:23.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:22 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:23.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:22 smithi116 ceph-mon[103554]: Deploying daemon mds.d on smithi026 2023-12-01T01:02:23.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:22 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1028491463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:23.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:22 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.26:6834/3831137706,v1:172.21.15.26:6835/3831137706] up:boot 2023-12-01T01:02:23.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:22 smithi093 ceph-mon[103327]: fsmap 3 up:standby 2023-12-01T01:02:23.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:22 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-01T01:02:23.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:22 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:23.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:22 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:23.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:22 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:23.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:22 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:23.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:22 smithi093 ceph-mon[103327]: Deploying daemon mds.d on smithi026 2023-12-01T01:02:23.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:22 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1028491463' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:23.298 INFO:journalctl@ceph.mds.d.smithi026.stdout:Dec 01 01:02:23 smithi026 systemd[1]: Starting Ceph mds.d for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:02:23.878 INFO:journalctl@ceph.mds.d.smithi026.stdout:Dec 01 01:02:23 smithi026 podman[148982]: 2023-12-01T01:02:23.878 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:23 smithi026 ceph-mon[98801]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:24.066 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:02:24.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:23 smithi116 ceph-mon[103554]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:24.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.196+0000 7fe685d11700 1 -- 172.21.15.26:0/1164088539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6801023a0 msgr2=0x7fe6801027c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:24.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.196+0000 7fe685d11700 1 --2- 172.21.15.26:0/1164088539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6801023a0 0x7fe6801027c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe668009990 tx=0x7fe668009ca0 comp rx=0 tx=0).stop 2023-12-01T01:02:24.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.196+0000 7fe685d11700 1 -- 172.21.15.26:0/1164088539 shutdown_connections 2023-12-01T01:02:24.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.196+0000 7fe685d11700 1 --2- 172.21.15.26:0/1164088539 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6800ff7b0 0x7fe680109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:24.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.196+0000 7fe685d11700 1 --2- 172.21.15.26:0/1164088539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6801023a0 0x7fe6801027c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:24.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.196+0000 7fe685d11700 1 --2- 172.21.15.26:0/1164088539 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6800fee10 0x7fe6800ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:24.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.196+0000 7fe685d11700 1 -- 172.21.15.26:0/1164088539 >> 172.21.15.26:0/1164088539 conn(0x7fe6800fa950 msgr2=0x7fe6800fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:24.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.196+0000 7fe685d11700 1 -- 172.21.15.26:0/1164088539 shutdown_connections 2023-12-01T01:02:24.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.196+0000 7fe685d11700 1 -- 172.21.15.26:0/1164088539 wait complete. 2023-12-01T01:02:24.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.197+0000 7fe685d11700 1 Processor -- start 2023-12-01T01:02:24.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.197+0000 7fe685d11700 1 -- start start 2023-12-01T01:02:24.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.197+0000 7fe685d11700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6800fee10 0x7fe680196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:24.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.197+0000 7fe685d11700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6800ff7b0 0x7fe680197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:24.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.197+0000 7fe685d11700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6801023a0 0x7fe68019e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe685d11700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68019e6a0 con 0x7fe6800fee10 2023-12-01T01:02:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe685d11700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68019e7e0 con 0x7fe6800ff7b0 2023-12-01T01:02:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe685d11700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68019e970 con 0x7fe6801023a0 2023-12-01T01:02:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe67f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6800fee10 0x7fe680196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe67f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6800fee10 0x7fe680196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53270/0 (socket says 172.21.15.26:53270) 2023-12-01T01:02:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe67f7fe700 1 -- 172.21.15.26:0/88065242 learned_addr learned my addr 172.21.15.26:0/88065242 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe67effd700 1 --2- 172.21.15.26:0/88065242 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6800ff7b0 0x7fe680197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe67ffff700 1 --2- 172.21.15.26:0/88065242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6801023a0 0x7fe68019e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe67f7fe700 1 -- 172.21.15.26:0/88065242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6801023a0 msgr2=0x7fe68019e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe67f7fe700 1 --2- 172.21.15.26:0/88065242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6801023a0 0x7fe68019e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe67f7fe700 1 -- 172.21.15.26:0/88065242 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6800ff7b0 msgr2=0x7fe680197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe67f7fe700 1 --2- 172.21.15.26:0/88065242 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6800ff7b0 0x7fe680197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe67f7fe700 1 -- 172.21.15.26:0/88065242 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680095f0 con 0x7fe6800fee10 2023-12-01T01:02:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe67ffff700 1 --2- 172.21.15.26:0/88065242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6801023a0 0x7fe68019e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:02:24.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe67f7fe700 1 --2- 172.21.15.26:0/88065242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6800fee10 0x7fe680196b20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe66800b5c0 tx=0x7fe66800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:24.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe67cff9700 1 -- 172.21.15.26:0/88065242 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66801d070 con 0x7fe6800fee10 2023-12-01T01:02:24.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe67cff9700 1 -- 172.21.15.26:0/88065242 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe668004cb0 con 0x7fe6800fee10 2023-12-01T01:02:24.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe685d11700 1 -- 172.21.15.26:0/88065242 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68019ebf0 con 0x7fe6800fee10 2023-12-01T01:02:24.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe67cff9700 1 -- 172.21.15.26:0/88065242 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe668005490 con 0x7fe6800fee10 2023-12-01T01:02:24.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.198+0000 7fe685d11700 1 -- 172.21.15.26:0/88065242 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68019f010 con 0x7fe6800fee10 2023-12-01T01:02:24.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.199+0000 7fe685d11700 1 -- 172.21.15.26:0/88065242 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6801084e0 con 0x7fe6800fee10 2023-12-01T01:02:24.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.200+0000 7fe67cff9700 1 -- 172.21.15.26:0/88065242 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fe6680047d0 con 0x7fe6800fee10 2023-12-01T01:02:24.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.201+0000 7fe67cff9700 1 --2- 172.21.15.26:0/88065242 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe66c0a0570 0x7fe66c0a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:24.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.201+0000 7fe67effd700 1 --2- 172.21.15.26:0/88065242 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe66c0a0570 0x7fe66c0a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:24.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.201+0000 7fe67cff9700 1 -- 172.21.15.26:0/88065242 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe6680cc910 con 0x7fe6800fee10 2023-12-01T01:02:24.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.202+0000 7fe67effd700 1 --2- 172.21.15.26:0/88065242 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe66c0a0570 0x7fe66c0a2a30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe670007c60 tx=0x7fe6700073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:24.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.205+0000 7fe67cff9700 1 -- 172.21.15.26:0/88065242 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe6680969e0 con 0x7fe6800fee10 2023-12-01T01:02:24.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:23 smithi093 ceph-mon[103327]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:24.296 INFO:journalctl@ceph.mds.d.smithi026.stdout:Dec 01 01:02:23 smithi026 bash[148982]: ddf87e2e4d7256417f6e0909f978d5e9247693dd144ed23698ea65439b21d44d 2023-12-01T01:02:24.296 INFO:journalctl@ceph.mds.d.smithi026.stdout:Dec 01 01:02:23 smithi026 ceph-mds[149023]: -- 172.21.15.26:0/621491513 <== mon.0 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562d723f31e0 con 0x562d723c9000 2023-12-01T01:02:24.296 INFO:journalctl@ceph.mds.d.smithi026.stdout:Dec 01 01:02:23 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-d[148998]: starting mds.d at 2023-12-01T01:02:24.296 INFO:journalctl@ceph.mds.d.smithi026.stdout:Dec 01 01:02:23 smithi026 systemd[1]: Started Ceph mds.d for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T01:02:24.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.460+0000 7fe685d11700 1 -- 172.21.15.26:0/88065242 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe68002cc70 con 0x7fe6800fee10 2023-12-01T01:02:24.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.460+0000 7fe67cff9700 1 -- 172.21.15.26:0/88065242 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2774 (secure 0 0 0) 0x7fe66809a000 con 0x7fe6800fee10 2023-12-01T01:02:24.461 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:24.461 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-01T01:02:24.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.462+0000 7fe685d11700 1 -- 172.21.15.26:0/88065242 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe66c0a0570 msgr2=0x7fe66c0a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:24.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.462+0000 7fe685d11700 1 --2- 172.21.15.26:0/88065242 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe66c0a0570 0x7fe66c0a2a30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe670007c60 tx=0x7fe6700073d0 comp rx=0 tx=0).stop 2023-12-01T01:02:24.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.462+0000 7fe685d11700 1 -- 172.21.15.26:0/88065242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6800fee10 msgr2=0x7fe680196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:24.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.462+0000 7fe685d11700 1 --2- 172.21.15.26:0/88065242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6800fee10 0x7fe680196b20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe66800b5c0 tx=0x7fe66800f690 comp rx=0 tx=0).stop 2023-12-01T01:02:24.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.462+0000 7fe685d11700 1 -- 172.21.15.26:0/88065242 shutdown_connections 2023-12-01T01:02:24.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.462+0000 7fe685d11700 1 --2- 172.21.15.26:0/88065242 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe66c0a0570 0x7fe66c0a2a30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:24.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.462+0000 7fe685d11700 1 --2- 172.21.15.26:0/88065242 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6801023a0 0x7fe68019e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:24.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.462+0000 7fe685d11700 1 --2- 172.21.15.26:0/88065242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe6800fee10 0x7fe680196b20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:24.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.462+0000 7fe685d11700 1 --2- 172.21.15.26:0/88065242 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6800ff7b0 0x7fe680197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:24.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.462+0000 7fe685d11700 1 -- 172.21.15.26:0/88065242 >> 172.21.15.26:0/88065242 conn(0x7fe6800fa950 msgr2=0x7fe680105620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:24.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.463+0000 7fe685d11700 1 -- 172.21.15.26:0/88065242 shutdown_connections 2023-12-01T01:02:24.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:24.463+0000 7fe685d11700 1 -- 172.21.15.26:0/88065242 wait complete. 2023-12-01T01:02:24.465 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 4 2023-12-01T01:02:25.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:25.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:25.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:24 smithi093 ceph-mon[103327]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:25.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:25.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:25.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:25.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:25.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:24 smithi093 ceph-mon[103327]: Deploying daemon mds.e on smithi093 2023-12-01T01:02:25.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:24 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/88065242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:25.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:24 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.26:6836/1419946505,v1:172.21.15.26:6837/1419946505] up:boot 2023-12-01T01:02:25.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:24 smithi093 ceph-mon[103327]: fsmap 4 up:standby 2023-12-01T01:02:25.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:24 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-01T01:02:25.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:25.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:25.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:24 smithi026 ceph-mon[98801]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:25.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:25.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:25.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:25.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:25.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:24 smithi026 ceph-mon[98801]: Deploying daemon mds.e on smithi093 2023-12-01T01:02:25.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:24 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/88065242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:25.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:24 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.26:6836/1419946505,v1:172.21.15.26:6837/1419946505] up:boot 2023-12-01T01:02:25.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:24 smithi026 ceph-mon[98801]: fsmap 4 up:standby 2023-12-01T01:02:25.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:24 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-01T01:02:25.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:25.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:25.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:24 smithi116 ceph-mon[103554]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:25.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:25.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:25.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:25.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:25.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:24 smithi116 ceph-mon[103554]: Deploying daemon mds.e on smithi093 2023-12-01T01:02:25.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:24 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/88065242' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:25.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:24 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.26:6836/1419946505,v1:172.21.15.26:6837/1419946505] up:boot 2023-12-01T01:02:25.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:24 smithi116 ceph-mon[103554]: fsmap 4 up:standby 2023-12-01T01:02:25.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:24 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-01T01:02:25.715 INFO:journalctl@ceph.mds.e.smithi093.stdout:Dec 01 01:02:25 smithi093 systemd[1]: Starting Ceph mds.e for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:02:26.056 INFO:journalctl@ceph.mds.e.smithi093.stdout:Dec 01 01:02:25 smithi093 podman[138680]: 2023-12-01T01:02:26.056 INFO:journalctl@ceph.mds.e.smithi093.stdout:Dec 01 01:02:26 smithi093 bash[138680]: b8c8b7103ffe575da4e90fb169eca8e6a12100e5a74f5c2c6604828381a32115 2023-12-01T01:02:26.057 INFO:journalctl@ceph.mds.e.smithi093.stdout:Dec 01 01:02:26 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-e[138696]: starting mds.e at 2023-12-01T01:02:26.465 INFO:journalctl@ceph.mds.e.smithi093.stdout:Dec 01 01:02:26 smithi093 systemd[1]: Started Ceph mds.e for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T01:02:26.476 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:02:26.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.617+0000 7f1eb90ae700 1 -- 172.21.15.26:0/1141163596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1eb4100ea0 msgr2=0x7f1eb4101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:26.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.617+0000 7f1eb90ae700 1 --2- 172.21.15.26:0/1141163596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1eb4100ea0 0x7f1eb4101300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c0099c0 tx=0x7f1e9c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:02:26.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.617+0000 7f1eb90ae700 1 -- 172.21.15.26:0/1141163596 shutdown_connections 2023-12-01T01:02:26.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.617+0000 7f1eb90ae700 1 --2- 172.21.15.26:0/1141163596 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1eb4101840 0x7f1eb41080f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:26.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.617+0000 7f1eb90ae700 1 --2- 172.21.15.26:0/1141163596 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1eb40ffcb0 0x7f1eb41000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:26.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.617+0000 7f1eb90ae700 1 --2- 172.21.15.26:0/1141163596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1eb4100ea0 0x7f1eb4101300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:26.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.617+0000 7f1eb90ae700 1 -- 172.21.15.26:0/1141163596 >> 172.21.15.26:0/1141163596 conn(0x7f1eb40fb220 msgr2=0x7f1eb40fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:26.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.617+0000 7f1eb90ae700 1 -- 172.21.15.26:0/1141163596 shutdown_connections 2023-12-01T01:02:26.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.617+0000 7f1eb90ae700 1 -- 172.21.15.26:0/1141163596 wait complete. 2023-12-01T01:02:26.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.618+0000 7f1eb90ae700 1 Processor -- start 2023-12-01T01:02:26.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.618+0000 7f1eb90ae700 1 -- start start 2023-12-01T01:02:26.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.618+0000 7f1eb90ae700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1eb40ffcb0 0x7f1eb4069a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:26.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.618+0000 7f1eb90ae700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1eb4100ea0 0x7f1eb419b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:26.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.618+0000 7f1eb90ae700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1eb4101840 0x7f1eb419de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:26.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.618+0000 7f1eb90ae700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb419e610 con 0x7f1eb40ffcb0 2023-12-01T01:02:26.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.618+0000 7f1eb90ae700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb419e780 con 0x7f1eb4100ea0 2023-12-01T01:02:26.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.618+0000 7f1eb90ae700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb419e940 con 0x7f1eb4101840 2023-12-01T01:02:26.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.618+0000 7f1eb2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1eb40ffcb0 0x7f1eb4069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:26.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.618+0000 7f1eb2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1eb40ffcb0 0x7f1eb4069a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53286/0 (socket says 172.21.15.26:53286) 2023-12-01T01:02:26.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.618+0000 7f1eb2d9d700 1 -- 172.21.15.26:0/3934994995 learned_addr learned my addr 172.21.15.26:0/3934994995 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.618+0000 7f1eb259c700 1 --2- 172.21.15.26:0/3934994995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1eb4100ea0 0x7f1eb419b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.618+0000 7f1eb359e700 1 --2- 172.21.15.26:0/3934994995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1eb4101840 0x7f1eb419de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.619+0000 7f1eb2d9d700 1 -- 172.21.15.26:0/3934994995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1eb4101840 msgr2=0x7f1eb419de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.619+0000 7f1eb2d9d700 1 --2- 172.21.15.26:0/3934994995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1eb4101840 0x7f1eb419de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.619+0000 7f1eb2d9d700 1 -- 172.21.15.26:0/3934994995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1eb4100ea0 msgr2=0x7f1eb419b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.619+0000 7f1eb2d9d700 1 --2- 172.21.15.26:0/3934994995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1eb4100ea0 0x7f1eb419b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.619+0000 7f1eb2d9d700 1 -- 172.21.15.26:0/3934994995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9c0095f0 con 0x7f1eb40ffcb0 2023-12-01T01:02:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.619+0000 7f1eb359e700 1 --2- 172.21.15.26:0/3934994995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1eb4101840 0x7f1eb419de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:02:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.619+0000 7f1eb259c700 1 --2- 172.21.15.26:0/3934994995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1eb4100ea0 0x7f1eb419b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:02:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.619+0000 7f1eb2d9d700 1 --2- 172.21.15.26:0/3934994995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1eb40ffcb0 0x7f1eb4069a90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400e970 tx=0x7f1ea400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.619+0000 7f1eabfff700 1 -- 172.21.15.26:0/3934994995 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4009790 con 0x7f1eb40ffcb0 2023-12-01T01:02:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.619+0000 7f1eabfff700 1 -- 172.21.15.26:0/3934994995 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1ea400ccc0 con 0x7f1eb40ffcb0 2023-12-01T01:02:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.619+0000 7f1eb90ae700 1 -- 172.21.15.26:0/3934994995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb419ec20 con 0x7f1eb40ffcb0 2023-12-01T01:02:26.624 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.619+0000 7f1eabfff700 1 -- 172.21.15.26:0/3934994995 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4003d80 con 0x7f1eb40ffcb0 2023-12-01T01:02:26.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.619+0000 7f1eb90ae700 1 -- 172.21.15.26:0/3934994995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb419f130 con 0x7f1eb40ffcb0 2023-12-01T01:02:26.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.620+0000 7f1eb90ae700 1 -- 172.21.15.26:0/3934994995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb4106b40 con 0x7f1eb40ffcb0 2023-12-01T01:02:26.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.621+0000 7f1eabfff700 1 -- 172.21.15.26:0/3934994995 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f1ea400c7e0 con 0x7f1eb40ffcb0 2023-12-01T01:02:26.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.622+0000 7f1eabfff700 1 --2- 172.21.15.26:0/3934994995 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ea00a0570 0x7f1ea00a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:26.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.622+0000 7f1eb259c700 1 --2- 172.21.15.26:0/3934994995 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ea00a0570 0x7f1ea00a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:26.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.622+0000 7f1eabfff700 1 -- 172.21.15.26:0/3934994995 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1ea4014070 con 0x7f1eb40ffcb0 2023-12-01T01:02:26.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.622+0000 7f1eb259c700 1 --2- 172.21.15.26:0/3934994995 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ea00a0570 0x7f1ea00a2a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c000c00 tx=0x7f1e9c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:26.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.626+0000 7f1eabfff700 1 -- 172.21.15.26:0/3934994995 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1ea40956c0 con 0x7f1eb40ffcb0 2023-12-01T01:02:26.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.878+0000 7f1eb90ae700 1 -- 172.21.15.26:0/3934994995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1eb402cc70 con 0x7f1eb40ffcb0 2023-12-01T01:02:26.879 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.878+0000 7f1eabfff700 1 -- 172.21.15.26:0/3934994995 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3531 (secure 0 0 0) 0x7f1ea4098ce0 con 0x7f1eb40ffcb0 2023-12-01T01:02:26.880 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:26.880 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-01T01:02:26.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.880+0000 7f1eb90ae700 1 -- 172.21.15.26:0/3934994995 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ea00a0570 msgr2=0x7f1ea00a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:26.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.880+0000 7f1eb90ae700 1 --2- 172.21.15.26:0/3934994995 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ea00a0570 0x7f1ea00a2a30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1e9c000c00 tx=0x7f1e9c005fb0 comp rx=0 tx=0).stop 2023-12-01T01:02:26.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.880+0000 7f1eb90ae700 1 -- 172.21.15.26:0/3934994995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1eb40ffcb0 msgr2=0x7f1eb4069a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:26.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.880+0000 7f1eb90ae700 1 --2- 172.21.15.26:0/3934994995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1eb40ffcb0 0x7f1eb4069a90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1ea400e970 tx=0x7f1ea400ec80 comp rx=0 tx=0).stop 2023-12-01T01:02:26.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.880+0000 7f1eb90ae700 1 -- 172.21.15.26:0/3934994995 shutdown_connections 2023-12-01T01:02:26.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.880+0000 7f1eb90ae700 1 --2- 172.21.15.26:0/3934994995 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1ea00a0570 0x7f1ea00a2a30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:26.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.880+0000 7f1eb90ae700 1 --2- 172.21.15.26:0/3934994995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1eb4101840 0x7f1eb419de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:26.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.880+0000 7f1eb90ae700 1 --2- 172.21.15.26:0/3934994995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1eb40ffcb0 0x7f1eb4069a90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:26.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.880+0000 7f1eb90ae700 1 --2- 172.21.15.26:0/3934994995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1eb4100ea0 0x7f1eb419b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:26.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.880+0000 7f1eb90ae700 1 -- 172.21.15.26:0/3934994995 >> 172.21.15.26:0/3934994995 conn(0x7f1eb40fb220 msgr2=0x7f1eb40fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:26.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.881+0000 7f1eb90ae700 1 -- 172.21.15.26:0/3934994995 shutdown_connections 2023-12-01T01:02:26.882 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:26.881+0000 7f1eb90ae700 1 -- 172.21.15.26:0/3934994995 wait complete. 2023-12-01T01:02:26.883 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 5 2023-12-01T01:02:27.249 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:27 smithi116 ceph-mon[103554]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:27.249 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:27 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:27.249 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:27 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:27.249 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:27 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:27.249 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:27 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:27.250 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:27 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:27.250 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:27 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:27.250 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:27 smithi116 ceph-mon[103554]: Deploying daemon mds.f on smithi116 2023-12-01T01:02:27.250 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:27 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3934994995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:27.250 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:27 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.93:6834/2286202770,v1:172.21.15.93:6835/2286202770] up:boot 2023-12-01T01:02:27.250 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:27 smithi116 ceph-mon[103554]: fsmap 5 up:standby 2023-12-01T01:02:27.250 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:27 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-01T01:02:27.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:27 smithi026 ceph-mon[98801]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:27.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:27 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:27.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:27 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:27.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:27 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:27.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:27 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:27.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:27 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:27.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:27 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:27.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:27 smithi026 ceph-mon[98801]: Deploying daemon mds.f on smithi116 2023-12-01T01:02:27.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:27 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3934994995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:27.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:27 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.93:6834/2286202770,v1:172.21.15.93:6835/2286202770] up:boot 2023-12-01T01:02:27.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:27 smithi026 ceph-mon[98801]: fsmap 5 up:standby 2023-12-01T01:02:27.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:27 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-01T01:02:27.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:27 smithi093 ceph-mon[103327]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:27.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:27 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:27.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:27 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:27.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:27 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:27.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:27 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:27.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:27 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:27.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:27 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:27.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:27 smithi093 ceph-mon[103327]: Deploying daemon mds.f on smithi116 2023-12-01T01:02:27.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:27 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3934994995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:27.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:27 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.93:6834/2286202770,v1:172.21.15.93:6835/2286202770] up:boot 2023-12-01T01:02:27.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:27 smithi093 ceph-mon[103327]: fsmap 5 up:standby 2023-12-01T01:02:27.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:27 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-01T01:02:27.680 INFO:journalctl@ceph.mds.f.smithi116.stdout:Dec 01 01:02:27 smithi116 systemd[1]: Starting Ceph mds.f for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:02:28.023 INFO:journalctl@ceph.mds.f.smithi116.stdout:Dec 01 01:02:27 smithi116 podman[141285]: 2023-12-01T01:02:28.430 INFO:journalctl@ceph.mds.f.smithi116.stdout:Dec 01 01:02:28 smithi116 ceph-mds[141325]: -- 172.21.15.116:0/3035264150 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5638356471e0 con 0x56383561cc00 2023-12-01T01:02:28.430 INFO:journalctl@ceph.mds.f.smithi116.stdout:Dec 01 01:02:28 smithi116 bash[141285]: 4c49480c5e9ab5f329a79cebc05af746f832508c0dd556c31297512216d9d5b8 2023-12-01T01:02:28.430 INFO:journalctl@ceph.mds.f.smithi116.stdout:Dec 01 01:02:28 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-f[141301]: starting mds.f at 2023-12-01T01:02:28.430 INFO:journalctl@ceph.mds.f.smithi116.stdout:Dec 01 01:02:28 smithi116 systemd[1]: Started Ceph mds.f for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T01:02:28.894 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:02:29.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.033+0000 7f90c3791700 1 -- 172.21.15.26:0/1026898898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90bc101840 msgr2=0x7f90bc1080f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:29.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.033+0000 7f90c3791700 1 --2- 172.21.15.26:0/1026898898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90bc101840 0x7f90bc1080f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f90b400b0d0 tx=0x7f90b400b3e0 comp rx=0 tx=0).stop 2023-12-01T01:02:29.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.034+0000 7f90c3791700 1 -- 172.21.15.26:0/1026898898 shutdown_connections 2023-12-01T01:02:29.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.034+0000 7f90c3791700 1 --2- 172.21.15.26:0/1026898898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90bc101840 0x7f90bc1080f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:29.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.034+0000 7f90c3791700 1 --2- 172.21.15.26:0/1026898898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90bc0ffcb0 0x7f90bc1000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:29.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.034+0000 7f90c3791700 1 --2- 172.21.15.26:0/1026898898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90bc100ea0 0x7f90bc101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:29.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.034+0000 7f90c3791700 1 -- 172.21.15.26:0/1026898898 >> 172.21.15.26:0/1026898898 conn(0x7f90bc0fb220 msgr2=0x7f90bc0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:29.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.034+0000 7f90c3791700 1 -- 172.21.15.26:0/1026898898 shutdown_connections 2023-12-01T01:02:29.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.034+0000 7f90c3791700 1 -- 172.21.15.26:0/1026898898 wait complete. 2023-12-01T01:02:29.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.034+0000 7f90c3791700 1 Processor -- start 2023-12-01T01:02:29.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.034+0000 7f90c3791700 1 -- start start 2023-12-01T01:02:29.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c3791700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90bc0ffcb0 0x7f90bc069a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:29.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c3791700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90bc100ea0 0x7f90bc19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:29.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c3791700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90bc101840 0x7f90bc19df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:29.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c3791700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc19e730 con 0x7f90bc101840 2023-12-01T01:02:29.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c3791700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc19e8a0 con 0x7f90bc0ffcb0 2023-12-01T01:02:29.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c3791700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90bc19ea60 con 0x7f90bc100ea0 2023-12-01T01:02:29.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c1d2e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90bc101840 0x7f90bc19df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:29.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c1d2e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90bc101840 0x7f90bc19df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53304/0 (socket says 172.21.15.26:53304) 2023-12-01T01:02:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c1d2e700 1 -- 172.21.15.26:0/4289711092 learned_addr learned my addr 172.21.15.26:0/4289711092 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c0d2c700 1 --2- 172.21.15.26:0/4289711092 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90bc100ea0 0x7f90bc19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c152d700 1 --2- 172.21.15.26:0/4289711092 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90bc0ffcb0 0x7f90bc069a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c1d2e700 1 -- 172.21.15.26:0/4289711092 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90bc100ea0 msgr2=0x7f90bc19b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c1d2e700 1 --2- 172.21.15.26:0/4289711092 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90bc100ea0 0x7f90bc19b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c1d2e700 1 -- 172.21.15.26:0/4289711092 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90bc0ffcb0 msgr2=0x7f90bc069a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c1d2e700 1 --2- 172.21.15.26:0/4289711092 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90bc0ffcb0 0x7f90bc069a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c1d2e700 1 -- 172.21.15.26:0/4289711092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b4009d00 con 0x7f90bc101840 2023-12-01T01:02:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c1d2e700 1 --2- 172.21.15.26:0/4289711092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90bc101840 0x7f90bc19df90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009fd0 tx=0x7f90b4009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90b27fc700 1 -- 172.21.15.26:0/4289711092 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b400e040 con 0x7f90bc101840 2023-12-01T01:02:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90b27fc700 1 -- 172.21.15.26:0/4289711092 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f90b4004e60 con 0x7f90bc101840 2023-12-01T01:02:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c3791700 1 -- 172.21.15.26:0/4289711092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90bc19ece0 con 0x7f90bc101840 2023-12-01T01:02:29.039 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90b27fc700 1 -- 172.21.15.26:0/4289711092 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b401b790 con 0x7f90bc101840 2023-12-01T01:02:29.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.035+0000 7f90c3791700 1 -- 172.21.15.26:0/4289711092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90bc195940 con 0x7f90bc101840 2023-12-01T01:02:29.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.037+0000 7f90c3791700 1 -- 172.21.15.26:0/4289711092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90bc10b660 con 0x7f90bc101840 2023-12-01T01:02:29.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.038+0000 7f90b27fc700 1 -- 172.21.15.26:0/4289711092 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f90b401d480 con 0x7f90bc101840 2023-12-01T01:02:29.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.038+0000 7f90b27fc700 1 --2- 172.21.15.26:0/4289711092 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f90a80a0570 0x7f90a80a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:29.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.038+0000 7f90b27fc700 1 -- 172.21.15.26:0/4289711092 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f90b40cd570 con 0x7f90bc101840 2023-12-01T01:02:29.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.038+0000 7f90c152d700 1 --2- 172.21.15.26:0/4289711092 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f90a80a0570 0x7f90a80a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:29.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.039+0000 7f90c152d700 1 --2- 172.21.15.26:0/4289711092 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f90a80a0570 0x7f90a80a2a30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f90bc100d00 tx=0x7f90b8007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:29.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.042+0000 7f90b27fc700 1 -- 172.21.15.26:0/4289711092 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f90b40600e0 con 0x7f90bc101840 2023-12-01T01:02:29.265 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:29 smithi116 ceph-mon[103554]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:29.265 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:29 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.116:6834/1591216017,v1:172.21.15.116:6835/1591216017] up:boot 2023-12-01T01:02:29.265 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:29 smithi116 ceph-mon[103554]: fsmap 6 up:standby 2023-12-01T01:02:29.265 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:29 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-01T01:02:29.265 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:29 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:29.265 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:29 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:29.265 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:29 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:29.265 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:29 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:29.266 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:29 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:29.266 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:29 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:29.266 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:29 smithi116 ceph-mon[103554]: Deploying daemon mds.c on smithi116 2023-12-01T01:02:29.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.291+0000 7f90c3791700 1 -- 172.21.15.26:0/4289711092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90bc10b850 con 0x7f90bc101840 2023-12-01T01:02:29.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.292+0000 7f90b27fc700 1 -- 172.21.15.26:0/4289711092 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5048 (secure 0 0 0) 0x7f90b4097640 con 0x7f90bc101840 2023-12-01T01:02:29.293 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:29.293 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2023-12-01T01:02:29.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.294+0000 7f90c3791700 1 -- 172.21.15.26:0/4289711092 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f90a80a0570 msgr2=0x7f90a80a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:29.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.294+0000 7f90c3791700 1 --2- 172.21.15.26:0/4289711092 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f90a80a0570 0x7f90a80a2a30 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f90bc100d00 tx=0x7f90b8007400 comp rx=0 tx=0).stop 2023-12-01T01:02:29.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.294+0000 7f90c3791700 1 -- 172.21.15.26:0/4289711092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90bc101840 msgr2=0x7f90bc19df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:29.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.294+0000 7f90c3791700 1 --2- 172.21.15.26:0/4289711092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90bc101840 0x7f90bc19df90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f90b4009fd0 tx=0x7f90b4009300 comp rx=0 tx=0).stop 2023-12-01T01:02:29.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.294+0000 7f90c3791700 1 -- 172.21.15.26:0/4289711092 shutdown_connections 2023-12-01T01:02:29.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.294+0000 7f90c3791700 1 --2- 172.21.15.26:0/4289711092 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f90a80a0570 0x7f90a80a2a30 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:29.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.294+0000 7f90c3791700 1 --2- 172.21.15.26:0/4289711092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90bc101840 0x7f90bc19df90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:29.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.294+0000 7f90c3791700 1 --2- 172.21.15.26:0/4289711092 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90bc0ffcb0 0x7f90bc069a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:29.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.294+0000 7f90c3791700 1 --2- 172.21.15.26:0/4289711092 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f90bc100ea0 0x7f90bc19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:29.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.294+0000 7f90c3791700 1 -- 172.21.15.26:0/4289711092 >> 172.21.15.26:0/4289711092 conn(0x7f90bc0fb220 msgr2=0x7f90bc0fd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:29.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.294+0000 7f90c3791700 1 -- 172.21.15.26:0/4289711092 shutdown_connections 2023-12-01T01:02:29.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:29.294+0000 7f90c3791700 1 -- 172.21.15.26:0/4289711092 wait complete. 2023-12-01T01:02:29.296 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 7 2023-12-01T01:02:29.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:29 smithi026 ceph-mon[98801]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:29.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:29 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.116:6834/1591216017,v1:172.21.15.116:6835/1591216017] up:boot 2023-12-01T01:02:29.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:29 smithi026 ceph-mon[98801]: fsmap 6 up:standby 2023-12-01T01:02:29.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:29 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-01T01:02:29.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:29 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:29.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:29 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:29.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:29 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:29.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:29 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:29.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:29 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:29.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:29 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:29.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:29 smithi026 ceph-mon[98801]: Deploying daemon mds.c on smithi116 2023-12-01T01:02:29.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:29 smithi093 ceph-mon[103327]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:29.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:29 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.116:6834/1591216017,v1:172.21.15.116:6835/1591216017] up:boot 2023-12-01T01:02:29.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:29 smithi093 ceph-mon[103327]: fsmap 6 up:standby 2023-12-01T01:02:29.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:29 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-01T01:02:29.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:29 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:29.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:29 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:29.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:29 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:29.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:29 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:29.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:29 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:29.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:29 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:29.466 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:29 smithi093 ceph-mon[103327]: Deploying daemon mds.c on smithi116 2023-12-01T01:02:29.681 INFO:journalctl@ceph.mds.c.smithi116.stdout:Dec 01 01:02:29 smithi116 systemd[1]: Starting Ceph mds.c for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:02:30.089 INFO:journalctl@ceph.mds.c.smithi116.stdout:Dec 01 01:02:29 smithi116 podman[141625]: 2023-12-01T01:02:30.089 INFO:journalctl@ceph.mds.c.smithi116.stdout:Dec 01 01:02:30 smithi116 ceph-mds[141666]: -- 172.21.15.116:0/3768674503 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55fe75f0b1e0 con 0x55fe75ee0800 2023-12-01T01:02:30.090 INFO:journalctl@ceph.mds.c.smithi116.stdout:Dec 01 01:02:30 smithi116 bash[141625]: e90813430685e536b22081e2b64406b56010d0b438215e82495108131176f9c1 2023-12-01T01:02:30.090 INFO:journalctl@ceph.mds.c.smithi116.stdout:Dec 01 01:02:30 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-c[141641]: starting mds.c at 2023-12-01T01:02:30.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:30 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/4289711092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:30.430 INFO:journalctl@ceph.mds.c.smithi116.stdout:Dec 01 01:02:30 smithi116 systemd[1]: Started Ceph mds.c for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T01:02:30.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:30 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/4289711092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:30.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:30 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/4289711092' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:31.309 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:02:31.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:31 smithi116 ceph-mon[103554]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:31.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:31 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:31.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:31 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:31.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:31 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:31.431 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:31 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:31.432 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:31 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:31.432 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:31 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:31.432 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:31 smithi116 ceph-mon[103554]: Deploying daemon mds.h on smithi093 2023-12-01T01:02:31.432 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:31 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.116:6836/1714302836,v1:172.21.15.116:6837/1714302836] up:boot 2023-12-01T01:02:31.432 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:31 smithi116 ceph-mon[103554]: fsmap 7 up:standby 2023-12-01T01:02:31.432 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:31 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-01T01:02:31.444 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:31 smithi093 ceph-mon[103327]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:31.444 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:31 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:31.445 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:31 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:31.445 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:31 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:31.445 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:31 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:31.445 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:31 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:31.445 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:31 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:31.445 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:31 smithi093 ceph-mon[103327]: Deploying daemon mds.h on smithi093 2023-12-01T01:02:31.445 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:31 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.116:6836/1714302836,v1:172.21.15.116:6837/1714302836] up:boot 2023-12-01T01:02:31.445 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:31 smithi093 ceph-mon[103327]: fsmap 7 up:standby 2023-12-01T01:02:31.445 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:31 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-01T01:02:31.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.448+0000 7f586da14700 1 -- 172.21.15.26:0/801319334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5868104160 msgr2=0x7f5868106550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:31.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.448+0000 7f586da14700 1 --2- 172.21.15.26:0/801319334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5868104160 0x7f5868106550 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f585c009990 tx=0x7f585c009ca0 comp rx=0 tx=0).stop 2023-12-01T01:02:31.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.448+0000 7f586da14700 1 -- 172.21.15.26:0/801319334 shutdown_connections 2023-12-01T01:02:31.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.448+0000 7f586da14700 1 --2- 172.21.15.26:0/801319334 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5868106a90 0x7f5868108ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:31.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.448+0000 7f586da14700 1 --2- 172.21.15.26:0/801319334 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5868101830 0x7f5868103c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:31.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.448+0000 7f586da14700 1 --2- 172.21.15.26:0/801319334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5868104160 0x7f5868106550 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:31.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.448+0000 7f586da14700 1 -- 172.21.15.26:0/801319334 >> 172.21.15.26:0/801319334 conn(0x7f58680fb1c0 msgr2=0x7f58680fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:31.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.448+0000 7f586da14700 1 -- 172.21.15.26:0/801319334 shutdown_connections 2023-12-01T01:02:31.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.448+0000 7f586da14700 1 -- 172.21.15.26:0/801319334 wait complete. 2023-12-01T01:02:31.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.449+0000 7f586da14700 1 Processor -- start 2023-12-01T01:02:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.449+0000 7f586da14700 1 -- start start 2023-12-01T01:02:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.449+0000 7f586da14700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5868101830 0x7f5868196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.449+0000 7f586da14700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5868104160 0x7f5868197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.449+0000 7f586da14700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5868106a90 0x7f586819e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.449+0000 7f586da14700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586819e680 con 0x7f5868106a90 2023-12-01T01:02:31.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.449+0000 7f586da14700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586819e7c0 con 0x7f5868104160 2023-12-01T01:02:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.449+0000 7f586da14700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586819e950 con 0x7f5868101830 2023-12-01T01:02:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.449+0000 7f58677fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5868106a90 0x7f586819e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.449+0000 7f58667fc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5868104160 0x7f5868197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.449+0000 7f58677fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5868106a90 0x7f586819e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53318/0 (socket says 172.21.15.26:53318) 2023-12-01T01:02:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.449+0000 7f58667fc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5868104160 0x7f5868197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:44054/0 (socket says 172.21.15.26:44054) 2023-12-01T01:02:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.449+0000 7f58677fe700 1 -- 172.21.15.26:0/31240551 learned_addr learned my addr 172.21.15.26:0/31240551 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.450+0000 7f5866ffd700 1 --2- 172.21.15.26:0/31240551 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5868101830 0x7f5868196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.450+0000 7f58677fe700 1 -- 172.21.15.26:0/31240551 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5868101830 msgr2=0x7f5868196b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.450+0000 7f58677fe700 1 --2- 172.21.15.26:0/31240551 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5868101830 0x7f5868196b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.450+0000 7f58677fe700 1 -- 172.21.15.26:0/31240551 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5868104160 msgr2=0x7f5868197040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.450+0000 7f58677fe700 1 --2- 172.21.15.26:0/31240551 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5868104160 0x7f5868197040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.450+0000 7f58677fe700 1 -- 172.21.15.26:0/31240551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c0095f0 con 0x7f5868106a90 2023-12-01T01:02:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.450+0000 7f58667fc700 1 --2- 172.21.15.26:0/31240551 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5868104160 0x7f5868197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:02:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.450+0000 7f58677fe700 1 --2- 172.21.15.26:0/31240551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5868106a90 0x7f586819e0b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5860007ee0 tx=0x7f586000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:31.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.450+0000 7f586ca12700 1 -- 172.21.15.26:0/31240551 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586000ddd0 con 0x7f5868106a90 2023-12-01T01:02:31.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.450+0000 7f586ca12700 1 -- 172.21.15.26:0/31240551 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f586000f040 con 0x7f5868106a90 2023-12-01T01:02:31.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.450+0000 7f586da14700 1 -- 172.21.15.26:0/31240551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f586819ec30 con 0x7f5868106a90 2023-12-01T01:02:31.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.450+0000 7f586ca12700 1 -- 172.21.15.26:0/31240551 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5860015400 con 0x7f5868106a90 2023-12-01T01:02:31.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.450+0000 7f586da14700 1 -- 172.21.15.26:0/31240551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586819f0f0 con 0x7f5868106a90 2023-12-01T01:02:31.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.451+0000 7f586da14700 1 -- 172.21.15.26:0/31240551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58680fcd40 con 0x7f5868106a90 2023-12-01T01:02:31.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.452+0000 7f586ca12700 1 -- 172.21.15.26:0/31240551 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f5860003a00 con 0x7f5868106a90 2023-12-01T01:02:31.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.453+0000 7f586ca12700 1 --2- 172.21.15.26:0/31240551 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f58500a0570 0x7f58500a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:31.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.453+0000 7f5866ffd700 1 --2- 172.21.15.26:0/31240551 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f58500a0570 0x7f58500a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:31.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.453+0000 7f586ca12700 1 -- 172.21.15.26:0/31240551 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f58600cada0 con 0x7f5868106a90 2023-12-01T01:02:31.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.453+0000 7f5866ffd700 1 --2- 172.21.15.26:0/31240551 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f58500a0570 0x7f58500a2a30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5858009bf0 tx=0x7f5858009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:31.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.457+0000 7f586ca12700 1 -- 172.21.15.26:0/31240551 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5860094de0 con 0x7f5868106a90 2023-12-01T01:02:31.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:31 smithi026 ceph-mon[98801]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:31.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:31 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:31.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:31 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:31.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:31 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:31.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:31 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:31.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:31 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:31.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:31 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:31.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:31 smithi026 ceph-mon[98801]: Deploying daemon mds.h on smithi093 2023-12-01T01:02:31.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:31 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.116:6836/1714302836,v1:172.21.15.116:6837/1714302836] up:boot 2023-12-01T01:02:31.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:31 smithi026 ceph-mon[98801]: fsmap 7 up:standby 2023-12-01T01:02:31.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:31 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-01T01:02:31.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.707+0000 7f586da14700 1 -- 172.21.15.26:0/31240551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f586802cc70 con 0x7f5868106a90 2023-12-01T01:02:31.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.707+0000 7f586ca12700 1 -- 172.21.15.26:0/31240551 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5808 (secure 0 0 0) 0x7f5860098400 con 0x7f5868106a90 2023-12-01T01:02:31.708 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:31.709 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8}],"filesystems":[]} 2023-12-01T01:02:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.709+0000 7f586da14700 1 -- 172.21.15.26:0/31240551 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f58500a0570 msgr2=0x7f58500a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.709+0000 7f586da14700 1 --2- 172.21.15.26:0/31240551 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f58500a0570 0x7f58500a2a30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5858009bf0 tx=0x7f5858009260 comp rx=0 tx=0).stop 2023-12-01T01:02:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.709+0000 7f586da14700 1 -- 172.21.15.26:0/31240551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5868106a90 msgr2=0x7f586819e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.709+0000 7f586da14700 1 --2- 172.21.15.26:0/31240551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5868106a90 0x7f586819e0b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5860007ee0 tx=0x7f586000d3b0 comp rx=0 tx=0).stop 2023-12-01T01:02:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.710+0000 7f586da14700 1 -- 172.21.15.26:0/31240551 shutdown_connections 2023-12-01T01:02:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.710+0000 7f586da14700 1 --2- 172.21.15.26:0/31240551 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f58500a0570 0x7f58500a2a30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.710+0000 7f586da14700 1 --2- 172.21.15.26:0/31240551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5868106a90 0x7f586819e0b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.710+0000 7f586da14700 1 --2- 172.21.15.26:0/31240551 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5868101830 0x7f5868196b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.710+0000 7f586da14700 1 --2- 172.21.15.26:0/31240551 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5868104160 0x7f5868197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.710+0000 7f586da14700 1 -- 172.21.15.26:0/31240551 >> 172.21.15.26:0/31240551 conn(0x7f58680fb1c0 msgr2=0x7f58681024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.710+0000 7f586da14700 1 -- 172.21.15.26:0/31240551 shutdown_connections 2023-12-01T01:02:31.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:31.710+0000 7f586da14700 1 -- 172.21.15.26:0/31240551 wait complete. 2023-12-01T01:02:31.712 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2023-12-01T01:02:31.715 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:02:31 smithi093 systemd[1]: Starting Ceph mds.h for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:02:32.241 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:02:31 smithi093 podman[139021]: 2023-12-01T01:02:32.242 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:32 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/31240551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:32.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:32 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/31240551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:32.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:32 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/31240551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:32.715 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:02:32 smithi093 bash[139021]: daed2d4db20bc79e95d6f485653e557ebfff665cad2b401825c6d2fd4c175470 2023-12-01T01:02:32.715 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:02:32 smithi093 ceph-mds[139061]: -- 172.21.15.93:0/456028934 <== mon.2 v2:172.21.15.93:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558bc6c571e0 con 0x558bc6c2d000 2023-12-01T01:02:32.715 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:02:32 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: starting mds.h at 2023-12-01T01:02:32.715 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:02:32 smithi093 systemd[1]: Started Ceph mds.h for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T01:02:33.616 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:33 smithi116 ceph-mon[103554]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:33.616 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:33 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:33.616 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:33 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:33.616 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:33 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:33.616 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:33 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:33.616 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:33 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:33.616 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:33 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:33.616 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:33 smithi116 ceph-mon[103554]: Deploying daemon mds.i on smithi116 2023-12-01T01:02:33.616 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:33 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.93:6836/3333520218,v1:172.21.15.93:6837/3333520218] up:boot 2023-12-01T01:02:33.616 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:33 smithi116 ceph-mon[103554]: fsmap 8 up:standby 2023-12-01T01:02:33.616 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:33 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-01T01:02:33.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:33 smithi093 ceph-mon[103327]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:33.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:33 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:33.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:33 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:33.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:33 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:33.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:33 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:33.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:33 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:33.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:33 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:33.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:33 smithi093 ceph-mon[103327]: Deploying daemon mds.i on smithi116 2023-12-01T01:02:33.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:33 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.93:6836/3333520218,v1:172.21.15.93:6837/3333520218] up:boot 2023-12-01T01:02:33.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:33 smithi093 ceph-mon[103327]: fsmap 8 up:standby 2023-12-01T01:02:33.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:33 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-01T01:02:33.724 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:02:33.754 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:33 smithi026 ceph-mon[98801]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:33.754 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:33 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:33.754 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:33 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:33.754 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:33 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:33.754 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:33 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:33.755 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:33 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:33.755 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:33 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:33.755 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:33 smithi026 ceph-mon[98801]: Deploying daemon mds.i on smithi116 2023-12-01T01:02:33.755 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:33 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.93:6836/3333520218,v1:172.21.15.93:6837/3333520218] up:boot 2023-12-01T01:02:33.755 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:33 smithi026 ceph-mon[98801]: fsmap 8 up:standby 2023-12-01T01:02:33.755 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:33 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-01T01:02:33.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.862+0000 7f4d0c1c3700 1 -- 172.21.15.26:0/2930406506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d04101fa0 msgr2=0x7f4d04102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.862+0000 7f4d0c1c3700 1 --2- 172.21.15.26:0/2930406506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d04101fa0 0x7f4d04102400 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4d000099c0 tx=0x7f4d00009cd0 comp rx=0 tx=0).stop 2023-12-01T01:02:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.862+0000 7f4d0c1c3700 1 -- 172.21.15.26:0/2930406506 shutdown_connections 2023-12-01T01:02:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.862+0000 7f4d0c1c3700 1 --2- 172.21.15.26:0/2930406506 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d04102940 0x7f4d041091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.862+0000 7f4d0c1c3700 1 --2- 172.21.15.26:0/2930406506 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d04100db0 0x7f4d041011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.862+0000 7f4d0c1c3700 1 --2- 172.21.15.26:0/2930406506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d04101fa0 0x7f4d04102400 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.862+0000 7f4d0c1c3700 1 -- 172.21.15.26:0/2930406506 >> 172.21.15.26:0/2930406506 conn(0x7f4d040fc340 msgr2=0x7f4d040fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.863+0000 7f4d0c1c3700 1 -- 172.21.15.26:0/2930406506 shutdown_connections 2023-12-01T01:02:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.863+0000 7f4d0c1c3700 1 -- 172.21.15.26:0/2930406506 wait complete. 2023-12-01T01:02:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.863+0000 7f4d0c1c3700 1 Processor -- start 2023-12-01T01:02:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.863+0000 7f4d0c1c3700 1 -- start start 2023-12-01T01:02:33.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.863+0000 7f4d0c1c3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d04100db0 0x7f4d04074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.863+0000 7f4d0c1c3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d04101fa0 0x7f4d04073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.863+0000 7f4d0c1c3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d04102940 0x7f4d040736c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.863+0000 7f4d0c1c3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d04073e60 con 0x7f4d04102940 2023-12-01T01:02:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.863+0000 7f4d0c1c3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d04073fd0 con 0x7f4d04101fa0 2023-12-01T01:02:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.863+0000 7f4d0c1c3700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d041a0b70 con 0x7f4d04100db0 2023-12-01T01:02:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.863+0000 7f4d0a760700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d04102940 0x7f4d040736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4d0a760700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d04102940 0x7f4d040736c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53332/0 (socket says 172.21.15.26:53332) 2023-12-01T01:02:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4d09f5f700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d04100db0 0x7f4d04074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4d0a760700 1 -- 172.21.15.26:0/1229430854 learned_addr learned my addr 172.21.15.26:0/1229430854 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4d0975e700 1 --2- 172.21.15.26:0/1229430854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d04101fa0 0x7f4d04073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4d0a760700 1 -- 172.21.15.26:0/1229430854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d04100db0 msgr2=0x7f4d04074b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4d0a760700 1 --2- 172.21.15.26:0/1229430854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d04100db0 0x7f4d04074b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4d0a760700 1 -- 172.21.15.26:0/1229430854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d04101fa0 msgr2=0x7f4d04073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4d0a760700 1 --2- 172.21.15.26:0/1229430854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d04101fa0 0x7f4d04073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:33.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4d0a760700 1 -- 172.21.15.26:0/1229430854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d000095f0 con 0x7f4d04102940 2023-12-01T01:02:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4d0975e700 1 --2- 172.21.15.26:0/1229430854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d04101fa0 0x7f4d04073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:02:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4d09f5f700 1 --2- 172.21.15.26:0/1229430854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d04100db0 0x7f4d04074b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:02:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4d0a760700 1 --2- 172.21.15.26:0/1229430854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d04102940 0x7f4d040736c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00ef30 tx=0x7f4cfc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4cf6ffd700 1 -- 172.21.15.26:0/1229430854 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc018070 con 0x7f4d04102940 2023-12-01T01:02:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4cf6ffd700 1 -- 172.21.15.26:0/1229430854 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4cfc00f040 con 0x7f4d04102940 2023-12-01T01:02:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4d0c1c3700 1 -- 172.21.15.26:0/1229430854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d041a0df0 con 0x7f4d04102940 2023-12-01T01:02:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4cf6ffd700 1 -- 172.21.15.26:0/1229430854 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00ce00 con 0x7f4d04102940 2023-12-01T01:02:33.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.864+0000 7f4d0c1c3700 1 -- 172.21.15.26:0/1229430854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d041a1270 con 0x7f4d04102940 2023-12-01T01:02:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.865+0000 7f4d0c1c3700 1 -- 172.21.15.26:0/1229430854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0410c7c0 con 0x7f4d04102940 2023-12-01T01:02:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.866+0000 7f4cf6ffd700 1 -- 172.21.15.26:0/1229430854 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f4cfc003a00 con 0x7f4d04102940 2023-12-01T01:02:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.867+0000 7f4cf6ffd700 1 --2- 172.21.15.26:0/1229430854 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4cf00a05f0 0x7f4cf00a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.867+0000 7f4d09f5f700 1 --2- 172.21.15.26:0/1229430854 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4cf00a05f0 0x7f4cf00a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.867+0000 7f4cf6ffd700 1 -- 172.21.15.26:0/1229430854 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4cfc0cb0b0 con 0x7f4d04102940 2023-12-01T01:02:33.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.867+0000 7f4d09f5f700 1 --2- 172.21.15.26:0/1229430854 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4cf00a05f0 0x7f4cf00a2ab0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4d04101e00 tx=0x7f4cf8007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:33.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:33.871+0000 7f4cf6ffd700 1 -- 172.21.15.26:0/1229430854 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4cfc0950e0 con 0x7f4d04102940 2023-12-01T01:02:33.930 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:02:33 smithi116 systemd[1]: Starting Ceph mds.i for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:02:34.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:34.122+0000 7f4d0c1c3700 1 -- 172.21.15.26:0/1229430854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d04107c10 con 0x7f4d04102940 2023-12-01T01:02:34.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:34.122+0000 7f4cf6ffd700 1 -- 172.21.15.26:0/1229430854 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6565 (secure 0 0 0) 0x7f4cfc098700 con 0x7f4d04102940 2023-12-01T01:02:34.124 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:34.124 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3333520218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3333520218},{"type":"v1","addr":"172.21.15.93:6837","nonce":3333520218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2023-12-01T01:02:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:34.125+0000 7f4d0c1c3700 1 -- 172.21.15.26:0/1229430854 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4cf00a05f0 msgr2=0x7f4cf00a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:34.125+0000 7f4d0c1c3700 1 --2- 172.21.15.26:0/1229430854 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4cf00a05f0 0x7f4cf00a2ab0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4d04101e00 tx=0x7f4cf8007400 comp rx=0 tx=0).stop 2023-12-01T01:02:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:34.125+0000 7f4d0c1c3700 1 -- 172.21.15.26:0/1229430854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d04102940 msgr2=0x7f4d040736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:34.125+0000 7f4d0c1c3700 1 --2- 172.21.15.26:0/1229430854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d04102940 0x7f4d040736c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc00ef30 tx=0x7f4cfc00c3a0 comp rx=0 tx=0).stop 2023-12-01T01:02:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:34.125+0000 7f4d0c1c3700 1 -- 172.21.15.26:0/1229430854 shutdown_connections 2023-12-01T01:02:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:34.125+0000 7f4d0c1c3700 1 --2- 172.21.15.26:0/1229430854 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4cf00a05f0 0x7f4cf00a2ab0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:34.125+0000 7f4d0c1c3700 1 --2- 172.21.15.26:0/1229430854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d04102940 0x7f4d040736c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:34.125+0000 7f4d0c1c3700 1 --2- 172.21.15.26:0/1229430854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d04100db0 0x7f4d04074b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:34.125+0000 7f4d0c1c3700 1 --2- 172.21.15.26:0/1229430854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d04101fa0 0x7f4d04073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:34.125+0000 7f4d0c1c3700 1 -- 172.21.15.26:0/1229430854 >> 172.21.15.26:0/1229430854 conn(0x7f4d040fc340 msgr2=0x7f4d040fe500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:34.125+0000 7f4d0c1c3700 1 -- 172.21.15.26:0/1229430854 shutdown_connections 2023-12-01T01:02:34.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:34.125+0000 7f4d0c1c3700 1 -- 172.21.15.26:0/1229430854 wait complete. 2023-12-01T01:02:34.127 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 9 2023-12-01T01:02:34.304 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:02:34 smithi116 podman[141965]: 2023-12-01T01:02:34.304 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:02:34 smithi116 bash[141965]: b2f1b44701db9231933a045ea5ee58827a845398cc7f06186fd48284dc6198db 2023-12-01T01:02:34.304 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:02:34 smithi116 ceph-mds[142005]: -- 172.21.15.116:0/2300583304 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b0b1a731e0 con 0x55b0b1a48c00 2023-12-01T01:02:34.304 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:02:34 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: starting mds.i at 2023-12-01T01:02:34.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:34 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1229430854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:34.680 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:02:34 smithi116 systemd[1]: Started Ceph mds.i for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T01:02:34.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:34 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1229430854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:34.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:34 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1229430854' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:35.605 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:35 smithi026 ceph-mon[98801]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:35.605 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:35 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] up:boot 2023-12-01T01:02:35.605 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:35 smithi026 ceph-mon[98801]: fsmap 9 up:standby 2023-12-01T01:02:35.605 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:35 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-01T01:02:35.605 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:35 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:35.605 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:35 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:35.605 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:35 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:35.605 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:35 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:35.605 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:35 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:35.605 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:35 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:35.605 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:35 smithi026 ceph-mon[98801]: Deploying daemon mds.g on smithi026 2023-12-01T01:02:35.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:35 smithi116 ceph-mon[103554]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:35.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:35 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] up:boot 2023-12-01T01:02:35.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:35 smithi116 ceph-mon[103554]: fsmap 9 up:standby 2023-12-01T01:02:35.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:35 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-01T01:02:35.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:35 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:35.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:35 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:35.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:35 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:35.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:35 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:35.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:35 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:35.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:35 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:35.682 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:35 smithi116 ceph-mon[103554]: Deploying daemon mds.g on smithi026 2023-12-01T01:02:35.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:35 smithi093 ceph-mon[103327]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:35.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:35 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] up:boot 2023-12-01T01:02:35.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:35 smithi093 ceph-mon[103327]: fsmap 9 up:standby 2023-12-01T01:02:35.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:35 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-01T01:02:35.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:35 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:35.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:35 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:35.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:35 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:35.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:35 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:35.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:35 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:35.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:35 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:35.717 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:35 smithi093 ceph-mon[103327]: Deploying daemon mds.g on smithi026 2023-12-01T01:02:35.869 INFO:journalctl@ceph.mds.g.smithi026.stdout:Dec 01 01:02:35 smithi026 systemd[1]: Starting Ceph mds.g for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:02:36.142 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:02:36.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.275+0000 7f6716aa4700 1 -- 172.21.15.26:0/632275691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6710102920 msgr2=0x7f67101091d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:36.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.275+0000 7f6716aa4700 1 --2- 172.21.15.26:0/632275691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6710102920 0x7f67101091d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f670800b0d0 tx=0x7f670800b3e0 comp rx=0 tx=0).stop 2023-12-01T01:02:36.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.275+0000 7f6716aa4700 1 -- 172.21.15.26:0/632275691 shutdown_connections 2023-12-01T01:02:36.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.275+0000 7f6716aa4700 1 --2- 172.21.15.26:0/632275691 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6710102920 0x7f67101091d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:36.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.275+0000 7f6716aa4700 1 --2- 172.21.15.26:0/632275691 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6710100d90 0x7f67101011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.275+0000 7f6716aa4700 1 --2- 172.21.15.26:0/632275691 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6710101f80 0x7f67101023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.275+0000 7f6716aa4700 1 -- 172.21.15.26:0/632275691 >> 172.21.15.26:0/632275691 conn(0x7f67100fc2e0 msgr2=0x7f67100fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.275+0000 7f6716aa4700 1 -- 172.21.15.26:0/632275691 shutdown_connections 2023-12-01T01:02:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.275+0000 7f6716aa4700 1 -- 172.21.15.26:0/632275691 wait complete. 2023-12-01T01:02:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6716aa4700 1 Processor -- start 2023-12-01T01:02:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6716aa4700 1 -- start start 2023-12-01T01:02:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6716aa4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6710100d90 0x7f6710196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6716aa4700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6710101f80 0x7f67101970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6716aa4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6710102920 0x7f671019e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6716aa4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671019e730 con 0x7f6710100d90 2023-12-01T01:02:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6716aa4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671019e870 con 0x7f6710102920 2023-12-01T01:02:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6716aa4700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671019ea00 con 0x7f6710101f80 2023-12-01T01:02:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6714840700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6710100d90 0x7f6710196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6714840700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6710100d90 0x7f6710196bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53340/0 (socket says 172.21.15.26:53340) 2023-12-01T01:02:36.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6714840700 1 -- 172.21.15.26:0/1413235480 learned_addr learned my addr 172.21.15.26:0/1413235480 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f670ffff700 1 --2- 172.21.15.26:0/1413235480 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6710101f80 0x7f67101970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6715041700 1 --2- 172.21.15.26:0/1413235480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6710102920 0x7f671019e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6714840700 1 -- 172.21.15.26:0/1413235480 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6710101f80 msgr2=0x7f67101970f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6714840700 1 --2- 172.21.15.26:0/1413235480 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6710101f80 0x7f67101970f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6714840700 1 -- 172.21.15.26:0/1413235480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6710102920 msgr2=0x7f671019e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6714840700 1 --2- 172.21.15.26:0/1413235480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6710102920 0x7f671019e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6714840700 1 -- 172.21.15.26:0/1413235480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6708009d00 con 0x7f6710100d90 2023-12-01T01:02:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6715041700 1 --2- 172.21.15.26:0/1413235480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6710102920 0x7f671019e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:02:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f6714840700 1 --2- 172.21.15.26:0/1413235480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6710100d90 0x7f6710196bb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f670400d980 tx=0x7f670400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.276+0000 7f670dffb700 1 -- 172.21.15.26:0/1413235480 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670400b950 con 0x7f6710100d90 2023-12-01T01:02:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.277+0000 7f670dffb700 1 -- 172.21.15.26:0/1413235480 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6704007620 con 0x7f6710100d90 2023-12-01T01:02:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.277+0000 7f6716aa4700 1 -- 172.21.15.26:0/1413235480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671019ece0 con 0x7f6710100d90 2023-12-01T01:02:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.277+0000 7f670dffb700 1 -- 172.21.15.26:0/1413235480 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670400f620 con 0x7f6710100d90 2023-12-01T01:02:36.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.277+0000 7f6716aa4700 1 -- 172.21.15.26:0/1413235480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671019f1a0 con 0x7f6710100d90 2023-12-01T01:02:36.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.278+0000 7f6716aa4700 1 -- 172.21.15.26:0/1413235480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671010c6f0 con 0x7f6710100d90 2023-12-01T01:02:36.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.279+0000 7f670dffb700 1 -- 172.21.15.26:0/1413235480 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f67040106f0 con 0x7f6710100d90 2023-12-01T01:02:36.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.279+0000 7f670dffb700 1 --2- 172.21.15.26:0/1413235480 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f67000a0570 0x7f67000a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:36.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.279+0000 7f670dffb700 1 -- 172.21.15.26:0/1413235480 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f67040cb3b0 con 0x7f6710100d90 2023-12-01T01:02:36.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.279+0000 7f670ffff700 1 --2- 172.21.15.26:0/1413235480 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f67000a0570 0x7f67000a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:36.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.280+0000 7f670ffff700 1 --2- 172.21.15.26:0/1413235480 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f67000a0570 0x7f67000a2a30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f66fc009be0 tx=0x7f66fc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:36.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.284+0000 7f670dffb700 1 -- 172.21.15.26:0/1413235480 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f67040953f0 con 0x7f6710100d90 2023-12-01T01:02:36.491 INFO:journalctl@ceph.mds.g.smithi026.stdout:Dec 01 01:02:36 smithi026 podman[149548]: 2023-12-01T01:02:36.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.544+0000 7f6716aa4700 1 -- 172.21.15.26:0/1413235480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f671010c8e0 con 0x7f6710100d90 2023-12-01T01:02:36.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.545+0000 7f670dffb700 1 -- 172.21.15.26:0/1413235480 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7324 (secure 0 0 0) 0x7f671010c8e0 con 0x7f6710100d90 2023-12-01T01:02:36.546 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:36.546 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3333520218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3333520218},{"type":"v1","addr":"172.21.15.93:6837","nonce":3333520218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-12-01T01:02:36.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.547+0000 7f6716aa4700 1 -- 172.21.15.26:0/1413235480 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f67000a0570 msgr2=0x7f67000a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:36.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.547+0000 7f6716aa4700 1 --2- 172.21.15.26:0/1413235480 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f67000a0570 0x7f67000a2a30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f66fc009be0 tx=0x7f66fc009260 comp rx=0 tx=0).stop 2023-12-01T01:02:36.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.547+0000 7f6716aa4700 1 -- 172.21.15.26:0/1413235480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6710100d90 msgr2=0x7f6710196bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:36.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.547+0000 7f6716aa4700 1 --2- 172.21.15.26:0/1413235480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6710100d90 0x7f6710196bb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f670400d980 tx=0x7f670400dc90 comp rx=0 tx=0).stop 2023-12-01T01:02:36.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.547+0000 7f6716aa4700 1 -- 172.21.15.26:0/1413235480 shutdown_connections 2023-12-01T01:02:36.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.547+0000 7f6716aa4700 1 --2- 172.21.15.26:0/1413235480 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f67000a0570 0x7f67000a2a30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:36.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.547+0000 7f6716aa4700 1 --2- 172.21.15.26:0/1413235480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6710102920 0x7f671019e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:36.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.547+0000 7f6716aa4700 1 --2- 172.21.15.26:0/1413235480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6710100d90 0x7f6710196bb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:36.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.547+0000 7f6716aa4700 1 --2- 172.21.15.26:0/1413235480 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6710101f80 0x7f67101970f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:36.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.547+0000 7f6716aa4700 1 -- 172.21.15.26:0/1413235480 >> 172.21.15.26:0/1413235480 conn(0x7f67100fc2e0 msgr2=0x7f67100fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:36.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.547+0000 7f6716aa4700 1 -- 172.21.15.26:0/1413235480 shutdown_connections 2023-12-01T01:02:36.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:36.547+0000 7f6716aa4700 1 -- 172.21.15.26:0/1413235480 wait complete. 2023-12-01T01:02:36.549 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 10 2023-12-01T01:02:36.797 INFO:journalctl@ceph.mds.g.smithi026.stdout:Dec 01 01:02:36 smithi026 ceph-mds[149631]: -- 172.21.15.26:0/740230288 <== mon.0 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5621d9b171e0 con 0x5621d9aec800 2023-12-01T01:02:36.797 INFO:journalctl@ceph.mds.g.smithi026.stdout:Dec 01 01:02:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-g[149589]: starting mds.g at 2023-12-01T01:02:36.797 INFO:journalctl@ceph.mds.g.smithi026.stdout:Dec 01 01:02:36 smithi026 bash[149548]: 66caad904af7a0cc6964f2721a97e983d080df5fe68f0a25e33b676df424bc40 2023-12-01T01:02:36.798 INFO:journalctl@ceph.mds.g.smithi026.stdout:Dec 01 01:02:36 smithi026 systemd[1]: Started Ceph mds.g for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T01:02:37.614 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:37 smithi026 ceph-mon[98801]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:37.614 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:37 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1413235480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:37.614 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:37 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:37.614 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:37 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:37.614 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:37 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:37.615 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:37 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:37.615 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:37 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:37.615 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:37 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:37.615 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:37 smithi026 ceph-mon[98801]: Deploying daemon mds.a on smithi026 2023-12-01T01:02:37.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:37 smithi116 ceph-mon[103554]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:37.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:37 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1413235480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:37.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:37 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:37.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:37 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:37.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:37 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:37.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:37 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:37.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:37 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:37.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:37 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:37.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:37 smithi116 ceph-mon[103554]: Deploying daemon mds.a on smithi026 2023-12-01T01:02:37.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:37 smithi093 ceph-mon[103327]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:37.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:37 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1413235480' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:37.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:37 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:37.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:37 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:37.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:37 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:37.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:37 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:37.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:37 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:37.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:37 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:37.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:37 smithi093 ceph-mon[103327]: Deploying daemon mds.a on smithi026 2023-12-01T01:02:38.425 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:38 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] up:boot 2023-12-01T01:02:38.425 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:38 smithi026 ceph-mon[98801]: fsmap 10 up:standby 2023-12-01T01:02:38.425 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:38 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-01T01:02:38.426 INFO:journalctl@ceph.mds.a.smithi026.stdout:Dec 01 01:02:38 smithi026 systemd[1]: Starting Ceph mds.a for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:02:38.562 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:02:38.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:38 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] up:boot 2023-12-01T01:02:38.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:38 smithi116 ceph-mon[103554]: fsmap 10 up:standby 2023-12-01T01:02:38.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:38 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-01T01:02:38.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.694+0000 7f1f5c033700 1 -- 172.21.15.26:0/3019079002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f54106ab0 msgr2=0x7f1f54108ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:38.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.694+0000 7f1f5c033700 1 --2- 172.21.15.26:0/3019079002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f54106ab0 0x7f1f54108ec0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c00b0a0 tx=0x7f1f4c00b3b0 comp rx=0 tx=0).stop 2023-12-01T01:02:38.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.694+0000 7f1f5c033700 1 -- 172.21.15.26:0/3019079002 shutdown_connections 2023-12-01T01:02:38.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.694+0000 7f1f5c033700 1 --2- 172.21.15.26:0/3019079002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f54106ab0 0x7f1f54108ec0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.694+0000 7f1f5c033700 1 --2- 172.21.15.26:0/3019079002 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f54101850 0x7f1f54103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.694+0000 7f1f5c033700 1 --2- 172.21.15.26:0/3019079002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f54104180 0x7f1f54106570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.694+0000 7f1f5c033700 1 -- 172.21.15.26:0/3019079002 >> 172.21.15.26:0/3019079002 conn(0x7f1f540fb1c0 msgr2=0x7f1f540fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.694+0000 7f1f5c033700 1 -- 172.21.15.26:0/3019079002 shutdown_connections 2023-12-01T01:02:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.694+0000 7f1f5c033700 1 -- 172.21.15.26:0/3019079002 wait complete. 2023-12-01T01:02:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f5c033700 1 Processor -- start 2023-12-01T01:02:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f5c033700 1 -- start start 2023-12-01T01:02:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f5c033700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f54101850 0x7f1f541011c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f5c033700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f54104180 0x7f1f540ff800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f5c033700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f54106ab0 0x7f1f540ffd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f5c033700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f541004e0 con 0x7f1f54101850 2023-12-01T01:02:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f5c033700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f54100650 con 0x7f1f54106ab0 2023-12-01T01:02:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f5c033700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f541a0c40 con 0x7f1f54104180 2023-12-01T01:02:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f59dcf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f54101850 0x7f1f541011c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f59dcf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f54101850 0x7f1f541011c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53376/0 (socket says 172.21.15.26:53376) 2023-12-01T01:02:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f59dcf700 1 -- 172.21.15.26:0/3756447358 learned_addr learned my addr 172.21.15.26:0/3756447358 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f5a5d0700 1 --2- 172.21.15.26:0/3756447358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f54106ab0 0x7f1f540ffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f595ce700 1 --2- 172.21.15.26:0/3756447358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f54104180 0x7f1f540ff800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f59dcf700 1 -- 172.21.15.26:0/3756447358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f54104180 msgr2=0x7f1f540ff800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f59dcf700 1 --2- 172.21.15.26:0/3756447358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f54104180 0x7f1f540ff800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f59dcf700 1 -- 172.21.15.26:0/3756447358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f54106ab0 msgr2=0x7f1f540ffd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.695+0000 7f1f59dcf700 1 --2- 172.21.15.26:0/3756447358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f54106ab0 0x7f1f540ffd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.696+0000 7f1f59dcf700 1 -- 172.21.15.26:0/3756447358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f4c009d00 con 0x7f1f54101850 2023-12-01T01:02:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.696+0000 7f1f5a5d0700 1 --2- 172.21.15.26:0/3756447358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f54106ab0 0x7f1f540ffd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:02:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.696+0000 7f1f59dcf700 1 --2- 172.21.15.26:0/3756447358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f54101850 0x7f1f541011c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400e9a0 tx=0x7f1f4400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.696+0000 7f1f4affd700 1 -- 172.21.15.26:0/3756447358 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44009790 con 0x7f1f54101850 2023-12-01T01:02:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.696+0000 7f1f5c033700 1 -- 172.21.15.26:0/3756447358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f541a0f20 con 0x7f1f54101850 2023-12-01T01:02:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.696+0000 7f1f4affd700 1 -- 172.21.15.26:0/3756447358 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1f4400cbd0 con 0x7f1f54101850 2023-12-01T01:02:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.696+0000 7f1f4affd700 1 -- 172.21.15.26:0/3756447358 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f44018730 con 0x7f1f54101850 2023-12-01T01:02:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.696+0000 7f1f5c033700 1 -- 172.21.15.26:0/3756447358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f541a1340 con 0x7f1f54101850 2023-12-01T01:02:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.697+0000 7f1f5c033700 1 -- 172.21.15.26:0/3756447358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f540fcd40 con 0x7f1f54101850 2023-12-01T01:02:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.699+0000 7f1f4affd700 1 -- 172.21.15.26:0/3756447358 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f1f44010430 con 0x7f1f54101850 2023-12-01T01:02:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.699+0000 7f1f4affd700 1 --2- 172.21.15.26:0/3756447358 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1f400a0570 0x7f1f400a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.699+0000 7f1f4affd700 1 -- 172.21.15.26:0/3756447358 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1f44014070 con 0x7f1f54101850 2023-12-01T01:02:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.699+0000 7f1f595ce700 1 --2- 172.21.15.26:0/3756447358 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1f400a0570 0x7f1f400a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:38.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.700+0000 7f1f595ce700 1 --2- 172.21.15.26:0/3756447358 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1f400a0570 0x7f1f400a2a30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009bf0 tx=0x7f1f50009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.703+0000 7f1f4affd700 1 -- 172.21.15.26:0/3756447358 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1f44095cf0 con 0x7f1f54101850 2023-12-01T01:02:38.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:38 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] up:boot 2023-12-01T01:02:38.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:38 smithi093 ceph-mon[103327]: fsmap 10 up:standby 2023-12-01T01:02:38.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:38 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-01T01:02:38.734 INFO:journalctl@ceph.mds.a.smithi026.stdout:Dec 01 01:02:38 smithi026 podman[149934]: 2023-12-01T01:02:38.734 INFO:journalctl@ceph.mds.a.smithi026.stdout:Dec 01 01:02:38 smithi026 ceph-mds[149999]: -- 172.21.15.26:0/1238885999 <== mon.0 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5575ba63f1e0 con 0x5575ba614800 2023-12-01T01:02:38.734 INFO:journalctl@ceph.mds.a.smithi026.stdout:Dec 01 01:02:38 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-a[149952]: starting mds.a at 2023-12-01T01:02:38.734 INFO:journalctl@ceph.mds.a.smithi026.stdout:Dec 01 01:02:38 smithi026 bash[149934]: 95c853087e183dad3800cf58dcf4d7c6642ec25754beaa604a6bff814b8cc320 2023-12-01T01:02:38.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.977+0000 7f1f5c033700 1 -- 172.21.15.26:0/3756447358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f5402cc70 con 0x7f1f54101850 2023-12-01T01:02:38.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.977+0000 7f1f4affd700 1 -- 172.21.15.26:0/3756447358 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8082 (secure 0 0 0) 0x7f1f44099310 con 0x7f1f54101850 2023-12-01T01:02:38.979 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:38.980 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3333520218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3333520218},{"type":"v1","addr":"172.21.15.93:6837","nonce":3333520218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24493,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[]} 2023-12-01T01:02:38.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.979+0000 7f1f5c033700 1 -- 172.21.15.26:0/3756447358 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1f400a0570 msgr2=0x7f1f400a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:38.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.979+0000 7f1f5c033700 1 --2- 172.21.15.26:0/3756447358 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1f400a0570 0x7f1f400a2a30 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009bf0 tx=0x7f1f50009260 comp rx=0 tx=0).stop 2023-12-01T01:02:38.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.979+0000 7f1f5c033700 1 -- 172.21.15.26:0/3756447358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f54101850 msgr2=0x7f1f541011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:38.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.979+0000 7f1f5c033700 1 --2- 172.21.15.26:0/3756447358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f54101850 0x7f1f541011c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1f4400e9a0 tx=0x7f1f4400ed60 comp rx=0 tx=0).stop 2023-12-01T01:02:38.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.979+0000 7f1f5c033700 1 -- 172.21.15.26:0/3756447358 shutdown_connections 2023-12-01T01:02:38.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.979+0000 7f1f5c033700 1 --2- 172.21.15.26:0/3756447358 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1f400a0570 0x7f1f400a2a30 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:38.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.979+0000 7f1f5c033700 1 --2- 172.21.15.26:0/3756447358 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f54106ab0 0x7f1f540ffd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:38.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.979+0000 7f1f5c033700 1 --2- 172.21.15.26:0/3756447358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f54101850 0x7f1f541011c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:38.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.979+0000 7f1f5c033700 1 --2- 172.21.15.26:0/3756447358 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f54104180 0x7f1f540ff800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:38.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.979+0000 7f1f5c033700 1 -- 172.21.15.26:0/3756447358 >> 172.21.15.26:0/3756447358 conn(0x7f1f540fb1c0 msgr2=0x7f1f541024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:38.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.980+0000 7f1f5c033700 1 -- 172.21.15.26:0/3756447358 shutdown_connections 2023-12-01T01:02:38.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:38.980+0000 7f1f5c033700 1 -- 172.21.15.26:0/3756447358 wait complete. 2023-12-01T01:02:38.983 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 11 2023-12-01T01:02:38.992 INFO:journalctl@ceph.mds.a.smithi026.stdout:Dec 01 01:02:38 smithi026 systemd[1]: Started Ceph mds.a for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T01:02:40.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:39 smithi026 ceph-mon[98801]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:40.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:39 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:40.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:39 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:40.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:39 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:40.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:39 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:40.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:39 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:40.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:39 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:40.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:39 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3756447358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:40.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:39 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.26:6840/3515135915,v1:172.21.15.26:6841/3515135915] up:boot 2023-12-01T01:02:40.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:39 smithi026 ceph-mon[98801]: fsmap 11 up:standby 2023-12-01T01:02:40.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:39 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-01T01:02:40.109 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:39 smithi093 ceph-mon[103327]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:40.109 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:39 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:40.109 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:39 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:40.109 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:39 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:40.109 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:39 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:40.109 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:39 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:40.109 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:39 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:40.109 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:39 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3756447358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:40.109 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:39 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.26:6840/3515135915,v1:172.21.15.26:6841/3515135915] up:boot 2023-12-01T01:02:40.109 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:39 smithi093 ceph-mon[103327]: fsmap 11 up:standby 2023-12-01T01:02:40.109 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:39 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-01T01:02:40.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:39 smithi116 ceph-mon[103554]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:40.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:39 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:40.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:39 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:40.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:39 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:40.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:39 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-01T01:02:40.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:39 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-01T01:02:40.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:39 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:40.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:39 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3756447358' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:40.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:39 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.26:6840/3515135915,v1:172.21.15.26:6841/3515135915] up:boot 2023-12-01T01:02:40.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:39 smithi116 ceph-mon[103554]: fsmap 11 up:standby 2023-12-01T01:02:40.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:39 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-01T01:02:40.716 INFO:journalctl@ceph.mds.b.smithi093.stdout:Dec 01 01:02:40 smithi093 systemd[1]: Starting Ceph mds.b for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:02:40.989 INFO:journalctl@ceph.mds.b.smithi093.stdout:Dec 01 01:02:40 smithi093 podman[139359]: 2023-12-01T01:02:40.990 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:40 smithi093 ceph-mon[103327]: Deploying daemon mds.b on smithi093 2023-12-01T01:02:40.994 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:02:41.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:40 smithi026 ceph-mon[98801]: Deploying daemon mds.b on smithi093 2023-12-01T01:02:41.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.137+0000 7fe78793b700 1 -- 172.21.15.26:0/678673149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7800ffc70 msgr2=0x7fe780100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:41.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.137+0000 7fe78793b700 1 --2- 172.21.15.26:0/678673149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7800ffc70 0x7fe780100090 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe77c0099c0 tx=0x7fe77c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:02:41.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.137+0000 7fe78793b700 1 -- 172.21.15.26:0/678673149 shutdown_connections 2023-12-01T01:02:41.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.137+0000 7fe78793b700 1 --2- 172.21.15.26:0/678673149 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe780101800 0x7fe7801080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:41.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.137+0000 7fe78793b700 1 --2- 172.21.15.26:0/678673149 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe7800ffc70 0x7fe780100090 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:41.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.137+0000 7fe78793b700 1 --2- 172.21.15.26:0/678673149 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe780100e60 0x7fe7801012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:41.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.137+0000 7fe78793b700 1 -- 172.21.15.26:0/678673149 >> 172.21.15.26:0/678673149 conn(0x7fe7800fb1c0 msgr2=0x7fe7800fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:41.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.137+0000 7fe78793b700 1 -- 172.21.15.26:0/678673149 shutdown_connections 2023-12-01T01:02:41.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.137+0000 7fe78793b700 1 -- 172.21.15.26:0/678673149 wait complete. 2023-12-01T01:02:41.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe78793b700 1 Processor -- start 2023-12-01T01:02:41.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe78793b700 1 -- start start 2023-12-01T01:02:41.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe78793b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7800ffc70 0x7fe780198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:41.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe78793b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe780100e60 0x7fe780199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:41.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe78793b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe780101800 0x7fe7801a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:41.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe78793b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7801a0840 con 0x7fe780101800 2023-12-01T01:02:41.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe78793b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7801a09b0 con 0x7fe780100e60 2023-12-01T01:02:41.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe78793b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7801a0b70 con 0x7fe7800ffc70 2023-12-01T01:02:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe785ed8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe780101800 0x7fe7801a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe785ed8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe780101800 0x7fe7801a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53396/0 (socket says 172.21.15.26:53396) 2023-12-01T01:02:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe785ed8700 1 -- 172.21.15.26:0/1359385126 learned_addr learned my addr 172.21.15.26:0/1359385126 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe7856d7700 1 --2- 172.21.15.26:0/1359385126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7800ffc70 0x7fe780198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe784ed6700 1 --2- 172.21.15.26:0/1359385126 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe780100e60 0x7fe780199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe785ed8700 1 -- 172.21.15.26:0/1359385126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7800ffc70 msgr2=0x7fe780198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe785ed8700 1 --2- 172.21.15.26:0/1359385126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7800ffc70 0x7fe780198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe785ed8700 1 -- 172.21.15.26:0/1359385126 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe780100e60 msgr2=0x7fe780199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe785ed8700 1 --2- 172.21.15.26:0/1359385126 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe780100e60 0x7fe780199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.138+0000 7fe785ed8700 1 -- 172.21.15.26:0/1359385126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe770009520 con 0x7fe780101800 2023-12-01T01:02:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.139+0000 7fe785ed8700 1 --2- 172.21.15.26:0/1359385126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe780101800 0x7fe7801a0270 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe77800ef30 tx=0x7fe77800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.139+0000 7fe7767fc700 1 -- 172.21.15.26:0/1359385126 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe778018070 con 0x7fe780101800 2023-12-01T01:02:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.139+0000 7fe7767fc700 1 -- 172.21.15.26:0/1359385126 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe77800f040 con 0x7fe780101800 2023-12-01T01:02:41.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.139+0000 7fe78793b700 1 -- 172.21.15.26:0/1359385126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c0095f0 con 0x7fe780101800 2023-12-01T01:02:41.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.139+0000 7fe7767fc700 1 -- 172.21.15.26:0/1359385126 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77800cd50 con 0x7fe780101800 2023-12-01T01:02:41.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.139+0000 7fe78793b700 1 -- 172.21.15.26:0/1359385126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7801a1170 con 0x7fe780101800 2023-12-01T01:02:41.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.140+0000 7fe78793b700 1 -- 172.21.15.26:0/1359385126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78010b5c0 con 0x7fe780101800 2023-12-01T01:02:41.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.141+0000 7fe7767fc700 1 -- 172.21.15.26:0/1359385126 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fe778003a00 con 0x7fe780101800 2023-12-01T01:02:41.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.142+0000 7fe7767fc700 1 --2- 172.21.15.26:0/1359385126 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe76c0a05f0 0x7fe76c0a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:41.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.142+0000 7fe7856d7700 1 --2- 172.21.15.26:0/1359385126 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe76c0a05f0 0x7fe76c0a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:41.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.142+0000 7fe7767fc700 1 -- 172.21.15.26:0/1359385126 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe7780cb980 con 0x7fe780101800 2023-12-01T01:02:41.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.142+0000 7fe7856d7700 1 --2- 172.21.15.26:0/1359385126 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe76c0a05f0 0x7fe76c0a2ab0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe78019a1d0 tx=0x7fe77c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:41.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.146+0000 7fe7767fc700 1 -- 172.21.15.26:0/1359385126 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe778095a50 con 0x7fe780101800 2023-12-01T01:02:41.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:40 smithi116 ceph-mon[103554]: Deploying daemon mds.b on smithi093 2023-12-01T01:02:41.408 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.406+0000 7fe78793b700 1 -- 172.21.15.26:0/1359385126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7801a1720 con 0x7fe780101800 2023-12-01T01:02:41.409 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.407+0000 7fe7767fc700 1 -- 172.21.15.26:0/1359385126 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8840 (secure 0 0 0) 0x7fe778099070 con 0x7fe780101800 2023-12-01T01:02:41.409 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:41.410 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6841/3515135915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6840","nonce":3515135915},{"type":"v1","addr":"172.21.15.26:6841","nonce":3515135915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3333520218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3333520218},{"type":"v1","addr":"172.21.15.93:6837","nonce":3333520218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24493,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[]} 2023-12-01T01:02:41.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.409+0000 7fe78793b700 1 -- 172.21.15.26:0/1359385126 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe76c0a05f0 msgr2=0x7fe76c0a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:41.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.409+0000 7fe78793b700 1 --2- 172.21.15.26:0/1359385126 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe76c0a05f0 0x7fe76c0a2ab0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe78019a1d0 tx=0x7fe77c005fb0 comp rx=0 tx=0).stop 2023-12-01T01:02:41.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.409+0000 7fe78793b700 1 -- 172.21.15.26:0/1359385126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe780101800 msgr2=0x7fe7801a0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:41.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.409+0000 7fe78793b700 1 --2- 172.21.15.26:0/1359385126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe780101800 0x7fe7801a0270 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe77800ef30 tx=0x7fe77800c3a0 comp rx=0 tx=0).stop 2023-12-01T01:02:41.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.409+0000 7fe78793b700 1 -- 172.21.15.26:0/1359385126 shutdown_connections 2023-12-01T01:02:41.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.409+0000 7fe78793b700 1 --2- 172.21.15.26:0/1359385126 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe76c0a05f0 0x7fe76c0a2ab0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:41.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.410+0000 7fe78793b700 1 --2- 172.21.15.26:0/1359385126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe780101800 0x7fe7801a0270 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:41.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.410+0000 7fe78793b700 1 --2- 172.21.15.26:0/1359385126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7800ffc70 0x7fe780198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:41.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.410+0000 7fe78793b700 1 --2- 172.21.15.26:0/1359385126 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe780100e60 0x7fe780199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:41.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.410+0000 7fe78793b700 1 -- 172.21.15.26:0/1359385126 >> 172.21.15.26:0/1359385126 conn(0x7fe7800fb1c0 msgr2=0x7fe780067f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:41.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.410+0000 7fe78793b700 1 -- 172.21.15.26:0/1359385126 shutdown_connections 2023-12-01T01:02:41.412 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:41.410+0000 7fe78793b700 1 -- 172.21.15.26:0/1359385126 wait complete. 2023-12-01T01:02:41.413 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 12 2023-12-01T01:02:41.465 INFO:journalctl@ceph.mds.b.smithi093.stdout:Dec 01 01:02:40 smithi093 bash[139359]: 3708cec203401852b6d735b37054ef8bc1ca63d71ef4c6ae9e7bed9bf39cc032 2023-12-01T01:02:41.465 INFO:journalctl@ceph.mds.b.smithi093.stdout:Dec 01 01:02:40 smithi093 ceph-mds[139399]: -- 172.21.15.93:0/2216577460 <== mon.2 v2:172.21.15.93:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562f67cf71e0 con 0x562f67cccc00 2023-12-01T01:02:41.465 INFO:journalctl@ceph.mds.b.smithi093.stdout:Dec 01 01:02:40 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-b[139375]: starting mds.b at 2023-12-01T01:02:41.465 INFO:journalctl@ceph.mds.b.smithi093.stdout:Dec 01 01:02:41 smithi093 systemd[1]: Started Ceph mds.b for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T01:02:42.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:41 smithi026 ceph-mon[98801]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:42.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:42.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:42.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:42.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:42.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:42.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:41 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:02:42.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:41 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1359385126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:42.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:41 smithi116 ceph-mon[103554]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:42.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:42.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:42.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:42.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:42.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:42.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:41 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:02:42.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:41 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1359385126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:42.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:41 smithi093 ceph-mon[103327]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:42.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:42.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:42.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:42.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:42.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:42.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:41 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:02:42.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:41 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1359385126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:43.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:42 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] up:boot 2023-12-01T01:02:43.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:42 smithi116 ceph-mon[103554]: fsmap 12 up:standby 2023-12-01T01:02:43.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:42 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-01T01:02:43.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:42 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] up:boot 2023-12-01T01:02:43.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:42 smithi093 ceph-mon[103327]: fsmap 12 up:standby 2023-12-01T01:02:43.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:42 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-01T01:02:43.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:42 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] up:boot 2023-12-01T01:02:43.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:42 smithi026 ceph-mon[98801]: fsmap 12 up:standby 2023-12-01T01:02:43.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:42 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-01T01:02:43.425 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:02:43.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.555+0000 7fdd81b7c700 1 -- 172.21.15.26:0/1179619080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c101800 msgr2=0x7fdd7c1080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.555+0000 7fdd81b7c700 1 --2- 172.21.15.26:0/1179619080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c101800 0x7fdd7c1080b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdd7400b0d0 tx=0x7fdd7400b3e0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.555+0000 7fdd81b7c700 1 -- 172.21.15.26:0/1179619080 shutdown_connections 2023-12-01T01:02:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.555+0000 7fdd81b7c700 1 --2- 172.21.15.26:0/1179619080 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c101800 0x7fdd7c1080b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.555+0000 7fdd81b7c700 1 --2- 172.21.15.26:0/1179619080 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd7c0ffc70 0x7fdd7c100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.555+0000 7fdd81b7c700 1 --2- 172.21.15.26:0/1179619080 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd7c100e60 0x7fdd7c1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.555+0000 7fdd81b7c700 1 -- 172.21.15.26:0/1179619080 >> 172.21.15.26:0/1179619080 conn(0x7fdd7c0fb1c0 msgr2=0x7fdd7c0fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.555+0000 7fdd81b7c700 1 -- 172.21.15.26:0/1179619080 shutdown_connections 2023-12-01T01:02:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.555+0000 7fdd81b7c700 1 -- 172.21.15.26:0/1179619080 wait complete. 2023-12-01T01:02:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.556+0000 7fdd81b7c700 1 Processor -- start 2023-12-01T01:02:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.556+0000 7fdd81b7c700 1 -- start start 2023-12-01T01:02:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.556+0000 7fdd81b7c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd7c0ffc70 0x7fdd7c198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.556+0000 7fdd81b7c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd7c100e60 0x7fdd7c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.556+0000 7fdd81b7c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c101800 0x7fdd7c1a0320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.556+0000 7fdd81b7c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c1a08f0 con 0x7fdd7c101800 2023-12-01T01:02:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.556+0000 7fdd81b7c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c1a0a60 con 0x7fdd7c0ffc70 2023-12-01T01:02:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.556+0000 7fdd81b7c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7c1a0c20 con 0x7fdd7c100e60 2023-12-01T01:02:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.556+0000 7fdd7bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c101800 0x7fdd7c1a0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.556+0000 7fdd7bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c101800 0x7fdd7c1a0320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53408/0 (socket says 172.21.15.26:53408) 2023-12-01T01:02:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.556+0000 7fdd7bfff700 1 -- 172.21.15.26:0/976579911 learned_addr learned my addr 172.21.15.26:0/976579911 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.557+0000 7fdd7affd700 1 --2- 172.21.15.26:0/976579911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd7c100e60 0x7fdd7c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.557+0000 7fdd7bfff700 1 -- 172.21.15.26:0/976579911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd7c100e60 msgr2=0x7fdd7c1992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.557+0000 7fdd7bfff700 1 --2- 172.21.15.26:0/976579911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd7c100e60 0x7fdd7c1992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.557+0000 7fdd7bfff700 1 -- 172.21.15.26:0/976579911 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd7c0ffc70 msgr2=0x7fdd7c198db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.557+0000 7fdd7bfff700 1 --2- 172.21.15.26:0/976579911 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd7c0ffc70 0x7fdd7c198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.557+0000 7fdd7bfff700 1 -- 172.21.15.26:0/976579911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd74009d00 con 0x7fdd7c101800 2023-12-01T01:02:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.557+0000 7fdd7bfff700 1 --2- 172.21.15.26:0/976579911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c101800 0x7fdd7c1a0320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdd7400d010 tx=0x7fdd7400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.557+0000 7fdd78ff9700 1 -- 172.21.15.26:0/976579911 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7400e040 con 0x7fdd7c101800 2023-12-01T01:02:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.557+0000 7fdd78ff9700 1 -- 172.21.15.26:0/976579911 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdd7401dd70 con 0x7fdd7c101800 2023-12-01T01:02:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.557+0000 7fdd81b7c700 1 -- 172.21.15.26:0/976579911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd7c1a0ea0 con 0x7fdd7c101800 2023-12-01T01:02:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.557+0000 7fdd78ff9700 1 -- 172.21.15.26:0/976579911 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74012e80 con 0x7fdd7c101800 2023-12-01T01:02:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.557+0000 7fdd81b7c700 1 -- 172.21.15.26:0/976579911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7c1a12c0 con 0x7fdd7c101800 2023-12-01T01:02:43.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.558+0000 7fdd81b7c700 1 -- 172.21.15.26:0/976579911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd7c10b5d0 con 0x7fdd7c101800 2023-12-01T01:02:43.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.560+0000 7fdd78ff9700 1 -- 172.21.15.26:0/976579911 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fdd74012470 con 0x7fdd7c101800 2023-12-01T01:02:43.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.560+0000 7fdd78ff9700 1 --2- 172.21.15.26:0/976579911 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdd640a0570 0x7fdd640a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:43.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.560+0000 7fdd78ff9700 1 -- 172.21.15.26:0/976579911 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdd740cd840 con 0x7fdd7c101800 2023-12-01T01:02:43.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.560+0000 7fdd7b7fe700 1 --2- 172.21.15.26:0/976579911 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdd640a0570 0x7fdd640a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:43.563 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.561+0000 7fdd7b7fe700 1 --2- 172.21.15.26:0/976579911 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdd640a0570 0x7fdd640a2a30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c19a280 tx=0x7fdd700096c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:43.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.564+0000 7fdd78ff9700 1 -- 172.21.15.26:0/976579911 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fdd74097910 con 0x7fdd7c101800 2023-12-01T01:02:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.826+0000 7fdd81b7c700 1 -- 172.21.15.26:0/976579911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd7c1a18d0 con 0x7fdd7c101800 2023-12-01T01:02:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.826+0000 7fdd78ff9700 1 -- 172.21.15.26:0/976579911 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9598 (secure 0 0 0) 0x7fdd7409af30 con 0x7fdd7c101800 2023-12-01T01:02:43.829 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:43.829 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6841/3515135915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6840","nonce":3515135915},{"type":"v1","addr":"172.21.15.26:6841","nonce":3515135915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24448,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24460,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24479,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6837/3333520218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3333520218},{"type":"v1","addr":"172.21.15.93:6837","nonce":3333520218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24481,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24493,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24509,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6839/3364532241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":3364532241},{"type":"v1","addr":"172.21.15.93:6839","nonce":3364532241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2023-12-01T01:02:43.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.828+0000 7fdd81b7c700 1 -- 172.21.15.26:0/976579911 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdd640a0570 msgr2=0x7fdd640a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:43.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.828+0000 7fdd81b7c700 1 --2- 172.21.15.26:0/976579911 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdd640a0570 0x7fdd640a2a30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c19a280 tx=0x7fdd700096c0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.828+0000 7fdd81b7c700 1 -- 172.21.15.26:0/976579911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c101800 msgr2=0x7fdd7c1a0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:43.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.828+0000 7fdd81b7c700 1 --2- 172.21.15.26:0/976579911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c101800 0x7fdd7c1a0320 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdd7400d010 tx=0x7fdd7400bd50 comp rx=0 tx=0).stop 2023-12-01T01:02:43.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.828+0000 7fdd81b7c700 1 -- 172.21.15.26:0/976579911 shutdown_connections 2023-12-01T01:02:43.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.828+0000 7fdd81b7c700 1 --2- 172.21.15.26:0/976579911 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdd640a0570 0x7fdd640a2a30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.828+0000 7fdd81b7c700 1 --2- 172.21.15.26:0/976579911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd7c101800 0x7fdd7c1a0320 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.828+0000 7fdd81b7c700 1 --2- 172.21.15.26:0/976579911 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd7c0ffc70 0x7fdd7c198db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.828+0000 7fdd81b7c700 1 --2- 172.21.15.26:0/976579911 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd7c100e60 0x7fdd7c1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.829+0000 7fdd81b7c700 1 -- 172.21.15.26:0/976579911 >> 172.21.15.26:0/976579911 conn(0x7fdd7c0fb1c0 msgr2=0x7fdd7c067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:43.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.829+0000 7fdd81b7c700 1 -- 172.21.15.26:0/976579911 shutdown_connections 2023-12-01T01:02:43.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.829+0000 7fdd81b7c700 1 -- 172.21.15.26:0/976579911 wait complete. 2023-12-01T01:02:43.832 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 13 2023-12-01T01:02:43.848 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:02:43.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.981+0000 7f59d14b1700 1 -- 172.21.15.26:0/1584035078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc100d90 msgr2=0x7f59cc1011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:43.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.981+0000 7f59d14b1700 1 --2- 172.21.15.26:0/1584035078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc100d90 0x7f59cc1011b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f59bc0099c0 tx=0x7f59bc009cd0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.981+0000 7f59d14b1700 1 -- 172.21.15.26:0/1584035078 shutdown_connections 2023-12-01T01:02:43.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.981+0000 7f59d14b1700 1 --2- 172.21.15.26:0/1584035078 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59cc102920 0x7f59cc1091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.981+0000 7f59d14b1700 1 --2- 172.21.15.26:0/1584035078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc100d90 0x7f59cc1011b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.981+0000 7f59d14b1700 1 --2- 172.21.15.26:0/1584035078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59cc101f80 0x7f59cc1023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.981+0000 7f59d14b1700 1 -- 172.21.15.26:0/1584035078 >> 172.21.15.26:0/1584035078 conn(0x7f59cc0fc2c0 msgr2=0x7f59cc0fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.981+0000 7f59d14b1700 1 -- 172.21.15.26:0/1584035078 shutdown_connections 2023-12-01T01:02:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.981+0000 7f59d14b1700 1 -- 172.21.15.26:0/1584035078 wait complete. 2023-12-01T01:02:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.981+0000 7f59d14b1700 1 Processor -- start 2023-12-01T01:02:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59d14b1700 1 -- start start 2023-12-01T01:02:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59d14b1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59cc100d90 0x7f59cc074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59d14b1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59cc101f80 0x7f59cc073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59d14b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc102920 0x7f59cc0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59d14b1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc073e60 con 0x7f59cc102920 2023-12-01T01:02:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59d14b1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc073fd0 con 0x7f59cc100d90 2023-12-01T01:02:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59d14b1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59cc1a0ba0 con 0x7f59cc101f80 2023-12-01T01:02:43.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59cb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc102920 0x7f59cc0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59cb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc102920 0x7f59cc0736c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53420/0 (socket says 172.21.15.26:53420) 2023-12-01T01:02:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59cb7fe700 1 -- 172.21.15.26:0/4180705408 learned_addr learned my addr 172.21.15.26:0/4180705408 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59ca7fc700 1 --2- 172.21.15.26:0/4180705408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59cc101f80 0x7f59cc073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59caffd700 1 --2- 172.21.15.26:0/4180705408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59cc100d90 0x7f59cc074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59cb7fe700 1 -- 172.21.15.26:0/4180705408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59cc101f80 msgr2=0x7f59cc073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59cb7fe700 1 --2- 172.21.15.26:0/4180705408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59cc101f80 0x7f59cc073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59cb7fe700 1 -- 172.21.15.26:0/4180705408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59cc100d90 msgr2=0x7f59cc074b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59cb7fe700 1 --2- 172.21.15.26:0/4180705408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59cc100d90 0x7f59cc074b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59cb7fe700 1 -- 172.21.15.26:0/4180705408 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc0095f0 con 0x7f59cc102920 2023-12-01T01:02:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.982+0000 7f59caffd700 1 --2- 172.21.15.26:0/4180705408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59cc100d90 0x7f59cc074b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:02:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.983+0000 7f59cb7fe700 1 --2- 172.21.15.26:0/4180705408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc102920 0x7f59cc0736c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f59c400ef30 tx=0x7f59c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.983+0000 7f59b3fff700 1 -- 172.21.15.26:0/4180705408 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c4018070 con 0x7f59cc102920 2023-12-01T01:02:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.983+0000 7f59d14b1700 1 -- 172.21.15.26:0/4180705408 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59cc1a0e20 con 0x7f59cc102920 2023-12-01T01:02:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.983+0000 7f59b3fff700 1 -- 172.21.15.26:0/4180705408 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f59c400f040 con 0x7f59cc102920 2023-12-01T01:02:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.983+0000 7f59b3fff700 1 -- 172.21.15.26:0/4180705408 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c400cdb0 con 0x7f59cc102920 2023-12-01T01:02:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.983+0000 7f59d14b1700 1 -- 172.21.15.26:0/4180705408 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59cc1a12f0 con 0x7f59cc102920 2023-12-01T01:02:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.984+0000 7f59d14b1700 1 -- 172.21.15.26:0/4180705408 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59cc10c6e0 con 0x7f59cc102920 2023-12-01T01:02:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.985+0000 7f59b3fff700 1 -- 172.21.15.26:0/4180705408 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f59c4003a00 con 0x7f59cc102920 2023-12-01T01:02:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.986+0000 7f59b3fff700 1 --2- 172.21.15.26:0/4180705408 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f59b40a0570 0x7f59b40a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.986+0000 7f59b3fff700 1 -- 172.21.15.26:0/4180705408 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f59c40cb9c0 con 0x7f59cc102920 2023-12-01T01:02:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.986+0000 7f59caffd700 1 --2- 172.21.15.26:0/4180705408 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f59b40a0570 0x7f59b40a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.986+0000 7f59caffd700 1 --2- 172.21.15.26:0/4180705408 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f59b40a0570 0x7f59b40a2a30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00b580 tx=0x7f59bc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:43.989+0000 7f59b3fff700 1 -- 172.21.15.26:0/4180705408 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f59c4095a90 con 0x7f59cc102920 2023-12-01T01:02:44.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:43 smithi116 ceph-mon[103554]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:44.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:43 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:44.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:43 smithi093 ceph-mon[103327]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:44.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:43 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:44.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.223+0000 7f59d14b1700 1 -- 172.21.15.26:0/4180705408 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59cc107c90 con 0x7f59cc102920 2023-12-01T01:02:44.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.225+0000 7f59b3fff700 1 -- 172.21.15.26:0/4180705408 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+18350 (secure 0 0 0) 0x7f59c40b1e60 con 0x7f59cc102920 2023-12-01T01:02:44.227 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:44.228 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":77,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:06.752812+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:02:44.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.227+0000 7f59d14b1700 1 -- 172.21.15.26:0/4180705408 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f59b40a0570 msgr2=0x7f59b40a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:44.229 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.227+0000 7f59d14b1700 1 --2- 172.21.15.26:0/4180705408 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f59b40a0570 0x7f59b40a2a30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00b580 tx=0x7f59bc005fb0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.227+0000 7f59d14b1700 1 -- 172.21.15.26:0/4180705408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc102920 msgr2=0x7f59cc0736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:44.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.227+0000 7f59d14b1700 1 --2- 172.21.15.26:0/4180705408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc102920 0x7f59cc0736c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f59c400ef30 tx=0x7f59c400c3a0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.227+0000 7f59d14b1700 1 -- 172.21.15.26:0/4180705408 shutdown_connections 2023-12-01T01:02:44.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.227+0000 7f59d14b1700 1 --2- 172.21.15.26:0/4180705408 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f59b40a0570 0x7f59b40a2a30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.227+0000 7f59d14b1700 1 --2- 172.21.15.26:0/4180705408 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc102920 0x7f59cc0736c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.227+0000 7f59d14b1700 1 --2- 172.21.15.26:0/4180705408 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f59cc100d90 0x7f59cc074b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.227+0000 7f59d14b1700 1 --2- 172.21.15.26:0/4180705408 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f59cc101f80 0x7f59cc073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.227+0000 7f59d14b1700 1 -- 172.21.15.26:0/4180705408 >> 172.21.15.26:0/4180705408 conn(0x7f59cc0fc2c0 msgr2=0x7f59cc0fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:44.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.228+0000 7f59d14b1700 1 -- 172.21.15.26:0/4180705408 shutdown_connections 2023-12-01T01:02:44.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.228+0000 7f59d14b1700 1 -- 172.21.15.26:0/4180705408 wait complete. 2023-12-01T01:02:44.241 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:43 smithi026 ceph-mon[98801]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:44.241 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:43 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:44.242 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T00:59:06.411348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T01:02:44.242 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T01:02:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.372+0000 7f6a95ec4700 1 -- 172.21.15.26:0/836942693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a90102350 msgr2=0x7f6a90102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.372+0000 7f6a95ec4700 1 --2- 172.21.15.26:0/836942693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a90102350 0x7f6a90102770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6a800099c0 tx=0x7f6a80009cd0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.372+0000 7f6a95ec4700 1 -- 172.21.15.26:0/836942693 shutdown_connections 2023-12-01T01:02:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.372+0000 7f6a95ec4700 1 --2- 172.21.15.26:0/836942693 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a900ff760 0x7f6a90109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.372+0000 7f6a95ec4700 1 --2- 172.21.15.26:0/836942693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a90102350 0x7f6a90102770 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.372+0000 7f6a95ec4700 1 --2- 172.21.15.26:0/836942693 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a900fedc0 0x7f6a900ff220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.372+0000 7f6a95ec4700 1 -- 172.21.15.26:0/836942693 >> 172.21.15.26:0/836942693 conn(0x7f6a900fa960 msgr2=0x7f6a900fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.373+0000 7f6a95ec4700 1 -- 172.21.15.26:0/836942693 shutdown_connections 2023-12-01T01:02:44.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.373+0000 7f6a95ec4700 1 -- 172.21.15.26:0/836942693 wait complete. 2023-12-01T01:02:44.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.373+0000 7f6a95ec4700 1 Processor -- start 2023-12-01T01:02:44.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.373+0000 7f6a95ec4700 1 -- start start 2023-12-01T01:02:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.373+0000 7f6a95ec4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a900fedc0 0x7f6a90196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a95ec4700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a900ff760 0x7f6a90197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a95ec4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a90102350 0x7f6a9019e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a95ec4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9019e760 con 0x7f6a90102350 2023-12-01T01:02:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a95ec4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9019e8a0 con 0x7f6a900fedc0 2023-12-01T01:02:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a95ec4700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9019ea30 con 0x7f6a900ff760 2023-12-01T01:02:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a8ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a90102350 0x7f6a9019e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a8f7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a900fedc0 0x7f6a90196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a8ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a90102350 0x7f6a9019e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53434/0 (socket says 172.21.15.26:53434) 2023-12-01T01:02:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a8effd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a900ff760 0x7f6a90197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a8ffff700 1 -- 172.21.15.26:0/1962384582 learned_addr learned my addr 172.21.15.26:0/1962384582 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:44.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a8f7fe700 1 -- 172.21.15.26:0/1962384582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a900ff760 msgr2=0x7f6a90197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a8f7fe700 1 --2- 172.21.15.26:0/1962384582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a900ff760 0x7f6a90197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a8f7fe700 1 -- 172.21.15.26:0/1962384582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a90102350 msgr2=0x7f6a9019e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a8f7fe700 1 --2- 172.21.15.26:0/1962384582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a90102350 0x7f6a9019e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a8f7fe700 1 -- 172.21.15.26:0/1962384582 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a800095f0 con 0x7f6a900fedc0 2023-12-01T01:02:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a8effd700 1 --2- 172.21.15.26:0/1962384582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a900ff760 0x7f6a90197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:02:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a8ffff700 1 --2- 172.21.15.26:0/1962384582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a90102350 0x7f6a9019e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:02:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a8f7fe700 1 --2- 172.21.15.26:0/1962384582 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a900fedc0 0x7f6a90196be0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009990 tx=0x7f6a8000f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.374+0000 7f6a8cff9700 1 -- 172.21.15.26:0/1962384582 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8001d070 con 0x7f6a900fedc0 2023-12-01T01:02:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.375+0000 7f6a8cff9700 1 -- 172.21.15.26:0/1962384582 <== mon.2 v2:172.21.15.93:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6a80022470 con 0x7f6a900fedc0 2023-12-01T01:02:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.375+0000 7f6a95ec4700 1 -- 172.21.15.26:0/1962384582 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9019ecb0 con 0x7f6a900fedc0 2023-12-01T01:02:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.375+0000 7f6a8cff9700 1 -- 172.21.15.26:0/1962384582 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80017650 con 0x7f6a900fedc0 2023-12-01T01:02:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.375+0000 7f6a95ec4700 1 -- 172.21.15.26:0/1962384582 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9019f130 con 0x7f6a900fedc0 2023-12-01T01:02:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.376+0000 7f6a95ec4700 1 -- 172.21.15.26:0/1962384582 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a90107e70 con 0x7f6a900fedc0 2023-12-01T01:02:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.377+0000 7f6a8cff9700 1 -- 172.21.15.26:0/1962384582 <== mon.2 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f6a800225e0 con 0x7f6a900fedc0 2023-12-01T01:02:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.377+0000 7f6a8cff9700 1 --2- 172.21.15.26:0/1962384582 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6a780a05a0 0x7f6a780a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.378+0000 7f6a8effd700 1 --2- 172.21.15.26:0/1962384582 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6a780a05a0 0x7f6a780a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.378+0000 7f6a8cff9700 1 -- 172.21.15.26:0/1962384582 <== mon.2 v2:172.21.15.93:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6a800cc7c0 con 0x7f6a900fedc0 2023-12-01T01:02:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.378+0000 7f6a8effd700 1 --2- 172.21.15.26:0/1962384582 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6a780a05a0 0x7f6a780a2a60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6a84011490 tx=0x7f6a84009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.381+0000 7f6a8cff9700 1 -- 172.21.15.26:0/1962384582 <== mon.2 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f6a800967f0 con 0x7f6a900fedc0 2023-12-01T01:02:44.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.589+0000 7f6a95ec4700 1 -- 172.21.15.26:0/1962384582 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a9002ce00 con 0x7f6a900fedc0 2023-12-01T01:02:44.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.590+0000 7f6a8cff9700 1 -- 172.21.15.26:0/1962384582 <== mon.2 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a80099e10 con 0x7f6a900fedc0 2023-12-01T01:02:44.592 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-12-01T01:02:44.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.592+0000 7f6a95ec4700 1 -- 172.21.15.26:0/1962384582 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6a780a05a0 msgr2=0x7f6a780a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:44.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.592+0000 7f6a95ec4700 1 --2- 172.21.15.26:0/1962384582 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6a780a05a0 0x7f6a780a2a60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6a84011490 tx=0x7f6a84009260 comp rx=0 tx=0).stop 2023-12-01T01:02:44.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.592+0000 7f6a95ec4700 1 -- 172.21.15.26:0/1962384582 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a900fedc0 msgr2=0x7f6a90196be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:44.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.592+0000 7f6a95ec4700 1 --2- 172.21.15.26:0/1962384582 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a900fedc0 0x7f6a90196be0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009990 tx=0x7f6a8000f690 comp rx=0 tx=0).stop 2023-12-01T01:02:44.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.592+0000 7f6a95ec4700 1 -- 172.21.15.26:0/1962384582 shutdown_connections 2023-12-01T01:02:44.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.592+0000 7f6a95ec4700 1 --2- 172.21.15.26:0/1962384582 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6a780a05a0 0x7f6a780a2a60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.594 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.592+0000 7f6a95ec4700 1 --2- 172.21.15.26:0/1962384582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a90102350 0x7f6a9019e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.592+0000 7f6a95ec4700 1 --2- 172.21.15.26:0/1962384582 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a900fedc0 0x7f6a90196be0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.592+0000 7f6a95ec4700 1 --2- 172.21.15.26:0/1962384582 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6a900ff760 0x7f6a90197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.592+0000 7f6a95ec4700 1 -- 172.21.15.26:0/1962384582 >> 172.21.15.26:0/1962384582 conn(0x7f6a900fa960 msgr2=0x7f6a900fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:44.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.592+0000 7f6a95ec4700 1 -- 172.21.15.26:0/1962384582 shutdown_connections 2023-12-01T01:02:44.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.592+0000 7f6a95ec4700 1 -- 172.21.15.26:0/1962384582 wait complete. 2023-12-01T01:02:44.606 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-01T01:02:44.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.732+0000 7f2144e52700 1 -- 172.21.15.26:0/3698549262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21400fee10 msgr2=0x7f21400ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:44.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.732+0000 7f2144e52700 1 --2- 172.21.15.26:0/3698549262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21400fee10 0x7f21400ff270 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2128009990 tx=0x7f2128009ca0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.732+0000 7f2144e52700 1 -- 172.21.15.26:0/3698549262 shutdown_connections 2023-12-01T01:02:44.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.732+0000 7f2144e52700 1 --2- 172.21.15.26:0/3698549262 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21400ff7b0 0x7f2140109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.732+0000 7f2144e52700 1 --2- 172.21.15.26:0/3698549262 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21401023a0 0x7f21401027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.732+0000 7f2144e52700 1 --2- 172.21.15.26:0/3698549262 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21400fee10 0x7f21400ff270 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.732+0000 7f2144e52700 1 -- 172.21.15.26:0/3698549262 >> 172.21.15.26:0/3698549262 conn(0x7f21400fa950 msgr2=0x7f21400fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:44.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.732+0000 7f2144e52700 1 -- 172.21.15.26:0/3698549262 shutdown_connections 2023-12-01T01:02:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.732+0000 7f2144e52700 1 -- 172.21.15.26:0/3698549262 wait complete. 2023-12-01T01:02:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.733+0000 7f2144e52700 1 Processor -- start 2023-12-01T01:02:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.733+0000 7f2144e52700 1 -- start start 2023-12-01T01:02:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.733+0000 7f2144e52700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21400fee10 0x7f2140196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.733+0000 7f2144e52700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21400ff7b0 0x7f2140196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.733+0000 7f2144e52700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21401023a0 0x7f214019e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.733+0000 7f2144e52700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214019e630 con 0x7f21400fee10 2023-12-01T01:02:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.733+0000 7f2144e52700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214019e770 con 0x7f21400ff7b0 2023-12-01T01:02:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.733+0000 7f2144e52700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214019e900 con 0x7f21401023a0 2023-12-01T01:02:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f213e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21400fee10 0x7f2140196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f213e59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21400fee10 0x7f2140196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53444/0 (socket says 172.21.15.26:53444) 2023-12-01T01:02:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f213dd9b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21400ff7b0 0x7f2140196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f213e59c700 1 -- 172.21.15.26:0/979368122 learned_addr learned my addr 172.21.15.26:0/979368122 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:44.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f213ed9d700 1 --2- 172.21.15.26:0/979368122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21401023a0 0x7f214019e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f213e59c700 1 -- 172.21.15.26:0/979368122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21401023a0 msgr2=0x7f214019e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f213e59c700 1 --2- 172.21.15.26:0/979368122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21401023a0 0x7f214019e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f213e59c700 1 -- 172.21.15.26:0/979368122 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21400ff7b0 msgr2=0x7f2140196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f213e59c700 1 --2- 172.21.15.26:0/979368122 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21400ff7b0 0x7f2140196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f213e59c700 1 -- 172.21.15.26:0/979368122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2130009520 con 0x7f21400fee10 2023-12-01T01:02:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f213dd9b700 1 --2- 172.21.15.26:0/979368122 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21400ff7b0 0x7f2140196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:02:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f213e59c700 1 --2- 172.21.15.26:0/979368122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21400fee10 0x7f2140196ab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f213000ea50 tx=0x7f213000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f21377fe700 1 -- 172.21.15.26:0/979368122 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213000cbd0 con 0x7f21400fee10 2023-12-01T01:02:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f2144e52700 1 -- 172.21.15.26:0/979368122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21280095f0 con 0x7f21400fee10 2023-12-01T01:02:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f21377fe700 1 -- 172.21.15.26:0/979368122 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f213000cd30 con 0x7f21400fee10 2023-12-01T01:02:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f21377fe700 1 -- 172.21.15.26:0/979368122 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130018660 con 0x7f21400fee10 2023-12-01T01:02:44.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.734+0000 7f2144e52700 1 -- 172.21.15.26:0/979368122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214019efb0 con 0x7f21400fee10 2023-12-01T01:02:44.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.735+0000 7f2144e52700 1 -- 172.21.15.26:0/979368122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2140107dd0 con 0x7f21400fee10 2023-12-01T01:02:44.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.736+0000 7f21377fe700 1 -- 172.21.15.26:0/979368122 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f2130018880 con 0x7f21400fee10 2023-12-01T01:02:44.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.737+0000 7f21377fe700 1 --2- 172.21.15.26:0/979368122 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f212c0a0570 0x7f212c0a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:44.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.737+0000 7f213dd9b700 1 --2- 172.21.15.26:0/979368122 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f212c0a0570 0x7f212c0a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:44.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.738+0000 7f21377fe700 1 -- 172.21.15.26:0/979368122 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2130014070 con 0x7f21400fee10 2023-12-01T01:02:44.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.738+0000 7f213dd9b700 1 --2- 172.21.15.26:0/979368122 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f212c0a0570 0x7f212c0a2a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f212800b2e0 tx=0x7f2128005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:44.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.741+0000 7f21377fe700 1 -- 172.21.15.26:0/979368122 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2130095f40 con 0x7f21400fee10 2023-12-01T01:02:44.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.947+0000 7f2144e52700 1 -- 172.21.15.26:0/979368122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f214002cea0 con 0x7f21400fee10 2023-12-01T01:02:44.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.947+0000 7f21377fe700 1 -- 172.21.15.26:0/979368122 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v77) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2130099560 con 0x7f21400fee10 2023-12-01T01:02:44.949 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:44.949 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-12-01T01:02:44.949 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:02:44.950 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2023-12-01T01:02:44.950 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2023-12-01T01:02:44.950 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:02:44.950 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-12-01T01:02:44.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.949+0000 7f2144e52700 1 -- 172.21.15.26:0/979368122 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f212c0a0570 msgr2=0x7f212c0a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:44.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.949+0000 7f2144e52700 1 --2- 172.21.15.26:0/979368122 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f212c0a0570 0x7f212c0a2a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f212800b2e0 tx=0x7f2128005fb0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.949+0000 7f2144e52700 1 -- 172.21.15.26:0/979368122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21400fee10 msgr2=0x7f2140196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:44.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.949+0000 7f2144e52700 1 --2- 172.21.15.26:0/979368122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21400fee10 0x7f2140196ab0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f213000ea50 tx=0x7f213000ed60 comp rx=0 tx=0).stop 2023-12-01T01:02:44.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.949+0000 7f2144e52700 1 -- 172.21.15.26:0/979368122 shutdown_connections 2023-12-01T01:02:44.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.949+0000 7f2144e52700 1 --2- 172.21.15.26:0/979368122 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f212c0a0570 0x7f212c0a2a30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.949+0000 7f2144e52700 1 --2- 172.21.15.26:0/979368122 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f21401023a0 0x7f214019e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.949+0000 7f2144e52700 1 --2- 172.21.15.26:0/979368122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21400fee10 0x7f2140196ab0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.949+0000 7f2144e52700 1 --2- 172.21.15.26:0/979368122 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21400ff7b0 0x7f2140196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:44.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.949+0000 7f2144e52700 1 -- 172.21.15.26:0/979368122 >> 172.21.15.26:0/979368122 conn(0x7f21400fa950 msgr2=0x7f21400fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:44.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.949+0000 7f2144e52700 1 -- 172.21.15.26:0/979368122 shutdown_connections 2023-12-01T01:02:44.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:44.949+0000 7f2144e52700 1 -- 172.21.15.26:0/979368122 wait complete. 2023-12-01T01:02:44.963 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:44 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/976579911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:44.963 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:44.963 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:44.963 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:44.963 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:44.963 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:44.963 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:44.964 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:44 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/4180705408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:44.964 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:44 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1962384582' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:02:44.964 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:44.964 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:02:44.964 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:44 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:44.965 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-01T01:02:44.965 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-01T01:02:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.098+0000 7fa823859700 1 -- 172.21.15.26:0/3939527817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c101f70 msgr2=0x7fa81c1023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.098+0000 7fa823859700 1 --2- 172.21.15.26:0/3939527817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c101f70 0x7fa81c1023d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa80c0099c0 tx=0x7fa80c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:02:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.098+0000 7fa823859700 1 -- 172.21.15.26:0/3939527817 shutdown_connections 2023-12-01T01:02:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.098+0000 7fa823859700 1 --2- 172.21.15.26:0/3939527817 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa81c102910 0x7fa81c1091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.098+0000 7fa823859700 1 --2- 172.21.15.26:0/3939527817 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa81c100d80 0x7fa81c1011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.098+0000 7fa823859700 1 --2- 172.21.15.26:0/3939527817 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c101f70 0x7fa81c1023d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.098+0000 7fa823859700 1 -- 172.21.15.26:0/3939527817 >> 172.21.15.26:0/3939527817 conn(0x7fa81c0fc310 msgr2=0x7fa81c0fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.098+0000 7fa823859700 1 -- 172.21.15.26:0/3939527817 shutdown_connections 2023-12-01T01:02:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.098+0000 7fa823859700 1 -- 172.21.15.26:0/3939527817 wait complete. 2023-12-01T01:02:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa823859700 1 Processor -- start 2023-12-01T01:02:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa823859700 1 -- start start 2023-12-01T01:02:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa823859700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa81c100d80 0x7fa81c074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa823859700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c101f70 0x7fa81c073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa823859700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa81c102910 0x7fa81c0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa823859700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c073e60 con 0x7fa81c101f70 2023-12-01T01:02:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa823859700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c073fd0 con 0x7fa81c100d80 2023-12-01T01:02:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa823859700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa81c1a0b80 con 0x7fa81c102910 2023-12-01T01:02:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa820df4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c101f70 0x7fa81c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa820df4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c101f70 0x7fa81c073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53460/0 (socket says 172.21.15.26:53460) 2023-12-01T01:02:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa820df4700 1 -- 172.21.15.26:0/844641904 learned_addr learned my addr 172.21.15.26:0/844641904 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa8215f5700 1 --2- 172.21.15.26:0/844641904 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa81c100d80 0x7fa81c074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa820df4700 1 -- 172.21.15.26:0/844641904 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa81c102910 msgr2=0x7fa81c0736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa820df4700 1 --2- 172.21.15.26:0/844641904 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa81c102910 0x7fa81c0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa820df4700 1 -- 172.21.15.26:0/844641904 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa81c100d80 msgr2=0x7fa81c074b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa820df4700 1 --2- 172.21.15.26:0/844641904 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa81c100d80 0x7fa81c074b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa820df4700 1 -- 172.21.15.26:0/844641904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c0095f0 con 0x7fa81c101f70 2023-12-01T01:02:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.099+0000 7fa8215f5700 1 --2- 172.21.15.26:0/844641904 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa81c100d80 0x7fa81c074b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:02:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.100+0000 7fa820df4700 1 --2- 172.21.15.26:0/844641904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c101f70 0x7fa81c073180 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c010 tx=0x7fa80c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.100+0000 7fa8127fc700 1 -- 172.21.15.26:0/844641904 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c01d070 con 0x7fa81c101f70 2023-12-01T01:02:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.100+0000 7fa8127fc700 1 -- 172.21.15.26:0/844641904 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa80c00fbf0 con 0x7fa81c101f70 2023-12-01T01:02:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.100+0000 7fa823859700 1 -- 172.21.15.26:0/844641904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa81c1a0e00 con 0x7fa81c101f70 2023-12-01T01:02:45.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.100+0000 7fa8127fc700 1 -- 172.21.15.26:0/844641904 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c017650 con 0x7fa81c101f70 2023-12-01T01:02:45.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.100+0000 7fa823859700 1 -- 172.21.15.26:0/844641904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81c1a1220 con 0x7fa81c101f70 2023-12-01T01:02:45.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.101+0000 7fa823859700 1 -- 172.21.15.26:0/844641904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81c107cb0 con 0x7fa81c101f70 2023-12-01T01:02:45.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.102+0000 7fa8127fc700 1 -- 172.21.15.26:0/844641904 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fa80c022470 con 0x7fa81c101f70 2023-12-01T01:02:45.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.102+0000 7fa8127fc700 1 --2- 172.21.15.26:0/844641904 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa8080a0520 0x7fa8080a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:45.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.102+0000 7fa8127fc700 1 -- 172.21.15.26:0/844641904 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa80c0cc8b0 con 0x7fa81c101f70 2023-12-01T01:02:45.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.102+0000 7fa8215f5700 1 --2- 172.21.15.26:0/844641904 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa8080a0520 0x7fa8080a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:45.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.103+0000 7fa8215f5700 1 --2- 172.21.15.26:0/844641904 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa8080a0520 0x7fa8080a29e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa81c101dd0 tx=0x7fa81400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:45.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.107+0000 7fa8127fc700 1 -- 172.21.15.26:0/844641904 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa80c096980 con 0x7fa81c101f70 2023-12-01T01:02:45.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:44 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/976579911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:45.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:45.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:45.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:45.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:45.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:45.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:45.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:44 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/4180705408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:45.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:44 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1962384582' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:02:45.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:45.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:02:45.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:44 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:45.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:44 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/976579911' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:45.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:45.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:45.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:45.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:45.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:45.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:45.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:44 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/4180705408' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:45.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:44 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1962384582' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:02:45.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:45.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:02:45.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:44 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:45.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.321+0000 7fa823859700 1 -- 172.21.15.26:0/844641904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa81c10c740 con 0x7fa81c101f70 2023-12-01T01:02:45.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.811+0000 7fa8127fc700 1 -- 172.21.15.26:0/844641904 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v78) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa80c099fa0 con 0x7fa81c101f70 2023-12-01T01:02:45.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.817+0000 7fa823859700 1 -- 172.21.15.26:0/844641904 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa8080a0520 msgr2=0x7fa8080a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:45.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.817+0000 7fa823859700 1 --2- 172.21.15.26:0/844641904 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa8080a0520 0x7fa8080a29e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa81c101dd0 tx=0x7fa81400b040 comp rx=0 tx=0).stop 2023-12-01T01:02:45.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.817+0000 7fa823859700 1 -- 172.21.15.26:0/844641904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c101f70 msgr2=0x7fa81c073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:45.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.817+0000 7fa823859700 1 --2- 172.21.15.26:0/844641904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c101f70 0x7fa81c073180 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa80c00c010 tx=0x7fa80c009580 comp rx=0 tx=0).stop 2023-12-01T01:02:45.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.817+0000 7fa823859700 1 -- 172.21.15.26:0/844641904 shutdown_connections 2023-12-01T01:02:45.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.817+0000 7fa823859700 1 --2- 172.21.15.26:0/844641904 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa8080a0520 0x7fa8080a29e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:45.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.817+0000 7fa823859700 1 --2- 172.21.15.26:0/844641904 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa81c102910 0x7fa81c0736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:45.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.817+0000 7fa823859700 1 --2- 172.21.15.26:0/844641904 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa81c100d80 0x7fa81c074b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:45.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.817+0000 7fa823859700 1 --2- 172.21.15.26:0/844641904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa81c101f70 0x7fa81c073180 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:45.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.817+0000 7fa823859700 1 -- 172.21.15.26:0/844641904 >> 172.21.15.26:0/844641904 conn(0x7fa81c0fc310 msgr2=0x7fa81c0fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:45.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.818+0000 7fa823859700 1 -- 172.21.15.26:0/844641904 shutdown_connections 2023-12-01T01:02:45.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.818+0000 7fa823859700 1 -- 172.21.15.26:0/844641904 wait complete. 2023-12-01T01:02:45.821 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2023-12-01T01:02:45.832 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-01T01:02:45.978 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.975+0000 7f918628f700 1 -- 172.21.15.26:0/3626869025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91801018b0 msgr2=0x7f9180103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:45.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.975+0000 7f918628f700 1 --2- 172.21.15.26:0/3626869025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91801018b0 0x7f9180103ca0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9170009990 tx=0x7f9170009ca0 comp rx=0 tx=0).stop 2023-12-01T01:02:45.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.976+0000 7f918628f700 1 -- 172.21.15.26:0/3626869025 shutdown_connections 2023-12-01T01:02:45.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.976+0000 7f918628f700 1 --2- 172.21.15.26:0/3626869025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9180106b10 0x7f9180108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:45.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.976+0000 7f918628f700 1 --2- 172.21.15.26:0/3626869025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91801018b0 0x7f9180103ca0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:45.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.976+0000 7f918628f700 1 --2- 172.21.15.26:0/3626869025 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91801041e0 0x7f91801065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:45.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.976+0000 7f918628f700 1 -- 172.21.15.26:0/3626869025 >> 172.21.15.26:0/3626869025 conn(0x7f91800fb220 msgr2=0x7f91800fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:45.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.976+0000 7f918628f700 1 -- 172.21.15.26:0/3626869025 shutdown_connections 2023-12-01T01:02:45.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.976+0000 7f918628f700 1 -- 172.21.15.26:0/3626869025 wait complete. 2023-12-01T01:02:45.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.977+0000 7f918628f700 1 Processor -- start 2023-12-01T01:02:45.979 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.977+0000 7f918628f700 1 -- start start 2023-12-01T01:02:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.977+0000 7f918628f700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91801018b0 0x7f9180196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.977+0000 7f918628f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91801041e0 0x7f9180197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:45.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.977+0000 7f918628f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9180106b10 0x7f918019e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.977+0000 7f918628f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918019e6b0 con 0x7f9180106b10 2023-12-01T01:02:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.977+0000 7f918628f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918019e7f0 con 0x7f91801041e0 2023-12-01T01:02:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.977+0000 7f918628f700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918019e980 con 0x7f91801018b0 2023-12-01T01:02:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.978+0000 7f917f7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91801041e0 0x7f9180197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.978+0000 7f918482c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9180106b10 0x7f918019e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.978+0000 7f918482c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9180106b10 0x7f918019e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53476/0 (socket says 172.21.15.26:53476) 2023-12-01T01:02:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.978+0000 7f917f7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91801041e0 0x7f9180197070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:44210/0 (socket says 172.21.15.26:44210) 2023-12-01T01:02:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.978+0000 7f918482c700 1 -- 172.21.15.26:0/2468464690 learned_addr learned my addr 172.21.15.26:0/2468464690 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.978+0000 7f917ffff700 1 --2- 172.21.15.26:0/2468464690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91801018b0 0x7f9180196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:45.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.978+0000 7f917f7fe700 1 -- 172.21.15.26:0/2468464690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91801018b0 msgr2=0x7f9180196b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.978+0000 7f917f7fe700 1 --2- 172.21.15.26:0/2468464690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91801018b0 0x7f9180196b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.978+0000 7f917f7fe700 1 -- 172.21.15.26:0/2468464690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9180106b10 msgr2=0x7f918019e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.978+0000 7f917f7fe700 1 --2- 172.21.15.26:0/2468464690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9180106b10 0x7f918019e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.978+0000 7f917f7fe700 1 -- 172.21.15.26:0/2468464690 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91700095f0 con 0x7f91801041e0 2023-12-01T01:02:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.978+0000 7f918482c700 1 --2- 172.21.15.26:0/2468464690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9180106b10 0x7f918019e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:02:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.978+0000 7f917f7fe700 1 --2- 172.21.15.26:0/2468464690 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91801041e0 0x7f9180197070 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f917400e9f0 tx=0x7f917400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.978+0000 7f917d7fa700 1 -- 172.21.15.26:0/2468464690 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917400c9c0 con 0x7f91801041e0 2023-12-01T01:02:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.979+0000 7f917d7fa700 1 -- 172.21.15.26:0/2468464690 <== mon.2 v2:172.21.15.93:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9174010430 con 0x7f91801041e0 2023-12-01T01:02:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.979+0000 7f918628f700 1 -- 172.21.15.26:0/2468464690 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f918019ec60 con 0x7f91801041e0 2023-12-01T01:02:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.979+0000 7f917d7fa700 1 -- 172.21.15.26:0/2468464690 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9174018680 con 0x7f91801041e0 2023-12-01T01:02:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.979+0000 7f918628f700 1 -- 172.21.15.26:0/2468464690 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918019f170 con 0x7f91801041e0 2023-12-01T01:02:45.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.979+0000 7f918628f700 1 -- 172.21.15.26:0/2468464690 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91800fcda0 con 0x7f91801041e0 2023-12-01T01:02:45.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.981+0000 7f917d7fa700 1 -- 172.21.15.26:0/2468464690 <== mon.2 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f9174010910 con 0x7f91801041e0 2023-12-01T01:02:45.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.981+0000 7f917d7fa700 1 --2- 172.21.15.26:0/2468464690 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f91680a0520 0x7f91680a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:45.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.981+0000 7f917ffff700 1 --2- 172.21.15.26:0/2468464690 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f91680a0520 0x7f91680a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:45.984 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.981+0000 7f917d7fa700 1 -- 172.21.15.26:0/2468464690 <== mon.2 v2:172.21.15.93:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f9174014070 con 0x7f91801041e0 2023-12-01T01:02:45.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.982+0000 7f917ffff700 1 --2- 172.21.15.26:0/2468464690 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f91680a0520 0x7f91680a29e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f917000b2e0 tx=0x7f9170005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:45.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:45.984+0000 7f917d7fa700 1 -- 172.21.15.26:0/2468464690 <== mon.2 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9174095a70 con 0x7f91801041e0 2023-12-01T01:02:46.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:45 smithi116 ceph-mon[103554]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:46.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:45 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:02:46.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:45 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/979368122' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-12-01T01:02:46.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:45 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/844641904' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-01T01:02:46.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.191+0000 7f918628f700 1 -- 172.21.15.26:0/2468464690 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f918002cc70 con 0x7f91801041e0 2023-12-01T01:02:46.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:45 smithi093 ceph-mon[103327]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:46.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:45 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:02:46.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:45 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/979368122' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-12-01T01:02:46.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:45 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/844641904' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-01T01:02:46.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:45 smithi026 ceph-mon[98801]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:46.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:45 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:02:46.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:45 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/979368122' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-12-01T01:02:46.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:45 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/844641904' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-01T01:02:46.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.821+0000 7f917d7fa700 1 -- 172.21.15.26:0/2468464690 <== mon.2 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) v1 ==== 170+0+0 (secure 0 0 0) 0x7f91740105a0 con 0x7f91801041e0 2023-12-01T01:02:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.825+0000 7f918628f700 1 -- 172.21.15.26:0/2468464690 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f91680a0520 msgr2=0x7f91680a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.825+0000 7f918628f700 1 --2- 172.21.15.26:0/2468464690 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f91680a0520 0x7f91680a29e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f917000b2e0 tx=0x7f9170005fb0 comp rx=0 tx=0).stop 2023-12-01T01:02:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.825+0000 7f918628f700 1 -- 172.21.15.26:0/2468464690 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91801041e0 msgr2=0x7f9180197070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:46.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.825+0000 7f918628f700 1 --2- 172.21.15.26:0/2468464690 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91801041e0 0x7f9180197070 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f917400e9f0 tx=0x7f917400ed00 comp rx=0 tx=0).stop 2023-12-01T01:02:46.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.830+0000 7f918628f700 1 -- 172.21.15.26:0/2468464690 shutdown_connections 2023-12-01T01:02:46.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.830+0000 7f918628f700 1 --2- 172.21.15.26:0/2468464690 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f91680a0520 0x7f91680a29e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:46.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.830+0000 7f918628f700 1 --2- 172.21.15.26:0/2468464690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9180106b10 0x7f918019e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:46.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.830+0000 7f918628f700 1 --2- 172.21.15.26:0/2468464690 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91801018b0 0x7f9180196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:46.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.830+0000 7f918628f700 1 --2- 172.21.15.26:0/2468464690 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91801041e0 0x7f9180197070 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:46.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.830+0000 7f918628f700 1 -- 172.21.15.26:0/2468464690 >> 172.21.15.26:0/2468464690 conn(0x7f91800fb220 msgr2=0x7f9180102580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:46.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.833+0000 7f918628f700 1 -- 172.21.15.26:0/2468464690 shutdown_connections 2023-12-01T01:02:46.835 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.833+0000 7f918628f700 1 -- 172.21.15.26:0/2468464690 wait complete. 2023-12-01T01:02:46.836 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2023-12-01T01:02:46.848 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-01T01:02:46.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.989+0000 7fdfccc8e700 1 -- 172.21.15.26:0/2850278098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc81029a0 msgr2=0x7fdfc8109250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:46.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.989+0000 7fdfccc8e700 1 --2- 172.21.15.26:0/2850278098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc81029a0 0x7fdfc8109250 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdfc000b0a0 tx=0x7fdfc000b3b0 comp rx=0 tx=0).stop 2023-12-01T01:02:46.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.989+0000 7fdfccc8e700 1 -- 172.21.15.26:0/2850278098 shutdown_connections 2023-12-01T01:02:46.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.989+0000 7fdfccc8e700 1 --2- 172.21.15.26:0/2850278098 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc81029a0 0x7fdfc8109250 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:46.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.989+0000 7fdfccc8e700 1 --2- 172.21.15.26:0/2850278098 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfc80ff030 0x7fdfc80ff450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:46.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.989+0000 7fdfccc8e700 1 --2- 172.21.15.26:0/2850278098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfc8102000 0x7fdfc8102460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:46.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.989+0000 7fdfccc8e700 1 -- 172.21.15.26:0/2850278098 >> 172.21.15.26:0/2850278098 conn(0x7fdfc80fa960 msgr2=0x7fdfc80fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:46.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.989+0000 7fdfccc8e700 1 -- 172.21.15.26:0/2850278098 shutdown_connections 2023-12-01T01:02:46.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.989+0000 7fdfccc8e700 1 -- 172.21.15.26:0/2850278098 wait complete. 2023-12-01T01:02:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfccc8e700 1 Processor -- start 2023-12-01T01:02:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfccc8e700 1 -- start start 2023-12-01T01:02:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfccc8e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc80ff030 0x7fdfc8196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfccc8e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfc8102000 0x7fdfc81971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfccc8e700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfc81029a0 0x7fdfc819e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfccc8e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc819e7b0 con 0x7fdfc80ff030 2023-12-01T01:02:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfccc8e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc819e920 con 0x7fdfc8102000 2023-12-01T01:02:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfccc8e700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc819eae0 con 0x7fdfc81029a0 2023-12-01T01:02:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfc659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc80ff030 0x7fdfc8196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfc659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc80ff030 0x7fdfc8196c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53490/0 (socket says 172.21.15.26:53490) 2023-12-01T01:02:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfc659c700 1 -- 172.21.15.26:0/4171911721 learned_addr learned my addr 172.21.15.26:0/4171911721 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfc5d9b700 1 --2- 172.21.15.26:0/4171911721 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfc8102000 0x7fdfc81971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:46.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfc6d9d700 1 --2- 172.21.15.26:0/4171911721 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfc81029a0 0x7fdfc819e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfc659c700 1 -- 172.21.15.26:0/4171911721 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfc81029a0 msgr2=0x7fdfc819e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfc659c700 1 --2- 172.21.15.26:0/4171911721 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfc81029a0 0x7fdfc819e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfc659c700 1 -- 172.21.15.26:0/4171911721 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfc8102000 msgr2=0x7fdfc81971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfc659c700 1 --2- 172.21.15.26:0/4171911721 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfc8102000 0x7fdfc81971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfc659c700 1 -- 172.21.15.26:0/4171911721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc0009d00 con 0x7fdfc80ff030 2023-12-01T01:02:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.990+0000 7fdfc659c700 1 --2- 172.21.15.26:0/4171911721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc80ff030 0x7fdfc8196c70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800d980 tx=0x7fdfb800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.991+0000 7fdfb77fe700 1 -- 172.21.15.26:0/4171911721 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb800f890 con 0x7fdfc80ff030 2023-12-01T01:02:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.991+0000 7fdfccc8e700 1 -- 172.21.15.26:0/4171911721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc819edc0 con 0x7fdfc80ff030 2023-12-01T01:02:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.991+0000 7fdfb77fe700 1 -- 172.21.15.26:0/4171911721 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdfb8010460 con 0x7fdfc80ff030 2023-12-01T01:02:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.991+0000 7fdfb77fe700 1 -- 172.21.15.26:0/4171911721 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb800e610 con 0x7fdfc80ff030 2023-12-01T01:02:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.991+0000 7fdfccc8e700 1 -- 172.21.15.26:0/4171911721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc819f210 con 0x7fdfc80ff030 2023-12-01T01:02:46.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.992+0000 7fdfccc8e700 1 -- 172.21.15.26:0/4171911721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc810c6d0 con 0x7fdfc80ff030 2023-12-01T01:02:46.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.993+0000 7fdfb77fe700 1 -- 172.21.15.26:0/4171911721 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fdfb8010960 con 0x7fdfc80ff030 2023-12-01T01:02:46.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.993+0000 7fdfb77fe700 1 --2- 172.21.15.26:0/4171911721 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdfb00a0520 0x7fdfb00a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:46.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.994+0000 7fdfc5d9b700 1 --2- 172.21.15.26:0/4171911721 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdfb00a0520 0x7fdfb00a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:46.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.994+0000 7fdfb77fe700 1 -- 172.21.15.26:0/4171911721 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7879+0+0 (secure 0 0 0) 0x7fdfb80cb280 con 0x7fdfc80ff030 2023-12-01T01:02:46.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.994+0000 7fdfc5d9b700 1 --2- 172.21.15.26:0/4171911721 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdfb00a0520 0x7fdfb00a29e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc005950 tx=0x7fdfbc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:46.999 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:46.997+0000 7fdfb77fe700 1 -- 172.21.15.26:0/4171911721 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fdfb8094fd0 con 0x7fdfc80ff030 2023-12-01T01:02:47.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:46 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/844641904' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-12-01T01:02:47.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:46 smithi116 ceph-mon[103554]: osdmap e78: 12 total, 12 up, 12 in 2023-12-01T01:02:47.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:46 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2468464690' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-01T01:02:47.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:46 smithi116 ceph-mon[103554]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-01T01:02:47.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:46 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/844641904' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-12-01T01:02:47.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:46 smithi093 ceph-mon[103327]: osdmap e78: 12 total, 12 up, 12 in 2023-12-01T01:02:47.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:46 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2468464690' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-01T01:02:47.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:46 smithi093 ceph-mon[103327]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-01T01:02:47.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.250+0000 7fdfccc8e700 1 -- 172.21.15.26:0/4171911721 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdfc8107c70 con 0x7fdfc80ff030 2023-12-01T01:02:47.263 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.257+0000 7fdfb77fe700 1 -- 172.21.15.26:0/4171911721 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdfb80985f0 con 0x7fdfc80ff030 2023-12-01T01:02:47.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.263+0000 7fdfccc8e700 1 -- 172.21.15.26:0/4171911721 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdfb00a0520 msgr2=0x7fdfb00a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:47.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.263+0000 7fdfccc8e700 1 --2- 172.21.15.26:0/4171911721 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdfb00a0520 0x7fdfb00a29e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc005950 tx=0x7fdfbc00b410 comp rx=0 tx=0).stop 2023-12-01T01:02:47.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.263+0000 7fdfccc8e700 1 -- 172.21.15.26:0/4171911721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc80ff030 msgr2=0x7fdfc8196c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:47.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.263+0000 7fdfccc8e700 1 --2- 172.21.15.26:0/4171911721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc80ff030 0x7fdfc8196c70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800d980 tx=0x7fdfb800dc90 comp rx=0 tx=0).stop 2023-12-01T01:02:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.264+0000 7fdfccc8e700 1 -- 172.21.15.26:0/4171911721 shutdown_connections 2023-12-01T01:02:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.264+0000 7fdfccc8e700 1 --2- 172.21.15.26:0/4171911721 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdfb00a0520 0x7fdfb00a29e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.264+0000 7fdfccc8e700 1 --2- 172.21.15.26:0/4171911721 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfc81029a0 0x7fdfc819e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.264+0000 7fdfccc8e700 1 --2- 172.21.15.26:0/4171911721 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfc80ff030 0x7fdfc8196c70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.264+0000 7fdfccc8e700 1 --2- 172.21.15.26:0/4171911721 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfc8102000 0x7fdfc81971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.264+0000 7fdfccc8e700 1 -- 172.21.15.26:0/4171911721 >> 172.21.15.26:0/4171911721 conn(0x7fdfc80fa960 msgr2=0x7fdfc80fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.264+0000 7fdfccc8e700 1 -- 172.21.15.26:0/4171911721 shutdown_connections 2023-12-01T01:02:47.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.264+0000 7fdfccc8e700 1 -- 172.21.15.26:0/4171911721 wait complete. 2023-12-01T01:02:47.269 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 2 and data pool 3 2023-12-01T01:02:47.289 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:46 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/844641904' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-12-01T01:02:47.289 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:46 smithi026 ceph-mon[98801]: osdmap e78: 12 total, 12 up, 12 in 2023-12-01T01:02:47.289 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:46 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2468464690' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-01T01:02:47.289 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:46 smithi026 ceph-mon[98801]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-01T01:02:47.290 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:02:47.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.430+0000 7f99e5aa5700 1 -- 172.21.15.26:0/2034208000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e0100e60 msgr2=0x7f99e01012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:47.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.430+0000 7f99e5aa5700 1 --2- 172.21.15.26:0/2034208000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e0100e60 0x7f99e01012c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f99c80099c0 tx=0x7f99c8009cd0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.430+0000 7f99e5aa5700 1 -- 172.21.15.26:0/2034208000 shutdown_connections 2023-12-01T01:02:47.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.430+0000 7f99e5aa5700 1 --2- 172.21.15.26:0/2034208000 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99e0101800 0x7f99e01080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.430+0000 7f99e5aa5700 1 --2- 172.21.15.26:0/2034208000 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99e00ffc70 0x7f99e0100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.430+0000 7f99e5aa5700 1 --2- 172.21.15.26:0/2034208000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e0100e60 0x7f99e01012c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.430+0000 7f99e5aa5700 1 -- 172.21.15.26:0/2034208000 >> 172.21.15.26:0/2034208000 conn(0x7f99e00fb1c0 msgr2=0x7f99e00fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:47.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.430+0000 7f99e5aa5700 1 -- 172.21.15.26:0/2034208000 shutdown_connections 2023-12-01T01:02:47.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.430+0000 7f99e5aa5700 1 -- 172.21.15.26:0/2034208000 wait complete. 2023-12-01T01:02:47.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.431+0000 7f99e5aa5700 1 Processor -- start 2023-12-01T01:02:47.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.431+0000 7f99e5aa5700 1 -- start start 2023-12-01T01:02:47.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.431+0000 7f99e5aa5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e00ffc70 0x7f99e0068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:47.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.431+0000 7f99e5aa5700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99e0100e60 0x7f99e019b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:47.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.431+0000 7f99e5aa5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99e0101800 0x7f99e019de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:47.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.431+0000 7f99e5aa5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e019e5e0 con 0x7f99e00ffc70 2023-12-01T01:02:47.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.431+0000 7f99e5aa5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e019e750 con 0x7f99e0101800 2023-12-01T01:02:47.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.431+0000 7f99e5aa5700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e019e910 con 0x7f99e0100e60 2023-12-01T01:02:47.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.431+0000 7f99df7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e00ffc70 0x7f99e0068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:47.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.431+0000 7f99df7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e00ffc70 0x7f99e0068a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53508/0 (socket says 172.21.15.26:53508) 2023-12-01T01:02:47.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.431+0000 7f99df7fe700 1 -- 172.21.15.26:0/1493920475 learned_addr learned my addr 172.21.15.26:0/1493920475 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:47.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.431+0000 7f99dffff700 1 --2- 172.21.15.26:0/1493920475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99e0101800 0x7f99e019de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:47.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.431+0000 7f99deffd700 1 --2- 172.21.15.26:0/1493920475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99e0100e60 0x7f99e019b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:47.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.432+0000 7f99df7fe700 1 -- 172.21.15.26:0/1493920475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99e0100e60 msgr2=0x7f99e019b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:47.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.432+0000 7f99df7fe700 1 --2- 172.21.15.26:0/1493920475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99e0100e60 0x7f99e019b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.432+0000 7f99df7fe700 1 -- 172.21.15.26:0/1493920475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99e0101800 msgr2=0x7f99e019de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:47.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.432+0000 7f99df7fe700 1 --2- 172.21.15.26:0/1493920475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99e0101800 0x7f99e019de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.432+0000 7f99df7fe700 1 -- 172.21.15.26:0/1493920475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c80095f0 con 0x7f99e00ffc70 2023-12-01T01:02:47.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.432+0000 7f99dffff700 1 --2- 172.21.15.26:0/1493920475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99e0101800 0x7f99e019de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:02:47.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.432+0000 7f99df7fe700 1 --2- 172.21.15.26:0/1493920475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e00ffc70 0x7f99e0068a60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f99d000c990 tx=0x7f99d000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:47.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.432+0000 7f99dcff9700 1 -- 172.21.15.26:0/1493920475 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0007940 con 0x7f99e00ffc70 2023-12-01T01:02:47.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.432+0000 7f99dcff9700 1 -- 172.21.15.26:0/1493920475 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f99d000f450 con 0x7f99e00ffc70 2023-12-01T01:02:47.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.432+0000 7f99e5aa5700 1 -- 172.21.15.26:0/1493920475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e019ebf0 con 0x7f99e00ffc70 2023-12-01T01:02:47.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.432+0000 7f99dcff9700 1 -- 172.21.15.26:0/1493920475 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d0018640 con 0x7f99e00ffc70 2023-12-01T01:02:47.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.432+0000 7f99e5aa5700 1 -- 172.21.15.26:0/1493920475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e019f150 con 0x7f99e00ffc70 2023-12-01T01:02:47.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.433+0000 7f99e5aa5700 1 -- 172.21.15.26:0/1493920475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e0107110 con 0x7f99e00ffc70 2023-12-01T01:02:47.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.434+0000 7f99dcff9700 1 -- 172.21.15.26:0/1493920475 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f99d000f950 con 0x7f99e00ffc70 2023-12-01T01:02:47.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.435+0000 7f99dcff9700 1 --2- 172.21.15.26:0/1493920475 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f99cc0a05f0 0x7f99cc0a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:47.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.435+0000 7f99dcff9700 1 -- 172.21.15.26:0/1493920475 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f99d00cb860 con 0x7f99e00ffc70 2023-12-01T01:02:47.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.435+0000 7f99deffd700 1 --2- 172.21.15.26:0/1493920475 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f99cc0a05f0 0x7f99cc0a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:47.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.435+0000 7f99deffd700 1 --2- 172.21.15.26:0/1493920475 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f99cc0a05f0 0x7f99cc0a2ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f99c800b580 tx=0x7f99c8003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:47.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.439+0000 7f99dcff9700 1 -- 172.21.15.26:0/1493920475 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f99d00955c0 con 0x7f99e00ffc70 2023-12-01T01:02:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.670+0000 7f99e5aa5700 1 -- 172.21.15.26:0/1493920475 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99e002ce80 con 0x7f99e00ffc70 2023-12-01T01:02:47.673 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.671+0000 7f99dcff9700 1 -- 172.21.15.26:0/1493920475 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+22060 (secure 0 0 0) 0x7f99d0098be0 con 0x7f99e00ffc70 2023-12-01T01:02:47.674 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:47.674 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":80,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:47.252511+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:02:47.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.673+0000 7f99e5aa5700 1 -- 172.21.15.26:0/1493920475 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f99cc0a05f0 msgr2=0x7f99cc0a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:47.675 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.673+0000 7f99e5aa5700 1 --2- 172.21.15.26:0/1493920475 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f99cc0a05f0 0x7f99cc0a2ab0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f99c800b580 tx=0x7f99c8003680 comp rx=0 tx=0).stop 2023-12-01T01:02:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.673+0000 7f99e5aa5700 1 -- 172.21.15.26:0/1493920475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e00ffc70 msgr2=0x7f99e0068a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.673+0000 7f99e5aa5700 1 --2- 172.21.15.26:0/1493920475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e00ffc70 0x7f99e0068a60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f99d000c990 tx=0x7f99d000cca0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.673+0000 7f99e5aa5700 1 -- 172.21.15.26:0/1493920475 shutdown_connections 2023-12-01T01:02:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.673+0000 7f99e5aa5700 1 --2- 172.21.15.26:0/1493920475 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f99cc0a05f0 0x7f99cc0a2ab0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.673+0000 7f99e5aa5700 1 --2- 172.21.15.26:0/1493920475 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99e0101800 0x7f99e019de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.673+0000 7f99e5aa5700 1 --2- 172.21.15.26:0/1493920475 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99e00ffc70 0x7f99e0068a60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.673+0000 7f99e5aa5700 1 --2- 172.21.15.26:0/1493920475 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99e0100e60 0x7f99e019b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.673+0000 7f99e5aa5700 1 -- 172.21.15.26:0/1493920475 >> 172.21.15.26:0/1493920475 conn(0x7f99e00fb1c0 msgr2=0x7f99e0104250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.673+0000 7f99e5aa5700 1 -- 172.21.15.26:0/1493920475 shutdown_connections 2023-12-01T01:02:47.676 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.673+0000 7f99e5aa5700 1 -- 172.21.15.26:0/1493920475 wait complete. 2023-12-01T01:02:47.688 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:02:47.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.813+0000 7f288421c700 1 -- 172.21.15.26:0/3319640061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f287c0ffc70 msgr2=0x7f287c100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:47.818 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.813+0000 7f288421c700 1 --2- 172.21.15.26:0/3319640061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f287c0ffc70 0x7f287c100090 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2878009990 tx=0x7f2878009ca0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.813+0000 7f288421c700 1 -- 172.21.15.26:0/3319640061 shutdown_connections 2023-12-01T01:02:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.813+0000 7f288421c700 1 --2- 172.21.15.26:0/3319640061 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c101800 0x7f287c1080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.813+0000 7f288421c700 1 --2- 172.21.15.26:0/3319640061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f287c0ffc70 0x7f287c100090 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.813+0000 7f288421c700 1 --2- 172.21.15.26:0/3319640061 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c100e60 0x7f287c1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.813+0000 7f288421c700 1 -- 172.21.15.26:0/3319640061 >> 172.21.15.26:0/3319640061 conn(0x7f287c0fb1c0 msgr2=0x7f287c0fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.814+0000 7f288421c700 1 -- 172.21.15.26:0/3319640061 shutdown_connections 2023-12-01T01:02:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.814+0000 7f288421c700 1 -- 172.21.15.26:0/3319640061 wait complete. 2023-12-01T01:02:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.814+0000 7f288421c700 1 Processor -- start 2023-12-01T01:02:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.814+0000 7f288421c700 1 -- start start 2023-12-01T01:02:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.814+0000 7f288421c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0ffc70 0x7f287c196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.814+0000 7f288421c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f287c100e60 0x7f287c197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:47.819 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.814+0000 7f288421c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c101800 0x7f287c19e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.814+0000 7f288421c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c19e6c0 con 0x7f287c100e60 2023-12-01T01:02:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.814+0000 7f288421c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c19e800 con 0x7f287c0ffc70 2023-12-01T01:02:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.814+0000 7f288421c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c19e990 con 0x7f287c101800 2023-12-01T01:02:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.814+0000 7f28817b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f287c100e60 0x7f287c197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.814+0000 7f2881fb8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0ffc70 0x7f287c196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.814+0000 7f28817b7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f287c100e60 0x7f287c197080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53524/0 (socket says 172.21.15.26:53524) 2023-12-01T01:02:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.815+0000 7f28817b7700 1 -- 172.21.15.26:0/1757934806 learned_addr learned my addr 172.21.15.26:0/1757934806 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.815+0000 7f2881fb8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0ffc70 0x7f287c196b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:44260/0 (socket says 172.21.15.26:44260) 2023-12-01T01:02:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.815+0000 7f28827b9700 1 --2- 172.21.15.26:0/1757934806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c101800 0x7f287c19e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.815+0000 7f28817b7700 1 -- 172.21.15.26:0/1757934806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c101800 msgr2=0x7f287c19e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:47.820 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.815+0000 7f28817b7700 1 --2- 172.21.15.26:0/1757934806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c101800 0x7f287c19e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.815+0000 7f28817b7700 1 -- 172.21.15.26:0/1757934806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0ffc70 msgr2=0x7f287c196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:47.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.815+0000 7f28817b7700 1 --2- 172.21.15.26:0/1757934806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0ffc70 0x7f287c196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:47.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.815+0000 7f28817b7700 1 -- 172.21.15.26:0/1757934806 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28780095f0 con 0x7f287c100e60 2023-12-01T01:02:47.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.815+0000 7f2881fb8700 1 --2- 172.21.15.26:0/1757934806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0ffc70 0x7f287c196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:02:47.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.815+0000 7f28817b7700 1 --2- 172.21.15.26:0/1757934806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f287c100e60 0x7f287c197080 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f286c00e9a0 tx=0x7f286c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:47.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.815+0000 7f2872ffd700 1 -- 172.21.15.26:0/1757934806 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c009790 con 0x7f287c100e60 2023-12-01T01:02:47.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.815+0000 7f2872ffd700 1 -- 172.21.15.26:0/1757934806 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f286c010430 con 0x7f287c100e60 2023-12-01T01:02:47.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.815+0000 7f288421c700 1 -- 172.21.15.26:0/1757934806 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c19ec70 con 0x7f287c100e60 2023-12-01T01:02:47.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.815+0000 7f2872ffd700 1 -- 172.21.15.26:0/1757934806 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c018680 con 0x7f287c100e60 2023-12-01T01:02:47.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.815+0000 7f288421c700 1 -- 172.21.15.26:0/1757934806 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c19f1d0 con 0x7f287c100e60 2023-12-01T01:02:47.821 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.816+0000 7f288421c700 1 -- 172.21.15.26:0/1757934806 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c1071b0 con 0x7f287c100e60 2023-12-01T01:02:47.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.817+0000 7f2872ffd700 1 -- 172.21.15.26:0/1757934806 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f286c010910 con 0x7f287c100e60 2023-12-01T01:02:47.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.818+0000 7f2872ffd700 1 --2- 172.21.15.26:0/1757934806 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f28680a05f0 0x7f28680a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:47.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.818+0000 7f2872ffd700 1 -- 172.21.15.26:0/1757934806 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f286c014070 con 0x7f287c100e60 2023-12-01T01:02:47.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.818+0000 7f2881fb8700 1 --2- 172.21.15.26:0/1757934806 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f28680a05f0 0x7f28680a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:47.822 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.818+0000 7f2881fb8700 1 --2- 172.21.15.26:0/1757934806 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f28680a05f0 0x7f28680a2ab0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f287800b780 tx=0x7f2878005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:47.823 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:47.821+0000 7f2872ffd700 1 -- 172.21.15.26:0/1757934806 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f286c095b50 con 0x7f287c100e60 2023-12-01T01:02:48.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.028+0000 7f288421c700 1 -- 172.21.15.26:0/1757934806 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f287c02cec0 con 0x7f287c100e60 2023-12-01T01:02:48.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.030+0000 7f2872ffd700 1 -- 172.21.15.26:0/1757934806 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+22060 (secure 0 0 0) 0x7f286c026020 con 0x7f287c100e60 2023-12-01T01:02:48.032 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:48.032 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":80,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:47.252511+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:02:48.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.032+0000 7f288421c700 1 -- 172.21.15.26:0/1757934806 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f28680a05f0 msgr2=0x7f28680a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:48.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.032+0000 7f288421c700 1 --2- 172.21.15.26:0/1757934806 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f28680a05f0 0x7f28680a2ab0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f287800b780 tx=0x7f2878005fd0 comp rx=0 tx=0).stop 2023-12-01T01:02:48.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.032+0000 7f288421c700 1 -- 172.21.15.26:0/1757934806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f287c100e60 msgr2=0x7f287c197080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:48.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.032+0000 7f288421c700 1 --2- 172.21.15.26:0/1757934806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f287c100e60 0x7f287c197080 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f286c00e9a0 tx=0x7f286c00ecb0 comp rx=0 tx=0).stop 2023-12-01T01:02:48.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.032+0000 7f288421c700 1 -- 172.21.15.26:0/1757934806 shutdown_connections 2023-12-01T01:02:48.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.032+0000 7f288421c700 1 --2- 172.21.15.26:0/1757934806 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f28680a05f0 0x7f28680a2ab0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:48.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.032+0000 7f288421c700 1 --2- 172.21.15.26:0/1757934806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f287c101800 0x7f287c19e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:48.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.032+0000 7f288421c700 1 --2- 172.21.15.26:0/1757934806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f287c0ffc70 0x7f287c196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:48.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.032+0000 7f288421c700 1 --2- 172.21.15.26:0/1757934806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f287c100e60 0x7f287c197080 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:48.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.032+0000 7f288421c700 1 -- 172.21.15.26:0/1757934806 >> 172.21.15.26:0/1757934806 conn(0x7f287c0fb1c0 msgr2=0x7f287c1042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:48.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.032+0000 7f288421c700 1 -- 172.21.15.26:0/1757934806 shutdown_connections 2023-12-01T01:02:48.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.032+0000 7f288421c700 1 -- 172.21.15.26:0/1757934806 wait complete. 2023-12-01T01:02:48.045 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: pgmap v242: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:48.045 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-01T01:02:48.045 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-12-01T01:02:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: osdmap e79: 12 total, 12 up, 12 in 2023-12-01T01:02:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/4171911721' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-01T01:02:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-12-01T01:02:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: osdmap e80: 12 total, 12 up, 12 in 2023-12-01T01:02:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/4171911721' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-12-01T01:02:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-12-01T01:02:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-12-01T01:02:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:47 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1493920475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:48.048 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-01T01:02:48.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: pgmap v242: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:48.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-01T01:02:48.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-12-01T01:02:48.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: osdmap e79: 12 total, 12 up, 12 in 2023-12-01T01:02:48.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/4171911721' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-01T01:02:48.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-12-01T01:02:48.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: osdmap e80: 12 total, 12 up, 12 in 2023-12-01T01:02:48.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/4171911721' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-12-01T01:02:48.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-12-01T01:02:48.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-12-01T01:02:48.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:47 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1493920475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:48.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.182+0000 7fedb7c96700 1 -- 172.21.15.26:0/3924681367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb0101810 msgr2=0x7fedb01080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:48.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.182+0000 7fedb7c96700 1 --2- 172.21.15.26:0/3924681367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb0101810 0x7fedb01080c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7feda800b0d0 tx=0x7feda800b3e0 comp rx=0 tx=0).stop 2023-12-01T01:02:48.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.182+0000 7fedb7c96700 1 -- 172.21.15.26:0/3924681367 shutdown_connections 2023-12-01T01:02:48.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.182+0000 7fedb7c96700 1 --2- 172.21.15.26:0/3924681367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb0101810 0x7fedb01080c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:48.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.182+0000 7fedb7c96700 1 --2- 172.21.15.26:0/3924681367 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fedb00ffc80 0x7fedb01000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.182+0000 7fedb7c96700 1 --2- 172.21.15.26:0/3924681367 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedb0100e70 0x7fedb01012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.182+0000 7fedb7c96700 1 -- 172.21.15.26:0/3924681367 >> 172.21.15.26:0/3924681367 conn(0x7fedb00fb1f0 msgr2=0x7fedb00fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.182+0000 7fedb7c96700 1 -- 172.21.15.26:0/3924681367 shutdown_connections 2023-12-01T01:02:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.182+0000 7fedb7c96700 1 -- 172.21.15.26:0/3924681367 wait complete. 2023-12-01T01:02:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.183+0000 7fedb7c96700 1 Processor -- start 2023-12-01T01:02:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.183+0000 7fedb7c96700 1 -- start start 2023-12-01T01:02:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.183+0000 7fedb7c96700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fedb00ffc80 0x7fedb0068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.183+0000 7fedb7c96700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedb0100e70 0x7fedb019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.183+0000 7fedb7c96700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb0101810 0x7fedb019df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.183+0000 7fedb7c96700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb019e700 con 0x7fedb0101810 2023-12-01T01:02:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.183+0000 7fedb7c96700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb019e870 con 0x7fedb0100e70 2023-12-01T01:02:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.183+0000 7fedb7c96700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb019ea30 con 0x7fedb00ffc80 2023-12-01T01:02:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.183+0000 7fedb6233700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb0101810 0x7fedb019df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.183+0000 7fedb6233700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb0101810 0x7fedb019df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53540/0 (socket says 172.21.15.26:53540) 2023-12-01T01:02:48.187 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.183+0000 7fedb6233700 1 -- 172.21.15.26:0/438545394 learned_addr learned my addr 172.21.15.26:0/438545394 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:48.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.183+0000 7fedb5a32700 1 --2- 172.21.15.26:0/438545394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fedb00ffc80 0x7fedb0068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:48.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.183+0000 7fedb5231700 1 --2- 172.21.15.26:0/438545394 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedb0100e70 0x7fedb019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:48.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.184+0000 7fedb6233700 1 -- 172.21.15.26:0/438545394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fedb00ffc80 msgr2=0x7fedb0068a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:48.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.184+0000 7fedb6233700 1 --2- 172.21.15.26:0/438545394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fedb00ffc80 0x7fedb0068a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:48.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.184+0000 7fedb6233700 1 -- 172.21.15.26:0/438545394 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedb0100e70 msgr2=0x7fedb019b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:48.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.184+0000 7fedb6233700 1 --2- 172.21.15.26:0/438545394 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedb0100e70 0x7fedb019b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:48.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.184+0000 7fedb6233700 1 -- 172.21.15.26:0/438545394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda8009d00 con 0x7fedb0101810 2023-12-01T01:02:48.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.184+0000 7fedb6233700 1 --2- 172.21.15.26:0/438545394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb0101810 0x7fedb019df60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feda800b770 tx=0x7feda800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:48.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.184+0000 7feda6ffd700 1 -- 172.21.15.26:0/438545394 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda800e040 con 0x7fedb0101810 2023-12-01T01:02:48.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.184+0000 7feda6ffd700 1 -- 172.21.15.26:0/438545394 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7feda8003e10 con 0x7fedb0101810 2023-12-01T01:02:48.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.184+0000 7fedb7c96700 1 -- 172.21.15.26:0/438545394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb019ecb0 con 0x7fedb0101810 2023-12-01T01:02:48.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.184+0000 7feda6ffd700 1 -- 172.21.15.26:0/438545394 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda801dbf0 con 0x7fedb0101810 2023-12-01T01:02:48.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.184+0000 7fedb7c96700 1 -- 172.21.15.26:0/438545394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb019f130 con 0x7fedb0101810 2023-12-01T01:02:48.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.185+0000 7fedb7c96700 1 -- 172.21.15.26:0/438545394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb0106a70 con 0x7fedb0101810 2023-12-01T01:02:48.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.186+0000 7feda6ffd700 1 -- 172.21.15.26:0/438545394 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7feda801dd50 con 0x7fedb0101810 2023-12-01T01:02:48.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.186+0000 7feda6ffd700 1 --2- 172.21.15.26:0/438545394 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fed9c0a05a0 0x7fed9c0a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:48.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.187+0000 7fedb5a32700 1 --2- 172.21.15.26:0/438545394 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fed9c0a05a0 0x7fed9c0a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:48.189 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.187+0000 7feda6ffd700 1 -- 172.21.15.26:0/438545394 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7979+0+0 (secure 0 0 0) 0x7feda80cca60 con 0x7fedb0101810 2023-12-01T01:02:48.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.187+0000 7fedb5a32700 1 --2- 172.21.15.26:0/438545394 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fed9c0a05a0 0x7fed9c0a2a60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fedb0100cd0 tx=0x7feda0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:48.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.190+0000 7feda6ffd700 1 -- 172.21.15.26:0/438545394 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7feda8096870 con 0x7fedb0101810 2023-12-01T01:02:48.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: pgmap v242: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:48.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-01T01:02:48.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-12-01T01:02:48.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: osdmap e79: 12 total, 12 up, 12 in 2023-12-01T01:02:48.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/4171911721' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-01T01:02:48.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-12-01T01:02:48.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: osdmap e80: 12 total, 12 up, 12 in 2023-12-01T01:02:48.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/4171911721' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-12-01T01:02:48.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-12-01T01:02:48.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-12-01T01:02:48.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:48.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:47 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1493920475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:48.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:48.443+0000 7fedb7c96700 1 -- 172.21.15.26:0/438545394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fedb002cc70 con 0x7fedb0101810 2023-12-01T01:02:49.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:48 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1757934806' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:49.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:48 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:49.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:48 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:02:49.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:48 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:49.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:48 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] up:active 2023-12-01T01:02:49.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:48 smithi116 ceph-mon[103554]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-01T01:02:49.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:48 smithi116 ceph-mon[103554]: osdmap e81: 12 total, 12 up, 12 in 2023-12-01T01:02:49.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:48 smithi116 ceph-mon[103554]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-01T01:02:49.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:48 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/438545394' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-12-01T01:02:49.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:48 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1757934806' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:49.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:48 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:49.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:48 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:02:49.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:48 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:49.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:48 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] up:active 2023-12-01T01:02:49.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:48 smithi093 ceph-mon[103327]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-01T01:02:49.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:48 smithi093 ceph-mon[103327]: osdmap e81: 12 total, 12 up, 12 in 2023-12-01T01:02:49.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:48 smithi093 ceph-mon[103327]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-01T01:02:49.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:48 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/438545394' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-12-01T01:02:49.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.264+0000 7feda6ffd700 1 -- 172.21.15.26:0/438545394 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7feda8099e90 con 0x7fedb0101810 2023-12-01T01:02:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.267+0000 7fedb7c96700 1 -- 172.21.15.26:0/438545394 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fed9c0a05a0 msgr2=0x7fed9c0a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.267+0000 7fedb7c96700 1 --2- 172.21.15.26:0/438545394 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fed9c0a05a0 0x7fed9c0a2a60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fedb0100cd0 tx=0x7feda0009260 comp rx=0 tx=0).stop 2023-12-01T01:02:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.267+0000 7fedb7c96700 1 -- 172.21.15.26:0/438545394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb0101810 msgr2=0x7fedb019df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.267+0000 7fedb7c96700 1 --2- 172.21.15.26:0/438545394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb0101810 0x7fedb019df60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feda800b770 tx=0x7feda800bd40 comp rx=0 tx=0).stop 2023-12-01T01:02:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.267+0000 7fedb7c96700 1 -- 172.21.15.26:0/438545394 shutdown_connections 2023-12-01T01:02:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.267+0000 7fedb7c96700 1 --2- 172.21.15.26:0/438545394 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fed9c0a05a0 0x7fed9c0a2a60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.267+0000 7fedb7c96700 1 --2- 172.21.15.26:0/438545394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb0101810 0x7fedb019df60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.267+0000 7fedb7c96700 1 --2- 172.21.15.26:0/438545394 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fedb00ffc80 0x7fedb0068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.267+0000 7fedb7c96700 1 --2- 172.21.15.26:0/438545394 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fedb0100e70 0x7fedb019b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.267+0000 7fedb7c96700 1 -- 172.21.15.26:0/438545394 >> 172.21.15.26:0/438545394 conn(0x7fedb00fb1f0 msgr2=0x7fedb00fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.267+0000 7fedb7c96700 1 -- 172.21.15.26:0/438545394 shutdown_connections 2023-12-01T01:02:49.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.267+0000 7fedb7c96700 1 -- 172.21.15.26:0/438545394 wait complete. 2023-12-01T01:02:49.283 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:48 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1757934806' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:49.283 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:48 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:02:49.283 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:48 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:02:49.283 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:48 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:02:49.283 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:48 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] up:active 2023-12-01T01:02:49.283 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:48 smithi026 ceph-mon[98801]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-01T01:02:49.283 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:48 smithi026 ceph-mon[98801]: osdmap e81: 12 total, 12 up, 12 in 2023-12-01T01:02:49.284 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:48 smithi026 ceph-mon[98801]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-01T01:02:49.284 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:48 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/438545394' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-12-01T01:02:49.285 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2023-12-01T01:02:49.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-12-01T01:02:49.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.420+0000 7f0bea7d0700 1 -- 172.21.15.26:0/1393677359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be41012f0 msgr2=0x7f0be4101710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:49.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.420+0000 7f0bea7d0700 1 --2- 172.21.15.26:0/1393677359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be41012f0 0x7f0be4101710 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009990 tx=0x7f0bd4009ca0 comp rx=0 tx=0).stop 2023-12-01T01:02:49.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.420+0000 7f0bea7d0700 1 -- 172.21.15.26:0/1393677359 shutdown_connections 2023-12-01T01:02:49.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.420+0000 7f0bea7d0700 1 --2- 172.21.15.26:0/1393677359 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0be40ff7a0 0x7f0be40ffc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:49.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.420+0000 7f0bea7d0700 1 --2- 172.21.15.26:0/1393677359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be41012f0 0x7f0be4101710 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:49.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.420+0000 7f0bea7d0700 1 --2- 172.21.15.26:0/1393677359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0be40fede0 0x7f0be40ff260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:49.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.420+0000 7f0bea7d0700 1 -- 172.21.15.26:0/1393677359 >> 172.21.15.26:0/1393677359 conn(0x7f0be40fa960 msgr2=0x7f0be40fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:49.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.420+0000 7f0bea7d0700 1 -- 172.21.15.26:0/1393677359 shutdown_connections 2023-12-01T01:02:49.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.420+0000 7f0bea7d0700 1 -- 172.21.15.26:0/1393677359 wait complete. 2023-12-01T01:02:49.424 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0bea7d0700 1 Processor -- start 2023-12-01T01:02:49.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0bea7d0700 1 -- start start 2023-12-01T01:02:49.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0bea7d0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0be40fede0 0x7f0be4198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:49.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0bea7d0700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0be40ff7a0 0x7f0be4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:49.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0bea7d0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be41012f0 0x7f0be41a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:49.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0bea7d0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be41a0900 con 0x7f0be41012f0 2023-12-01T01:02:49.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0bea7d0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be41a0a70 con 0x7f0be40fede0 2023-12-01T01:02:49.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0bea7d0700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be41a0c30 con 0x7f0be40ff7a0 2023-12-01T01:02:49.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0be8d6d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be41012f0 0x7f0be41a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:49.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0be8d6d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be41012f0 0x7f0be41a0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53554/0 (socket says 172.21.15.26:53554) 2023-12-01T01:02:49.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0be8d6d700 1 -- 172.21.15.26:0/2801700554 learned_addr learned my addr 172.21.15.26:0/2801700554 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:49.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0bdbfff700 1 --2- 172.21.15.26:0/2801700554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0be40ff7a0 0x7f0be4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:49.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0be3fff700 1 --2- 172.21.15.26:0/2801700554 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0be40fede0 0x7f0be4198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:49.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0be8d6d700 1 -- 172.21.15.26:0/2801700554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0be40ff7a0 msgr2=0x7f0be4199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:49.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0be8d6d700 1 --2- 172.21.15.26:0/2801700554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0be40ff7a0 0x7f0be4199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:49.425 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0be8d6d700 1 -- 172.21.15.26:0/2801700554 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0be40fede0 msgr2=0x7f0be4198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:49.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0be8d6d700 1 --2- 172.21.15.26:0/2801700554 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0be40fede0 0x7f0be4198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:49.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0be8d6d700 1 -- 172.21.15.26:0/2801700554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd40095f0 con 0x7f0be41012f0 2023-12-01T01:02:49.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0be3fff700 1 --2- 172.21.15.26:0/2801700554 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0be40fede0 0x7f0be4198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:02:49.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.421+0000 7f0be8d6d700 1 --2- 172.21.15.26:0/2801700554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be41012f0 0x7f0be41a0330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc00ef30 tx=0x7f0bdc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:49.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.422+0000 7f0be1ffb700 1 -- 172.21.15.26:0/2801700554 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc018070 con 0x7f0be41012f0 2023-12-01T01:02:49.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.422+0000 7f0be1ffb700 1 -- 172.21.15.26:0/2801700554 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0bdc00f040 con 0x7f0be41012f0 2023-12-01T01:02:49.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.422+0000 7f0bea7d0700 1 -- 172.21.15.26:0/2801700554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be41a0eb0 con 0x7f0be41012f0 2023-12-01T01:02:49.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.422+0000 7f0be1ffb700 1 -- 172.21.15.26:0/2801700554 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc00ce00 con 0x7f0be41012f0 2023-12-01T01:02:49.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.422+0000 7f0bea7d0700 1 -- 172.21.15.26:0/2801700554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be41a12d0 con 0x7f0be41012f0 2023-12-01T01:02:49.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.423+0000 7f0bea7d0700 1 -- 172.21.15.26:0/2801700554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be410ac90 con 0x7f0be41012f0 2023-12-01T01:02:49.427 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.424+0000 7f0be1ffb700 1 -- 172.21.15.26:0/2801700554 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f0bdc003a00 con 0x7f0be41012f0 2023-12-01T01:02:49.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.425+0000 7f0be1ffb700 1 --2- 172.21.15.26:0/2801700554 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0bd00a0520 0x7f0bd00a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:49.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.425+0000 7f0be3fff700 1 --2- 172.21.15.26:0/2801700554 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0bd00a0520 0x7f0bd00a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:49.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.425+0000 7f0be1ffb700 1 -- 172.21.15.26:0/2801700554 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0bdc0cbda0 con 0x7f0be41012f0 2023-12-01T01:02:49.428 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.425+0000 7f0be3fff700 1 --2- 172.21.15.26:0/2801700554 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0bd00a0520 0x7f0bd00a29e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400b2e0 tx=0x7f0bd4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:49.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.428+0000 7f0be1ffb700 1 -- 172.21.15.26:0/2801700554 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0bdc095b20 con 0x7f0be41012f0 2023-12-01T01:02:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:49.679+0000 7f0bea7d0700 1 -- 172.21.15.26:0/2801700554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f0be402cec0 con 0x7f0be41012f0 2023-12-01T01:02:50.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:49 smithi116 ceph-mon[103554]: pgmap v245: 97 pgs: 7 creating+peering, 4 active+clean, 86 unknown; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:50.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:49 smithi116 ceph-mon[103554]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-01T01:02:50.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:49 smithi116 ceph-mon[103554]: Cluster is now healthy 2023-12-01T01:02:50.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:49 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/438545394' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-12-01T01:02:50.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:49 smithi116 ceph-mon[103554]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-01T01:02:50.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:49 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2801700554' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-12-01T01:02:50.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:49 smithi093 ceph-mon[103327]: pgmap v245: 97 pgs: 7 creating+peering, 4 active+clean, 86 unknown; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:50.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:49 smithi093 ceph-mon[103327]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-01T01:02:50.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:49 smithi093 ceph-mon[103327]: Cluster is now healthy 2023-12-01T01:02:50.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:49 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/438545394' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-12-01T01:02:50.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:49 smithi093 ceph-mon[103327]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-01T01:02:50.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:49 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2801700554' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-12-01T01:02:50.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:49 smithi026 ceph-mon[98801]: pgmap v245: 97 pgs: 7 creating+peering, 4 active+clean, 86 unknown; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-01T01:02:50.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:49 smithi026 ceph-mon[98801]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-01T01:02:50.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:49 smithi026 ceph-mon[98801]: Cluster is now healthy 2023-12-01T01:02:50.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:49 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/438545394' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-12-01T01:02:50.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:49 smithi026 ceph-mon[98801]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-01T01:02:50.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:49 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2801700554' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-12-01T01:02:50.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.309+0000 7f0be1ffb700 1 -- 172.21.15.26:0/2801700554 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f0bdc099140 con 0x7f0be41012f0 2023-12-01T01:02:50.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.313+0000 7f0bea7d0700 1 -- 172.21.15.26:0/2801700554 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0bd00a0520 msgr2=0x7f0bd00a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:50.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.313+0000 7f0bea7d0700 1 --2- 172.21.15.26:0/2801700554 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0bd00a0520 0x7f0bd00a29e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0bd400b2e0 tx=0x7f0bd4005fb0 comp rx=0 tx=0).stop 2023-12-01T01:02:50.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.313+0000 7f0bea7d0700 1 -- 172.21.15.26:0/2801700554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be41012f0 msgr2=0x7f0be41a0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:50.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.313+0000 7f0bea7d0700 1 --2- 172.21.15.26:0/2801700554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be41012f0 0x7f0be41a0330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc00ef30 tx=0x7f0bdc00c3a0 comp rx=0 tx=0).stop 2023-12-01T01:02:50.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.313+0000 7f0bea7d0700 1 -- 172.21.15.26:0/2801700554 shutdown_connections 2023-12-01T01:02:50.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.313+0000 7f0bea7d0700 1 --2- 172.21.15.26:0/2801700554 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0bd00a0520 0x7f0bd00a29e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:50.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.313+0000 7f0bea7d0700 1 --2- 172.21.15.26:0/2801700554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0be41012f0 0x7f0be41a0330 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:50.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.313+0000 7f0bea7d0700 1 --2- 172.21.15.26:0/2801700554 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0be40fede0 0x7f0be4198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:50.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.313+0000 7f0bea7d0700 1 --2- 172.21.15.26:0/2801700554 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0be40ff7a0 0x7f0be4199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:50.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.313+0000 7f0bea7d0700 1 -- 172.21.15.26:0/2801700554 >> 172.21.15.26:0/2801700554 conn(0x7f0be40fa960 msgr2=0x7f0be40fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:50.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.313+0000 7f0bea7d0700 1 -- 172.21.15.26:0/2801700554 shutdown_connections 2023-12-01T01:02:50.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.313+0000 7f0bea7d0700 1 -- 172.21.15.26:0/2801700554 wait complete. 2023-12-01T01:02:50.336 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-12-01T01:02:50.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.469+0000 7f5d1d026700 1 -- 172.21.15.26:0/3919812042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d18100e70 msgr2=0x7f5d181012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:50.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.469+0000 7f5d1d026700 1 --2- 172.21.15.26:0/3919812042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d18100e70 0x7f5d181012d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c0099c0 tx=0x7f5d0c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:02:50.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.469+0000 7f5d1d026700 1 -- 172.21.15.26:0/3919812042 shutdown_connections 2023-12-01T01:02:50.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.469+0000 7f5d1d026700 1 --2- 172.21.15.26:0/3919812042 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d18101810 0x7f5d181080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:50.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.469+0000 7f5d1d026700 1 --2- 172.21.15.26:0/3919812042 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5d180ffc80 0x7f5d181000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:50.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.469+0000 7f5d1d026700 1 --2- 172.21.15.26:0/3919812042 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d18100e70 0x7f5d181012d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:50.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.469+0000 7f5d1d026700 1 -- 172.21.15.26:0/3919812042 >> 172.21.15.26:0/3919812042 conn(0x7f5d180fb1f0 msgr2=0x7f5d180fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:50.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.469+0000 7f5d1d026700 1 -- 172.21.15.26:0/3919812042 shutdown_connections 2023-12-01T01:02:50.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.469+0000 7f5d1d026700 1 -- 172.21.15.26:0/3919812042 wait complete. 2023-12-01T01:02:50.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.469+0000 7f5d1d026700 1 Processor -- start 2023-12-01T01:02:50.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1d026700 1 -- start start 2023-12-01T01:02:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1d026700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d180ffc80 0x7f5d18196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1d026700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d18100e70 0x7f5d181970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1d026700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5d18101810 0x7f5d1819e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1d026700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1819e730 con 0x7f5d18100e70 2023-12-01T01:02:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1d026700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1819e870 con 0x7f5d18101810 2023-12-01T01:02:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1d026700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d1819ea00 con 0x7f5d180ffc80 2023-12-01T01:02:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d18100e70 0x7f5d181970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d18100e70 0x7f5d181970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53584/0 (socket says 172.21.15.26:53584) 2023-12-01T01:02:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1659c700 1 -- 172.21.15.26:0/1348023969 learned_addr learned my addr 172.21.15.26:0/1348023969 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d16d9d700 1 --2- 172.21.15.26:0/1348023969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d180ffc80 0x7f5d18196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1659c700 1 -- 172.21.15.26:0/1348023969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d180ffc80 msgr2=0x7f5d18196bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1759e700 1 --2- 172.21.15.26:0/1348023969 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5d18101810 0x7f5d1819e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1659c700 1 --2- 172.21.15.26:0/1348023969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d180ffc80 0x7f5d18196bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:50.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1659c700 1 -- 172.21.15.26:0/1348023969 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5d18101810 msgr2=0x7f5d1819e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1659c700 1 --2- 172.21.15.26:0/1348023969 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5d18101810 0x7f5d1819e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1659c700 1 -- 172.21.15.26:0/1348023969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c0095f0 con 0x7f5d18100e70 2023-12-01T01:02:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1759e700 1 --2- 172.21.15.26:0/1348023969 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5d18101810 0x7f5d1819e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:02:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.470+0000 7f5d1659c700 1 --2- 172.21.15.26:0/1348023969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d18100e70 0x7f5d181970f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c003800 tx=0x7f5d0c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.471+0000 7f5cfffff700 1 -- 172.21.15.26:0/1348023969 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c01d070 con 0x7f5d18100e70 2023-12-01T01:02:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.471+0000 7f5cfffff700 1 -- 172.21.15.26:0/1348023969 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5d0c004120 con 0x7f5d18100e70 2023-12-01T01:02:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.471+0000 7f5d1d026700 1 -- 172.21.15.26:0/1348023969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d1819ec80 con 0x7f5d18100e70 2023-12-01T01:02:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.471+0000 7f5cfffff700 1 -- 172.21.15.26:0/1348023969 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0c021410 con 0x7f5d18100e70 2023-12-01T01:02:50.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.471+0000 7f5d1d026700 1 -- 172.21.15.26:0/1348023969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d1819f0a0 con 0x7f5d18100e70 2023-12-01T01:02:50.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.472+0000 7f5d1d026700 1 -- 172.21.15.26:0/1348023969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d1810b690 con 0x7f5d18100e70 2023-12-01T01:02:50.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.473+0000 7f5cfffff700 1 -- 172.21.15.26:0/1348023969 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f5d0c00f680 con 0x7f5d18100e70 2023-12-01T01:02:50.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.473+0000 7f5cfffff700 1 --2- 172.21.15.26:0/1348023969 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5d000a0520 0x7f5d000a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:50.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.473+0000 7f5cfffff700 1 -- 172.21.15.26:0/1348023969 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5d0c0cc930 con 0x7f5d18100e70 2023-12-01T01:02:50.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.473+0000 7f5d16d9d700 1 --2- 172.21.15.26:0/1348023969 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5d000a0520 0x7f5d000a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:50.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.474+0000 7f5d16d9d700 1 --2- 172.21.15.26:0/1348023969 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5d000a0520 0x7f5d000a29e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5d18100cd0 tx=0x7f5d0800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:50.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.478+0000 7f5cfffff700 1 -- 172.21.15.26:0/1348023969 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5d0c0966b0 con 0x7f5d18100e70 2023-12-01T01:02:50.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:50.730+0000 7f5d1d026700 1 -- 172.21.15.26:0/1348023969 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f5d1819f650 con 0x7f5d18100e70 2023-12-01T01:02:51.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:50 smithi116 ceph-mon[103554]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-01T01:02:51.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:50 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2801700554' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-12-01T01:02:51.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:50 smithi116 ceph-mon[103554]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-01T01:02:51.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:50 smithi116 ceph-mon[103554]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-01T01:02:51.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:50 smithi116 ceph-mon[103554]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2023-12-01T01:02:51.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:50 smithi116 ceph-mon[103554]: daemon mds.g is now active in filesystem cephfs as rank 1 2023-12-01T01:02:51.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:50 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1348023969' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-01T01:02:51.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:50 smithi093 ceph-mon[103327]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-01T01:02:51.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:50 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2801700554' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-12-01T01:02:51.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:50 smithi093 ceph-mon[103327]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-01T01:02:51.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:50 smithi093 ceph-mon[103327]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-01T01:02:51.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:50 smithi093 ceph-mon[103327]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2023-12-01T01:02:51.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:50 smithi093 ceph-mon[103327]: daemon mds.g is now active in filesystem cephfs as rank 1 2023-12-01T01:02:51.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:50 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1348023969' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-01T01:02:51.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:50 smithi026 ceph-mon[98801]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-01T01:02:51.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:50 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2801700554' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-12-01T01:02:51.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:50 smithi026 ceph-mon[98801]: daemon mds.g assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-01T01:02:51.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:50 smithi026 ceph-mon[98801]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-01T01:02:51.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:50 smithi026 ceph-mon[98801]: fsmap cephfs:2 {0=b=up:active,1=g=up:creating} 10 up:standby 2023-12-01T01:02:51.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:50 smithi026 ceph-mon[98801]: daemon mds.g is now active in filesystem cephfs as rank 1 2023-12-01T01:02:51.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:50 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1348023969' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-01T01:02:51.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.317+0000 7f5cfffff700 1 -- 172.21.15.26:0/1348023969 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7f5d0c099cd0 con 0x7f5d18100e70 2023-12-01T01:02:51.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.320+0000 7f5d1d026700 1 -- 172.21.15.26:0/1348023969 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5d000a0520 msgr2=0x7f5d000a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:51.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.320+0000 7f5d1d026700 1 --2- 172.21.15.26:0/1348023969 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5d000a0520 0x7f5d000a29e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5d18100cd0 tx=0x7f5d0800a380 comp rx=0 tx=0).stop 2023-12-01T01:02:51.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.320+0000 7f5d1d026700 1 -- 172.21.15.26:0/1348023969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d18100e70 msgr2=0x7f5d181970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:51.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.320+0000 7f5d1d026700 1 --2- 172.21.15.26:0/1348023969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d18100e70 0x7f5d181970f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5d0c003800 tx=0x7f5d0c005740 comp rx=0 tx=0).stop 2023-12-01T01:02:51.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.320+0000 7f5d1d026700 1 -- 172.21.15.26:0/1348023969 shutdown_connections 2023-12-01T01:02:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.320+0000 7f5d1d026700 1 --2- 172.21.15.26:0/1348023969 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5d000a0520 0x7f5d000a29e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.320+0000 7f5d1d026700 1 --2- 172.21.15.26:0/1348023969 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5d18101810 0x7f5d1819e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.320+0000 7f5d1d026700 1 --2- 172.21.15.26:0/1348023969 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5d180ffc80 0x7f5d18196bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.320+0000 7f5d1d026700 1 --2- 172.21.15.26:0/1348023969 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d18100e70 0x7f5d181970f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.320+0000 7f5d1d026700 1 -- 172.21.15.26:0/1348023969 >> 172.21.15.26:0/1348023969 conn(0x7f5d180fb1f0 msgr2=0x7f5d18067f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.320+0000 7f5d1d026700 1 -- 172.21.15.26:0/1348023969 shutdown_connections 2023-12-01T01:02:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.320+0000 7f5d1d026700 1 -- 172.21.15.26:0/1348023969 wait complete. 2023-12-01T01:02:51.340 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-12-01T01:02:51.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.469+0000 7fad5dc11700 1 -- 172.21.15.26:0/2724230059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58102910 msgr2=0x7fad581091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:51.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.469+0000 7fad5dc11700 1 --2- 172.21.15.26:0/2724230059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58102910 0x7fad581091c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fad5000b0d0 tx=0x7fad5000b3e0 comp rx=0 tx=0).stop 2023-12-01T01:02:51.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.469+0000 7fad5dc11700 1 -- 172.21.15.26:0/2724230059 shutdown_connections 2023-12-01T01:02:51.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.469+0000 7fad5dc11700 1 --2- 172.21.15.26:0/2724230059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58102910 0x7fad581091c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:51.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.469+0000 7fad5dc11700 1 --2- 172.21.15.26:0/2724230059 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad58100d80 0x7fad581011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:51.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.469+0000 7fad5dc11700 1 --2- 172.21.15.26:0/2724230059 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad58101f70 0x7fad581023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:51.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.469+0000 7fad5dc11700 1 -- 172.21.15.26:0/2724230059 >> 172.21.15.26:0/2724230059 conn(0x7fad580fc310 msgr2=0x7fad580fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:51.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.469+0000 7fad5dc11700 1 -- 172.21.15.26:0/2724230059 shutdown_connections 2023-12-01T01:02:51.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.469+0000 7fad5dc11700 1 -- 172.21.15.26:0/2724230059 wait complete. 2023-12-01T01:02:51.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.470+0000 7fad5dc11700 1 Processor -- start 2023-12-01T01:02:51.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.470+0000 7fad5dc11700 1 -- start start 2023-12-01T01:02:51.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad5dc11700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad58100d80 0x7fad58196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:51.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad5dc11700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58101f70 0x7fad581971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:51.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad5dc11700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad58102910 0x7fad5819e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:51.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad5dc11700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5819e800 con 0x7fad58101f70 2023-12-01T01:02:51.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad5dc11700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5819e970 con 0x7fad58102910 2023-12-01T01:02:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad5dc11700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5819eb30 con 0x7fad58100d80 2023-12-01T01:02:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad56ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58101f70 0x7fad581971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad56ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58101f70 0x7fad581971d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53600/0 (socket says 172.21.15.26:53600) 2023-12-01T01:02:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad56ffd700 1 -- 172.21.15.26:0/3226181590 learned_addr learned my addr 172.21.15.26:0/3226181590 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad577fe700 1 --2- 172.21.15.26:0/3226181590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad58100d80 0x7fad58196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad57fff700 1 --2- 172.21.15.26:0/3226181590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad58102910 0x7fad5819e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad56ffd700 1 -- 172.21.15.26:0/3226181590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad58100d80 msgr2=0x7fad58196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad56ffd700 1 --2- 172.21.15.26:0/3226181590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad58100d80 0x7fad58196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad56ffd700 1 -- 172.21.15.26:0/3226181590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad58102910 msgr2=0x7fad5819e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad56ffd700 1 --2- 172.21.15.26:0/3226181590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad58102910 0x7fad5819e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad56ffd700 1 -- 172.21.15.26:0/3226181590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad50009d00 con 0x7fad58101f70 2023-12-01T01:02:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad57fff700 1 --2- 172.21.15.26:0/3226181590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad58102910 0x7fad5819e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:02:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad56ffd700 1 --2- 172.21.15.26:0/3226181590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58101f70 0x7fad581971d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00d950 tx=0x7fad4c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:51.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.471+0000 7fad54ff9700 1 -- 172.21.15.26:0/3226181590 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c009b40 con 0x7fad58101f70 2023-12-01T01:02:51.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.472+0000 7fad54ff9700 1 -- 172.21.15.26:0/3226181590 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fad4c009ca0 con 0x7fad58101f70 2023-12-01T01:02:51.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.472+0000 7fad5dc11700 1 -- 172.21.15.26:0/3226181590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5819ee10 con 0x7fad58101f70 2023-12-01T01:02:51.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.472+0000 7fad54ff9700 1 -- 172.21.15.26:0/3226181590 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00f6b0 con 0x7fad58101f70 2023-12-01T01:02:51.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.472+0000 7fad5dc11700 1 -- 172.21.15.26:0/3226181590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad5819f310 con 0x7fad58101f70 2023-12-01T01:02:51.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.472+0000 7fad5dc11700 1 -- 172.21.15.26:0/3226181590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5810c7c0 con 0x7fad58101f70 2023-12-01T01:02:51.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.474+0000 7fad54ff9700 1 -- 172.21.15.26:0/3226181590 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fad4c010460 con 0x7fad58101f70 2023-12-01T01:02:51.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.474+0000 7fad54ff9700 1 --2- 172.21.15.26:0/3226181590 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fad400a0520 0x7fad400a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:51.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.474+0000 7fad54ff9700 1 -- 172.21.15.26:0/3226181590 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fad4c0cbb50 con 0x7fad58101f70 2023-12-01T01:02:51.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.474+0000 7fad577fe700 1 --2- 172.21.15.26:0/3226181590 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fad400a0520 0x7fad400a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:51.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.475+0000 7fad577fe700 1 --2- 172.21.15.26:0/3226181590 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fad400a0520 0x7fad400a29e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fad48006fd0 tx=0x7fad48008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:51.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.478+0000 7fad54ff9700 1 -- 172.21.15.26:0/3226181590 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fad4c095840 con 0x7fad58101f70 2023-12-01T01:02:51.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:51.729+0000 7fad5dc11700 1 -- 172.21.15.26:0/3226181590 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fad58107c10 con 0x7fad58101f70 2023-12-01T01:02:52.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:51 smithi116 ceph-mon[103554]: pgmap v247: 97 pgs: 7 creating+peering, 60 active+clean, 30 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 741 B/s wr, 6 op/s 2023-12-01T01:02:52.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:51 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] up:active 2023-12-01T01:02:52.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:51 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1348023969' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-01T01:02:52.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:51 smithi116 ceph-mon[103554]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-12-01T01:02:52.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:51 smithi116 ceph-mon[103554]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-01T01:02:52.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:51 smithi116 ceph-mon[103554]: Cluster is now healthy 2023-12-01T01:02:52.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:51 smithi116 ceph-mon[103554]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2023-12-01T01:02:52.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:51 smithi116 ceph-mon[103554]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2023-12-01T01:02:52.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:51 smithi116 ceph-mon[103554]: daemon mds.i is now active in filesystem cephfs as rank 2 2023-12-01T01:02:52.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:51 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3226181590' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-12-01T01:02:52.215 INFO:journalctl@ceph.mds.b.smithi093.stdout:Dec 01 01:02:51 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-b[139375]: 2023-12-01T01:02:51.798+0000 7fc106390700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-01T01:02:52.215 INFO:journalctl@ceph.mds.b.smithi093.stdout:Dec 01 01:02:51 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-b[139375]: 2023-12-01T01:02:51.798+0000 7fc106390700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-12-01T01:02:52.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:51 smithi093 ceph-mon[103327]: pgmap v247: 97 pgs: 7 creating+peering, 60 active+clean, 30 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 741 B/s wr, 6 op/s 2023-12-01T01:02:52.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:51 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] up:active 2023-12-01T01:02:52.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:51 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1348023969' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-01T01:02:52.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:51 smithi093 ceph-mon[103327]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-12-01T01:02:52.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:51 smithi093 ceph-mon[103327]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-01T01:02:52.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:51 smithi093 ceph-mon[103327]: Cluster is now healthy 2023-12-01T01:02:52.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:51 smithi093 ceph-mon[103327]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2023-12-01T01:02:52.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:51 smithi093 ceph-mon[103327]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2023-12-01T01:02:52.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:51 smithi093 ceph-mon[103327]: daemon mds.i is now active in filesystem cephfs as rank 2 2023-12-01T01:02:52.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:51 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3226181590' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-12-01T01:02:52.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:51 smithi026 ceph-mon[98801]: pgmap v247: 97 pgs: 7 creating+peering, 60 active+clean, 30 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 741 B/s wr, 6 op/s 2023-12-01T01:02:52.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:51 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] up:active 2023-12-01T01:02:52.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:51 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1348023969' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-01T01:02:52.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:51 smithi026 ceph-mon[98801]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-12-01T01:02:52.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:51 smithi026 ceph-mon[98801]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-01T01:02:52.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:51 smithi026 ceph-mon[98801]: Cluster is now healthy 2023-12-01T01:02:52.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:51 smithi026 ceph-mon[98801]: fsmap cephfs:2 {0=b=up:active,1=g=up:active} 10 up:standby 2023-12-01T01:02:52.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:51 smithi026 ceph-mon[98801]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:creating} 9 up:standby 2023-12-01T01:02:52.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:51 smithi026 ceph-mon[98801]: daemon mds.i is now active in filesystem cephfs as rank 2 2023-12-01T01:02:52.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:51 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3226181590' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-12-01T01:02:52.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.325+0000 7fad54ff9700 1 -- 172.21.15.26:0/3226181590 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7fad4c098e60 con 0x7fad58101f70 2023-12-01T01:02:52.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.327+0000 7fad5dc11700 1 -- 172.21.15.26:0/3226181590 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fad400a0520 msgr2=0x7fad400a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.327+0000 7fad5dc11700 1 --2- 172.21.15.26:0/3226181590 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fad400a0520 0x7fad400a29e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fad48006fd0 tx=0x7fad48008040 comp rx=0 tx=0).stop 2023-12-01T01:02:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.327+0000 7fad5dc11700 1 -- 172.21.15.26:0/3226181590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58101f70 msgr2=0x7fad581971d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.327+0000 7fad5dc11700 1 --2- 172.21.15.26:0/3226181590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58101f70 0x7fad581971d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fad4c00d950 tx=0x7fad4c00dd10 comp rx=0 tx=0).stop 2023-12-01T01:02:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.328+0000 7fad5dc11700 1 -- 172.21.15.26:0/3226181590 shutdown_connections 2023-12-01T01:02:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.328+0000 7fad5dc11700 1 --2- 172.21.15.26:0/3226181590 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fad400a0520 0x7fad400a29e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.328+0000 7fad5dc11700 1 --2- 172.21.15.26:0/3226181590 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad58102910 0x7fad5819e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.328+0000 7fad5dc11700 1 --2- 172.21.15.26:0/3226181590 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fad58100d80 0x7fad58196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.328+0000 7fad5dc11700 1 --2- 172.21.15.26:0/3226181590 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fad58101f70 0x7fad581971d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.328+0000 7fad5dc11700 1 -- 172.21.15.26:0/3226181590 >> 172.21.15.26:0/3226181590 conn(0x7fad580fc310 msgr2=0x7fad580fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.328+0000 7fad5dc11700 1 -- 172.21.15.26:0/3226181590 shutdown_connections 2023-12-01T01:02:52.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.328+0000 7fad5dc11700 1 -- 172.21.15.26:0/3226181590 wait complete. 2023-12-01T01:02:52.345 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2023-12-01T01:02:52.346 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-12-01T01:02:52.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.479+0000 7f8a4376d700 1 -- 172.21.15.26:0/1814472629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a3c0ffc80 msgr2=0x7f8a3c1000a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:52.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.479+0000 7f8a4376d700 1 --2- 172.21.15.26:0/1814472629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a3c0ffc80 0x7f8a3c1000a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0099c0 tx=0x7f8a2c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.479+0000 7f8a4376d700 1 -- 172.21.15.26:0/1814472629 shutdown_connections 2023-12-01T01:02:52.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.479+0000 7f8a4376d700 1 --2- 172.21.15.26:0/1814472629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a3c101810 0x7f8a3c1080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.479+0000 7f8a4376d700 1 --2- 172.21.15.26:0/1814472629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a3c0ffc80 0x7f8a3c1000a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.479+0000 7f8a4376d700 1 --2- 172.21.15.26:0/1814472629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a3c100e70 0x7f8a3c1012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.479+0000 7f8a4376d700 1 -- 172.21.15.26:0/1814472629 >> 172.21.15.26:0/1814472629 conn(0x7f8a3c0fb1f0 msgr2=0x7f8a3c0fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:52.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.479+0000 7f8a4376d700 1 -- 172.21.15.26:0/1814472629 shutdown_connections 2023-12-01T01:02:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.479+0000 7f8a4376d700 1 -- 172.21.15.26:0/1814472629 wait complete. 2023-12-01T01:02:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.479+0000 7f8a4376d700 1 Processor -- start 2023-12-01T01:02:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a4376d700 1 -- start start 2023-12-01T01:02:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a4376d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a3c0ffc80 0x7f8a3c068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a4376d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a3c100e70 0x7f8a3c19b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a4376d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a3c101810 0x7f8a3c19df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a4376d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c19e6c0 con 0x7f8a3c100e70 2023-12-01T01:02:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a4376d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c19e830 con 0x7f8a3c0ffc80 2023-12-01T01:02:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a4376d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c19e9f0 con 0x7f8a3c101810 2023-12-01T01:02:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a40d08700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a3c100e70 0x7f8a3c19b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a40d08700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a3c100e70 0x7f8a3c19b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53614/0 (socket says 172.21.15.26:53614) 2023-12-01T01:02:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a40d08700 1 -- 172.21.15.26:0/2015205854 learned_addr learned my addr 172.21.15.26:0/2015205854 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a41d0a700 1 --2- 172.21.15.26:0/2015205854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a3c101810 0x7f8a3c19df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a41509700 1 --2- 172.21.15.26:0/2015205854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a3c0ffc80 0x7f8a3c068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:52.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a40d08700 1 -- 172.21.15.26:0/2015205854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a3c101810 msgr2=0x7f8a3c19df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:52.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a40d08700 1 --2- 172.21.15.26:0/2015205854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a3c101810 0x7f8a3c19df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a40d08700 1 -- 172.21.15.26:0/2015205854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a3c0ffc80 msgr2=0x7f8a3c068a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:52.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a40d08700 1 --2- 172.21.15.26:0/2015205854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a3c0ffc80 0x7f8a3c068a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a40d08700 1 -- 172.21.15.26:0/2015205854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c0095f0 con 0x7f8a3c100e70 2023-12-01T01:02:52.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a41509700 1 --2- 172.21.15.26:0/2015205854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a3c0ffc80 0x7f8a3c068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:02:52.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a40d08700 1 --2- 172.21.15.26:0/2015205854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a3c100e70 0x7f8a3c19b8e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800d950 tx=0x7f8a3800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:52.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a327fc700 1 -- 172.21.15.26:0/2015205854 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a38009940 con 0x7f8a3c100e70 2023-12-01T01:02:52.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.480+0000 7f8a327fc700 1 -- 172.21.15.26:0/2015205854 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8a38010460 con 0x7f8a3c100e70 2023-12-01T01:02:52.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.481+0000 7f8a327fc700 1 -- 172.21.15.26:0/2015205854 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3800f620 con 0x7f8a3c100e70 2023-12-01T01:02:52.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.481+0000 7f8a4376d700 1 -- 172.21.15.26:0/2015205854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c19ecd0 con 0x7f8a3c100e70 2023-12-01T01:02:52.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.481+0000 7f8a4376d700 1 -- 172.21.15.26:0/2015205854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c19f190 con 0x7f8a3c100e70 2023-12-01T01:02:52.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.481+0000 7f8a4376d700 1 -- 172.21.15.26:0/2015205854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3c106bb0 con 0x7f8a3c100e70 2023-12-01T01:02:52.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.483+0000 7f8a327fc700 1 -- 172.21.15.26:0/2015205854 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f8a38010960 con 0x7f8a3c100e70 2023-12-01T01:02:52.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.483+0000 7f8a327fc700 1 --2- 172.21.15.26:0/2015205854 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8a280a0520 0x7f8a280a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:52.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.483+0000 7f8a41509700 1 --2- 172.21.15.26:0/2015205854 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8a280a0520 0x7f8a280a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:52.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.483+0000 7f8a327fc700 1 -- 172.21.15.26:0/2015205854 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8a380cb710 con 0x7f8a3c100e70 2023-12-01T01:02:52.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.484+0000 7f8a41509700 1 --2- 172.21.15.26:0/2015205854 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8a280a0520 0x7f8a280a29e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00b580 tx=0x7f8a2c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:52.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.486+0000 7f8a327fc700 1 -- 172.21.15.26:0/2015205854 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8a38095400 con 0x7f8a3c100e70 2023-12-01T01:02:52.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.723+0000 7f8a4376d700 1 -- 172.21.15.26:0/2015205854 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a3c061260 con 0x7f8a280a0520 2023-12-01T01:02:52.733 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 01:02:52 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T01:02:52.728+0000 7fb0710aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-01T01:02:52.733 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 01:02:52 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T01:02:52.728+0000 7fb0710aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-01T01:02:52.733 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 01:02:52 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T01:02:52.728+0000 7fb0710aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-01T01:02:52.733 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 01:02:52 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T01:02:52.728+0000 7fb0710aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-01T01:02:52.733 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 01:02:52 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T01:02:52.728+0000 7fb0710aa700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-01T01:02:52.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.769+0000 7f8a327fc700 1 -- 172.21.15.26:0/2015205854 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8a3c061260 con 0x7f8a280a0520 2023-12-01T01:02:52.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.772+0000 7f8a4376d700 1 -- 172.21.15.26:0/2015205854 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8a280a0520 msgr2=0x7f8a280a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:52.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.772+0000 7f8a4376d700 1 --2- 172.21.15.26:0/2015205854 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8a280a0520 0x7f8a280a29e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00b580 tx=0x7f8a2c005fb0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.772+0000 7f8a4376d700 1 -- 172.21.15.26:0/2015205854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a3c100e70 msgr2=0x7f8a3c19b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:52.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.772+0000 7f8a4376d700 1 --2- 172.21.15.26:0/2015205854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a3c100e70 0x7f8a3c19b8e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8a3800d950 tx=0x7f8a3800dc60 comp rx=0 tx=0).stop 2023-12-01T01:02:52.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.772+0000 7f8a4376d700 1 -- 172.21.15.26:0/2015205854 shutdown_connections 2023-12-01T01:02:52.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.772+0000 7f8a4376d700 1 --2- 172.21.15.26:0/2015205854 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8a280a0520 0x7f8a280a29e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.772+0000 7f8a4376d700 1 --2- 172.21.15.26:0/2015205854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8a3c101810 0x7f8a3c19df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.772+0000 7f8a4376d700 1 --2- 172.21.15.26:0/2015205854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8a3c0ffc80 0x7f8a3c068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.772+0000 7f8a4376d700 1 --2- 172.21.15.26:0/2015205854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a3c100e70 0x7f8a3c19b8e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.772+0000 7f8a4376d700 1 -- 172.21.15.26:0/2015205854 >> 172.21.15.26:0/2015205854 conn(0x7f8a3c0fb1f0 msgr2=0x7f8a3c0fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:52.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.772+0000 7f8a4376d700 1 -- 172.21.15.26:0/2015205854 shutdown_connections 2023-12-01T01:02:52.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.772+0000 7f8a4376d700 1 -- 172.21.15.26:0/2015205854 wait complete. 2023-12-01T01:02:52.786 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-12-01T01:02:52.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.914+0000 7f550febe700 1 -- 172.21.15.26:0/1502597256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5508100e70 msgr2=0x7f55081012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:52.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.914+0000 7f550febe700 1 --2- 172.21.15.26:0/1502597256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5508100e70 0x7f55081012d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f54f80099c0 tx=0x7f54f8009cd0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.914+0000 7f550febe700 1 -- 172.21.15.26:0/1502597256 shutdown_connections 2023-12-01T01:02:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.914+0000 7f550febe700 1 --2- 172.21.15.26:0/1502597256 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5508101810 0x7f55081080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.914+0000 7f550febe700 1 --2- 172.21.15.26:0/1502597256 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f55080ffc80 0x7f55081000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.914+0000 7f550febe700 1 --2- 172.21.15.26:0/1502597256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5508100e70 0x7f55081012d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.914+0000 7f550febe700 1 -- 172.21.15.26:0/1502597256 >> 172.21.15.26:0/1502597256 conn(0x7f55080fb1f0 msgr2=0x7f55080fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.914+0000 7f550febe700 1 -- 172.21.15.26:0/1502597256 shutdown_connections 2023-12-01T01:02:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.914+0000 7f550febe700 1 -- 172.21.15.26:0/1502597256 wait complete. 2023-12-01T01:02:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.915+0000 7f550febe700 1 Processor -- start 2023-12-01T01:02:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.915+0000 7f550febe700 1 -- start start 2023-12-01T01:02:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.915+0000 7f550febe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55080ffc80 0x7f5508196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.915+0000 7f550febe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5508100e70 0x7f5508197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.915+0000 7f550febe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5508101810 0x7f550819e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.915+0000 7f550febe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550819e680 con 0x7f55080ffc80 2023-12-01T01:02:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.915+0000 7f550febe700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550819e7c0 con 0x7f5508101810 2023-12-01T01:02:52.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.915+0000 7f550febe700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550819e950 con 0x7f5508100e70 2023-12-01T01:02:52.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.915+0000 7f550dc5a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55080ffc80 0x7f5508196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:52.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.915+0000 7f550dc5a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55080ffc80 0x7f5508196b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53646/0 (socket says 172.21.15.26:53646) 2023-12-01T01:02:52.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.915+0000 7f550dc5a700 1 -- 172.21.15.26:0/2658675338 learned_addr learned my addr 172.21.15.26:0/2658675338 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:52.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.915+0000 7f550e45b700 1 --2- 172.21.15.26:0/2658675338 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5508101810 0x7f550819e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:52.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.916+0000 7f550dc5a700 1 -- 172.21.15.26:0/2658675338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5508100e70 msgr2=0x7f5508197040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:52.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.916+0000 7f550dc5a700 1 --2- 172.21.15.26:0/2658675338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5508100e70 0x7f5508197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.916+0000 7f550dc5a700 1 -- 172.21.15.26:0/2658675338 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5508101810 msgr2=0x7f550819e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:52.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.916+0000 7f550dc5a700 1 --2- 172.21.15.26:0/2658675338 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5508101810 0x7f550819e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:52.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.916+0000 7f550dc5a700 1 -- 172.21.15.26:0/2658675338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f80095f0 con 0x7f55080ffc80 2023-12-01T01:02:52.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.916+0000 7f550e45b700 1 --2- 172.21.15.26:0/2658675338 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5508101810 0x7f550819e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:02:52.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.916+0000 7f550dc5a700 1 --2- 172.21.15.26:0/2658675338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55080ffc80 0x7f5508196b00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f550400c990 tx=0x7f550400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:52.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.916+0000 7f54feffd700 1 -- 172.21.15.26:0/2658675338 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5504007b00 con 0x7f55080ffc80 2023-12-01T01:02:52.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.916+0000 7f54feffd700 1 -- 172.21.15.26:0/2658675338 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5504007c60 con 0x7f55080ffc80 2023-12-01T01:02:52.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.916+0000 7f550febe700 1 -- 172.21.15.26:0/2658675338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550819ec30 con 0x7f55080ffc80 2023-12-01T01:02:52.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.916+0000 7f54feffd700 1 -- 172.21.15.26:0/2658675338 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5504018680 con 0x7f55080ffc80 2023-12-01T01:02:52.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.916+0000 7f550febe700 1 -- 172.21.15.26:0/2658675338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550819f140 con 0x7f55080ffc80 2023-12-01T01:02:52.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.917+0000 7f550febe700 1 -- 172.21.15.26:0/2658675338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550810b620 con 0x7f55080ffc80 2023-12-01T01:02:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.918+0000 7f54feffd700 1 -- 172.21.15.26:0/2658675338 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f550400f450 con 0x7f55080ffc80 2023-12-01T01:02:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.918+0000 7f54feffd700 1 --2- 172.21.15.26:0/2658675338 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f54f40a0520 0x7f54f40a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.919+0000 7f550d459700 1 --2- 172.21.15.26:0/2658675338 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f54f40a0520 0x7f54f40a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.919+0000 7f54feffd700 1 -- 172.21.15.26:0/2658675338 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f55040cb8e0 con 0x7f55080ffc80 2023-12-01T01:02:52.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.919+0000 7f550d459700 1 --2- 172.21.15.26:0/2658675338 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f54f40a0520 0x7f54f40a29e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f54f8003800 tx=0x7f54f8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:52.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:52.923+0000 7f54feffd700 1 -- 172.21.15.26:0/2658675338 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f55040955d0 con 0x7f55080ffc80 2023-12-01T01:02:53.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.159+0000 7f550febe700 1 -- 172.21.15.26:0/2658675338 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f5508068620 con 0x7f54f40a0520 2023-12-01T01:02:53.166 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.164+0000 7f54feffd700 1 -- 172.21.15.26:0/2658675338 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f5508068620 con 0x7f54f40a0520 2023-12-01T01:02:53.166 INFO:teuthology.orchestra.run.smithi026.stdout:/volumes/_nogroup/sv_0/a5e6419e-9c4d-4f0e-91ef-2f4de9fcd118 2023-12-01T01:02:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.167+0000 7f550febe700 1 -- 172.21.15.26:0/2658675338 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f54f40a0520 msgr2=0x7f54f40a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:53.168 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.167+0000 7f550febe700 1 --2- 172.21.15.26:0/2658675338 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f54f40a0520 0x7f54f40a29e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f54f8003800 tx=0x7f54f8000bc0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.167+0000 7f550febe700 1 -- 172.21.15.26:0/2658675338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55080ffc80 msgr2=0x7f5508196b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.167+0000 7f550febe700 1 --2- 172.21.15.26:0/2658675338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55080ffc80 0x7f5508196b00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f550400c990 tx=0x7f550400cd50 comp rx=0 tx=0).stop 2023-12-01T01:02:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.167+0000 7f550febe700 1 -- 172.21.15.26:0/2658675338 shutdown_connections 2023-12-01T01:02:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.167+0000 7f550febe700 1 --2- 172.21.15.26:0/2658675338 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f54f40a0520 0x7f54f40a29e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.167+0000 7f550febe700 1 --2- 172.21.15.26:0/2658675338 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5508101810 0x7f550819e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.167+0000 7f550febe700 1 --2- 172.21.15.26:0/2658675338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f55080ffc80 0x7f5508196b00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.167+0000 7f550febe700 1 --2- 172.21.15.26:0/2658675338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5508100e70 0x7f5508197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.167+0000 7f550febe700 1 -- 172.21.15.26:0/2658675338 >> 172.21.15.26:0/2658675338 conn(0x7f55080fb1f0 msgr2=0x7f5508067f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:53.169 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.167+0000 7f550febe700 1 -- 172.21.15.26:0/2658675338 shutdown_connections 2023-12-01T01:02:53.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.167+0000 7f550febe700 1 -- 172.21.15.26:0/2658675338 wait complete. 2023-12-01T01:02:53.182 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-12-01T01:02:53.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.311+0000 7facae2f5700 1 -- 172.21.15.26:0/34603033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca8102950 msgr2=0x7faca8109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:53.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.311+0000 7facae2f5700 1 --2- 172.21.15.26:0/34603033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca8102950 0x7faca8109200 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7faca000b0d0 tx=0x7faca000b3e0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.311+0000 7facae2f5700 1 -- 172.21.15.26:0/34603033 shutdown_connections 2023-12-01T01:02:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.311+0000 7facae2f5700 1 --2- 172.21.15.26:0/34603033 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca8102950 0x7faca8109200 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.311+0000 7facae2f5700 1 --2- 172.21.15.26:0/34603033 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faca8100dc0 0x7faca81011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.311+0000 7facae2f5700 1 --2- 172.21.15.26:0/34603033 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faca8101fb0 0x7faca8102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.311+0000 7facae2f5700 1 -- 172.21.15.26:0/34603033 >> 172.21.15.26:0/34603033 conn(0x7faca80fc310 msgr2=0x7faca80fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.311+0000 7facae2f5700 1 -- 172.21.15.26:0/34603033 shutdown_connections 2023-12-01T01:02:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.311+0000 7facae2f5700 1 -- 172.21.15.26:0/34603033 wait complete. 2023-12-01T01:02:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.311+0000 7facae2f5700 1 Processor -- start 2023-12-01T01:02:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.311+0000 7facae2f5700 1 -- start start 2023-12-01T01:02:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7facae2f5700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faca8100dc0 0x7faca8198e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7facae2f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca8101fb0 0x7faca8199390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7facae2f5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faca8102950 0x7faca81a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7facae2f5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca81a09d0 con 0x7faca8101fb0 2023-12-01T01:02:53.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7facae2f5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca81a0b10 con 0x7faca8102950 2023-12-01T01:02:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7facae2f5700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca81a0ca0 con 0x7faca8100dc0 2023-12-01T01:02:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7faca77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca8101fb0 0x7faca8199390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7faca77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca8101fb0 0x7faca8199390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53662/0 (socket says 172.21.15.26:53662) 2023-12-01T01:02:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7faca77fe700 1 -- 172.21.15.26:0/832535876 learned_addr learned my addr 172.21.15.26:0/832535876 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7faca7fff700 1 --2- 172.21.15.26:0/832535876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faca8100dc0 0x7faca8198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7facac892700 1 --2- 172.21.15.26:0/832535876 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faca8102950 0x7faca81a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7faca77fe700 1 -- 172.21.15.26:0/832535876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faca8100dc0 msgr2=0x7faca8198e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7faca77fe700 1 --2- 172.21.15.26:0/832535876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faca8100dc0 0x7faca8198e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7faca77fe700 1 -- 172.21.15.26:0/832535876 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faca8102950 msgr2=0x7faca81a0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7faca77fe700 1 --2- 172.21.15.26:0/832535876 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faca8102950 0x7faca81a0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7faca77fe700 1 -- 172.21.15.26:0/832535876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca0009d00 con 0x7faca8101fb0 2023-12-01T01:02:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7facac892700 1 --2- 172.21.15.26:0/832535876 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faca8102950 0x7faca81a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:02:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.312+0000 7faca77fe700 1 --2- 172.21.15.26:0/832535876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca8101fb0 0x7faca8199390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fac9000c9b0 tx=0x7fac9000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.313+0000 7faca57fa700 1 -- 172.21.15.26:0/832535876 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90007b00 con 0x7faca8101fb0 2023-12-01T01:02:53.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.313+0000 7faca57fa700 1 -- 172.21.15.26:0/832535876 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fac90007c60 con 0x7faca8101fb0 2023-12-01T01:02:53.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.313+0000 7facae2f5700 1 -- 172.21.15.26:0/832535876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca81a0f80 con 0x7faca8101fb0 2023-12-01T01:02:53.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.313+0000 7faca57fa700 1 -- 172.21.15.26:0/832535876 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90018660 con 0x7faca8101fb0 2023-12-01T01:02:53.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.313+0000 7facae2f5700 1 -- 172.21.15.26:0/832535876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca81a14d0 con 0x7faca8101fb0 2023-12-01T01:02:53.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.314+0000 7facae2f5700 1 -- 172.21.15.26:0/832535876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca810c7b0 con 0x7faca8101fb0 2023-12-01T01:02:53.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.315+0000 7faca57fa700 1 -- 172.21.15.26:0/832535876 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fac9000f450 con 0x7faca8101fb0 2023-12-01T01:02:53.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.316+0000 7faca57fa700 1 --2- 172.21.15.26:0/832535876 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fac940a05a0 0x7fac940a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:53.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.316+0000 7faca7fff700 1 --2- 172.21.15.26:0/832535876 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fac940a05a0 0x7fac940a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:53.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.316+0000 7faca57fa700 1 -- 172.21.15.26:0/832535876 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fac900cba90 con 0x7faca8101fb0 2023-12-01T01:02:53.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.316+0000 7faca7fff700 1 --2- 172.21.15.26:0/832535876 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fac940a05a0 0x7fac940a2a60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faca8101e10 tx=0x7fac98009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:53.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.319+0000 7faca57fa700 1 -- 172.21.15.26:0/832535876 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fac900957f0 con 0x7faca8101fb0 2023-12-01T01:02:53.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:53 smithi026 ceph-mon[98801]: pgmap v248: 97 pgs: 4 creating+peering, 93 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 7 op/s 2023-12-01T01:02:53.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:53 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] up:active 2023-12-01T01:02:53.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:53 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3226181590' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-12-01T01:02:53.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:53 smithi026 ceph-mon[98801]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2023-12-01T01:02:53.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:53 smithi026 ceph-mon[98801]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:02:53.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:53 smithi026 ceph-mon[98801]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:02:53.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.556+0000 7facae2f5700 1 -- 172.21.15.26:0/832535876 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7faca80746e0 con 0x7fac940a05a0 2023-12-01T01:02:53.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.580+0000 7faca57fa700 1 -- 172.21.15.26:0/832535876 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7faca80746e0 con 0x7fac940a05a0 2023-12-01T01:02:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.582+0000 7facae2f5700 1 -- 172.21.15.26:0/832535876 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fac940a05a0 msgr2=0x7fac940a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.582+0000 7facae2f5700 1 --2- 172.21.15.26:0/832535876 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fac940a05a0 0x7fac940a2a60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faca8101e10 tx=0x7fac98009190 comp rx=0 tx=0).stop 2023-12-01T01:02:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.582+0000 7facae2f5700 1 -- 172.21.15.26:0/832535876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca8101fb0 msgr2=0x7faca8199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.582+0000 7facae2f5700 1 --2- 172.21.15.26:0/832535876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca8101fb0 0x7faca8199390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fac9000c9b0 tx=0x7fac9000ccc0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.582+0000 7facae2f5700 1 -- 172.21.15.26:0/832535876 shutdown_connections 2023-12-01T01:02:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.582+0000 7facae2f5700 1 --2- 172.21.15.26:0/832535876 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fac940a05a0 0x7fac940a2a60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.582+0000 7facae2f5700 1 --2- 172.21.15.26:0/832535876 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faca8102950 0x7faca81a0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.582+0000 7facae2f5700 1 --2- 172.21.15.26:0/832535876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faca8100dc0 0x7faca8198e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.582+0000 7facae2f5700 1 --2- 172.21.15.26:0/832535876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faca8101fb0 0x7faca8199390 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.582+0000 7facae2f5700 1 -- 172.21.15.26:0/832535876 >> 172.21.15.26:0/832535876 conn(0x7faca80fc310 msgr2=0x7faca8072fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.582+0000 7facae2f5700 1 -- 172.21.15.26:0/832535876 shutdown_connections 2023-12-01T01:02:53.585 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.582+0000 7facae2f5700 1 -- 172.21.15.26:0/832535876 wait complete. 2023-12-01T01:02:53.597 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-12-01T01:02:53.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:53 smithi116 ceph-mon[103554]: pgmap v248: 97 pgs: 4 creating+peering, 93 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 7 op/s 2023-12-01T01:02:53.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:53 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] up:active 2023-12-01T01:02:53.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:53 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3226181590' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-12-01T01:02:53.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:53 smithi116 ceph-mon[103554]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2023-12-01T01:02:53.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:53 smithi116 ceph-mon[103554]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:02:53.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:53 smithi116 ceph-mon[103554]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:02:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:53 smithi093 ceph-mon[103327]: pgmap v248: 97 pgs: 4 creating+peering, 93 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 7 op/s 2023-12-01T01:02:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:53 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] up:active 2023-12-01T01:02:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:53 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3226181590' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-12-01T01:02:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:53 smithi093 ceph-mon[103327]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 9 up:standby 2023-12-01T01:02:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:53 smithi093 ceph-mon[103327]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:02:53.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:53 smithi093 ceph-mon[103327]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:02:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.723+0000 7f94dfed5700 1 -- 172.21.15.26:0/1130046814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d8101810 msgr2=0x7f94d81080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.723+0000 7f94dfed5700 1 --2- 172.21.15.26:0/1130046814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d8101810 0x7f94d81080c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f94d000b0d0 tx=0x7f94d000b3e0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.724+0000 7f94dfed5700 1 -- 172.21.15.26:0/1130046814 shutdown_connections 2023-12-01T01:02:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.724+0000 7f94dfed5700 1 --2- 172.21.15.26:0/1130046814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d8101810 0x7f94d81080c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.724+0000 7f94dfed5700 1 --2- 172.21.15.26:0/1130046814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d80ffc80 0x7f94d81000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.724+0000 7f94dfed5700 1 --2- 172.21.15.26:0/1130046814 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f94d8100e70 0x7f94d81012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.724+0000 7f94dfed5700 1 -- 172.21.15.26:0/1130046814 >> 172.21.15.26:0/1130046814 conn(0x7f94d80fb1f0 msgr2=0x7f94d80fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.724+0000 7f94dfed5700 1 -- 172.21.15.26:0/1130046814 shutdown_connections 2023-12-01T01:02:53.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.724+0000 7f94dfed5700 1 -- 172.21.15.26:0/1130046814 wait complete. 2023-12-01T01:02:53.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.724+0000 7f94dfed5700 1 Processor -- start 2023-12-01T01:02:53.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.724+0000 7f94dfed5700 1 -- start start 2023-12-01T01:02:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.724+0000 7f94dfed5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f94d80ffc80 0x7f94d8196c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.724+0000 7f94dfed5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d8100e70 0x7f94d81971c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.724+0000 7f94dfed5700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d8101810 0x7f94d819e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.724+0000 7f94dfed5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d819e7c0 con 0x7f94d8100e70 2023-12-01T01:02:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.724+0000 7f94dfed5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d819e930 con 0x7f94d80ffc80 2023-12-01T01:02:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.724+0000 7f94dfed5700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94d819eaf0 con 0x7f94d8101810 2023-12-01T01:02:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.725+0000 7f94dd470700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d8100e70 0x7f94d81971c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.725+0000 7f94dd470700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d8100e70 0x7f94d81971c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53678/0 (socket says 172.21.15.26:53678) 2023-12-01T01:02:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.725+0000 7f94dd470700 1 -- 172.21.15.26:0/1023770187 learned_addr learned my addr 172.21.15.26:0/1023770187 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.725+0000 7f94de472700 1 --2- 172.21.15.26:0/1023770187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d8101810 0x7f94d819e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.725+0000 7f94ddc71700 1 --2- 172.21.15.26:0/1023770187 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f94d80ffc80 0x7f94d8196c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.725+0000 7f94dd470700 1 -- 172.21.15.26:0/1023770187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d8101810 msgr2=0x7f94d819e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.725+0000 7f94dd470700 1 --2- 172.21.15.26:0/1023770187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d8101810 0x7f94d819e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.725+0000 7f94dd470700 1 -- 172.21.15.26:0/1023770187 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f94d80ffc80 msgr2=0x7f94d8196c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.725+0000 7f94dd470700 1 --2- 172.21.15.26:0/1023770187 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f94d80ffc80 0x7f94d8196c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.725+0000 7f94dd470700 1 -- 172.21.15.26:0/1023770187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94d0009d00 con 0x7f94d8100e70 2023-12-01T01:02:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.725+0000 7f94dd470700 1 --2- 172.21.15.26:0/1023770187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d8100e70 0x7f94d81971c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f94c800e9a0 tx=0x7f94c800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.725+0000 7f94ceffd700 1 -- 172.21.15.26:0/1023770187 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8009790 con 0x7f94d8100e70 2023-12-01T01:02:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.725+0000 7f94dfed5700 1 -- 172.21.15.26:0/1023770187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94d819edd0 con 0x7f94d8100e70 2023-12-01T01:02:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.725+0000 7f94ceffd700 1 -- 172.21.15.26:0/1023770187 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f94c8010430 con 0x7f94d8100e70 2023-12-01T01:02:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.725+0000 7f94ceffd700 1 -- 172.21.15.26:0/1023770187 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c8018680 con 0x7f94d8100e70 2023-12-01T01:02:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.725+0000 7f94dfed5700 1 -- 172.21.15.26:0/1023770187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94d819f200 con 0x7f94d8100e70 2023-12-01T01:02:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.726+0000 7f94dfed5700 1 -- 172.21.15.26:0/1023770187 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94d8107c10 con 0x7f94d8100e70 2023-12-01T01:02:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.727+0000 7f94ceffd700 1 -- 172.21.15.26:0/1023770187 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f94c8010910 con 0x7f94d8100e70 2023-12-01T01:02:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.728+0000 7f94ceffd700 1 --2- 172.21.15.26:0/1023770187 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f94c40a0520 0x7f94c40a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.728+0000 7f94ceffd700 1 -- 172.21.15.26:0/1023770187 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f94c8014070 con 0x7f94d8100e70 2023-12-01T01:02:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.728+0000 7f94ddc71700 1 --2- 172.21.15.26:0/1023770187 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f94c40a0520 0x7f94c40a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:53.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.728+0000 7f94ddc71700 1 --2- 172.21.15.26:0/1023770187 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f94c40a0520 0x7f94c40a29e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f94d8198150 tx=0x7f94d400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.731+0000 7f94ceffd700 1 -- 172.21.15.26:0/1023770187 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f94c8095c00 con 0x7f94d8100e70 2023-12-01T01:02:53.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.971+0000 7f94dfed5700 1 -- 172.21.15.26:0/1023770187 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f94d80611d0 con 0x7f94c40a0520 2023-12-01T01:02:53.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.975+0000 7f94ceffd700 1 -- 172.21.15.26:0/1023770187 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f94d80611d0 con 0x7f94c40a0520 2023-12-01T01:02:53.978 INFO:teuthology.orchestra.run.smithi026.stdout:/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50 2023-12-01T01:02:53.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.977+0000 7f94dfed5700 1 -- 172.21.15.26:0/1023770187 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f94c40a0520 msgr2=0x7f94c40a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:53.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.977+0000 7f94dfed5700 1 --2- 172.21.15.26:0/1023770187 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f94c40a0520 0x7f94c40a29e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f94d8198150 tx=0x7f94d400b410 comp rx=0 tx=0).stop 2023-12-01T01:02:53.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.977+0000 7f94dfed5700 1 -- 172.21.15.26:0/1023770187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d8100e70 msgr2=0x7f94d81971c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:53.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.977+0000 7f94dfed5700 1 --2- 172.21.15.26:0/1023770187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d8100e70 0x7f94d81971c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f94c800e9a0 tx=0x7f94c800ecb0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.977+0000 7f94dfed5700 1 -- 172.21.15.26:0/1023770187 shutdown_connections 2023-12-01T01:02:53.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.977+0000 7f94dfed5700 1 --2- 172.21.15.26:0/1023770187 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f94c40a0520 0x7f94c40a29e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.977+0000 7f94dfed5700 1 --2- 172.21.15.26:0/1023770187 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f94d8101810 0x7f94d819e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.977+0000 7f94dfed5700 1 --2- 172.21.15.26:0/1023770187 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f94d80ffc80 0x7f94d8196c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.977+0000 7f94dfed5700 1 --2- 172.21.15.26:0/1023770187 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f94d8100e70 0x7f94d81971c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:53.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.978+0000 7f94dfed5700 1 -- 172.21.15.26:0/1023770187 >> 172.21.15.26:0/1023770187 conn(0x7f94d80fb1f0 msgr2=0x7f94d80fd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:53.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.978+0000 7f94dfed5700 1 -- 172.21.15.26:0/1023770187 shutdown_connections 2023-12-01T01:02:53.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:53.978+0000 7f94dfed5700 1 -- 172.21.15.26:0/1023770187 wait complete. 2023-12-01T01:02:53.993 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:02:54.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.117+0000 7f860376c700 1 -- 172.21.15.26:0/2284560422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc106ab0 msgr2=0x7f85fc108ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:54.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.117+0000 7f860376c700 1 --2- 172.21.15.26:0/2284560422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc106ab0 0x7f85fc108ec0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f85f400b0a0 tx=0x7f85f400b3b0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.117+0000 7f860376c700 1 -- 172.21.15.26:0/2284560422 shutdown_connections 2023-12-01T01:02:54.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.117+0000 7f860376c700 1 --2- 172.21.15.26:0/2284560422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc106ab0 0x7f85fc108ec0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.117+0000 7f860376c700 1 --2- 172.21.15.26:0/2284560422 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85fc101850 0x7f85fc103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.117+0000 7f860376c700 1 --2- 172.21.15.26:0/2284560422 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85fc104180 0x7f85fc106570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.117+0000 7f860376c700 1 -- 172.21.15.26:0/2284560422 >> 172.21.15.26:0/2284560422 conn(0x7f85fc0fb1c0 msgr2=0x7f85fc0fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:54.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.117+0000 7f860376c700 1 -- 172.21.15.26:0/2284560422 shutdown_connections 2023-12-01T01:02:54.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.117+0000 7f860376c700 1 -- 172.21.15.26:0/2284560422 wait complete. 2023-12-01T01:02:54.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f860376c700 1 Processor -- start 2023-12-01T01:02:54.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f860376c700 1 -- start start 2023-12-01T01:02:54.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f860376c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85fc101850 0x7f85fc198e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:54.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f860376c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85fc104180 0x7f85fc199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:54.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f860376c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc106ab0 0x7f85fc1a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:54.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f860376c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc1a0980 con 0x7f85fc106ab0 2023-12-01T01:02:54.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f860376c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc1a0ac0 con 0x7f85fc104180 2023-12-01T01:02:54.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f860376c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85fc1a0c50 con 0x7f85fc101850 2023-12-01T01:02:54.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f8601d09700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc106ab0 0x7f85fc1a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:54.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f8601d09700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc106ab0 0x7f85fc1a03b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53694/0 (socket says 172.21.15.26:53694) 2023-12-01T01:02:54.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f8601d09700 1 -- 172.21.15.26:0/3065903430 learned_addr learned my addr 172.21.15.26:0/3065903430 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:54.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f8601508700 1 --2- 172.21.15.26:0/3065903430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85fc101850 0x7f85fc198e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:54.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f8600d07700 1 --2- 172.21.15.26:0/3065903430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85fc104180 0x7f85fc199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:54.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f8601d09700 1 -- 172.21.15.26:0/3065903430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85fc101850 msgr2=0x7f85fc198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:54.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f8601d09700 1 --2- 172.21.15.26:0/3065903430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85fc101850 0x7f85fc198e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f8601d09700 1 -- 172.21.15.26:0/3065903430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85fc104180 msgr2=0x7f85fc199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:54.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f8601d09700 1 --2- 172.21.15.26:0/3065903430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85fc104180 0x7f85fc199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f8601d09700 1 -- 172.21.15.26:0/3065903430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f4009d00 con 0x7f85fc106ab0 2023-12-01T01:02:54.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f8601508700 1 --2- 172.21.15.26:0/3065903430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85fc101850 0x7f85fc198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:02:54.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.118+0000 7f8601d09700 1 --2- 172.21.15.26:0/3065903430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc106ab0 0x7f85fc1a03b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009fd0 tx=0x7f85f400bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:54.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.119+0000 7f85f27fc700 1 -- 172.21.15.26:0/3065903430 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f400e040 con 0x7f85fc106ab0 2023-12-01T01:02:54.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.119+0000 7f860376c700 1 -- 172.21.15.26:0/3065903430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85fc1a0ed0 con 0x7f85fc106ab0 2023-12-01T01:02:54.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.119+0000 7f85f27fc700 1 -- 172.21.15.26:0/3065903430 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f85f4003e10 con 0x7f85fc106ab0 2023-12-01T01:02:54.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.119+0000 7f85f27fc700 1 -- 172.21.15.26:0/3065903430 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f401b750 con 0x7f85fc106ab0 2023-12-01T01:02:54.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.119+0000 7f860376c700 1 -- 172.21.15.26:0/3065903430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85fc1a1240 con 0x7f85fc106ab0 2023-12-01T01:02:54.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.120+0000 7f860376c700 1 -- 172.21.15.26:0/3065903430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85fc108630 con 0x7f85fc106ab0 2023-12-01T01:02:54.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.121+0000 7f85f27fc700 1 -- 172.21.15.26:0/3065903430 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 16) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f85f401d9e0 con 0x7f85fc106ab0 2023-12-01T01:02:54.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.121+0000 7f85f27fc700 1 --2- 172.21.15.26:0/3065903430 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f85e80a0570 0x7f85e80a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:54.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.121+0000 7f8601508700 1 --2- 172.21.15.26:0/3065903430 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f85e80a0570 0x7f85e80a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:54.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.121+0000 7f85f27fc700 1 -- 172.21.15.26:0/3065903430 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f85f40cd250 con 0x7f85fc106ab0 2023-12-01T01:02:54.124 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.122+0000 7f8601508700 1 --2- 172.21.15.26:0/3065903430 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f85e80a0570 0x7f85e80a2a30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009cb0 tx=0x7f85f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:54.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.125+0000 7f85f27fc700 1 -- 172.21.15.26:0/3065903430 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f85f4096fd0 con 0x7f85fc106ab0 2023-12-01T01:02:54.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.340+0000 7f85f27fc700 1 -- 172.21.15.26:0/3065903430 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f85f40973a0 con 0x7f85fc106ab0 2023-12-01T01:02:54.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.383+0000 7f860376c700 1 -- 172.21.15.26:0/3065903430 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85fc02cc70 con 0x7f85fc106ab0 2023-12-01T01:02:54.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.384+0000 7f85f27fc700 1 -- 172.21.15.26:0/3065903430 <== mon.0 v2:172.21.15.26:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10777 (secure 0 0 0) 0x7f85f409aa60 con 0x7f85fc106ab0 2023-12-01T01:02:54.386 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:54.386 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6841/3515135915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6840","nonce":3515135915},{"type":"v1","addr":"172.21.15.26:6841","nonce":3515135915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-01T01:02:47.252972+0000","modified":"2023-12-01T01:02:52.326753+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24493,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.93:6837/3333520218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3333520218},{"type":"v1","addr":"172.21.15.93:6837","nonce":3333520218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6839/3364532241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":3364532241},{"type":"v1","addr":"172.21.15.93:6839","nonce":3364532241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T01:02:54.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.386+0000 7f860376c700 1 -- 172.21.15.26:0/3065903430 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f85e80a0570 msgr2=0x7f85e80a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:54.390 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.386+0000 7f860376c700 1 --2- 172.21.15.26:0/3065903430 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f85e80a0570 0x7f85e80a2a30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009cb0 tx=0x7f85f8009260 comp rx=0 tx=0).stop 2023-12-01T01:02:54.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.386+0000 7f860376c700 1 -- 172.21.15.26:0/3065903430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc106ab0 msgr2=0x7f85fc1a03b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:54.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.386+0000 7f860376c700 1 --2- 172.21.15.26:0/3065903430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc106ab0 0x7f85fc1a03b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f85f4009fd0 tx=0x7f85f400bd90 comp rx=0 tx=0).stop 2023-12-01T01:02:54.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.386+0000 7f860376c700 1 -- 172.21.15.26:0/3065903430 shutdown_connections 2023-12-01T01:02:54.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.386+0000 7f860376c700 1 --2- 172.21.15.26:0/3065903430 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f85e80a0570 0x7f85e80a2a30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.391 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.386+0000 7f860376c700 1 --2- 172.21.15.26:0/3065903430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f85fc106ab0 0x7f85fc1a03b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.386+0000 7f860376c700 1 --2- 172.21.15.26:0/3065903430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f85fc101850 0x7f85fc198e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.386+0000 7f860376c700 1 --2- 172.21.15.26:0/3065903430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85fc104180 0x7f85fc199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.386+0000 7f860376c700 1 -- 172.21.15.26:0/3065903430 >> 172.21.15.26:0/3065903430 conn(0x7f85fc0fb1c0 msgr2=0x7f85fc0ffe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:54.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.386+0000 7f860376c700 1 -- 172.21.15.26:0/3065903430 shutdown_connections 2023-12-01T01:02:54.392 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.386+0000 7f860376c700 1 -- 172.21.15.26:0/3065903430 wait complete. 2023-12-01T01:02:54.392 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 23 2023-12-01T01:02:54.401 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:02:54.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.524+0000 7efe43fff700 1 -- 172.21.15.26:0/3207546600 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe440123f0 con 0x7efe4c101840 2023-12-01T01:02:54.528 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.524+0000 7efe537ba700 1 -- 172.21.15.26:0/3207546600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe4c101840 msgr2=0x7efe4c1080f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.524+0000 7efe537ba700 1 --2- 172.21.15.26:0/3207546600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe4c101840 0x7efe4c1080f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7efe4400b0d0 tx=0x7efe4400b3e0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.524+0000 7efe537ba700 1 -- 172.21.15.26:0/3207546600 shutdown_connections 2023-12-01T01:02:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.524+0000 7efe537ba700 1 --2- 172.21.15.26:0/3207546600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe4c101840 0x7efe4c1080f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.524+0000 7efe537ba700 1 --2- 172.21.15.26:0/3207546600 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe4c0ffcb0 0x7efe4c1000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.524+0000 7efe537ba700 1 --2- 172.21.15.26:0/3207546600 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe4c100ea0 0x7efe4c101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.524+0000 7efe537ba700 1 -- 172.21.15.26:0/3207546600 >> 172.21.15.26:0/3207546600 conn(0x7efe4c0fb220 msgr2=0x7efe4c0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.524+0000 7efe537ba700 1 -- 172.21.15.26:0/3207546600 shutdown_connections 2023-12-01T01:02:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.524+0000 7efe537ba700 1 -- 172.21.15.26:0/3207546600 wait complete. 2023-12-01T01:02:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe537ba700 1 Processor -- start 2023-12-01T01:02:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe537ba700 1 -- start start 2023-12-01T01:02:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe537ba700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe4c0ffcb0 0x7efe4c196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe537ba700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe4c100ea0 0x7efe4c197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe537ba700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe4c101840 0x7efe4c19e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe537ba700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c19e790 con 0x7efe4c0ffcb0 2023-12-01T01:02:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe537ba700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c19e900 con 0x7efe4c100ea0 2023-12-01T01:02:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe537ba700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c19eac0 con 0x7efe4c101840 2023-12-01T01:02:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe51556700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe4c0ffcb0 0x7efe4c196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe51556700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe4c0ffcb0 0x7efe4c196c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53704/0 (socket says 172.21.15.26:53704) 2023-12-01T01:02:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe51556700 1 -- 172.21.15.26:0/1893581071 learned_addr learned my addr 172.21.15.26:0/1893581071 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe51d57700 1 --2- 172.21.15.26:0/1893581071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe4c101840 0x7efe4c19e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe50d55700 1 --2- 172.21.15.26:0/1893581071 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe4c100ea0 0x7efe4c197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe51556700 1 -- 172.21.15.26:0/1893581071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe4c101840 msgr2=0x7efe4c19e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe51556700 1 --2- 172.21.15.26:0/1893581071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe4c101840 0x7efe4c19e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe51556700 1 -- 172.21.15.26:0/1893581071 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe4c100ea0 msgr2=0x7efe4c197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe51556700 1 --2- 172.21.15.26:0/1893581071 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe4c100ea0 0x7efe4c197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.525+0000 7efe51556700 1 -- 172.21.15.26:0/1893581071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe44009d00 con 0x7efe4c0ffcb0 2023-12-01T01:02:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.526+0000 7efe51556700 1 --2- 172.21.15.26:0/1893581071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe4c0ffcb0 0x7efe4c196c50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efe4800d980 tx=0x7efe4800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:54.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.526+0000 7efe427fc700 1 -- 172.21.15.26:0/1893581071 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48004020 con 0x7efe4c0ffcb0 2023-12-01T01:02:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.526+0000 7efe427fc700 1 -- 172.21.15.26:0/1893581071 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efe4800f690 con 0x7efe4c0ffcb0 2023-12-01T01:02:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.526+0000 7efe537ba700 1 -- 172.21.15.26:0/1893581071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4c19eda0 con 0x7efe4c0ffcb0 2023-12-01T01:02:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.526+0000 7efe427fc700 1 -- 172.21.15.26:0/1893581071 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48003b40 con 0x7efe4c0ffcb0 2023-12-01T01:02:54.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.526+0000 7efe537ba700 1 -- 172.21.15.26:0/1893581071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4c19f1f0 con 0x7efe4c0ffcb0 2023-12-01T01:02:54.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.527+0000 7efe537ba700 1 -- 172.21.15.26:0/1893581071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4c10b6b0 con 0x7efe4c0ffcb0 2023-12-01T01:02:54.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.528+0000 7efe427fc700 1 -- 172.21.15.26:0/1893581071 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7efe4800fb20 con 0x7efe4c0ffcb0 2023-12-01T01:02:54.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.529+0000 7efe427fc700 1 --2- 172.21.15.26:0/1893581071 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efe380a05f0 0x7efe380a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:54.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.529+0000 7efe50d55700 1 --2- 172.21.15.26:0/1893581071 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efe380a05f0 0x7efe380a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:54.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.529+0000 7efe427fc700 1 -- 172.21.15.26:0/1893581071 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7efe480cb980 con 0x7efe4c0ffcb0 2023-12-01T01:02:54.532 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.529+0000 7efe50d55700 1 --2- 172.21.15.26:0/1893581071 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efe380a05f0 0x7efe380a2ab0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efe3c005950 tx=0x7efe3c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:54.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.532+0000 7efe427fc700 1 -- 172.21.15.26:0/1893581071 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7efe48095470 con 0x7efe4c0ffcb0 2023-12-01T01:02:54.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:54 smithi116 ceph-mon[103554]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:02:54.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:54 smithi116 ceph-mon[103554]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:02:54.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:54 smithi093 ceph-mon[103327]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:02:54.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:54 smithi093 ceph-mon[103327]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:02:54.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.733+0000 7efe537ba700 1 -- 172.21.15.26:0/1893581071 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe4c10b8a0 con 0x7efe4c0ffcb0 2023-12-01T01:02:54.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.735+0000 7efe427fc700 1 -- 172.21.15.26:0/1893581071 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+22047 (secure 0 0 0) 0x7efe48098a90 con 0x7efe4c0ffcb0 2023-12-01T01:02:54.737 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:54.737 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":81,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:48.255066+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:02:54.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.737+0000 7efe537ba700 1 -- 172.21.15.26:0/1893581071 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efe380a05f0 msgr2=0x7efe380a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:54.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.737+0000 7efe537ba700 1 --2- 172.21.15.26:0/1893581071 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efe380a05f0 0x7efe380a2ab0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efe3c005950 tx=0x7efe3c00b410 comp rx=0 tx=0).stop 2023-12-01T01:02:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.737+0000 7efe537ba700 1 -- 172.21.15.26:0/1893581071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe4c0ffcb0 msgr2=0x7efe4c196c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.737+0000 7efe537ba700 1 --2- 172.21.15.26:0/1893581071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe4c0ffcb0 0x7efe4c196c50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efe4800d980 tx=0x7efe4800dc90 comp rx=0 tx=0).stop 2023-12-01T01:02:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.737+0000 7efe537ba700 1 -- 172.21.15.26:0/1893581071 shutdown_connections 2023-12-01T01:02:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.737+0000 7efe537ba700 1 --2- 172.21.15.26:0/1893581071 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efe380a05f0 0x7efe380a2ab0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.737+0000 7efe537ba700 1 --2- 172.21.15.26:0/1893581071 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe4c101840 0x7efe4c19e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.737+0000 7efe537ba700 1 --2- 172.21.15.26:0/1893581071 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe4c0ffcb0 0x7efe4c196c50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.737+0000 7efe537ba700 1 --2- 172.21.15.26:0/1893581071 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe4c100ea0 0x7efe4c197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.737+0000 7efe537ba700 1 -- 172.21.15.26:0/1893581071 >> 172.21.15.26:0/1893581071 conn(0x7efe4c0fb220 msgr2=0x7efe4c0fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.737+0000 7efe537ba700 1 -- 172.21.15.26:0/1893581071 shutdown_connections 2023-12-01T01:02:54.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.737+0000 7efe537ba700 1 -- 172.21.15.26:0/1893581071 wait complete. 2023-12-01T01:02:54.750 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:54 smithi026 ceph-mon[98801]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:02:54.751 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:54 smithi026 ceph-mon[98801]: from='client.14739 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:02:54.752 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-01T01:02:54.752 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T01:02:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.877+0000 7ff2176e6700 1 -- 172.21.15.26:0/2788079325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff210101800 msgr2=0x7ff2101080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.877+0000 7ff2176e6700 1 --2- 172.21.15.26:0/2788079325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff210101800 0x7ff2101080b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff20800b0d0 tx=0x7ff20800b3e0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.877+0000 7ff2176e6700 1 -- 172.21.15.26:0/2788079325 shutdown_connections 2023-12-01T01:02:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.877+0000 7ff2176e6700 1 --2- 172.21.15.26:0/2788079325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff210101800 0x7ff2101080b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.877+0000 7ff2176e6700 1 --2- 172.21.15.26:0/2788079325 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff2100ffc70 0x7ff210100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.877+0000 7ff2176e6700 1 --2- 172.21.15.26:0/2788079325 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff210100e60 0x7ff2101012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.877+0000 7ff2176e6700 1 -- 172.21.15.26:0/2788079325 >> 172.21.15.26:0/2788079325 conn(0x7ff2100fb1c0 msgr2=0x7ff2100fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.877+0000 7ff2176e6700 1 -- 172.21.15.26:0/2788079325 shutdown_connections 2023-12-01T01:02:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.877+0000 7ff2176e6700 1 -- 172.21.15.26:0/2788079325 wait complete. 2023-12-01T01:02:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.878+0000 7ff2176e6700 1 Processor -- start 2023-12-01T01:02:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.878+0000 7ff2176e6700 1 -- start start 2023-12-01T01:02:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.878+0000 7ff2176e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2100ffc70 0x7ff210068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.878+0000 7ff2176e6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff210100e60 0x7ff21019b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.878+0000 7ff2176e6700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff210101800 0x7ff21019df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.878+0000 7ff2176e6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21019e730 con 0x7ff2100ffc70 2023-12-01T01:02:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.878+0000 7ff2176e6700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21019e8a0 con 0x7ff210100e60 2023-12-01T01:02:54.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.878+0000 7ff2176e6700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21019ea60 con 0x7ff210101800 2023-12-01T01:02:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff215482700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2100ffc70 0x7ff210068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff215482700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2100ffc70 0x7ff210068ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53718/0 (socket says 172.21.15.26:53718) 2023-12-01T01:02:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff215482700 1 -- 172.21.15.26:0/345154560 learned_addr learned my addr 172.21.15.26:0/345154560 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff214c81700 1 --2- 172.21.15.26:0/345154560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff210100e60 0x7ff21019b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff215c83700 1 --2- 172.21.15.26:0/345154560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff210101800 0x7ff21019df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff215482700 1 -- 172.21.15.26:0/345154560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff210101800 msgr2=0x7ff21019df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff215482700 1 --2- 172.21.15.26:0/345154560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff210101800 0x7ff21019df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff215482700 1 -- 172.21.15.26:0/345154560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff210100e60 msgr2=0x7ff21019b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff215482700 1 --2- 172.21.15.26:0/345154560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff210100e60 0x7ff21019b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff215482700 1 -- 172.21.15.26:0/345154560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff208009d00 con 0x7ff2100ffc70 2023-12-01T01:02:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff215c83700 1 --2- 172.21.15.26:0/345154560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff210101800 0x7ff21019df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:02:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff215482700 1 --2- 172.21.15.26:0/345154560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2100ffc70 0x7ff210068ac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff20000e970 tx=0x7ff20000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff2067fc700 1 -- 172.21.15.26:0/345154560 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200009790 con 0x7ff2100ffc70 2023-12-01T01:02:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff2067fc700 1 -- 172.21.15.26:0/345154560 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff200004500 con 0x7ff2100ffc70 2023-12-01T01:02:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff2176e6700 1 -- 172.21.15.26:0/345154560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21019ed40 con 0x7ff2100ffc70 2023-12-01T01:02:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff2067fc700 1 -- 172.21.15.26:0/345154560 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200010430 con 0x7ff2100ffc70 2023-12-01T01:02:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.879+0000 7ff2176e6700 1 -- 172.21.15.26:0/345154560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21019f1e0 con 0x7ff2100ffc70 2023-12-01T01:02:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.880+0000 7ff2176e6700 1 -- 172.21.15.26:0/345154560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21010b5d0 con 0x7ff2100ffc70 2023-12-01T01:02:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.881+0000 7ff2067fc700 1 -- 172.21.15.26:0/345154560 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7ff20000cbd0 con 0x7ff2100ffc70 2023-12-01T01:02:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.882+0000 7ff2067fc700 1 --2- 172.21.15.26:0/345154560 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff1fc0a0670 0x7ff1fc0a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.882+0000 7ff214c81700 1 --2- 172.21.15.26:0/345154560 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff1fc0a0670 0x7ff1fc0a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:54.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.882+0000 7ff2067fc700 1 -- 172.21.15.26:0/345154560 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff200014070 con 0x7ff2100ffc70 2023-12-01T01:02:54.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.882+0000 7ff214c81700 1 --2- 172.21.15.26:0/345154560 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff1fc0a0670 0x7ff1fc0a2b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff20c005fd0 tx=0x7ff20c005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:54.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:54.886+0000 7ff2067fc700 1 -- 172.21.15.26:0/345154560 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff2000957f0 con 0x7ff2100ffc70 2023-12-01T01:02:55.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.084+0000 7ff2176e6700 1 -- 172.21.15.26:0/345154560 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2100611d0 con 0x7ff1fc0a0670 2023-12-01T01:02:55.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.097+0000 7ff2067fc700 1 -- 172.21.15.26:0/345154560 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335370 (secure 0 0 0) 0x7ff2100611d0 con 0x7ff1fc0a0670 2023-12-01T01:02:55.104 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:55.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.101+0000 7ff2176e6700 1 -- 172.21.15.26:0/345154560 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff1fc0a0670 msgr2=0x7ff1fc0a2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:55.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.101+0000 7ff2176e6700 1 --2- 172.21.15.26:0/345154560 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff1fc0a0670 0x7ff1fc0a2b30 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff20c005fd0 tx=0x7ff20c005f60 comp rx=0 tx=0).stop 2023-12-01T01:02:55.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.101+0000 7ff2176e6700 1 -- 172.21.15.26:0/345154560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2100ffc70 msgr2=0x7ff210068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:55.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.101+0000 7ff2176e6700 1 --2- 172.21.15.26:0/345154560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2100ffc70 0x7ff210068ac0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff20000e970 tx=0x7ff20000ed30 comp rx=0 tx=0).stop 2023-12-01T01:02:55.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.101+0000 7ff2176e6700 1 -- 172.21.15.26:0/345154560 shutdown_connections 2023-12-01T01:02:55.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.101+0000 7ff2176e6700 1 --2- 172.21.15.26:0/345154560 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff1fc0a0670 0x7ff1fc0a2b30 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:55.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.101+0000 7ff2176e6700 1 --2- 172.21.15.26:0/345154560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff210101800 0x7ff21019df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:55.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.101+0000 7ff2176e6700 1 --2- 172.21.15.26:0/345154560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff2100ffc70 0x7ff210068ac0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:55.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.101+0000 7ff2176e6700 1 --2- 172.21.15.26:0/345154560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff210100e60 0x7ff21019b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:55.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.101+0000 7ff2176e6700 1 -- 172.21.15.26:0/345154560 >> 172.21.15.26:0/345154560 conn(0x7ff2100fb1c0 msgr2=0x7ff2100fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:55.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.101+0000 7ff2176e6700 1 -- 172.21.15.26:0/345154560 shutdown_connections 2023-12-01T01:02:55.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.101+0000 7ff2176e6700 1 -- 172.21.15.26:0/345154560 wait complete. 2023-12-01T01:02:55.109 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-12-01T01:02:55.115 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2023-12-01T01:02:53.953654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592820,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":245,"num_write_kb":2953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191,"ondisk_log_size":191,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":333872,"kb_used_data":10448,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124607952,"statfs":{"total":1151940427776,"available":1151598542848,"internally_reserved":0,"allocated":10698752,"data_stored":6768896,"data_compressed":108279,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2452,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.141386"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.785234+0000","last_change":"2023-12-01T01:02:47.280671+0000","last_active":"2023-12-01T01:02:48.785234+0000","last_peered":"2023-12-01T01:02:48.785234+0000","last_clean":"2023-12-01T01:02:48.785234+0000","last_became_active":"2023-12-01T01:02:47.279922+0000","last_became_peered":"2023-12-01T01:02:47.279922+0000","last_unstale":"2023-12-01T01:02:48.785234+0000","last_undegraded":"2023-12-01T01:02:48.785234+0000","last_fullsized":"2023-12-01T01:02:48.785234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:07:38.049977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784882+0000","last_change":"2023-12-01T01:02:47.286185+0000","last_active":"2023-12-01T01:02:48.784882+0000","last_peered":"2023-12-01T01:02:48.784882+0000","last_clean":"2023-12-01T01:02:48.784882+0000","last_became_active":"2023-12-01T01:02:47.283747+0000","last_became_peered":"2023-12-01T01:02:47.283747+0000","last_unstale":"2023-12-01T01:02:48.784882+0000","last_undegraded":"2023-12-01T01:02:48.784882+0000","last_fullsized":"2023-12-01T01:02:48.784882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:38:32.697826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784500+0000","last_change":"2023-12-01T01:02:47.285778+0000","last_active":"2023-12-01T01:02:48.784500+0000","last_peered":"2023-12-01T01:02:48.784500+0000","last_clean":"2023-12-01T01:02:48.784500+0000","last_became_active":"2023-12-01T01:02:47.279395+0000","last_became_peered":"2023-12-01T01:02:47.279395+0000","last_unstale":"2023-12-01T01:02:48.784500+0000","last_undegraded":"2023-12-01T01:02:48.784500+0000","last_fullsized":"2023-12-01T01:02:48.784500+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:04:20.570660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784888+0000","last_change":"2023-12-01T01:02:47.269316+0000","last_active":"2023-12-01T01:02:48.784888+0000","last_peered":"2023-12-01T01:02:48.784888+0000","last_clean":"2023-12-01T01:02:48.784888+0000","last_became_active":"2023-12-01T01:02:47.269041+0000","last_became_peered":"2023-12-01T01:02:47.269041+0000","last_unstale":"2023-12-01T01:02:48.784888+0000","last_undegraded":"2023-12-01T01:02:48.784888+0000","last_fullsized":"2023-12-01T01:02:48.784888+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:24:27.951422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262813+0000","last_change":"2023-12-01T01:02:47.273802+0000","last_active":"2023-12-01T01:02:48.262813+0000","last_peered":"2023-12-01T01:02:48.262813+0000","last_clean":"2023-12-01T01:02:48.262813+0000","last_became_active":"2023-12-01T01:02:47.273450+0000","last_became_peered":"2023-12-01T01:02:47.273450+0000","last_unstale":"2023-12-01T01:02:48.262813+0000","last_undegraded":"2023-12-01T01:02:48.262813+0000","last_fullsized":"2023-12-01T01:02:48.262813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:19:39.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-12-01T01:02:47.277408+0000","last_change":"2023-12-01T01:02:47.274505+0000","last_active":"2023-12-01T01:02:47.277408+0000","last_peered":"2023-12-01T01:02:47.277408+0000","last_clean":"2023-12-01T01:02:47.277408+0000","last_became_active":"2023-12-01T01:02:47.274141+0000","last_became_peered":"2023-12-01T01:02:47.274141+0000","last_unstale":"2023-12-01T01:02:47.277408+0000","last_undegraded":"2023-12-01T01:02:47.277408+0000","last_fullsized":"2023-12-01T01:02:47.277408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:27:16.589927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783985+0000","last_change":"2023-12-01T01:02:47.279480+0000","last_active":"2023-12-01T01:02:48.783985+0000","last_peered":"2023-12-01T01:02:48.783985+0000","last_clean":"2023-12-01T01:02:48.783985+0000","last_became_active":"2023-12-01T01:02:47.279147+0000","last_became_peered":"2023-12-01T01:02:47.279147+0000","last_unstale":"2023-12-01T01:02:48.783985+0000","last_undegraded":"2023-12-01T01:02:48.783985+0000","last_fullsized":"2023-12-01T01:02:48.783985+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:28:37.815087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783733+0000","last_change":"2023-12-01T01:02:47.283997+0000","last_active":"2023-12-01T01:02:48.783733+0000","last_peered":"2023-12-01T01:02:48.783733+0000","last_clean":"2023-12-01T01:02:48.783733+0000","last_became_active":"2023-12-01T01:02:47.283694+0000","last_became_peered":"2023-12-01T01:02:47.283694+0000","last_unstale":"2023-12-01T01:02:48.783733+0000","last_undegraded":"2023-12-01T01:02:48.783733+0000","last_fullsized":"2023-12-01T01:02:48.783733+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:49:30.154079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784297+0000","last_change":"2023-12-01T01:02:47.280113+0000","last_active":"2023-12-01T01:02:48.784297+0000","last_peered":"2023-12-01T01:02:48.784297+0000","last_clean":"2023-12-01T01:02:48.784297+0000","last_became_active":"2023-12-01T01:02:47.279844+0000","last_became_peered":"2023-12-01T01:02:47.279844+0000","last_unstale":"2023-12-01T01:02:48.784297+0000","last_undegraded":"2023-12-01T01:02:48.784297+0000","last_fullsized":"2023-12-01T01:02:48.784297+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:50:19.955146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-12-01T01:02:47.278206+0000","last_change":"2023-12-01T01:02:47.275575+0000","last_active":"2023-12-01T01:02:47.278206+0000","last_peered":"2023-12-01T01:02:47.278206+0000","last_clean":"2023-12-01T01:02:47.278206+0000","last_became_active":"2023-12-01T01:02:47.275283+0000","last_became_peered":"2023-12-01T01:02:47.275283+0000","last_unstale":"2023-12-01T01:02:47.278206+0000","last_undegraded":"2023-12-01T01:02:47.278206+0000","last_fullsized":"2023-12-01T01:02:47.278206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:08:41.842374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.785105+0000","last_change":"2023-12-01T01:02:47.275992+0000","last_active":"2023-12-01T01:02:48.785105+0000","last_peered":"2023-12-01T01:02:48.785105+0000","last_clean":"2023-12-01T01:02:48.785105+0000","last_became_active":"2023-12-01T01:02:47.275406+0000","last_became_peered":"2023-12-01T01:02:47.275406+0000","last_unstale":"2023-12-01T01:02:48.785105+0000","last_undegraded":"2023-12-01T01:02:48.785105+0000","last_fullsized":"2023-12-01T01:02:48.785105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:58:39.978873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784876+0000","last_change":"2023-12-01T01:02:47.282829+0000","last_active":"2023-12-01T01:02:48.784876+0000","last_peered":"2023-12-01T01:02:48.784876+0000","last_clean":"2023-12-01T01:02:48.784876+0000","last_became_active":"2023-12-01T01:02:47.282007+0000","last_became_peered":"2023-12-01T01:02:47.282007+0000","last_unstale":"2023-12-01T01:02:48.784876+0000","last_undegraded":"2023-12-01T01:02:48.784876+0000","last_fullsized":"2023-12-01T01:02:48.784876+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:55:57.394004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262855+0000","last_change":"2023-12-01T01:02:47.276769+0000","last_active":"2023-12-01T01:02:48.262855+0000","last_peered":"2023-12-01T01:02:48.262855+0000","last_clean":"2023-12-01T01:02:48.262855+0000","last_became_active":"2023-12-01T01:02:47.276355+0000","last_became_peered":"2023-12-01T01:02:47.276355+0000","last_unstale":"2023-12-01T01:02:48.262855+0000","last_undegraded":"2023-12-01T01:02:48.262855+0000","last_fullsized":"2023-12-01T01:02:48.262855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:15:23.314516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784040+0000","last_change":"2023-12-01T01:02:47.286107+0000","last_active":"2023-12-01T01:02:48.784040+0000","last_peered":"2023-12-01T01:02:48.784040+0000","last_clean":"2023-12-01T01:02:48.784040+0000","last_became_active":"2023-12-01T01:02:47.285772+0000","last_became_peered":"2023-12-01T01:02:47.285772+0000","last_unstale":"2023-12-01T01:02:48.784040+0000","last_undegraded":"2023-12-01T01:02:48.784040+0000","last_fullsized":"2023-12-01T01:02:48.784040+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:30:29.730055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783787+0000","last_change":"2023-12-01T01:02:47.281813+0000","last_active":"2023-12-01T01:02:48.783787+0000","last_peered":"2023-12-01T01:02:48.783787+0000","last_clean":"2023-12-01T01:02:48.783787+0000","last_became_active":"2023-12-01T01:02:47.279117+0000","last_became_peered":"2023-12-01T01:02:47.279117+0000","last_unstale":"2023-12-01T01:02:48.783787+0000","last_undegraded":"2023-12-01T01:02:48.783787+0000","last_fullsized":"2023-12-01T01:02:48.783787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:11:34.646161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783766+0000","last_change":"2023-12-01T01:02:47.289596+0000","last_active":"2023-12-01T01:02:48.783766+0000","last_peered":"2023-12-01T01:02:48.783766+0000","last_clean":"2023-12-01T01:02:48.783766+0000","last_became_active":"2023-12-01T01:02:47.289273+0000","last_became_peered":"2023-12-01T01:02:47.289273+0000","last_unstale":"2023-12-01T01:02:48.783766+0000","last_undegraded":"2023-12-01T01:02:48.783766+0000","last_fullsized":"2023-12-01T01:02:48.783766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:10:33.606237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.785322+0000","last_change":"2023-12-01T01:02:47.281198+0000","last_active":"2023-12-01T01:02:48.785322+0000","last_peered":"2023-12-01T01:02:48.785322+0000","last_clean":"2023-12-01T01:02:48.785322+0000","last_became_active":"2023-12-01T01:02:47.280903+0000","last_became_peered":"2023-12-01T01:02:47.280903+0000","last_unstale":"2023-12-01T01:02:48.785322+0000","last_undegraded":"2023-12-01T01:02:48.785322+0000","last_fullsized":"2023-12-01T01:02:48.785322+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:14:56.199140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784382+0000","last_change":"2023-12-01T01:02:47.281015+0000","last_active":"2023-12-01T01:02:48.784382+0000","last_peered":"2023-12-01T01:02:48.784382+0000","last_clean":"2023-12-01T01:02:48.784382+0000","last_became_active":"2023-12-01T01:02:47.280670+0000","last_became_peered":"2023-12-01T01:02:47.280670+0000","last_unstale":"2023-12-01T01:02:48.784382+0000","last_undegraded":"2023-12-01T01:02:48.784382+0000","last_fullsized":"2023-12-01T01:02:48.784382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:13:12.686506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784348+0000","last_change":"2023-12-01T01:02:47.283444+0000","last_active":"2023-12-01T01:02:48.784348+0000","last_peered":"2023-12-01T01:02:48.784348+0000","last_clean":"2023-12-01T01:02:48.784348+0000","last_became_active":"2023-12-01T01:02:47.283131+0000","last_became_peered":"2023-12-01T01:02:47.283131+0000","last_unstale":"2023-12-01T01:02:48.784348+0000","last_undegraded":"2023-12-01T01:02:48.784348+0000","last_fullsized":"2023-12-01T01:02:48.784348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:36:50.069639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:51.333823+0000","last_change":"2023-12-01T01:02:46.825507+0000","last_active":"2023-12-01T01:02:51.333823+0000","last_peered":"2023-12-01T01:02:51.333823+0000","last_clean":"2023-12-01T01:02:51.333823+0000","last_became_active":"2023-12-01T01:02:46.825170+0000","last_became_peered":"2023-12-01T01:02:46.825170+0000","last_unstale":"2023-12-01T01:02:51.333823+0000","last_undegraded":"2023-12-01T01:02:51.333823+0000","last_fullsized":"2023-12-01T01:02:51.333823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:10:10.518664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784253+0000","last_change":"2023-12-01T01:02:47.283262+0000","last_active":"2023-12-01T01:02:48.784253+0000","last_peered":"2023-12-01T01:02:48.784253+0000","last_clean":"2023-12-01T01:02:48.784253+0000","last_became_active":"2023-12-01T01:02:47.282926+0000","last_became_peered":"2023-12-01T01:02:47.282926+0000","last_unstale":"2023-12-01T01:02:48.784253+0000","last_undegraded":"2023-12-01T01:02:48.784253+0000","last_fullsized":"2023-12-01T01:02:48.784253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:17:04.252123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784401+0000","last_change":"2023-12-01T01:02:46.835504+0000","last_active":"2023-12-01T01:02:48.784401+0000","last_peered":"2023-12-01T01:02:48.784401+0000","last_clean":"2023-12-01T01:02:48.784401+0000","last_became_active":"2023-12-01T01:02:46.835206+0000","last_became_peered":"2023-12-01T01:02:46.835206+0000","last_unstale":"2023-12-01T01:02:48.784401+0000","last_undegraded":"2023-12-01T01:02:48.784401+0000","last_fullsized":"2023-12-01T01:02:48.784401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:42:18.756880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784792+0000","last_change":"2023-12-01T01:02:47.286713+0000","last_active":"2023-12-01T01:02:48.784792+0000","last_peered":"2023-12-01T01:02:48.784792+0000","last_clean":"2023-12-01T01:02:48.784792+0000","last_became_active":"2023-12-01T01:02:47.285868+0000","last_became_peered":"2023-12-01T01:02:47.285868+0000","last_unstale":"2023-12-01T01:02:48.784792+0000","last_undegraded":"2023-12-01T01:02:48.784792+0000","last_fullsized":"2023-12-01T01:02:48.784792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:16:31.496085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.263051+0000","last_change":"2023-12-01T01:02:46.828871+0000","last_active":"2023-12-01T01:02:48.263051+0000","last_peered":"2023-12-01T01:02:48.263051+0000","last_clean":"2023-12-01T01:02:48.263051+0000","last_became_active":"2023-12-01T01:02:46.828547+0000","last_became_peered":"2023-12-01T01:02:46.828547+0000","last_unstale":"2023-12-01T01:02:48.263051+0000","last_undegraded":"2023-12-01T01:02:48.263051+0000","last_fullsized":"2023-12-01T01:02:48.263051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:36:19.260707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784467+0000","last_change":"2023-12-01T01:02:47.284868+0000","last_active":"2023-12-01T01:02:48.784467+0000","last_peered":"2023-12-01T01:02:48.784467+0000","last_clean":"2023-12-01T01:02:48.784467+0000","last_became_active":"2023-12-01T01:02:47.284602+0000","last_became_peered":"2023-12-01T01:02:47.284602+0000","last_unstale":"2023-12-01T01:02:48.784467+0000","last_undegraded":"2023-12-01T01:02:48.784467+0000","last_fullsized":"2023-12-01T01:02:48.784467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:12:36.510333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.263011+0000","last_change":"2023-12-01T01:02:46.832234+0000","last_active":"2023-12-01T01:02:48.263011+0000","last_peered":"2023-12-01T01:02:48.263011+0000","last_clean":"2023-12-01T01:02:48.263011+0000","last_became_active":"2023-12-01T01:02:46.831986+0000","last_became_peered":"2023-12-01T01:02:46.831986+0000","last_unstale":"2023-12-01T01:02:48.263011+0000","last_undegraded":"2023-12-01T01:02:48.263011+0000","last_fullsized":"2023-12-01T01:02:48.263011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:49:35.773243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784003+0000","last_change":"2023-12-01T01:02:47.275033+0000","last_active":"2023-12-01T01:02:48.784003+0000","last_peered":"2023-12-01T01:02:48.784003+0000","last_clean":"2023-12-01T01:02:48.784003+0000","last_became_active":"2023-12-01T01:02:47.274730+0000","last_became_peered":"2023-12-01T01:02:47.274730+0000","last_unstale":"2023-12-01T01:02:48.784003+0000","last_undegraded":"2023-12-01T01:02:48.784003+0000","last_fullsized":"2023-12-01T01:02:48.784003+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:48:44.959720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783895+0000","last_change":"2023-12-01T01:02:46.827046+0000","last_active":"2023-12-01T01:02:48.783895+0000","last_peered":"2023-12-01T01:02:48.783895+0000","last_clean":"2023-12-01T01:02:48.783895+0000","last_became_active":"2023-12-01T01:02:46.826716+0000","last_became_peered":"2023-12-01T01:02:46.826716+0000","last_unstale":"2023-12-01T01:02:48.783895+0000","last_undegraded":"2023-12-01T01:02:48.783895+0000","last_fullsized":"2023-12-01T01:02:48.783895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:06:46.195630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262766+0000","last_change":"2023-12-01T01:02:47.270299+0000","last_active":"2023-12-01T01:02:48.262766+0000","last_peered":"2023-12-01T01:02:48.262766+0000","last_clean":"2023-12-01T01:02:48.262766+0000","last_became_active":"2023-12-01T01:02:47.270016+0000","last_became_peered":"2023-12-01T01:02:47.270016+0000","last_unstale":"2023-12-01T01:02:48.262766+0000","last_undegraded":"2023-12-01T01:02:48.262766+0000","last_fullsized":"2023-12-01T01:02:48.262766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:16:30.207449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:51.332707+0000","last_change":"2023-12-01T01:02:46.829469+0000","last_active":"2023-12-01T01:02:51.332707+0000","last_peered":"2023-12-01T01:02:51.332707+0000","last_clean":"2023-12-01T01:02:51.332707+0000","last_became_active":"2023-12-01T01:02:46.829167+0000","last_became_peered":"2023-12-01T01:02:46.829167+0000","last_unstale":"2023-12-01T01:02:51.332707+0000","last_undegraded":"2023-12-01T01:02:51.332707+0000","last_fullsized":"2023-12-01T01:02:51.332707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:19:37.621080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784005+0000","last_change":"2023-12-01T01:02:47.274600+0000","last_active":"2023-12-01T01:02:48.784005+0000","last_peered":"2023-12-01T01:02:48.784005+0000","last_clean":"2023-12-01T01:02:48.784005+0000","last_became_active":"2023-12-01T01:02:47.273979+0000","last_became_peered":"2023-12-01T01:02:47.273979+0000","last_unstale":"2023-12-01T01:02:48.784005+0000","last_undegraded":"2023-12-01T01:02:48.784005+0000","last_fullsized":"2023-12-01T01:02:48.784005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:20:55.693393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262518+0000","last_change":"2023-12-01T01:02:46.821479+0000","last_active":"2023-12-01T01:02:48.262518+0000","last_peered":"2023-12-01T01:02:48.262518+0000","last_clean":"2023-12-01T01:02:48.262518+0000","last_became_active":"2023-12-01T01:02:46.821090+0000","last_became_peered":"2023-12-01T01:02:46.821090+0000","last_unstale":"2023-12-01T01:02:48.262518+0000","last_undegraded":"2023-12-01T01:02:48.262518+0000","last_fullsized":"2023-12-01T01:02:48.262518+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:17:48.216217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783816+0000","last_change":"2023-12-01T01:02:47.274298+0000","last_active":"2023-12-01T01:02:48.783816+0000","last_peered":"2023-12-01T01:02:48.783816+0000","last_clean":"2023-12-01T01:02:48.783816+0000","last_became_active":"2023-12-01T01:02:47.274006+0000","last_became_peered":"2023-12-01T01:02:47.274006+0000","last_unstale":"2023-12-01T01:02:48.783816+0000","last_undegraded":"2023-12-01T01:02:48.783816+0000","last_fullsized":"2023-12-01T01:02:48.783816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:38.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783480+0000","last_change":"2023-12-01T01:02:46.826341+0000","last_active":"2023-12-01T01:02:48.783480+0000","last_peered":"2023-12-01T01:02:48.783480+0000","last_clean":"2023-12-01T01:02:48.783480+0000","last_became_active":"2023-12-01T01:02:46.825979+0000","last_became_peered":"2023-12-01T01:02:46.825979+0000","last_unstale":"2023-12-01T01:02:48.783480+0000","last_undegraded":"2023-12-01T01:02:48.783480+0000","last_fullsized":"2023-12-01T01:02:48.783480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:29:48.681232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784306+0000","last_change":"2023-12-01T01:02:47.280989+0000","last_active":"2023-12-01T01:02:48.784306+0000","last_peered":"2023-12-01T01:02:48.784306+0000","last_clean":"2023-12-01T01:02:48.784306+0000","last_became_active":"2023-12-01T01:02:47.280649+0000","last_became_peered":"2023-12-01T01:02:47.280649+0000","last_unstale":"2023-12-01T01:02:48.784306+0000","last_undegraded":"2023-12-01T01:02:48.784306+0000","last_fullsized":"2023-12-01T01:02:48.784306+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:16:30.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'3","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:50.327831+0000","last_change":"2023-12-01T01:02:46.832304+0000","last_active":"2023-12-01T01:02:50.327831+0000","last_peered":"2023-12-01T01:02:50.327831+0000","last_clean":"2023-12-01T01:02:50.327831+0000","last_became_active":"2023-12-01T01:02:46.832014+0000","last_became_peered":"2023-12-01T01:02:46.832014+0000","last_unstale":"2023-12-01T01:02:50.327831+0000","last_undegraded":"2023-12-01T01:02:50.327831+0000","last_fullsized":"2023-12-01T01:02:50.327831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:41:46.003527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784334+0000","last_change":"2023-12-01T01:02:47.277819+0000","last_active":"2023-12-01T01:02:48.784334+0000","last_peered":"2023-12-01T01:02:48.784334+0000","last_clean":"2023-12-01T01:02:48.784334+0000","last_became_active":"2023-12-01T01:02:47.277534+0000","last_became_peered":"2023-12-01T01:02:47.277534+0000","last_unstale":"2023-12-01T01:02:48.784334+0000","last_undegraded":"2023-12-01T01:02:48.784334+0000","last_fullsized":"2023-12-01T01:02:48.784334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:56:15.627538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784205+0000","last_change":"2023-12-01T01:02:46.826783+0000","last_active":"2023-12-01T01:02:48.784205+0000","last_peered":"2023-12-01T01:02:48.784205+0000","last_clean":"2023-12-01T01:02:48.784205+0000","last_became_active":"2023-12-01T01:02:46.826479+0000","last_became_peered":"2023-12-01T01:02:46.826479+0000","last_unstale":"2023-12-01T01:02:48.784205+0000","last_undegraded":"2023-12-01T01:02:48.784205+0000","last_fullsized":"2023-12-01T01:02:48.784205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:30:09.681494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784725+0000","last_change":"2023-12-01T01:02:47.289301+0000","last_active":"2023-12-01T01:02:48.784725+0000","last_peered":"2023-12-01T01:02:48.784725+0000","last_clean":"2023-12-01T01:02:48.784725+0000","last_became_active":"2023-12-01T01:02:47.288976+0000","last_became_peered":"2023-12-01T01:02:47.288976+0000","last_unstale":"2023-12-01T01:02:48.784725+0000","last_undegraded":"2023-12-01T01:02:48.784725+0000","last_fullsized":"2023-12-01T01:02:48.784725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:21:02.981778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784096+0000","last_change":"2023-12-01T01:02:46.829332+0000","last_active":"2023-12-01T01:02:48.784096+0000","last_peered":"2023-12-01T01:02:48.784096+0000","last_clean":"2023-12-01T01:02:48.784096+0000","last_became_active":"2023-12-01T01:02:46.828828+0000","last_became_peered":"2023-12-01T01:02:46.828828+0000","last_unstale":"2023-12-01T01:02:48.784096+0000","last_undegraded":"2023-12-01T01:02:48.784096+0000","last_fullsized":"2023-12-01T01:02:48.784096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:15:15.648138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784556+0000","last_change":"2023-12-01T01:02:47.277938+0000","last_active":"2023-12-01T01:02:48.784556+0000","last_peered":"2023-12-01T01:02:48.784556+0000","last_clean":"2023-12-01T01:02:48.784556+0000","last_became_active":"2023-12-01T01:02:47.277650+0000","last_became_peered":"2023-12-01T01:02:47.277650+0000","last_unstale":"2023-12-01T01:02:48.784556+0000","last_undegraded":"2023-12-01T01:02:48.784556+0000","last_fullsized":"2023-12-01T01:02:48.784556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:03:46.667892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'8","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:50.328221+0000","last_change":"2023-12-01T01:02:46.828753+0000","last_active":"2023-12-01T01:02:50.328221+0000","last_peered":"2023-12-01T01:02:50.328221+0000","last_clean":"2023-12-01T01:02:50.328221+0000","last_became_active":"2023-12-01T01:02:46.828453+0000","last_became_peered":"2023-12-01T01:02:46.828453+0000","last_unstale":"2023-12-01T01:02:50.328221+0000","last_undegraded":"2023-12-01T01:02:50.328221+0000","last_fullsized":"2023-12-01T01:02:50.328221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:23:31.475164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.263064+0000","last_change":"2023-12-01T01:02:47.272049+0000","last_active":"2023-12-01T01:02:48.263064+0000","last_peered":"2023-12-01T01:02:48.263064+0000","last_clean":"2023-12-01T01:02:48.263064+0000","last_became_active":"2023-12-01T01:02:47.271726+0000","last_became_peered":"2023-12-01T01:02:47.271726+0000","last_unstale":"2023-12-01T01:02:48.263064+0000","last_undegraded":"2023-12-01T01:02:48.263064+0000","last_fullsized":"2023-12-01T01:02:48.263064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:08:45.038989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783782+0000","last_change":"2023-12-01T01:02:46.831362+0000","last_active":"2023-12-01T01:02:48.783782+0000","last_peered":"2023-12-01T01:02:48.783782+0000","last_clean":"2023-12-01T01:02:48.783782+0000","last_became_active":"2023-12-01T01:02:46.830929+0000","last_became_peered":"2023-12-01T01:02:46.830929+0000","last_unstale":"2023-12-01T01:02:48.783782+0000","last_undegraded":"2023-12-01T01:02:48.783782+0000","last_fullsized":"2023-12-01T01:02:48.783782+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:39:54.855526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262781+0000","last_change":"2023-12-01T01:02:47.275343+0000","last_active":"2023-12-01T01:02:48.262781+0000","last_peered":"2023-12-01T01:02:48.262781+0000","last_clean":"2023-12-01T01:02:48.262781+0000","last_became_active":"2023-12-01T01:02:47.275042+0000","last_became_peered":"2023-12-01T01:02:47.275042+0000","last_unstale":"2023-12-01T01:02:48.262781+0000","last_undegraded":"2023-12-01T01:02:48.262781+0000","last_fullsized":"2023-12-01T01:02:48.262781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:18:27.862601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784445+0000","last_change":"2023-12-01T01:02:46.831996+0000","last_active":"2023-12-01T01:02:48.784445+0000","last_peered":"2023-12-01T01:02:48.784445+0000","last_clean":"2023-12-01T01:02:48.784445+0000","last_became_active":"2023-12-01T01:02:46.831710+0000","last_became_peered":"2023-12-01T01:02:46.831710+0000","last_unstale":"2023-12-01T01:02:48.784445+0000","last_undegraded":"2023-12-01T01:02:48.784445+0000","last_fullsized":"2023-12-01T01:02:48.784445+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:50:42.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784201+0000","last_change":"2023-12-01T01:02:47.283771+0000","last_active":"2023-12-01T01:02:48.784201+0000","last_peered":"2023-12-01T01:02:48.784201+0000","last_clean":"2023-12-01T01:02:48.784201+0000","last_became_active":"2023-12-01T01:02:47.283363+0000","last_became_peered":"2023-12-01T01:02:47.283363+0000","last_unstale":"2023-12-01T01:02:48.784201+0000","last_undegraded":"2023-12-01T01:02:48.784201+0000","last_fullsized":"2023-12-01T01:02:48.784201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:44:40.918161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784232+0000","last_change":"2023-12-01T01:02:46.825170+0000","last_active":"2023-12-01T01:02:48.784232+0000","last_peered":"2023-12-01T01:02:48.784232+0000","last_clean":"2023-12-01T01:02:48.784232+0000","last_became_active":"2023-12-01T01:02:46.824857+0000","last_became_peered":"2023-12-01T01:02:46.824857+0000","last_unstale":"2023-12-01T01:02:48.784232+0000","last_undegraded":"2023-12-01T01:02:48.784232+0000","last_fullsized":"2023-12-01T01:02:48.784232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:05:54.095408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783658+0000","last_change":"2023-12-01T01:02:47.279495+0000","last_active":"2023-12-01T01:02:48.783658+0000","last_peered":"2023-12-01T01:02:48.783658+0000","last_clean":"2023-12-01T01:02:48.783658+0000","last_became_active":"2023-12-01T01:02:47.279171+0000","last_became_peered":"2023-12-01T01:02:47.279171+0000","last_unstale":"2023-12-01T01:02:48.783658+0000","last_undegraded":"2023-12-01T01:02:48.783658+0000","last_fullsized":"2023-12-01T01:02:48.783658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:29:33.298818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262720+0000","last_change":"2023-12-01T01:02:46.833837+0000","last_active":"2023-12-01T01:02:48.262720+0000","last_peered":"2023-12-01T01:02:48.262720+0000","last_clean":"2023-12-01T01:02:48.262720+0000","last_became_active":"2023-12-01T01:02:46.833549+0000","last_became_peered":"2023-12-01T01:02:46.833549+0000","last_unstale":"2023-12-01T01:02:48.262720+0000","last_undegraded":"2023-12-01T01:02:48.262720+0000","last_fullsized":"2023-12-01T01:02:48.262720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:35:02.581360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783939+0000","last_change":"2023-12-01T01:02:47.273884+0000","last_active":"2023-12-01T01:02:48.783939+0000","last_peered":"2023-12-01T01:02:48.783939+0000","last_clean":"2023-12-01T01:02:48.783939+0000","last_became_active":"2023-12-01T01:02:47.273575+0000","last_became_peered":"2023-12-01T01:02:47.273575+0000","last_unstale":"2023-12-01T01:02:48.783939+0000","last_undegraded":"2023-12-01T01:02:48.783939+0000","last_fullsized":"2023-12-01T01:02:48.783939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:49:54.924619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262978+0000","last_change":"2023-12-01T01:02:46.832265+0000","last_active":"2023-12-01T01:02:48.262978+0000","last_peered":"2023-12-01T01:02:48.262978+0000","last_clean":"2023-12-01T01:02:48.262978+0000","last_became_active":"2023-12-01T01:02:46.831944+0000","last_became_peered":"2023-12-01T01:02:46.831944+0000","last_unstale":"2023-12-01T01:02:48.262978+0000","last_undegraded":"2023-12-01T01:02:48.262978+0000","last_fullsized":"2023-12-01T01:02:48.262978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:54:54.814744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784271+0000","last_change":"2023-12-01T01:02:47.276967+0000","last_active":"2023-12-01T01:02:48.784271+0000","last_peered":"2023-12-01T01:02:48.784271+0000","last_clean":"2023-12-01T01:02:48.784271+0000","last_became_active":"2023-12-01T01:02:47.276660+0000","last_became_peered":"2023-12-01T01:02:47.276660+0000","last_unstale":"2023-12-01T01:02:48.784271+0000","last_undegraded":"2023-12-01T01:02:48.784271+0000","last_fullsized":"2023-12-01T01:02:48.784271+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:19:16.029376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-12-01T01:02:47.263640+0000","last_change":"2023-12-01T01:02:46.834425+0000","last_active":"2023-12-01T01:02:47.263640+0000","last_peered":"2023-12-01T01:02:47.263640+0000","last_clean":"2023-12-01T01:02:47.263640+0000","last_became_active":"2023-12-01T01:02:46.834150+0000","last_became_peered":"2023-12-01T01:02:46.834150+0000","last_unstale":"2023-12-01T01:02:47.263640+0000","last_undegraded":"2023-12-01T01:02:47.263640+0000","last_fullsized":"2023-12-01T01:02:47.263640+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:52:39.619014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-12-01T01:02:47.280145+0000","last_change":"2023-12-01T01:02:47.276386+0000","last_active":"2023-12-01T01:02:47.280145+0000","last_peered":"2023-12-01T01:02:47.280145+0000","last_clean":"2023-12-01T01:02:47.280145+0000","last_became_active":"2023-12-01T01:02:47.276092+0000","last_became_peered":"2023-12-01T01:02:47.276092+0000","last_unstale":"2023-12-01T01:02:47.280145+0000","last_undegraded":"2023-12-01T01:02:47.280145+0000","last_fullsized":"2023-12-01T01:02:47.280145+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:33:39.707619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784480+0000","last_change":"2023-12-01T01:02:46.832778+0000","last_active":"2023-12-01T01:02:48.784480+0000","last_peered":"2023-12-01T01:02:48.784480+0000","last_clean":"2023-12-01T01:02:48.784480+0000","last_became_active":"2023-12-01T01:02:46.832406+0000","last_became_peered":"2023-12-01T01:02:46.832406+0000","last_unstale":"2023-12-01T01:02:48.784480+0000","last_undegraded":"2023-12-01T01:02:48.784480+0000","last_fullsized":"2023-12-01T01:02:48.784480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:06:08.569651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-12-01T01:02:47.278303+0000","last_change":"2023-12-01T01:02:47.274395+0000","last_active":"2023-12-01T01:02:47.278303+0000","last_peered":"2023-12-01T01:02:47.278303+0000","last_clean":"2023-12-01T01:02:47.278303+0000","last_became_active":"2023-12-01T01:02:47.274065+0000","last_became_peered":"2023-12-01T01:02:47.274065+0000","last_unstale":"2023-12-01T01:02:47.278303+0000","last_undegraded":"2023-12-01T01:02:47.278303+0000","last_fullsized":"2023-12-01T01:02:47.278303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:46:38.919835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783667+0000","last_change":"2023-12-01T01:02:47.269953+0000","last_active":"2023-12-01T01:02:48.783667+0000","last_peered":"2023-12-01T01:02:48.783667+0000","last_clean":"2023-12-01T01:02:48.783667+0000","last_became_active":"2023-12-01T01:02:47.265723+0000","last_became_peered":"2023-12-01T01:02:47.265723+0000","last_unstale":"2023-12-01T01:02:48.783667+0000","last_undegraded":"2023-12-01T01:02:48.783667+0000","last_fullsized":"2023-12-01T01:02:48.783667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:28:44.370883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:50.326412+0000","last_change":"2023-12-01T01:02:46.827001+0000","last_active":"2023-12-01T01:02:50.326412+0000","last_peered":"2023-12-01T01:02:50.326412+0000","last_clean":"2023-12-01T01:02:50.326412+0000","last_became_active":"2023-12-01T01:02:46.826690+0000","last_became_peered":"2023-12-01T01:02:46.826690+0000","last_unstale":"2023-12-01T01:02:50.326412+0000","last_undegraded":"2023-12-01T01:02:50.326412+0000","last_fullsized":"2023-12-01T01:02:50.326412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:37:38.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784292+0000","last_change":"2023-12-01T01:02:47.283372+0000","last_active":"2023-12-01T01:02:48.784292+0000","last_peered":"2023-12-01T01:02:48.784292+0000","last_clean":"2023-12-01T01:02:48.784292+0000","last_became_active":"2023-12-01T01:02:47.283075+0000","last_became_peered":"2023-12-01T01:02:47.283075+0000","last_unstale":"2023-12-01T01:02:48.784292+0000","last_undegraded":"2023-12-01T01:02:48.784292+0000","last_fullsized":"2023-12-01T01:02:48.784292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:37:07.707284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.785292+0000","last_change":"2023-12-01T01:02:46.828490+0000","last_active":"2023-12-01T01:02:48.785292+0000","last_peered":"2023-12-01T01:02:48.785292+0000","last_clean":"2023-12-01T01:02:48.785292+0000","last_became_active":"2023-12-01T01:02:46.828129+0000","last_became_peered":"2023-12-01T01:02:46.828129+0000","last_unstale":"2023-12-01T01:02:48.785292+0000","last_undegraded":"2023-12-01T01:02:48.785292+0000","last_fullsized":"2023-12-01T01:02:48.785292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:52:17.060443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":320,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783760+0000","last_change":"2023-12-01T01:01:49.966660+0000","last_active":"2023-12-01T01:02:48.783760+0000","last_peered":"2023-12-01T01:02:48.783760+0000","last_clean":"2023-12-01T01:02:48.783760+0000","last_became_active":"2023-12-01T01:01:49.966125+0000","last_became_peered":"2023-12-01T01:01:49.966125+0000","last_unstale":"2023-12-01T01:02:48.783760+0000","last_undegraded":"2023-12-01T01:02:48.783760+0000","last_fullsized":"2023-12-01T01:02:48.783760+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T00:59:06.461487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T00:59:06.461487+0000","last_clean_scrub_stamp":"2023-12-01T00:59:06.461487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:34:52.236994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262423+0000","last_change":"2023-12-01T01:02:47.282702+0000","last_active":"2023-12-01T01:02:48.262423+0000","last_peered":"2023-12-01T01:02:48.262423+0000","last_clean":"2023-12-01T01:02:48.262423+0000","last_became_active":"2023-12-01T01:02:47.282368+0000","last_became_peered":"2023-12-01T01:02:47.282368+0000","last_unstale":"2023-12-01T01:02:48.262423+0000","last_undegraded":"2023-12-01T01:02:48.262423+0000","last_fullsized":"2023-12-01T01:02:48.262423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:24:40.985055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783935+0000","last_change":"2023-12-01T01:02:46.827882+0000","last_active":"2023-12-01T01:02:48.783935+0000","last_peered":"2023-12-01T01:02:48.783935+0000","last_clean":"2023-12-01T01:02:48.783935+0000","last_became_active":"2023-12-01T01:02:46.827354+0000","last_became_peered":"2023-12-01T01:02:46.827354+0000","last_unstale":"2023-12-01T01:02:48.783935+0000","last_undegraded":"2023-12-01T01:02:48.783935+0000","last_fullsized":"2023-12-01T01:02:48.783935+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:48:42.894733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262959+0000","last_change":"2023-12-01T01:02:46.833439+0000","last_active":"2023-12-01T01:02:48.262959+0000","last_peered":"2023-12-01T01:02:48.262959+0000","last_clean":"2023-12-01T01:02:48.262959+0000","last_became_active":"2023-12-01T01:02:46.833199+0000","last_became_peered":"2023-12-01T01:02:46.833199+0000","last_unstale":"2023-12-01T01:02:48.262959+0000","last_undegraded":"2023-12-01T01:02:48.262959+0000","last_fullsized":"2023-12-01T01:02:48.262959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:44:49.559138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262637+0000","last_change":"2023-12-01T01:02:47.283580+0000","last_active":"2023-12-01T01:02:48.262637+0000","last_peered":"2023-12-01T01:02:48.262637+0000","last_clean":"2023-12-01T01:02:48.262637+0000","last_became_active":"2023-12-01T01:02:47.283095+0000","last_became_peered":"2023-12-01T01:02:47.283095+0000","last_unstale":"2023-12-01T01:02:48.262637+0000","last_undegraded":"2023-12-01T01:02:48.262637+0000","last_fullsized":"2023-12-01T01:02:48.262637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:33:12.541487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'3","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:51.332745+0000","last_change":"2023-12-01T01:02:46.831348+0000","last_active":"2023-12-01T01:02:51.332745+0000","last_peered":"2023-12-01T01:02:51.332745+0000","last_clean":"2023-12-01T01:02:51.332745+0000","last_became_active":"2023-12-01T01:02:46.831031+0000","last_became_peered":"2023-12-01T01:02:46.831031+0000","last_unstale":"2023-12-01T01:02:51.332745+0000","last_undegraded":"2023-12-01T01:02:51.332745+0000","last_fullsized":"2023-12-01T01:02:51.332745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:15:53.172465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784142+0000","last_change":"2023-12-01T01:02:47.276281+0000","last_active":"2023-12-01T01:02:48.784142+0000","last_peered":"2023-12-01T01:02:48.784142+0000","last_clean":"2023-12-01T01:02:48.784142+0000","last_became_active":"2023-12-01T01:02:47.275573+0000","last_became_peered":"2023-12-01T01:02:47.275573+0000","last_unstale":"2023-12-01T01:02:48.784142+0000","last_undegraded":"2023-12-01T01:02:48.784142+0000","last_fullsized":"2023-12-01T01:02:48.784142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:50:07.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784575+0000","last_change":"2023-12-01T01:02:46.823053+0000","last_active":"2023-12-01T01:02:48.784575+0000","last_peered":"2023-12-01T01:02:48.784575+0000","last_clean":"2023-12-01T01:02:48.784575+0000","last_became_active":"2023-12-01T01:02:46.822772+0000","last_became_peered":"2023-12-01T01:02:46.822772+0000","last_unstale":"2023-12-01T01:02:48.784575+0000","last_undegraded":"2023-12-01T01:02:48.784575+0000","last_fullsized":"2023-12-01T01:02:48.784575+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:43:22.496286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784830+0000","last_change":"2023-12-01T01:02:47.289484+0000","last_active":"2023-12-01T01:02:48.784830+0000","last_peered":"2023-12-01T01:02:48.784830+0000","last_clean":"2023-12-01T01:02:48.784830+0000","last_became_active":"2023-12-01T01:02:47.289176+0000","last_became_peered":"2023-12-01T01:02:47.289176+0000","last_unstale":"2023-12-01T01:02:48.784830+0000","last_undegraded":"2023-12-01T01:02:48.784830+0000","last_fullsized":"2023-12-01T01:02:48.784830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:21:52.905017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783856+0000","last_change":"2023-12-01T01:02:46.830635+0000","last_active":"2023-12-01T01:02:48.783856+0000","last_peered":"2023-12-01T01:02:48.783856+0000","last_clean":"2023-12-01T01:02:48.783856+0000","last_became_active":"2023-12-01T01:02:46.830337+0000","last_became_peered":"2023-12-01T01:02:46.830337+0000","last_unstale":"2023-12-01T01:02:48.783856+0000","last_undegraded":"2023-12-01T01:02:48.783856+0000","last_fullsized":"2023-12-01T01:02:48.783856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:02:10.017744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262696+0000","last_change":"2023-12-01T01:02:47.281923+0000","last_active":"2023-12-01T01:02:48.262696+0000","last_peered":"2023-12-01T01:02:48.262696+0000","last_clean":"2023-12-01T01:02:48.262696+0000","last_became_active":"2023-12-01T01:02:47.281598+0000","last_became_peered":"2023-12-01T01:02:47.281598+0000","last_unstale":"2023-12-01T01:02:48.262696+0000","last_undegraded":"2023-12-01T01:02:48.262696+0000","last_fullsized":"2023-12-01T01:02:48.262696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:07:54.327023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784985+0000","last_change":"2023-12-01T01:02:46.830248+0000","last_active":"2023-12-01T01:02:48.784985+0000","last_peered":"2023-12-01T01:02:48.784985+0000","last_clean":"2023-12-01T01:02:48.784985+0000","last_became_active":"2023-12-01T01:02:46.829951+0000","last_became_peered":"2023-12-01T01:02:46.829951+0000","last_unstale":"2023-12-01T01:02:48.784985+0000","last_undegraded":"2023-12-01T01:02:48.784985+0000","last_fullsized":"2023-12-01T01:02:48.784985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:04:23.978035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784607+0000","last_change":"2023-12-01T01:02:47.280871+0000","last_active":"2023-12-01T01:02:48.784607+0000","last_peered":"2023-12-01T01:02:48.784607+0000","last_clean":"2023-12-01T01:02:48.784607+0000","last_became_active":"2023-12-01T01:02:47.280527+0000","last_became_peered":"2023-12-01T01:02:47.280527+0000","last_unstale":"2023-12-01T01:02:48.784607+0000","last_undegraded":"2023-12-01T01:02:48.784607+0000","last_fullsized":"2023-12-01T01:02:48.784607+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:16:47.700500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783562+0000","last_change":"2023-12-01T01:02:46.829436+0000","last_active":"2023-12-01T01:02:48.783562+0000","last_peered":"2023-12-01T01:02:48.783562+0000","last_clean":"2023-12-01T01:02:48.783562+0000","last_became_active":"2023-12-01T01:02:46.829049+0000","last_became_peered":"2023-12-01T01:02:46.829049+0000","last_unstale":"2023-12-01T01:02:48.783562+0000","last_undegraded":"2023-12-01T01:02:48.783562+0000","last_fullsized":"2023-12-01T01:02:48.783562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:01:40.384545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.785075+0000","last_change":"2023-12-01T01:02:47.284981+0000","last_active":"2023-12-01T01:02:48.785075+0000","last_peered":"2023-12-01T01:02:48.785075+0000","last_clean":"2023-12-01T01:02:48.785075+0000","last_became_active":"2023-12-01T01:02:47.284576+0000","last_became_peered":"2023-12-01T01:02:47.284576+0000","last_unstale":"2023-12-01T01:02:48.785075+0000","last_undegraded":"2023-12-01T01:02:48.785075+0000","last_fullsized":"2023-12-01T01:02:48.785075+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:58:21.152156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262954+0000","last_change":"2023-12-01T01:02:46.828769+0000","last_active":"2023-12-01T01:02:48.262954+0000","last_peered":"2023-12-01T01:02:48.262954+0000","last_clean":"2023-12-01T01:02:48.262954+0000","last_became_active":"2023-12-01T01:02:46.828498+0000","last_became_peered":"2023-12-01T01:02:46.828498+0000","last_unstale":"2023-12-01T01:02:48.262954+0000","last_undegraded":"2023-12-01T01:02:48.262954+0000","last_fullsized":"2023-12-01T01:02:48.262954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:12:26.618082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784537+0000","last_change":"2023-12-01T01:02:47.283179+0000","last_active":"2023-12-01T01:02:48.784537+0000","last_peered":"2023-12-01T01:02:48.784537+0000","last_clean":"2023-12-01T01:02:48.784537+0000","last_became_active":"2023-12-01T01:02:47.282883+0000","last_became_peered":"2023-12-01T01:02:47.282883+0000","last_unstale":"2023-12-01T01:02:48.784537+0000","last_undegraded":"2023-12-01T01:02:48.784537+0000","last_fullsized":"2023-12-01T01:02:48.784537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:19:47.406888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783664+0000","last_change":"2023-12-01T01:02:46.833482+0000","last_active":"2023-12-01T01:02:48.783664+0000","last_peered":"2023-12-01T01:02:48.783664+0000","last_clean":"2023-12-01T01:02:48.783664+0000","last_became_active":"2023-12-01T01:02:46.833200+0000","last_became_peered":"2023-12-01T01:02:46.833200+0000","last_unstale":"2023-12-01T01:02:48.783664+0000","last_undegraded":"2023-12-01T01:02:48.783664+0000","last_fullsized":"2023-12-01T01:02:48.783664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:52:41.480509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.785229+0000","last_change":"2023-12-01T01:02:47.275802+0000","last_active":"2023-12-01T01:02:48.785229+0000","last_peered":"2023-12-01T01:02:48.785229+0000","last_clean":"2023-12-01T01:02:48.785229+0000","last_became_active":"2023-12-01T01:02:47.274837+0000","last_became_peered":"2023-12-01T01:02:47.274837+0000","last_unstale":"2023-12-01T01:02:48.785229+0000","last_undegraded":"2023-12-01T01:02:48.785229+0000","last_fullsized":"2023-12-01T01:02:48.785229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:43:30.799999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783893+0000","last_change":"2023-12-01T01:02:46.829445+0000","last_active":"2023-12-01T01:02:48.783893+0000","last_peered":"2023-12-01T01:02:48.783893+0000","last_clean":"2023-12-01T01:02:48.783893+0000","last_became_active":"2023-12-01T01:02:46.829120+0000","last_became_peered":"2023-12-01T01:02:46.829120+0000","last_unstale":"2023-12-01T01:02:48.783893+0000","last_undegraded":"2023-12-01T01:02:48.783893+0000","last_fullsized":"2023-12-01T01:02:48.783893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:57:44.467570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784100+0000","last_change":"2023-12-01T01:02:47.282683+0000","last_active":"2023-12-01T01:02:48.784100+0000","last_peered":"2023-12-01T01:02:48.784100+0000","last_clean":"2023-12-01T01:02:48.784100+0000","last_became_active":"2023-12-01T01:02:47.282346+0000","last_became_peered":"2023-12-01T01:02:47.282346+0000","last_unstale":"2023-12-01T01:02:48.784100+0000","last_undegraded":"2023-12-01T01:02:48.784100+0000","last_fullsized":"2023-12-01T01:02:48.784100+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:20:25.085982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262811+0000","last_change":"2023-12-01T01:02:46.828060+0000","last_active":"2023-12-01T01:02:48.262811+0000","last_peered":"2023-12-01T01:02:48.262811+0000","last_clean":"2023-12-01T01:02:48.262811+0000","last_became_active":"2023-12-01T01:02:46.827754+0000","last_became_peered":"2023-12-01T01:02:46.827754+0000","last_unstale":"2023-12-01T01:02:48.262811+0000","last_undegraded":"2023-12-01T01:02:48.262811+0000","last_fullsized":"2023-12-01T01:02:48.262811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:22.794619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784692+0000","last_change":"2023-12-01T01:02:47.269538+0000","last_active":"2023-12-01T01:02:48.784692+0000","last_peered":"2023-12-01T01:02:48.784692+0000","last_clean":"2023-12-01T01:02:48.784692+0000","last_became_active":"2023-12-01T01:02:47.269245+0000","last_became_peered":"2023-12-01T01:02:47.269245+0000","last_unstale":"2023-12-01T01:02:48.784692+0000","last_undegraded":"2023-12-01T01:02:48.784692+0000","last_fullsized":"2023-12-01T01:02:48.784692+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:49.163896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784696+0000","last_change":"2023-12-01T01:02:47.277545+0000","last_active":"2023-12-01T01:02:48.784696+0000","last_peered":"2023-12-01T01:02:48.784696+0000","last_clean":"2023-12-01T01:02:48.784696+0000","last_became_active":"2023-12-01T01:02:47.277307+0000","last_became_peered":"2023-12-01T01:02:47.277307+0000","last_unstale":"2023-12-01T01:02:48.784696+0000","last_undegraded":"2023-12-01T01:02:48.784696+0000","last_fullsized":"2023-12-01T01:02:48.784696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:08.655231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783468+0000","last_change":"2023-12-01T01:02:47.267831+0000","last_active":"2023-12-01T01:02:48.783468+0000","last_peered":"2023-12-01T01:02:48.783468+0000","last_clean":"2023-12-01T01:02:48.783468+0000","last_became_active":"2023-12-01T01:02:47.267538+0000","last_became_peered":"2023-12-01T01:02:47.267538+0000","last_unstale":"2023-12-01T01:02:48.783468+0000","last_undegraded":"2023-12-01T01:02:48.783468+0000","last_fullsized":"2023-12-01T01:02:48.783468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:54:00.840031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783472+0000","last_change":"2023-12-01T01:02:47.274775+0000","last_active":"2023-12-01T01:02:48.783472+0000","last_peered":"2023-12-01T01:02:48.783472+0000","last_clean":"2023-12-01T01:02:48.783472+0000","last_became_active":"2023-12-01T01:02:47.274459+0000","last_became_peered":"2023-12-01T01:02:47.274459+0000","last_unstale":"2023-12-01T01:02:48.783472+0000","last_undegraded":"2023-12-01T01:02:48.783472+0000","last_fullsized":"2023-12-01T01:02:48.783472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:06:01.273551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784651+0000","last_change":"2023-12-01T01:02:47.277487+0000","last_active":"2023-12-01T01:02:48.784651+0000","last_peered":"2023-12-01T01:02:48.784651+0000","last_clean":"2023-12-01T01:02:48.784651+0000","last_became_active":"2023-12-01T01:02:47.277092+0000","last_became_peered":"2023-12-01T01:02:47.277092+0000","last_unstale":"2023-12-01T01:02:48.784651+0000","last_undegraded":"2023-12-01T01:02:48.784651+0000","last_fullsized":"2023-12-01T01:02:48.784651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:02:51.967302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262574+0000","last_change":"2023-12-01T01:02:47.283814+0000","last_active":"2023-12-01T01:02:48.262574+0000","last_peered":"2023-12-01T01:02:48.262574+0000","last_clean":"2023-12-01T01:02:48.262574+0000","last_became_active":"2023-12-01T01:02:47.283289+0000","last_became_peered":"2023-12-01T01:02:47.283289+0000","last_unstale":"2023-12-01T01:02:48.262574+0000","last_undegraded":"2023-12-01T01:02:48.262574+0000","last_fullsized":"2023-12-01T01:02:48.262574+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:42:59.523846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784080+0000","last_change":"2023-12-01T01:02:47.281748+0000","last_active":"2023-12-01T01:02:48.784080+0000","last_peered":"2023-12-01T01:02:48.784080+0000","last_clean":"2023-12-01T01:02:48.784080+0000","last_became_active":"2023-12-01T01:02:47.281445+0000","last_became_peered":"2023-12-01T01:02:47.281445+0000","last_unstale":"2023-12-01T01:02:48.784080+0000","last_undegraded":"2023-12-01T01:02:48.784080+0000","last_fullsized":"2023-12-01T01:02:48.784080+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:33:18.146911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784493+0000","last_change":"2023-12-01T01:02:47.276827+0000","last_active":"2023-12-01T01:02:48.784493+0000","last_peered":"2023-12-01T01:02:48.784493+0000","last_clean":"2023-12-01T01:02:48.784493+0000","last_became_active":"2023-12-01T01:02:47.276346+0000","last_became_peered":"2023-12-01T01:02:47.276346+0000","last_unstale":"2023-12-01T01:02:48.784493+0000","last_undegraded":"2023-12-01T01:02:48.784493+0000","last_fullsized":"2023-12-01T01:02:48.784493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:49:23.203883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784049+0000","last_change":"2023-12-01T01:02:47.276461+0000","last_active":"2023-12-01T01:02:48.784049+0000","last_peered":"2023-12-01T01:02:48.784049+0000","last_clean":"2023-12-01T01:02:48.784049+0000","last_became_active":"2023-12-01T01:02:47.275992+0000","last_became_peered":"2023-12-01T01:02:47.275992+0000","last_unstale":"2023-12-01T01:02:48.784049+0000","last_undegraded":"2023-12-01T01:02:48.784049+0000","last_fullsized":"2023-12-01T01:02:48.784049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:14:04.629355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783579+0000","last_change":"2023-12-01T01:02:47.274018+0000","last_active":"2023-12-01T01:02:48.783579+0000","last_peered":"2023-12-01T01:02:48.783579+0000","last_clean":"2023-12-01T01:02:48.783579+0000","last_became_active":"2023-12-01T01:02:47.273714+0000","last_became_peered":"2023-12-01T01:02:47.273714+0000","last_unstale":"2023-12-01T01:02:48.783579+0000","last_undegraded":"2023-12-01T01:02:48.783579+0000","last_fullsized":"2023-12-01T01:02:48.783579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:26:14.154249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784895+0000","last_change":"2023-12-01T01:02:47.276438+0000","last_active":"2023-12-01T01:02:48.784895+0000","last_peered":"2023-12-01T01:02:48.784895+0000","last_clean":"2023-12-01T01:02:48.784895+0000","last_became_active":"2023-12-01T01:02:47.276121+0000","last_became_peered":"2023-12-01T01:02:47.276121+0000","last_unstale":"2023-12-01T01:02:48.784895+0000","last_undegraded":"2023-12-01T01:02:48.784895+0000","last_fullsized":"2023-12-01T01:02:48.784895+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:09:25.689189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784065+0000","last_change":"2023-12-01T01:02:47.275763+0000","last_active":"2023-12-01T01:02:48.784065+0000","last_peered":"2023-12-01T01:02:48.784065+0000","last_clean":"2023-12-01T01:02:48.784065+0000","last_became_active":"2023-12-01T01:02:47.275484+0000","last_became_peered":"2023-12-01T01:02:47.275484+0000","last_unstale":"2023-12-01T01:02:48.784065+0000","last_undegraded":"2023-12-01T01:02:48.784065+0000","last_fullsized":"2023-12-01T01:02:48.784065+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:38:02.612857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262756+0000","last_change":"2023-12-01T01:02:47.274122+0000","last_active":"2023-12-01T01:02:48.262756+0000","last_peered":"2023-12-01T01:02:48.262756+0000","last_clean":"2023-12-01T01:02:48.262756+0000","last_became_active":"2023-12-01T01:02:47.273005+0000","last_became_peered":"2023-12-01T01:02:47.273005+0000","last_unstale":"2023-12-01T01:02:48.262756+0000","last_undegraded":"2023-12-01T01:02:48.262756+0000","last_fullsized":"2023-12-01T01:02:48.262756+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:42:59.273076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783824+0000","last_change":"2023-12-01T01:02:47.270221+0000","last_active":"2023-12-01T01:02:48.783824+0000","last_peered":"2023-12-01T01:02:48.783824+0000","last_clean":"2023-12-01T01:02:48.783824+0000","last_became_active":"2023-12-01T01:02:47.269946+0000","last_became_peered":"2023-12-01T01:02:47.269946+0000","last_unstale":"2023-12-01T01:02:48.783824+0000","last_undegraded":"2023-12-01T01:02:48.783824+0000","last_fullsized":"2023-12-01T01:02:48.783824+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:00:01.640510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283824,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2452,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":9240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514508,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":868352,"data_stored":415764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":10,"up_from":69,"seq":296352743440,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":1009226,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.314}]},{"osd":2,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.40500000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.45500000000000002}]},{"osd":6,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.53400000000000003}]},{"osd":9,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.54900000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]},{"osd":9,"up_from":64,"seq":274877906963,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":884736,"data_stored":416548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.317}]},{"osd":1,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.63},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.502}]},{"osd":5,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.2309999999999999,"5min":4.2309999999999999,"15min":4.2309999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.64600000000000002}]},{"osd":8,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":4.2729999999999997,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.61899999999999999}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":4.6369999999999996,"5min":4.6369999999999996,"15min":4.6369999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.69399999999999995}]}]},{"osd":8,"up_from":57,"seq":244813135895,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":876544,"data_stored":416368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.621}]},{"osd":1,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.435}]},{"osd":3,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.68799999999999994}]},{"osd":4,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.7429999999999999,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.5590000000000002,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.75},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.71399999999999997}]},{"osd":9,"last update":"Fri Dec 1 01:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.73699999999999999}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.76200000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":7,"up_from":50,"seq":214748364827,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":921600,"data_stored":1006714,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.39600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.251},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.372},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.42299999999999999,"15min":0.41799999999999998},"min":{"1min":0.27000000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.435,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.51200000000000001}]},{"osd":3,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.46700000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61199999999999999,"15min":0.60599999999999998},"min":{"1min":0.48699999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.48699999999999999,"15min":0.48299999999999998},"min":{"1min":0.311,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.40100000000000002}]},{"osd":5,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.501,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.59999999999999998}]},{"osd":6,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51000000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56000000000000005}]},{"osd":8,"last update":"Fri Dec 1 01:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.59399999999999997}]},{"osd":9,"last update":"Fri Dec 1 01:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.57899999999999996}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.54400000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":6,"up_from":45,"seq":193273528351,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":868352,"data_stored":415764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.66000000000000003,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.437,"15min":0.43099999999999999},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.435,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.72199999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.62},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63,"15min":0.624},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.55400000000000005}]},{"osd":3,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.375,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85199999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.432}]},{"osd":4,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60199999999999998,"15min":0.59899999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.68000000000000005,"15min":0.66800000000000004},"min":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.496}]},{"osd":5,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65100000000000002,"15min":0.65200000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83199999999999996,"5min":1.319,"15min":1.319},"last":0.77300000000000002}]},{"osd":7,"last update":"Fri Dec 1 01:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64500000000000002,"15min":0.64000000000000001},"min":{"1min":0.53500000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.52900000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.755}]},{"osd":8,"last update":"Fri Dec 1 01:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.72499999999999998}]},{"osd":9,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.59599999999999997}]},{"osd":10,"last update":"Fri Dec 1 01:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.70699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27812,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717340,"statfs":{"total":95995035648,"available":95966556160,"internally_reserved":0,"allocated":880640,"data_stored":417328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.503,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.75600000000000001,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.34999999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.48699999999999999},"min":{"1min":0.40799999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82699999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.51100000000000001,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Dec 1 01:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.378},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55800000000000005,"15min":0.54200000000000004},"min":{"1min":0.36499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.35799999999999998},"min":{"1min":0.28399999999999997,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.38400000000000001,"15min":0.376},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55100000000000005,"15min":0.54400000000000004},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":0.72499999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.55300000000000005},"min":{"1min":0.41399999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Dec 1 01:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.42999999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.50600000000000001}]},{"osd":7,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.53400000000000003,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.41699999999999998}]},{"osd":8,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60599999999999998}]},{"osd":9,"last update":"Fri Dec 1 01:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58899999999999997}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.621},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738423,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":872448,"data_stored":415854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.505}]},{"osd":2,"last update":"Fri Dec 1 01:02:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78900000000000003,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.85299999999999998,"5min":0.875,"15min":0.875},"last":0.67700000000000005}]},{"osd":3,"last update":"Fri Dec 1 01:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40799999999999997},"min":{"1min":0.251,"5min":0.249,"15min":0.249},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.46200000000000002,"15min":0.45600000000000002},"min":{"1min":0.32600000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.53200000000000003,"15min":0.51900000000000002},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53300000000000003,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.56000000000000005}]},{"osd":5,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81200000000000006,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57899999999999996,"15min":0.57999999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Dec 1 01:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80700000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60399999999999998,"15min":0.59599999999999997},"min":{"1min":0.38800000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.91700000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.628}]},{"osd":8,"last update":"Fri Dec 1 01:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.44},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63700000000000001}]},{"osd":9,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.54900000000000004}]},{"osd":10,"last update":"Fri Dec 1 01:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.81999999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":884736,"data_stored":417362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77000000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48099999999999998,"15min":0.47699999999999998},"min":{"1min":0.33600000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Dec 1 01:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.625,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66700000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Dec 1 01:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.53700000000000003,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89600000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.42599999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.60199999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.39000000000000001}]},{"osd":6,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.877,"15min":0.877},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.48799999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.52000000000000002}]},{"osd":7,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.59199999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.495},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46899999999999997}]},{"osd":9,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.503},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.52800000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":3,"up_from":25,"seq":107374182443,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":876544,"data_stored":415868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.376,"15min":0.35199999999999998},"min":{"1min":0.312,"5min":0.245,"15min":0.245},"max":{"1min":0.61099999999999999,"5min":0.623,"15min":0.623},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.39300000000000002,"15min":0.373},"min":{"1min":0.315,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.623,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.53900000000000003,"15min":0.505},"min":{"1min":0.435,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.84899999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.629},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.56499999999999995,"15min":0.52100000000000002},"min":{"1min":0.497,"5min":0.371,"15min":0.371},"max":{"1min":0.85199999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46200000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.442},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52800000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:02:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.60999999999999999,"15min":0.58099999999999996},"min":{"1min":0.504,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.60099999999999998,"15min":0.57699999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60899999999999999,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.495},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.50600000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51100000000000001}]},{"osd":6,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.35499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77100000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.57699999999999996,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri Dec 1 01:02:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.74299999999999999,"15min":0.73599999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.73099999999999998,"15min":0.71899999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.71899999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.65200000000000002}]},{"osd":9,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.60399999999999998}]},{"osd":10,"last update":"Fri Dec 1 01:02:48 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.752}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":4,"up_from":32,"seq":137438953511,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":872448,"data_stored":415786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51600000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.85099999999999998,"5min":0.88,"15min":0.88},"last":0.371},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.42999999999999999}]},{"osd":1,"last update":"Fri Dec 1 01:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.36199999999999999,"15min":0.35999999999999999},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.498,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.377},"min":{"1min":0.28999999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68200000000000005,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.44}]},{"osd":2,"last update":"Fri Dec 1 01:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.44600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Dec 1 01:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71699999999999997,"5min":1.004,"15min":1.004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86599999999999999,"5min":0.879,"15min":0.879},"last":0.46200000000000002}]},{"osd":5,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81200000000000006,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.63}]},{"osd":6,"last update":"Fri Dec 1 01:02:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.41499999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94499999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.496},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.60799999999999998,"15min":0.59399999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.50600000000000001}]},{"osd":7,"last update":"Fri Dec 1 01:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.54300000000000004}]},{"osd":8,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.67400000000000004}]},{"osd":9,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.55400000000000005}]},{"osd":10,"last update":"Fri Dec 1 01:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":5,"up_from":37,"seq":158913789988,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":929792,"data_stored":1006314,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.495,"15min":0.495},"min":{"1min":0.30299999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.249},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.49099999999999999,"15min":0.48799999999999999},"min":{"1min":0.307,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.28999999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69399999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.437}]},{"osd":2,"last update":"Fri Dec 1 01:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.379},"min":{"1min":0.26300000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.28399999999999997,"5min":0.249,"15min":0.249},"max":{"1min":0.58299999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.30399999999999999}]},{"osd":3,"last update":"Fri Dec 1 01:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53600000000000003,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77100000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35099999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.35099999999999998}]},{"osd":4,"last update":"Fri Dec 1 01:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.374},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.318}]},{"osd":6,"last update":"Fri Dec 1 01:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.621,"15min":0.624},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66800000000000004,"15min":0.67000000000000004},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91100000000000003,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.42899999999999999}]},{"osd":7,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88100000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.47899999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47899999999999998}]},{"osd":8,"last update":"Fri Dec 1 01:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.39500000000000002}]},{"osd":9,"last update":"Fri Dec 1 01:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.48999999999999999}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.45900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T01:02:55.125 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T01:02:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.280+0000 7fa426734700 1 -- 172.21.15.26:0/82198060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa420104920 msgr2=0x7fa420104da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.280+0000 7fa426734700 1 --2- 172.21.15.26:0/82198060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa420104920 0x7fa420104da0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa41800b0a0 tx=0x7fa41800b3b0 comp rx=0 tx=0).stop 2023-12-01T01:02:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.280+0000 7fa426734700 1 -- 172.21.15.26:0/82198060 shutdown_connections 2023-12-01T01:02:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.281+0000 7fa426734700 1 --2- 172.21.15.26:0/82198060 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa420104920 0x7fa420104da0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.281+0000 7fa426734700 1 --2- 172.21.15.26:0/82198060 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa4200ff5e0 0x7fa420101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.281+0000 7fa426734700 1 --2- 172.21.15.26:0/82198060 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa420101f50 0x7fa4201043e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.281+0000 7fa426734700 1 -- 172.21.15.26:0/82198060 >> 172.21.15.26:0/82198060 conn(0x7fa4200fb1c0 msgr2=0x7fa4200fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.281+0000 7fa426734700 1 -- 172.21.15.26:0/82198060 shutdown_connections 2023-12-01T01:02:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.281+0000 7fa426734700 1 -- 172.21.15.26:0/82198060 wait complete. 2023-12-01T01:02:55.284 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.281+0000 7fa426734700 1 Processor -- start 2023-12-01T01:02:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.281+0000 7fa426734700 1 -- start start 2023-12-01T01:02:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.282+0000 7fa426734700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4200ff5e0 0x7fa42019d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.282+0000 7fa426734700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa420101f50 0x7fa42019d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:55.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.282+0000 7fa426734700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa420104920 0x7fa4201a4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.282+0000 7fa426734700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4201a4e00 con 0x7fa4200ff5e0 2023-12-01T01:02:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.282+0000 7fa426734700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4201a4f40 con 0x7fa420101f50 2023-12-01T01:02:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.282+0000 7fa426734700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4201a50d0 con 0x7fa420104920 2023-12-01T01:02:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.282+0000 7fa41ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4200ff5e0 0x7fa42019d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.282+0000 7fa41ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4200ff5e0 0x7fa42019d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53730/0 (socket says 172.21.15.26:53730) 2023-12-01T01:02:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.282+0000 7fa41ffff700 1 -- 172.21.15.26:0/116078915 learned_addr learned my addr 172.21.15.26:0/116078915 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.282+0000 7fa41f7fe700 1 --2- 172.21.15.26:0/116078915 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa420101f50 0x7fa42019d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.282+0000 7fa424cd1700 1 --2- 172.21.15.26:0/116078915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa420104920 0x7fa4201a4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.282+0000 7fa41ffff700 1 -- 172.21.15.26:0/116078915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa420104920 msgr2=0x7fa4201a4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.282+0000 7fa41ffff700 1 --2- 172.21.15.26:0/116078915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa420104920 0x7fa4201a4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.282+0000 7fa41ffff700 1 -- 172.21.15.26:0/116078915 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa420101f50 msgr2=0x7fa42019d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.282+0000 7fa41ffff700 1 --2- 172.21.15.26:0/116078915 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa420101f50 0x7fa42019d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.282+0000 7fa41ffff700 1 -- 172.21.15.26:0/116078915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa408009520 con 0x7fa4200ff5e0 2023-12-01T01:02:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.283+0000 7fa41ffff700 1 --2- 172.21.15.26:0/116078915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4200ff5e0 0x7fa42019d280 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa40800eb30 tx=0x7fa40800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.283+0000 7fa41d7fa700 1 -- 172.21.15.26:0/116078915 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa408009880 con 0x7fa4200ff5e0 2023-12-01T01:02:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.283+0000 7fa426734700 1 -- 172.21.15.26:0/116078915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa418009d00 con 0x7fa4200ff5e0 2023-12-01T01:02:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.283+0000 7fa41d7fa700 1 -- 172.21.15.26:0/116078915 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa408004500 con 0x7fa4200ff5e0 2023-12-01T01:02:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.283+0000 7fa41d7fa700 1 -- 172.21.15.26:0/116078915 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa408003e70 con 0x7fa4200ff5e0 2023-12-01T01:02:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.283+0000 7fa426734700 1 -- 172.21.15.26:0/116078915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4201a5780 con 0x7fa4200ff5e0 2023-12-01T01:02:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.284+0000 7fa426734700 1 -- 172.21.15.26:0/116078915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4200fcd40 con 0x7fa4200ff5e0 2023-12-01T01:02:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.285+0000 7fa41d7fa700 1 -- 172.21.15.26:0/116078915 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fa40800cbd0 con 0x7fa4200ff5e0 2023-12-01T01:02:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.286+0000 7fa41d7fa700 1 --2- 172.21.15.26:0/116078915 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa40c0a0670 0x7fa40c0a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.286+0000 7fa41f7fe700 1 --2- 172.21.15.26:0/116078915 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa40c0a0670 0x7fa40c0a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.286+0000 7fa41d7fa700 1 -- 172.21.15.26:0/116078915 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa408014070 con 0x7fa4200ff5e0 2023-12-01T01:02:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.287+0000 7fa41f7fe700 1 --2- 172.21.15.26:0/116078915 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa40c0a0670 0x7fa40c0a2b30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa410009be0 tx=0x7fa410009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:55.292 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.290+0000 7fa41d7fa700 1 -- 172.21.15.26:0/116078915 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa4080958f0 con 0x7fa4200ff5e0 2023-12-01T01:02:55.494 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.491+0000 7fa426734700 1 -- 172.21.15.26:0/116078915 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa4200611d0 con 0x7fa40c0a0670 2023-12-01T01:02:55.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.503+0000 7fa41d7fa700 1 -- 172.21.15.26:0/116078915 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335370 (secure 0 0 0) 0x7fa4200611d0 con 0x7fa40c0a0670 2023-12-01T01:02:55.509 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:02:55.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.507+0000 7fa426734700 1 -- 172.21.15.26:0/116078915 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa40c0a0670 msgr2=0x7fa40c0a2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.507+0000 7fa426734700 1 --2- 172.21.15.26:0/116078915 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa40c0a0670 0x7fa40c0a2b30 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa410009be0 tx=0x7fa410009260 comp rx=0 tx=0).stop 2023-12-01T01:02:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.507+0000 7fa426734700 1 -- 172.21.15.26:0/116078915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4200ff5e0 msgr2=0x7fa42019d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.507+0000 7fa426734700 1 --2- 172.21.15.26:0/116078915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4200ff5e0 0x7fa42019d280 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa40800eb30 tx=0x7fa40800ee40 comp rx=0 tx=0).stop 2023-12-01T01:02:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.507+0000 7fa426734700 1 -- 172.21.15.26:0/116078915 shutdown_connections 2023-12-01T01:02:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.507+0000 7fa426734700 1 --2- 172.21.15.26:0/116078915 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa40c0a0670 0x7fa40c0a2b30 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.507+0000 7fa426734700 1 --2- 172.21.15.26:0/116078915 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa420104920 0x7fa4201a4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.507+0000 7fa426734700 1 --2- 172.21.15.26:0/116078915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa4200ff5e0 0x7fa42019d280 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.507+0000 7fa426734700 1 --2- 172.21.15.26:0/116078915 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa420101f50 0x7fa42019d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.507+0000 7fa426734700 1 -- 172.21.15.26:0/116078915 >> 172.21.15.26:0/116078915 conn(0x7fa4200fb1c0 msgr2=0x7fa420100290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.507+0000 7fa426734700 1 -- 172.21.15.26:0/116078915 shutdown_connections 2023-12-01T01:02:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:55.507+0000 7fa426734700 1 -- 172.21.15.26:0/116078915 wait complete. 2023-12-01T01:02:55.512 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-12-01T01:02:55.520 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:55 smithi026 ceph-mon[98801]: pgmap v249: 97 pgs: 97 active+clean; 579 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 8 op/s 2023-12-01T01:02:55.521 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:55 smithi026 ceph-mon[98801]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:02:55.521 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:55 smithi026 ceph-mon[98801]: mgrmap e17: x(active, since 5m), standbys: z, y 2023-12-01T01:02:55.521 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:55 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3065903430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:55.521 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:55 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1893581071' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:55.522 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2023-12-01T01:02:53.953654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592820,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":245,"num_write_kb":2953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":191,"ondisk_log_size":191,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":217,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":333872,"kb_used_data":10448,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124607952,"statfs":{"total":1151940427776,"available":1151598542848,"internally_reserved":0,"allocated":10698752,"data_stored":6768896,"data_compressed":108279,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2452,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.141386"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.785234+0000","last_change":"2023-12-01T01:02:47.280671+0000","last_active":"2023-12-01T01:02:48.785234+0000","last_peered":"2023-12-01T01:02:48.785234+0000","last_clean":"2023-12-01T01:02:48.785234+0000","last_became_active":"2023-12-01T01:02:47.279922+0000","last_became_peered":"2023-12-01T01:02:47.279922+0000","last_unstale":"2023-12-01T01:02:48.785234+0000","last_undegraded":"2023-12-01T01:02:48.785234+0000","last_fullsized":"2023-12-01T01:02:48.785234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:07:38.049977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784882+0000","last_change":"2023-12-01T01:02:47.286185+0000","last_active":"2023-12-01T01:02:48.784882+0000","last_peered":"2023-12-01T01:02:48.784882+0000","last_clean":"2023-12-01T01:02:48.784882+0000","last_became_active":"2023-12-01T01:02:47.283747+0000","last_became_peered":"2023-12-01T01:02:47.283747+0000","last_unstale":"2023-12-01T01:02:48.784882+0000","last_undegraded":"2023-12-01T01:02:48.784882+0000","last_fullsized":"2023-12-01T01:02:48.784882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:38:32.697826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784500+0000","last_change":"2023-12-01T01:02:47.285778+0000","last_active":"2023-12-01T01:02:48.784500+0000","last_peered":"2023-12-01T01:02:48.784500+0000","last_clean":"2023-12-01T01:02:48.784500+0000","last_became_active":"2023-12-01T01:02:47.279395+0000","last_became_peered":"2023-12-01T01:02:47.279395+0000","last_unstale":"2023-12-01T01:02:48.784500+0000","last_undegraded":"2023-12-01T01:02:48.784500+0000","last_fullsized":"2023-12-01T01:02:48.784500+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:04:20.570660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784888+0000","last_change":"2023-12-01T01:02:47.269316+0000","last_active":"2023-12-01T01:02:48.784888+0000","last_peered":"2023-12-01T01:02:48.784888+0000","last_clean":"2023-12-01T01:02:48.784888+0000","last_became_active":"2023-12-01T01:02:47.269041+0000","last_became_peered":"2023-12-01T01:02:47.269041+0000","last_unstale":"2023-12-01T01:02:48.784888+0000","last_undegraded":"2023-12-01T01:02:48.784888+0000","last_fullsized":"2023-12-01T01:02:48.784888+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:24:27.951422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262813+0000","last_change":"2023-12-01T01:02:47.273802+0000","last_active":"2023-12-01T01:02:48.262813+0000","last_peered":"2023-12-01T01:02:48.262813+0000","last_clean":"2023-12-01T01:02:48.262813+0000","last_became_active":"2023-12-01T01:02:47.273450+0000","last_became_peered":"2023-12-01T01:02:47.273450+0000","last_unstale":"2023-12-01T01:02:48.262813+0000","last_undegraded":"2023-12-01T01:02:48.262813+0000","last_fullsized":"2023-12-01T01:02:48.262813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:19:39.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-12-01T01:02:47.277408+0000","last_change":"2023-12-01T01:02:47.274505+0000","last_active":"2023-12-01T01:02:47.277408+0000","last_peered":"2023-12-01T01:02:47.277408+0000","last_clean":"2023-12-01T01:02:47.277408+0000","last_became_active":"2023-12-01T01:02:47.274141+0000","last_became_peered":"2023-12-01T01:02:47.274141+0000","last_unstale":"2023-12-01T01:02:47.277408+0000","last_undegraded":"2023-12-01T01:02:47.277408+0000","last_fullsized":"2023-12-01T01:02:47.277408+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:27:16.589927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783985+0000","last_change":"2023-12-01T01:02:47.279480+0000","last_active":"2023-12-01T01:02:48.783985+0000","last_peered":"2023-12-01T01:02:48.783985+0000","last_clean":"2023-12-01T01:02:48.783985+0000","last_became_active":"2023-12-01T01:02:47.279147+0000","last_became_peered":"2023-12-01T01:02:47.279147+0000","last_unstale":"2023-12-01T01:02:48.783985+0000","last_undegraded":"2023-12-01T01:02:48.783985+0000","last_fullsized":"2023-12-01T01:02:48.783985+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:28:37.815087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783733+0000","last_change":"2023-12-01T01:02:47.283997+0000","last_active":"2023-12-01T01:02:48.783733+0000","last_peered":"2023-12-01T01:02:48.783733+0000","last_clean":"2023-12-01T01:02:48.783733+0000","last_became_active":"2023-12-01T01:02:47.283694+0000","last_became_peered":"2023-12-01T01:02:47.283694+0000","last_unstale":"2023-12-01T01:02:48.783733+0000","last_undegraded":"2023-12-01T01:02:48.783733+0000","last_fullsized":"2023-12-01T01:02:48.783733+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:49:30.154079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784297+0000","last_change":"2023-12-01T01:02:47.280113+0000","last_active":"2023-12-01T01:02:48.784297+0000","last_peered":"2023-12-01T01:02:48.784297+0000","last_clean":"2023-12-01T01:02:48.784297+0000","last_became_active":"2023-12-01T01:02:47.279844+0000","last_became_peered":"2023-12-01T01:02:47.279844+0000","last_unstale":"2023-12-01T01:02:48.784297+0000","last_undegraded":"2023-12-01T01:02:48.784297+0000","last_fullsized":"2023-12-01T01:02:48.784297+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:50:19.955146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-12-01T01:02:47.278206+0000","last_change":"2023-12-01T01:02:47.275575+0000","last_active":"2023-12-01T01:02:47.278206+0000","last_peered":"2023-12-01T01:02:47.278206+0000","last_clean":"2023-12-01T01:02:47.278206+0000","last_became_active":"2023-12-01T01:02:47.275283+0000","last_became_peered":"2023-12-01T01:02:47.275283+0000","last_unstale":"2023-12-01T01:02:47.278206+0000","last_undegraded":"2023-12-01T01:02:47.278206+0000","last_fullsized":"2023-12-01T01:02:47.278206+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:08:41.842374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.785105+0000","last_change":"2023-12-01T01:02:47.275992+0000","last_active":"2023-12-01T01:02:48.785105+0000","last_peered":"2023-12-01T01:02:48.785105+0000","last_clean":"2023-12-01T01:02:48.785105+0000","last_became_active":"2023-12-01T01:02:47.275406+0000","last_became_peered":"2023-12-01T01:02:47.275406+0000","last_unstale":"2023-12-01T01:02:48.785105+0000","last_undegraded":"2023-12-01T01:02:48.785105+0000","last_fullsized":"2023-12-01T01:02:48.785105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:58:39.978873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784876+0000","last_change":"2023-12-01T01:02:47.282829+0000","last_active":"2023-12-01T01:02:48.784876+0000","last_peered":"2023-12-01T01:02:48.784876+0000","last_clean":"2023-12-01T01:02:48.784876+0000","last_became_active":"2023-12-01T01:02:47.282007+0000","last_became_peered":"2023-12-01T01:02:47.282007+0000","last_unstale":"2023-12-01T01:02:48.784876+0000","last_undegraded":"2023-12-01T01:02:48.784876+0000","last_fullsized":"2023-12-01T01:02:48.784876+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:55:57.394004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262855+0000","last_change":"2023-12-01T01:02:47.276769+0000","last_active":"2023-12-01T01:02:48.262855+0000","last_peered":"2023-12-01T01:02:48.262855+0000","last_clean":"2023-12-01T01:02:48.262855+0000","last_became_active":"2023-12-01T01:02:47.276355+0000","last_became_peered":"2023-12-01T01:02:47.276355+0000","last_unstale":"2023-12-01T01:02:48.262855+0000","last_undegraded":"2023-12-01T01:02:48.262855+0000","last_fullsized":"2023-12-01T01:02:48.262855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:15:23.314516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784040+0000","last_change":"2023-12-01T01:02:47.286107+0000","last_active":"2023-12-01T01:02:48.784040+0000","last_peered":"2023-12-01T01:02:48.784040+0000","last_clean":"2023-12-01T01:02:48.784040+0000","last_became_active":"2023-12-01T01:02:47.285772+0000","last_became_peered":"2023-12-01T01:02:47.285772+0000","last_unstale":"2023-12-01T01:02:48.784040+0000","last_undegraded":"2023-12-01T01:02:48.784040+0000","last_fullsized":"2023-12-01T01:02:48.784040+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:30:29.730055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783787+0000","last_change":"2023-12-01T01:02:47.281813+0000","last_active":"2023-12-01T01:02:48.783787+0000","last_peered":"2023-12-01T01:02:48.783787+0000","last_clean":"2023-12-01T01:02:48.783787+0000","last_became_active":"2023-12-01T01:02:47.279117+0000","last_became_peered":"2023-12-01T01:02:47.279117+0000","last_unstale":"2023-12-01T01:02:48.783787+0000","last_undegraded":"2023-12-01T01:02:48.783787+0000","last_fullsized":"2023-12-01T01:02:48.783787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:11:34.646161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783766+0000","last_change":"2023-12-01T01:02:47.289596+0000","last_active":"2023-12-01T01:02:48.783766+0000","last_peered":"2023-12-01T01:02:48.783766+0000","last_clean":"2023-12-01T01:02:48.783766+0000","last_became_active":"2023-12-01T01:02:47.289273+0000","last_became_peered":"2023-12-01T01:02:47.289273+0000","last_unstale":"2023-12-01T01:02:48.783766+0000","last_undegraded":"2023-12-01T01:02:48.783766+0000","last_fullsized":"2023-12-01T01:02:48.783766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:10:33.606237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.785322+0000","last_change":"2023-12-01T01:02:47.281198+0000","last_active":"2023-12-01T01:02:48.785322+0000","last_peered":"2023-12-01T01:02:48.785322+0000","last_clean":"2023-12-01T01:02:48.785322+0000","last_became_active":"2023-12-01T01:02:47.280903+0000","last_became_peered":"2023-12-01T01:02:47.280903+0000","last_unstale":"2023-12-01T01:02:48.785322+0000","last_undegraded":"2023-12-01T01:02:48.785322+0000","last_fullsized":"2023-12-01T01:02:48.785322+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:14:56.199140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784382+0000","last_change":"2023-12-01T01:02:47.281015+0000","last_active":"2023-12-01T01:02:48.784382+0000","last_peered":"2023-12-01T01:02:48.784382+0000","last_clean":"2023-12-01T01:02:48.784382+0000","last_became_active":"2023-12-01T01:02:47.280670+0000","last_became_peered":"2023-12-01T01:02:47.280670+0000","last_unstale":"2023-12-01T01:02:48.784382+0000","last_undegraded":"2023-12-01T01:02:48.784382+0000","last_fullsized":"2023-12-01T01:02:48.784382+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:13:12.686506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784348+0000","last_change":"2023-12-01T01:02:47.283444+0000","last_active":"2023-12-01T01:02:48.784348+0000","last_peered":"2023-12-01T01:02:48.784348+0000","last_clean":"2023-12-01T01:02:48.784348+0000","last_became_active":"2023-12-01T01:02:47.283131+0000","last_became_peered":"2023-12-01T01:02:47.283131+0000","last_unstale":"2023-12-01T01:02:48.784348+0000","last_undegraded":"2023-12-01T01:02:48.784348+0000","last_fullsized":"2023-12-01T01:02:48.784348+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:36:50.069639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":21,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:51.333823+0000","last_change":"2023-12-01T01:02:46.825507+0000","last_active":"2023-12-01T01:02:51.333823+0000","last_peered":"2023-12-01T01:02:51.333823+0000","last_clean":"2023-12-01T01:02:51.333823+0000","last_became_active":"2023-12-01T01:02:46.825170+0000","last_became_peered":"2023-12-01T01:02:46.825170+0000","last_unstale":"2023-12-01T01:02:51.333823+0000","last_undegraded":"2023-12-01T01:02:51.333823+0000","last_fullsized":"2023-12-01T01:02:51.333823+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:10:10.518664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784253+0000","last_change":"2023-12-01T01:02:47.283262+0000","last_active":"2023-12-01T01:02:48.784253+0000","last_peered":"2023-12-01T01:02:48.784253+0000","last_clean":"2023-12-01T01:02:48.784253+0000","last_became_active":"2023-12-01T01:02:47.282926+0000","last_became_peered":"2023-12-01T01:02:47.282926+0000","last_unstale":"2023-12-01T01:02:48.784253+0000","last_undegraded":"2023-12-01T01:02:48.784253+0000","last_fullsized":"2023-12-01T01:02:48.784253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:17:04.252123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"80'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784401+0000","last_change":"2023-12-01T01:02:46.835504+0000","last_active":"2023-12-01T01:02:48.784401+0000","last_peered":"2023-12-01T01:02:48.784401+0000","last_clean":"2023-12-01T01:02:48.784401+0000","last_became_active":"2023-12-01T01:02:46.835206+0000","last_became_peered":"2023-12-01T01:02:46.835206+0000","last_unstale":"2023-12-01T01:02:48.784401+0000","last_undegraded":"2023-12-01T01:02:48.784401+0000","last_fullsized":"2023-12-01T01:02:48.784401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:42:18.756880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784792+0000","last_change":"2023-12-01T01:02:47.286713+0000","last_active":"2023-12-01T01:02:48.784792+0000","last_peered":"2023-12-01T01:02:48.784792+0000","last_clean":"2023-12-01T01:02:48.784792+0000","last_became_active":"2023-12-01T01:02:47.285868+0000","last_became_peered":"2023-12-01T01:02:47.285868+0000","last_unstale":"2023-12-01T01:02:48.784792+0000","last_undegraded":"2023-12-01T01:02:48.784792+0000","last_fullsized":"2023-12-01T01:02:48.784792+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:16:31.496085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.263051+0000","last_change":"2023-12-01T01:02:46.828871+0000","last_active":"2023-12-01T01:02:48.263051+0000","last_peered":"2023-12-01T01:02:48.263051+0000","last_clean":"2023-12-01T01:02:48.263051+0000","last_became_active":"2023-12-01T01:02:46.828547+0000","last_became_peered":"2023-12-01T01:02:46.828547+0000","last_unstale":"2023-12-01T01:02:48.263051+0000","last_undegraded":"2023-12-01T01:02:48.263051+0000","last_fullsized":"2023-12-01T01:02:48.263051+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:36:19.260707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784467+0000","last_change":"2023-12-01T01:02:47.284868+0000","last_active":"2023-12-01T01:02:48.784467+0000","last_peered":"2023-12-01T01:02:48.784467+0000","last_clean":"2023-12-01T01:02:48.784467+0000","last_became_active":"2023-12-01T01:02:47.284602+0000","last_became_peered":"2023-12-01T01:02:47.284602+0000","last_unstale":"2023-12-01T01:02:48.784467+0000","last_undegraded":"2023-12-01T01:02:48.784467+0000","last_fullsized":"2023-12-01T01:02:48.784467+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:12:36.510333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.263011+0000","last_change":"2023-12-01T01:02:46.832234+0000","last_active":"2023-12-01T01:02:48.263011+0000","last_peered":"2023-12-01T01:02:48.263011+0000","last_clean":"2023-12-01T01:02:48.263011+0000","last_became_active":"2023-12-01T01:02:46.831986+0000","last_became_peered":"2023-12-01T01:02:46.831986+0000","last_unstale":"2023-12-01T01:02:48.263011+0000","last_undegraded":"2023-12-01T01:02:48.263011+0000","last_fullsized":"2023-12-01T01:02:48.263011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:49:35.773243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784003+0000","last_change":"2023-12-01T01:02:47.275033+0000","last_active":"2023-12-01T01:02:48.784003+0000","last_peered":"2023-12-01T01:02:48.784003+0000","last_clean":"2023-12-01T01:02:48.784003+0000","last_became_active":"2023-12-01T01:02:47.274730+0000","last_became_peered":"2023-12-01T01:02:47.274730+0000","last_unstale":"2023-12-01T01:02:48.784003+0000","last_undegraded":"2023-12-01T01:02:48.784003+0000","last_fullsized":"2023-12-01T01:02:48.784003+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:48:44.959720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"80'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783895+0000","last_change":"2023-12-01T01:02:46.827046+0000","last_active":"2023-12-01T01:02:48.783895+0000","last_peered":"2023-12-01T01:02:48.783895+0000","last_clean":"2023-12-01T01:02:48.783895+0000","last_became_active":"2023-12-01T01:02:46.826716+0000","last_became_peered":"2023-12-01T01:02:46.826716+0000","last_unstale":"2023-12-01T01:02:48.783895+0000","last_undegraded":"2023-12-01T01:02:48.783895+0000","last_fullsized":"2023-12-01T01:02:48.783895+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:06:46.195630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262766+0000","last_change":"2023-12-01T01:02:47.270299+0000","last_active":"2023-12-01T01:02:48.262766+0000","last_peered":"2023-12-01T01:02:48.262766+0000","last_clean":"2023-12-01T01:02:48.262766+0000","last_became_active":"2023-12-01T01:02:47.270016+0000","last_became_peered":"2023-12-01T01:02:47.270016+0000","last_unstale":"2023-12-01T01:02:48.262766+0000","last_undegraded":"2023-12-01T01:02:48.262766+0000","last_fullsized":"2023-12-01T01:02:48.262766+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:16:30.207449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:51.332707+0000","last_change":"2023-12-01T01:02:46.829469+0000","last_active":"2023-12-01T01:02:51.332707+0000","last_peered":"2023-12-01T01:02:51.332707+0000","last_clean":"2023-12-01T01:02:51.332707+0000","last_became_active":"2023-12-01T01:02:46.829167+0000","last_became_peered":"2023-12-01T01:02:46.829167+0000","last_unstale":"2023-12-01T01:02:51.332707+0000","last_undegraded":"2023-12-01T01:02:51.332707+0000","last_fullsized":"2023-12-01T01:02:51.332707+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:19:37.621080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784005+0000","last_change":"2023-12-01T01:02:47.274600+0000","last_active":"2023-12-01T01:02:48.784005+0000","last_peered":"2023-12-01T01:02:48.784005+0000","last_clean":"2023-12-01T01:02:48.784005+0000","last_became_active":"2023-12-01T01:02:47.273979+0000","last_became_peered":"2023-12-01T01:02:47.273979+0000","last_unstale":"2023-12-01T01:02:48.784005+0000","last_undegraded":"2023-12-01T01:02:48.784005+0000","last_fullsized":"2023-12-01T01:02:48.784005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:20:55.693393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262518+0000","last_change":"2023-12-01T01:02:46.821479+0000","last_active":"2023-12-01T01:02:48.262518+0000","last_peered":"2023-12-01T01:02:48.262518+0000","last_clean":"2023-12-01T01:02:48.262518+0000","last_became_active":"2023-12-01T01:02:46.821090+0000","last_became_peered":"2023-12-01T01:02:46.821090+0000","last_unstale":"2023-12-01T01:02:48.262518+0000","last_undegraded":"2023-12-01T01:02:48.262518+0000","last_fullsized":"2023-12-01T01:02:48.262518+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:17:48.216217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783816+0000","last_change":"2023-12-01T01:02:47.274298+0000","last_active":"2023-12-01T01:02:48.783816+0000","last_peered":"2023-12-01T01:02:48.783816+0000","last_clean":"2023-12-01T01:02:48.783816+0000","last_became_active":"2023-12-01T01:02:47.274006+0000","last_became_peered":"2023-12-01T01:02:47.274006+0000","last_unstale":"2023-12-01T01:02:48.783816+0000","last_undegraded":"2023-12-01T01:02:48.783816+0000","last_fullsized":"2023-12-01T01:02:48.783816+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:38.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783480+0000","last_change":"2023-12-01T01:02:46.826341+0000","last_active":"2023-12-01T01:02:48.783480+0000","last_peered":"2023-12-01T01:02:48.783480+0000","last_clean":"2023-12-01T01:02:48.783480+0000","last_became_active":"2023-12-01T01:02:46.825979+0000","last_became_peered":"2023-12-01T01:02:46.825979+0000","last_unstale":"2023-12-01T01:02:48.783480+0000","last_undegraded":"2023-12-01T01:02:48.783480+0000","last_fullsized":"2023-12-01T01:02:48.783480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:29:48.681232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784306+0000","last_change":"2023-12-01T01:02:47.280989+0000","last_active":"2023-12-01T01:02:48.784306+0000","last_peered":"2023-12-01T01:02:48.784306+0000","last_clean":"2023-12-01T01:02:48.784306+0000","last_became_active":"2023-12-01T01:02:47.280649+0000","last_became_peered":"2023-12-01T01:02:47.280649+0000","last_unstale":"2023-12-01T01:02:48.784306+0000","last_undegraded":"2023-12-01T01:02:48.784306+0000","last_fullsized":"2023-12-01T01:02:48.784306+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:16:30.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'3","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:50.327831+0000","last_change":"2023-12-01T01:02:46.832304+0000","last_active":"2023-12-01T01:02:50.327831+0000","last_peered":"2023-12-01T01:02:50.327831+0000","last_clean":"2023-12-01T01:02:50.327831+0000","last_became_active":"2023-12-01T01:02:46.832014+0000","last_became_peered":"2023-12-01T01:02:46.832014+0000","last_unstale":"2023-12-01T01:02:50.327831+0000","last_undegraded":"2023-12-01T01:02:50.327831+0000","last_fullsized":"2023-12-01T01:02:50.327831+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:41:46.003527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784334+0000","last_change":"2023-12-01T01:02:47.277819+0000","last_active":"2023-12-01T01:02:48.784334+0000","last_peered":"2023-12-01T01:02:48.784334+0000","last_clean":"2023-12-01T01:02:48.784334+0000","last_became_active":"2023-12-01T01:02:47.277534+0000","last_became_peered":"2023-12-01T01:02:47.277534+0000","last_unstale":"2023-12-01T01:02:48.784334+0000","last_undegraded":"2023-12-01T01:02:48.784334+0000","last_fullsized":"2023-12-01T01:02:48.784334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:56:15.627538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784205+0000","last_change":"2023-12-01T01:02:46.826783+0000","last_active":"2023-12-01T01:02:48.784205+0000","last_peered":"2023-12-01T01:02:48.784205+0000","last_clean":"2023-12-01T01:02:48.784205+0000","last_became_active":"2023-12-01T01:02:46.826479+0000","last_became_peered":"2023-12-01T01:02:46.826479+0000","last_unstale":"2023-12-01T01:02:48.784205+0000","last_undegraded":"2023-12-01T01:02:48.784205+0000","last_fullsized":"2023-12-01T01:02:48.784205+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:30:09.681494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784725+0000","last_change":"2023-12-01T01:02:47.289301+0000","last_active":"2023-12-01T01:02:48.784725+0000","last_peered":"2023-12-01T01:02:48.784725+0000","last_clean":"2023-12-01T01:02:48.784725+0000","last_became_active":"2023-12-01T01:02:47.288976+0000","last_became_peered":"2023-12-01T01:02:47.288976+0000","last_unstale":"2023-12-01T01:02:48.784725+0000","last_undegraded":"2023-12-01T01:02:48.784725+0000","last_fullsized":"2023-12-01T01:02:48.784725+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:21:02.981778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'3","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784096+0000","last_change":"2023-12-01T01:02:46.829332+0000","last_active":"2023-12-01T01:02:48.784096+0000","last_peered":"2023-12-01T01:02:48.784096+0000","last_clean":"2023-12-01T01:02:48.784096+0000","last_became_active":"2023-12-01T01:02:46.828828+0000","last_became_peered":"2023-12-01T01:02:46.828828+0000","last_unstale":"2023-12-01T01:02:48.784096+0000","last_undegraded":"2023-12-01T01:02:48.784096+0000","last_fullsized":"2023-12-01T01:02:48.784096+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:15:15.648138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784556+0000","last_change":"2023-12-01T01:02:47.277938+0000","last_active":"2023-12-01T01:02:48.784556+0000","last_peered":"2023-12-01T01:02:48.784556+0000","last_clean":"2023-12-01T01:02:48.784556+0000","last_became_active":"2023-12-01T01:02:47.277650+0000","last_became_peered":"2023-12-01T01:02:47.277650+0000","last_unstale":"2023-12-01T01:02:48.784556+0000","last_undegraded":"2023-12-01T01:02:48.784556+0000","last_fullsized":"2023-12-01T01:02:48.784556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:03:46.667892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"81'8","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:50.328221+0000","last_change":"2023-12-01T01:02:46.828753+0000","last_active":"2023-12-01T01:02:50.328221+0000","last_peered":"2023-12-01T01:02:50.328221+0000","last_clean":"2023-12-01T01:02:50.328221+0000","last_became_active":"2023-12-01T01:02:46.828453+0000","last_became_peered":"2023-12-01T01:02:46.828453+0000","last_unstale":"2023-12-01T01:02:50.328221+0000","last_undegraded":"2023-12-01T01:02:50.328221+0000","last_fullsized":"2023-12-01T01:02:50.328221+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:23:31.475164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.263064+0000","last_change":"2023-12-01T01:02:47.272049+0000","last_active":"2023-12-01T01:02:48.263064+0000","last_peered":"2023-12-01T01:02:48.263064+0000","last_clean":"2023-12-01T01:02:48.263064+0000","last_became_active":"2023-12-01T01:02:47.271726+0000","last_became_peered":"2023-12-01T01:02:47.271726+0000","last_unstale":"2023-12-01T01:02:48.263064+0000","last_undegraded":"2023-12-01T01:02:48.263064+0000","last_fullsized":"2023-12-01T01:02:48.263064+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:08:45.038989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783782+0000","last_change":"2023-12-01T01:02:46.831362+0000","last_active":"2023-12-01T01:02:48.783782+0000","last_peered":"2023-12-01T01:02:48.783782+0000","last_clean":"2023-12-01T01:02:48.783782+0000","last_became_active":"2023-12-01T01:02:46.830929+0000","last_became_peered":"2023-12-01T01:02:46.830929+0000","last_unstale":"2023-12-01T01:02:48.783782+0000","last_undegraded":"2023-12-01T01:02:48.783782+0000","last_fullsized":"2023-12-01T01:02:48.783782+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:39:54.855526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262781+0000","last_change":"2023-12-01T01:02:47.275343+0000","last_active":"2023-12-01T01:02:48.262781+0000","last_peered":"2023-12-01T01:02:48.262781+0000","last_clean":"2023-12-01T01:02:48.262781+0000","last_became_active":"2023-12-01T01:02:47.275042+0000","last_became_peered":"2023-12-01T01:02:47.275042+0000","last_unstale":"2023-12-01T01:02:48.262781+0000","last_undegraded":"2023-12-01T01:02:48.262781+0000","last_fullsized":"2023-12-01T01:02:48.262781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:18:27.862601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784445+0000","last_change":"2023-12-01T01:02:46.831996+0000","last_active":"2023-12-01T01:02:48.784445+0000","last_peered":"2023-12-01T01:02:48.784445+0000","last_clean":"2023-12-01T01:02:48.784445+0000","last_became_active":"2023-12-01T01:02:46.831710+0000","last_became_peered":"2023-12-01T01:02:46.831710+0000","last_unstale":"2023-12-01T01:02:48.784445+0000","last_undegraded":"2023-12-01T01:02:48.784445+0000","last_fullsized":"2023-12-01T01:02:48.784445+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:50:42.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784201+0000","last_change":"2023-12-01T01:02:47.283771+0000","last_active":"2023-12-01T01:02:48.784201+0000","last_peered":"2023-12-01T01:02:48.784201+0000","last_clean":"2023-12-01T01:02:48.784201+0000","last_became_active":"2023-12-01T01:02:47.283363+0000","last_became_peered":"2023-12-01T01:02:47.283363+0000","last_unstale":"2023-12-01T01:02:48.784201+0000","last_undegraded":"2023-12-01T01:02:48.784201+0000","last_fullsized":"2023-12-01T01:02:48.784201+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:44:40.918161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784232+0000","last_change":"2023-12-01T01:02:46.825170+0000","last_active":"2023-12-01T01:02:48.784232+0000","last_peered":"2023-12-01T01:02:48.784232+0000","last_clean":"2023-12-01T01:02:48.784232+0000","last_became_active":"2023-12-01T01:02:46.824857+0000","last_became_peered":"2023-12-01T01:02:46.824857+0000","last_unstale":"2023-12-01T01:02:48.784232+0000","last_undegraded":"2023-12-01T01:02:48.784232+0000","last_fullsized":"2023-12-01T01:02:48.784232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:05:54.095408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783658+0000","last_change":"2023-12-01T01:02:47.279495+0000","last_active":"2023-12-01T01:02:48.783658+0000","last_peered":"2023-12-01T01:02:48.783658+0000","last_clean":"2023-12-01T01:02:48.783658+0000","last_became_active":"2023-12-01T01:02:47.279171+0000","last_became_peered":"2023-12-01T01:02:47.279171+0000","last_unstale":"2023-12-01T01:02:48.783658+0000","last_undegraded":"2023-12-01T01:02:48.783658+0000","last_fullsized":"2023-12-01T01:02:48.783658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:29:33.298818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'8","reported_seq":20,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262720+0000","last_change":"2023-12-01T01:02:46.833837+0000","last_active":"2023-12-01T01:02:48.262720+0000","last_peered":"2023-12-01T01:02:48.262720+0000","last_clean":"2023-12-01T01:02:48.262720+0000","last_became_active":"2023-12-01T01:02:46.833549+0000","last_became_peered":"2023-12-01T01:02:46.833549+0000","last_unstale":"2023-12-01T01:02:48.262720+0000","last_undegraded":"2023-12-01T01:02:48.262720+0000","last_fullsized":"2023-12-01T01:02:48.262720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:35:02.581360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783939+0000","last_change":"2023-12-01T01:02:47.273884+0000","last_active":"2023-12-01T01:02:48.783939+0000","last_peered":"2023-12-01T01:02:48.783939+0000","last_clean":"2023-12-01T01:02:48.783939+0000","last_became_active":"2023-12-01T01:02:47.273575+0000","last_became_peered":"2023-12-01T01:02:47.273575+0000","last_unstale":"2023-12-01T01:02:48.783939+0000","last_undegraded":"2023-12-01T01:02:48.783939+0000","last_fullsized":"2023-12-01T01:02:48.783939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:49:54.924619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262978+0000","last_change":"2023-12-01T01:02:46.832265+0000","last_active":"2023-12-01T01:02:48.262978+0000","last_peered":"2023-12-01T01:02:48.262978+0000","last_clean":"2023-12-01T01:02:48.262978+0000","last_became_active":"2023-12-01T01:02:46.831944+0000","last_became_peered":"2023-12-01T01:02:46.831944+0000","last_unstale":"2023-12-01T01:02:48.262978+0000","last_undegraded":"2023-12-01T01:02:48.262978+0000","last_fullsized":"2023-12-01T01:02:48.262978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:54:54.814744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784271+0000","last_change":"2023-12-01T01:02:47.276967+0000","last_active":"2023-12-01T01:02:48.784271+0000","last_peered":"2023-12-01T01:02:48.784271+0000","last_clean":"2023-12-01T01:02:48.784271+0000","last_became_active":"2023-12-01T01:02:47.276660+0000","last_became_peered":"2023-12-01T01:02:47.276660+0000","last_unstale":"2023-12-01T01:02:48.784271+0000","last_undegraded":"2023-12-01T01:02:48.784271+0000","last_fullsized":"2023-12-01T01:02:48.784271+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:19:16.029376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-12-01T01:02:47.263640+0000","last_change":"2023-12-01T01:02:46.834425+0000","last_active":"2023-12-01T01:02:47.263640+0000","last_peered":"2023-12-01T01:02:47.263640+0000","last_clean":"2023-12-01T01:02:47.263640+0000","last_became_active":"2023-12-01T01:02:46.834150+0000","last_became_peered":"2023-12-01T01:02:46.834150+0000","last_unstale":"2023-12-01T01:02:47.263640+0000","last_undegraded":"2023-12-01T01:02:47.263640+0000","last_fullsized":"2023-12-01T01:02:47.263640+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:52:39.619014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-12-01T01:02:47.280145+0000","last_change":"2023-12-01T01:02:47.276386+0000","last_active":"2023-12-01T01:02:47.280145+0000","last_peered":"2023-12-01T01:02:47.280145+0000","last_clean":"2023-12-01T01:02:47.280145+0000","last_became_active":"2023-12-01T01:02:47.276092+0000","last_became_peered":"2023-12-01T01:02:47.276092+0000","last_unstale":"2023-12-01T01:02:47.280145+0000","last_undegraded":"2023-12-01T01:02:47.280145+0000","last_fullsized":"2023-12-01T01:02:47.280145+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:33:39.707619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784480+0000","last_change":"2023-12-01T01:02:46.832778+0000","last_active":"2023-12-01T01:02:48.784480+0000","last_peered":"2023-12-01T01:02:48.784480+0000","last_clean":"2023-12-01T01:02:48.784480+0000","last_became_active":"2023-12-01T01:02:46.832406+0000","last_became_peered":"2023-12-01T01:02:46.832406+0000","last_unstale":"2023-12-01T01:02:48.784480+0000","last_undegraded":"2023-12-01T01:02:48.784480+0000","last_fullsized":"2023-12-01T01:02:48.784480+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:06:08.569651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":80,"state":"active+clean","last_fresh":"2023-12-01T01:02:47.278303+0000","last_change":"2023-12-01T01:02:47.274395+0000","last_active":"2023-12-01T01:02:47.278303+0000","last_peered":"2023-12-01T01:02:47.278303+0000","last_clean":"2023-12-01T01:02:47.278303+0000","last_became_active":"2023-12-01T01:02:47.274065+0000","last_became_peered":"2023-12-01T01:02:47.274065+0000","last_unstale":"2023-12-01T01:02:47.278303+0000","last_undegraded":"2023-12-01T01:02:47.278303+0000","last_fullsized":"2023-12-01T01:02:47.278303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:46:38.919835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783667+0000","last_change":"2023-12-01T01:02:47.269953+0000","last_active":"2023-12-01T01:02:48.783667+0000","last_peered":"2023-12-01T01:02:48.783667+0000","last_clean":"2023-12-01T01:02:48.783667+0000","last_became_active":"2023-12-01T01:02:47.265723+0000","last_became_peered":"2023-12-01T01:02:47.265723+0000","last_unstale":"2023-12-01T01:02:48.783667+0000","last_undegraded":"2023-12-01T01:02:48.783667+0000","last_fullsized":"2023-12-01T01:02:48.783667+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:28:44.370883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:50.326412+0000","last_change":"2023-12-01T01:02:46.827001+0000","last_active":"2023-12-01T01:02:50.326412+0000","last_peered":"2023-12-01T01:02:50.326412+0000","last_clean":"2023-12-01T01:02:50.326412+0000","last_became_active":"2023-12-01T01:02:46.826690+0000","last_became_peered":"2023-12-01T01:02:46.826690+0000","last_unstale":"2023-12-01T01:02:50.326412+0000","last_undegraded":"2023-12-01T01:02:50.326412+0000","last_fullsized":"2023-12-01T01:02:50.326412+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:37:38.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784292+0000","last_change":"2023-12-01T01:02:47.283372+0000","last_active":"2023-12-01T01:02:48.784292+0000","last_peered":"2023-12-01T01:02:48.784292+0000","last_clean":"2023-12-01T01:02:48.784292+0000","last_became_active":"2023-12-01T01:02:47.283075+0000","last_became_peered":"2023-12-01T01:02:47.283075+0000","last_unstale":"2023-12-01T01:02:48.784292+0000","last_undegraded":"2023-12-01T01:02:48.784292+0000","last_fullsized":"2023-12-01T01:02:48.784292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:37:07.707284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.785292+0000","last_change":"2023-12-01T01:02:46.828490+0000","last_active":"2023-12-01T01:02:48.785292+0000","last_peered":"2023-12-01T01:02:48.785292+0000","last_clean":"2023-12-01T01:02:48.785292+0000","last_became_active":"2023-12-01T01:02:46.828129+0000","last_became_peered":"2023-12-01T01:02:46.828129+0000","last_unstale":"2023-12-01T01:02:48.785292+0000","last_undegraded":"2023-12-01T01:02:48.785292+0000","last_fullsized":"2023-12-01T01:02:48.785292+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:52:17.060443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":320,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783760+0000","last_change":"2023-12-01T01:01:49.966660+0000","last_active":"2023-12-01T01:02:48.783760+0000","last_peered":"2023-12-01T01:02:48.783760+0000","last_clean":"2023-12-01T01:02:48.783760+0000","last_became_active":"2023-12-01T01:01:49.966125+0000","last_became_peered":"2023-12-01T01:01:49.966125+0000","last_unstale":"2023-12-01T01:02:48.783760+0000","last_undegraded":"2023-12-01T01:02:48.783760+0000","last_fullsized":"2023-12-01T01:02:48.783760+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T00:59:06.461487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T00:59:06.461487+0000","last_clean_scrub_stamp":"2023-12-01T00:59:06.461487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:34:52.236994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262423+0000","last_change":"2023-12-01T01:02:47.282702+0000","last_active":"2023-12-01T01:02:48.262423+0000","last_peered":"2023-12-01T01:02:48.262423+0000","last_clean":"2023-12-01T01:02:48.262423+0000","last_became_active":"2023-12-01T01:02:47.282368+0000","last_became_peered":"2023-12-01T01:02:47.282368+0000","last_unstale":"2023-12-01T01:02:48.262423+0000","last_undegraded":"2023-12-01T01:02:48.262423+0000","last_fullsized":"2023-12-01T01:02:48.262423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:24:40.985055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783935+0000","last_change":"2023-12-01T01:02:46.827882+0000","last_active":"2023-12-01T01:02:48.783935+0000","last_peered":"2023-12-01T01:02:48.783935+0000","last_clean":"2023-12-01T01:02:48.783935+0000","last_became_active":"2023-12-01T01:02:46.827354+0000","last_became_peered":"2023-12-01T01:02:46.827354+0000","last_unstale":"2023-12-01T01:02:48.783935+0000","last_undegraded":"2023-12-01T01:02:48.783935+0000","last_fullsized":"2023-12-01T01:02:48.783935+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:48:42.894733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262959+0000","last_change":"2023-12-01T01:02:46.833439+0000","last_active":"2023-12-01T01:02:48.262959+0000","last_peered":"2023-12-01T01:02:48.262959+0000","last_clean":"2023-12-01T01:02:48.262959+0000","last_became_active":"2023-12-01T01:02:46.833199+0000","last_became_peered":"2023-12-01T01:02:46.833199+0000","last_unstale":"2023-12-01T01:02:48.262959+0000","last_undegraded":"2023-12-01T01:02:48.262959+0000","last_fullsized":"2023-12-01T01:02:48.262959+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:44:49.559138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262637+0000","last_change":"2023-12-01T01:02:47.283580+0000","last_active":"2023-12-01T01:02:48.262637+0000","last_peered":"2023-12-01T01:02:48.262637+0000","last_clean":"2023-12-01T01:02:48.262637+0000","last_became_active":"2023-12-01T01:02:47.283095+0000","last_became_peered":"2023-12-01T01:02:47.283095+0000","last_unstale":"2023-12-01T01:02:48.262637+0000","last_undegraded":"2023-12-01T01:02:48.262637+0000","last_fullsized":"2023-12-01T01:02:48.262637+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:33:12.541487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"81'3","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:51.332745+0000","last_change":"2023-12-01T01:02:46.831348+0000","last_active":"2023-12-01T01:02:51.332745+0000","last_peered":"2023-12-01T01:02:51.332745+0000","last_clean":"2023-12-01T01:02:51.332745+0000","last_became_active":"2023-12-01T01:02:46.831031+0000","last_became_peered":"2023-12-01T01:02:46.831031+0000","last_unstale":"2023-12-01T01:02:51.332745+0000","last_undegraded":"2023-12-01T01:02:51.332745+0000","last_fullsized":"2023-12-01T01:02:51.332745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:15:53.172465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784142+0000","last_change":"2023-12-01T01:02:47.276281+0000","last_active":"2023-12-01T01:02:48.784142+0000","last_peered":"2023-12-01T01:02:48.784142+0000","last_clean":"2023-12-01T01:02:48.784142+0000","last_became_active":"2023-12-01T01:02:47.275573+0000","last_became_peered":"2023-12-01T01:02:47.275573+0000","last_unstale":"2023-12-01T01:02:48.784142+0000","last_undegraded":"2023-12-01T01:02:48.784142+0000","last_fullsized":"2023-12-01T01:02:48.784142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:50:07.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784575+0000","last_change":"2023-12-01T01:02:46.823053+0000","last_active":"2023-12-01T01:02:48.784575+0000","last_peered":"2023-12-01T01:02:48.784575+0000","last_clean":"2023-12-01T01:02:48.784575+0000","last_became_active":"2023-12-01T01:02:46.822772+0000","last_became_peered":"2023-12-01T01:02:46.822772+0000","last_unstale":"2023-12-01T01:02:48.784575+0000","last_undegraded":"2023-12-01T01:02:48.784575+0000","last_fullsized":"2023-12-01T01:02:48.784575+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:43:22.496286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784830+0000","last_change":"2023-12-01T01:02:47.289484+0000","last_active":"2023-12-01T01:02:48.784830+0000","last_peered":"2023-12-01T01:02:48.784830+0000","last_clean":"2023-12-01T01:02:48.784830+0000","last_became_active":"2023-12-01T01:02:47.289176+0000","last_became_peered":"2023-12-01T01:02:47.289176+0000","last_unstale":"2023-12-01T01:02:48.784830+0000","last_undegraded":"2023-12-01T01:02:48.784830+0000","last_fullsized":"2023-12-01T01:02:48.784830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:21:52.905017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783856+0000","last_change":"2023-12-01T01:02:46.830635+0000","last_active":"2023-12-01T01:02:48.783856+0000","last_peered":"2023-12-01T01:02:48.783856+0000","last_clean":"2023-12-01T01:02:48.783856+0000","last_became_active":"2023-12-01T01:02:46.830337+0000","last_became_peered":"2023-12-01T01:02:46.830337+0000","last_unstale":"2023-12-01T01:02:48.783856+0000","last_undegraded":"2023-12-01T01:02:48.783856+0000","last_fullsized":"2023-12-01T01:02:48.783856+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:02:10.017744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262696+0000","last_change":"2023-12-01T01:02:47.281923+0000","last_active":"2023-12-01T01:02:48.262696+0000","last_peered":"2023-12-01T01:02:48.262696+0000","last_clean":"2023-12-01T01:02:48.262696+0000","last_became_active":"2023-12-01T01:02:47.281598+0000","last_became_peered":"2023-12-01T01:02:47.281598+0000","last_unstale":"2023-12-01T01:02:48.262696+0000","last_undegraded":"2023-12-01T01:02:48.262696+0000","last_fullsized":"2023-12-01T01:02:48.262696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:07:54.327023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784985+0000","last_change":"2023-12-01T01:02:46.830248+0000","last_active":"2023-12-01T01:02:48.784985+0000","last_peered":"2023-12-01T01:02:48.784985+0000","last_clean":"2023-12-01T01:02:48.784985+0000","last_became_active":"2023-12-01T01:02:46.829951+0000","last_became_peered":"2023-12-01T01:02:46.829951+0000","last_unstale":"2023-12-01T01:02:48.784985+0000","last_undegraded":"2023-12-01T01:02:48.784985+0000","last_fullsized":"2023-12-01T01:02:48.784985+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:04:23.978035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784607+0000","last_change":"2023-12-01T01:02:47.280871+0000","last_active":"2023-12-01T01:02:48.784607+0000","last_peered":"2023-12-01T01:02:48.784607+0000","last_clean":"2023-12-01T01:02:48.784607+0000","last_became_active":"2023-12-01T01:02:47.280527+0000","last_became_peered":"2023-12-01T01:02:47.280527+0000","last_unstale":"2023-12-01T01:02:48.784607+0000","last_undegraded":"2023-12-01T01:02:48.784607+0000","last_fullsized":"2023-12-01T01:02:48.784607+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:16:47.700500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783562+0000","last_change":"2023-12-01T01:02:46.829436+0000","last_active":"2023-12-01T01:02:48.783562+0000","last_peered":"2023-12-01T01:02:48.783562+0000","last_clean":"2023-12-01T01:02:48.783562+0000","last_became_active":"2023-12-01T01:02:46.829049+0000","last_became_peered":"2023-12-01T01:02:46.829049+0000","last_unstale":"2023-12-01T01:02:48.783562+0000","last_undegraded":"2023-12-01T01:02:48.783562+0000","last_fullsized":"2023-12-01T01:02:48.783562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:01:40.384545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.785075+0000","last_change":"2023-12-01T01:02:47.284981+0000","last_active":"2023-12-01T01:02:48.785075+0000","last_peered":"2023-12-01T01:02:48.785075+0000","last_clean":"2023-12-01T01:02:48.785075+0000","last_became_active":"2023-12-01T01:02:47.284576+0000","last_became_peered":"2023-12-01T01:02:47.284576+0000","last_unstale":"2023-12-01T01:02:48.785075+0000","last_undegraded":"2023-12-01T01:02:48.785075+0000","last_fullsized":"2023-12-01T01:02:48.785075+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:58:21.152156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262954+0000","last_change":"2023-12-01T01:02:46.828769+0000","last_active":"2023-12-01T01:02:48.262954+0000","last_peered":"2023-12-01T01:02:48.262954+0000","last_clean":"2023-12-01T01:02:48.262954+0000","last_became_active":"2023-12-01T01:02:46.828498+0000","last_became_peered":"2023-12-01T01:02:46.828498+0000","last_unstale":"2023-12-01T01:02:48.262954+0000","last_undegraded":"2023-12-01T01:02:48.262954+0000","last_fullsized":"2023-12-01T01:02:48.262954+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:12:26.618082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784537+0000","last_change":"2023-12-01T01:02:47.283179+0000","last_active":"2023-12-01T01:02:48.784537+0000","last_peered":"2023-12-01T01:02:48.784537+0000","last_clean":"2023-12-01T01:02:48.784537+0000","last_became_active":"2023-12-01T01:02:47.282883+0000","last_became_peered":"2023-12-01T01:02:47.282883+0000","last_unstale":"2023-12-01T01:02:48.784537+0000","last_undegraded":"2023-12-01T01:02:48.784537+0000","last_fullsized":"2023-12-01T01:02:48.784537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:19:47.406888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783664+0000","last_change":"2023-12-01T01:02:46.833482+0000","last_active":"2023-12-01T01:02:48.783664+0000","last_peered":"2023-12-01T01:02:48.783664+0000","last_clean":"2023-12-01T01:02:48.783664+0000","last_became_active":"2023-12-01T01:02:46.833200+0000","last_became_peered":"2023-12-01T01:02:46.833200+0000","last_unstale":"2023-12-01T01:02:48.783664+0000","last_undegraded":"2023-12-01T01:02:48.783664+0000","last_fullsized":"2023-12-01T01:02:48.783664+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:52:41.480509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.785229+0000","last_change":"2023-12-01T01:02:47.275802+0000","last_active":"2023-12-01T01:02:48.785229+0000","last_peered":"2023-12-01T01:02:48.785229+0000","last_clean":"2023-12-01T01:02:48.785229+0000","last_became_active":"2023-12-01T01:02:47.274837+0000","last_became_peered":"2023-12-01T01:02:47.274837+0000","last_unstale":"2023-12-01T01:02:48.785229+0000","last_undegraded":"2023-12-01T01:02:48.785229+0000","last_fullsized":"2023-12-01T01:02:48.785229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:43:30.799999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783893+0000","last_change":"2023-12-01T01:02:46.829445+0000","last_active":"2023-12-01T01:02:48.783893+0000","last_peered":"2023-12-01T01:02:48.783893+0000","last_clean":"2023-12-01T01:02:48.783893+0000","last_became_active":"2023-12-01T01:02:46.829120+0000","last_became_peered":"2023-12-01T01:02:46.829120+0000","last_unstale":"2023-12-01T01:02:48.783893+0000","last_undegraded":"2023-12-01T01:02:48.783893+0000","last_fullsized":"2023-12-01T01:02:48.783893+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:57:44.467570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784100+0000","last_change":"2023-12-01T01:02:47.282683+0000","last_active":"2023-12-01T01:02:48.784100+0000","last_peered":"2023-12-01T01:02:48.784100+0000","last_clean":"2023-12-01T01:02:48.784100+0000","last_became_active":"2023-12-01T01:02:47.282346+0000","last_became_peered":"2023-12-01T01:02:47.282346+0000","last_unstale":"2023-12-01T01:02:48.784100+0000","last_undegraded":"2023-12-01T01:02:48.784100+0000","last_fullsized":"2023-12-01T01:02:48.784100+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:20:25.085982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262811+0000","last_change":"2023-12-01T01:02:46.828060+0000","last_active":"2023-12-01T01:02:48.262811+0000","last_peered":"2023-12-01T01:02:48.262811+0000","last_clean":"2023-12-01T01:02:48.262811+0000","last_became_active":"2023-12-01T01:02:46.827754+0000","last_became_peered":"2023-12-01T01:02:46.827754+0000","last_unstale":"2023-12-01T01:02:48.262811+0000","last_undegraded":"2023-12-01T01:02:48.262811+0000","last_fullsized":"2023-12-01T01:02:48.262811+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:22.794619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784692+0000","last_change":"2023-12-01T01:02:47.269538+0000","last_active":"2023-12-01T01:02:48.784692+0000","last_peered":"2023-12-01T01:02:48.784692+0000","last_clean":"2023-12-01T01:02:48.784692+0000","last_became_active":"2023-12-01T01:02:47.269245+0000","last_became_peered":"2023-12-01T01:02:47.269245+0000","last_unstale":"2023-12-01T01:02:48.784692+0000","last_undegraded":"2023-12-01T01:02:48.784692+0000","last_fullsized":"2023-12-01T01:02:48.784692+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:49.163896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784696+0000","last_change":"2023-12-01T01:02:47.277545+0000","last_active":"2023-12-01T01:02:48.784696+0000","last_peered":"2023-12-01T01:02:48.784696+0000","last_clean":"2023-12-01T01:02:48.784696+0000","last_became_active":"2023-12-01T01:02:47.277307+0000","last_became_peered":"2023-12-01T01:02:47.277307+0000","last_unstale":"2023-12-01T01:02:48.784696+0000","last_undegraded":"2023-12-01T01:02:48.784696+0000","last_fullsized":"2023-12-01T01:02:48.784696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:08.655231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783468+0000","last_change":"2023-12-01T01:02:47.267831+0000","last_active":"2023-12-01T01:02:48.783468+0000","last_peered":"2023-12-01T01:02:48.783468+0000","last_clean":"2023-12-01T01:02:48.783468+0000","last_became_active":"2023-12-01T01:02:47.267538+0000","last_became_peered":"2023-12-01T01:02:47.267538+0000","last_unstale":"2023-12-01T01:02:48.783468+0000","last_undegraded":"2023-12-01T01:02:48.783468+0000","last_fullsized":"2023-12-01T01:02:48.783468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:54:00.840031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783472+0000","last_change":"2023-12-01T01:02:47.274775+0000","last_active":"2023-12-01T01:02:48.783472+0000","last_peered":"2023-12-01T01:02:48.783472+0000","last_clean":"2023-12-01T01:02:48.783472+0000","last_became_active":"2023-12-01T01:02:47.274459+0000","last_became_peered":"2023-12-01T01:02:47.274459+0000","last_unstale":"2023-12-01T01:02:48.783472+0000","last_undegraded":"2023-12-01T01:02:48.783472+0000","last_fullsized":"2023-12-01T01:02:48.783472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:06:01.273551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784651+0000","last_change":"2023-12-01T01:02:47.277487+0000","last_active":"2023-12-01T01:02:48.784651+0000","last_peered":"2023-12-01T01:02:48.784651+0000","last_clean":"2023-12-01T01:02:48.784651+0000","last_became_active":"2023-12-01T01:02:47.277092+0000","last_became_peered":"2023-12-01T01:02:47.277092+0000","last_unstale":"2023-12-01T01:02:48.784651+0000","last_undegraded":"2023-12-01T01:02:48.784651+0000","last_fullsized":"2023-12-01T01:02:48.784651+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:02:51.967302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262574+0000","last_change":"2023-12-01T01:02:47.283814+0000","last_active":"2023-12-01T01:02:48.262574+0000","last_peered":"2023-12-01T01:02:48.262574+0000","last_clean":"2023-12-01T01:02:48.262574+0000","last_became_active":"2023-12-01T01:02:47.283289+0000","last_became_peered":"2023-12-01T01:02:47.283289+0000","last_unstale":"2023-12-01T01:02:48.262574+0000","last_undegraded":"2023-12-01T01:02:48.262574+0000","last_fullsized":"2023-12-01T01:02:48.262574+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:42:59.523846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784080+0000","last_change":"2023-12-01T01:02:47.281748+0000","last_active":"2023-12-01T01:02:48.784080+0000","last_peered":"2023-12-01T01:02:48.784080+0000","last_clean":"2023-12-01T01:02:48.784080+0000","last_became_active":"2023-12-01T01:02:47.281445+0000","last_became_peered":"2023-12-01T01:02:47.281445+0000","last_unstale":"2023-12-01T01:02:48.784080+0000","last_undegraded":"2023-12-01T01:02:48.784080+0000","last_fullsized":"2023-12-01T01:02:48.784080+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:33:18.146911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784493+0000","last_change":"2023-12-01T01:02:47.276827+0000","last_active":"2023-12-01T01:02:48.784493+0000","last_peered":"2023-12-01T01:02:48.784493+0000","last_clean":"2023-12-01T01:02:48.784493+0000","last_became_active":"2023-12-01T01:02:47.276346+0000","last_became_peered":"2023-12-01T01:02:47.276346+0000","last_unstale":"2023-12-01T01:02:48.784493+0000","last_undegraded":"2023-12-01T01:02:48.784493+0000","last_fullsized":"2023-12-01T01:02:48.784493+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:49:23.203883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784049+0000","last_change":"2023-12-01T01:02:47.276461+0000","last_active":"2023-12-01T01:02:48.784049+0000","last_peered":"2023-12-01T01:02:48.784049+0000","last_clean":"2023-12-01T01:02:48.784049+0000","last_became_active":"2023-12-01T01:02:47.275992+0000","last_became_peered":"2023-12-01T01:02:47.275992+0000","last_unstale":"2023-12-01T01:02:48.784049+0000","last_undegraded":"2023-12-01T01:02:48.784049+0000","last_fullsized":"2023-12-01T01:02:48.784049+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:14:04.629355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783579+0000","last_change":"2023-12-01T01:02:47.274018+0000","last_active":"2023-12-01T01:02:48.783579+0000","last_peered":"2023-12-01T01:02:48.783579+0000","last_clean":"2023-12-01T01:02:48.783579+0000","last_became_active":"2023-12-01T01:02:47.273714+0000","last_became_peered":"2023-12-01T01:02:47.273714+0000","last_unstale":"2023-12-01T01:02:48.783579+0000","last_undegraded":"2023-12-01T01:02:48.783579+0000","last_fullsized":"2023-12-01T01:02:48.783579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:26:14.154249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784895+0000","last_change":"2023-12-01T01:02:47.276438+0000","last_active":"2023-12-01T01:02:48.784895+0000","last_peered":"2023-12-01T01:02:48.784895+0000","last_clean":"2023-12-01T01:02:48.784895+0000","last_became_active":"2023-12-01T01:02:47.276121+0000","last_became_peered":"2023-12-01T01:02:47.276121+0000","last_unstale":"2023-12-01T01:02:48.784895+0000","last_undegraded":"2023-12-01T01:02:48.784895+0000","last_fullsized":"2023-12-01T01:02:48.784895+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:09:25.689189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.784065+0000","last_change":"2023-12-01T01:02:47.275763+0000","last_active":"2023-12-01T01:02:48.784065+0000","last_peered":"2023-12-01T01:02:48.784065+0000","last_clean":"2023-12-01T01:02:48.784065+0000","last_became_active":"2023-12-01T01:02:47.275484+0000","last_became_peered":"2023-12-01T01:02:47.275484+0000","last_unstale":"2023-12-01T01:02:48.784065+0000","last_undegraded":"2023-12-01T01:02:48.784065+0000","last_fullsized":"2023-12-01T01:02:48.784065+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:38:02.612857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.262756+0000","last_change":"2023-12-01T01:02:47.274122+0000","last_active":"2023-12-01T01:02:48.262756+0000","last_peered":"2023-12-01T01:02:48.262756+0000","last_clean":"2023-12-01T01:02:48.262756+0000","last_became_active":"2023-12-01T01:02:47.273005+0000","last_became_peered":"2023-12-01T01:02:47.273005+0000","last_unstale":"2023-12-01T01:02:48.262756+0000","last_undegraded":"2023-12-01T01:02:48.262756+0000","last_fullsized":"2023-12-01T01:02:48.262756+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:42:59.273076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-01T01:02:48.783824+0000","last_change":"2023-12-01T01:02:47.270221+0000","last_active":"2023-12-01T01:02:48.783824+0000","last_peered":"2023-12-01T01:02:48.783824+0000","last_clean":"2023-12-01T01:02:48.783824+0000","last_became_active":"2023-12-01T01:02:47.269946+0000","last_became_peered":"2023-12-01T01:02:47.269946+0000","last_unstale":"2023-12-01T01:02:48.783824+0000","last_undegraded":"2023-12-01T01:02:48.783824+0000","last_fullsized":"2023-12-01T01:02:48.783824+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:00:01.640510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283824,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2452,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":64,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":9240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":54,"ondisk_log_size":54,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514508,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":868352,"data_stored":415764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":10,"up_from":69,"seq":296352743440,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":1009226,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.314}]},{"osd":2,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.41699999999999998}]},{"osd":3,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.40500000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.45500000000000002}]},{"osd":6,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.53400000000000003}]},{"osd":9,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.54900000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]},{"osd":9,"up_from":64,"seq":274877906963,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":884736,"data_stored":416548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.317}]},{"osd":1,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.63},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.502}]},{"osd":5,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.2309999999999999,"5min":4.2309999999999999,"15min":4.2309999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59299999999999997}]},{"osd":7,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.64600000000000002}]},{"osd":8,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":4.2729999999999997,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.61899999999999999}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":4.6369999999999996,"5min":4.6369999999999996,"15min":4.6369999999999996},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.69399999999999995}]}]},{"osd":8,"up_from":57,"seq":244813135895,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":876544,"data_stored":416368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.621}]},{"osd":1,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.58999999999999997}]},{"osd":2,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":2.1240000000000001,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.435}]},{"osd":3,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.68799999999999994}]},{"osd":4,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":2.7429999999999999,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.5590000000000002,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.75},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.71399999999999997}]},{"osd":9,"last update":"Fri Dec 1 01:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.73699999999999999}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.76200000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]}]},{"osd":7,"up_from":50,"seq":214748364827,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":921600,"data_stored":1006714,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.39600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.251},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.372},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.42299999999999999,"15min":0.41799999999999998},"min":{"1min":0.27000000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.35599999999999998}]},{"osd":2,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.435,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.51200000000000001}]},{"osd":3,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.46700000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61199999999999999,"15min":0.60599999999999998},"min":{"1min":0.48699999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.48699999999999999,"15min":0.48299999999999998},"min":{"1min":0.311,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.40100000000000002}]},{"osd":5,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.501,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.59999999999999998}]},{"osd":6,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51000000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.56000000000000005}]},{"osd":8,"last update":"Fri Dec 1 01:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.59399999999999997}]},{"osd":9,"last update":"Fri Dec 1 01:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.57899999999999996}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.54400000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":6,"up_from":45,"seq":193273528351,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27800,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717352,"statfs":{"total":95995035648,"available":95966568448,"internally_reserved":0,"allocated":868352,"data_stored":415764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.66000000000000003,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.437,"15min":0.43099999999999999},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.435,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.72199999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.62},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63,"15min":0.624},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.55400000000000005}]},{"osd":3,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.375,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85199999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.432}]},{"osd":4,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60199999999999998,"15min":0.59899999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.68000000000000005,"15min":0.66800000000000004},"min":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.496}]},{"osd":5,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65100000000000002,"15min":0.65200000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83199999999999996,"5min":1.319,"15min":1.319},"last":0.77300000000000002}]},{"osd":7,"last update":"Fri Dec 1 01:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64500000000000002,"15min":0.64000000000000001},"min":{"1min":0.53500000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.52900000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.755}]},{"osd":8,"last update":"Fri Dec 1 01:02:09 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.72499999999999998}]},{"osd":9,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.59599999999999997}]},{"osd":10,"last update":"Fri Dec 1 01:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.70699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27812,"kb_used_data":860,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717340,"statfs":{"total":95995035648,"available":95966556160,"internally_reserved":0,"allocated":880640,"data_stored":417328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.503,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.75600000000000001,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.34999999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.50600000000000001,"15min":0.48699999999999999},"min":{"1min":0.40799999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82699999999999996,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.51100000000000001,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Dec 1 01:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.378},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55800000000000005,"15min":0.54200000000000004},"min":{"1min":0.36499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:01:51 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.36399999999999999,"15min":0.35799999999999998},"min":{"1min":0.28399999999999997,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.38400000000000001,"15min":0.376},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55100000000000005,"15min":0.54400000000000004},"min":{"1min":0.44,"5min":0.37,"15min":0.37},"max":{"1min":0.72499999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.56200000000000006,"15min":0.55300000000000005},"min":{"1min":0.41399999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.53600000000000003}]},{"osd":6,"last update":"Fri Dec 1 01:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.42999999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.50600000000000001}]},{"osd":7,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.53400000000000003,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.41699999999999998}]},{"osd":8,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.60599999999999998}]},{"osd":9,"last update":"Fri Dec 1 01:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58899999999999997}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.621},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738423,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":872448,"data_stored":415854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32800000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.51800000000000002,"15min":0.51000000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.505}]},{"osd":2,"last update":"Fri Dec 1 01:02:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.53400000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.78900000000000003,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.85299999999999998,"5min":0.875,"15min":0.875},"last":0.67700000000000005}]},{"osd":3,"last update":"Fri Dec 1 01:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40799999999999997},"min":{"1min":0.251,"5min":0.249,"15min":0.249},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.46200000000000002,"15min":0.45600000000000002},"min":{"1min":0.32600000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.36299999999999999}]},{"osd":4,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.53200000000000003,"15min":0.51900000000000002},"min":{"1min":0.40699999999999997,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.53300000000000003,"15min":0.52300000000000002},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.56000000000000005}]},{"osd":5,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60299999999999998,"15min":0.60199999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.81200000000000006,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57899999999999996,"15min":0.57999999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.58599999999999997}]},{"osd":6,"last update":"Fri Dec 1 01:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80700000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60399999999999998,"15min":0.59599999999999997},"min":{"1min":0.38800000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.91700000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.61599999999999999}]},{"osd":7,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.628}]},{"osd":8,"last update":"Fri Dec 1 01:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.44},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63700000000000001}]},{"osd":9,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.54900000000000004}]},{"osd":10,"last update":"Fri Dec 1 01:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.81999999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411376,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27816,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717336,"statfs":{"total":95995035648,"available":95966552064,"internally_reserved":0,"allocated":884736,"data_stored":417362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.47999999999999998},"min":{"1min":0.30199999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77000000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48099999999999998,"15min":0.47699999999999998},"min":{"1min":0.33600000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Dec 1 01:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.625,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.66700000000000004,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Dec 1 01:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.53700000000000003,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89600000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.42599999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.60199999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40100000000000002,"15min":0.39700000000000002},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.42199999999999999,"15min":0.41599999999999998},"min":{"1min":0.311,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.39000000000000001}]},{"osd":6,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.877,"15min":0.877},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.48799999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.52000000000000002}]},{"osd":7,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.59199999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:02:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.495},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46899999999999997}]},{"osd":9,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.503},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.52800000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]}]},{"osd":3,"up_from":25,"seq":107374182443,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27808,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717344,"statfs":{"total":95995035648,"available":95966560256,"internally_reserved":0,"allocated":876544,"data_stored":415868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.376,"15min":0.35199999999999998},"min":{"1min":0.312,"5min":0.245,"15min":0.245},"max":{"1min":0.61099999999999999,"5min":0.623,"15min":0.623},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.39300000000000002,"15min":0.373},"min":{"1min":0.315,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.623,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.53900000000000003,"15min":0.505},"min":{"1min":0.435,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.84899999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.629},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.56499999999999995,"15min":0.52100000000000002},"min":{"1min":0.497,"5min":0.371,"15min":0.371},"max":{"1min":0.85199999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46200000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.442},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52800000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:02:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.60999999999999999,"15min":0.58099999999999996},"min":{"1min":0.504,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.60099999999999998,"15min":0.57699999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.60899999999999999,"15min":0.60499999999999998},"min":{"1min":0.46700000000000003,"5min":0.441,"15min":0.441},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.495},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.60299999999999998,"15min":0.59099999999999997},"min":{"1min":0.50600000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.51100000000000001}]},{"osd":6,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.35499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77100000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.57699999999999996,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri Dec 1 01:02:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.74299999999999999,"15min":0.73599999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.73099999999999998,"15min":0.71899999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.71899999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.65200000000000002}]},{"osd":9,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.60399999999999998}]},{"osd":10,"last update":"Fri Dec 1 01:02:48 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.752}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]}]},{"osd":4,"up_from":32,"seq":137438953511,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27804,"kb_used_data":852,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717348,"statfs":{"total":95995035648,"available":95966564352,"internally_reserved":0,"allocated":872448,"data_stored":415786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51600000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.85099999999999998,"5min":0.88,"15min":0.88},"last":0.371},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.42999999999999999}]},{"osd":1,"last update":"Fri Dec 1 01:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.36199999999999999,"15min":0.35999999999999999},"min":{"1min":0.27600000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.498,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.38500000000000001,"15min":0.377},"min":{"1min":0.28999999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68200000000000005,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.44}]},{"osd":2,"last update":"Fri Dec 1 01:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55200000000000005,"15min":0.54700000000000004},"min":{"1min":0.44600000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58799999999999997}]},{"osd":3,"last update":"Fri Dec 1 01:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54000000000000004,"15min":0.53800000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.71699999999999997,"5min":1.004,"15min":1.004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86599999999999999,"5min":0.879,"15min":0.879},"last":0.46200000000000002}]},{"osd":5,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57399999999999995,"15min":0.56999999999999995},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.58999999999999997,"15min":0.58399999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81200000000000006,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.63}]},{"osd":6,"last update":"Fri Dec 1 01:02:24 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.41499999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.94499999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.496},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.60799999999999998,"15min":0.59399999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.50600000000000001}]},{"osd":7,"last update":"Fri Dec 1 01:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.54300000000000004}]},{"osd":8,"last update":"Fri Dec 1 01:02:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.67400000000000004}]},{"osd":9,"last update":"Fri Dec 1 01:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.55400000000000005}]},{"osd":10,"last update":"Fri Dec 1 01:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.51600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]}]},{"osd":5,"up_from":37,"seq":158913789988,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27860,"kb_used_data":908,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717292,"statfs":{"total":95995035648,"available":95966507008,"internally_reserved":0,"allocated":929792,"data_stored":1006314,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.495,"15min":0.495},"min":{"1min":0.30299999999999999,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.249},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.49099999999999999,"15min":0.48799999999999999},"min":{"1min":0.307,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.28999999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.69399999999999995,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52800000000000002,"15min":0.52700000000000002},"min":{"1min":0.39500000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78500000000000003,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.437}]},{"osd":2,"last update":"Fri Dec 1 01:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38300000000000001,"15min":0.379},"min":{"1min":0.26300000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.42199999999999999,"15min":0.42399999999999999},"min":{"1min":0.28399999999999997,"5min":0.249,"15min":0.249},"max":{"1min":0.58299999999999996,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.30399999999999999}]},{"osd":3,"last update":"Fri Dec 1 01:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53600000000000003,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.77100000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35099999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.35099999999999998}]},{"osd":4,"last update":"Fri Dec 1 01:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.374},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.318}]},{"osd":6,"last update":"Fri Dec 1 01:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.621,"15min":0.624},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66800000000000004,"15min":0.67000000000000004},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91100000000000003,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.42899999999999999}]},{"osd":7,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88100000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.47899999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.47899999999999998}]},{"osd":8,"last update":"Fri Dec 1 01:02:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.39500000000000002}]},{"osd":9,"last update":"Fri Dec 1 01:02:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.48999999999999999}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.45900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T01:02:55.528 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-01T01:02:55.528 INFO:tasks.cephadm:Setting up client nodes... 2023-12-01T01:02:55.528 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-01T01:02:55.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:55 smithi116 ceph-mon[103554]: pgmap v249: 97 pgs: 97 active+clean; 579 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 8 op/s 2023-12-01T01:02:55.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:55 smithi116 ceph-mon[103554]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:02:55.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:55 smithi116 ceph-mon[103554]: mgrmap e17: x(active, since 5m), standbys: z, y 2023-12-01T01:02:55.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:55 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3065903430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:55.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:55 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1893581071' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:55.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:55 smithi093 ceph-mon[103327]: pgmap v249: 97 pgs: 97 active+clean; 579 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s wr, 8 op/s 2023-12-01T01:02:55.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:55 smithi093 ceph-mon[103327]: from='client.14745 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:02:55.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:55 smithi093 ceph-mon[103327]: mgrmap e17: x(active, since 5m), standbys: z, y 2023-12-01T01:02:55.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:55 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3065903430' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:02:55.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:55 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1893581071' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:02:56.117 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:02:56.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:56 smithi026 ceph-mon[98801]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:02:56.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:56 smithi026 ceph-mon[98801]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:02:56.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:56 smithi116 ceph-mon[103554]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:02:56.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:56 smithi116 ceph-mon[103554]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:02:56.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:56 smithi093 ceph-mon[103327]: from='client.14763 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:02:56.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:56 smithi093 ceph-mon[103327]: from='client.14769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:02:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.328+0000 7fe6361d7700 1 -- 172.21.15.26:0/3522744640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe630100e90 msgr2=0x7fe6301012b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.328+0000 7fe6361d7700 1 --2- 172.21.15.26:0/3522744640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe630100e90 0x7fe6301012b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe624009990 tx=0x7fe624009ca0 comp rx=0 tx=0).stop 2023-12-01T01:02:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.329+0000 7fe6361d7700 1 -- 172.21.15.26:0/3522744640 shutdown_connections 2023-12-01T01:02:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.329+0000 7fe6361d7700 1 --2- 172.21.15.26:0/3522744640 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe6301029b0 0x7fe6301092d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.329+0000 7fe6361d7700 1 --2- 172.21.15.26:0/3522744640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe630100e90 0x7fe6301012b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.329+0000 7fe6361d7700 1 --2- 172.21.15.26:0/3522744640 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe630101ff0 0x7fe630102470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.329+0000 7fe6361d7700 1 -- 172.21.15.26:0/3522744640 >> 172.21.15.26:0/3522744640 conn(0x7fe6300fc410 msgr2=0x7fe6300fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.329+0000 7fe6361d7700 1 -- 172.21.15.26:0/3522744640 shutdown_connections 2023-12-01T01:02:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.329+0000 7fe6361d7700 1 -- 172.21.15.26:0/3522744640 wait complete. 2023-12-01T01:02:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.329+0000 7fe6361d7700 1 Processor -- start 2023-12-01T01:02:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.329+0000 7fe6361d7700 1 -- start start 2023-12-01T01:02:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe6361d7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe630100e90 0x7fe630196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe6361d7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe630101ff0 0x7fe630197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe6361d7700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6301029b0 0x7fe63019e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe6361d7700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63019e750 con 0x7fe630101ff0 2023-12-01T01:02:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe6361d7700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63019e890 con 0x7fe630100e90 2023-12-01T01:02:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe6361d7700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63019ea20 con 0x7fe6301029b0 2023-12-01T01:02:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe62effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe630101ff0 0x7fe630197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe62effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe630101ff0 0x7fe630197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53746/0 (socket says 172.21.15.26:53746) 2023-12-01T01:02:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe62effd700 1 -- 172.21.15.26:0/2972002486 learned_addr learned my addr 172.21.15.26:0/2972002486 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe62f7fe700 1 --2- 172.21.15.26:0/2972002486 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe630100e90 0x7fe630196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe62ffff700 1 --2- 172.21.15.26:0/2972002486 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6301029b0 0x7fe63019e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe62effd700 1 -- 172.21.15.26:0/2972002486 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6301029b0 msgr2=0x7fe63019e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe62effd700 1 --2- 172.21.15.26:0/2972002486 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6301029b0 0x7fe63019e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe62effd700 1 -- 172.21.15.26:0/2972002486 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe630100e90 msgr2=0x7fe630196bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe62effd700 1 --2- 172.21.15.26:0/2972002486 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe630100e90 0x7fe630196bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe62effd700 1 -- 172.21.15.26:0/2972002486 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6240095f0 con 0x7fe630101ff0 2023-12-01T01:02:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe62f7fe700 1 --2- 172.21.15.26:0/2972002486 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe630100e90 0x7fe630196bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:02:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe62effd700 1 --2- 172.21.15.26:0/2972002486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe630101ff0 0x7fe630197100 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe62000d980 tx=0x7fe62000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe62cff9700 1 -- 172.21.15.26:0/2972002486 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620009b40 con 0x7fe630101ff0 2023-12-01T01:02:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe62cff9700 1 -- 172.21.15.26:0/2972002486 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe62000b6e0 con 0x7fe630101ff0 2023-12-01T01:02:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe6361d7700 1 -- 172.21.15.26:0/2972002486 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63019ed00 con 0x7fe630101ff0 2023-12-01T01:02:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.330+0000 7fe62cff9700 1 -- 172.21.15.26:0/2972002486 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62000f620 con 0x7fe630101ff0 2023-12-01T01:02:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.331+0000 7fe6361d7700 1 -- 172.21.15.26:0/2972002486 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63019f1b0 con 0x7fe630101ff0 2023-12-01T01:02:57.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.331+0000 7fe6361d7700 1 -- 172.21.15.26:0/2972002486 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63010c7f0 con 0x7fe630101ff0 2023-12-01T01:02:57.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.333+0000 7fe62cff9700 1 -- 172.21.15.26:0/2972002486 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fe620010460 con 0x7fe630101ff0 2023-12-01T01:02:57.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.333+0000 7fe62cff9700 1 --2- 172.21.15.26:0/2972002486 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe6180a05b0 0x7fe6180a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:57.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.333+0000 7fe62f7fe700 1 --2- 172.21.15.26:0/2972002486 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe6180a05b0 0x7fe6180a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:57.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.333+0000 7fe62cff9700 1 -- 172.21.15.26:0/2972002486 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe6200cbc40 con 0x7fe630101ff0 2023-12-01T01:02:57.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.334+0000 7fe62f7fe700 1 --2- 172.21.15.26:0/2972002486 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe6180a05b0 0x7fe6180a2a70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe624006010 tx=0x7fe62400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:57.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.337+0000 7fe62cff9700 1 -- 172.21.15.26:0/2972002486 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe620095830 con 0x7fe630101ff0 2023-12-01T01:02:57.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:57 smithi026 ceph-mon[98801]: pgmap v250: 97 pgs: 97 active+clean; 582 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4.7 KiB/s wr, 18 op/s 2023-12-01T01:02:57.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.618+0000 7fe6361d7700 1 -- 172.21.15.26:0/2972002486 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fe630107d40 con 0x7fe630101ff0 2023-12-01T01:02:57.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.623+0000 7fe62cff9700 1 -- 172.21.15.26:0/2972002486 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7fe620020050 con 0x7fe630101ff0 2023-12-01T01:02:57.625 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2023-12-01T01:02:57.625 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDBMGllfDIBJRAAipPvlUEJyfRXL24ex5c1nQ== 2023-12-01T01:02:57.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.625+0000 7fe6361d7700 1 -- 172.21.15.26:0/2972002486 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe6180a05b0 msgr2=0x7fe6180a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:57.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.625+0000 7fe6361d7700 1 --2- 172.21.15.26:0/2972002486 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe6180a05b0 0x7fe6180a2a70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe624006010 tx=0x7fe62400b540 comp rx=0 tx=0).stop 2023-12-01T01:02:57.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.625+0000 7fe6361d7700 1 -- 172.21.15.26:0/2972002486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe630101ff0 msgr2=0x7fe630197100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:57.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.625+0000 7fe6361d7700 1 --2- 172.21.15.26:0/2972002486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe630101ff0 0x7fe630197100 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe62000d980 tx=0x7fe62000dc90 comp rx=0 tx=0).stop 2023-12-01T01:02:57.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.625+0000 7fe6361d7700 1 -- 172.21.15.26:0/2972002486 shutdown_connections 2023-12-01T01:02:57.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.625+0000 7fe6361d7700 1 --2- 172.21.15.26:0/2972002486 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe6180a05b0 0x7fe6180a2a70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:57.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.625+0000 7fe6361d7700 1 --2- 172.21.15.26:0/2972002486 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe6301029b0 0x7fe63019e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:57.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.625+0000 7fe6361d7700 1 --2- 172.21.15.26:0/2972002486 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe630100e90 0x7fe630196bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:57.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.625+0000 7fe6361d7700 1 --2- 172.21.15.26:0/2972002486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe630101ff0 0x7fe630197100 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:57.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.625+0000 7fe6361d7700 1 -- 172.21.15.26:0/2972002486 >> 172.21.15.26:0/2972002486 conn(0x7fe6300fc410 msgr2=0x7fe6300fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:57.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.625+0000 7fe6361d7700 1 -- 172.21.15.26:0/2972002486 shutdown_connections 2023-12-01T01:02:57.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:57.625+0000 7fe6361d7700 1 -- 172.21.15.26:0/2972002486 wait complete. 2023-12-01T01:02:57.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:57 smithi116 ceph-mon[103554]: pgmap v250: 97 pgs: 97 active+clean; 582 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4.7 KiB/s wr, 18 op/s 2023-12-01T01:02:57.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:57 smithi093 ceph-mon[103327]: pgmap v250: 97 pgs: 97 active+clean; 582 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 4.7 KiB/s wr, 18 op/s 2023-12-01T01:02:57.976 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T01:02:57.976 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-01T01:02:57.976 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-01T01:02:58.019 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-01T01:02:58.019 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-01T01:02:58.019 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph mgr dump --format=json 2023-12-01T01:02:58.617 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:02:58.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:58 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2972002486' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-01T01:02:58.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:58 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2972002486' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-01T01:02:58.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-12-01T01:02:58.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2023-12-01T01:02:58.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2023-12-01T01:02:58.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2023-12-01T01:02:58.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-12-01T01:02:58.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2023-12-01T01:02:58.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2023-12-01T01:02:58.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2023-12-01T01:02:58.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:58 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2972002486' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-01T01:02:58.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:58 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2972002486' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-01T01:02:58.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-12-01T01:02:58.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2023-12-01T01:02:58.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2023-12-01T01:02:58.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2023-12-01T01:02:58.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-12-01T01:02:58.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2023-12-01T01:02:58.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2023-12-01T01:02:58.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2023-12-01T01:02:58.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:58 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2972002486' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-01T01:02:58.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:58 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2972002486' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-01T01:02:58.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-12-01T01:02:58.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2023-12-01T01:02:58.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2023-12-01T01:02:58.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2023-12-01T01:02:58.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2023-12-01T01:02:58.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2023-12-01T01:02:58.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2023-12-01T01:02:58.797 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]: dispatch 2023-12-01T01:02:59.723 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:59 smithi026 ceph-mon[98801]: pgmap v251: 97 pgs: 97 active+clean; 621 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 8.3 KiB/s wr, 19 op/s 2023-12-01T01:02:59.723 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-12-01T01:02:59.723 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2023-12-01T01:02:59.724 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2023-12-01T01:02:59.724 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2023-12-01T01:02:59.724 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-12-01T01:02:59.724 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2023-12-01T01:02:59.724 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2023-12-01T01:02:59.724 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:59 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2023-12-01T01:02:59.724 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:02:59 smithi026 ceph-mon[98801]: osdmap e82: 12 total, 12 up, 12 in 2023-12-01T01:02:59.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.904+0000 7efc80cdf700 1 -- 172.21.15.26:0/1130547931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7c105d80 msgr2=0x7efc7c106160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:59.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.904+0000 7efc80cdf700 1 --2- 172.21.15.26:0/1130547931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7c105d80 0x7efc7c106160 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efc6c009990 tx=0x7efc6c009ca0 comp rx=0 tx=0).stop 2023-12-01T01:02:59.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.904+0000 7efc80cdf700 1 -- 172.21.15.26:0/1130547931 shutdown_connections 2023-12-01T01:02:59.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.904+0000 7efc80cdf700 1 --2- 172.21.15.26:0/1130547931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c100690 0x7efc7c10cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:59.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.904+0000 7efc80cdf700 1 --2- 172.21.15.26:0/1130547931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7c105d80 0x7efc7c106160 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:59.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.904+0000 7efc80cdf700 1 --2- 172.21.15.26:0/1130547931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc7c0ffcd0 0x7efc7c100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:59.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.904+0000 7efc80cdf700 1 -- 172.21.15.26:0/1130547931 >> 172.21.15.26:0/1130547931 conn(0x7efc7c076d90 msgr2=0x7efc7c0771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:02:59.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.904+0000 7efc80cdf700 1 -- 172.21.15.26:0/1130547931 shutdown_connections 2023-12-01T01:02:59.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.904+0000 7efc80cdf700 1 -- 172.21.15.26:0/1130547931 wait complete. 2023-12-01T01:02:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.905+0000 7efc80cdf700 1 Processor -- start 2023-12-01T01:02:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.905+0000 7efc80cdf700 1 -- start start 2023-12-01T01:02:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.905+0000 7efc80cdf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7c0ffcd0 0x7efc7c197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.905+0000 7efc80cdf700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc7c100690 0x7efc7c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.905+0000 7efc80cdf700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c105d80 0x7efc7c1a2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.905+0000 7efc80cdf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c198c00 con 0x7efc7c0ffcd0 2023-12-01T01:02:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.905+0000 7efc80cdf700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c1a3370 con 0x7efc7c105d80 2023-12-01T01:02:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.905+0000 7efc80cdf700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c1a34e0 con 0x7efc7c100690 2023-12-01T01:02:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.905+0000 7efc7a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7c0ffcd0 0x7efc7c197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.905+0000 7efc7a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7c0ffcd0 0x7efc7c197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53758/0 (socket says 172.21.15.26:53758) 2023-12-01T01:02:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.905+0000 7efc7a59c700 1 -- 172.21.15.26:0/223617420 learned_addr learned my addr 172.21.15.26:0/223617420 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:02:59.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.905+0000 7efc7ad9d700 1 --2- 172.21.15.26:0/223617420 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c105d80 0x7efc7c1a2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:59.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.905+0000 7efc79d9b700 1 --2- 172.21.15.26:0/223617420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc7c100690 0x7efc7c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:59.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.906+0000 7efc7a59c700 1 -- 172.21.15.26:0/223617420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc7c100690 msgr2=0x7efc7c1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:59.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.906+0000 7efc7a59c700 1 --2- 172.21.15.26:0/223617420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc7c100690 0x7efc7c1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:59.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.906+0000 7efc7a59c700 1 -- 172.21.15.26:0/223617420 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c105d80 msgr2=0x7efc7c1a2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:02:59.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.906+0000 7efc7a59c700 1 --2- 172.21.15.26:0/223617420 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c105d80 0x7efc7c1a2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:02:59.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.906+0000 7efc7a59c700 1 -- 172.21.15.26:0/223617420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c0095f0 con 0x7efc7c0ffcd0 2023-12-01T01:02:59.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.906+0000 7efc7ad9d700 1 --2- 172.21.15.26:0/223617420 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c105d80 0x7efc7c1a2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:02:59.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.906+0000 7efc7a59c700 1 --2- 172.21.15.26:0/223617420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7c0ffcd0 0x7efc7c197db0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efc6c000c00 tx=0x7efc6c00f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:59.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.906+0000 7efc6b7fe700 1 -- 172.21.15.26:0/223617420 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c01d070 con 0x7efc7c0ffcd0 2023-12-01T01:02:59.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.906+0000 7efc6b7fe700 1 -- 172.21.15.26:0/223617420 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efc6c003680 con 0x7efc7c0ffcd0 2023-12-01T01:02:59.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.906+0000 7efc80cdf700 1 -- 172.21.15.26:0/223617420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7c1a3760 con 0x7efc7c0ffcd0 2023-12-01T01:02:59.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.906+0000 7efc6b7fe700 1 -- 172.21.15.26:0/223617420 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c017650 con 0x7efc7c0ffcd0 2023-12-01T01:02:59.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.906+0000 7efc80cdf700 1 -- 172.21.15.26:0/223617420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7c1a3c50 con 0x7efc7c0ffcd0 2023-12-01T01:02:59.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.907+0000 7efc80cdf700 1 -- 172.21.15.26:0/223617420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7c04ea90 con 0x7efc7c0ffcd0 2023-12-01T01:02:59.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.908+0000 7efc6b7fe700 1 -- 172.21.15.26:0/223617420 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7efc6c022470 con 0x7efc7c0ffcd0 2023-12-01T01:02:59.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.909+0000 7efc6b7fe700 1 --2- 172.21.15.26:0/223617420 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efc640a0630 0x7efc640a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:02:59.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.909+0000 7efc79d9b700 1 --2- 172.21.15.26:0/223617420 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efc640a0630 0x7efc640a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:02:59.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.909+0000 7efc6b7fe700 1 -- 172.21.15.26:0/223617420 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efc6c0ccff0 con 0x7efc7c0ffcd0 2023-12-01T01:02:59.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.909+0000 7efc79d9b700 1 --2- 172.21.15.26:0/223617420 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efc640a0630 0x7efc640a2af0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efc70006fd0 tx=0x7efc70008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:02:59.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:02:59.913+0000 7efc6b7fe700 1 -- 172.21.15.26:0/223617420 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7efc6c096a90 con 0x7efc7c0ffcd0 2023-12-01T01:02:59.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:59 smithi116 ceph-mon[103554]: pgmap v251: 97 pgs: 97 active+clean; 621 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 8.3 KiB/s wr, 19 op/s 2023-12-01T01:02:59.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-12-01T01:02:59.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2023-12-01T01:02:59.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2023-12-01T01:02:59.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2023-12-01T01:02:59.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-12-01T01:02:59.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2023-12-01T01:02:59.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2023-12-01T01:02:59.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:59 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2023-12-01T01:02:59.931 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:02:59 smithi116 ceph-mon[103554]: osdmap e82: 12 total, 12 up, 12 in 2023-12-01T01:02:59.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:59 smithi093 ceph-mon[103327]: pgmap v251: 97 pgs: 97 active+clean; 621 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 8.3 KiB/s wr, 19 op/s 2023-12-01T01:02:59.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-12-01T01:02:59.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2023-12-01T01:02:59.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2023-12-01T01:02:59.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2023-12-01T01:02:59.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2023-12-01T01:02:59.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2023-12-01T01:02:59.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2023-12-01T01:02:59.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:59 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [5, 9]}]': finished 2023-12-01T01:02:59.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:02:59 smithi093 ceph-mon[103327]: osdmap e82: 12 total, 12 up, 12 in 2023-12-01T01:03:00.170 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:00.169+0000 7efc80cdf700 1 -- 172.21.15.26:0/223617420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7efc7c1a3f10 con 0x7efc7c0ffcd0 2023-12-01T01:03:00.175 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:00.174+0000 7efc6b7fe700 1 -- 172.21.15.26:0/223617420 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+258830 (secure 0 0 0) 0x7efc6c113320 con 0x7efc7c0ffcd0 2023-12-01T01:03:00.178 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:03:00.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:00.177+0000 7efc80cdf700 1 -- 172.21.15.26:0/223617420 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efc640a0630 msgr2=0x7efc640a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:00.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:00.177+0000 7efc80cdf700 1 --2- 172.21.15.26:0/223617420 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efc640a0630 0x7efc640a2af0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efc70006fd0 tx=0x7efc70008040 comp rx=0 tx=0).stop 2023-12-01T01:03:00.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:00.177+0000 7efc80cdf700 1 -- 172.21.15.26:0/223617420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7c0ffcd0 msgr2=0x7efc7c197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:00.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:00.177+0000 7efc80cdf700 1 --2- 172.21.15.26:0/223617420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7c0ffcd0 0x7efc7c197db0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efc6c000c00 tx=0x7efc6c00f710 comp rx=0 tx=0).stop 2023-12-01T01:03:00.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:00.177+0000 7efc80cdf700 1 -- 172.21.15.26:0/223617420 shutdown_connections 2023-12-01T01:03:00.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:00.177+0000 7efc80cdf700 1 --2- 172.21.15.26:0/223617420 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efc640a0630 0x7efc640a2af0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:00.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:00.177+0000 7efc80cdf700 1 --2- 172.21.15.26:0/223617420 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc7c105d80 0x7efc7c1a2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:00.180 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:00.177+0000 7efc80cdf700 1 --2- 172.21.15.26:0/223617420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc7c0ffcd0 0x7efc7c197db0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:00.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:00.177+0000 7efc80cdf700 1 --2- 172.21.15.26:0/223617420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc7c100690 0x7efc7c1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:00.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:00.177+0000 7efc80cdf700 1 -- 172.21.15.26:0/223617420 >> 172.21.15.26:0/223617420 conn(0x7efc7c076d90 msgr2=0x7efc7c0fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:00.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:00.177+0000 7efc80cdf700 1 -- 172.21.15.26:0/223617420 shutdown_connections 2023-12-01T01:03:00.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:00.177+0000 7efc80cdf700 1 -- 172.21.15.26:0/223617420 wait complete. 2023-12-01T01:03:00.772 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":17,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":4255346255},{"type":"v1","addr":"172.21.15.26:6801","nonce":4255346255}]},"active_addr":"172.21.15.26:6801/4255346255","active_change":"2023-12-01T00:56:57.880046+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.26:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":1800968198}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":4105078704}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":3489999514}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":2555779830}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.26:0","nonce":1094224993}]}]} 2023-12-01T01:03:00.777 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-01T01:03:00.777 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-01T01:03:00.777 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-01T01:03:00.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:00 smithi116 ceph-mon[103554]: osdmap e83: 12 total, 12 up, 12 in 2023-12-01T01:03:00.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:00 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/223617420' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-01T01:03:00.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:00 smithi093 ceph-mon[103327]: osdmap e83: 12 total, 12 up, 12 in 2023-12-01T01:03:00.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:00 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/223617420' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-01T01:03:01.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:00 smithi026 ceph-mon[98801]: osdmap e83: 12 total, 12 up, 12 in 2023-12-01T01:03:01.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:00 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/223617420' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-01T01:03:01.337 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:01.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:01 smithi026 ceph-mon[98801]: pgmap v254: 97 pgs: 1 activating, 96 active+clean; 621 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 9.0 KiB/s wr, 18 op/s 2023-12-01T01:03:01.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:01 smithi116 ceph-mon[103554]: pgmap v254: 97 pgs: 1 activating, 96 active+clean; 621 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 9.0 KiB/s wr, 18 op/s 2023-12-01T01:03:01.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:01 smithi093 ceph-mon[103327]: pgmap v254: 97 pgs: 1 activating, 96 active+clean; 621 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 9.0 KiB/s wr, 18 op/s 2023-12-01T01:03:02.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.544+0000 7fa6e4b6b700 1 -- 172.21.15.26:0/379557248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e0100690 msgr2=0x7fa6e010cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:02.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.544+0000 7fa6e4b6b700 1 --2- 172.21.15.26:0/379557248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e0100690 0x7fa6e010cb30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa6d800b0a0 tx=0x7fa6d800b3b0 comp rx=0 tx=0).stop 2023-12-01T01:03:02.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.544+0000 7fa6e4b6b700 1 -- 172.21.15.26:0/379557248 shutdown_connections 2023-12-01T01:03:02.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.544+0000 7fa6e4b6b700 1 --2- 172.21.15.26:0/379557248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e0100690 0x7fa6e010cb30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:02.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.544+0000 7fa6e4b6b700 1 --2- 172.21.15.26:0/379557248 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6e0105d80 0x7fa6e0106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:02.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.544+0000 7fa6e4b6b700 1 --2- 172.21.15.26:0/379557248 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6e00ffcd0 0x7fa6e0100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:02.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.544+0000 7fa6e4b6b700 1 -- 172.21.15.26:0/379557248 >> 172.21.15.26:0/379557248 conn(0x7fa6e0076d90 msgr2=0x7fa6e00771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:02.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.544+0000 7fa6e4b6b700 1 -- 172.21.15.26:0/379557248 shutdown_connections 2023-12-01T01:03:02.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.544+0000 7fa6e4b6b700 1 -- 172.21.15.26:0/379557248 wait complete. 2023-12-01T01:03:02.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.545+0000 7fa6e4b6b700 1 Processor -- start 2023-12-01T01:03:02.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.545+0000 7fa6e4b6b700 1 -- start start 2023-12-01T01:03:02.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.545+0000 7fa6e4b6b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6e00ffcd0 0x7fa6e0196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:02.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.545+0000 7fa6e4b6b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e0100690 0x7fa6e0197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:02.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.545+0000 7fa6e4b6b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6e0105d80 0x7fa6e019b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:02.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.545+0000 7fa6e4b6b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e019bf10 con 0x7fa6e0100690 2023-12-01T01:03:02.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.545+0000 7fa6e4b6b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e019c080 con 0x7fa6e0105d80 2023-12-01T01:03:02.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.545+0000 7fa6e4b6b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e019c240 con 0x7fa6e00ffcd0 2023-12-01T01:03:02.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.545+0000 7fa6ddd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e0100690 0x7fa6e0197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:02.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.545+0000 7fa6ddd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e0100690 0x7fa6e0197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53774/0 (socket says 172.21.15.26:53774) 2023-12-01T01:03:02.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.545+0000 7fa6ddd9b700 1 -- 172.21.15.26:0/36599229 learned_addr learned my addr 172.21.15.26:0/36599229 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.545+0000 7fa6ded9d700 1 --2- 172.21.15.26:0/36599229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6e0105d80 0x7fa6e019b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.545+0000 7fa6de59c700 1 --2- 172.21.15.26:0/36599229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6e00ffcd0 0x7fa6e0196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.546+0000 7fa6ddd9b700 1 -- 172.21.15.26:0/36599229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6e00ffcd0 msgr2=0x7fa6e0196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.546+0000 7fa6ddd9b700 1 --2- 172.21.15.26:0/36599229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6e00ffcd0 0x7fa6e0196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.546+0000 7fa6ddd9b700 1 -- 172.21.15.26:0/36599229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6e0105d80 msgr2=0x7fa6e019b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.546+0000 7fa6ddd9b700 1 --2- 172.21.15.26:0/36599229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6e0105d80 0x7fa6e019b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.546+0000 7fa6ddd9b700 1 -- 172.21.15.26:0/36599229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d8009d00 con 0x7fa6e0100690 2023-12-01T01:03:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.546+0000 7fa6ddd9b700 1 --2- 172.21.15.26:0/36599229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e0100690 0x7fa6e0197490 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000c9b0 tx=0x7fa6d000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.546+0000 7fa6cf7fe700 1 -- 172.21.15.26:0/36599229 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0007b00 con 0x7fa6e0100690 2023-12-01T01:03:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.546+0000 7fa6e4b6b700 1 -- 172.21.15.26:0/36599229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e019c520 con 0x7fa6e0100690 2023-12-01T01:03:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.546+0000 7fa6cf7fe700 1 -- 172.21.15.26:0/36599229 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa6d0007c60 con 0x7fa6e0100690 2023-12-01T01:03:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.546+0000 7fa6cf7fe700 1 -- 172.21.15.26:0/36599229 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d0018660 con 0x7fa6e0100690 2023-12-01T01:03:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.546+0000 7fa6e4b6b700 1 -- 172.21.15.26:0/36599229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e01a3d80 con 0x7fa6e0100690 2023-12-01T01:03:02.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.547+0000 7fa6e4b6b700 1 -- 172.21.15.26:0/36599229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e004ea90 con 0x7fa6e0100690 2023-12-01T01:03:02.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.548+0000 7fa6cf7fe700 1 -- 172.21.15.26:0/36599229 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fa6d000f450 con 0x7fa6e0100690 2023-12-01T01:03:02.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.549+0000 7fa6cf7fe700 1 --2- 172.21.15.26:0/36599229 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa6c80a05b0 0x7fa6c80a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:02.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.549+0000 7fa6cf7fe700 1 -- 172.21.15.26:0/36599229 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa6d00cbb00 con 0x7fa6e0100690 2023-12-01T01:03:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.549+0000 7fa6de59c700 1 --2- 172.21.15.26:0/36599229 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa6c80a05b0 0x7fa6c80a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.549+0000 7fa6de59c700 1 --2- 172.21.15.26:0/36599229 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa6c80a05b0 0x7fa6c80a2a70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4005fd0 tx=0x7fa6d400a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:02.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.553+0000 7fa6cf7fe700 1 -- 172.21.15.26:0/36599229 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa6d0095550 con 0x7fa6e0100690 2023-12-01T01:03:02.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.757+0000 7fa6e4b6b700 1 -- 172.21.15.26:0/36599229 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6e01a4070 con 0x7fa6e0100690 2023-12-01T01:03:02.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.759+0000 7fa6cf7fe700 1 -- 172.21.15.26:0/36599229 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22481 (secure 0 0 0) 0x7fa6d0098b70 con 0x7fa6e0100690 2023-12-01T01:03:02.760 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:03:02.760 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":83,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:59.627676+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:03:02.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.760+0000 7fa6e4b6b700 1 -- 172.21.15.26:0/36599229 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa6c80a05b0 msgr2=0x7fa6c80a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:02.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.760+0000 7fa6e4b6b700 1 --2- 172.21.15.26:0/36599229 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa6c80a05b0 0x7fa6c80a2a70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4005fd0 tx=0x7fa6d400a560 comp rx=0 tx=0).stop 2023-12-01T01:03:02.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.760+0000 7fa6e4b6b700 1 -- 172.21.15.26:0/36599229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e0100690 msgr2=0x7fa6e0197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:02.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.760+0000 7fa6e4b6b700 1 --2- 172.21.15.26:0/36599229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e0100690 0x7fa6e0197490 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa6d000c9b0 tx=0x7fa6d000ccc0 comp rx=0 tx=0).stop 2023-12-01T01:03:02.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.761+0000 7fa6e4b6b700 1 -- 172.21.15.26:0/36599229 shutdown_connections 2023-12-01T01:03:02.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.761+0000 7fa6e4b6b700 1 --2- 172.21.15.26:0/36599229 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa6c80a05b0 0x7fa6c80a2a70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:02.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.761+0000 7fa6e4b6b700 1 --2- 172.21.15.26:0/36599229 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6e0105d80 0x7fa6e019b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:02.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.761+0000 7fa6e4b6b700 1 --2- 172.21.15.26:0/36599229 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa6e00ffcd0 0x7fa6e0196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:02.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.761+0000 7fa6e4b6b700 1 --2- 172.21.15.26:0/36599229 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6e0100690 0x7fa6e0197490 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:02.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.761+0000 7fa6e4b6b700 1 -- 172.21.15.26:0/36599229 >> 172.21.15.26:0/36599229 conn(0x7fa6e0076d90 msgr2=0x7fa6e0068870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:02.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.761+0000 7fa6e4b6b700 1 -- 172.21.15.26:0/36599229 shutdown_connections 2023-12-01T01:03:02.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:02.761+0000 7fa6e4b6b700 1 -- 172.21.15.26:0/36599229 wait complete. 2023-12-01T01:03:03.100 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-01T01:03:03.100 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd dump --format=json 2023-12-01T01:03:03.660 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:03.907 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:03 smithi026 ceph-mon[98801]: pgmap v255: 97 pgs: 1 activating, 96 active+clean; 621 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 KiB/s wr, 18 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-12-01T01:03:03.907 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:03 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/36599229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:03:03.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:03 smithi116 ceph-mon[103554]: pgmap v255: 97 pgs: 1 activating, 96 active+clean; 621 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 KiB/s wr, 18 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-12-01T01:03:03.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:03 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/36599229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:03:03.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:03 smithi093 ceph-mon[103327]: pgmap v255: 97 pgs: 1 activating, 96 active+clean; 621 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 KiB/s wr, 18 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-12-01T01:03:03.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:03 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/36599229' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:03:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.944+0000 7fb8879f5700 1 -- 172.21.15.26:0/788958801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb880069270 msgr2=0x7fb88010dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.944+0000 7fb8879f5700 1 --2- 172.21.15.26:0/788958801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb880069270 0x7fb88010dbd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb87800b0a0 tx=0x7fb87800b3b0 comp rx=0 tx=0).stop 2023-12-01T01:03:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.944+0000 7fb8879f5700 1 -- 172.21.15.26:0/788958801 shutdown_connections 2023-12-01T01:03:04.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.944+0000 7fb8879f5700 1 --2- 172.21.15.26:0/788958801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb880069270 0x7fb88010dbd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.944+0000 7fb8879f5700 1 --2- 172.21.15.26:0/788958801 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb880106f20 0x7fb880107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.944+0000 7fb8879f5700 1 --2- 172.21.15.26:0/788958801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb8800688b0 0x7fb880068d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.944+0000 7fb8879f5700 1 -- 172.21.15.26:0/788958801 >> 172.21.15.26:0/788958801 conn(0x7fb880076d90 msgr2=0x7fb8800771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.944+0000 7fb8879f5700 1 -- 172.21.15.26:0/788958801 shutdown_connections 2023-12-01T01:03:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.944+0000 7fb8879f5700 1 -- 172.21.15.26:0/788958801 wait complete. 2023-12-01T01:03:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb8879f5700 1 Processor -- start 2023-12-01T01:03:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb8879f5700 1 -- start start 2023-12-01T01:03:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb8879f5700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8800688b0 0x7fb880197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb8879f5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb880069270 0x7fb880197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb8879f5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb880106f20 0x7fb88019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb8879f5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88019bfc0 con 0x7fb880106f20 2023-12-01T01:03:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb8879f5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88019c130 con 0x7fb880069270 2023-12-01T01:03:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb8879f5700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb88019c2f0 con 0x7fb8800688b0 2023-12-01T01:03:04.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb885f92700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb880106f20 0x7fb88019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb885f92700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb880106f20 0x7fb88019b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53788/0 (socket says 172.21.15.26:53788) 2023-12-01T01:03:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb885f92700 1 -- 172.21.15.26:0/3257735836 learned_addr learned my addr 172.21.15.26:0/3257735836 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb884f90700 1 --2- 172.21.15.26:0/3257735836 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb880069270 0x7fb880197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb885791700 1 --2- 172.21.15.26:0/3257735836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8800688b0 0x7fb880197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb885f92700 1 -- 172.21.15.26:0/3257735836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8800688b0 msgr2=0x7fb880197000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb885f92700 1 --2- 172.21.15.26:0/3257735836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8800688b0 0x7fb880197000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb885f92700 1 -- 172.21.15.26:0/3257735836 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb880069270 msgr2=0x7fb880197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb885f92700 1 --2- 172.21.15.26:0/3257735836 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb880069270 0x7fb880197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.945+0000 7fb885f92700 1 -- 172.21.15.26:0/3257735836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb878009d00 con 0x7fb880106f20 2023-12-01T01:03:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.946+0000 7fb885f92700 1 --2- 172.21.15.26:0/3257735836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb880106f20 0x7fb88019b9b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb87800b830 tx=0x7fb878004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.946+0000 7fb8767fc700 1 -- 172.21.15.26:0/3257735836 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87800e040 con 0x7fb880106f20 2023-12-01T01:03:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.946+0000 7fb8767fc700 1 -- 172.21.15.26:0/3257735836 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb878007850 con 0x7fb880106f20 2023-12-01T01:03:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.946+0000 7fb8879f5700 1 -- 172.21.15.26:0/3257735836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb88019c570 con 0x7fb880106f20 2023-12-01T01:03:04.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.946+0000 7fb8767fc700 1 -- 172.21.15.26:0/3257735836 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb87801d480 con 0x7fb880106f20 2023-12-01T01:03:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.946+0000 7fb8879f5700 1 -- 172.21.15.26:0/3257735836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8801a3e30 con 0x7fb880106f20 2023-12-01T01:03:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.947+0000 7fb8879f5700 1 -- 172.21.15.26:0/3257735836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb88004ea90 con 0x7fb880106f20 2023-12-01T01:03:04.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.949+0000 7fb8767fc700 1 -- 172.21.15.26:0/3257735836 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fb878004000 con 0x7fb880106f20 2023-12-01T01:03:04.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.949+0000 7fb8767fc700 1 --2- 172.21.15.26:0/3257735836 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb86c0a05b0 0x7fb86c0a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:04.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.949+0000 7fb885791700 1 --2- 172.21.15.26:0/3257735836 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb86c0a05b0 0x7fb86c0a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:04.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.949+0000 7fb8767fc700 1 -- 172.21.15.26:0/3257735836 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb8780cd740 con 0x7fb880106f20 2023-12-01T01:03:04.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.950+0000 7fb885791700 1 --2- 172.21.15.26:0/3257735836 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb86c0a05b0 0x7fb86c0a2a70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb87c005fd0 tx=0x7fb87c005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:04.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:04.953+0000 7fb8767fc700 1 -- 172.21.15.26:0/3257735836 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb878097220 con 0x7fb880106f20 2023-12-01T01:03:05.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:05.150+0000 7fb8879f5700 1 -- 172.21.15.26:0/3257735836 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8801a3fc0 con 0x7fb880106f20 2023-12-01T01:03:05.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:05.151+0000 7fb8767fc700 1 -- 172.21.15.26:0/3257735836 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22481 (secure 0 0 0) 0x7fb87809a840 con 0x7fb880106f20 2023-12-01T01:03:05.152 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:03:05.153 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":83,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:59.627676+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:03:05.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:05.153+0000 7fb8879f5700 1 -- 172.21.15.26:0/3257735836 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb86c0a05b0 msgr2=0x7fb86c0a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:05.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:05.153+0000 7fb8879f5700 1 --2- 172.21.15.26:0/3257735836 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb86c0a05b0 0x7fb86c0a2a70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb87c005fd0 tx=0x7fb87c005db0 comp rx=0 tx=0).stop 2023-12-01T01:03:05.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:05.153+0000 7fb8879f5700 1 -- 172.21.15.26:0/3257735836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb880106f20 msgr2=0x7fb88019b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:05.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:05.153+0000 7fb8879f5700 1 --2- 172.21.15.26:0/3257735836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb880106f20 0x7fb88019b9b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb87800b830 tx=0x7fb878004d50 comp rx=0 tx=0).stop 2023-12-01T01:03:05.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:05.153+0000 7fb8879f5700 1 -- 172.21.15.26:0/3257735836 shutdown_connections 2023-12-01T01:03:05.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:05.153+0000 7fb8879f5700 1 --2- 172.21.15.26:0/3257735836 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb86c0a05b0 0x7fb86c0a2a70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:05.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:05.153+0000 7fb8879f5700 1 --2- 172.21.15.26:0/3257735836 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb880106f20 0x7fb88019b9b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:05.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:05.153+0000 7fb8879f5700 1 --2- 172.21.15.26:0/3257735836 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb8800688b0 0x7fb880197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:05.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:05.153+0000 7fb8879f5700 1 --2- 172.21.15.26:0/3257735836 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb880069270 0x7fb880197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:05.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:05.153+0000 7fb8879f5700 1 -- 172.21.15.26:0/3257735836 >> 172.21.15.26:0/3257735836 conn(0x7fb880076d90 msgr2=0x7fb880104ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:05.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:05.153+0000 7fb8879f5700 1 -- 172.21.15.26:0/3257735836 shutdown_connections 2023-12-01T01:03:05.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:05.153+0000 7fb8879f5700 1 -- 172.21.15.26:0/3257735836 wait complete. 2023-12-01T01:03:05.523 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-01T01:03:05.523 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-01T01:03:05.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-01T01:03:05.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-01T01:03:05.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-01T01:03:05.525 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-01T01:03:05.527 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2023-12-01T01:03:05.527 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2023-12-01T01:03:05.528 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph tell osd.8 flush_pg_stats 2023-12-01T01:03:05.528 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph tell osd.9 flush_pg_stats 2023-12-01T01:03:05.528 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph tell osd.10 flush_pg_stats 2023-12-01T01:03:05.529 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph tell osd.11 flush_pg_stats 2023-12-01T01:03:05.805 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:05 smithi026 ceph-mon[98801]: pgmap v256: 97 pgs: 1 activating, 96 active+clean; 633 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.1 KiB/s wr, 8 op/s; 5.0 KiB/s, 1 keys/s, 1 objects/s recovering 2023-12-01T01:03:05.806 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:05 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3257735836' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:03:05.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:05 smithi116 ceph-mon[103554]: pgmap v256: 97 pgs: 1 activating, 96 active+clean; 633 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.1 KiB/s wr, 8 op/s; 5.0 KiB/s, 1 keys/s, 1 objects/s recovering 2023-12-01T01:03:05.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:05 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3257735836' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:03:05.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:05 smithi093 ceph-mon[103327]: pgmap v256: 97 pgs: 1 activating, 96 active+clean; 633 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 7.1 KiB/s wr, 8 op/s; 5.0 KiB/s, 1 keys/s, 1 objects/s recovering 2023-12-01T01:03:05.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:05 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3257735836' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:03:07.348 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:07.373 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:07.511 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:07.512 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:07.699 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:07.702 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:07.849 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:07 smithi026 ceph-mon[98801]: pgmap v257: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.9 KiB/s wr, 5 op/s; 5.0 KiB/s, 1 keys/s, 1 objects/s recovering 2023-12-01T01:03:07.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:07 smithi116 ceph-mon[103554]: pgmap v257: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.9 KiB/s wr, 5 op/s; 5.0 KiB/s, 1 keys/s, 1 objects/s recovering 2023-12-01T01:03:07.936 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:07.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:07 smithi093 ceph-mon[103327]: pgmap v257: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.9 KiB/s wr, 5 op/s; 5.0 KiB/s, 1 keys/s, 1 objects/s recovering 2023-12-01T01:03:08.374 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:08.549 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:08.661 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:08.882 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:09.545 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:09.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:09 smithi116 ceph-mon[103554]: pgmap v258: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 4.3 KiB/s, 1 keys/s, 0 objects/s recovering 2023-12-01T01:03:09.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:09 smithi093 ceph-mon[103327]: pgmap v258: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 4.3 KiB/s, 1 keys/s, 0 objects/s recovering 2023-12-01T01:03:10.036 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:09 smithi026 ceph-mon[98801]: pgmap v258: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.6 KiB/s wr, 6 op/s; 4.3 KiB/s, 1 keys/s, 0 objects/s recovering 2023-12-01T01:03:11.220 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.102+0000 7fe2e71a4700 1 -- 172.21.15.26:0/2935552361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2e0100690 msgr2=0x7fe2e010cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.102+0000 7fe2e71a4700 1 --2- 172.21.15.26:0/2935552361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2e0100690 0x7fe2e010cb30 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800b0a0 tx=0x7fe2d800b3b0 comp rx=0 tx=0).stop 2023-12-01T01:03:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.102+0000 7fe2e71a4700 1 -- 172.21.15.26:0/2935552361 shutdown_connections 2023-12-01T01:03:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.102+0000 7fe2e71a4700 1 --2- 172.21.15.26:0/2935552361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2e0100690 0x7fe2e010cb30 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.102+0000 7fe2e71a4700 1 --2- 172.21.15.26:0/2935552361 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2e0105d80 0x7fe2e0106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.102+0000 7fe2e71a4700 1 --2- 172.21.15.26:0/2935552361 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2e00ffcd0 0x7fe2e0100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.102+0000 7fe2e71a4700 1 -- 172.21.15.26:0/2935552361 >> 172.21.15.26:0/2935552361 conn(0x7fe2e0076d90 msgr2=0x7fe2e00771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.102+0000 7fe2e71a4700 1 -- 172.21.15.26:0/2935552361 shutdown_connections 2023-12-01T01:03:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.103+0000 7fe2e71a4700 1 -- 172.21.15.26:0/2935552361 wait complete. 2023-12-01T01:03:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.103+0000 7fe2e71a4700 1 Processor -- start 2023-12-01T01:03:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.103+0000 7fe2e71a4700 1 -- start start 2023-12-01T01:03:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.103+0000 7fe2e71a4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2e00ffcd0 0x7fe2e0196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.103+0000 7fe2e71a4700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2e0100690 0x7fe2e0197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.103+0000 7fe2e71a4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2e0105d80 0x7fe2e019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:11.221 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.103+0000 7fe2e71a4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e019bf80 con 0x7fe2e0105d80 2023-12-01T01:03:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.103+0000 7fe2e71a4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e019c0f0 con 0x7fe2e00ffcd0 2023-12-01T01:03:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.103+0000 7fe2e71a4700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e019c2b0 con 0x7fe2e0100690 2023-12-01T01:03:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.104+0000 7fe2e5741700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2e0105d80 0x7fe2e019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.104+0000 7fe2e5741700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2e0105d80 0x7fe2e019b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53802/0 (socket says 172.21.15.26:53802) 2023-12-01T01:03:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.104+0000 7fe2e5741700 1 -- 172.21.15.26:0/2238933922 learned_addr learned my addr 172.21.15.26:0/2238933922 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.104+0000 7fe2dffff700 1 --2- 172.21.15.26:0/2238933922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2e0100690 0x7fe2e0197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.104+0000 7fe2e4f40700 1 --2- 172.21.15.26:0/2238933922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2e00ffcd0 0x7fe2e0196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.104+0000 7fe2e5741700 1 -- 172.21.15.26:0/2238933922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2e0100690 msgr2=0x7fe2e0197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.104+0000 7fe2e5741700 1 --2- 172.21.15.26:0/2238933922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe2e0100690 0x7fe2e0197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.104+0000 7fe2e5741700 1 -- 172.21.15.26:0/2238933922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2e00ffcd0 msgr2=0x7fe2e0196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.104+0000 7fe2e5741700 1 --2- 172.21.15.26:0/2238933922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe2e00ffcd0 0x7fe2e0196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.104+0000 7fe2e5741700 1 -- 172.21.15.26:0/2238933922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d8009d00 con 0x7fe2e0105d80 2023-12-01T01:03:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.104+0000 7fe2e5741700 1 --2- 172.21.15.26:0/2238933922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2e0105d80 0x7fe2e019b970 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800b830 tx=0x7fe2d8004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:11.222 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.104+0000 7fe2ddffb700 1 -- 172.21.15.26:0/2238933922 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d800e040 con 0x7fe2e0105d80 2023-12-01T01:03:11.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.104+0000 7fe2ddffb700 1 -- 172.21.15.26:0/2238933922 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe2d80077d0 con 0x7fe2e0105d80 2023-12-01T01:03:11.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.104+0000 7fe2ddffb700 1 -- 172.21.15.26:0/2238933922 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d8004850 con 0x7fe2e0105d80 2023-12-01T01:03:11.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.104+0000 7fe2e71a4700 1 -- 172.21.15.26:0/2238933922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e019c530 con 0x7fe2e0105d80 2023-12-01T01:03:11.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.105+0000 7fe2e71a4700 1 -- 172.21.15.26:0/2238933922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e01a3df0 con 0x7fe2e0105d80 2023-12-01T01:03:11.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.105+0000 7fe2e71a4700 1 -- 172.21.15.26:0/2238933922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe2e004ea90 con 0x7fe2e0105d80 2023-12-01T01:03:11.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.107+0000 7fe2ddffb700 1 -- 172.21.15.26:0/2238933922 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fe2d8003a00 con 0x7fe2e0105d80 2023-12-01T01:03:11.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.107+0000 7fe2ddffb700 1 --2- 172.21.15.26:0/2238933922 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe2d00a0630 0x7fe2d00a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:11.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.107+0000 7fe2e4f40700 1 --2- 172.21.15.26:0/2238933922 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe2d00a0630 0x7fe2d00a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:11.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.108+0000 7fe2ddffb700 1 -- 172.21.15.26:0/2238933922 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe2d80cda70 con 0x7fe2e0105d80 2023-12-01T01:03:11.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.108+0000 7fe2ddffb700 1 --2- 172.21.15.26:0/2238933922 >> [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820] conn(0x7fe2d00aa170 0x7fe2d00ac610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.108+0000 7fe2ddffb700 1 -- 172.21.15.26:0/2238933922 --> [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe2d00acce0 con 0x7fe2d00aa170 2023-12-01T01:03:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.108+0000 7fe2ddffb700 1 -- 172.21.15.26:0/2238933922 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe2d80cde80 con 0x7fe2e0105d80 2023-12-01T01:03:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.108+0000 7fe2e4f40700 1 --2- 172.21.15.26:0/2238933922 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe2d00a0630 0x7fe2d00a2af0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4005950 tx=0x7fe2d400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.108+0000 7fe2dffff700 1 --2- 172.21.15.26:0/2238933922 >> [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820] conn(0x7fe2d00aa170 0x7fe2d00ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.108+0000 7fe2dffff700 1 --2- 172.21.15.26:0/2238933922 >> [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820] conn(0x7fe2d00aa170 0x7fe2d00ac610 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.109+0000 7fe2ddffb700 1 -- 172.21.15.26:0/2238933922 <== osd.2 v2:172.21.15.116:6800/859484820 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe2d00acce0 con 0x7fe2d00aa170 2023-12-01T01:03:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.127+0000 7fe2e71a4700 1 -- 172.21.15.26:0/2238933922 --> [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe2e0110090 con 0x7fe2d00aa170 2023-12-01T01:03:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.127+0000 7fe2ddffb700 1 -- 172.21.15.26:0/2238933922 <== osd.2 v2:172.21.15.116:6800/859484820 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe2cc00bd30 con 0x7fe2d00aa170 2023-12-01T01:03:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.128+0000 7fe2e71a4700 1 -- 172.21.15.26:0/2238933922 >> [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820] conn(0x7fe2d00aa170 msgr2=0x7fe2d00ac610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.128+0000 7fe2e71a4700 1 --2- 172.21.15.26:0/2238933922 >> [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820] conn(0x7fe2d00aa170 0x7fe2d00ac610 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.128+0000 7fe2e71a4700 1 -- 172.21.15.26:0/2238933922 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe2d00a0630 msgr2=0x7fe2d00a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.128+0000 7fe2e71a4700 1 --2- 172.21.15.26:0/2238933922 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe2d00a0630 0x7fe2d00a2af0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4005950 tx=0x7fe2d400b410 comp rx=0 tx=0).stop 2023-12-01T01:03:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.128+0000 7fe2e71a4700 1 -- 172.21.15.26:0/2238933922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2e0105d80 msgr2=0x7fe2e019b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.128+0000 7fe2e71a4700 1 --2- 172.21.15.26:0/2238933922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2e0105d80 0x7fe2e019b970 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe2d800b830 tx=0x7fe2d8004d50 comp rx=0 tx=0).stop 2023-12-01T01:03:11.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.128+0000 7fe2e5741700 1 -- 172.21.15.26:0/2238933922 reap_dead start 2023-12-01T01:03:11.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.128+0000 7fe2e71a4700 1 -- 172.21.15.26:0/2238933922 shutdown_connections 2023-12-01T01:03:11.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.128+0000 7fe2e71a4700 1 -- 172.21.15.26:0/2238933922 >> 172.21.15.26:0/2238933922 conn(0x7fe2e0076d90 msgr2=0x7fe2e00fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:11.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.128+0000 7fe2e71a4700 1 -- 172.21.15.26:0/2238933922 shutdown_connections 2023-12-01T01:03:11.225 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:11.128+0000 7fe2e71a4700 1 -- 172.21.15.26:0/2238933922 wait complete. 2023-12-01T01:03:11.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:11 smithi093 ceph-mon[103327]: pgmap v259: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.5 KiB/s wr, 5 op/s; 3.9 KiB/s, 0 keys/s, 0 objects/s recovering 2023-12-01T01:03:11.972 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:11 smithi026 ceph-mon[98801]: pgmap v259: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.5 KiB/s wr, 5 op/s; 3.9 KiB/s, 0 keys/s, 0 objects/s recovering 2023-12-01T01:03:12.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:11 smithi116 ceph-mon[103554]: pgmap v259: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.5 KiB/s wr, 5 op/s; 3.9 KiB/s, 0 keys/s, 0 objects/s recovering 2023-12-01T01:03:12.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.345+0000 7f40be848700 1 -- 172.21.15.26:0/3371051932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b8106fa0 msgr2=0x7f40b8107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:12.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.345+0000 7f40be848700 1 --2- 172.21.15.26:0/3371051932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b8106fa0 0x7f40b8107380 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f40a80099c0 tx=0x7f40a8009cd0 comp rx=0 tx=0).stop 2023-12-01T01:03:12.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.346+0000 7f40be848700 1 -- 172.21.15.26:0/3371051932 shutdown_connections 2023-12-01T01:03:12.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.346+0000 7f40be848700 1 --2- 172.21.15.26:0/3371051932 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40b81019e0 0x7f40b810dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:12.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.346+0000 7f40be848700 1 --2- 172.21.15.26:0/3371051932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b8106fa0 0x7f40b8107380 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:12.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.346+0000 7f40be848700 1 --2- 172.21.15.26:0/3371051932 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40b8101020 0x7f40b81014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:12.564 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.346+0000 7f40be848700 1 -- 172.21.15.26:0/3371051932 >> 172.21.15.26:0/3371051932 conn(0x7f40b8078db0 msgr2=0x7f40b80791c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.346+0000 7f40be848700 1 -- 172.21.15.26:0/3371051932 shutdown_connections 2023-12-01T01:03:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.346+0000 7f40be848700 1 -- 172.21.15.26:0/3371051932 wait complete. 2023-12-01T01:03:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.346+0000 7f40be848700 1 Processor -- start 2023-12-01T01:03:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.346+0000 7f40be848700 1 -- start start 2023-12-01T01:03:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40be848700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40b8101020 0x7f40b8196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40be848700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40b81019e0 0x7f40b81974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40be848700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b8106fa0 0x7f40b819b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40be848700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b819bf20 con 0x7f40b8106fa0 2023-12-01T01:03:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40be848700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b819c090 con 0x7f40b81019e0 2023-12-01T01:03:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40be848700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b819c250 con 0x7f40b8101020 2023-12-01T01:03:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40bcde5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b8106fa0 0x7f40b819b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40bcde5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b8106fa0 0x7f40b819b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53818/0 (socket says 172.21.15.26:53818) 2023-12-01T01:03:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40bcde5700 1 -- 172.21.15.26:0/4039351057 learned_addr learned my addr 172.21.15.26:0/4039351057 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40b77fe700 1 --2- 172.21.15.26:0/4039351057 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40b81019e0 0x7f40b81974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:12.565 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40b7fff700 1 --2- 172.21.15.26:0/4039351057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40b8101020 0x7f40b8196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:12.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40bcde5700 1 -- 172.21.15.26:0/4039351057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40b8101020 msgr2=0x7f40b8196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:12.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40bcde5700 1 --2- 172.21.15.26:0/4039351057 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40b8101020 0x7f40b8196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:12.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40bcde5700 1 -- 172.21.15.26:0/4039351057 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40b81019e0 msgr2=0x7f40b81974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:12.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40bcde5700 1 --2- 172.21.15.26:0/4039351057 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40b81019e0 0x7f40b81974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:12.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40bcde5700 1 -- 172.21.15.26:0/4039351057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a80095f0 con 0x7f40b8106fa0 2023-12-01T01:03:12.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.347+0000 7f40b77fe700 1 --2- 172.21.15.26:0/4039351057 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40b81019e0 0x7f40b81974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:03:12.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.348+0000 7f40bcde5700 1 --2- 172.21.15.26:0/4039351057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b8106fa0 0x7f40b819b910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f40b0007ee0 tx=0x7f40b000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:12.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.348+0000 7f40b57fa700 1 -- 172.21.15.26:0/4039351057 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b0017070 con 0x7f40b8106fa0 2023-12-01T01:03:12.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.348+0000 7f40b57fa700 1 -- 172.21.15.26:0/4039351057 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f40b000f040 con 0x7f40b8106fa0 2023-12-01T01:03:12.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.348+0000 7f40be848700 1 -- 172.21.15.26:0/4039351057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b819c530 con 0x7f40b8106fa0 2023-12-01T01:03:12.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.348+0000 7f40b57fa700 1 -- 172.21.15.26:0/4039351057 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b0005610 con 0x7f40b8106fa0 2023-12-01T01:03:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.348+0000 7f40be848700 1 -- 172.21.15.26:0/4039351057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b81a3d90 con 0x7f40b8106fa0 2023-12-01T01:03:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.349+0000 7f40be848700 1 -- 172.21.15.26:0/4039351057 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f40b8111120 con 0x7f40b8106fa0 2023-12-01T01:03:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.350+0000 7f40b57fa700 1 -- 172.21.15.26:0/4039351057 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f40b0005770 con 0x7f40b8106fa0 2023-12-01T01:03:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.351+0000 7f40b57fa700 1 --2- 172.21.15.26:0/4039351057 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f40a00a05b0 0x7f40a00a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.351+0000 7f40b7fff700 1 --2- 172.21.15.26:0/4039351057 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f40a00a05b0 0x7f40a00a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.351+0000 7f40b57fa700 1 -- 172.21.15.26:0/4039351057 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f40b00cb8c0 con 0x7f40b8106fa0 2023-12-01T01:03:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.351+0000 7f40b57fa700 1 --2- 172.21.15.26:0/4039351057 >> [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980] conn(0x7f40a00aa0f0 0x7f40a00ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.351+0000 7f40b57fa700 1 -- 172.21.15.26:0/4039351057 --> [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40a00acc60 con 0x7f40a00aa0f0 2023-12-01T01:03:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.351+0000 7f40b57fa700 1 -- 172.21.15.26:0/4039351057 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40b00cbc30 con 0x7f40b8106fa0 2023-12-01T01:03:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.351+0000 7f40b7fff700 1 --2- 172.21.15.26:0/4039351057 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f40a00a05b0 0x7f40a00a2a70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009990 tx=0x7f40a8005bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.351+0000 7f40b77fe700 1 --2- 172.21.15.26:0/4039351057 >> [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980] conn(0x7f40a00aa0f0 0x7f40a00ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.352+0000 7f40b77fe700 1 --2- 172.21.15.26:0/4039351057 >> [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980] conn(0x7f40a00aa0f0 0x7f40a00ac590 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.353+0000 7f40b57fa700 1 -- 172.21.15.26:0/4039351057 <== osd.8 v2:172.21.15.116:6816/3617757980 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f40a00acc60 con 0x7f40a00aa0f0 2023-12-01T01:03:12.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.369+0000 7f40be848700 1 -- 172.21.15.26:0/4039351057 --> [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f40b804ea90 con 0x7f40a00aa0f0 2023-12-01T01:03:12.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.369+0000 7f40b57fa700 1 -- 172.21.15.26:0/4039351057 <== osd.8 v2:172.21.15.116:6816/3617757980 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f40b804ea90 con 0x7f40a00aa0f0 2023-12-01T01:03:12.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.369+0000 7f40be848700 1 -- 172.21.15.26:0/4039351057 >> [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980] conn(0x7f40a00aa0f0 msgr2=0x7f40a00ac590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:12.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.369+0000 7f40be848700 1 --2- 172.21.15.26:0/4039351057 >> [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980] conn(0x7f40a00aa0f0 0x7f40a00ac590 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:12.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.369+0000 7f40be848700 1 -- 172.21.15.26:0/4039351057 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f40a00a05b0 msgr2=0x7f40a00a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:12.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.370+0000 7f40be848700 1 --2- 172.21.15.26:0/4039351057 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f40a00a05b0 0x7f40a00a2a70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009990 tx=0x7f40a8005bc0 comp rx=0 tx=0).stop 2023-12-01T01:03:12.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.370+0000 7f40be848700 1 -- 172.21.15.26:0/4039351057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b8106fa0 msgr2=0x7f40b819b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:12.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.370+0000 7f40be848700 1 --2- 172.21.15.26:0/4039351057 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b8106fa0 0x7f40b819b910 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f40b0007ee0 tx=0x7f40b000d3b0 comp rx=0 tx=0).stop 2023-12-01T01:03:12.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.370+0000 7f40bcde5700 1 -- 172.21.15.26:0/4039351057 reap_dead start 2023-12-01T01:03:12.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.370+0000 7f40be848700 1 -- 172.21.15.26:0/4039351057 shutdown_connections 2023-12-01T01:03:12.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.370+0000 7f40be848700 1 -- 172.21.15.26:0/4039351057 >> 172.21.15.26:0/4039351057 conn(0x7f40b8078db0 msgr2=0x7f40b80ffb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:12.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.370+0000 7f40be848700 1 -- 172.21.15.26:0/4039351057 shutdown_connections 2023-12-01T01:03:12.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:12.370+0000 7f40be848700 1 -- 172.21.15.26:0/4039351057 wait complete. 2023-12-01T01:03:13.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.541+0000 7f68e8f70700 1 -- 172.21.15.26:0/1714471025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68e41018f0 msgr2=0x7f68e4101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:13.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.541+0000 7f68e8f70700 1 --2- 172.21.15.26:0/1714471025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68e41018f0 0x7f68e4101d70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f68d80099c0 tx=0x7f68d8009cd0 comp rx=0 tx=0).stop 2023-12-01T01:03:13.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.541+0000 7f68e8f70700 1 -- 172.21.15.26:0/1714471025 shutdown_connections 2023-12-01T01:03:13.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.541+0000 7f68e8f70700 1 --2- 172.21.15.26:0/1714471025 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f68e41022b0 0x7f68e410cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:13.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.541+0000 7f68e8f70700 1 --2- 172.21.15.26:0/1714471025 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68e4100010 0x7f68e41003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.541+0000 7f68e8f70700 1 --2- 172.21.15.26:0/1714471025 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68e41018f0 0x7f68e4101d70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.541+0000 7f68e8f70700 1 -- 172.21.15.26:0/1714471025 >> 172.21.15.26:0/1714471025 conn(0x7f68e4076d80 msgr2=0x7f68e4077190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.541+0000 7f68e8f70700 1 -- 172.21.15.26:0/1714471025 shutdown_connections 2023-12-01T01:03:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.541+0000 7f68e8f70700 1 -- 172.21.15.26:0/1714471025 wait complete. 2023-12-01T01:03:13.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.542+0000 7f68e8f70700 1 Processor -- start 2023-12-01T01:03:13.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.542+0000 7f68e8f70700 1 -- start start 2023-12-01T01:03:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.542+0000 7f68e8f70700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f68e4100010 0x7f68e4195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.542+0000 7f68e8f70700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68e41018f0 0x7f68e41961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.542+0000 7f68e8f70700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68e41022b0 0x7f68e419acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.542+0000 7f68e8f70700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e419b1f0 con 0x7f68e41022b0 2023-12-01T01:03:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.542+0000 7f68e8f70700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e419b360 con 0x7f68e41018f0 2023-12-01T01:03:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.542+0000 7f68e8f70700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68e419b520 con 0x7f68e4100010 2023-12-01T01:03:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.543+0000 7f68e2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68e41022b0 0x7f68e419acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.543+0000 7f68e2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68e41022b0 0x7f68e419acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53834/0 (socket says 172.21.15.26:53834) 2023-12-01T01:03:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.543+0000 7f68e2d9d700 1 -- 172.21.15.26:0/3614474069 learned_addr learned my addr 172.21.15.26:0/3614474069 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.543+0000 7f68e1d9b700 1 --2- 172.21.15.26:0/3614474069 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68e41018f0 0x7f68e41961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.543+0000 7f68e259c700 1 --2- 172.21.15.26:0/3614474069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f68e4100010 0x7f68e4195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.543+0000 7f68e2d9d700 1 -- 172.21.15.26:0/3614474069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f68e4100010 msgr2=0x7f68e4195c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.543+0000 7f68e2d9d700 1 --2- 172.21.15.26:0/3614474069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f68e4100010 0x7f68e4195c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.543+0000 7f68e2d9d700 1 -- 172.21.15.26:0/3614474069 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68e41018f0 msgr2=0x7f68e41961a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:13.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.543+0000 7f68e2d9d700 1 --2- 172.21.15.26:0/3614474069 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68e41018f0 0x7f68e41961a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.543+0000 7f68e2d9d700 1 -- 172.21.15.26:0/3614474069 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d80095f0 con 0x7f68e41022b0 2023-12-01T01:03:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.543+0000 7f68e1d9b700 1 --2- 172.21.15.26:0/3614474069 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f68e41018f0 0x7f68e41961a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:03:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.543+0000 7f68e2d9d700 1 --2- 172.21.15.26:0/3614474069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68e41022b0 0x7f68e419acb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f68dc007ee0 tx=0x7f68dc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.544+0000 7f68d37fe700 1 -- 172.21.15.26:0/3614474069 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc017070 con 0x7f68e41022b0 2023-12-01T01:03:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.544+0000 7f68e8f70700 1 -- 172.21.15.26:0/3614474069 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68e419b800 con 0x7f68e41022b0 2023-12-01T01:03:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.544+0000 7f68d37fe700 1 -- 172.21.15.26:0/3614474069 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f68dc00f040 con 0x7f68e41022b0 2023-12-01T01:03:13.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.544+0000 7f68d37fe700 1 -- 172.21.15.26:0/3614474069 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68dc005610 con 0x7f68e41022b0 2023-12-01T01:03:13.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.544+0000 7f68e8f70700 1 -- 172.21.15.26:0/3614474069 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68e419bcd0 con 0x7f68e41022b0 2023-12-01T01:03:13.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.545+0000 7f68e8f70700 1 -- 172.21.15.26:0/3614474069 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68e404ea90 con 0x7f68e41022b0 2023-12-01T01:03:13.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.546+0000 7f68d37fe700 1 -- 172.21.15.26:0/3614474069 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f68dc005770 con 0x7f68e41022b0 2023-12-01T01:03:13.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.547+0000 7f68d37fe700 1 --2- 172.21.15.26:0/3614474069 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f68cc0a05b0 0x7f68cc0a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.548+0000 7f68e259c700 1 --2- 172.21.15.26:0/3614474069 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f68cc0a05b0 0x7f68cc0a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.548+0000 7f68d37fe700 1 -- 172.21.15.26:0/3614474069 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f68dc0cb860 con 0x7f68e41022b0 2023-12-01T01:03:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.548+0000 7f68d37fe700 1 --2- 172.21.15.26:0/3614474069 >> [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137] conn(0x7f68cc0aa0f0 0x7f68cc0ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.548+0000 7f68d37fe700 1 -- 172.21.15.26:0/3614474069 --> [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68cc0acc60 con 0x7f68cc0aa0f0 2023-12-01T01:03:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.548+0000 7f68d37fe700 1 -- 172.21.15.26:0/3614474069 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68dc0cbc70 con 0x7f68e41022b0 2023-12-01T01:03:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.548+0000 7f68e1d9b700 1 --2- 172.21.15.26:0/3614474069 >> [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137] conn(0x7f68cc0aa0f0 0x7f68cc0ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:13.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.548+0000 7f68e259c700 1 --2- 172.21.15.26:0/3614474069 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f68cc0a05b0 0x7f68cc0a2a70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f68d4007be0 tx=0x7f68d40073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.548+0000 7f68e1d9b700 1 --2- 172.21.15.26:0/3614474069 >> [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137] conn(0x7f68cc0aa0f0 0x7f68cc0ac590 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:13.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.549+0000 7f68d37fe700 1 -- 172.21.15.26:0/3614474069 <== osd.3 v2:172.21.15.26:6810/63607137 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f68cc0acc60 con 0x7f68cc0aa0f0 2023-12-01T01:03:13.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.575+0000 7f68e8f70700 1 -- 172.21.15.26:0/3614474069 --> [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f68e4110130 con 0x7f68cc0aa0f0 2023-12-01T01:03:13.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.576+0000 7f68d37fe700 1 -- 172.21.15.26:0/3614474069 <== osd.3 v2:172.21.15.26:6810/63607137 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f68d801e040 con 0x7f68cc0aa0f0 2023-12-01T01:03:13.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.576+0000 7f68e8f70700 1 -- 172.21.15.26:0/3614474069 >> [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137] conn(0x7f68cc0aa0f0 msgr2=0x7f68cc0ac590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.576+0000 7f68e8f70700 1 --2- 172.21.15.26:0/3614474069 >> [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137] conn(0x7f68cc0aa0f0 0x7f68cc0ac590 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.576+0000 7f68e8f70700 1 -- 172.21.15.26:0/3614474069 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f68cc0a05b0 msgr2=0x7f68cc0a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.576+0000 7f68e8f70700 1 --2- 172.21.15.26:0/3614474069 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f68cc0a05b0 0x7f68cc0a2a70 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f68d4007be0 tx=0x7f68d40073d0 comp rx=0 tx=0).stop 2023-12-01T01:03:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.576+0000 7f68e8f70700 1 -- 172.21.15.26:0/3614474069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68e41022b0 msgr2=0x7f68e419acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.576+0000 7f68e8f70700 1 --2- 172.21.15.26:0/3614474069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68e41022b0 0x7f68e419acb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f68dc007ee0 tx=0x7f68dc00d3b0 comp rx=0 tx=0).stop 2023-12-01T01:03:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.576+0000 7f68e2d9d700 1 -- 172.21.15.26:0/3614474069 reap_dead start 2023-12-01T01:03:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.576+0000 7f68e8f70700 1 -- 172.21.15.26:0/3614474069 shutdown_connections 2023-12-01T01:03:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.576+0000 7f68e8f70700 1 -- 172.21.15.26:0/3614474069 >> 172.21.15.26:0/3614474069 conn(0x7f68e4076d80 msgr2=0x7f68e40fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.576+0000 7f68e8f70700 1 -- 172.21.15.26:0/3614474069 shutdown_connections 2023-12-01T01:03:13.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.576+0000 7f68e8f70700 1 -- 172.21.15.26:0/3614474069 wait complete. 2023-12-01T01:03:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.792+0000 7fcf60185700 1 -- 172.21.15.26:0/980447681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf58100690 msgr2=0x7fcf5810cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:13.793 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.792+0000 7fcf60185700 1 --2- 172.21.15.26:0/980447681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf58100690 0x7fcf5810cb30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcf5000b0a0 tx=0x7fcf5000b3b0 comp rx=0 tx=0).stop 2023-12-01T01:03:13.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.792+0000 7fcf60185700 1 -- 172.21.15.26:0/980447681 shutdown_connections 2023-12-01T01:03:13.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.792+0000 7fcf60185700 1 --2- 172.21.15.26:0/980447681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf58100690 0x7fcf5810cb30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:13.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.792+0000 7fcf60185700 1 --2- 172.21.15.26:0/980447681 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf58105d80 0x7fcf58106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:13.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.792+0000 7fcf60185700 1 --2- 172.21.15.26:0/980447681 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf580ffcd0 0x7fcf58100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:13.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.792+0000 7fcf60185700 1 -- 172.21.15.26:0/980447681 >> 172.21.15.26:0/980447681 conn(0x7fcf58076d90 msgr2=0x7fcf580771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:13.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.792+0000 7fcf60185700 1 -- 172.21.15.26:0/980447681 shutdown_connections 2023-12-01T01:03:13.794 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.792+0000 7fcf60185700 1 -- 172.21.15.26:0/980447681 wait complete. 2023-12-01T01:03:13.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.793+0000 7fcf60185700 1 Processor -- start 2023-12-01T01:03:13.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.793+0000 7fcf60185700 1 -- start start 2023-12-01T01:03:13.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.793+0000 7fcf60185700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf580ffcd0 0x7fcf58197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:13.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.793+0000 7fcf60185700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf58100690 0x7fcf58198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:13.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.793+0000 7fcf60185700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf58105d80 0x7fcf581a2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:13.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.793+0000 7fcf60185700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf58198c70 con 0x7fcf58100690 2023-12-01T01:03:13.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.793+0000 7fcf60185700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf581a33e0 con 0x7fcf58105d80 2023-12-01T01:03:13.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.793+0000 7fcf60185700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf581a3550 con 0x7fcf580ffcd0 2023-12-01T01:03:13.796 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.793+0000 7fcf5d720700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf58100690 0x7fcf58198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.794+0000 7fcf5d720700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf58100690 0x7fcf58198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53846/0 (socket says 172.21.15.26:53846) 2023-12-01T01:03:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.794+0000 7fcf5d720700 1 -- 172.21.15.26:0/2937764686 learned_addr learned my addr 172.21.15.26:0/2937764686 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.794+0000 7fcf5e722700 1 --2- 172.21.15.26:0/2937764686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf58105d80 0x7fcf581a2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.794+0000 7fcf5df21700 1 --2- 172.21.15.26:0/2937764686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf580ffcd0 0x7fcf58197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.794+0000 7fcf5d720700 1 -- 172.21.15.26:0/2937764686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf580ffcd0 msgr2=0x7fcf58197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.794+0000 7fcf5d720700 1 --2- 172.21.15.26:0/2937764686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf580ffcd0 0x7fcf58197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.794+0000 7fcf5d720700 1 -- 172.21.15.26:0/2937764686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf58105d80 msgr2=0x7fcf581a2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.794+0000 7fcf5d720700 1 --2- 172.21.15.26:0/2937764686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf58105d80 0x7fcf581a2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.794+0000 7fcf5d720700 1 -- 172.21.15.26:0/2937764686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf50009d00 con 0x7fcf58100690 2023-12-01T01:03:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.794+0000 7fcf5d720700 1 --2- 172.21.15.26:0/2937764686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf58100690 0x7fcf58198360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800d950 tx=0x7fcf4800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.794+0000 7fcf4effd700 1 -- 172.21.15.26:0/2937764686 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800f890 con 0x7fcf58100690 2023-12-01T01:03:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.794+0000 7fcf60185700 1 -- 172.21.15.26:0/2937764686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf581a3830 con 0x7fcf58100690 2023-12-01T01:03:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.794+0000 7fcf4effd700 1 -- 172.21.15.26:0/2937764686 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcf48010460 con 0x7fcf58100690 2023-12-01T01:03:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.794+0000 7fcf4effd700 1 -- 172.21.15.26:0/2937764686 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4800e610 con 0x7fcf58100690 2023-12-01T01:03:13.797 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.794+0000 7fcf60185700 1 -- 172.21.15.26:0/2937764686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf581a3d30 con 0x7fcf58100690 2023-12-01T01:03:13.798 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.795+0000 7fcf60185700 1 -- 172.21.15.26:0/2937764686 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf5804ea90 con 0x7fcf58100690 2023-12-01T01:03:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.797+0000 7fcf4effd700 1 -- 172.21.15.26:0/2937764686 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fcf48010960 con 0x7fcf58100690 2023-12-01T01:03:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.797+0000 7fcf4effd700 1 --2- 172.21.15.26:0/2937764686 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcf440a05b0 0x7fcf440a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.797+0000 7fcf5df21700 1 --2- 172.21.15.26:0/2937764686 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcf440a05b0 0x7fcf440a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.797+0000 7fcf4effd700 1 -- 172.21.15.26:0/2937764686 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fcf480cbde0 con 0x7fcf58100690 2023-12-01T01:03:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.797+0000 7fcf4effd700 1 --2- 172.21.15.26:0/2937764686 >> [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148] conn(0x7fcf440aa0f0 0x7fcf440ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.797+0000 7fcf4effd700 1 -- 172.21.15.26:0/2937764686 --> [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf440acc60 con 0x7fcf440aa0f0 2023-12-01T01:03:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.797+0000 7fcf4effd700 1 -- 172.21.15.26:0/2937764686 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf480cc1f0 con 0x7fcf58100690 2023-12-01T01:03:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.798+0000 7fcf5e722700 1 --2- 172.21.15.26:0/2937764686 >> [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148] conn(0x7fcf440aa0f0 0x7fcf440ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.798+0000 7fcf5df21700 1 --2- 172.21.15.26:0/2937764686 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcf440a05b0 0x7fcf440a2a70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcf54005950 tx=0x7fcf5400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.798+0000 7fcf5e722700 1 --2- 172.21.15.26:0/2937764686 >> [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148] conn(0x7fcf440aa0f0 0x7fcf440ac590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:13.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.799+0000 7fcf4effd700 1 -- 172.21.15.26:0/2937764686 <== osd.0 v2:172.21.15.26:6802/3366878148 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fcf440acc60 con 0x7fcf440aa0f0 2023-12-01T01:03:13.815 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.814+0000 7fcf60185700 1 -- 172.21.15.26:0/2937764686 --> [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcf58110090 con 0x7fcf440aa0f0 2023-12-01T01:03:13.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.815+0000 7fcf4effd700 1 -- 172.21.15.26:0/2937764686 <== osd.0 v2:172.21.15.26:6802/3366878148 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcf50009b80 con 0x7fcf440aa0f0 2023-12-01T01:03:13.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.815+0000 7fcf60185700 1 -- 172.21.15.26:0/2937764686 >> [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148] conn(0x7fcf440aa0f0 msgr2=0x7fcf440ac590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:13.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.815+0000 7fcf60185700 1 --2- 172.21.15.26:0/2937764686 >> [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148] conn(0x7fcf440aa0f0 0x7fcf440ac590 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:13.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.815+0000 7fcf60185700 1 -- 172.21.15.26:0/2937764686 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcf440a05b0 msgr2=0x7fcf440a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:13.816 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.815+0000 7fcf60185700 1 --2- 172.21.15.26:0/2937764686 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcf440a05b0 0x7fcf440a2a70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcf54005950 tx=0x7fcf5400b410 comp rx=0 tx=0).stop 2023-12-01T01:03:13.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.815+0000 7fcf60185700 1 -- 172.21.15.26:0/2937764686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf58100690 msgr2=0x7fcf58198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:13.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.815+0000 7fcf60185700 1 --2- 172.21.15.26:0/2937764686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf58100690 0x7fcf58198360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcf4800d950 tx=0x7fcf4800dc60 comp rx=0 tx=0).stop 2023-12-01T01:03:13.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.815+0000 7fcf5e722700 1 -- 172.21.15.26:0/2937764686 reap_dead start 2023-12-01T01:03:13.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.815+0000 7fcf60185700 1 -- 172.21.15.26:0/2937764686 shutdown_connections 2023-12-01T01:03:13.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.815+0000 7fcf60185700 1 -- 172.21.15.26:0/2937764686 >> 172.21.15.26:0/2937764686 conn(0x7fcf58076d90 msgr2=0x7fcf58103930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:13.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.815+0000 7fcf60185700 1 -- 172.21.15.26:0/2937764686 shutdown_connections 2023-12-01T01:03:13.817 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:13.816+0000 7fcf60185700 1 -- 172.21.15.26:0/2937764686 wait complete. 2023-12-01T01:03:13.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:13 smithi093 ceph-mon[103327]: pgmap v260: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 5 op/s; 3.3 KiB/s, 0 keys/s, 0 objects/s recovering 2023-12-01T01:03:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:13 smithi026 ceph-mon[98801]: pgmap v260: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 5 op/s; 3.3 KiB/s, 0 keys/s, 0 objects/s recovering 2023-12-01T01:03:14.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:13 smithi116 ceph-mon[103554]: pgmap v260: 97 pgs: 97 active+clean; 633 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 1.2 KiB/s wr, 5 op/s; 3.3 KiB/s, 0 keys/s, 0 objects/s recovering 2023-12-01T01:03:14.213 INFO:teuthology.orchestra.run.smithi026.stdout:107374182448 2023-12-01T01:03:14.214 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-01T01:03:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.265+0000 7fb083a2d700 1 -- 172.21.15.26:0/509060558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c0ffcd0 msgr2=0x7fb07c100150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.265+0000 7fb083a2d700 1 --2- 172.21.15.26:0/509060558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c0ffcd0 0x7fb07c100150 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009990 tx=0x7fb06c009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.265+0000 7fb083a2d700 1 -- 172.21.15.26:0/509060558 shutdown_connections 2023-12-01T01:03:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.265+0000 7fb083a2d700 1 --2- 172.21.15.26:0/509060558 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb07c100690 0x7fb07c10cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.265+0000 7fb083a2d700 1 --2- 172.21.15.26:0/509060558 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb07c105d80 0x7fb07c106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.265+0000 7fb083a2d700 1 --2- 172.21.15.26:0/509060558 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c0ffcd0 0x7fb07c100150 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.265+0000 7fb083a2d700 1 -- 172.21.15.26:0/509060558 >> 172.21.15.26:0/509060558 conn(0x7fb07c076d90 msgr2=0x7fb07c0771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.265+0000 7fb083a2d700 1 -- 172.21.15.26:0/509060558 shutdown_connections 2023-12-01T01:03:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.265+0000 7fb083a2d700 1 -- 172.21.15.26:0/509060558 wait complete. 2023-12-01T01:03:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.266+0000 7fb083a2d700 1 Processor -- start 2023-12-01T01:03:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.266+0000 7fb083a2d700 1 -- start start 2023-12-01T01:03:14.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.266+0000 7fb083a2d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb07c0ffcd0 0x7fb07c10d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.266+0000 7fb083a2d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c100690 0x7fb07c10da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.266+0000 7fb083a2d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb07c105d80 0x7fb07c10df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.266+0000 7fb083a2d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c1a5370 con 0x7fb07c100690 2023-12-01T01:03:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.266+0000 7fb083a2d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c1a54e0 con 0x7fb07c0ffcd0 2023-12-01T01:03:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.266+0000 7fb083a2d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c1a56a0 con 0x7fb07c105d80 2023-12-01T01:03:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.266+0000 7fb080fc8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c100690 0x7fb07c10da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.266+0000 7fb080fc8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c100690 0x7fb07c10da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53862/0 (socket says 172.21.15.26:53862) 2023-12-01T01:03:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.266+0000 7fb080fc8700 1 -- 172.21.15.26:0/833911233 learned_addr learned my addr 172.21.15.26:0/833911233 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.266+0000 7fb0817c9700 1 --2- 172.21.15.26:0/833911233 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb07c0ffcd0 0x7fb07c10d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.266+0000 7fb081fca700 1 --2- 172.21.15.26:0/833911233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb07c105d80 0x7fb07c10df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.267+0000 7fb080fc8700 1 -- 172.21.15.26:0/833911233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb07c105d80 msgr2=0x7fb07c10df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.267+0000 7fb080fc8700 1 --2- 172.21.15.26:0/833911233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb07c105d80 0x7fb07c10df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.267+0000 7fb080fc8700 1 -- 172.21.15.26:0/833911233 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb07c0ffcd0 msgr2=0x7fb07c10d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.267+0000 7fb080fc8700 1 --2- 172.21.15.26:0/833911233 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb07c0ffcd0 0x7fb07c10d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:14.378 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.267+0000 7fb080fc8700 1 -- 172.21.15.26:0/833911233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0095f0 con 0x7fb07c100690 2023-12-01T01:03:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.267+0000 7fb080fc8700 1 --2- 172.21.15.26:0/833911233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c100690 0x7fb07c10da00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb06c000c00 tx=0x7fb06c00f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.267+0000 7fb0727fc700 1 -- 172.21.15.26:0/833911233 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c01d070 con 0x7fb07c100690 2023-12-01T01:03:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.267+0000 7fb083a2d700 1 -- 172.21.15.26:0/833911233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c1a5920 con 0x7fb07c100690 2023-12-01T01:03:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.267+0000 7fb0727fc700 1 -- 172.21.15.26:0/833911233 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb06c003680 con 0x7fb07c100690 2023-12-01T01:03:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.267+0000 7fb0727fc700 1 -- 172.21.15.26:0/833911233 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c0173f0 con 0x7fb07c100690 2023-12-01T01:03:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.267+0000 7fb083a2d700 1 -- 172.21.15.26:0/833911233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c1a5dc0 con 0x7fb07c100690 2023-12-01T01:03:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.268+0000 7fb083a2d700 1 -- 172.21.15.26:0/833911233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb07c04ea90 con 0x7fb07c100690 2023-12-01T01:03:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.269+0000 7fb0727fc700 1 -- 172.21.15.26:0/833911233 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fb06c022470 con 0x7fb07c100690 2023-12-01T01:03:14.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.270+0000 7fb0727fc700 1 --2- 172.21.15.26:0/833911233 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb0680a05b0 0x7fb0680a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:14.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.270+0000 7fb0817c9700 1 --2- 172.21.15.26:0/833911233 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb0680a05b0 0x7fb0680a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:14.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.270+0000 7fb0727fc700 1 -- 172.21.15.26:0/833911233 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb06c0ccfe0 con 0x7fb07c100690 2023-12-01T01:03:14.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.270+0000 7fb0727fc700 1 --2- 172.21.15.26:0/833911233 >> [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702] conn(0x7fb0680aa0f0 0x7fb0680ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:14.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.270+0000 7fb0727fc700 1 -- 172.21.15.26:0/833911233 --> [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0680acc60 con 0x7fb0680aa0f0 2023-12-01T01:03:14.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.270+0000 7fb0727fc700 1 -- 172.21.15.26:0/833911233 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb06c0cd480 con 0x7fb07c100690 2023-12-01T01:03:14.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.270+0000 7fb0817c9700 1 --2- 172.21.15.26:0/833911233 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb0680a05b0 0x7fb0680a2a70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb078005950 tx=0x7fb07800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:14.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.270+0000 7fb081fca700 1 --2- 172.21.15.26:0/833911233 >> [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702] conn(0x7fb0680aa0f0 0x7fb0680ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:14.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.271+0000 7fb081fca700 1 --2- 172.21.15.26:0/833911233 >> [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702] conn(0x7fb0680aa0f0 0x7fb0680ac590 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:14.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.272+0000 7fb0727fc700 1 -- 172.21.15.26:0/833911233 <== osd.7 v2:172.21.15.93:6816/671599702 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb0680acc60 con 0x7fb0680aa0f0 2023-12-01T01:03:14.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.288+0000 7fb083a2d700 1 -- 172.21.15.26:0/833911233 --> [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb07c111130 con 0x7fb0680aa0f0 2023-12-01T01:03:14.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.288+0000 7fb0727fc700 1 -- 172.21.15.26:0/833911233 <== osd.7 v2:172.21.15.93:6816/671599702 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb0740098c0 con 0x7fb0680aa0f0 2023-12-01T01:03:14.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.289+0000 7fb083a2d700 1 -- 172.21.15.26:0/833911233 >> [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702] conn(0x7fb0680aa0f0 msgr2=0x7fb0680ac590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:14.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.289+0000 7fb083a2d700 1 --2- 172.21.15.26:0/833911233 >> [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702] conn(0x7fb0680aa0f0 0x7fb0680ac590 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:14.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.289+0000 7fb083a2d700 1 -- 172.21.15.26:0/833911233 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb0680a05b0 msgr2=0x7fb0680a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:14.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.289+0000 7fb083a2d700 1 --2- 172.21.15.26:0/833911233 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb0680a05b0 0x7fb0680a2a70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb078005950 tx=0x7fb07800b410 comp rx=0 tx=0).stop 2023-12-01T01:03:14.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.289+0000 7fb083a2d700 1 -- 172.21.15.26:0/833911233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c100690 msgr2=0x7fb07c10da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:14.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.289+0000 7fb083a2d700 1 --2- 172.21.15.26:0/833911233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c100690 0x7fb07c10da00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb06c000c00 tx=0x7fb06c00f710 comp rx=0 tx=0).stop 2023-12-01T01:03:14.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.289+0000 7fb081fca700 1 -- 172.21.15.26:0/833911233 reap_dead start 2023-12-01T01:03:14.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.289+0000 7fb083a2d700 1 -- 172.21.15.26:0/833911233 shutdown_connections 2023-12-01T01:03:14.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.289+0000 7fb083a2d700 1 -- 172.21.15.26:0/833911233 >> 172.21.15.26:0/833911233 conn(0x7fb07c076d90 msgr2=0x7fb07c0fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:14.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.289+0000 7fb083a2d700 1 -- 172.21.15.26:0/833911233 shutdown_connections 2023-12-01T01:03:14.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.289+0000 7fb083a2d700 1 -- 172.21.15.26:0/833911233 wait complete. 2023-12-01T01:03:14.458 INFO:teuthology.orchestra.run.smithi026.stdout:244813135900 2023-12-01T01:03:14.458 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.8 2023-12-01T01:03:15.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.777+0000 7f47e91ab700 1 -- 172.21.15.26:0/1576112610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e4101050 msgr2=0x7f47e4101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.777+0000 7f47e91ab700 1 --2- 172.21.15.26:0/1576112610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e4101050 0x7f47e4101430 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009990 tx=0x7f47d4009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.777+0000 7f47e91ab700 1 -- 172.21.15.26:0/1576112610 shutdown_connections 2023-12-01T01:03:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.777+0000 7f47e91ab700 1 --2- 172.21.15.26:0/1576112610 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47e4106130 0x7f47e410dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.777+0000 7f47e91ab700 1 --2- 172.21.15.26:0/1576112610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e4101050 0x7f47e4101430 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.777+0000 7f47e91ab700 1 --2- 172.21.15.26:0/1576112610 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47e4101a00 0x7f47e4105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.777+0000 7f47e91ab700 1 -- 172.21.15.26:0/1576112610 >> 172.21.15.26:0/1576112610 conn(0x7f47e40fc8c0 msgr2=0x7f47e40fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.777+0000 7f47e91ab700 1 -- 172.21.15.26:0/1576112610 shutdown_connections 2023-12-01T01:03:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.777+0000 7f47e91ab700 1 -- 172.21.15.26:0/1576112610 wait complete. 2023-12-01T01:03:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.778+0000 7f47e91ab700 1 Processor -- start 2023-12-01T01:03:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.778+0000 7f47e91ab700 1 -- start start 2023-12-01T01:03:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.779+0000 7f47e91ab700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47e4101050 0x7f47e4196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:15.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.779+0000 7f47e91ab700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47e4101a00 0x7f47e41974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.779+0000 7f47e91ab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e4106130 0x7f47e419b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.779+0000 7f47e91ab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e419bf50 con 0x7f47e4106130 2023-12-01T01:03:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.779+0000 7f47e91ab700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e419c0c0 con 0x7f47e4101a00 2023-12-01T01:03:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.779+0000 7f47e91ab700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e419c280 con 0x7f47e4101050 2023-12-01T01:03:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.779+0000 7f47e2d9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47e4101050 0x7f47e4196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.779+0000 7f47e2d9d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47e4101050 0x7f47e4196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.26:46104/0 (socket says 172.21.15.26:46104) 2023-12-01T01:03:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.779+0000 7f47e2d9d700 1 -- 172.21.15.26:0/344939383 learned_addr learned my addr 172.21.15.26:0/344939383 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.779+0000 7f47e2d9d700 1 -- 172.21.15.26:0/344939383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47e4101a00 msgr2=0x7f47e41974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.779+0000 7f47e2d9d700 1 --2- 172.21.15.26:0/344939383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f47e4101a00 0x7f47e41974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.779+0000 7f47e2d9d700 1 -- 172.21.15.26:0/344939383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e4106130 msgr2=0x7f47e419b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.779+0000 7f47e2d9d700 1 --2- 172.21.15.26:0/344939383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f47e4106130 0x7f47e419b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.779+0000 7f47e2d9d700 1 -- 172.21.15.26:0/344939383 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d40095f0 con 0x7f47e4101050 2023-12-01T01:03:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.780+0000 7f47e2d9d700 1 --2- 172.21.15.26:0/344939383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47e4101050 0x7f47e4196f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f47d4000c00 tx=0x7f47d400f7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:15.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.780+0000 7f47cbfff700 1 -- 172.21.15.26:0/344939383 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d401d070 con 0x7f47e4101050 2023-12-01T01:03:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.780+0000 7f47e91ab700 1 -- 172.21.15.26:0/344939383 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e419c500 con 0x7f47e4101050 2023-12-01T01:03:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.780+0000 7f47e91ab700 1 -- 172.21.15.26:0/344939383 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e41a3dc0 con 0x7f47e4101050 2023-12-01T01:03:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.780+0000 7f47cbfff700 1 -- 172.21.15.26:0/344939383 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f47d400fcb0 con 0x7f47e4101050 2023-12-01T01:03:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.780+0000 7f47cbfff700 1 -- 172.21.15.26:0/344939383 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4017650 con 0x7f47e4101050 2023-12-01T01:03:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.781+0000 7f47e91ab700 1 -- 172.21.15.26:0/344939383 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f47e4111180 con 0x7f47e4101050 2023-12-01T01:03:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.783+0000 7f47cbfff700 1 -- 172.21.15.26:0/344939383 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f47d4022470 con 0x7f47e4101050 2023-12-01T01:03:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.784+0000 7f47cbfff700 1 --2- 172.21.15.26:0/344939383 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f47cc0a05b0 0x7f47cc0a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.784+0000 7f47cbfff700 1 -- 172.21.15.26:0/344939383 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f47d40cdcc0 con 0x7f47e4101050 2023-12-01T01:03:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.784+0000 7f47e259c700 1 --2- 172.21.15.26:0/344939383 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f47cc0a05b0 0x7f47cc0a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.784+0000 7f47cbfff700 1 --2- 172.21.15.26:0/344939383 >> [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363] conn(0x7f47cc0aa0f0 0x7f47cc0ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.784+0000 7f47cbfff700 1 -- 172.21.15.26:0/344939383 --> [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47cc0acc60 con 0x7f47cc0aa0f0 2023-12-01T01:03:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.784+0000 7f47cbfff700 1 -- 172.21.15.26:0/344939383 <== mon.1 v2:172.21.15.116:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47d40ce030 con 0x7f47e4101050 2023-12-01T01:03:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.784+0000 7f47e359e700 1 --2- 172.21.15.26:0/344939383 >> [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363] conn(0x7f47cc0aa0f0 0x7f47cc0ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:15.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.784+0000 7f47e259c700 1 --2- 172.21.15.26:0/344939383 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f47cc0a05b0 0x7f47cc0a2a70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f47e41985b0 tx=0x7f47d8005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.785+0000 7f47e359e700 1 --2- 172.21.15.26:0/344939383 >> [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363] conn(0x7f47cc0aa0f0 0x7f47cc0ac590 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.786+0000 7f47cbfff700 1 -- 172.21.15.26:0/344939383 <== osd.4 v2:172.21.15.93:6808/4081534363 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f47cc0acc60 con 0x7f47cc0aa0f0 2023-12-01T01:03:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.803+0000 7f47e91ab700 1 -- 172.21.15.26:0/344939383 --> [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f47e404ea90 con 0x7f47cc0aa0f0 2023-12-01T01:03:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.804+0000 7f47cbfff700 1 -- 172.21.15.26:0/344939383 <== osd.4 v2:172.21.15.93:6808/4081534363 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f47e404ea90 con 0x7f47cc0aa0f0 2023-12-01T01:03:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.804+0000 7f47e91ab700 1 -- 172.21.15.26:0/344939383 >> [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363] conn(0x7f47cc0aa0f0 msgr2=0x7f47cc0ac590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.804+0000 7f47e91ab700 1 --2- 172.21.15.26:0/344939383 >> [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363] conn(0x7f47cc0aa0f0 0x7f47cc0ac590 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.804+0000 7f47e91ab700 1 -- 172.21.15.26:0/344939383 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f47cc0a05b0 msgr2=0x7f47cc0a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.804+0000 7f47e91ab700 1 --2- 172.21.15.26:0/344939383 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f47cc0a05b0 0x7f47cc0a2a70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f47e41985b0 tx=0x7f47d8005c80 comp rx=0 tx=0).stop 2023-12-01T01:03:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.804+0000 7f47e91ab700 1 -- 172.21.15.26:0/344939383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47e4101050 msgr2=0x7f47e4196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.804+0000 7f47e91ab700 1 --2- 172.21.15.26:0/344939383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f47e4101050 0x7f47e4196f90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f47d4000c00 tx=0x7f47d400f7c0 comp rx=0 tx=0).stop 2023-12-01T01:03:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.804+0000 7f47e359e700 1 -- 172.21.15.26:0/344939383 reap_dead start 2023-12-01T01:03:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.804+0000 7f47e91ab700 1 -- 172.21.15.26:0/344939383 shutdown_connections 2023-12-01T01:03:15.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.804+0000 7f47e91ab700 1 -- 172.21.15.26:0/344939383 >> 172.21.15.26:0/344939383 conn(0x7f47e40fc8c0 msgr2=0x7f47e40fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:15.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.804+0000 7f47e91ab700 1 -- 172.21.15.26:0/344939383 shutdown_connections 2023-12-01T01:03:15.075 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:14.804+0000 7f47e91ab700 1 -- 172.21.15.26:0/344939383 wait complete. 2023-12-01T01:03:15.843 INFO:teuthology.orchestra.run.smithi026.stdout:77309411381 2023-12-01T01:03:15.843 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-01T01:03:15.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:15 smithi093 ceph-mon[103327]: pgmap v261: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 6 op/s; 3.3 KiB/s, 0 objects/s recovering 2023-12-01T01:03:15.983 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:15 smithi026 ceph-mon[98801]: pgmap v261: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 6 op/s; 3.3 KiB/s, 0 objects/s recovering 2023-12-01T01:03:16.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.003+0000 7f0d796a0700 1 -- 172.21.15.26:0/604317591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d74100690 msgr2=0x7f0d7410cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:16.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.003+0000 7f0d796a0700 1 --2- 172.21.15.26:0/604317591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d74100690 0x7f0d7410cb30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00b0a0 tx=0x7f0d6c00b3b0 comp rx=0 tx=0).stop 2023-12-01T01:03:16.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.003+0000 7f0d796a0700 1 -- 172.21.15.26:0/604317591 shutdown_connections 2023-12-01T01:03:16.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.003+0000 7f0d796a0700 1 --2- 172.21.15.26:0/604317591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d74100690 0x7f0d7410cb30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:16.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.003+0000 7f0d796a0700 1 --2- 172.21.15.26:0/604317591 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d74105d80 0x7f0d74106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:16.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.003+0000 7f0d796a0700 1 --2- 172.21.15.26:0/604317591 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d740ffcd0 0x7f0d74100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:16.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.003+0000 7f0d796a0700 1 -- 172.21.15.26:0/604317591 >> 172.21.15.26:0/604317591 conn(0x7f0d74076d90 msgr2=0x7f0d740771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:16.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.003+0000 7f0d796a0700 1 -- 172.21.15.26:0/604317591 shutdown_connections 2023-12-01T01:03:16.004 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.003+0000 7f0d796a0700 1 -- 172.21.15.26:0/604317591 wait complete. 2023-12-01T01:03:16.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.003+0000 7f0d796a0700 1 Processor -- start 2023-12-01T01:03:16.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.004+0000 7f0d796a0700 1 -- start start 2023-12-01T01:03:16.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.004+0000 7f0d796a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d740ffcd0 0x7f0d7410d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:16.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.004+0000 7f0d796a0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d74100690 0x7f0d7410da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:16.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.004+0000 7f0d796a0700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d74105d80 0x7f0d7410df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:16.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.004+0000 7f0d796a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d741a5440 con 0x7f0d740ffcd0 2023-12-01T01:03:16.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.004+0000 7f0d796a0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d741a55b0 con 0x7f0d74100690 2023-12-01T01:03:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.004+0000 7f0d796a0700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d741a5770 con 0x7f0d74105d80 2023-12-01T01:03:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.004+0000 7f0d72ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d740ffcd0 0x7f0d7410d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.004+0000 7f0d72ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d740ffcd0 0x7f0d7410d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53888/0 (socket says 172.21.15.26:53888) 2023-12-01T01:03:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.004+0000 7f0d72ffd700 1 -- 172.21.15.26:0/3697111026 learned_addr learned my addr 172.21.15.26:0/3697111026 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.004+0000 7f0d727fc700 1 --2- 172.21.15.26:0/3697111026 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d74100690 0x7f0d7410da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.004+0000 7f0d737fe700 1 --2- 172.21.15.26:0/3697111026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d74105d80 0x7f0d7410df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.005+0000 7f0d727fc700 1 -- 172.21.15.26:0/3697111026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d74105d80 msgr2=0x7f0d7410df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.005+0000 7f0d727fc700 1 --2- 172.21.15.26:0/3697111026 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0d74105d80 0x7f0d7410df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.005+0000 7f0d727fc700 1 -- 172.21.15.26:0/3697111026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d740ffcd0 msgr2=0x7f0d7410d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.005+0000 7f0d727fc700 1 --2- 172.21.15.26:0/3697111026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d740ffcd0 0x7f0d7410d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.005+0000 7f0d727fc700 1 -- 172.21.15.26:0/3697111026 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c009d00 con 0x7f0d74100690 2023-12-01T01:03:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.005+0000 7f0d72ffd700 1 --2- 172.21.15.26:0/3697111026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d740ffcd0 0x7f0d7410d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:03:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.005+0000 7f0d727fc700 1 --2- 172.21.15.26:0/3697111026 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d74100690 0x7f0d7410da00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800e9f0 tx=0x7f0d6800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:16.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.005+0000 7f0d5bfff700 1 -- 172.21.15.26:0/3697111026 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6800c9c0 con 0x7f0d74100690 2023-12-01T01:03:16.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.005+0000 7f0d796a0700 1 -- 172.21.15.26:0/3697111026 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d741a5a50 con 0x7f0d74100690 2023-12-01T01:03:16.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.005+0000 7f0d796a0700 1 -- 172.21.15.26:0/3697111026 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d741a5fa0 con 0x7f0d74100690 2023-12-01T01:03:16.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.005+0000 7f0d5bfff700 1 -- 172.21.15.26:0/3697111026 <== mon.2 v2:172.21.15.93:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0d68010430 con 0x7f0d74100690 2023-12-01T01:03:16.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.005+0000 7f0d5bfff700 1 -- 172.21.15.26:0/3697111026 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d68018680 con 0x7f0d74100690 2023-12-01T01:03:16.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.006+0000 7f0d796a0700 1 -- 172.21.15.26:0/3697111026 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d60000ff0 con 0x7f0d74100690 2023-12-01T01:03:16.008 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.007+0000 7f0d5bfff700 1 -- 172.21.15.26:0/3697111026 <== mon.2 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f0d6800cb20 con 0x7f0d74100690 2023-12-01T01:03:16.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.008+0000 7f0d5bfff700 1 --2- 172.21.15.26:0/3697111026 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0d5c0a0630 0x7f0d5c0a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:16.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.008+0000 7f0d72ffd700 1 --2- 172.21.15.26:0/3697111026 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0d5c0a0630 0x7f0d5c0a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:16.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.008+0000 7f0d5bfff700 1 -- 172.21.15.26:0/3697111026 <== mon.2 v2:172.21.15.93:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0d68014070 con 0x7f0d74100690 2023-12-01T01:03:16.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.008+0000 7f0d5bfff700 1 --2- 172.21.15.26:0/3697111026 >> [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189] conn(0x7f0d5c0aa170 0x7f0d5c0ac610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:16.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.008+0000 7f0d5bfff700 1 -- 172.21.15.26:0/3697111026 --> [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d5c0acce0 con 0x7f0d5c0aa170 2023-12-01T01:03:16.009 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.008+0000 7f0d5bfff700 1 -- 172.21.15.26:0/3697111026 <== mon.2 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d680cc850 con 0x7f0d74100690 2023-12-01T01:03:16.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.008+0000 7f0d737fe700 1 --2- 172.21.15.26:0/3697111026 >> [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189] conn(0x7f0d5c0aa170 0x7f0d5c0ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:16.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.009+0000 7f0d72ffd700 1 --2- 172.21.15.26:0/3697111026 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0d5c0a0630 0x7f0d5c0a2af0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0d64005950 tx=0x7f0d6400b500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:16.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.009+0000 7f0d737fe700 1 --2- 172.21.15.26:0/3697111026 >> [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189] conn(0x7f0d5c0aa170 0x7f0d5c0ac610 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:16.010 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.009+0000 7f0d5bfff700 1 -- 172.21.15.26:0/3697111026 <== osd.9 v2:172.21.15.26:6826/499283189 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0d5c0acce0 con 0x7f0d5c0aa170 2023-12-01T01:03:16.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.030+0000 7f0d796a0700 1 -- 172.21.15.26:0/3697111026 --> [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0d60002d70 con 0x7f0d5c0aa170 2023-12-01T01:03:16.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.030+0000 7f0d5bfff700 1 -- 172.21.15.26:0/3697111026 <== osd.9 v2:172.21.15.26:6826/499283189 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0d60002d70 con 0x7f0d5c0aa170 2023-12-01T01:03:16.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.031+0000 7f0d796a0700 1 -- 172.21.15.26:0/3697111026 >> [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189] conn(0x7f0d5c0aa170 msgr2=0x7f0d5c0ac610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:16.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.031+0000 7f0d796a0700 1 --2- 172.21.15.26:0/3697111026 >> [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189] conn(0x7f0d5c0aa170 0x7f0d5c0ac610 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:16.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.031+0000 7f0d796a0700 1 -- 172.21.15.26:0/3697111026 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0d5c0a0630 msgr2=0x7f0d5c0a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:16.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.031+0000 7f0d796a0700 1 --2- 172.21.15.26:0/3697111026 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0d5c0a0630 0x7f0d5c0a2af0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0d64005950 tx=0x7f0d6400b500 comp rx=0 tx=0).stop 2023-12-01T01:03:16.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.031+0000 7f0d796a0700 1 -- 172.21.15.26:0/3697111026 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d74100690 msgr2=0x7f0d7410da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:16.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.031+0000 7f0d796a0700 1 --2- 172.21.15.26:0/3697111026 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0d74100690 0x7f0d7410da00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800e9f0 tx=0x7f0d6800ed00 comp rx=0 tx=0).stop 2023-12-01T01:03:16.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.031+0000 7f0d737fe700 1 -- 172.21.15.26:0/3697111026 reap_dead start 2023-12-01T01:03:16.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.031+0000 7f0d796a0700 1 -- 172.21.15.26:0/3697111026 shutdown_connections 2023-12-01T01:03:16.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.031+0000 7f0d796a0700 1 -- 172.21.15.26:0/3697111026 >> 172.21.15.26:0/3697111026 conn(0x7f0d74076d90 msgr2=0x7f0d740fe6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:16.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.031+0000 7f0d796a0700 1 -- 172.21.15.26:0/3697111026 shutdown_connections 2023-12-01T01:03:16.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.031+0000 7f0d796a0700 1 -- 172.21.15.26:0/3697111026 wait complete. 2023-12-01T01:03:16.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:15 smithi116 ceph-mon[103554]: pgmap v261: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 6 op/s; 3.3 KiB/s, 0 objects/s recovering 2023-12-01T01:03:16.861 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.068+0000 7f9f11291700 1 -- 172.21.15.26:0/2390861147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f0c101020 msgr2=0x7f9f0c1014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:16.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.068+0000 7f9f11291700 1 --2- 172.21.15.26:0/2390861147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f0c101020 0x7f9f0c1014a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9efc0099c0 tx=0x7f9efc009cd0 comp rx=0 tx=0).stop 2023-12-01T01:03:16.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.068+0000 7f9f11291700 1 -- 172.21.15.26:0/2390861147 shutdown_connections 2023-12-01T01:03:16.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.068+0000 7f9f11291700 1 --2- 172.21.15.26:0/2390861147 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f0c1019e0 0x7f9f0c10dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:16.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.068+0000 7f9f11291700 1 --2- 172.21.15.26:0/2390861147 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f0c106fa0 0x7f9f0c107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:16.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.068+0000 7f9f11291700 1 --2- 172.21.15.26:0/2390861147 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f0c101020 0x7f9f0c1014a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:16.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.068+0000 7f9f11291700 1 -- 172.21.15.26:0/2390861147 >> 172.21.15.26:0/2390861147 conn(0x7f9f0c078db0 msgr2=0x7f9f0c0791c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:16.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.068+0000 7f9f11291700 1 -- 172.21.15.26:0/2390861147 shutdown_connections 2023-12-01T01:03:16.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.068+0000 7f9f11291700 1 -- 172.21.15.26:0/2390861147 wait complete. 2023-12-01T01:03:16.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.068+0000 7f9f11291700 1 Processor -- start 2023-12-01T01:03:16.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.068+0000 7f9f11291700 1 -- start start 2023-12-01T01:03:16.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f11291700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f0c101020 0x7f9f0c196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:16.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f11291700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f0c1019e0 0x7f9f0c197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:16.862 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f11291700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f0c106fa0 0x7f9f0c19b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f11291700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c19bee0 con 0x7f9f0c106fa0 2023-12-01T01:03:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f11291700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c19c050 con 0x7f9f0c101020 2023-12-01T01:03:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f11291700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0c19c210 con 0x7f9f0c1019e0 2023-12-01T01:03:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f0b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f0c106fa0 0x7f9f0c19b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f0b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f0c106fa0 0x7f9f0c19b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53908/0 (socket says 172.21.15.26:53908) 2023-12-01T01:03:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f0b7fe700 1 -- 172.21.15.26:0/3798661849 learned_addr learned my addr 172.21.15.26:0/3798661849 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f0a7fc700 1 --2- 172.21.15.26:0/3798661849 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f0c1019e0 0x7f9f0c197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f0affd700 1 --2- 172.21.15.26:0/3798661849 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f0c101020 0x7f9f0c196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f0b7fe700 1 -- 172.21.15.26:0/3798661849 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f0c1019e0 msgr2=0x7f9f0c197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f0b7fe700 1 --2- 172.21.15.26:0/3798661849 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9f0c1019e0 0x7f9f0c197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f0b7fe700 1 -- 172.21.15.26:0/3798661849 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f0c101020 msgr2=0x7f9f0c196f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f0b7fe700 1 --2- 172.21.15.26:0/3798661849 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f0c101020 0x7f9f0c196f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f0b7fe700 1 -- 172.21.15.26:0/3798661849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9efc0095f0 con 0x7f9f0c106fa0 2023-12-01T01:03:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f0affd700 1 --2- 172.21.15.26:0/3798661849 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f0c101020 0x7f9f0c196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:03:16.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f0b7fe700 1 --2- 172.21.15.26:0/3798661849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f0c106fa0 0x7f9f0c19b8d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9f04007ee0 tx=0x7f9f0400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9ef3fff700 1 -- 172.21.15.26:0/3798661849 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f04017070 con 0x7f9f0c106fa0 2023-12-01T01:03:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9ef3fff700 1 -- 172.21.15.26:0/3798661849 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9f0400f040 con 0x7f9f0c106fa0 2023-12-01T01:03:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.069+0000 7f9f11291700 1 -- 172.21.15.26:0/3798661849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f0c19c4f0 con 0x7f9f0c106fa0 2023-12-01T01:03:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.070+0000 7f9ef3fff700 1 -- 172.21.15.26:0/3798661849 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f04005760 con 0x7f9f0c106fa0 2023-12-01T01:03:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.070+0000 7f9f11291700 1 -- 172.21.15.26:0/3798661849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0c1a3d50 con 0x7f9f0c106fa0 2023-12-01T01:03:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.070+0000 7f9f11291700 1 -- 172.21.15.26:0/3798661849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f0c111170 con 0x7f9f0c106fa0 2023-12-01T01:03:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.071+0000 7f9ef3fff700 1 -- 172.21.15.26:0/3798661849 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f9f040058c0 con 0x7f9f0c106fa0 2023-12-01T01:03:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.072+0000 7f9ef3fff700 1 --2- 172.21.15.26:0/3798661849 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9ef40a05b0 0x7f9ef40a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.072+0000 7f9f0affd700 1 --2- 172.21.15.26:0/3798661849 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9ef40a05b0 0x7f9ef40a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.072+0000 7f9ef3fff700 1 -- 172.21.15.26:0/3798661849 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9f040cb960 con 0x7f9f0c106fa0 2023-12-01T01:03:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.072+0000 7f9ef3fff700 1 --2- 172.21.15.26:0/3798661849 >> [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002] conn(0x7f9ef40aa0f0 0x7f9ef40ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.072+0000 7f9ef3fff700 1 -- 172.21.15.26:0/3798661849 --> [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ef40acc60 con 0x7f9ef40aa0f0 2023-12-01T01:03:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.072+0000 7f9ef3fff700 1 -- 172.21.15.26:0/3798661849 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f040cbd70 con 0x7f9f0c106fa0 2023-12-01T01:03:16.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.072+0000 7f9f0a7fc700 1 --2- 172.21.15.26:0/3798661849 >> [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002] conn(0x7f9ef40aa0f0 0x7f9ef40ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:16.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.073+0000 7f9f0affd700 1 --2- 172.21.15.26:0/3798661849 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9ef40a05b0 0x7f9ef40a2a70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9f00005fd0 tx=0x7f9f00005d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:16.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.073+0000 7f9f0a7fc700 1 --2- 172.21.15.26:0/3798661849 >> [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002] conn(0x7f9ef40aa0f0 0x7f9ef40ac590 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:16.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.073+0000 7f9ef3fff700 1 -- 172.21.15.26:0/3798661849 <== osd.6 v2:172.21.15.26:6818/1321295002 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9ef40acc60 con 0x7f9ef40aa0f0 2023-12-01T01:03:16.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.089+0000 7f9f11291700 1 -- 172.21.15.26:0/3798661849 --> [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f0c04ea90 con 0x7f9ef40aa0f0 2023-12-01T01:03:16.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.089+0000 7f9ef3fff700 1 -- 172.21.15.26:0/3798661849 <== osd.6 v2:172.21.15.26:6818/1321295002 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f9f0c04ea90 con 0x7f9ef40aa0f0 2023-12-01T01:03:16.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.090+0000 7f9f11291700 1 -- 172.21.15.26:0/3798661849 >> [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002] conn(0x7f9ef40aa0f0 msgr2=0x7f9ef40ac590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.090+0000 7f9f11291700 1 --2- 172.21.15.26:0/3798661849 >> [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002] conn(0x7f9ef40aa0f0 0x7f9ef40ac590 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.090+0000 7f9f11291700 1 -- 172.21.15.26:0/3798661849 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9ef40a05b0 msgr2=0x7f9ef40a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.090+0000 7f9f11291700 1 --2- 172.21.15.26:0/3798661849 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9ef40a05b0 0x7f9ef40a2a70 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9f00005fd0 tx=0x7f9f00005d40 comp rx=0 tx=0).stop 2023-12-01T01:03:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.090+0000 7f9f11291700 1 -- 172.21.15.26:0/3798661849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f0c106fa0 msgr2=0x7f9f0c19b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.090+0000 7f9f11291700 1 --2- 172.21.15.26:0/3798661849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f0c106fa0 0x7f9f0c19b8d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9f04007ee0 tx=0x7f9f0400d3b0 comp rx=0 tx=0).stop 2023-12-01T01:03:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.090+0000 7f9f0b7fe700 1 -- 172.21.15.26:0/3798661849 reap_dead start 2023-12-01T01:03:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.090+0000 7f9f11291700 1 -- 172.21.15.26:0/3798661849 shutdown_connections 2023-12-01T01:03:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.090+0000 7f9f11291700 1 -- 172.21.15.26:0/3798661849 >> 172.21.15.26:0/3798661849 conn(0x7f9f0c078db0 msgr2=0x7f9f0c104b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.090+0000 7f9f11291700 1 -- 172.21.15.26:0/3798661849 shutdown_connections 2023-12-01T01:03:16.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:16.090+0000 7f9f11291700 1 -- 172.21.15.26:0/3798661849 wait complete. 2023-12-01T01:03:17.251 INFO:teuthology.orchestra.run.smithi026.stdout:274877906968 2023-12-01T01:03:17.251 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.9 2023-12-01T01:03:17.258 INFO:teuthology.orchestra.run.smithi026.stdout:214748364832 2023-12-01T01:03:17.259 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.7 2023-12-01T01:03:17.737 INFO:teuthology.orchestra.run.smithi026.stdout:137438953516 2023-12-01T01:03:17.738 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-01T01:03:17.823 INFO:teuthology.orchestra.run.smithi026.stdout:193273528357 2023-12-01T01:03:17.824 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.6 2023-12-01T01:03:17.944 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:17 smithi026 ceph-mon[98801]: pgmap v262: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-01T01:03:17.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:17 smithi093 ceph-mon[103327]: pgmap v262: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-01T01:03:18.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.025+0000 7fb80f937700 1 -- 172.21.15.26:0/2985799437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb808101a00 msgr2=0x7fb808105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.025+0000 7fb80f937700 1 --2- 172.21.15.26:0/2985799437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb808101a00 0x7fb808105a50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb7f8009990 tx=0x7fb7f8009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.025+0000 7fb80f937700 1 -- 172.21.15.26:0/2985799437 shutdown_connections 2023-12-01T01:03:18.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.025+0000 7fb80f937700 1 --2- 172.21.15.26:0/2985799437 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb808106130 0x7fb80810dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.025+0000 7fb80f937700 1 --2- 172.21.15.26:0/2985799437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb808101050 0x7fb808101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.025+0000 7fb80f937700 1 --2- 172.21.15.26:0/2985799437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb808101a00 0x7fb808105a50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.025+0000 7fb80f937700 1 -- 172.21.15.26:0/2985799437 >> 172.21.15.26:0/2985799437 conn(0x7fb8080fc8c0 msgr2=0x7fb8080fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:18.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.025+0000 7fb80f937700 1 -- 172.21.15.26:0/2985799437 shutdown_connections 2023-12-01T01:03:18.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.027+0000 7fb80f937700 1 -- 172.21.15.26:0/2985799437 wait complete. 2023-12-01T01:03:18.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.028+0000 7fb80f937700 1 Processor -- start 2023-12-01T01:03:18.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.028+0000 7fb80f937700 1 -- start start 2023-12-01T01:03:18.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.028+0000 7fb80f937700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb808101050 0x7fb808196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.028+0000 7fb80f937700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb808101a00 0x7fb8081974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.028+0000 7fb80f937700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb808106130 0x7fb80819b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.028+0000 7fb80f937700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80819bf30 con 0x7fb808106130 2023-12-01T01:03:18.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.028+0000 7fb80f937700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80819c0a0 con 0x7fb808101a00 2023-12-01T01:03:18.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.028+0000 7fb80f937700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80819c260 con 0x7fb808101050 2023-12-01T01:03:18.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.028+0000 7fb80ded4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb808106130 0x7fb80819b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.028+0000 7fb80ded4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb808106130 0x7fb80819b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53938/0 (socket says 172.21.15.26:53938) 2023-12-01T01:03:18.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.028+0000 7fb80ded4700 1 -- 172.21.15.26:0/628085864 learned_addr learned my addr 172.21.15.26:0/628085864 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:18.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.028+0000 7fb80ced2700 1 --2- 172.21.15.26:0/628085864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb808101a00 0x7fb8081974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.028+0000 7fb80d6d3700 1 --2- 172.21.15.26:0/628085864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb808101050 0x7fb808196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.029+0000 7fb80ded4700 1 -- 172.21.15.26:0/628085864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb808101050 msgr2=0x7fb808196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.029+0000 7fb80ded4700 1 --2- 172.21.15.26:0/628085864 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb808101050 0x7fb808196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.029+0000 7fb80ded4700 1 -- 172.21.15.26:0/628085864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb808101a00 msgr2=0x7fb8081974b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.029+0000 7fb80ded4700 1 --2- 172.21.15.26:0/628085864 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb808101a00 0x7fb8081974b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.029+0000 7fb80ded4700 1 -- 172.21.15.26:0/628085864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f80095f0 con 0x7fb808106130 2023-12-01T01:03:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.029+0000 7fb80ded4700 1 --2- 172.21.15.26:0/628085864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb808106130 0x7fb80819b920 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb800007ee0 tx=0x7fb80000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.029+0000 7fb7fe7fc700 1 -- 172.21.15.26:0/628085864 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80000dd20 con 0x7fb808106130 2023-12-01T01:03:18.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.029+0000 7fb80f937700 1 -- 172.21.15.26:0/628085864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80819c540 con 0x7fb808106130 2023-12-01T01:03:18.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.029+0000 7fb7fe7fc700 1 -- 172.21.15.26:0/628085864 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb80000f040 con 0x7fb808106130 2023-12-01T01:03:18.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.029+0000 7fb7fe7fc700 1 -- 172.21.15.26:0/628085864 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb800015400 con 0x7fb808106130 2023-12-01T01:03:18.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.029+0000 7fb80f937700 1 -- 172.21.15.26:0/628085864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb808073190 con 0x7fb808106130 2023-12-01T01:03:18.032 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.030+0000 7fb80f937700 1 -- 172.21.15.26:0/628085864 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb80804ea90 con 0x7fb808106130 2023-12-01T01:03:18.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.032+0000 7fb7fe7fc700 1 -- 172.21.15.26:0/628085864 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fb800003a00 con 0x7fb808106130 2023-12-01T01:03:18.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.033+0000 7fb7fe7fc700 1 --2- 172.21.15.26:0/628085864 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb7f40a05b0 0x7fb7f40a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.033+0000 7fb7fe7fc700 1 -- 172.21.15.26:0/628085864 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb8000cbe60 con 0x7fb808106130 2023-12-01T01:03:18.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.033+0000 7fb7fe7fc700 1 --2- 172.21.15.26:0/628085864 >> [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045] conn(0x7fb7f40aa0f0 0x7fb7f40ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.033+0000 7fb7fe7fc700 1 -- 172.21.15.26:0/628085864 --> [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb7f40acc60 con 0x7fb7f40aa0f0 2023-12-01T01:03:18.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.033+0000 7fb7fe7fc700 1 -- 172.21.15.26:0/628085864 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8000cc270 con 0x7fb808106130 2023-12-01T01:03:18.035 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.034+0000 7fb80d6d3700 1 --2- 172.21.15.26:0/628085864 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb7f40a05b0 0x7fb7f40a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.034+0000 7fb80ced2700 1 --2- 172.21.15.26:0/628085864 >> [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045] conn(0x7fb7f40aa0f0 0x7fb7f40ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.034+0000 7fb80d6d3700 1 --2- 172.21.15.26:0/628085864 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb7f40a05b0 0x7fb7f40a2a70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb804010d80 tx=0x7fb804012040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.034+0000 7fb80ced2700 1 --2- 172.21.15.26:0/628085864 >> [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045] conn(0x7fb7f40aa0f0 0x7fb7f40ac590 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:18.036 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.035+0000 7fb7fe7fc700 1 -- 172.21.15.26:0/628085864 <== osd.1 v2:172.21.15.93:6800/1078035045 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb7f40acc60 con 0x7fb7f40aa0f0 2023-12-01T01:03:18.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.053+0000 7fb80f937700 1 -- 172.21.15.26:0/628085864 --> [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb808111160 con 0x7fb7f40aa0f0 2023-12-01T01:03:18.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.053+0000 7fb7fe7fc700 1 -- 172.21.15.26:0/628085864 <== osd.1 v2:172.21.15.93:6800/1078035045 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb7f801e040 con 0x7fb7f40aa0f0 2023-12-01T01:03:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.054+0000 7fb80f937700 1 -- 172.21.15.26:0/628085864 >> [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045] conn(0x7fb7f40aa0f0 msgr2=0x7fb7f40ac590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.054+0000 7fb80f937700 1 --2- 172.21.15.26:0/628085864 >> [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045] conn(0x7fb7f40aa0f0 0x7fb7f40ac590 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.054+0000 7fb80f937700 1 -- 172.21.15.26:0/628085864 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb7f40a05b0 msgr2=0x7fb7f40a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.054+0000 7fb80f937700 1 --2- 172.21.15.26:0/628085864 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb7f40a05b0 0x7fb7f40a2a70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb804010d80 tx=0x7fb804012040 comp rx=0 tx=0).stop 2023-12-01T01:03:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.054+0000 7fb80f937700 1 -- 172.21.15.26:0/628085864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb808106130 msgr2=0x7fb80819b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.054+0000 7fb80f937700 1 --2- 172.21.15.26:0/628085864 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb808106130 0x7fb80819b920 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb800007ee0 tx=0x7fb80000d3b0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.054+0000 7fb80ded4700 1 -- 172.21.15.26:0/628085864 reap_dead start 2023-12-01T01:03:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.054+0000 7fb80f937700 1 -- 172.21.15.26:0/628085864 shutdown_connections 2023-12-01T01:03:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.054+0000 7fb80f937700 1 -- 172.21.15.26:0/628085864 >> 172.21.15.26:0/628085864 conn(0x7fb8080fc8c0 msgr2=0x7fb8080fd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.054+0000 7fb80f937700 1 -- 172.21.15.26:0/628085864 shutdown_connections 2023-12-01T01:03:18.063 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.054+0000 7fb80f937700 1 -- 172.21.15.26:0/628085864 wait complete. 2023-12-01T01:03:18.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:17 smithi116 ceph-mon[103554]: pgmap v262: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-01T01:03:18.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.987+0000 7fc68cbc0700 1 -- 172.21.15.26:0/789297525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc688101ff0 msgr2=0x7fc6881023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.987+0000 7fc68cbc0700 1 --2- 172.21.15.26:0/789297525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc688101ff0 0x7fc6881023d0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc678009990 tx=0x7fc678009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.987+0000 7fc68cbc0700 1 -- 172.21.15.26:0/789297525 shutdown_connections 2023-12-01T01:03:18.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.987+0000 7fc68cbc0700 1 --2- 172.21.15.26:0/789297525 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc68810b3d0 0x7fc68810d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.987+0000 7fc68cbc0700 1 --2- 172.21.15.26:0/789297525 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc688101ff0 0x7fc6881023d0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.987+0000 7fc68cbc0700 1 --2- 172.21.15.26:0/789297525 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc688102910 0x7fc68810ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.987+0000 7fc68cbc0700 1 -- 172.21.15.26:0/789297525 >> 172.21.15.26:0/789297525 conn(0x7fc6880fb800 msgr2=0x7fc6880fdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:18.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.987+0000 7fc68cbc0700 1 -- 172.21.15.26:0/789297525 shutdown_connections 2023-12-01T01:03:18.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.987+0000 7fc68cbc0700 1 -- 172.21.15.26:0/789297525 wait complete. 2023-12-01T01:03:18.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.988+0000 7fc68cbc0700 1 Processor -- start 2023-12-01T01:03:18.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.989+0000 7fc68cbc0700 1 -- start start 2023-12-01T01:03:18.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.989+0000 7fc68cbc0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc688101ff0 0x7fc688197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.989+0000 7fc68cbc0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc688102910 0x7fc688197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.989+0000 7fc68cbc0700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc68810b3d0 0x7fc68819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.989+0000 7fc68cbc0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68819bfc0 con 0x7fc688101ff0 2023-12-01T01:03:18.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.989+0000 7fc68cbc0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68819c130 con 0x7fc688102910 2023-12-01T01:03:18.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.989+0000 7fc68cbc0700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68819c2f0 con 0x7fc68810b3d0 2023-12-01T01:03:18.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.989+0000 7fc68659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc688101ff0 0x7fc688197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.989+0000 7fc68659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc688101ff0 0x7fc688197000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53918/0 (socket says 172.21.15.26:53918) 2023-12-01T01:03:18.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.989+0000 7fc68659c700 1 -- 172.21.15.26:0/325849206 learned_addr learned my addr 172.21.15.26:0/325849206 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:18.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.989+0000 7fc685d9b700 1 --2- 172.21.15.26:0/325849206 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc688102910 0x7fc688197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.989+0000 7fc686d9d700 1 --2- 172.21.15.26:0/325849206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc68810b3d0 0x7fc68819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.989+0000 7fc68659c700 1 -- 172.21.15.26:0/325849206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc68810b3d0 msgr2=0x7fc68819b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.989+0000 7fc68659c700 1 --2- 172.21.15.26:0/325849206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc68810b3d0 0x7fc68819b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.989+0000 7fc68659c700 1 -- 172.21.15.26:0/325849206 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc688102910 msgr2=0x7fc688197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.989+0000 7fc68659c700 1 --2- 172.21.15.26:0/325849206 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc688102910 0x7fc688197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.990+0000 7fc68659c700 1 -- 172.21.15.26:0/325849206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6780095f0 con 0x7fc688101ff0 2023-12-01T01:03:18.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.990+0000 7fc68659c700 1 --2- 172.21.15.26:0/325849206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc688101ff0 0x7fc688197000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc678000c00 tx=0x7fc67800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:18.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.990+0000 7fc686d9d700 1 --2- 172.21.15.26:0/325849206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc68810b3d0 0x7fc68819b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:03:18.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.990+0000 7fc6777fe700 1 -- 172.21.15.26:0/325849206 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67801d070 con 0x7fc688101ff0 2023-12-01T01:03:18.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.990+0000 7fc68cbc0700 1 -- 172.21.15.26:0/325849206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68819c570 con 0x7fc688101ff0 2023-12-01T01:03:18.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.990+0000 7fc6777fe700 1 -- 172.21.15.26:0/325849206 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc678003680 con 0x7fc688101ff0 2023-12-01T01:03:18.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.990+0000 7fc6777fe700 1 -- 172.21.15.26:0/325849206 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6780173f0 con 0x7fc688101ff0 2023-12-01T01:03:18.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.990+0000 7fc68cbc0700 1 -- 172.21.15.26:0/325849206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6881a3e30 con 0x7fc688101ff0 2023-12-01T01:03:18.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.991+0000 7fc68cbc0700 1 -- 172.21.15.26:0/325849206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc688111180 con 0x7fc688101ff0 2023-12-01T01:03:18.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.992+0000 7fc6777fe700 1 -- 172.21.15.26:0/325849206 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fc678022470 con 0x7fc688101ff0 2023-12-01T01:03:18.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.993+0000 7fc6777fe700 1 --2- 172.21.15.26:0/325849206 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc6700a05b0 0x7fc6700a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.993+0000 7fc6777fe700 1 -- 172.21.15.26:0/325849206 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc6780cd260 con 0x7fc688101ff0 2023-12-01T01:03:18.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.993+0000 7fc685d9b700 1 --2- 172.21.15.26:0/325849206 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc6700a05b0 0x7fc6700a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.993+0000 7fc6777fe700 1 --2- 172.21.15.26:0/325849206 >> [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413] conn(0x7fc6700aa0f0 0x7fc6700ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.993+0000 7fc6777fe700 1 -- 172.21.15.26:0/325849206 --> [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6700acc60 con 0x7fc6700aa0f0 2023-12-01T01:03:18.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.993+0000 7fc6777fe700 1 -- 172.21.15.26:0/325849206 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6780cd5d0 con 0x7fc688101ff0 2023-12-01T01:03:18.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.994+0000 7fc686d9d700 1 --2- 172.21.15.26:0/325849206 >> [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413] conn(0x7fc6700aa0f0 0x7fc6700ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.994+0000 7fc685d9b700 1 --2- 172.21.15.26:0/325849206 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc6700a05b0 0x7fc6700a2a70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc688198620 tx=0x7fc67c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:18.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.994+0000 7fc686d9d700 1 --2- 172.21.15.26:0/325849206 >> [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413] conn(0x7fc6700aa0f0 0x7fc6700ac590 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:18.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:17.995+0000 7fc6777fe700 1 -- 172.21.15.26:0/325849206 <== osd.5 v2:172.21.15.116:6808/2687669413 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc6700acc60 con 0x7fc6700aa0f0 2023-12-01T01:03:18.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.011+0000 7fc68cbc0700 1 -- 172.21.15.26:0/325849206 --> [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc688068a20 con 0x7fc6700aa0f0 2023-12-01T01:03:18.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.012+0000 7fc6777fe700 1 -- 172.21.15.26:0/325849206 <== osd.5 v2:172.21.15.116:6808/2687669413 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fc688068a20 con 0x7fc6700aa0f0 2023-12-01T01:03:18.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.013+0000 7fc68cbc0700 1 -- 172.21.15.26:0/325849206 >> [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413] conn(0x7fc6700aa0f0 msgr2=0x7fc6700ac590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.013+0000 7fc68cbc0700 1 --2- 172.21.15.26:0/325849206 >> [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413] conn(0x7fc6700aa0f0 0x7fc6700ac590 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.013+0000 7fc68cbc0700 1 -- 172.21.15.26:0/325849206 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc6700a05b0 msgr2=0x7fc6700a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.013+0000 7fc68cbc0700 1 --2- 172.21.15.26:0/325849206 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc6700a05b0 0x7fc6700a2a70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc688198620 tx=0x7fc67c00a300 comp rx=0 tx=0).stop 2023-12-01T01:03:18.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.013+0000 7fc68cbc0700 1 -- 172.21.15.26:0/325849206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc688101ff0 msgr2=0x7fc688197000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.013+0000 7fc68cbc0700 1 --2- 172.21.15.26:0/325849206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc688101ff0 0x7fc688197000 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc678000c00 tx=0x7fc67800f710 comp rx=0 tx=0).stop 2023-12-01T01:03:18.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.013+0000 7fc686d9d700 1 -- 172.21.15.26:0/325849206 reap_dead start 2023-12-01T01:03:18.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.013+0000 7fc68cbc0700 1 -- 172.21.15.26:0/325849206 shutdown_connections 2023-12-01T01:03:18.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.013+0000 7fc68cbc0700 1 -- 172.21.15.26:0/325849206 >> 172.21.15.26:0/325849206 conn(0x7fc6880fb800 msgr2=0x7fc68810d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:18.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.013+0000 7fc68cbc0700 1 -- 172.21.15.26:0/325849206 shutdown_connections 2023-12-01T01:03:18.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.013+0000 7fc68cbc0700 1 -- 172.21.15.26:0/325849206 wait complete. 2023-12-01T01:03:18.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.440+0000 7fd7c50fa700 1 -- 172.21.15.26:0/3441921099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7c0101000 msgr2=0x7fd7c0104920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.440+0000 7fd7c50fa700 1 --2- 172.21.15.26:0/3441921099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7c0101000 0x7fd7c0104920 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009990 tx=0x7fd7b4009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.441+0000 7fd7c50fa700 1 -- 172.21.15.26:0/3441921099 shutdown_connections 2023-12-01T01:03:18.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.441+0000 7fd7c50fa700 1 --2- 172.21.15.26:0/3441921099 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd7c0105000 0x7fd7c010cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.441+0000 7fd7c50fa700 1 --2- 172.21.15.26:0/3441921099 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7c0100650 0x7fd7c0100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.441+0000 7fd7c50fa700 1 --2- 172.21.15.26:0/3441921099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7c0101000 0x7fd7c0104920 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.441+0000 7fd7c50fa700 1 -- 172.21.15.26:0/3441921099 >> 172.21.15.26:0/3441921099 conn(0x7fd7c0076200 msgr2=0x7fd7c00fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:18.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.441+0000 7fd7c50fa700 1 -- 172.21.15.26:0/3441921099 shutdown_connections 2023-12-01T01:03:18.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.441+0000 7fd7c50fa700 1 -- 172.21.15.26:0/3441921099 wait complete. 2023-12-01T01:03:18.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.441+0000 7fd7c50fa700 1 Processor -- start 2023-12-01T01:03:18.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.442+0000 7fd7c50fa700 1 -- start start 2023-12-01T01:03:18.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.442+0000 7fd7c50fa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7c0100650 0x7fd7c0196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.442+0000 7fd7c50fa700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd7c0101000 0x7fd7c01974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.442+0000 7fd7c50fa700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7c0105000 0x7fd7c019b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.442+0000 7fd7c50fa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c019bf50 con 0x7fd7c0100650 2023-12-01T01:03:18.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.442+0000 7fd7c50fa700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c019c0c0 con 0x7fd7c0101000 2023-12-01T01:03:18.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.442+0000 7fd7c50fa700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c019c280 con 0x7fd7c0105000 2023-12-01T01:03:18.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.442+0000 7fd7bed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7c0100650 0x7fd7c0196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.442+0000 7fd7bed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7c0100650 0x7fd7c0196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53966/0 (socket says 172.21.15.26:53966) 2023-12-01T01:03:18.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.442+0000 7fd7bed9d700 1 -- 172.21.15.26:0/1531074008 learned_addr learned my addr 172.21.15.26:0/1531074008 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:18.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.442+0000 7fd7be59c700 1 --2- 172.21.15.26:0/1531074008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd7c0101000 0x7fd7c01974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.442+0000 7fd7bf59e700 1 --2- 172.21.15.26:0/1531074008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7c0105000 0x7fd7c019b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.442+0000 7fd7bed9d700 1 -- 172.21.15.26:0/1531074008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7c0105000 msgr2=0x7fd7c019b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.443+0000 7fd7bed9d700 1 --2- 172.21.15.26:0/1531074008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd7c0105000 0x7fd7c019b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.443+0000 7fd7bed9d700 1 -- 172.21.15.26:0/1531074008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd7c0101000 msgr2=0x7fd7c01974d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.443+0000 7fd7bed9d700 1 --2- 172.21.15.26:0/1531074008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd7c0101000 0x7fd7c01974d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.443+0000 7fd7bed9d700 1 -- 172.21.15.26:0/1531074008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b40095f0 con 0x7fd7c0100650 2023-12-01T01:03:18.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.443+0000 7fd7be59c700 1 --2- 172.21.15.26:0/1531074008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd7c0101000 0x7fd7c01974d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:03:18.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.443+0000 7fd7bed9d700 1 --2- 172.21.15.26:0/1531074008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7c0100650 0x7fd7c0196f90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000d980 tx=0x7fd7b000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:18.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.443+0000 7fd7a7fff700 1 -- 172.21.15.26:0/1531074008 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0009b40 con 0x7fd7c0100650 2023-12-01T01:03:18.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.443+0000 7fd7c50fa700 1 -- 172.21.15.26:0/1531074008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c019c560 con 0x7fd7c0100650 2023-12-01T01:03:18.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.443+0000 7fd7a7fff700 1 -- 172.21.15.26:0/1531074008 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd7b000de60 con 0x7fd7c0100650 2023-12-01T01:03:18.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.443+0000 7fd7a7fff700 1 -- 172.21.15.26:0/1531074008 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b00056a0 con 0x7fd7c0100650 2023-12-01T01:03:18.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.443+0000 7fd7c50fa700 1 -- 172.21.15.26:0/1531074008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c01a3dc0 con 0x7fd7c0100650 2023-12-01T01:03:18.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.444+0000 7fd7c50fa700 1 -- 172.21.15.26:0/1531074008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7c004ea90 con 0x7fd7c0100650 2023-12-01T01:03:18.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.445+0000 7fd7a7fff700 1 -- 172.21.15.26:0/1531074008 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fd7b0009ca0 con 0x7fd7c0100650 2023-12-01T01:03:18.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.446+0000 7fd7a7fff700 1 --2- 172.21.15.26:0/1531074008 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd7a80a05b0 0x7fd7a80a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.446+0000 7fd7a7fff700 1 -- 172.21.15.26:0/1531074008 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd7b00cc0b0 con 0x7fd7c0100650 2023-12-01T01:03:18.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.446+0000 7fd7be59c700 1 --2- 172.21.15.26:0/1531074008 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd7a80a05b0 0x7fd7a80a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.446+0000 7fd7a7fff700 1 --2- 172.21.15.26:0/1531074008 >> [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175] conn(0x7fd7a80aa0f0 0x7fd7a80ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.446+0000 7fd7a7fff700 1 -- 172.21.15.26:0/1531074008 --> [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7a80acc60 con 0x7fd7a80aa0f0 2023-12-01T01:03:18.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.446+0000 7fd7a7fff700 1 -- 172.21.15.26:0/1531074008 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7b00cc4c0 con 0x7fd7c0100650 2023-12-01T01:03:18.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.446+0000 7fd7be59c700 1 --2- 172.21.15.26:0/1531074008 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd7a80a05b0 0x7fd7a80a2a70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400b5c0 tx=0x7fd7b4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:18.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.446+0000 7fd7bf59e700 1 --2- 172.21.15.26:0/1531074008 >> [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175] conn(0x7fd7a80aa0f0 0x7fd7a80ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.447+0000 7fd7bf59e700 1 --2- 172.21.15.26:0/1531074008 >> [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175] conn(0x7fd7a80aa0f0 0x7fd7a80ac590 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:18.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.447+0000 7fd7a7fff700 1 -- 172.21.15.26:0/1531074008 <== osd.10 v2:172.21.15.93:6824/1905842175 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd7a80acc60 con 0x7fd7a80aa0f0 2023-12-01T01:03:18.464 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.464+0000 7fd7c50fa700 1 -- 172.21.15.26:0/1531074008 --> [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7c01100d0 con 0x7fd7a80aa0f0 2023-12-01T01:03:18.465 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.464+0000 7fd7a7fff700 1 -- 172.21.15.26:0/1531074008 <== osd.10 v2:172.21.15.93:6824/1905842175 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd7b8009cd0 con 0x7fd7a80aa0f0 2023-12-01T01:03:18.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.465+0000 7fd7c50fa700 1 -- 172.21.15.26:0/1531074008 >> [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175] conn(0x7fd7a80aa0f0 msgr2=0x7fd7a80ac590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.465+0000 7fd7c50fa700 1 --2- 172.21.15.26:0/1531074008 >> [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175] conn(0x7fd7a80aa0f0 0x7fd7a80ac590 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.465+0000 7fd7c50fa700 1 -- 172.21.15.26:0/1531074008 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd7a80a05b0 msgr2=0x7fd7a80a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.465+0000 7fd7c50fa700 1 --2- 172.21.15.26:0/1531074008 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd7a80a05b0 0x7fd7a80a2a70 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400b5c0 tx=0x7fd7b4005fb0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.465+0000 7fd7c50fa700 1 -- 172.21.15.26:0/1531074008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7c0100650 msgr2=0x7fd7c0196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.465+0000 7fd7c50fa700 1 --2- 172.21.15.26:0/1531074008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7c0100650 0x7fd7c0196f90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000d980 tx=0x7fd7b000dd40 comp rx=0 tx=0).stop 2023-12-01T01:03:18.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.465+0000 7fd7bf59e700 1 -- 172.21.15.26:0/1531074008 reap_dead start 2023-12-01T01:03:18.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.465+0000 7fd7c50fa700 1 -- 172.21.15.26:0/1531074008 shutdown_connections 2023-12-01T01:03:18.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.465+0000 7fd7c50fa700 1 -- 172.21.15.26:0/1531074008 >> 172.21.15.26:0/1531074008 conn(0x7fd7c0076200 msgr2=0x7fd7c00fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:18.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.465+0000 7fd7c50fa700 1 -- 172.21.15.26:0/1531074008 shutdown_connections 2023-12-01T01:03:18.467 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.465+0000 7fd7c50fa700 1 -- 172.21.15.26:0/1531074008 wait complete. 2023-12-01T01:03:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.394+0000 7f66202c1700 1 -- 172.21.15.26:0/1494350021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66180ffca0 msgr2=0x7f6618100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.394+0000 7f66202c1700 1 --2- 172.21.15.26:0/1494350021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66180ffca0 0x7f6618100120 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6608009990 tx=0x7f6608009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.394+0000 7f66202c1700 1 -- 172.21.15.26:0/1494350021 shutdown_connections 2023-12-01T01:03:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.394+0000 7f66202c1700 1 --2- 172.21.15.26:0/1494350021 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6618100660 0x7f661810cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.394+0000 7f66202c1700 1 --2- 172.21.15.26:0/1494350021 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6618105d50 0x7f6618106130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.394+0000 7f66202c1700 1 --2- 172.21.15.26:0/1494350021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66180ffca0 0x7f6618100120 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.394+0000 7f66202c1700 1 -- 172.21.15.26:0/1494350021 >> 172.21.15.26:0/1494350021 conn(0x7f6618076de0 msgr2=0x7f66180771f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.395+0000 7f66202c1700 1 -- 172.21.15.26:0/1494350021 shutdown_connections 2023-12-01T01:03:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.395+0000 7f66202c1700 1 -- 172.21.15.26:0/1494350021 wait complete. 2023-12-01T01:03:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.395+0000 7f66202c1700 1 Processor -- start 2023-12-01T01:03:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.395+0000 7f66202c1700 1 -- start start 2023-12-01T01:03:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.395+0000 7f66202c1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66180ffca0 0x7f6618197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.395+0000 7f66202c1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6618100660 0x7f6618198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.395+0000 7f66202c1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6618105d50 0x7f66181a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.395+0000 7f66202c1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6618198b20 con 0x7f6618100660 2023-12-01T01:03:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.395+0000 7f66202c1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66181a32e0 con 0x7f66180ffca0 2023-12-01T01:03:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.395+0000 7f66202c1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66181a3420 con 0x7f6618105d50 2023-12-01T01:03:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.396+0000 7f661d85c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6618100660 0x7f6618198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.396+0000 7f661d85c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6618100660 0x7f6618198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53952/0 (socket says 172.21.15.26:53952) 2023-12-01T01:03:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.396+0000 7f661d85c700 1 -- 172.21.15.26:0/2897927366 learned_addr learned my addr 172.21.15.26:0/2897927366 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.396+0000 7f661e05d700 1 --2- 172.21.15.26:0/2897927366 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66180ffca0 0x7f6618197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.396+0000 7f661e85e700 1 --2- 172.21.15.26:0/2897927366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6618105d50 0x7f66181a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.396+0000 7f661d85c700 1 -- 172.21.15.26:0/2897927366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6618105d50 msgr2=0x7f66181a2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.396+0000 7f661d85c700 1 --2- 172.21.15.26:0/2897927366 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6618105d50 0x7f66181a2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.396+0000 7f661d85c700 1 -- 172.21.15.26:0/2897927366 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66180ffca0 msgr2=0x7f6618197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.396+0000 7f661d85c700 1 --2- 172.21.15.26:0/2897927366 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f66180ffca0 0x7f6618197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.396+0000 7f661d85c700 1 -- 172.21.15.26:0/2897927366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66080095f0 con 0x7f6618100660 2023-12-01T01:03:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.396+0000 7f661d85c700 1 --2- 172.21.15.26:0/2897927366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6618100660 0x7f6618198260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6608000c00 tx=0x7f660800f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.396+0000 7f660f7fe700 1 -- 172.21.15.26:0/2897927366 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660801d070 con 0x7f6618100660 2023-12-01T01:03:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.396+0000 7f66202c1700 1 -- 172.21.15.26:0/2897927366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66181a36a0 con 0x7f6618100660 2023-12-01T01:03:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.396+0000 7f660f7fe700 1 -- 172.21.15.26:0/2897927366 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f660800fb50 con 0x7f6618100660 2023-12-01T01:03:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.396+0000 7f660f7fe700 1 -- 172.21.15.26:0/2897927366 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608022ea0 con 0x7f6618100660 2023-12-01T01:03:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.396+0000 7f66202c1700 1 -- 172.21.15.26:0/2897927366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66181a3b40 con 0x7f6618100660 2023-12-01T01:03:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.397+0000 7f66202c1700 1 -- 172.21.15.26:0/2897927366 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6618110020 con 0x7f6618100660 2023-12-01T01:03:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.399+0000 7f660f7fe700 1 -- 172.21.15.26:0/2897927366 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f6608022470 con 0x7f6618100660 2023-12-01T01:03:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.399+0000 7f660f7fe700 1 --2- 172.21.15.26:0/2897927366 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f66040a05b0 0x7f66040a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.399+0000 7f661e05d700 1 --2- 172.21.15.26:0/2897927366 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f66040a05b0 0x7f66040a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.399+0000 7f660f7fe700 1 -- 172.21.15.26:0/2897927366 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f66080cd1f0 con 0x7f6618100660 2023-12-01T01:03:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.399+0000 7f660f7fe700 1 --2- 172.21.15.26:0/2897927366 >> [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198] conn(0x7f66040aa0f0 0x7f66040ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.399+0000 7f660f7fe700 1 -- 172.21.15.26:0/2897927366 --> [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66040acc60 con 0x7f66040aa0f0 2023-12-01T01:03:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.399+0000 7f660f7fe700 1 -- 172.21.15.26:0/2897927366 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66080cd560 con 0x7f6618100660 2023-12-01T01:03:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.400+0000 7f661e05d700 1 --2- 172.21.15.26:0/2897927366 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f66040a05b0 0x7f66040a2a70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6614005950 tx=0x7f661400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.400+0000 7f661e85e700 1 --2- 172.21.15.26:0/2897927366 >> [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198] conn(0x7f66040aa0f0 0x7f66040ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.400+0000 7f661e85e700 1 --2- 172.21.15.26:0/2897927366 >> [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198] conn(0x7f66040aa0f0 0x7f66040ac590 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.401+0000 7f660f7fe700 1 -- 172.21.15.26:0/2897927366 <== osd.11 v2:172.21.15.116:6824/3877607198 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f66040acc60 con 0x7f66040aa0f0 2023-12-01T01:03:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.417+0000 7f66202c1700 1 -- 172.21.15.26:0/2897927366 --> [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f661804ea90 con 0x7f66040aa0f0 2023-12-01T01:03:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.418+0000 7f660f7fe700 1 -- 172.21.15.26:0/2897927366 <== osd.11 v2:172.21.15.116:6824/3877607198 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f661804ea90 con 0x7f66040aa0f0 2023-12-01T01:03:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.418+0000 7f66202c1700 1 -- 172.21.15.26:0/2897927366 >> [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198] conn(0x7f66040aa0f0 msgr2=0x7f66040ac590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.418+0000 7f66202c1700 1 --2- 172.21.15.26:0/2897927366 >> [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198] conn(0x7f66040aa0f0 0x7f66040ac590 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.418+0000 7f66202c1700 1 -- 172.21.15.26:0/2897927366 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f66040a05b0 msgr2=0x7f66040a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.418+0000 7f66202c1700 1 --2- 172.21.15.26:0/2897927366 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f66040a05b0 0x7f66040a2a70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6614005950 tx=0x7f661400b410 comp rx=0 tx=0).stop 2023-12-01T01:03:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.418+0000 7f66202c1700 1 -- 172.21.15.26:0/2897927366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6618100660 msgr2=0x7f6618198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.418+0000 7f66202c1700 1 --2- 172.21.15.26:0/2897927366 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6618100660 0x7f6618198260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6608000c00 tx=0x7f660800f710 comp rx=0 tx=0).stop 2023-12-01T01:03:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.418+0000 7f661e85e700 1 -- 172.21.15.26:0/2897927366 reap_dead start 2023-12-01T01:03:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.418+0000 7f66202c1700 1 -- 172.21.15.26:0/2897927366 shutdown_connections 2023-12-01T01:03:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.418+0000 7f66202c1700 1 -- 172.21.15.26:0/2897927366 >> 172.21.15.26:0/2897927366 conn(0x7f6618076de0 msgr2=0x7f66180fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:18.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.419+0000 7f66202c1700 1 -- 172.21.15.26:0/2897927366 shutdown_connections 2023-12-01T01:03:18.733 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:18.419+0000 7f66202c1700 1 -- 172.21.15.26:0/2897927366 wait complete. 2023-12-01T01:03:18.802 INFO:teuthology.orchestra.run.smithi026.stdout:34359738428 2023-12-01T01:03:18.802 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-01T01:03:18.996 INFO:teuthology.orchestra.run.smithi026.stdout:158913789994 2023-12-01T01:03:18.996 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-01T01:03:19.372 INFO:teuthology.orchestra.run.smithi026.stdout:296352743446 2023-12-01T01:03:19.372 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.10 2023-12-01T01:03:19.565 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:19.770 INFO:teuthology.orchestra.run.smithi026.stdout:55834574905 2023-12-01T01:03:19.770 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-01T01:03:19.949 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:19.950 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:19.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:19 smithi093 ceph-mon[103327]: pgmap v263: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-01T01:03:19.978 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:20.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:19 smithi026 ceph-mon[98801]: pgmap v263: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-01T01:03:20.136 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:20.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:19 smithi116 ceph-mon[103554]: pgmap v263: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-01T01:03:20.246 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:20.283 INFO:teuthology.orchestra.run.smithi026.stdout:326417514514 2023-12-01T01:03:20.284 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph osd last-stat-seq osd.11 2023-12-01T01:03:21.287 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:21.287 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:21.287 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:21.332 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:21.884 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:21 smithi026 ceph-mon[98801]: pgmap v264: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-01T01:03:21.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:21 smithi093 ceph-mon[103327]: pgmap v264: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-01T01:03:22.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:21 smithi116 ceph-mon[103554]: pgmap v264: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-01T01:03:23.698 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:23 smithi026 ceph-mon[98801]: pgmap v265: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-01T01:03:23.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:23 smithi093 ceph-mon[103327]: pgmap v265: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-01T01:03:24.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:23 smithi116 ceph-mon[103554]: pgmap v265: 97 pgs: 97 active+clean; 637 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2023-12-01T01:03:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.608+0000 7fafc7585700 1 -- 172.21.15.26:0/3909620971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc0106f20 msgr2=0x7fafc0107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.608+0000 7fafc7585700 1 --2- 172.21.15.26:0/3909620971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc0106f20 0x7fafc0107300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009990 tx=0x7fafbc009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.608+0000 7fafc7585700 1 -- 172.21.15.26:0/3909620971 shutdown_connections 2023-12-01T01:03:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.608+0000 7fafc7585700 1 --2- 172.21.15.26:0/3909620971 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fafc0069270 0x7fafc010dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.608+0000 7fafc7585700 1 --2- 172.21.15.26:0/3909620971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc0106f20 0x7fafc0107300 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.608+0000 7fafc7585700 1 --2- 172.21.15.26:0/3909620971 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fafc00688b0 0x7fafc0068d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.608+0000 7fafc7585700 1 -- 172.21.15.26:0/3909620971 >> 172.21.15.26:0/3909620971 conn(0x7fafc0076d90 msgr2=0x7fafc00771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.608+0000 7fafc7585700 1 -- 172.21.15.26:0/3909620971 shutdown_connections 2023-12-01T01:03:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.608+0000 7fafc7585700 1 -- 172.21.15.26:0/3909620971 wait complete. 2023-12-01T01:03:24.652 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc7585700 1 Processor -- start 2023-12-01T01:03:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc7585700 1 -- start start 2023-12-01T01:03:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc7585700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00688b0 0x7fafc00ffd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc7585700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fafc0069270 0x7fafc0100280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc7585700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fafc0106f20 0x7fafc0100800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc7585700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc01a53d0 con 0x7fafc00688b0 2023-12-01T01:03:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc7585700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc01a5540 con 0x7fafc0069270 2023-12-01T01:03:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc7585700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc01a5700 con 0x7fafc0106f20 2023-12-01T01:03:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc5321700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00688b0 0x7fafc00ffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc5321700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00688b0 0x7fafc00ffd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53982/0 (socket says 172.21.15.26:53982) 2023-12-01T01:03:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc5321700 1 -- 172.21.15.26:0/255193695 learned_addr learned my addr 172.21.15.26:0/255193695 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc4b20700 1 --2- 172.21.15.26:0/255193695 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fafc0069270 0x7fafc0100280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc5b22700 1 --2- 172.21.15.26:0/255193695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fafc0106f20 0x7fafc0100800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc5321700 1 -- 172.21.15.26:0/255193695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fafc0106f20 msgr2=0x7fafc0100800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc5321700 1 --2- 172.21.15.26:0/255193695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fafc0106f20 0x7fafc0100800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:24.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc5321700 1 -- 172.21.15.26:0/255193695 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fafc0069270 msgr2=0x7fafc0100280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc5321700 1 --2- 172.21.15.26:0/255193695 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fafc0069270 0x7fafc0100280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc5321700 1 -- 172.21.15.26:0/255193695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc0095f0 con 0x7fafc00688b0 2023-12-01T01:03:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc5b22700 1 --2- 172.21.15.26:0/255193695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fafc0106f20 0x7fafc0100800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:03:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafc5321700 1 --2- 172.21.15.26:0/255193695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00688b0 0x7fafc00ffd40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fafbc000c00 tx=0x7fafbc00f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.609+0000 7fafb67fc700 1 -- 172.21.15.26:0/255193695 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc01d070 con 0x7fafc00688b0 2023-12-01T01:03:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.610+0000 7fafc7585700 1 -- 172.21.15.26:0/255193695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc01a5980 con 0x7fafc00688b0 2023-12-01T01:03:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.610+0000 7fafb67fc700 1 -- 172.21.15.26:0/255193695 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fafbc00fc00 con 0x7fafc00688b0 2023-12-01T01:03:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.610+0000 7fafb67fc700 1 -- 172.21.15.26:0/255193695 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc017650 con 0x7fafc00688b0 2023-12-01T01:03:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.610+0000 7fafc7585700 1 -- 172.21.15.26:0/255193695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc01a5e20 con 0x7fafc00688b0 2023-12-01T01:03:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.610+0000 7fafc7585700 1 -- 172.21.15.26:0/255193695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc004ea90 con 0x7fafc00688b0 2023-12-01T01:03:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.612+0000 7fafb67fc700 1 -- 172.21.15.26:0/255193695 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fafbc022470 con 0x7fafc00688b0 2023-12-01T01:03:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.612+0000 7fafb67fc700 1 --2- 172.21.15.26:0/255193695 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fafac0a05b0 0x7fafac0a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:24.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.612+0000 7fafc4b20700 1 --2- 172.21.15.26:0/255193695 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fafac0a05b0 0x7fafac0a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:24.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.612+0000 7fafb67fc700 1 -- 172.21.15.26:0/255193695 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fafbc0cd650 con 0x7fafc00688b0 2023-12-01T01:03:24.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.613+0000 7fafc4b20700 1 --2- 172.21.15.26:0/255193695 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fafac0a05b0 0x7fafac0a2a70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fafc0101530 tx=0x7fafb0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:24.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.616+0000 7fafb67fc700 1 -- 172.21.15.26:0/255193695 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fafbc097130 con 0x7fafc00688b0 2023-12-01T01:03:24.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.827+0000 7fafc7585700 1 -- 172.21.15.26:0/255193695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fafc01a6080 con 0x7fafc00688b0 2023-12-01T01:03:24.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.828+0000 7fafb67fc700 1 -- 172.21.15.26:0/255193695 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fafbc09a750 con 0x7fafc00688b0 2023-12-01T01:03:24.655 INFO:teuthology.orchestra.run.smithi026.stdout:193273528358 2023-12-01T01:03:24.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.830+0000 7fafc7585700 1 -- 172.21.15.26:0/255193695 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fafac0a05b0 msgr2=0x7fafac0a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:24.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.830+0000 7fafc7585700 1 --2- 172.21.15.26:0/255193695 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fafac0a05b0 0x7fafac0a2a70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fafc0101530 tx=0x7fafb0009190 comp rx=0 tx=0).stop 2023-12-01T01:03:24.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.830+0000 7fafc7585700 1 -- 172.21.15.26:0/255193695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00688b0 msgr2=0x7fafc00ffd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:24.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.830+0000 7fafc7585700 1 --2- 172.21.15.26:0/255193695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00688b0 0x7fafc00ffd40 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fafbc000c00 tx=0x7fafbc00f710 comp rx=0 tx=0).stop 2023-12-01T01:03:24.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.830+0000 7fafc7585700 1 -- 172.21.15.26:0/255193695 shutdown_connections 2023-12-01T01:03:24.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.830+0000 7fafc7585700 1 --2- 172.21.15.26:0/255193695 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fafac0a05b0 0x7fafac0a2a70 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:24.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.830+0000 7fafc7585700 1 --2- 172.21.15.26:0/255193695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fafc0106f20 0x7fafc0100800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:24.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.830+0000 7fafc7585700 1 --2- 172.21.15.26:0/255193695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fafc00688b0 0x7fafc00ffd40 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:24.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.830+0000 7fafc7585700 1 --2- 172.21.15.26:0/255193695 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fafc0069270 0x7fafc0100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:24.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.830+0000 7fafc7585700 1 -- 172.21.15.26:0/255193695 >> 172.21.15.26:0/255193695 conn(0x7fafc0076d90 msgr2=0x7fafc0104ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:24.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.830+0000 7fafc7585700 1 -- 172.21.15.26:0/255193695 shutdown_connections 2023-12-01T01:03:24.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:23.830+0000 7fafc7585700 1 -- 172.21.15.26:0/255193695 wait complete. 2023-12-01T01:03:24.785 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:24 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/255193695' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-12-01T01:03:24.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:24 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/255193695' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-12-01T01:03:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.143+0000 7f2efe77c700 1 -- 172.21.15.26:0/1627059159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ef8100690 msgr2=0x7f2ef810cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.143+0000 7f2efe77c700 1 --2- 172.21.15.26:0/1627059159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ef8100690 0x7f2ef810cb30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000b0a0 tx=0x7f2ef000b3b0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.144+0000 7f2efe77c700 1 -- 172.21.15.26:0/1627059159 shutdown_connections 2023-12-01T01:03:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.144+0000 7f2efe77c700 1 --2- 172.21.15.26:0/1627059159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ef8100690 0x7f2ef810cb30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.144+0000 7f2efe77c700 1 --2- 172.21.15.26:0/1627059159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ef8105d80 0x7f2ef8106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.144+0000 7f2efe77c700 1 --2- 172.21.15.26:0/1627059159 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef80ffcd0 0x7f2ef8100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.144+0000 7f2efe77c700 1 -- 172.21.15.26:0/1627059159 >> 172.21.15.26:0/1627059159 conn(0x7f2ef8076d90 msgr2=0x7f2ef80771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.144+0000 7f2efe77c700 1 -- 172.21.15.26:0/1627059159 shutdown_connections 2023-12-01T01:03:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.144+0000 7f2efe77c700 1 -- 172.21.15.26:0/1627059159 wait complete. 2023-12-01T01:03:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.144+0000 7f2efe77c700 1 Processor -- start 2023-12-01T01:03:25.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.144+0000 7f2efe77c700 1 -- start start 2023-12-01T01:03:25.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.145+0000 7f2efe77c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef80ffcd0 0x7f2ef8197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:25.147 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.145+0000 7f2efe77c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ef8100690 0x7f2ef8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.145+0000 7f2efe77c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ef8105d80 0x7f2ef81a2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.145+0000 7f2efe77c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef81a33e0 con 0x7f2ef8100690 2023-12-01T01:03:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.145+0000 7f2efe77c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef81a3520 con 0x7f2ef80ffcd0 2023-12-01T01:03:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.145+0000 7f2efe77c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef81a3660 con 0x7f2ef8105d80 2023-12-01T01:03:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.145+0000 7f2ef77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ef8100690 0x7f2ef8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.145+0000 7f2ef77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ef8100690 0x7f2ef8198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53996/0 (socket says 172.21.15.26:53996) 2023-12-01T01:03:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.145+0000 7f2ef77fe700 1 -- 172.21.15.26:0/1621170313 learned_addr learned my addr 172.21.15.26:0/1621170313 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.145+0000 7f2ef7fff700 1 --2- 172.21.15.26:0/1621170313 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef80ffcd0 0x7f2ef8197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.145+0000 7f2efcd19700 1 --2- 172.21.15.26:0/1621170313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ef8105d80 0x7f2ef81a2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.145+0000 7f2ef77fe700 1 -- 172.21.15.26:0/1621170313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ef8105d80 msgr2=0x7f2ef81a2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.145+0000 7f2ef77fe700 1 --2- 172.21.15.26:0/1621170313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ef8105d80 0x7f2ef81a2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.145+0000 7f2ef77fe700 1 -- 172.21.15.26:0/1621170313 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef80ffcd0 msgr2=0x7f2ef8197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.145+0000 7f2ef77fe700 1 --2- 172.21.15.26:0/1621170313 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef80ffcd0 0x7f2ef8197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.148 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.145+0000 7f2ef77fe700 1 -- 172.21.15.26:0/1621170313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef0009d00 con 0x7f2ef8100690 2023-12-01T01:03:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.146+0000 7f2ef77fe700 1 --2- 172.21.15.26:0/1621170313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ef8100690 0x7f2ef8198360 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00d950 tx=0x7f2eec00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.146+0000 7f2ef57fa700 1 -- 172.21.15.26:0/1621170313 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00f890 con 0x7f2ef8100690 2023-12-01T01:03:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.146+0000 7f2efe77c700 1 -- 172.21.15.26:0/1621170313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef81a38c0 con 0x7f2ef8100690 2023-12-01T01:03:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.146+0000 7f2ef57fa700 1 -- 172.21.15.26:0/1621170313 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2eec010460 con 0x7f2ef8100690 2023-12-01T01:03:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.146+0000 7f2ef57fa700 1 -- 172.21.15.26:0/1621170313 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00e610 con 0x7f2ef8100690 2023-12-01T01:03:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.146+0000 7f2efe77c700 1 -- 172.21.15.26:0/1621170313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef81a3d90 con 0x7f2ef8100690 2023-12-01T01:03:25.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.147+0000 7f2efe77c700 1 -- 172.21.15.26:0/1621170313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ef804ea90 con 0x7f2ef8100690 2023-12-01T01:03:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.148+0000 7f2ef57fa700 1 -- 172.21.15.26:0/1621170313 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f2eec010960 con 0x7f2ef8100690 2023-12-01T01:03:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.149+0000 7f2ef57fa700 1 --2- 172.21.15.26:0/1621170313 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2ee00a05b0 0x7f2ee00a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.149+0000 7f2ef7fff700 1 --2- 172.21.15.26:0/1621170313 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2ee00a05b0 0x7f2ee00a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.149+0000 7f2ef57fa700 1 -- 172.21.15.26:0/1621170313 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2eec0cb8f0 con 0x7f2ef8100690 2023-12-01T01:03:25.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.149+0000 7f2ef7fff700 1 --2- 172.21.15.26:0/1621170313 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2ee00a05b0 0x7f2ee00a2a70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8005950 tx=0x7f2ee800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:25.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.153+0000 7f2ef57fa700 1 -- 172.21.15.26:0/1621170313 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2eec0952e0 con 0x7f2ef8100690 2023-12-01T01:03:25.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:24 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/255193695' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-12-01T01:03:25.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.369+0000 7f2efe77c700 1 -- 172.21.15.26:0/1621170313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2ef8068ea0 con 0x7f2ef8100690 2023-12-01T01:03:25.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.370+0000 7f2ef57fa700 1 -- 172.21.15.26:0/1621170313 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2eec016090 con 0x7f2ef8100690 2023-12-01T01:03:25.371 INFO:teuthology.orchestra.run.smithi026.stdout:107374182450 2023-12-01T01:03:25.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.372+0000 7f2efe77c700 1 -- 172.21.15.26:0/1621170313 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2ee00a05b0 msgr2=0x7f2ee00a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:25.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.372+0000 7f2efe77c700 1 --2- 172.21.15.26:0/1621170313 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2ee00a05b0 0x7f2ee00a2a70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8005950 tx=0x7f2ee800a300 comp rx=0 tx=0).stop 2023-12-01T01:03:25.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.372+0000 7f2efe77c700 1 -- 172.21.15.26:0/1621170313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ef8100690 msgr2=0x7f2ef8198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:25.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.372+0000 7f2efe77c700 1 --2- 172.21.15.26:0/1621170313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ef8100690 0x7f2ef8198360 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2eec00d950 tx=0x7f2eec00dc60 comp rx=0 tx=0).stop 2023-12-01T01:03:25.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.372+0000 7f2efe77c700 1 -- 172.21.15.26:0/1621170313 shutdown_connections 2023-12-01T01:03:25.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.372+0000 7f2efe77c700 1 --2- 172.21.15.26:0/1621170313 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2ee00a05b0 0x7f2ee00a2a70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.372+0000 7f2efe77c700 1 --2- 172.21.15.26:0/1621170313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2ef8105d80 0x7f2ef81a2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.372+0000 7f2efe77c700 1 --2- 172.21.15.26:0/1621170313 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2ef80ffcd0 0x7f2ef8197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.372+0000 7f2efe77c700 1 --2- 172.21.15.26:0/1621170313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ef8100690 0x7f2ef8198360 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.372+0000 7f2efe77c700 1 -- 172.21.15.26:0/1621170313 >> 172.21.15.26:0/1621170313 conn(0x7f2ef8076d90 msgr2=0x7f2ef8103930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:25.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.372+0000 7f2efe77c700 1 -- 172.21.15.26:0/1621170313 shutdown_connections 2023-12-01T01:03:25.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.372+0000 7f2efe77c700 1 -- 172.21.15.26:0/1621170313 wait complete. 2023-12-01T01:03:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.378+0000 7f3f58ffe700 1 -- 172.21.15.26:0/3628079876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f54106f40 msgr2=0x7f3f54107320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.378+0000 7f3f58ffe700 1 --2- 172.21.15.26:0/3628079876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f54106f40 0x7f3f54107320 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3f44009990 tx=0x7f3f44009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.379+0000 7f3f58ffe700 1 -- 172.21.15.26:0/3628079876 shutdown_connections 2023-12-01T01:03:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.379+0000 7f3f58ffe700 1 --2- 172.21.15.26:0/3628079876 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f54100030 0x7f3f5410dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.379+0000 7f3f58ffe700 1 --2- 172.21.15.26:0/3628079876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f54106f40 0x7f3f54107320 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.379+0000 7f3f58ffe700 1 --2- 172.21.15.26:0/3628079876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3f540ff670 0x7f3f540ffaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.379+0000 7f3f58ffe700 1 -- 172.21.15.26:0/3628079876 >> 172.21.15.26:0/3628079876 conn(0x7f3f54075020 msgr2=0x7f3f54075430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.379+0000 7f3f58ffe700 1 -- 172.21.15.26:0/3628079876 shutdown_connections 2023-12-01T01:03:25.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.379+0000 7f3f58ffe700 1 -- 172.21.15.26:0/3628079876 wait complete. 2023-12-01T01:03:25.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.380+0000 7f3f58ffe700 1 Processor -- start 2023-12-01T01:03:25.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.380+0000 7f3f58ffe700 1 -- start start 2023-12-01T01:03:25.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.380+0000 7f3f58ffe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3f540ff670 0x7f3f54100850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:25.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.380+0000 7f3f58ffe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f54100030 0x7f3f54100d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:25.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.380+0000 7f3f58ffe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f54106f40 0x7f3f54101310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:25.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.380+0000 7f3f58ffe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f541a5510 con 0x7f3f54100030 2023-12-01T01:03:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.380+0000 7f3f58ffe700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f541a5680 con 0x7f3f54106f40 2023-12-01T01:03:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.380+0000 7f3f58ffe700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f541a5840 con 0x7f3f540ff670 2023-12-01T01:03:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.380+0000 7f3f51d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f54100030 0x7f3f54100d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.380+0000 7f3f51d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f54100030 0x7f3f54100d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54010/0 (socket says 172.21.15.26:54010) 2023-12-01T01:03:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.380+0000 7f3f51d9b700 1 -- 172.21.15.26:0/2931441766 learned_addr learned my addr 172.21.15.26:0/2931441766 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.380+0000 7f3f52d9d700 1 --2- 172.21.15.26:0/2931441766 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f54106f40 0x7f3f54101310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.381+0000 7f3f5259c700 1 --2- 172.21.15.26:0/2931441766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3f540ff670 0x7f3f54100850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.381+0000 7f3f51d9b700 1 -- 172.21.15.26:0/2931441766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3f540ff670 msgr2=0x7f3f54100850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.381+0000 7f3f51d9b700 1 --2- 172.21.15.26:0/2931441766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3f540ff670 0x7f3f54100850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.381+0000 7f3f51d9b700 1 -- 172.21.15.26:0/2931441766 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f54106f40 msgr2=0x7f3f54101310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.381+0000 7f3f51d9b700 1 --2- 172.21.15.26:0/2931441766 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f54106f40 0x7f3f54101310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.381+0000 7f3f51d9b700 1 -- 172.21.15.26:0/2931441766 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f440095f0 con 0x7f3f54100030 2023-12-01T01:03:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.381+0000 7f3f5259c700 1 --2- 172.21.15.26:0/2931441766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3f540ff670 0x7f3f54100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:03:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.381+0000 7f3f51d9b700 1 --2- 172.21.15.26:0/2931441766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f54100030 0x7f3f54100d90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800c970 tx=0x7f3f4800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:25.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.381+0000 7f3f437fe700 1 -- 172.21.15.26:0/2931441766 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48007aa0 con 0x7f3f54100030 2023-12-01T01:03:25.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.381+0000 7f3f58ffe700 1 -- 172.21.15.26:0/2931441766 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f541a5b20 con 0x7f3f54100030 2023-12-01T01:03:25.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.381+0000 7f3f437fe700 1 -- 172.21.15.26:0/2931441766 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3f48004d10 con 0x7f3f54100030 2023-12-01T01:03:25.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.381+0000 7f3f437fe700 1 -- 172.21.15.26:0/2931441766 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480055c0 con 0x7f3f54100030 2023-12-01T01:03:25.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.381+0000 7f3f58ffe700 1 -- 172.21.15.26:0/2931441766 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f541a5fd0 con 0x7f3f54100030 2023-12-01T01:03:25.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.382+0000 7f3f58ffe700 1 -- 172.21.15.26:0/2931441766 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5404ea90 con 0x7f3f54100030 2023-12-01T01:03:25.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.384+0000 7f3f437fe700 1 -- 172.21.15.26:0/2931441766 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f3f48007c00 con 0x7f3f54100030 2023-12-01T01:03:25.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.385+0000 7f3f437fe700 1 --2- 172.21.15.26:0/2931441766 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3f3c0a05b0 0x7f3f3c0a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:25.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.385+0000 7f3f5259c700 1 --2- 172.21.15.26:0/2931441766 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3f3c0a05b0 0x7f3f3c0a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:25.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.385+0000 7f3f437fe700 1 -- 172.21.15.26:0/2931441766 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3f48013070 con 0x7f3f54100030 2023-12-01T01:03:25.387 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.386+0000 7f3f5259c700 1 --2- 172.21.15.26:0/2931441766 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3f3c0a05b0 0x7f3f3c0a2a70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3f44006010 tx=0x7f3f4400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:25.389 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.389+0000 7f3f437fe700 1 -- 172.21.15.26:0/2931441766 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3f480956b0 con 0x7f3f54100030 2023-12-01T01:03:25.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.604+0000 7f3f58ffe700 1 -- 172.21.15.26:0/2931441766 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f3f541a61c0 con 0x7f3f54100030 2023-12-01T01:03:25.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.605+0000 7f3f437fe700 1 -- 172.21.15.26:0/2931441766 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f3f48098cd0 con 0x7f3f54100030 2023-12-01T01:03:25.607 INFO:teuthology.orchestra.run.smithi026.stdout:244813135902 2023-12-01T01:03:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.607+0000 7f3f58ffe700 1 -- 172.21.15.26:0/2931441766 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3f3c0a05b0 msgr2=0x7f3f3c0a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.607+0000 7f3f58ffe700 1 --2- 172.21.15.26:0/2931441766 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3f3c0a05b0 0x7f3f3c0a2a70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3f44006010 tx=0x7f3f4400b540 comp rx=0 tx=0).stop 2023-12-01T01:03:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.607+0000 7f3f58ffe700 1 -- 172.21.15.26:0/2931441766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f54100030 msgr2=0x7f3f54100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.607+0000 7f3f58ffe700 1 --2- 172.21.15.26:0/2931441766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f54100030 0x7f3f54100d90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800c970 tx=0x7f3f4800cc80 comp rx=0 tx=0).stop 2023-12-01T01:03:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.607+0000 7f3f58ffe700 1 -- 172.21.15.26:0/2931441766 shutdown_connections 2023-12-01T01:03:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.607+0000 7f3f58ffe700 1 --2- 172.21.15.26:0/2931441766 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3f3c0a05b0 0x7f3f3c0a2a70 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.607+0000 7f3f58ffe700 1 --2- 172.21.15.26:0/2931441766 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3f54106f40 0x7f3f54101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.607+0000 7f3f58ffe700 1 --2- 172.21.15.26:0/2931441766 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3f540ff670 0x7f3f54100850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.607+0000 7f3f58ffe700 1 --2- 172.21.15.26:0/2931441766 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3f54100030 0x7f3f54100d90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.607+0000 7f3f58ffe700 1 -- 172.21.15.26:0/2931441766 >> 172.21.15.26:0/2931441766 conn(0x7f3f54075020 msgr2=0x7f3f54104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.607+0000 7f3f58ffe700 1 -- 172.21.15.26:0/2931441766 shutdown_connections 2023-12-01T01:03:25.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.607+0000 7f3f58ffe700 1 -- 172.21.15.26:0/2931441766 wait complete. 2023-12-01T01:03:25.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.442+0000 7f762bf21700 1 -- 172.21.15.26:0/2075417104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76241007b0 msgr2=0x7f7624100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:25.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.442+0000 7f762bf21700 1 --2- 172.21.15.26:0/2075417104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76241007b0 0x7f7624100b90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7620009990 tx=0x7f7620009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.442+0000 7f762bf21700 1 -- 172.21.15.26:0/2075417104 shutdown_connections 2023-12-01T01:03:25.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.442+0000 7f762bf21700 1 --2- 172.21.15.26:0/2075417104 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f762410d820 0x7f762410fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.442+0000 7f762bf21700 1 --2- 172.21.15.26:0/2075417104 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76241007b0 0x7f7624100b90 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.442+0000 7f762bf21700 1 --2- 172.21.15.26:0/2075417104 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76241010d0 0x7f762410d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.442+0000 7f762bf21700 1 -- 172.21.15.26:0/2075417104 >> 172.21.15.26:0/2075417104 conn(0x7f7624076d90 msgr2=0x7f76240771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.442+0000 7f762bf21700 1 -- 172.21.15.26:0/2075417104 shutdown_connections 2023-12-01T01:03:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.442+0000 7f762bf21700 1 -- 172.21.15.26:0/2075417104 wait complete. 2023-12-01T01:03:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.443+0000 7f762bf21700 1 Processor -- start 2023-12-01T01:03:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.443+0000 7f762bf21700 1 -- start start 2023-12-01T01:03:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.443+0000 7f762bf21700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76241007b0 0x7f7624199170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.443+0000 7f762bf21700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76241010d0 0x7f76241996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.443+0000 7f762bf21700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f762410d820 0x7f762419db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.443+0000 7f762bf21700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762419e130 con 0x7f76241007b0 2023-12-01T01:03:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.443+0000 7f762bf21700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762419e2a0 con 0x7f762410d820 2023-12-01T01:03:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.443+0000 7f762bf21700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762419e460 con 0x7f76241010d0 2023-12-01T01:03:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.443+0000 7f7629cbd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76241007b0 0x7f7624199170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:25.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.443+0000 7f7629cbd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76241007b0 0x7f7624199170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54020/0 (socket says 172.21.15.26:54020) 2023-12-01T01:03:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.444+0000 7f7629cbd700 1 -- 172.21.15.26:0/575022107 learned_addr learned my addr 172.21.15.26:0/575022107 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.444+0000 7f762a4be700 1 --2- 172.21.15.26:0/575022107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f762410d820 0x7f762419db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.444+0000 7f76294bc700 1 --2- 172.21.15.26:0/575022107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76241010d0 0x7f76241996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.444+0000 7f7629cbd700 1 -- 172.21.15.26:0/575022107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76241010d0 msgr2=0x7f76241996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.444+0000 7f7629cbd700 1 --2- 172.21.15.26:0/575022107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76241010d0 0x7f76241996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.444+0000 7f7629cbd700 1 -- 172.21.15.26:0/575022107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f762410d820 msgr2=0x7f762419db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.444+0000 7f7629cbd700 1 --2- 172.21.15.26:0/575022107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f762410d820 0x7f762419db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.444+0000 7f7629cbd700 1 -- 172.21.15.26:0/575022107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76200095f0 con 0x7f76241007b0 2023-12-01T01:03:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.444+0000 7f7629cbd700 1 --2- 172.21.15.26:0/575022107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76241007b0 0x7f7624199170 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f76200098e0 tx=0x7f762000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.444+0000 7f761affd700 1 -- 172.21.15.26:0/575022107 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762001d070 con 0x7f76241007b0 2023-12-01T01:03:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.444+0000 7f762bf21700 1 -- 172.21.15.26:0/575022107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762419e6e0 con 0x7f76241007b0 2023-12-01T01:03:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.444+0000 7f761affd700 1 -- 172.21.15.26:0/575022107 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7620003680 con 0x7f76241007b0 2023-12-01T01:03:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.444+0000 7f761affd700 1 -- 172.21.15.26:0/575022107 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76200173f0 con 0x7f76241007b0 2023-12-01T01:03:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.444+0000 7f762bf21700 1 -- 172.21.15.26:0/575022107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76241a5fa0 con 0x7f76241007b0 2023-12-01T01:03:25.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.446+0000 7f762bf21700 1 -- 172.21.15.26:0/575022107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762404ea90 con 0x7f76241007b0 2023-12-01T01:03:25.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.447+0000 7f761affd700 1 -- 172.21.15.26:0/575022107 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f7620017550 con 0x7f76241007b0 2023-12-01T01:03:25.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.448+0000 7f761affd700 1 --2- 172.21.15.26:0/575022107 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f76100a05b0 0x7f76100a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:25.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.448+0000 7f761affd700 1 -- 172.21.15.26:0/575022107 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f76200ccca0 con 0x7f76241007b0 2023-12-01T01:03:25.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.448+0000 7f76294bc700 1 --2- 172.21.15.26:0/575022107 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f76100a05b0 0x7f76100a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:25.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.449+0000 7f76294bc700 1 --2- 172.21.15.26:0/575022107 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f76100a05b0 0x7f76100a2a70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f762419a790 tx=0x7f761400bef0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:25.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.453+0000 7f761affd700 1 -- 172.21.15.26:0/575022107 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f762005d0e0 con 0x7f76241007b0 2023-12-01T01:03:25.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.687+0000 7f762bf21700 1 -- 172.21.15.26:0/575022107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f76241a6130 con 0x7f76241007b0 2023-12-01T01:03:25.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.687+0000 7f761affd700 1 -- 172.21.15.26:0/575022107 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7620027090 con 0x7f76241007b0 2023-12-01T01:03:25.714 INFO:teuthology.orchestra.run.smithi026.stdout:274877906970 2023-12-01T01:03:25.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.689+0000 7f762bf21700 1 -- 172.21.15.26:0/575022107 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f76100a05b0 msgr2=0x7f76100a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:25.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.689+0000 7f762bf21700 1 --2- 172.21.15.26:0/575022107 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f76100a05b0 0x7f76100a2a70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f762419a790 tx=0x7f761400bef0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.689+0000 7f762bf21700 1 -- 172.21.15.26:0/575022107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76241007b0 msgr2=0x7f7624199170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:25.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.689+0000 7f762bf21700 1 --2- 172.21.15.26:0/575022107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76241007b0 0x7f7624199170 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f76200098e0 tx=0x7f762000f690 comp rx=0 tx=0).stop 2023-12-01T01:03:25.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.689+0000 7f762bf21700 1 -- 172.21.15.26:0/575022107 shutdown_connections 2023-12-01T01:03:25.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.689+0000 7f762bf21700 1 --2- 172.21.15.26:0/575022107 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f76100a05b0 0x7f76100a2a70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.689+0000 7f762bf21700 1 --2- 172.21.15.26:0/575022107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f762410d820 0x7f762419db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.689+0000 7f762bf21700 1 --2- 172.21.15.26:0/575022107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76241007b0 0x7f7624199170 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.689+0000 7f762bf21700 1 --2- 172.21.15.26:0/575022107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f76241010d0 0x7f76241996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:25.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.689+0000 7f762bf21700 1 -- 172.21.15.26:0/575022107 >> 172.21.15.26:0/575022107 conn(0x7f7624076d90 msgr2=0x7f762410ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:25.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.689+0000 7f762bf21700 1 -- 172.21.15.26:0/575022107 shutdown_connections 2023-12-01T01:03:25.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:25.689+0000 7f762bf21700 1 -- 172.21.15.26:0/575022107 wait complete. 2023-12-01T01:03:25.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:25 smithi093 ceph-mon[103327]: pgmap v266: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-01T01:03:25.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:25 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1621170313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-01T01:03:25.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:25 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2931441766' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-12-01T01:03:25.966 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:25 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/575022107' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-12-01T01:03:25.973 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:25 smithi026 ceph-mon[98801]: pgmap v266: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-01T01:03:25.973 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:25 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1621170313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-01T01:03:25.973 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:25 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2931441766' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-12-01T01:03:25.973 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:25 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/575022107' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-12-01T01:03:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:25 smithi116 ceph-mon[103554]: pgmap v266: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-01T01:03:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:25 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1621170313' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-01T01:03:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:25 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2931441766' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-12-01T01:03:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:25 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/575022107' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-12-01T01:03:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.502+0000 7efe3ea49700 1 -- 172.21.15.26:0/2188858126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe381018f0 msgr2=0x7efe38101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.502+0000 7efe3ea49700 1 --2- 172.21.15.26:0/2188858126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe381018f0 0x7efe38101d70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7efe2c0099c0 tx=0x7efe2c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.502+0000 7efe3ea49700 1 -- 172.21.15.26:0/2188858126 shutdown_connections 2023-12-01T01:03:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.502+0000 7efe3ea49700 1 --2- 172.21.15.26:0/2188858126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe381022b0 0x7efe3810cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.502+0000 7efe3ea49700 1 --2- 172.21.15.26:0/2188858126 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe38100010 0x7efe381003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.502+0000 7efe3ea49700 1 --2- 172.21.15.26:0/2188858126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe381018f0 0x7efe38101d70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.502+0000 7efe3ea49700 1 -- 172.21.15.26:0/2188858126 >> 172.21.15.26:0/2188858126 conn(0x7efe38076d80 msgr2=0x7efe38077190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.502+0000 7efe3ea49700 1 -- 172.21.15.26:0/2188858126 shutdown_connections 2023-12-01T01:03:26.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.502+0000 7efe3ea49700 1 -- 172.21.15.26:0/2188858126 wait complete. 2023-12-01T01:03:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.503+0000 7efe3ea49700 1 Processor -- start 2023-12-01T01:03:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.503+0000 7efe3ea49700 1 -- start start 2023-12-01T01:03:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.504+0000 7efe3ea49700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe38100010 0x7efe38195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.504+0000 7efe3ea49700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe381018f0 0x7efe381964a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.504+0000 7efe3ea49700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe381022b0 0x7efe3819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.504+0000 7efe3ea49700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3819af20 con 0x7efe381018f0 2023-12-01T01:03:26.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.504+0000 7efe3ea49700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3819b090 con 0x7efe38100010 2023-12-01T01:03:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.504+0000 7efe3ea49700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3819b250 con 0x7efe381022b0 2023-12-01T01:03:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.504+0000 7efe377fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe381018f0 0x7efe381964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.504+0000 7efe377fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe381018f0 0x7efe381964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54036/0 (socket says 172.21.15.26:54036) 2023-12-01T01:03:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.504+0000 7efe377fe700 1 -- 172.21.15.26:0/739798392 learned_addr learned my addr 172.21.15.26:0/739798392 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.504+0000 7efe37fff700 1 --2- 172.21.15.26:0/739798392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe38100010 0x7efe38195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.504+0000 7efe3cfe6700 1 --2- 172.21.15.26:0/739798392 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe381022b0 0x7efe3819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.505+0000 7efe377fe700 1 -- 172.21.15.26:0/739798392 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe381022b0 msgr2=0x7efe3819a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.505+0000 7efe377fe700 1 --2- 172.21.15.26:0/739798392 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe381022b0 0x7efe3819a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.505+0000 7efe377fe700 1 -- 172.21.15.26:0/739798392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe38100010 msgr2=0x7efe38195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.505+0000 7efe377fe700 1 --2- 172.21.15.26:0/739798392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe38100010 0x7efe38195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.505+0000 7efe377fe700 1 -- 172.21.15.26:0/739798392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c0095f0 con 0x7efe381018f0 2023-12-01T01:03:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.505+0000 7efe377fe700 1 --2- 172.21.15.26:0/739798392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe381018f0 0x7efe381964a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009990 tx=0x7efe2c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.505+0000 7efe357fa700 1 -- 172.21.15.26:0/739798392 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c01d070 con 0x7efe381018f0 2023-12-01T01:03:26.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.505+0000 7efe3ea49700 1 -- 172.21.15.26:0/739798392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3819b4d0 con 0x7efe381018f0 2023-12-01T01:03:26.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.505+0000 7efe357fa700 1 -- 172.21.15.26:0/739798392 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efe2c005050 con 0x7efe381018f0 2023-12-01T01:03:26.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.505+0000 7efe357fa700 1 -- 172.21.15.26:0/739798392 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c004a50 con 0x7efe381018f0 2023-12-01T01:03:26.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.505+0000 7efe3ea49700 1 -- 172.21.15.26:0/739798392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe381a2d90 con 0x7efe381018f0 2023-12-01T01:03:26.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.506+0000 7efe3ea49700 1 -- 172.21.15.26:0/739798392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3804ea90 con 0x7efe381018f0 2023-12-01T01:03:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.508+0000 7efe357fa700 1 -- 172.21.15.26:0/739798392 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7efe2c005530 con 0x7efe381018f0 2023-12-01T01:03:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.509+0000 7efe357fa700 1 --2- 172.21.15.26:0/739798392 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efe200a0630 0x7efe200a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:26.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.509+0000 7efe357fa700 1 -- 172.21.15.26:0/739798392 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efe2c0ccd60 con 0x7efe381018f0 2023-12-01T01:03:26.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.512+0000 7efe37fff700 1 --2- 172.21.15.26:0/739798392 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efe200a0630 0x7efe200a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:26.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.512+0000 7efe357fa700 1 -- 172.21.15.26:0/739798392 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7efe2c0967e0 con 0x7efe381018f0 2023-12-01T01:03:26.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.512+0000 7efe37fff700 1 --2- 172.21.15.26:0/739798392 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efe200a0630 0x7efe200a2af0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efe28009c60 tx=0x7efe28009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.613+0000 7f9b1a644700 1 -- 172.21.15.26:0/3897709746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b140688b0 msgr2=0x7f9b14068d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.613+0000 7f9b1a644700 1 --2- 172.21.15.26:0/3897709746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b140688b0 0x7f9b14068d30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009990 tx=0x7f9b08009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.613+0000 7f9b1a644700 1 -- 172.21.15.26:0/3897709746 shutdown_connections 2023-12-01T01:03:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.613+0000 7f9b1a644700 1 --2- 172.21.15.26:0/3897709746 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b14069270 0x7f9b1410dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.613+0000 7f9b1a644700 1 --2- 172.21.15.26:0/3897709746 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b14106f20 0x7f9b14107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.613+0000 7f9b1a644700 1 --2- 172.21.15.26:0/3897709746 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b140688b0 0x7f9b14068d30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.613+0000 7f9b1a644700 1 -- 172.21.15.26:0/3897709746 >> 172.21.15.26:0/3897709746 conn(0x7f9b14076d90 msgr2=0x7f9b140771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.613+0000 7f9b1a644700 1 -- 172.21.15.26:0/3897709746 shutdown_connections 2023-12-01T01:03:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.613+0000 7f9b1a644700 1 -- 172.21.15.26:0/3897709746 wait complete. 2023-12-01T01:03:26.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.614+0000 7f9b1a644700 1 Processor -- start 2023-12-01T01:03:26.617 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.614+0000 7f9b1a644700 1 -- start start 2023-12-01T01:03:26.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.614+0000 7f9b1a644700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b140688b0 0x7f9b140ffd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:26.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.614+0000 7f9b1a644700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b14069270 0x7f9b14100280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:26.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.614+0000 7f9b1a644700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b14106f20 0x7f9b14100800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:26.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.614+0000 7f9b1a644700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b141a5370 con 0x7f9b14069270 2023-12-01T01:03:26.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.614+0000 7f9b1a644700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b141a54e0 con 0x7f9b140688b0 2023-12-01T01:03:26.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.614+0000 7f9b1a644700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b141a56a0 con 0x7f9b14106f20 2023-12-01T01:03:26.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.614+0000 7f9b137fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b14069270 0x7f9b14100280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:26.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.614+0000 7f9b137fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b14069270 0x7f9b14100280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54050/0 (socket says 172.21.15.26:54050) 2023-12-01T01:03:26.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.614+0000 7f9b137fe700 1 -- 172.21.15.26:0/2896461290 learned_addr learned my addr 172.21.15.26:0/2896461290 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:26.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.614+0000 7f9b13fff700 1 --2- 172.21.15.26:0/2896461290 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b140688b0 0x7f9b140ffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:26.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.615+0000 7f9b18be1700 1 --2- 172.21.15.26:0/2896461290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b14106f20 0x7f9b14100800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:26.618 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.615+0000 7f9b137fe700 1 -- 172.21.15.26:0/2896461290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b14106f20 msgr2=0x7f9b14100800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:26.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.615+0000 7f9b137fe700 1 --2- 172.21.15.26:0/2896461290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b14106f20 0x7f9b14100800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.615+0000 7f9b137fe700 1 -- 172.21.15.26:0/2896461290 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b140688b0 msgr2=0x7f9b140ffd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:26.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.615+0000 7f9b137fe700 1 --2- 172.21.15.26:0/2896461290 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b140688b0 0x7f9b140ffd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.615+0000 7f9b137fe700 1 -- 172.21.15.26:0/2896461290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b080095f0 con 0x7f9b14069270 2023-12-01T01:03:26.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.615+0000 7f9b137fe700 1 --2- 172.21.15.26:0/2896461290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b14069270 0x7f9b14100280 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9b080098e0 tx=0x7f9b080058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:26.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.615+0000 7f9b117fa700 1 -- 172.21.15.26:0/2896461290 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0801d070 con 0x7f9b14069270 2023-12-01T01:03:26.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.615+0000 7f9b1a644700 1 -- 172.21.15.26:0/2896461290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b141a5920 con 0x7f9b14069270 2023-12-01T01:03:26.619 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.615+0000 7f9b117fa700 1 -- 172.21.15.26:0/2896461290 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9b0800fdd0 con 0x7f9b14069270 2023-12-01T01:03:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.615+0000 7f9b117fa700 1 -- 172.21.15.26:0/2896461290 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b080053a0 con 0x7f9b14069270 2023-12-01T01:03:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.615+0000 7f9b1a644700 1 -- 172.21.15.26:0/2896461290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b141a5cd0 con 0x7f9b14069270 2023-12-01T01:03:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.616+0000 7f9b1a644700 1 -- 172.21.15.26:0/2896461290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1404ea90 con 0x7f9b14069270 2023-12-01T01:03:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.618+0000 7f9b117fa700 1 -- 172.21.15.26:0/2896461290 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f9b08005500 con 0x7f9b14069270 2023-12-01T01:03:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.619+0000 7f9b117fa700 1 --2- 172.21.15.26:0/2896461290 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9afc0a05b0 0x7f9afc0a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.619+0000 7f9b13fff700 1 --2- 172.21.15.26:0/2896461290 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9afc0a05b0 0x7f9afc0a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:26.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.619+0000 7f9b117fa700 1 -- 172.21.15.26:0/2896461290 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9b080cd170 con 0x7f9b14069270 2023-12-01T01:03:26.622 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.619+0000 7f9b13fff700 1 --2- 172.21.15.26:0/2896461290 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9afc0a05b0 0x7f9afc0a2a70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9b04005950 tx=0x7f9b0400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:26.623 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.623+0000 7f9b117fa700 1 -- 172.21.15.26:0/2896461290 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9b08096c50 con 0x7f9b14069270 2023-12-01T01:03:26.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.721+0000 7efe3ea49700 1 -- 172.21.15.26:0/739798392 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7efe381a2f20 con 0x7efe381018f0 2023-12-01T01:03:26.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.721+0000 7efe357fa700 1 -- 172.21.15.26:0/739798392 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7efe2c026020 con 0x7efe381018f0 2023-12-01T01:03:26.726 INFO:teuthology.orchestra.run.smithi026.stdout:214748364835 2023-12-01T01:03:26.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.724+0000 7efe3ea49700 1 -- 172.21.15.26:0/739798392 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efe200a0630 msgr2=0x7efe200a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:26.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.724+0000 7efe3ea49700 1 --2- 172.21.15.26:0/739798392 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efe200a0630 0x7efe200a2af0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efe28009c60 tx=0x7efe28009260 comp rx=0 tx=0).stop 2023-12-01T01:03:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.724+0000 7efe3ea49700 1 -- 172.21.15.26:0/739798392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe381018f0 msgr2=0x7efe381964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.724+0000 7efe3ea49700 1 --2- 172.21.15.26:0/739798392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe381018f0 0x7efe381964a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009990 tx=0x7efe2c009580 comp rx=0 tx=0).stop 2023-12-01T01:03:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.724+0000 7efe3ea49700 1 -- 172.21.15.26:0/739798392 shutdown_connections 2023-12-01T01:03:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.724+0000 7efe3ea49700 1 --2- 172.21.15.26:0/739798392 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efe200a0630 0x7efe200a2af0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.724+0000 7efe3ea49700 1 --2- 172.21.15.26:0/739798392 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efe381022b0 0x7efe3819a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.724+0000 7efe3ea49700 1 --2- 172.21.15.26:0/739798392 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efe38100010 0x7efe38195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.724+0000 7efe3ea49700 1 --2- 172.21.15.26:0/739798392 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe381018f0 0x7efe381964a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.724+0000 7efe3ea49700 1 -- 172.21.15.26:0/739798392 >> 172.21.15.26:0/739798392 conn(0x7efe38076d80 msgr2=0x7efe380fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.724+0000 7efe3ea49700 1 -- 172.21.15.26:0/739798392 shutdown_connections 2023-12-01T01:03:26.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.724+0000 7efe3ea49700 1 -- 172.21.15.26:0/739798392 wait complete. 2023-12-01T01:03:26.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.836+0000 7f9b1a644700 1 -- 172.21.15.26:0/2896461290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9b14101270 con 0x7f9b14069270 2023-12-01T01:03:26.837 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.836+0000 7f9b117fa700 1 -- 172.21.15.26:0/2896461290 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9b0809a270 con 0x7f9b14069270 2023-12-01T01:03:26.838 INFO:teuthology.orchestra.run.smithi026.stdout:77309411384 2023-12-01T01:03:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.838+0000 7f9b1a644700 1 -- 172.21.15.26:0/2896461290 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9afc0a05b0 msgr2=0x7f9afc0a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:26.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.838+0000 7f9b1a644700 1 --2- 172.21.15.26:0/2896461290 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9afc0a05b0 0x7f9afc0a2a70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9b04005950 tx=0x7f9b0400a300 comp rx=0 tx=0).stop 2023-12-01T01:03:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.838+0000 7f9b1a644700 1 -- 172.21.15.26:0/2896461290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b14069270 msgr2=0x7f9b14100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.838+0000 7f9b1a644700 1 --2- 172.21.15.26:0/2896461290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b14069270 0x7f9b14100280 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9b080098e0 tx=0x7f9b080058e0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.838+0000 7f9b1a644700 1 -- 172.21.15.26:0/2896461290 shutdown_connections 2023-12-01T01:03:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.838+0000 7f9b1a644700 1 --2- 172.21.15.26:0/2896461290 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f9afc0a05b0 0x7f9afc0a2a70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.838+0000 7f9b1a644700 1 --2- 172.21.15.26:0/2896461290 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9b14106f20 0x7f9b14100800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.838+0000 7f9b1a644700 1 --2- 172.21.15.26:0/2896461290 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9b140688b0 0x7f9b140ffd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.838+0000 7f9b1a644700 1 --2- 172.21.15.26:0/2896461290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b14069270 0x7f9b14100280 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.838+0000 7f9b1a644700 1 -- 172.21.15.26:0/2896461290 >> 172.21.15.26:0/2896461290 conn(0x7f9b14076d90 msgr2=0x7f9b14104b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.838+0000 7f9b1a644700 1 -- 172.21.15.26:0/2896461290 shutdown_connections 2023-12-01T01:03:26.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:26.838+0000 7f9b1a644700 1 -- 172.21.15.26:0/2896461290 wait complete. 2023-12-01T01:03:27.047 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:27.305 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182448 got 107374182450 for osd.3 2023-12-01T01:03:27.305 DEBUG:teuthology.parallel:result is None 2023-12-01T01:03:27.376 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906968 got 274877906970 for osd.9 2023-12-01T01:03:27.377 DEBUG:teuthology.parallel:result is None 2023-12-01T01:03:27.602 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528357 got 193273528358 for osd.6 2023-12-01T01:03:27.603 DEBUG:teuthology.parallel:result is None 2023-12-01T01:03:27.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:27 smithi026 ceph-mon[98801]: pgmap v267: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-01T01:03:27.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:27 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/739798392' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-12-01T01:03:27.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:27 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2896461290' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-01T01:03:27.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.862+0000 7f906ce7b700 1 -- 172.21.15.26:0/3027909291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9068106f20 msgr2=0x7f9068107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:27.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.862+0000 7f906ce7b700 1 --2- 172.21.15.26:0/3027909291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9068106f20 0x7f9068107300 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9058009990 tx=0x7f9058009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:27.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.862+0000 7f906ce7b700 1 -- 172.21.15.26:0/3027909291 shutdown_connections 2023-12-01T01:03:27.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.862+0000 7f906ce7b700 1 --2- 172.21.15.26:0/3027909291 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9068069270 0x7f906810dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:27.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.862+0000 7f906ce7b700 1 --2- 172.21.15.26:0/3027909291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9068106f20 0x7f9068107300 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:27.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.862+0000 7f906ce7b700 1 --2- 172.21.15.26:0/3027909291 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90680688b0 0x7f9068068d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:27.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.862+0000 7f906ce7b700 1 -- 172.21.15.26:0/3027909291 >> 172.21.15.26:0/3027909291 conn(0x7f9068076d90 msgr2=0x7f90680771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:27.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.862+0000 7f906ce7b700 1 -- 172.21.15.26:0/3027909291 shutdown_connections 2023-12-01T01:03:27.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.862+0000 7f906ce7b700 1 -- 172.21.15.26:0/3027909291 wait complete. 2023-12-01T01:03:27.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f906ce7b700 1 Processor -- start 2023-12-01T01:03:27.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f906ce7b700 1 -- start start 2023-12-01T01:03:27.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f906ce7b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90680688b0 0x7f90680ffd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:27.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f906ce7b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9068069270 0x7f9068100280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:27.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f906ce7b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9068106f20 0x7f9068100800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:27.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f906ce7b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90681a5320 con 0x7f9068106f20 2023-12-01T01:03:27.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f906ce7b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90681a5490 con 0x7f90680688b0 2023-12-01T01:03:27.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f906ce7b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90681a5650 con 0x7f9068069270 2023-12-01T01:03:27.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f9066d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9068106f20 0x7f9068100800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:27.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f9066d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9068106f20 0x7f9068100800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54064/0 (socket says 172.21.15.26:54064) 2023-12-01T01:03:27.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f9066d9d700 1 -- 172.21.15.26:0/2296325294 learned_addr learned my addr 172.21.15.26:0/2296325294 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:27.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f9065d9b700 1 --2- 172.21.15.26:0/2296325294 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9068069270 0x7f9068100280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f906659c700 1 --2- 172.21.15.26:0/2296325294 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90680688b0 0x7f90680ffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f9066d9d700 1 -- 172.21.15.26:0/2296325294 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9068069270 msgr2=0x7f9068100280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f9066d9d700 1 --2- 172.21.15.26:0/2296325294 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9068069270 0x7f9068100280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f9066d9d700 1 -- 172.21.15.26:0/2296325294 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90680688b0 msgr2=0x7f90680ffd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f9066d9d700 1 --2- 172.21.15.26:0/2296325294 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90680688b0 0x7f90680ffd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.863+0000 7f9066d9d700 1 -- 172.21.15.26:0/2296325294 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90580095f0 con 0x7f9068106f20 2023-12-01T01:03:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.864+0000 7f9066d9d700 1 --2- 172.21.15.26:0/2296325294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9068106f20 0x7f9068100800 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9060007f10 tx=0x7f906000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.864+0000 7f90577fe700 1 -- 172.21.15.26:0/2296325294 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060017070 con 0x7f9068106f20 2023-12-01T01:03:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.864+0000 7f906ce7b700 1 -- 172.21.15.26:0/2296325294 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90681a5930 con 0x7f9068106f20 2023-12-01T01:03:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.864+0000 7f90577fe700 1 -- 172.21.15.26:0/2296325294 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f906000f040 con 0x7f9068106f20 2023-12-01T01:03:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.864+0000 7f90577fe700 1 -- 172.21.15.26:0/2296325294 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9060005760 con 0x7f9068106f20 2023-12-01T01:03:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.864+0000 7f906ce7b700 1 -- 172.21.15.26:0/2296325294 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90681a5e80 con 0x7f9068106f20 2023-12-01T01:03:27.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.865+0000 7f906ce7b700 1 -- 172.21.15.26:0/2296325294 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906804ea90 con 0x7f9068106f20 2023-12-01T01:03:27.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.866+0000 7f90577fe700 1 -- 172.21.15.26:0/2296325294 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f906000dc60 con 0x7f9068106f20 2023-12-01T01:03:27.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.867+0000 7f90577fe700 1 --2- 172.21.15.26:0/2296325294 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f90500a05b0 0x7f90500a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:27.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.867+0000 7f906659c700 1 --2- 172.21.15.26:0/2296325294 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f90500a05b0 0x7f90500a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:27.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.867+0000 7f90577fe700 1 -- 172.21.15.26:0/2296325294 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f90600cac90 con 0x7f9068106f20 2023-12-01T01:03:27.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.867+0000 7f906659c700 1 --2- 172.21.15.26:0/2296325294 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f90500a05b0 0x7f90500a2a70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9058006010 tx=0x7f905800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:27.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.871+0000 7f90577fe700 1 -- 172.21.15.26:0/2296325294 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9060094680 con 0x7f9068106f20 2023-12-01T01:03:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.932+0000 7f4b68c8e700 1 -- 172.21.15.26:0/138908169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b64106f20 msgr2=0x7f4b64107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.932+0000 7f4b68c8e700 1 --2- 172.21.15.26:0/138908169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b64106f20 0x7f4b64107300 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4b54009990 tx=0x7f4b54009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.932+0000 7f4b68c8e700 1 -- 172.21.15.26:0/138908169 shutdown_connections 2023-12-01T01:03:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.932+0000 7f4b68c8e700 1 --2- 172.21.15.26:0/138908169 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b64069270 0x7f4b6410dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.932+0000 7f4b68c8e700 1 --2- 172.21.15.26:0/138908169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b64106f20 0x7f4b64107300 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.932+0000 7f4b68c8e700 1 --2- 172.21.15.26:0/138908169 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b640688b0 0x7f4b64068d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.932+0000 7f4b68c8e700 1 -- 172.21.15.26:0/138908169 >> 172.21.15.26:0/138908169 conn(0x7f4b64076d90 msgr2=0x7f4b640771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.933+0000 7f4b68c8e700 1 -- 172.21.15.26:0/138908169 shutdown_connections 2023-12-01T01:03:27.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.933+0000 7f4b68c8e700 1 -- 172.21.15.26:0/138908169 wait complete. 2023-12-01T01:03:27.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.933+0000 7f4b68c8e700 1 Processor -- start 2023-12-01T01:03:27.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.933+0000 7f4b68c8e700 1 -- start start 2023-12-01T01:03:27.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b68c8e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b640688b0 0x7f4b64196e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b68c8e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b64069270 0x7f4b64197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b68c8e700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b64106f20 0x7f4b6419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b68c8e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6419bdc0 con 0x7f4b640688b0 2023-12-01T01:03:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b68c8e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6419bf30 con 0x7f4b64069270 2023-12-01T01:03:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b68c8e700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6419c0f0 con 0x7f4b64106f20 2023-12-01T01:03:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b6259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b640688b0 0x7f4b64196e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b61d9b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b64069270 0x7f4b64197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b6259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b640688b0 0x7f4b64196e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54074/0 (socket says 172.21.15.26:54074) 2023-12-01T01:03:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b6259c700 1 -- 172.21.15.26:0/3840294636 learned_addr learned my addr 172.21.15.26:0/3840294636 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b62d9d700 1 --2- 172.21.15.26:0/3840294636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b64106f20 0x7f4b6419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b6259c700 1 -- 172.21.15.26:0/3840294636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b64106f20 msgr2=0x7f4b6419b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b6259c700 1 --2- 172.21.15.26:0/3840294636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b64106f20 0x7f4b6419b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b6259c700 1 -- 172.21.15.26:0/3840294636 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b64069270 msgr2=0x7f4b64197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b6259c700 1 --2- 172.21.15.26:0/3840294636 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b64069270 0x7f4b64197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:27.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b6259c700 1 -- 172.21.15.26:0/3840294636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b540095f0 con 0x7f4b640688b0 2023-12-01T01:03:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b62d9d700 1 --2- 172.21.15.26:0/3840294636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b64106f20 0x7f4b6419b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:03:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b61d9b700 1 --2- 172.21.15.26:0/3840294636 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b64069270 0x7f4b64197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:03:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.934+0000 7f4b6259c700 1 --2- 172.21.15.26:0/3840294636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b640688b0 0x7f4b64196e00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4b540098e0 tx=0x7f4b5400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.935+0000 7f4b537fe700 1 -- 172.21.15.26:0/3840294636 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5401d070 con 0x7f4b640688b0 2023-12-01T01:03:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.935+0000 7f4b537fe700 1 -- 172.21.15.26:0/3840294636 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4b54003680 con 0x7f4b640688b0 2023-12-01T01:03:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.935+0000 7f4b537fe700 1 -- 172.21.15.26:0/3840294636 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b540173f0 con 0x7f4b640688b0 2023-12-01T01:03:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.935+0000 7f4b68c8e700 1 -- 172.21.15.26:0/3840294636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6419c370 con 0x7f4b640688b0 2023-12-01T01:03:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.935+0000 7f4b68c8e700 1 -- 172.21.15.26:0/3840294636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b641a3a60 con 0x7f4b640688b0 2023-12-01T01:03:27.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.936+0000 7f4b68c8e700 1 -- 172.21.15.26:0/3840294636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6404ea90 con 0x7f4b640688b0 2023-12-01T01:03:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.938+0000 7f4b537fe700 1 -- 172.21.15.26:0/3840294636 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f4b54022470 con 0x7f4b640688b0 2023-12-01T01:03:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.938+0000 7f4b537fe700 1 --2- 172.21.15.26:0/3840294636 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4b4c0a05b0 0x7f4b4c0a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.938+0000 7f4b537fe700 1 -- 172.21.15.26:0/3840294636 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4b540cccb0 con 0x7f4b640688b0 2023-12-01T01:03:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.938+0000 7f4b61d9b700 1 --2- 172.21.15.26:0/3840294636 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4b4c0a05b0 0x7f4b4c0a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:27.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.939+0000 7f4b61d9b700 1 --2- 172.21.15.26:0/3840294636 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4b4c0a05b0 0x7f4b4c0a2a70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4b64198420 tx=0x7f4b5800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:27.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:27.942+0000 7f4b537fe700 1 -- 172.21.15.26:0/3840294636 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4b5405d0e0 con 0x7f4b640688b0 2023-12-01T01:03:27.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:27 smithi093 ceph-mon[103327]: pgmap v267: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-01T01:03:27.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:27 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/739798392' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-12-01T01:03:27.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:27 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2896461290' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-01T01:03:28.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.080+0000 7f906ce7b700 1 -- 172.21.15.26:0/2296325294 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f90681a61a0 con 0x7f9068106f20 2023-12-01T01:03:28.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.080+0000 7f90577fe700 1 -- 172.21.15.26:0/2296325294 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f9060097ca0 con 0x7f9068106f20 2023-12-01T01:03:28.081 INFO:teuthology.orchestra.run.smithi026.stdout:158913789996 2023-12-01T01:03:28.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.082+0000 7f906ce7b700 1 -- 172.21.15.26:0/2296325294 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f90500a05b0 msgr2=0x7f90500a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.082+0000 7f906ce7b700 1 --2- 172.21.15.26:0/2296325294 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f90500a05b0 0x7f90500a2a70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9058006010 tx=0x7f905800b540 comp rx=0 tx=0).stop 2023-12-01T01:03:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.082+0000 7f906ce7b700 1 -- 172.21.15.26:0/2296325294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9068106f20 msgr2=0x7f9068100800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.082+0000 7f906ce7b700 1 --2- 172.21.15.26:0/2296325294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9068106f20 0x7f9068100800 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9060007f10 tx=0x7f906000d3b0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.082+0000 7f906ce7b700 1 -- 172.21.15.26:0/2296325294 shutdown_connections 2023-12-01T01:03:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.082+0000 7f906ce7b700 1 --2- 172.21.15.26:0/2296325294 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f90500a05b0 0x7f90500a2a70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.082+0000 7f906ce7b700 1 --2- 172.21.15.26:0/2296325294 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9068106f20 0x7f9068100800 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.082+0000 7f906ce7b700 1 --2- 172.21.15.26:0/2296325294 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90680688b0 0x7f90680ffd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.082+0000 7f906ce7b700 1 --2- 172.21.15.26:0/2296325294 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9068069270 0x7f9068100280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.082+0000 7f906ce7b700 1 -- 172.21.15.26:0/2296325294 >> 172.21.15.26:0/2296325294 conn(0x7f9068076d90 msgr2=0x7f90680fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.083+0000 7f906ce7b700 1 -- 172.21.15.26:0/2296325294 shutdown_connections 2023-12-01T01:03:28.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.083+0000 7f906ce7b700 1 -- 172.21.15.26:0/2296325294 wait complete. 2023-12-01T01:03:28.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.150+0000 7f4b68c8e700 1 -- 172.21.15.26:0/3840294636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4b641a3d30 con 0x7f4b640688b0 2023-12-01T01:03:28.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.150+0000 7f4b537fe700 1 -- 172.21.15.26:0/3840294636 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4b54096790 con 0x7f4b640688b0 2023-12-01T01:03:28.152 INFO:teuthology.orchestra.run.smithi026.stdout:34359738431 2023-12-01T01:03:28.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.154+0000 7f4b68c8e700 1 -- 172.21.15.26:0/3840294636 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4b4c0a05b0 msgr2=0x7f4b4c0a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:28.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.154+0000 7f4b68c8e700 1 --2- 172.21.15.26:0/3840294636 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4b4c0a05b0 0x7f4b4c0a2a70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4b64198420 tx=0x7f4b5800a380 comp rx=0 tx=0).stop 2023-12-01T01:03:28.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.154+0000 7f4b68c8e700 1 -- 172.21.15.26:0/3840294636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b640688b0 msgr2=0x7f4b64196e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:28.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.154+0000 7f4b68c8e700 1 --2- 172.21.15.26:0/3840294636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b640688b0 0x7f4b64196e00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4b540098e0 tx=0x7f4b5400f690 comp rx=0 tx=0).stop 2023-12-01T01:03:28.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.154+0000 7f4b68c8e700 1 -- 172.21.15.26:0/3840294636 shutdown_connections 2023-12-01T01:03:28.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.154+0000 7f4b68c8e700 1 --2- 172.21.15.26:0/3840294636 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4b4c0a05b0 0x7f4b4c0a2a70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.154+0000 7f4b68c8e700 1 --2- 172.21.15.26:0/3840294636 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4b64106f20 0x7f4b6419b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.154+0000 7f4b68c8e700 1 --2- 172.21.15.26:0/3840294636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b640688b0 0x7f4b64196e00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.154+0000 7f4b68c8e700 1 --2- 172.21.15.26:0/3840294636 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4b64069270 0x7f4b64197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.154+0000 7f4b68c8e700 1 -- 172.21.15.26:0/3840294636 >> 172.21.15.26:0/3840294636 conn(0x7f4b64076d90 msgr2=0x7f4b64104b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:28.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.154+0000 7f4b68c8e700 1 -- 172.21.15.26:0/3840294636 shutdown_connections 2023-12-01T01:03:28.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.154+0000 7f4b68c8e700 1 -- 172.21.15.26:0/3840294636 wait complete. 2023-12-01T01:03:28.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:27 smithi116 ceph-mon[103554]: pgmap v267: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-01T01:03:28.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:27 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/739798392' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-12-01T01:03:28.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:27 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2896461290' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-01T01:03:28.181 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364832 got 214748364835 for osd.7 2023-12-01T01:03:28.181 DEBUG:teuthology.parallel:result is None 2023-12-01T01:03:28.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.207+0000 7f2fea65b700 1 -- 172.21.15.26:0/3291353918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe4101020 msgr2=0x7f2fe4101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:28.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.207+0000 7f2fea65b700 1 --2- 172.21.15.26:0/3291353918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe4101020 0x7f2fe4101400 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4009990 tx=0x7f2fd4009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.207+0000 7f2fea65b700 1 -- 172.21.15.26:0/3291353918 shutdown_connections 2023-12-01T01:03:28.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.207+0000 7f2fea65b700 1 --2- 172.21.15.26:0/3291353918 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2fe4106100 0x7f2fe410dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.207+0000 7f2fea65b700 1 --2- 172.21.15.26:0/3291353918 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe4101020 0x7f2fe4101400 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.207+0000 7f2fea65b700 1 --2- 172.21.15.26:0/3291353918 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fe41019d0 0x7f2fe4105a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.207+0000 7f2fea65b700 1 -- 172.21.15.26:0/3291353918 >> 172.21.15.26:0/3291353918 conn(0x7f2fe40fc8b0 msgr2=0x7f2fe40fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:28.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.207+0000 7f2fea65b700 1 -- 172.21.15.26:0/3291353918 shutdown_connections 2023-12-01T01:03:28.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.207+0000 7f2fea65b700 1 -- 172.21.15.26:0/3291353918 wait complete. 2023-12-01T01:03:28.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.208+0000 7f2fea65b700 1 Processor -- start 2023-12-01T01:03:28.209 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.208+0000 7f2fea65b700 1 -- start start 2023-12-01T01:03:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.208+0000 7f2fea65b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe4101020 0x7f2fe4073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.208+0000 7f2fea65b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fe41019d0 0x7f2fe40735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.208+0000 7f2fea65b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2fe4106100 0x7f2fe4073b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.208+0000 7f2fea65b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe41a53b0 con 0x7f2fe4101020 2023-12-01T01:03:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.208+0000 7f2fea65b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe41a5520 con 0x7f2fe41019d0 2023-12-01T01:03:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.208+0000 7f2fea65b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe41a56e0 con 0x7f2fe4106100 2023-12-01T01:03:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.208+0000 7f2fe3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe4101020 0x7f2fe4073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.208+0000 7f2fe3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe4101020 0x7f2fe4073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54088/0 (socket says 172.21.15.26:54088) 2023-12-01T01:03:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.208+0000 7f2fe3fff700 1 -- 172.21.15.26:0/337293082 learned_addr learned my addr 172.21.15.26:0/337293082 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.208+0000 7f2fe37fe700 1 --2- 172.21.15.26:0/337293082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fe41019d0 0x7f2fe40735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.209+0000 7f2fe3fff700 1 -- 172.21.15.26:0/337293082 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2fe4106100 msgr2=0x7f2fe4073b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.209+0000 7f2fe3fff700 1 --2- 172.21.15.26:0/337293082 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2fe4106100 0x7f2fe4073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.211 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.209+0000 7f2fe3fff700 1 -- 172.21.15.26:0/337293082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fe41019d0 msgr2=0x7f2fe40735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:28.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.209+0000 7f2fe3fff700 1 --2- 172.21.15.26:0/337293082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fe41019d0 0x7f2fe40735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.209+0000 7f2fe3fff700 1 -- 172.21.15.26:0/337293082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd40095f0 con 0x7f2fe4101020 2023-12-01T01:03:28.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.209+0000 7f2fe3fff700 1 --2- 172.21.15.26:0/337293082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe4101020 0x7f2fe4073090 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4000c00 tx=0x7f2fd40047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:28.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.209+0000 7f2fe17fa700 1 -- 172.21.15.26:0/337293082 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd401d070 con 0x7f2fe4101020 2023-12-01T01:03:28.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.209+0000 7f2fe17fa700 1 -- 172.21.15.26:0/337293082 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2fd4021410 con 0x7f2fe4101020 2023-12-01T01:03:28.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.209+0000 7f2fea65b700 1 -- 172.21.15.26:0/337293082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe41a5960 con 0x7f2fe4101020 2023-12-01T01:03:28.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.209+0000 7f2fe17fa700 1 -- 172.21.15.26:0/337293082 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4017650 con 0x7f2fe4101020 2023-12-01T01:03:28.212 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.209+0000 7f2fea65b700 1 -- 172.21.15.26:0/337293082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe41a5e00 con 0x7f2fe4101020 2023-12-01T01:03:28.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.210+0000 7f2fea65b700 1 -- 172.21.15.26:0/337293082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe404ea90 con 0x7f2fe4101020 2023-12-01T01:03:28.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.211+0000 7f2fe17fa700 1 -- 172.21.15.26:0/337293082 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f2fd4021580 con 0x7f2fe4101020 2023-12-01T01:03:28.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.212+0000 7f2fe17fa700 1 --2- 172.21.15.26:0/337293082 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2fcc0a05b0 0x7f2fcc0a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:28.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.212+0000 7f2fe37fe700 1 --2- 172.21.15.26:0/337293082 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2fcc0a05b0 0x7f2fcc0a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:28.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.212+0000 7f2fe17fa700 1 -- 172.21.15.26:0/337293082 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2fd40cccc0 con 0x7f2fe4101020 2023-12-01T01:03:28.213 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.212+0000 7f2fe37fe700 1 --2- 172.21.15.26:0/337293082 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2fcc0a05b0 0x7f2fcc0a2a70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4074880 tx=0x7f2fd8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:28.217 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.216+0000 7f2fe17fa700 1 -- 172.21.15.26:0/337293082 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2fd40967a0 con 0x7f2fe4101020 2023-12-01T01:03:28.355 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:28.356 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411381 got 77309411384 for osd.2 2023-12-01T01:03:28.357 DEBUG:teuthology.parallel:result is None 2023-12-01T01:03:28.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.433+0000 7f2fea65b700 1 -- 172.21.15.26:0/337293082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f2fe41a6020 con 0x7f2fe4101020 2023-12-01T01:03:28.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.434+0000 7f2fe17fa700 1 -- 172.21.15.26:0/337293082 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f2fd4099dc0 con 0x7f2fe4101020 2023-12-01T01:03:28.435 INFO:teuthology.orchestra.run.smithi026.stdout:296352743447 2023-12-01T01:03:28.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.436+0000 7f2fea65b700 1 -- 172.21.15.26:0/337293082 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2fcc0a05b0 msgr2=0x7f2fcc0a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:28.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.436+0000 7f2fea65b700 1 --2- 172.21.15.26:0/337293082 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2fcc0a05b0 0x7f2fcc0a2a70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4074880 tx=0x7f2fd8009260 comp rx=0 tx=0).stop 2023-12-01T01:03:28.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.436+0000 7f2fea65b700 1 -- 172.21.15.26:0/337293082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe4101020 msgr2=0x7f2fe4073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:28.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.436+0000 7f2fea65b700 1 --2- 172.21.15.26:0/337293082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe4101020 0x7f2fe4073090 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4000c00 tx=0x7f2fd40047b0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.436+0000 7f2fea65b700 1 -- 172.21.15.26:0/337293082 shutdown_connections 2023-12-01T01:03:28.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.436+0000 7f2fea65b700 1 --2- 172.21.15.26:0/337293082 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2fcc0a05b0 0x7f2fcc0a2a70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.436+0000 7f2fea65b700 1 --2- 172.21.15.26:0/337293082 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2fe4106100 0x7f2fe4073b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.437 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.436+0000 7f2fea65b700 1 --2- 172.21.15.26:0/337293082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe4101020 0x7f2fe4073090 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.436+0000 7f2fea65b700 1 --2- 172.21.15.26:0/337293082 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2fe41019d0 0x7f2fe40735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:28.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.436+0000 7f2fea65b700 1 -- 172.21.15.26:0/337293082 >> 172.21.15.26:0/337293082 conn(0x7f2fe40fc8b0 msgr2=0x7f2fe40fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:28.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.436+0000 7f2fea65b700 1 -- 172.21.15.26:0/337293082 shutdown_connections 2023-12-01T01:03:28.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:28.436+0000 7f2fea65b700 1 -- 172.21.15.26:0/337293082 wait complete. 2023-12-01T01:03:28.873 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789994 got 158913789996 for osd.5 2023-12-01T01:03:28.873 DEBUG:teuthology.parallel:result is None 2023-12-01T01:03:28.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:28 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2296325294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-01T01:03:28.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:28 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3840294636' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-01T01:03:28.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:28 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/337293082' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-12-01T01:03:28.981 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:28 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2296325294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-01T01:03:28.981 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:28 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3840294636' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-01T01:03:28.982 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:28 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/337293082' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-12-01T01:03:29.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:28 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2296325294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-01T01:03:29.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:28 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3840294636' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-01T01:03:29.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:28 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/337293082' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-12-01T01:03:29.291 INFO:tasks.cephadm.ceph_manager.ceph:need seq 296352743446 got 296352743447 for osd.10 2023-12-01T01:03:29.291 DEBUG:teuthology.parallel:result is None 2023-12-01T01:03:29.425 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738428 got 34359738431 for osd.0 2023-12-01T01:03:29.425 DEBUG:teuthology.parallel:result is None 2023-12-01T01:03:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.685+0000 7f210cf3c700 1 -- 172.21.15.26:0/1041433869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21080694a0 msgr2=0x7f2108069880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.685+0000 7f210cf3c700 1 --2- 172.21.15.26:0/1041433869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21080694a0 0x7f2108069880 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f20f80099c0 tx=0x7f20f8009cd0 comp rx=0 tx=0).stop 2023-12-01T01:03:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.685+0000 7f210cf3c700 1 -- 172.21.15.26:0/1041433869 shutdown_connections 2023-12-01T01:03:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.685+0000 7f210cf3c700 1 --2- 172.21.15.26:0/1041433869 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2108103160 0x7f210810dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.685+0000 7f210cf3c700 1 --2- 172.21.15.26:0/1041433869 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f21080694a0 0x7f2108069880 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.685+0000 7f210cf3c700 1 --2- 172.21.15.26:0/1041433869 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2108069dc0 0x7f2108102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.685+0000 7f210cf3c700 1 -- 172.21.15.26:0/1041433869 >> 172.21.15.26:0/1041433869 conn(0x7f2108076d80 msgr2=0x7f2108077190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.685+0000 7f210cf3c700 1 -- 172.21.15.26:0/1041433869 shutdown_connections 2023-12-01T01:03:29.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.685+0000 7f210cf3c700 1 -- 172.21.15.26:0/1041433869 wait complete. 2023-12-01T01:03:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.686+0000 7f210cf3c700 1 Processor -- start 2023-12-01T01:03:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.686+0000 7f210cf3c700 1 -- start start 2023-12-01T01:03:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.686+0000 7f210cf3c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21080694a0 0x7f21080ffd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f210cf3c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2108069dc0 0x7f2108100280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f210cf3c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2108103160 0x7f2108100800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f210cf3c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21081a5540 con 0x7f2108069dc0 2023-12-01T01:03:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f210cf3c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21081a56b0 con 0x7f21080694a0 2023-12-01T01:03:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f210cf3c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21081a5870 con 0x7f2108103160 2023-12-01T01:03:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f2105d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2108069dc0 0x7f2108100280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f2105d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2108069dc0 0x7f2108100280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54104/0 (socket says 172.21.15.26:54104) 2023-12-01T01:03:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f2105d9b700 1 -- 172.21.15.26:0/3429387718 learned_addr learned my addr 172.21.15.26:0/3429387718 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f2106d9d700 1 --2- 172.21.15.26:0/3429387718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2108103160 0x7f2108100800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f210659c700 1 --2- 172.21.15.26:0/3429387718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21080694a0 0x7f21080ffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:29.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f2105d9b700 1 -- 172.21.15.26:0/3429387718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2108103160 msgr2=0x7f2108100800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f2105d9b700 1 --2- 172.21.15.26:0/3429387718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2108103160 0x7f2108100800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f2105d9b700 1 -- 172.21.15.26:0/3429387718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21080694a0 msgr2=0x7f21080ffd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f2105d9b700 1 --2- 172.21.15.26:0/3429387718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21080694a0 0x7f21080ffd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f2105d9b700 1 -- 172.21.15.26:0/3429387718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f80095f0 con 0x7f2108069dc0 2023-12-01T01:03:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f2106d9d700 1 --2- 172.21.15.26:0/3429387718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2108103160 0x7f2108100800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:03:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f2105d9b700 1 --2- 172.21.15.26:0/3429387718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2108069dc0 0x7f2108100280 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00d950 tx=0x7f20fc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f20f77fe700 1 -- 172.21.15.26:0/3429387718 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc009b40 con 0x7f2108069dc0 2023-12-01T01:03:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f210cf3c700 1 -- 172.21.15.26:0/3429387718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21081a5b50 con 0x7f2108069dc0 2023-12-01T01:03:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f20f77fe700 1 -- 172.21.15.26:0/3429387718 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f20fc00de30 con 0x7f2108069dc0 2023-12-01T01:03:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.687+0000 7f20f77fe700 1 -- 172.21.15.26:0/3429387718 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20fc00f620 con 0x7f2108069dc0 2023-12-01T01:03:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.688+0000 7f210cf3c700 1 -- 172.21.15.26:0/3429387718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21081a60a0 con 0x7f2108069dc0 2023-12-01T01:03:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.689+0000 7f210cf3c700 1 -- 172.21.15.26:0/3429387718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f210804ea90 con 0x7f2108069dc0 2023-12-01T01:03:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.690+0000 7f20f77fe700 1 -- 172.21.15.26:0/3429387718 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f20fc009ca0 con 0x7f2108069dc0 2023-12-01T01:03:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.691+0000 7f20f77fe700 1 --2- 172.21.15.26:0/3429387718 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f20f00a05b0 0x7f20f00a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:29.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.691+0000 7f210659c700 1 --2- 172.21.15.26:0/3429387718 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f20f00a05b0 0x7f20f00a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:29.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.691+0000 7f20f77fe700 1 -- 172.21.15.26:0/3429387718 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f20fc0cb7d0 con 0x7f2108069dc0 2023-12-01T01:03:29.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.691+0000 7f210659c700 1 --2- 172.21.15.26:0/3429387718 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f20f00a05b0 0x7f20f00a2a70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009fd0 tx=0x7f20f8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:29.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.697+0000 7f20f77fe700 1 -- 172.21.15.26:0/3429387718 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f20fc095220 con 0x7f2108069dc0 2023-12-01T01:03:29.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:29 smithi026 ceph-mon[98801]: pgmap v268: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-01T01:03:29.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.906+0000 7f210cf3c700 1 -- 172.21.15.26:0/3429387718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f21081a6230 con 0x7f2108069dc0 2023-12-01T01:03:29.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.906+0000 7f20f77fe700 1 -- 172.21.15.26:0/3429387718 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20fc021090 con 0x7f2108069dc0 2023-12-01T01:03:29.907 INFO:teuthology.orchestra.run.smithi026.stdout:137438953519 2023-12-01T01:03:29.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.909+0000 7f210cf3c700 1 -- 172.21.15.26:0/3429387718 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f20f00a05b0 msgr2=0x7f20f00a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:29.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.909+0000 7f210cf3c700 1 --2- 172.21.15.26:0/3429387718 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f20f00a05b0 0x7f20f00a2a70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f20f8009fd0 tx=0x7f20f8005fd0 comp rx=0 tx=0).stop 2023-12-01T01:03:29.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.909+0000 7f210cf3c700 1 -- 172.21.15.26:0/3429387718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2108069dc0 msgr2=0x7f2108100280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:29.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.909+0000 7f210cf3c700 1 --2- 172.21.15.26:0/3429387718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2108069dc0 0x7f2108100280 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f20fc00d950 tx=0x7f20fc00dd10 comp rx=0 tx=0).stop 2023-12-01T01:03:29.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.909+0000 7f210cf3c700 1 -- 172.21.15.26:0/3429387718 shutdown_connections 2023-12-01T01:03:29.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.909+0000 7f210cf3c700 1 --2- 172.21.15.26:0/3429387718 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f20f00a05b0 0x7f20f00a2a70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:29.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.909+0000 7f210cf3c700 1 --2- 172.21.15.26:0/3429387718 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2108103160 0x7f2108100800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:29.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.909+0000 7f210cf3c700 1 --2- 172.21.15.26:0/3429387718 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f21080694a0 0x7f21080ffd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:29.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.909+0000 7f210cf3c700 1 --2- 172.21.15.26:0/3429387718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2108069dc0 0x7f2108100280 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:29.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.909+0000 7f210cf3c700 1 -- 172.21.15.26:0/3429387718 >> 172.21.15.26:0/3429387718 conn(0x7f2108076d80 msgr2=0x7f21080fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:29.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.909+0000 7f210cf3c700 1 -- 172.21.15.26:0/3429387718 shutdown_connections 2023-12-01T01:03:29.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:29.909+0000 7f210cf3c700 1 -- 172.21.15.26:0/3429387718 wait complete. 2023-12-01T01:03:29.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:29 smithi093 ceph-mon[103327]: pgmap v268: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-01T01:03:30.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:29 smithi116 ceph-mon[103554]: pgmap v268: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-01T01:03:30.429 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135900 got 244813135902 for osd.8 2023-12-01T01:03:30.429 DEBUG:teuthology.parallel:result is None 2023-12-01T01:03:30.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.936+0000 7fbe845d0700 1 -- 172.21.15.26:0/2474577703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c101020 msgr2=0x7fbe7c1014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:30.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.936+0000 7fbe845d0700 1 --2- 172.21.15.26:0/2474577703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c101020 0x7fbe7c1014a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c0099c0 tx=0x7fbe6c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:03:30.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.936+0000 7fbe845d0700 1 -- 172.21.15.26:0/2474577703 shutdown_connections 2023-12-01T01:03:30.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.936+0000 7fbe845d0700 1 --2- 172.21.15.26:0/2474577703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe7c1019e0 0x7fbe7c10dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:30.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.936+0000 7fbe845d0700 1 --2- 172.21.15.26:0/2474577703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe7c106fa0 0x7fbe7c107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:30.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.936+0000 7fbe845d0700 1 --2- 172.21.15.26:0/2474577703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c101020 0x7fbe7c1014a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:30.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.936+0000 7fbe845d0700 1 -- 172.21.15.26:0/2474577703 >> 172.21.15.26:0/2474577703 conn(0x7fbe7c078db0 msgr2=0x7fbe7c0791c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:30.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.936+0000 7fbe845d0700 1 -- 172.21.15.26:0/2474577703 shutdown_connections 2023-12-01T01:03:30.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.936+0000 7fbe845d0700 1 -- 172.21.15.26:0/2474577703 wait complete. 2023-12-01T01:03:30.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.936+0000 7fbe845d0700 1 Processor -- start 2023-12-01T01:03:30.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.936+0000 7fbe845d0700 1 -- start start 2023-12-01T01:03:30.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe845d0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c101020 0x7fbe7c196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:30.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe845d0700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe7c1019e0 0x7fbe7c1973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:30.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe845d0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe7c106fa0 0x7fbe7c19b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:30.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe845d0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c19be70 con 0x7fbe7c101020 2023-12-01T01:03:30.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe845d0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c19bfe0 con 0x7fbe7c106fa0 2023-12-01T01:03:30.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe845d0700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c19c1a0 con 0x7fbe7c1019e0 2023-12-01T01:03:30.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe8236c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c101020 0x7fbe7c196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:30.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe8236c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c101020 0x7fbe7c196eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54116/0 (socket says 172.21.15.26:54116) 2023-12-01T01:03:30.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe8236c700 1 -- 172.21.15.26:0/2181643717 learned_addr learned my addr 172.21.15.26:0/2181643717 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:30.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe81b6b700 1 --2- 172.21.15.26:0/2181643717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe7c1019e0 0x7fbe7c1973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:30.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe82b6d700 1 --2- 172.21.15.26:0/2181643717 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe7c106fa0 0x7fbe7c19b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:30.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe8236c700 1 -- 172.21.15.26:0/2181643717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe7c1019e0 msgr2=0x7fbe7c1973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:30.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe8236c700 1 --2- 172.21.15.26:0/2181643717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe7c1019e0 0x7fbe7c1973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:30.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe8236c700 1 -- 172.21.15.26:0/2181643717 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe7c106fa0 msgr2=0x7fbe7c19b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:30.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe8236c700 1 --2- 172.21.15.26:0/2181643717 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe7c106fa0 0x7fbe7c19b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:30.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe8236c700 1 -- 172.21.15.26:0/2181643717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c0095f0 con 0x7fbe7c101020 2023-12-01T01:03:30.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe82b6d700 1 --2- 172.21.15.26:0/2181643717 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe7c106fa0 0x7fbe7c19b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:03:30.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe8236c700 1 --2- 172.21.15.26:0/2181643717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c101020 0x7fbe7c196eb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800d980 tx=0x7fbe7800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:30.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe737fe700 1 -- 172.21.15.26:0/2181643717 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78004220 con 0x7fbe7c101020 2023-12-01T01:03:30.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.937+0000 7fbe737fe700 1 -- 172.21.15.26:0/2181643717 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbe78007640 con 0x7fbe7c101020 2023-12-01T01:03:30.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.938+0000 7fbe845d0700 1 -- 172.21.15.26:0/2181643717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7c19c480 con 0x7fbe7c101020 2023-12-01T01:03:30.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.938+0000 7fbe737fe700 1 -- 172.21.15.26:0/2181643717 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78005720 con 0x7fbe7c101020 2023-12-01T01:03:30.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.938+0000 7fbe845d0700 1 -- 172.21.15.26:0/2181643717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c1a3ce0 con 0x7fbe7c101020 2023-12-01T01:03:30.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.939+0000 7fbe845d0700 1 -- 172.21.15.26:0/2181643717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7c04ea90 con 0x7fbe7c101020 2023-12-01T01:03:30.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.940+0000 7fbe737fe700 1 -- 172.21.15.26:0/2181643717 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fbe78004750 con 0x7fbe7c101020 2023-12-01T01:03:30.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.940+0000 7fbe737fe700 1 --2- 172.21.15.26:0/2181643717 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe680a0630 0x7fbe680a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:30.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.941+0000 7fbe81b6b700 1 --2- 172.21.15.26:0/2181643717 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe680a0630 0x7fbe680a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:30.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.941+0000 7fbe737fe700 1 -- 172.21.15.26:0/2181643717 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbe780cbd60 con 0x7fbe7c101020 2023-12-01T01:03:30.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.941+0000 7fbe81b6b700 1 --2- 172.21.15.26:0/2181643717 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe680a0630 0x7fbe680a2af0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009990 tx=0x7fbe6c005bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:30.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:30.944+0000 7fbe737fe700 1 -- 172.21.15.26:0/2181643717 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fbe780957b0 con 0x7fbe7c101020 2023-12-01T01:03:31.007 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:30 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3429387718' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-01T01:03:31.025 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953516 got 137438953519 for osd.4 2023-12-01T01:03:31.025 DEBUG:teuthology.parallel:result is None 2023-12-01T01:03:31.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.154+0000 7fbe845d0700 1 -- 172.21.15.26:0/2181643717 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fbe7c1a3fd0 con 0x7fbe7c101020 2023-12-01T01:03:31.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.155+0000 7fbe737fe700 1 -- 172.21.15.26:0/2181643717 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fbe78016020 con 0x7fbe7c101020 2023-12-01T01:03:31.156 INFO:teuthology.orchestra.run.smithi026.stdout:326417514516 2023-12-01T01:03:31.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.158+0000 7fbe845d0700 1 -- 172.21.15.26:0/2181643717 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe680a0630 msgr2=0x7fbe680a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:31.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.158+0000 7fbe845d0700 1 --2- 172.21.15.26:0/2181643717 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe680a0630 0x7fbe680a2af0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009990 tx=0x7fbe6c005bc0 comp rx=0 tx=0).stop 2023-12-01T01:03:31.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.158+0000 7fbe845d0700 1 -- 172.21.15.26:0/2181643717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c101020 msgr2=0x7fbe7c196eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:31.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.158+0000 7fbe845d0700 1 --2- 172.21.15.26:0/2181643717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c101020 0x7fbe7c196eb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800d980 tx=0x7fbe7800dc90 comp rx=0 tx=0).stop 2023-12-01T01:03:31.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.158+0000 7fbe845d0700 1 -- 172.21.15.26:0/2181643717 shutdown_connections 2023-12-01T01:03:31.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.158+0000 7fbe845d0700 1 --2- 172.21.15.26:0/2181643717 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe680a0630 0x7fbe680a2af0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:31.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.158+0000 7fbe845d0700 1 --2- 172.21.15.26:0/2181643717 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe7c106fa0 0x7fbe7c19b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:31.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.158+0000 7fbe845d0700 1 --2- 172.21.15.26:0/2181643717 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe7c101020 0x7fbe7c196eb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:31.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.158+0000 7fbe845d0700 1 --2- 172.21.15.26:0/2181643717 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe7c1019e0 0x7fbe7c1973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:31.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.158+0000 7fbe845d0700 1 -- 172.21.15.26:0/2181643717 >> 172.21.15.26:0/2181643717 conn(0x7fbe7c078db0 msgr2=0x7fbe7c104b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:31.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.158+0000 7fbe845d0700 1 -- 172.21.15.26:0/2181643717 shutdown_connections 2023-12-01T01:03:31.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.159+0000 7fbe845d0700 1 -- 172.21.15.26:0/2181643717 wait complete. 2023-12-01T01:03:31.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:30 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3429387718' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-01T01:03:31.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:30 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3429387718' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-01T01:03:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.475+0000 7fd512544700 1 -- 172.21.15.26:0/1807669069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c1019d0 msgr2=0x7fd50c105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.475+0000 7fd512544700 1 --2- 172.21.15.26:0/1807669069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c1019d0 0x7fd50c105a20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009990 tx=0x7fd4f4009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.475+0000 7fd512544700 1 -- 172.21.15.26:0/1807669069 shutdown_connections 2023-12-01T01:03:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.475+0000 7fd512544700 1 --2- 172.21.15.26:0/1807669069 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd50c106100 0x7fd50c10dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.475+0000 7fd512544700 1 --2- 172.21.15.26:0/1807669069 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd50c101020 0x7fd50c101400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.475+0000 7fd512544700 1 --2- 172.21.15.26:0/1807669069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c1019d0 0x7fd50c105a20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.475+0000 7fd512544700 1 -- 172.21.15.26:0/1807669069 >> 172.21.15.26:0/1807669069 conn(0x7fd50c0fc8b0 msgr2=0x7fd50c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.475+0000 7fd512544700 1 -- 172.21.15.26:0/1807669069 shutdown_connections 2023-12-01T01:03:31.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.475+0000 7fd512544700 1 -- 172.21.15.26:0/1807669069 wait complete. 2023-12-01T01:03:31.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.475+0000 7fd512544700 1 Processor -- start 2023-12-01T01:03:31.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.475+0000 7fd512544700 1 -- start start 2023-12-01T01:03:31.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.476+0000 7fd512544700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd50c101020 0x7fd50c196e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:31.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.476+0000 7fd512544700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c1019d0 0x7fd50c1973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:31.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.476+0000 7fd512544700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd50c106100 0x7fd50c19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:31.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.476+0000 7fd512544700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c19be50 con 0x7fd50c1019d0 2023-12-01T01:03:31.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.476+0000 7fd512544700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c19bfc0 con 0x7fd50c106100 2023-12-01T01:03:31.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.476+0000 7fd512544700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50c19c180 con 0x7fd50c101020 2023-12-01T01:03:31.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.476+0000 7fd50b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c1019d0 0x7fd50c1973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:31.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.476+0000 7fd50b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c1019d0 0x7fd50c1973d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54132/0 (socket says 172.21.15.26:54132) 2023-12-01T01:03:31.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.476+0000 7fd50b7fe700 1 -- 172.21.15.26:0/79295374 learned_addr learned my addr 172.21.15.26:0/79295374 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:31.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.476+0000 7fd50bfff700 1 --2- 172.21.15.26:0/79295374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd50c101020 0x7fd50c196e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:31.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.476+0000 7fd50b7fe700 1 -- 172.21.15.26:0/79295374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd50c101020 msgr2=0x7fd50c196e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:31.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.476+0000 7fd50b7fe700 1 --2- 172.21.15.26:0/79295374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd50c101020 0x7fd50c196e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:31.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.476+0000 7fd50b7fe700 1 -- 172.21.15.26:0/79295374 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd50c106100 msgr2=0x7fd50c19b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:31.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.476+0000 7fd50b7fe700 1 --2- 172.21.15.26:0/79295374 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd50c106100 0x7fd50c19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:31.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.476+0000 7fd50b7fe700 1 -- 172.21.15.26:0/79295374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f40095f0 con 0x7fd50c1019d0 2023-12-01T01:03:31.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.476+0000 7fd50b7fe700 1 --2- 172.21.15.26:0/79295374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c1019d0 0x7fd50c1973d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd4f40095c0 tx=0x7fd4f400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:31.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.477+0000 7fd5097fa700 1 -- 172.21.15.26:0/79295374 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f401d070 con 0x7fd50c1019d0 2023-12-01T01:03:31.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.477+0000 7fd5097fa700 1 -- 172.21.15.26:0/79295374 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd4f4003680 con 0x7fd50c1019d0 2023-12-01T01:03:31.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.477+0000 7fd512544700 1 -- 172.21.15.26:0/79295374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50c19c400 con 0x7fd50c1019d0 2023-12-01T01:03:31.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.477+0000 7fd5097fa700 1 -- 172.21.15.26:0/79295374 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f40173f0 con 0x7fd50c1019d0 2023-12-01T01:03:31.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.477+0000 7fd512544700 1 -- 172.21.15.26:0/79295374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd50c073190 con 0x7fd50c1019d0 2023-12-01T01:03:31.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.478+0000 7fd512544700 1 -- 172.21.15.26:0/79295374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd50c04ea90 con 0x7fd50c1019d0 2023-12-01T01:03:31.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.479+0000 7fd5097fa700 1 -- 172.21.15.26:0/79295374 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fd4f400fad0 con 0x7fd50c1019d0 2023-12-01T01:03:31.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.479+0000 7fd5097fa700 1 --2- 172.21.15.26:0/79295374 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd4f80a05b0 0x7fd4f80a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:31.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.480+0000 7fd50bfff700 1 --2- 172.21.15.26:0/79295374 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd4f80a05b0 0x7fd4f80a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:31.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.480+0000 7fd5097fa700 1 -- 172.21.15.26:0/79295374 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd4f40cd590 con 0x7fd50c1019d0 2023-12-01T01:03:31.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.480+0000 7fd50bfff700 1 --2- 172.21.15.26:0/79295374 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd4f80a05b0 0x7fd4f80a2a70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc007be0 tx=0x7fd4fc0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:31.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.483+0000 7fd5097fa700 1 -- 172.21.15.26:0/79295374 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd4f4097190 con 0x7fd50c1019d0 2023-12-01T01:03:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.687+0000 7fd512544700 1 -- 172.21.15.26:0/79295374 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd50c0733b0 con 0x7fd50c1019d0 2023-12-01T01:03:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.688+0000 7fd5097fa700 1 -- 172.21.15.26:0/79295374 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd4f4027070 con 0x7fd50c1019d0 2023-12-01T01:03:31.689 INFO:teuthology.orchestra.run.smithi026.stdout:55834574908 2023-12-01T01:03:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.690+0000 7fd512544700 1 -- 172.21.15.26:0/79295374 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd4f80a05b0 msgr2=0x7fd4f80a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.690+0000 7fd512544700 1 --2- 172.21.15.26:0/79295374 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd4f80a05b0 0x7fd4f80a2a70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc007be0 tx=0x7fd4fc0073d0 comp rx=0 tx=0).stop 2023-12-01T01:03:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.690+0000 7fd512544700 1 -- 172.21.15.26:0/79295374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c1019d0 msgr2=0x7fd50c1973d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.690+0000 7fd512544700 1 --2- 172.21.15.26:0/79295374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c1019d0 0x7fd50c1973d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd4f40095c0 tx=0x7fd4f400f690 comp rx=0 tx=0).stop 2023-12-01T01:03:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.690+0000 7fd512544700 1 -- 172.21.15.26:0/79295374 shutdown_connections 2023-12-01T01:03:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.690+0000 7fd512544700 1 --2- 172.21.15.26:0/79295374 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd4f80a05b0 0x7fd4f80a2a70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.690+0000 7fd512544700 1 --2- 172.21.15.26:0/79295374 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd50c106100 0x7fd50c19b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.690+0000 7fd512544700 1 --2- 172.21.15.26:0/79295374 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd50c101020 0x7fd50c196e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.690+0000 7fd512544700 1 --2- 172.21.15.26:0/79295374 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c1019d0 0x7fd50c1973d0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.690+0000 7fd512544700 1 -- 172.21.15.26:0/79295374 >> 172.21.15.26:0/79295374 conn(0x7fd50c0fc8b0 msgr2=0x7fd50c0fd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.690+0000 7fd512544700 1 -- 172.21.15.26:0/79295374 shutdown_connections 2023-12-01T01:03:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:31.690+0000 7fd512544700 1 -- 172.21.15.26:0/79295374 wait complete. 2023-12-01T01:03:31.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:31 smithi026 ceph-mon[98801]: pgmap v269: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-01T01:03:31.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:31 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2181643717' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-12-01T01:03:31.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:31 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/79295374' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-01T01:03:31.808 INFO:tasks.cephadm.ceph_manager.ceph:need seq 326417514514 got 326417514516 for osd.11 2023-12-01T01:03:31.808 DEBUG:teuthology.parallel:result is None 2023-12-01T01:03:32.130 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574905 got 55834574908 for osd.1 2023-12-01T01:03:32.131 DEBUG:teuthology.parallel:result is None 2023-12-01T01:03:32.131 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-01T01:03:32.131 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph pg dump --format=json 2023-12-01T01:03:32.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:31 smithi116 ceph-mon[103554]: pgmap v269: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-01T01:03:32.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:31 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2181643717' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-12-01T01:03:32.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:31 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/79295374' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-01T01:03:32.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:31 smithi093 ceph-mon[103327]: pgmap v269: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-01T01:03:32.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:31 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2181643717' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-12-01T01:03:32.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:31 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/79295374' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-01T01:03:32.694 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:34.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:33 smithi026 ceph-mon[98801]: pgmap v270: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-01T01:03:34.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.066+0000 7f24e57dd700 1 -- 172.21.15.26:0/51221066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24e00fff00 msgr2=0x7f24e01002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:34.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.066+0000 7f24e57dd700 1 --2- 172.21.15.26:0/51221066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24e00fff00 0x7f24e01002e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009990 tx=0x7f24d0009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:34.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.066+0000 7f24e57dd700 1 -- 172.21.15.26:0/51221066 shutdown_connections 2023-12-01T01:03:34.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.066+0000 7f24e57dd700 1 --2- 172.21.15.26:0/51221066 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24e0104fe0 0x7f24e010cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:34.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.066+0000 7f24e57dd700 1 --2- 172.21.15.26:0/51221066 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24e00fff00 0x7f24e01002e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:34.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.066+0000 7f24e57dd700 1 --2- 172.21.15.26:0/51221066 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24e01008b0 0x7f24e0104900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:34.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.066+0000 7f24e57dd700 1 -- 172.21.15.26:0/51221066 >> 172.21.15.26:0/51221066 conn(0x7f24e00fb790 msgr2=0x7f24e00fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:34.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.066+0000 7f24e57dd700 1 -- 172.21.15.26:0/51221066 shutdown_connections 2023-12-01T01:03:34.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.066+0000 7f24e57dd700 1 -- 172.21.15.26:0/51221066 wait complete. 2023-12-01T01:03:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.066+0000 7f24e57dd700 1 Processor -- start 2023-12-01T01:03:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.066+0000 7f24e57dd700 1 -- start start 2023-12-01T01:03:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24e57dd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24e00fff00 0x7f24e0197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24e57dd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24e01008b0 0x7f24e0197560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24e57dd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24e0104fe0 0x7f24e019b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24e57dd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e019bfe0 con 0x7f24e00fff00 2023-12-01T01:03:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24e57dd700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e019c150 con 0x7f24e01008b0 2023-12-01T01:03:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24e57dd700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e019c310 con 0x7f24e0104fe0 2023-12-01T01:03:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24deffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24e00fff00 0x7f24e0197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24deffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24e00fff00 0x7f24e0197020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54142/0 (socket says 172.21.15.26:54142) 2023-12-01T01:03:34.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24deffd700 1 -- 172.21.15.26:0/1217392206 learned_addr learned my addr 172.21.15.26:0/1217392206 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24df7fe700 1 --2- 172.21.15.26:0/1217392206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24e0104fe0 0x7f24e019b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24d7fff700 1 --2- 172.21.15.26:0/1217392206 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24e01008b0 0x7f24e0197560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24deffd700 1 -- 172.21.15.26:0/1217392206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24e0104fe0 msgr2=0x7f24e019b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24deffd700 1 --2- 172.21.15.26:0/1217392206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24e0104fe0 0x7f24e019b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24deffd700 1 -- 172.21.15.26:0/1217392206 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24e01008b0 msgr2=0x7f24e0197560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24deffd700 1 --2- 172.21.15.26:0/1217392206 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24e01008b0 0x7f24e0197560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24deffd700 1 -- 172.21.15.26:0/1217392206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d00095f0 con 0x7f24e00fff00 2023-12-01T01:03:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24deffd700 1 --2- 172.21.15.26:0/1217392206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24e00fff00 0x7f24e0197020 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f24d0006010 tx=0x7f24d000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24dcff9700 1 -- 172.21.15.26:0/1217392206 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d001d070 con 0x7f24e00fff00 2023-12-01T01:03:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24dcff9700 1 -- 172.21.15.26:0/1217392206 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f24d000fc30 con 0x7f24e00fff00 2023-12-01T01:03:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24dcff9700 1 -- 172.21.15.26:0/1217392206 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0017650 con 0x7f24e00fff00 2023-12-01T01:03:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24e57dd700 1 -- 172.21.15.26:0/1217392206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e019c590 con 0x7f24e00fff00 2023-12-01T01:03:34.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.067+0000 7f24e57dd700 1 -- 172.21.15.26:0/1217392206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e01a3e50 con 0x7f24e00fff00 2023-12-01T01:03:34.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.068+0000 7f24e57dd700 1 -- 172.21.15.26:0/1217392206 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e004ea90 con 0x7f24e00fff00 2023-12-01T01:03:34.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.070+0000 7f24dcff9700 1 -- 172.21.15.26:0/1217392206 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f24d0004800 con 0x7f24e00fff00 2023-12-01T01:03:34.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.070+0000 7f24dcff9700 1 --2- 172.21.15.26:0/1217392206 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f24cc0a0630 0x7f24cc0a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:34.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.070+0000 7f24d7fff700 1 --2- 172.21.15.26:0/1217392206 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f24cc0a0630 0x7f24cc0a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:34.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.070+0000 7f24dcff9700 1 -- 172.21.15.26:0/1217392206 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f24d00ccfa0 con 0x7f24e00fff00 2023-12-01T01:03:34.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.071+0000 7f24d7fff700 1 --2- 172.21.15.26:0/1217392206 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f24cc0a0630 0x7f24cc0a2af0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f24c8005fd0 tx=0x7f24c800a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:34.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.074+0000 7f24dcff9700 1 -- 172.21.15.26:0/1217392206 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f24d0096b20 con 0x7f24e00fff00 2023-12-01T01:03:34.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:33 smithi116 ceph-mon[103554]: pgmap v270: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-01T01:03:34.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:33 smithi093 ceph-mon[103327]: pgmap v270: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-01T01:03:34.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.268+0000 7f24e57dd700 1 -- 172.21.15.26:0/1217392206 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24e0069230 con 0x7f24cc0a0630 2023-12-01T01:03:34.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.280+0000 7f24dcff9700 1 -- 172.21.15.26:0/1217392206 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340118 (secure 0 0 0) 0x7f24e0069230 con 0x7f24cc0a0630 2023-12-01T01:03:34.285 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:03:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.284+0000 7f24e57dd700 1 -- 172.21.15.26:0/1217392206 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f24cc0a0630 msgr2=0x7f24cc0a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.284+0000 7f24e57dd700 1 --2- 172.21.15.26:0/1217392206 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f24cc0a0630 0x7f24cc0a2af0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f24c8005fd0 tx=0x7f24c800a560 comp rx=0 tx=0).stop 2023-12-01T01:03:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.284+0000 7f24e57dd700 1 -- 172.21.15.26:0/1217392206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24e00fff00 msgr2=0x7f24e0197020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.284+0000 7f24e57dd700 1 --2- 172.21.15.26:0/1217392206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24e00fff00 0x7f24e0197020 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f24d0006010 tx=0x7f24d000f740 comp rx=0 tx=0).stop 2023-12-01T01:03:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.284+0000 7f24e57dd700 1 -- 172.21.15.26:0/1217392206 shutdown_connections 2023-12-01T01:03:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.284+0000 7f24e57dd700 1 --2- 172.21.15.26:0/1217392206 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f24cc0a0630 0x7f24cc0a2af0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.284+0000 7f24e57dd700 1 --2- 172.21.15.26:0/1217392206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f24e0104fe0 0x7f24e019b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.284+0000 7f24e57dd700 1 --2- 172.21.15.26:0/1217392206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f24e00fff00 0x7f24e0197020 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.284+0000 7f24e57dd700 1 --2- 172.21.15.26:0/1217392206 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24e01008b0 0x7f24e0197560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:34.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.284+0000 7f24e57dd700 1 -- 172.21.15.26:0/1217392206 >> 172.21.15.26:0/1217392206 conn(0x7f24e00fb790 msgr2=0x7f24e0103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.284+0000 7f24e57dd700 1 -- 172.21.15.26:0/1217392206 shutdown_connections 2023-12-01T01:03:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:34.284+0000 7f24e57dd700 1 -- 172.21.15.26:0/1217392206 wait complete. 2023-12-01T01:03:34.289 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-12-01T01:03:34.756 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2023-12-01T01:03:33.965378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653444,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":380,"num_read_kb":299,"num_write":333,"num_write_kb":3043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1221573,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":334436,"kb_used_data":11012,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124607388,"statfs":{"total":1151940427776,"available":1151597965312,"internally_reserved":0,"allocated":11276288,"data_stored":7154628,"data_compressed":114720,"data_compressed_allocated":143360,"data_compressed_original":1806336,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":38,"num_write":1,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003160"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629901+0000","last_change":"2023-12-01T01:02:47.280671+0000","last_active":"2023-12-01T01:02:58.629901+0000","last_peered":"2023-12-01T01:02:58.629901+0000","last_clean":"2023-12-01T01:02:58.629901+0000","last_became_active":"2023-12-01T01:02:47.279922+0000","last_became_peered":"2023-12-01T01:02:47.279922+0000","last_unstale":"2023-12-01T01:02:58.629901+0000","last_undegraded":"2023-12-01T01:02:58.629901+0000","last_fullsized":"2023-12-01T01:02:58.629901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:07:38.049977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.633925+0000","last_change":"2023-12-01T01:02:47.286185+0000","last_active":"2023-12-01T01:02:58.633925+0000","last_peered":"2023-12-01T01:02:58.633925+0000","last_clean":"2023-12-01T01:02:58.633925+0000","last_became_active":"2023-12-01T01:02:47.283747+0000","last_became_peered":"2023-12-01T01:02:47.283747+0000","last_unstale":"2023-12-01T01:02:58.633925+0000","last_undegraded":"2023-12-01T01:02:58.633925+0000","last_fullsized":"2023-12-01T01:02:58.633925+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:38:32.697826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.633936+0000","last_change":"2023-12-01T01:02:47.285778+0000","last_active":"2023-12-01T01:02:58.633936+0000","last_peered":"2023-12-01T01:02:58.633936+0000","last_clean":"2023-12-01T01:02:58.633936+0000","last_became_active":"2023-12-01T01:02:47.279395+0000","last_became_peered":"2023-12-01T01:02:47.279395+0000","last_unstale":"2023-12-01T01:02:58.633936+0000","last_undegraded":"2023-12-01T01:02:58.633936+0000","last_fullsized":"2023-12-01T01:02:58.633936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:04:20.570660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.631324+0000","last_change":"2023-12-01T01:02:47.269316+0000","last_active":"2023-12-01T01:02:58.631324+0000","last_peered":"2023-12-01T01:02:58.631324+0000","last_clean":"2023-12-01T01:02:58.631324+0000","last_became_active":"2023-12-01T01:02:47.269041+0000","last_became_peered":"2023-12-01T01:02:47.269041+0000","last_unstale":"2023-12-01T01:02:58.631324+0000","last_undegraded":"2023-12-01T01:02:58.631324+0000","last_fullsized":"2023-12-01T01:02:58.631324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:24:27.951422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634558+0000","last_change":"2023-12-01T01:02:47.273802+0000","last_active":"2023-12-01T01:02:58.634558+0000","last_peered":"2023-12-01T01:02:58.634558+0000","last_clean":"2023-12-01T01:02:58.634558+0000","last_became_active":"2023-12-01T01:02:47.273450+0000","last_became_peered":"2023-12-01T01:02:47.273450+0000","last_unstale":"2023-12-01T01:02:58.634558+0000","last_undegraded":"2023-12-01T01:02:58.634558+0000","last_fullsized":"2023-12-01T01:02:58.634558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:19:39.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.633006+0000","last_change":"2023-12-01T01:02:47.274505+0000","last_active":"2023-12-01T01:02:58.633006+0000","last_peered":"2023-12-01T01:02:58.633006+0000","last_clean":"2023-12-01T01:02:58.633006+0000","last_became_active":"2023-12-01T01:02:47.274141+0000","last_became_peered":"2023-12-01T01:02:47.274141+0000","last_unstale":"2023-12-01T01:02:58.633006+0000","last_undegraded":"2023-12-01T01:02:58.633006+0000","last_fullsized":"2023-12-01T01:02:58.633006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:27:16.589927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638314+0000","last_change":"2023-12-01T01:02:47.279480+0000","last_active":"2023-12-01T01:02:58.638314+0000","last_peered":"2023-12-01T01:02:58.638314+0000","last_clean":"2023-12-01T01:02:58.638314+0000","last_became_active":"2023-12-01T01:02:47.279147+0000","last_became_peered":"2023-12-01T01:02:47.279147+0000","last_unstale":"2023-12-01T01:02:58.638314+0000","last_undegraded":"2023-12-01T01:02:58.638314+0000","last_fullsized":"2023-12-01T01:02:58.638314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:28:37.815087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637462+0000","last_change":"2023-12-01T01:02:47.283997+0000","last_active":"2023-12-01T01:02:58.637462+0000","last_peered":"2023-12-01T01:02:58.637462+0000","last_clean":"2023-12-01T01:02:58.637462+0000","last_became_active":"2023-12-01T01:02:47.283694+0000","last_became_peered":"2023-12-01T01:02:47.283694+0000","last_unstale":"2023-12-01T01:02:58.637462+0000","last_undegraded":"2023-12-01T01:02:58.637462+0000","last_fullsized":"2023-12-01T01:02:58.637462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:49:30.154079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635350+0000","last_change":"2023-12-01T01:02:47.280113+0000","last_active":"2023-12-01T01:02:58.635350+0000","last_peered":"2023-12-01T01:02:58.635350+0000","last_clean":"2023-12-01T01:02:58.635350+0000","last_became_active":"2023-12-01T01:02:47.279844+0000","last_became_peered":"2023-12-01T01:02:47.279844+0000","last_unstale":"2023-12-01T01:02:58.635350+0000","last_undegraded":"2023-12-01T01:02:58.635350+0000","last_fullsized":"2023-12-01T01:02:58.635350+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:50:19.955146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.632570+0000","last_change":"2023-12-01T01:02:47.275575+0000","last_active":"2023-12-01T01:02:58.632570+0000","last_peered":"2023-12-01T01:02:58.632570+0000","last_clean":"2023-12-01T01:02:58.632570+0000","last_became_active":"2023-12-01T01:02:47.275283+0000","last_became_peered":"2023-12-01T01:02:47.275283+0000","last_unstale":"2023-12-01T01:02:58.632570+0000","last_undegraded":"2023-12-01T01:02:58.632570+0000","last_fullsized":"2023-12-01T01:02:58.632570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:08:41.842374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638801+0000","last_change":"2023-12-01T01:02:47.275992+0000","last_active":"2023-12-01T01:02:58.638801+0000","last_peered":"2023-12-01T01:02:58.638801+0000","last_clean":"2023-12-01T01:02:58.638801+0000","last_became_active":"2023-12-01T01:02:47.275406+0000","last_became_peered":"2023-12-01T01:02:47.275406+0000","last_unstale":"2023-12-01T01:02:58.638801+0000","last_undegraded":"2023-12-01T01:02:58.638801+0000","last_fullsized":"2023-12-01T01:02:58.638801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:58:39.978873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.631254+0000","last_change":"2023-12-01T01:02:47.282829+0000","last_active":"2023-12-01T01:02:58.631254+0000","last_peered":"2023-12-01T01:02:58.631254+0000","last_clean":"2023-12-01T01:02:58.631254+0000","last_became_active":"2023-12-01T01:02:47.282007+0000","last_became_peered":"2023-12-01T01:02:47.282007+0000","last_unstale":"2023-12-01T01:02:58.631254+0000","last_undegraded":"2023-12-01T01:02:58.631254+0000","last_fullsized":"2023-12-01T01:02:58.631254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:55:57.394004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629377+0000","last_change":"2023-12-01T01:02:47.276769+0000","last_active":"2023-12-01T01:02:58.629377+0000","last_peered":"2023-12-01T01:02:58.629377+0000","last_clean":"2023-12-01T01:02:58.629377+0000","last_became_active":"2023-12-01T01:02:47.276355+0000","last_became_peered":"2023-12-01T01:02:47.276355+0000","last_unstale":"2023-12-01T01:02:58.629377+0000","last_undegraded":"2023-12-01T01:02:58.629377+0000","last_fullsized":"2023-12-01T01:02:58.629377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:15:23.314516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634053+0000","last_change":"2023-12-01T01:02:47.286107+0000","last_active":"2023-12-01T01:02:58.634053+0000","last_peered":"2023-12-01T01:02:58.634053+0000","last_clean":"2023-12-01T01:02:58.634053+0000","last_became_active":"2023-12-01T01:02:47.285772+0000","last_became_peered":"2023-12-01T01:02:47.285772+0000","last_unstale":"2023-12-01T01:02:58.634053+0000","last_undegraded":"2023-12-01T01:02:58.634053+0000","last_fullsized":"2023-12-01T01:02:58.634053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:30:29.730055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.633701+0000","last_change":"2023-12-01T01:02:47.281813+0000","last_active":"2023-12-01T01:02:58.633701+0000","last_peered":"2023-12-01T01:02:58.633701+0000","last_clean":"2023-12-01T01:02:58.633701+0000","last_became_active":"2023-12-01T01:02:47.279117+0000","last_became_peered":"2023-12-01T01:02:47.279117+0000","last_unstale":"2023-12-01T01:02:58.633701+0000","last_undegraded":"2023-12-01T01:02:58.633701+0000","last_fullsized":"2023-12-01T01:02:58.633701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:11:34.646161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634802+0000","last_change":"2023-12-01T01:02:47.289596+0000","last_active":"2023-12-01T01:02:58.634802+0000","last_peered":"2023-12-01T01:02:58.634802+0000","last_clean":"2023-12-01T01:02:58.634802+0000","last_became_active":"2023-12-01T01:02:47.289273+0000","last_became_peered":"2023-12-01T01:02:47.289273+0000","last_unstale":"2023-12-01T01:02:58.634802+0000","last_undegraded":"2023-12-01T01:02:58.634802+0000","last_fullsized":"2023-12-01T01:02:58.634802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:10:33.606237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629905+0000","last_change":"2023-12-01T01:02:47.281198+0000","last_active":"2023-12-01T01:02:58.629905+0000","last_peered":"2023-12-01T01:02:58.629905+0000","last_clean":"2023-12-01T01:02:58.629905+0000","last_became_active":"2023-12-01T01:02:47.280903+0000","last_became_peered":"2023-12-01T01:02:47.280903+0000","last_unstale":"2023-12-01T01:02:58.629905+0000","last_undegraded":"2023-12-01T01:02:58.629905+0000","last_fullsized":"2023-12-01T01:02:58.629905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:14:56.199140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634851+0000","last_change":"2023-12-01T01:02:47.281015+0000","last_active":"2023-12-01T01:02:58.634851+0000","last_peered":"2023-12-01T01:02:58.634851+0000","last_clean":"2023-12-01T01:02:58.634851+0000","last_became_active":"2023-12-01T01:02:47.280670+0000","last_became_peered":"2023-12-01T01:02:47.280670+0000","last_unstale":"2023-12-01T01:02:58.634851+0000","last_undegraded":"2023-12-01T01:02:58.634851+0000","last_fullsized":"2023-12-01T01:02:58.634851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:13:12.686506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635315+0000","last_change":"2023-12-01T01:02:47.283444+0000","last_active":"2023-12-01T01:02:58.635315+0000","last_peered":"2023-12-01T01:02:58.635315+0000","last_clean":"2023-12-01T01:02:58.635315+0000","last_became_active":"2023-12-01T01:02:47.283131+0000","last_became_peered":"2023-12-01T01:02:47.283131+0000","last_unstale":"2023-12-01T01:02:58.635315+0000","last_undegraded":"2023-12-01T01:02:58.635315+0000","last_fullsized":"2023-12-01T01:02:58.635315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:36:50.069639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635021+0000","last_change":"2023-12-01T01:02:46.825507+0000","last_active":"2023-12-01T01:02:58.635021+0000","last_peered":"2023-12-01T01:02:58.635021+0000","last_clean":"2023-12-01T01:02:58.635021+0000","last_became_active":"2023-12-01T01:02:46.825170+0000","last_became_peered":"2023-12-01T01:02:46.825170+0000","last_unstale":"2023-12-01T01:02:58.635021+0000","last_undegraded":"2023-12-01T01:02:58.635021+0000","last_fullsized":"2023-12-01T01:02:58.635021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:10:10.518664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:00.001703+0000","last_change":"2023-12-01T01:03:00.001168+0000","last_active":"2023-12-01T01:03:00.001703+0000","last_peered":"2023-12-01T01:03:00.001703+0000","last_clean":"2023-12-01T01:03:00.001703+0000","last_became_active":"2023-12-01T01:03:00.000826+0000","last_became_peered":"2023-12-01T01:03:00.000826+0000","last_unstale":"2023-12-01T01:03:00.001703+0000","last_undegraded":"2023-12-01T01:03:00.001703+0000","last_fullsized":"2023-12-01T01:03:00.001703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:03:25.647589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638080+0000","last_change":"2023-12-01T01:02:46.835504+0000","last_active":"2023-12-01T01:02:58.638080+0000","last_peered":"2023-12-01T01:02:58.638080+0000","last_clean":"2023-12-01T01:02:58.638080+0000","last_became_active":"2023-12-01T01:02:46.835206+0000","last_became_peered":"2023-12-01T01:02:46.835206+0000","last_unstale":"2023-12-01T01:02:58.638080+0000","last_undegraded":"2023-12-01T01:02:58.638080+0000","last_fullsized":"2023-12-01T01:02:58.638080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:42:18.756880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634395+0000","last_change":"2023-12-01T01:02:47.286713+0000","last_active":"2023-12-01T01:02:58.634395+0000","last_peered":"2023-12-01T01:02:58.634395+0000","last_clean":"2023-12-01T01:02:58.634395+0000","last_became_active":"2023-12-01T01:02:47.285868+0000","last_became_peered":"2023-12-01T01:02:47.285868+0000","last_unstale":"2023-12-01T01:02:58.634395+0000","last_undegraded":"2023-12-01T01:02:58.634395+0000","last_fullsized":"2023-12-01T01:02:58.634395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:16:31.496085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.648184+0000","last_change":"2023-12-01T01:02:59.647766+0000","last_active":"2023-12-01T01:02:59.648184+0000","last_peered":"2023-12-01T01:02:59.648184+0000","last_clean":"2023-12-01T01:02:59.648184+0000","last_became_active":"2023-12-01T01:02:59.641808+0000","last_became_peered":"2023-12-01T01:02:59.641808+0000","last_unstale":"2023-12-01T01:02:59.648184+0000","last_undegraded":"2023-12-01T01:02:59.648184+0000","last_fullsized":"2023-12-01T01:02:59.648184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:57:44.213111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635324+0000","last_change":"2023-12-01T01:02:47.284868+0000","last_active":"2023-12-01T01:02:58.635324+0000","last_peered":"2023-12-01T01:02:58.635324+0000","last_clean":"2023-12-01T01:02:58.635324+0000","last_became_active":"2023-12-01T01:02:47.284602+0000","last_became_peered":"2023-12-01T01:02:47.284602+0000","last_unstale":"2023-12-01T01:02:58.635324+0000","last_undegraded":"2023-12-01T01:02:58.635324+0000","last_fullsized":"2023-12-01T01:02:58.635324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:12:36.510333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634994+0000","last_change":"2023-12-01T01:02:46.832234+0000","last_active":"2023-12-01T01:02:58.634994+0000","last_peered":"2023-12-01T01:02:58.634994+0000","last_clean":"2023-12-01T01:02:58.634994+0000","last_became_active":"2023-12-01T01:02:46.831986+0000","last_became_peered":"2023-12-01T01:02:46.831986+0000","last_unstale":"2023-12-01T01:02:58.634994+0000","last_undegraded":"2023-12-01T01:02:58.634994+0000","last_fullsized":"2023-12-01T01:02:58.634994+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:49:35.773243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.639557+0000","last_change":"2023-12-01T01:02:47.275033+0000","last_active":"2023-12-01T01:02:58.639557+0000","last_peered":"2023-12-01T01:02:58.639557+0000","last_clean":"2023-12-01T01:02:58.639557+0000","last_became_active":"2023-12-01T01:02:47.274730+0000","last_became_peered":"2023-12-01T01:02:47.274730+0000","last_unstale":"2023-12-01T01:02:58.639557+0000","last_undegraded":"2023-12-01T01:02:58.639557+0000","last_fullsized":"2023-12-01T01:02:58.639557+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:48:44.959720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":61,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:28.391978+0000","last_change":"2023-12-01T01:02:46.827046+0000","last_active":"2023-12-01T01:03:28.391978+0000","last_peered":"2023-12-01T01:03:28.391978+0000","last_clean":"2023-12-01T01:03:28.391978+0000","last_became_active":"2023-12-01T01:02:46.826716+0000","last_became_peered":"2023-12-01T01:02:46.826716+0000","last_unstale":"2023-12-01T01:03:28.391978+0000","last_undegraded":"2023-12-01T01:03:28.391978+0000","last_fullsized":"2023-12-01T01:03:28.391978+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:06:46.195630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637058+0000","last_change":"2023-12-01T01:02:47.270299+0000","last_active":"2023-12-01T01:02:58.637058+0000","last_peered":"2023-12-01T01:02:58.637058+0000","last_clean":"2023-12-01T01:02:58.637058+0000","last_became_active":"2023-12-01T01:02:47.270016+0000","last_became_peered":"2023-12-01T01:02:47.270016+0000","last_unstale":"2023-12-01T01:02:58.637058+0000","last_undegraded":"2023-12-01T01:02:58.637058+0000","last_fullsized":"2023-12-01T01:02:58.637058+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:16:30.207449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.643802+0000","last_change":"2023-12-01T01:02:59.643802+0000","last_active":"2023-12-01T01:02:59.643802+0000","last_peered":"2023-12-01T01:02:59.643802+0000","last_clean":"2023-12-01T01:02:59.643802+0000","last_became_active":"2023-12-01T01:02:59.640951+0000","last_became_peered":"2023-12-01T01:02:59.640951+0000","last_unstale":"2023-12-01T01:02:59.643802+0000","last_undegraded":"2023-12-01T01:02:59.643802+0000","last_fullsized":"2023-12-01T01:02:59.643802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:52:32.599515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638692+0000","last_change":"2023-12-01T01:02:47.274600+0000","last_active":"2023-12-01T01:02:58.638692+0000","last_peered":"2023-12-01T01:02:58.638692+0000","last_clean":"2023-12-01T01:02:58.638692+0000","last_became_active":"2023-12-01T01:02:47.273979+0000","last_became_peered":"2023-12-01T01:02:47.273979+0000","last_unstale":"2023-12-01T01:02:58.638692+0000","last_undegraded":"2023-12-01T01:02:58.638692+0000","last_fullsized":"2023-12-01T01:02:58.638692+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:20:55.693393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629126+0000","last_change":"2023-12-01T01:02:46.821479+0000","last_active":"2023-12-01T01:02:58.629126+0000","last_peered":"2023-12-01T01:02:58.629126+0000","last_clean":"2023-12-01T01:02:58.629126+0000","last_became_active":"2023-12-01T01:02:46.821090+0000","last_became_peered":"2023-12-01T01:02:46.821090+0000","last_unstale":"2023-12-01T01:02:58.629126+0000","last_undegraded":"2023-12-01T01:02:58.629126+0000","last_fullsized":"2023-12-01T01:02:58.629126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:17:48.216217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637541+0000","last_change":"2023-12-01T01:02:47.274298+0000","last_active":"2023-12-01T01:02:58.637541+0000","last_peered":"2023-12-01T01:02:58.637541+0000","last_clean":"2023-12-01T01:02:58.637541+0000","last_became_active":"2023-12-01T01:02:47.274006+0000","last_became_peered":"2023-12-01T01:02:47.274006+0000","last_unstale":"2023-12-01T01:02:58.637541+0000","last_undegraded":"2023-12-01T01:02:58.637541+0000","last_fullsized":"2023-12-01T01:02:58.637541+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:38.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637568+0000","last_change":"2023-12-01T01:02:46.826341+0000","last_active":"2023-12-01T01:02:58.637568+0000","last_peered":"2023-12-01T01:02:58.637568+0000","last_clean":"2023-12-01T01:02:58.637568+0000","last_became_active":"2023-12-01T01:02:46.825979+0000","last_became_peered":"2023-12-01T01:02:46.825979+0000","last_unstale":"2023-12-01T01:02:58.637568+0000","last_undegraded":"2023-12-01T01:02:58.637568+0000","last_fullsized":"2023-12-01T01:02:58.637568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:29:48.681232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634567+0000","last_change":"2023-12-01T01:02:47.280989+0000","last_active":"2023-12-01T01:02:58.634567+0000","last_peered":"2023-12-01T01:02:58.634567+0000","last_clean":"2023-12-01T01:02:58.634567+0000","last_became_active":"2023-12-01T01:02:47.280649+0000","last_became_peered":"2023-12-01T01:02:47.280649+0000","last_unstale":"2023-12-01T01:02:58.634567+0000","last_undegraded":"2023-12-01T01:02:58.634567+0000","last_fullsized":"2023-12-01T01:02:58.634567+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:16:30.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'3","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:30.394702+0000","last_change":"2023-12-01T01:02:46.832304+0000","last_active":"2023-12-01T01:03:30.394702+0000","last_peered":"2023-12-01T01:03:30.394702+0000","last_clean":"2023-12-01T01:03:30.394702+0000","last_became_active":"2023-12-01T01:02:46.832014+0000","last_became_peered":"2023-12-01T01:02:46.832014+0000","last_unstale":"2023-12-01T01:03:30.394702+0000","last_undegraded":"2023-12-01T01:03:30.394702+0000","last_fullsized":"2023-12-01T01:03:30.394702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:41:46.003527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635324+0000","last_change":"2023-12-01T01:02:47.277819+0000","last_active":"2023-12-01T01:02:58.635324+0000","last_peered":"2023-12-01T01:02:58.635324+0000","last_clean":"2023-12-01T01:02:58.635324+0000","last_became_active":"2023-12-01T01:02:47.277534+0000","last_became_peered":"2023-12-01T01:02:47.277534+0000","last_unstale":"2023-12-01T01:02:58.635324+0000","last_undegraded":"2023-12-01T01:02:58.635324+0000","last_fullsized":"2023-12-01T01:02:58.635324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:56:15.627538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638700+0000","last_change":"2023-12-01T01:02:46.826783+0000","last_active":"2023-12-01T01:02:58.638700+0000","last_peered":"2023-12-01T01:02:58.638700+0000","last_clean":"2023-12-01T01:02:58.638700+0000","last_became_active":"2023-12-01T01:02:46.826479+0000","last_became_peered":"2023-12-01T01:02:46.826479+0000","last_unstale":"2023-12-01T01:02:58.638700+0000","last_undegraded":"2023-12-01T01:02:58.638700+0000","last_fullsized":"2023-12-01T01:02:58.638700+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:30:09.681494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:00.001466+0000","last_change":"2023-12-01T01:03:00.001466+0000","last_active":"2023-12-01T01:03:00.001466+0000","last_peered":"2023-12-01T01:03:00.001466+0000","last_clean":"2023-12-01T01:03:00.001466+0000","last_became_active":"2023-12-01T01:03:00.001077+0000","last_became_peered":"2023-12-01T01:03:00.001077+0000","last_unstale":"2023-12-01T01:03:00.001466+0000","last_undegraded":"2023-12-01T01:03:00.001466+0000","last_fullsized":"2023-12-01T01:03:00.001466+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:46:26.987257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.639542+0000","last_change":"2023-12-01T01:02:46.829332+0000","last_active":"2023-12-01T01:02:58.639542+0000","last_peered":"2023-12-01T01:02:58.639542+0000","last_clean":"2023-12-01T01:02:58.639542+0000","last_became_active":"2023-12-01T01:02:46.828828+0000","last_became_peered":"2023-12-01T01:02:46.828828+0000","last_unstale":"2023-12-01T01:02:58.639542+0000","last_undegraded":"2023-12-01T01:02:58.639542+0000","last_fullsized":"2023-12-01T01:02:58.639542+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:15:15.648138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635427+0000","last_change":"2023-12-01T01:02:47.277938+0000","last_active":"2023-12-01T01:02:58.635427+0000","last_peered":"2023-12-01T01:02:58.635427+0000","last_clean":"2023-12-01T01:02:58.635427+0000","last_became_active":"2023-12-01T01:02:47.277650+0000","last_became_peered":"2023-12-01T01:02:47.277650+0000","last_unstale":"2023-12-01T01:02:58.635427+0000","last_undegraded":"2023-12-01T01:02:58.635427+0000","last_fullsized":"2023-12-01T01:02:58.635427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:03:46.667892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'27","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:31.051291+0000","last_change":"2023-12-01T01:03:00.008983+0000","last_active":"2023-12-01T01:03:31.051291+0000","last_peered":"2023-12-01T01:03:31.051291+0000","last_clean":"2023-12-01T01:03:31.051291+0000","last_became_active":"2023-12-01T01:03:00.001444+0000","last_became_peered":"2023-12-01T01:03:00.001444+0000","last_unstale":"2023-12-01T01:03:31.051291+0000","last_undegraded":"2023-12-01T01:03:31.051291+0000","last_fullsized":"2023-12-01T01:03:31.051291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:29:25.347028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58530,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":91,"num_write":28,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":40837,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635297+0000","last_change":"2023-12-01T01:02:47.272049+0000","last_active":"2023-12-01T01:02:58.635297+0000","last_peered":"2023-12-01T01:02:58.635297+0000","last_clean":"2023-12-01T01:02:58.635297+0000","last_became_active":"2023-12-01T01:02:47.271726+0000","last_became_peered":"2023-12-01T01:02:47.271726+0000","last_unstale":"2023-12-01T01:02:58.635297+0000","last_undegraded":"2023-12-01T01:02:58.635297+0000","last_fullsized":"2023-12-01T01:02:58.635297+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:08:45.038989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634393+0000","last_change":"2023-12-01T01:02:46.831362+0000","last_active":"2023-12-01T01:02:58.634393+0000","last_peered":"2023-12-01T01:02:58.634393+0000","last_clean":"2023-12-01T01:02:58.634393+0000","last_became_active":"2023-12-01T01:02:46.830929+0000","last_became_peered":"2023-12-01T01:02:46.830929+0000","last_unstale":"2023-12-01T01:02:58.634393+0000","last_undegraded":"2023-12-01T01:02:58.634393+0000","last_fullsized":"2023-12-01T01:02:58.634393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:39:54.855526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629172+0000","last_change":"2023-12-01T01:02:47.275343+0000","last_active":"2023-12-01T01:02:58.629172+0000","last_peered":"2023-12-01T01:02:58.629172+0000","last_clean":"2023-12-01T01:02:58.629172+0000","last_became_active":"2023-12-01T01:02:47.275042+0000","last_became_peered":"2023-12-01T01:02:47.275042+0000","last_unstale":"2023-12-01T01:02:58.629172+0000","last_undegraded":"2023-12-01T01:02:58.629172+0000","last_fullsized":"2023-12-01T01:02:58.629172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:18:27.862601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638406+0000","last_change":"2023-12-01T01:02:46.831996+0000","last_active":"2023-12-01T01:02:58.638406+0000","last_peered":"2023-12-01T01:02:58.638406+0000","last_clean":"2023-12-01T01:02:58.638406+0000","last_became_active":"2023-12-01T01:02:46.831710+0000","last_became_peered":"2023-12-01T01:02:46.831710+0000","last_unstale":"2023-12-01T01:02:58.638406+0000","last_undegraded":"2023-12-01T01:02:58.638406+0000","last_fullsized":"2023-12-01T01:02:58.638406+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:50:42.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638845+0000","last_change":"2023-12-01T01:02:47.283771+0000","last_active":"2023-12-01T01:02:58.638845+0000","last_peered":"2023-12-01T01:02:58.638845+0000","last_clean":"2023-12-01T01:02:58.638845+0000","last_became_active":"2023-12-01T01:02:47.283363+0000","last_became_peered":"2023-12-01T01:02:47.283363+0000","last_unstale":"2023-12-01T01:02:58.638845+0000","last_undegraded":"2023-12-01T01:02:58.638845+0000","last_fullsized":"2023-12-01T01:02:58.638845+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:44:40.918161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":59,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:28.392004+0000","last_change":"2023-12-01T01:02:46.825170+0000","last_active":"2023-12-01T01:03:28.392004+0000","last_peered":"2023-12-01T01:03:28.392004+0000","last_clean":"2023-12-01T01:03:28.392004+0000","last_became_active":"2023-12-01T01:02:46.824857+0000","last_became_peered":"2023-12-01T01:02:46.824857+0000","last_unstale":"2023-12-01T01:03:28.392004+0000","last_undegraded":"2023-12-01T01:03:28.392004+0000","last_fullsized":"2023-12-01T01:03:28.392004+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:05:54.095408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638178+0000","last_change":"2023-12-01T01:02:47.279495+0000","last_active":"2023-12-01T01:02:58.638178+0000","last_peered":"2023-12-01T01:02:58.638178+0000","last_clean":"2023-12-01T01:02:58.638178+0000","last_became_active":"2023-12-01T01:02:47.279171+0000","last_became_peered":"2023-12-01T01:02:47.279171+0000","last_unstale":"2023-12-01T01:02:58.638178+0000","last_undegraded":"2023-12-01T01:02:58.638178+0000","last_fullsized":"2023-12-01T01:02:58.638178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:29:33.298818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634745+0000","last_change":"2023-12-01T01:02:46.833837+0000","last_active":"2023-12-01T01:02:58.634745+0000","last_peered":"2023-12-01T01:02:58.634745+0000","last_clean":"2023-12-01T01:02:58.634745+0000","last_became_active":"2023-12-01T01:02:46.833549+0000","last_became_peered":"2023-12-01T01:02:46.833549+0000","last_unstale":"2023-12-01T01:02:58.634745+0000","last_undegraded":"2023-12-01T01:02:58.634745+0000","last_fullsized":"2023-12-01T01:02:58.634745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:35:02.581360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638414+0000","last_change":"2023-12-01T01:02:47.273884+0000","last_active":"2023-12-01T01:02:58.638414+0000","last_peered":"2023-12-01T01:02:58.638414+0000","last_clean":"2023-12-01T01:02:58.638414+0000","last_became_active":"2023-12-01T01:02:47.273575+0000","last_became_peered":"2023-12-01T01:02:47.273575+0000","last_unstale":"2023-12-01T01:02:58.638414+0000","last_undegraded":"2023-12-01T01:02:58.638414+0000","last_fullsized":"2023-12-01T01:02:58.638414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:49:54.924619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635351+0000","last_change":"2023-12-01T01:02:46.832265+0000","last_active":"2023-12-01T01:02:58.635351+0000","last_peered":"2023-12-01T01:02:58.635351+0000","last_clean":"2023-12-01T01:02:58.635351+0000","last_became_active":"2023-12-01T01:02:46.831944+0000","last_became_peered":"2023-12-01T01:02:46.831944+0000","last_unstale":"2023-12-01T01:02:58.635351+0000","last_undegraded":"2023-12-01T01:02:58.635351+0000","last_fullsized":"2023-12-01T01:02:58.635351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:54:54.814744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629794+0000","last_change":"2023-12-01T01:02:47.276967+0000","last_active":"2023-12-01T01:02:58.629794+0000","last_peered":"2023-12-01T01:02:58.629794+0000","last_clean":"2023-12-01T01:02:58.629794+0000","last_became_active":"2023-12-01T01:02:47.276660+0000","last_became_peered":"2023-12-01T01:02:47.276660+0000","last_unstale":"2023-12-01T01:02:58.629794+0000","last_undegraded":"2023-12-01T01:02:58.629794+0000","last_fullsized":"2023-12-01T01:02:58.629794+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:19:16.029376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634786+0000","last_change":"2023-12-01T01:02:46.834425+0000","last_active":"2023-12-01T01:02:58.634786+0000","last_peered":"2023-12-01T01:02:58.634786+0000","last_clean":"2023-12-01T01:02:58.634786+0000","last_became_active":"2023-12-01T01:02:46.834150+0000","last_became_peered":"2023-12-01T01:02:46.834150+0000","last_unstale":"2023-12-01T01:02:58.634786+0000","last_undegraded":"2023-12-01T01:02:58.634786+0000","last_fullsized":"2023-12-01T01:02:58.634786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:52:39.619014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.632088+0000","last_change":"2023-12-01T01:02:47.276386+0000","last_active":"2023-12-01T01:02:58.632088+0000","last_peered":"2023-12-01T01:02:58.632088+0000","last_clean":"2023-12-01T01:02:58.632088+0000","last_became_active":"2023-12-01T01:02:47.276092+0000","last_became_peered":"2023-12-01T01:02:47.276092+0000","last_unstale":"2023-12-01T01:02:58.632088+0000","last_undegraded":"2023-12-01T01:02:58.632088+0000","last_fullsized":"2023-12-01T01:02:58.632088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:33:39.707619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638513+0000","last_change":"2023-12-01T01:02:46.832778+0000","last_active":"2023-12-01T01:02:58.638513+0000","last_peered":"2023-12-01T01:02:58.638513+0000","last_clean":"2023-12-01T01:02:58.638513+0000","last_became_active":"2023-12-01T01:02:46.832406+0000","last_became_peered":"2023-12-01T01:02:46.832406+0000","last_unstale":"2023-12-01T01:02:58.638513+0000","last_undegraded":"2023-12-01T01:02:58.638513+0000","last_fullsized":"2023-12-01T01:02:58.638513+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:06:08.569651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.639129+0000","last_change":"2023-12-01T01:02:59.639129+0000","last_active":"2023-12-01T01:02:59.639129+0000","last_peered":"2023-12-01T01:02:59.639129+0000","last_clean":"2023-12-01T01:02:59.639129+0000","last_became_active":"2023-12-01T01:02:59.638745+0000","last_became_peered":"2023-12-01T01:02:59.638745+0000","last_unstale":"2023-12-01T01:02:59.639129+0000","last_undegraded":"2023-12-01T01:02:59.639129+0000","last_fullsized":"2023-12-01T01:02:59.639129+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:26:26.032297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637786+0000","last_change":"2023-12-01T01:02:47.269953+0000","last_active":"2023-12-01T01:02:58.637786+0000","last_peered":"2023-12-01T01:02:58.637786+0000","last_clean":"2023-12-01T01:02:58.637786+0000","last_became_active":"2023-12-01T01:02:47.265723+0000","last_became_peered":"2023-12-01T01:02:47.265723+0000","last_unstale":"2023-12-01T01:02:58.637786+0000","last_undegraded":"2023-12-01T01:02:58.637786+0000","last_fullsized":"2023-12-01T01:02:58.637786+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:28:44.370883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'4","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:29.392863+0000","last_change":"2023-12-01T01:02:46.827001+0000","last_active":"2023-12-01T01:03:29.392863+0000","last_peered":"2023-12-01T01:03:29.392863+0000","last_clean":"2023-12-01T01:03:29.392863+0000","last_became_active":"2023-12-01T01:02:46.826690+0000","last_became_peered":"2023-12-01T01:02:46.826690+0000","last_unstale":"2023-12-01T01:03:29.392863+0000","last_undegraded":"2023-12-01T01:03:29.392863+0000","last_fullsized":"2023-12-01T01:03:29.392863+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:37:38.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637983+0000","last_change":"2023-12-01T01:02:47.283372+0000","last_active":"2023-12-01T01:02:58.637983+0000","last_peered":"2023-12-01T01:02:58.637983+0000","last_clean":"2023-12-01T01:02:58.637983+0000","last_became_active":"2023-12-01T01:02:47.283075+0000","last_became_peered":"2023-12-01T01:02:47.283075+0000","last_unstale":"2023-12-01T01:02:58.637983+0000","last_undegraded":"2023-12-01T01:02:58.637983+0000","last_fullsized":"2023-12-01T01:02:58.637983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:37:07.707284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.631280+0000","last_change":"2023-12-01T01:02:46.828490+0000","last_active":"2023-12-01T01:02:58.631280+0000","last_peered":"2023-12-01T01:02:58.631280+0000","last_clean":"2023-12-01T01:02:58.631280+0000","last_became_active":"2023-12-01T01:02:46.828129+0000","last_became_peered":"2023-12-01T01:02:46.828129+0000","last_unstale":"2023-12-01T01:02:58.631280+0000","last_undegraded":"2023-12-01T01:02:58.631280+0000","last_fullsized":"2023-12-01T01:02:58.631280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:52:17.060443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":322,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638309+0000","last_change":"2023-12-01T01:01:49.966660+0000","last_active":"2023-12-01T01:02:58.638309+0000","last_peered":"2023-12-01T01:02:58.638309+0000","last_clean":"2023-12-01T01:02:58.638309+0000","last_became_active":"2023-12-01T01:01:49.966125+0000","last_became_peered":"2023-12-01T01:01:49.966125+0000","last_unstale":"2023-12-01T01:02:58.638309+0000","last_undegraded":"2023-12-01T01:02:58.638309+0000","last_fullsized":"2023-12-01T01:02:58.638309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T00:59:06.461487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T00:59:06.461487+0000","last_clean_scrub_stamp":"2023-12-01T00:59:06.461487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:34:52.236994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629067+0000","last_change":"2023-12-01T01:02:47.282702+0000","last_active":"2023-12-01T01:02:58.629067+0000","last_peered":"2023-12-01T01:02:58.629067+0000","last_clean":"2023-12-01T01:02:58.629067+0000","last_became_active":"2023-12-01T01:02:47.282368+0000","last_became_peered":"2023-12-01T01:02:47.282368+0000","last_unstale":"2023-12-01T01:02:58.629067+0000","last_undegraded":"2023-12-01T01:02:58.629067+0000","last_fullsized":"2023-12-01T01:02:58.629067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:24:40.985055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638420+0000","last_change":"2023-12-01T01:02:46.827882+0000","last_active":"2023-12-01T01:02:58.638420+0000","last_peered":"2023-12-01T01:02:58.638420+0000","last_clean":"2023-12-01T01:02:58.638420+0000","last_became_active":"2023-12-01T01:02:46.827354+0000","last_became_peered":"2023-12-01T01:02:46.827354+0000","last_unstale":"2023-12-01T01:02:58.638420+0000","last_undegraded":"2023-12-01T01:02:58.638420+0000","last_fullsized":"2023-12-01T01:02:58.638420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:48:42.894733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635396+0000","last_change":"2023-12-01T01:02:46.833439+0000","last_active":"2023-12-01T01:02:58.635396+0000","last_peered":"2023-12-01T01:02:58.635396+0000","last_clean":"2023-12-01T01:02:58.635396+0000","last_became_active":"2023-12-01T01:02:46.833199+0000","last_became_peered":"2023-12-01T01:02:46.833199+0000","last_unstale":"2023-12-01T01:02:58.635396+0000","last_undegraded":"2023-12-01T01:02:58.635396+0000","last_fullsized":"2023-12-01T01:02:58.635396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:44:49.559138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629432+0000","last_change":"2023-12-01T01:02:47.283580+0000","last_active":"2023-12-01T01:02:58.629432+0000","last_peered":"2023-12-01T01:02:58.629432+0000","last_clean":"2023-12-01T01:02:58.629432+0000","last_became_active":"2023-12-01T01:02:47.283095+0000","last_became_peered":"2023-12-01T01:02:47.283095+0000","last_unstale":"2023-12-01T01:02:58.629432+0000","last_undegraded":"2023-12-01T01:02:58.629432+0000","last_fullsized":"2023-12-01T01:02:58.629432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:33:12.541487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.634655+0000","last_change":"2023-12-01T01:02:46.831348+0000","last_active":"2023-12-01T01:02:59.634655+0000","last_peered":"2023-12-01T01:02:59.634655+0000","last_clean":"2023-12-01T01:02:59.634655+0000","last_became_active":"2023-12-01T01:02:46.831031+0000","last_became_peered":"2023-12-01T01:02:46.831031+0000","last_unstale":"2023-12-01T01:02:59.634655+0000","last_undegraded":"2023-12-01T01:02:59.634655+0000","last_fullsized":"2023-12-01T01:02:59.634655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:15:53.172465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638241+0000","last_change":"2023-12-01T01:02:47.276281+0000","last_active":"2023-12-01T01:02:58.638241+0000","last_peered":"2023-12-01T01:02:58.638241+0000","last_clean":"2023-12-01T01:02:58.638241+0000","last_became_active":"2023-12-01T01:02:47.275573+0000","last_became_peered":"2023-12-01T01:02:47.275573+0000","last_unstale":"2023-12-01T01:02:58.638241+0000","last_undegraded":"2023-12-01T01:02:58.638241+0000","last_fullsized":"2023-12-01T01:02:58.638241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:50:07.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.631688+0000","last_change":"2023-12-01T01:02:46.823053+0000","last_active":"2023-12-01T01:02:58.631688+0000","last_peered":"2023-12-01T01:02:58.631688+0000","last_clean":"2023-12-01T01:02:58.631688+0000","last_became_active":"2023-12-01T01:02:46.822772+0000","last_became_peered":"2023-12-01T01:02:46.822772+0000","last_unstale":"2023-12-01T01:02:58.631688+0000","last_undegraded":"2023-12-01T01:02:58.631688+0000","last_fullsized":"2023-12-01T01:02:58.631688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:43:22.496286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.633833+0000","last_change":"2023-12-01T01:02:47.289484+0000","last_active":"2023-12-01T01:02:58.633833+0000","last_peered":"2023-12-01T01:02:58.633833+0000","last_clean":"2023-12-01T01:02:58.633833+0000","last_became_active":"2023-12-01T01:02:47.289176+0000","last_became_peered":"2023-12-01T01:02:47.289176+0000","last_unstale":"2023-12-01T01:02:58.633833+0000","last_undegraded":"2023-12-01T01:02:58.633833+0000","last_fullsized":"2023-12-01T01:02:58.633833+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:21:52.905017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634804+0000","last_change":"2023-12-01T01:02:46.830635+0000","last_active":"2023-12-01T01:02:58.634804+0000","last_peered":"2023-12-01T01:02:58.634804+0000","last_clean":"2023-12-01T01:02:58.634804+0000","last_became_active":"2023-12-01T01:02:46.830337+0000","last_became_peered":"2023-12-01T01:02:46.830337+0000","last_unstale":"2023-12-01T01:02:58.634804+0000","last_undegraded":"2023-12-01T01:02:58.634804+0000","last_fullsized":"2023-12-01T01:02:58.634804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:02:10.017744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634870+0000","last_change":"2023-12-01T01:02:47.281923+0000","last_active":"2023-12-01T01:02:58.634870+0000","last_peered":"2023-12-01T01:02:58.634870+0000","last_clean":"2023-12-01T01:02:58.634870+0000","last_became_active":"2023-12-01T01:02:47.281598+0000","last_became_peered":"2023-12-01T01:02:47.281598+0000","last_unstale":"2023-12-01T01:02:58.634870+0000","last_undegraded":"2023-12-01T01:02:58.634870+0000","last_fullsized":"2023-12-01T01:02:58.634870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:07:54.327023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637701+0000","last_change":"2023-12-01T01:02:46.830248+0000","last_active":"2023-12-01T01:02:58.637701+0000","last_peered":"2023-12-01T01:02:58.637701+0000","last_clean":"2023-12-01T01:02:58.637701+0000","last_became_active":"2023-12-01T01:02:46.829951+0000","last_became_peered":"2023-12-01T01:02:46.829951+0000","last_unstale":"2023-12-01T01:02:58.637701+0000","last_undegraded":"2023-12-01T01:02:58.637701+0000","last_fullsized":"2023-12-01T01:02:58.637701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:04:23.978035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629468+0000","last_change":"2023-12-01T01:02:47.280871+0000","last_active":"2023-12-01T01:02:58.629468+0000","last_peered":"2023-12-01T01:02:58.629468+0000","last_clean":"2023-12-01T01:02:58.629468+0000","last_became_active":"2023-12-01T01:02:47.280527+0000","last_became_peered":"2023-12-01T01:02:47.280527+0000","last_unstale":"2023-12-01T01:02:58.629468+0000","last_undegraded":"2023-12-01T01:02:58.629468+0000","last_fullsized":"2023-12-01T01:02:58.629468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:16:47.700500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.644414+0000","last_change":"2023-12-01T01:02:59.643980+0000","last_active":"2023-12-01T01:02:59.644414+0000","last_peered":"2023-12-01T01:02:59.644414+0000","last_clean":"2023-12-01T01:02:59.644414+0000","last_became_active":"2023-12-01T01:02:59.641039+0000","last_became_peered":"2023-12-01T01:02:59.641039+0000","last_unstale":"2023-12-01T01:02:59.644414+0000","last_undegraded":"2023-12-01T01:02:59.644414+0000","last_fullsized":"2023-12-01T01:02:59.644414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:06:23.044556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638187+0000","last_change":"2023-12-01T01:02:47.284981+0000","last_active":"2023-12-01T01:02:58.638187+0000","last_peered":"2023-12-01T01:02:58.638187+0000","last_clean":"2023-12-01T01:02:58.638187+0000","last_became_active":"2023-12-01T01:02:47.284576+0000","last_became_peered":"2023-12-01T01:02:47.284576+0000","last_unstale":"2023-12-01T01:02:58.638187+0000","last_undegraded":"2023-12-01T01:02:58.638187+0000","last_fullsized":"2023-12-01T01:02:58.638187+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:58:21.152156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634597+0000","last_change":"2023-12-01T01:02:46.828769+0000","last_active":"2023-12-01T01:02:58.634597+0000","last_peered":"2023-12-01T01:02:58.634597+0000","last_clean":"2023-12-01T01:02:58.634597+0000","last_became_active":"2023-12-01T01:02:46.828498+0000","last_became_peered":"2023-12-01T01:02:46.828498+0000","last_unstale":"2023-12-01T01:02:58.634597+0000","last_undegraded":"2023-12-01T01:02:58.634597+0000","last_fullsized":"2023-12-01T01:02:58.634597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:12:26.618082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638509+0000","last_change":"2023-12-01T01:02:47.283179+0000","last_active":"2023-12-01T01:02:58.638509+0000","last_peered":"2023-12-01T01:02:58.638509+0000","last_clean":"2023-12-01T01:02:58.638509+0000","last_became_active":"2023-12-01T01:02:47.282883+0000","last_became_peered":"2023-12-01T01:02:47.282883+0000","last_unstale":"2023-12-01T01:02:58.638509+0000","last_undegraded":"2023-12-01T01:02:58.638509+0000","last_fullsized":"2023-12-01T01:02:58.638509+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:19:47.406888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635111+0000","last_change":"2023-12-01T01:02:46.833482+0000","last_active":"2023-12-01T01:02:58.635111+0000","last_peered":"2023-12-01T01:02:58.635111+0000","last_clean":"2023-12-01T01:02:58.635111+0000","last_became_active":"2023-12-01T01:02:46.833200+0000","last_became_peered":"2023-12-01T01:02:46.833200+0000","last_unstale":"2023-12-01T01:02:58.635111+0000","last_undegraded":"2023-12-01T01:02:58.635111+0000","last_fullsized":"2023-12-01T01:02:58.635111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:52:41.480509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638880+0000","last_change":"2023-12-01T01:02:47.275802+0000","last_active":"2023-12-01T01:02:58.638880+0000","last_peered":"2023-12-01T01:02:58.638880+0000","last_clean":"2023-12-01T01:02:58.638880+0000","last_became_active":"2023-12-01T01:02:47.274837+0000","last_became_peered":"2023-12-01T01:02:47.274837+0000","last_unstale":"2023-12-01T01:02:58.638880+0000","last_undegraded":"2023-12-01T01:02:58.638880+0000","last_fullsized":"2023-12-01T01:02:58.638880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:43:30.799999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638603+0000","last_change":"2023-12-01T01:02:46.829445+0000","last_active":"2023-12-01T01:02:58.638603+0000","last_peered":"2023-12-01T01:02:58.638603+0000","last_clean":"2023-12-01T01:02:58.638603+0000","last_became_active":"2023-12-01T01:02:46.829120+0000","last_became_peered":"2023-12-01T01:02:46.829120+0000","last_unstale":"2023-12-01T01:02:58.638603+0000","last_undegraded":"2023-12-01T01:02:58.638603+0000","last_fullsized":"2023-12-01T01:02:58.638603+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:57:44.467570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638654+0000","last_change":"2023-12-01T01:02:47.282683+0000","last_active":"2023-12-01T01:02:58.638654+0000","last_peered":"2023-12-01T01:02:58.638654+0000","last_clean":"2023-12-01T01:02:58.638654+0000","last_became_active":"2023-12-01T01:02:47.282346+0000","last_became_peered":"2023-12-01T01:02:47.282346+0000","last_unstale":"2023-12-01T01:02:58.638654+0000","last_undegraded":"2023-12-01T01:02:58.638654+0000","last_fullsized":"2023-12-01T01:02:58.638654+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:20:25.085982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629529+0000","last_change":"2023-12-01T01:02:46.828060+0000","last_active":"2023-12-01T01:02:58.629529+0000","last_peered":"2023-12-01T01:02:58.629529+0000","last_clean":"2023-12-01T01:02:58.629529+0000","last_became_active":"2023-12-01T01:02:46.827754+0000","last_became_peered":"2023-12-01T01:02:46.827754+0000","last_unstale":"2023-12-01T01:02:58.629529+0000","last_undegraded":"2023-12-01T01:02:58.629529+0000","last_fullsized":"2023-12-01T01:02:58.629529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:22.794619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638803+0000","last_change":"2023-12-01T01:02:47.269538+0000","last_active":"2023-12-01T01:02:58.638803+0000","last_peered":"2023-12-01T01:02:58.638803+0000","last_clean":"2023-12-01T01:02:58.638803+0000","last_became_active":"2023-12-01T01:02:47.269245+0000","last_became_peered":"2023-12-01T01:02:47.269245+0000","last_unstale":"2023-12-01T01:02:58.638803+0000","last_undegraded":"2023-12-01T01:02:58.638803+0000","last_fullsized":"2023-12-01T01:02:58.638803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:49.163896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629550+0000","last_change":"2023-12-01T01:02:47.277545+0000","last_active":"2023-12-01T01:02:58.629550+0000","last_peered":"2023-12-01T01:02:58.629550+0000","last_clean":"2023-12-01T01:02:58.629550+0000","last_became_active":"2023-12-01T01:02:47.277307+0000","last_became_peered":"2023-12-01T01:02:47.277307+0000","last_unstale":"2023-12-01T01:02:58.629550+0000","last_undegraded":"2023-12-01T01:02:58.629550+0000","last_fullsized":"2023-12-01T01:02:58.629550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:08.655231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:00.001120+0000","last_change":"2023-12-01T01:03:00.001120+0000","last_active":"2023-12-01T01:03:00.001120+0000","last_peered":"2023-12-01T01:03:00.001120+0000","last_clean":"2023-12-01T01:03:00.001120+0000","last_became_active":"2023-12-01T01:03:00.000707+0000","last_became_peered":"2023-12-01T01:03:00.000707+0000","last_unstale":"2023-12-01T01:03:00.001120+0000","last_undegraded":"2023-12-01T01:03:00.001120+0000","last_fullsized":"2023-12-01T01:03:00.001120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:12:25.500981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634166+0000","last_change":"2023-12-01T01:02:47.274775+0000","last_active":"2023-12-01T01:02:58.634166+0000","last_peered":"2023-12-01T01:02:58.634166+0000","last_clean":"2023-12-01T01:02:58.634166+0000","last_became_active":"2023-12-01T01:02:47.274459+0000","last_became_peered":"2023-12-01T01:02:47.274459+0000","last_unstale":"2023-12-01T01:02:58.634166+0000","last_undegraded":"2023-12-01T01:02:58.634166+0000","last_fullsized":"2023-12-01T01:02:58.634166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:06:01.273551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634245+0000","last_change":"2023-12-01T01:02:47.277487+0000","last_active":"2023-12-01T01:02:58.634245+0000","last_peered":"2023-12-01T01:02:58.634245+0000","last_clean":"2023-12-01T01:02:58.634245+0000","last_became_active":"2023-12-01T01:02:47.277092+0000","last_became_peered":"2023-12-01T01:02:47.277092+0000","last_unstale":"2023-12-01T01:02:58.634245+0000","last_undegraded":"2023-12-01T01:02:58.634245+0000","last_fullsized":"2023-12-01T01:02:58.634245+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:02:51.967302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629367+0000","last_change":"2023-12-01T01:02:47.283814+0000","last_active":"2023-12-01T01:02:58.629367+0000","last_peered":"2023-12-01T01:02:58.629367+0000","last_clean":"2023-12-01T01:02:58.629367+0000","last_became_active":"2023-12-01T01:02:47.283289+0000","last_became_peered":"2023-12-01T01:02:47.283289+0000","last_unstale":"2023-12-01T01:02:58.629367+0000","last_undegraded":"2023-12-01T01:02:58.629367+0000","last_fullsized":"2023-12-01T01:02:58.629367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:42:59.523846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629683+0000","last_change":"2023-12-01T01:02:47.281748+0000","last_active":"2023-12-01T01:02:58.629683+0000","last_peered":"2023-12-01T01:02:58.629683+0000","last_clean":"2023-12-01T01:02:58.629683+0000","last_became_active":"2023-12-01T01:02:47.281445+0000","last_became_peered":"2023-12-01T01:02:47.281445+0000","last_unstale":"2023-12-01T01:02:58.629683+0000","last_undegraded":"2023-12-01T01:02:58.629683+0000","last_fullsized":"2023-12-01T01:02:58.629683+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:33:18.146911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635655+0000","last_change":"2023-12-01T01:02:47.276827+0000","last_active":"2023-12-01T01:02:58.635655+0000","last_peered":"2023-12-01T01:02:58.635655+0000","last_clean":"2023-12-01T01:02:58.635655+0000","last_became_active":"2023-12-01T01:02:47.276346+0000","last_became_peered":"2023-12-01T01:02:47.276346+0000","last_unstale":"2023-12-01T01:02:58.635655+0000","last_undegraded":"2023-12-01T01:02:58.635655+0000","last_fullsized":"2023-12-01T01:02:58.635655+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:49:23.203883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638155+0000","last_change":"2023-12-01T01:02:47.276461+0000","last_active":"2023-12-01T01:02:58.638155+0000","last_peered":"2023-12-01T01:02:58.638155+0000","last_clean":"2023-12-01T01:02:58.638155+0000","last_became_active":"2023-12-01T01:02:47.275992+0000","last_became_peered":"2023-12-01T01:02:47.275992+0000","last_unstale":"2023-12-01T01:02:58.638155+0000","last_undegraded":"2023-12-01T01:02:58.638155+0000","last_fullsized":"2023-12-01T01:02:58.638155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:14:04.629355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637658+0000","last_change":"2023-12-01T01:02:47.274018+0000","last_active":"2023-12-01T01:02:58.637658+0000","last_peered":"2023-12-01T01:02:58.637658+0000","last_clean":"2023-12-01T01:02:58.637658+0000","last_became_active":"2023-12-01T01:02:47.273714+0000","last_became_peered":"2023-12-01T01:02:47.273714+0000","last_unstale":"2023-12-01T01:02:58.637658+0000","last_undegraded":"2023-12-01T01:02:58.637658+0000","last_fullsized":"2023-12-01T01:02:58.637658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:26:14.154249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637587+0000","last_change":"2023-12-01T01:02:47.276438+0000","last_active":"2023-12-01T01:02:58.637587+0000","last_peered":"2023-12-01T01:02:58.637587+0000","last_clean":"2023-12-01T01:02:58.637587+0000","last_became_active":"2023-12-01T01:02:47.276121+0000","last_became_peered":"2023-12-01T01:02:47.276121+0000","last_unstale":"2023-12-01T01:02:58.637587+0000","last_undegraded":"2023-12-01T01:02:58.637587+0000","last_fullsized":"2023-12-01T01:02:58.637587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:09:25.689189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635042+0000","last_change":"2023-12-01T01:02:47.275763+0000","last_active":"2023-12-01T01:02:58.635042+0000","last_peered":"2023-12-01T01:02:58.635042+0000","last_clean":"2023-12-01T01:02:58.635042+0000","last_became_active":"2023-12-01T01:02:47.275484+0000","last_became_peered":"2023-12-01T01:02:47.275484+0000","last_unstale":"2023-12-01T01:02:58.635042+0000","last_undegraded":"2023-12-01T01:02:58.635042+0000","last_fullsized":"2023-12-01T01:02:58.635042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:38:02.612857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629342+0000","last_change":"2023-12-01T01:02:47.274122+0000","last_active":"2023-12-01T01:02:58.629342+0000","last_peered":"2023-12-01T01:02:58.629342+0000","last_clean":"2023-12-01T01:02:58.629342+0000","last_became_active":"2023-12-01T01:02:47.273005+0000","last_became_peered":"2023-12-01T01:02:47.273005+0000","last_unstale":"2023-12-01T01:02:58.629342+0000","last_undegraded":"2023-12-01T01:02:58.629342+0000","last_fullsized":"2023-12-01T01:02:58.629342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:42:59.273076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629680+0000","last_change":"2023-12-01T01:02:47.270221+0000","last_active":"2023-12-01T01:02:58.629680+0000","last_peered":"2023-12-01T01:02:58.629680+0000","last_clean":"2023-12-01T01:02:58.629680+0000","last_became_active":"2023-12-01T01:02:47.269946+0000","last_became_peered":"2023-12-01T01:02:47.269946+0000","last_unstale":"2023-12-01T01:02:58.629680+0000","last_undegraded":"2023-12-01T01:02:58.629680+0000","last_fullsized":"2023-12-01T01:02:58.629680+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:00:01.640510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283824,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62830,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":254,"num_read_kb":190,"num_write":150,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":40837,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":188490,"data_compressed":6441,"data_compressed_allocated":8192,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514517,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":897024,"data_stored":433440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.58799999999999997}]},{"osd":1,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.78300000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":9,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.89900000000000002}]},{"osd":10,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.84999999999999998}]}]},{"osd":10,"up_from":69,"seq":296352743449,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":1048576,"data_stored":1083802,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":1,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.436},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.502}]},{"osd":5,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.747}]},{"osd":9,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.78900000000000003}]},{"osd":11,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.77500000000000002}]}]},{"osd":9,"up_from":64,"seq":274877906972,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":913408,"data_stored":433676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.45200000000000001,"15min":0.46300000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58499999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.46800000000000003,"15min":0.47699999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64600000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.379}]},{"osd":1,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73799999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.65000000000000002,"15min":0.63100000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":4.5899999999999999,"5min":4.5899999999999999,"15min":4.5899999999999999},"last":0.46800000000000003}]},{"osd":2,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63,"15min":0.63900000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91900000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.59199999999999997,"15min":0.60799999999999998},"min":{"1min":0.317,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.748,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53500000000000003,"15min":0.54300000000000004},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.40699999999999997}]},{"osd":4,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83999999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.90600000000000003,"15min":0.94999999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89200000000000002,"5min":4.2309999999999999,"15min":4.2309999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":4.6200000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.64000000000000001,"15min":0.65300000000000002},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81699999999999995,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.70299999999999996,"15min":0.71899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95699999999999996,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.6040000000000001,"5min":4.6040000000000001,"15min":4.6040000000000001},"last":0.628},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98999999999999999,"5min":1.111,"15min":1.111},"last":0.61499999999999999}]},{"osd":8,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76300000000000001,"15min":0.77200000000000002},"min":{"1min":0.54600000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":1.071,"15min":1.1259999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.004,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.68899999999999995}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":4.6369999999999996,"5min":4.6369999999999996,"15min":4.6369999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.66800000000000004}]}]},{"osd":8,"up_from":57,"seq":244813135904,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":913408,"data_stored":433596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.621,"15min":0.63800000000000001},"min":{"1min":0.34399999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79400000000000004,"5min":2.25,"15min":2.25},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":0.60199999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.871,"5min":2.234,"15min":2.234},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55400000000000005,"15min":0.54700000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47699999999999998}]},{"osd":2,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.27700000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72199999999999998,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.375},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53600000000000003,"15min":0.54600000000000004},"min":{"1min":0.29299999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.67900000000000005,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78100000000000003,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.56999999999999995}]},{"osd":4,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77200000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.437,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84099999999999997,"5min":2.222,"15min":2.222},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.67400000000000004,"15min":0.68500000000000005},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.92300000000000004,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.42899999999999999}]},{"osd":6,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.78000000000000003,"15min":0.79100000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.7230000000000001,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.48399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.625,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.78200000000000003,"15min":0.79300000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90700000000000003,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.51500000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.032,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.71599999999999997}]},{"osd":9,"last update":"Fri Dec 1 01:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.5910000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.748}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.78600000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]}]},{"osd":7,"up_from":50,"seq":214748364836,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":1025831,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.39600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.251},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.42299999999999999,"15min":0.41799999999999998},"min":{"1min":0.27000000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.41399999999999998}]},{"osd":2,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.435,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.46700000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61199999999999999,"15min":0.60599999999999998},"min":{"1min":0.48699999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.495},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.48699999999999999,"15min":0.48299999999999998},"min":{"1min":0.311,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.501,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.61799999999999999}]},{"osd":6,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51000000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.68400000000000005}]},{"osd":8,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.54300000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71499999999999997,"15min":0.71199999999999997},"min":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88700000000000001,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.76900000000000002}]},{"osd":9,"last update":"Fri Dec 1 01:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.67000000000000004}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.70299999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]}]},{"osd":6,"up_from":45,"seq":193273528360,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":901120,"data_stored":433071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.66000000000000003,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.437,"15min":0.43099999999999999},"min":{"1min":0.27500000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.40999999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.435,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.55900000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.72199999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.504},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.63,"15min":0.624},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.54500000000000004}]},{"osd":3,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.375,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.85199999999999998,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60199999999999998,"15min":0.59899999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.68000000000000005,"15min":0.66800000000000004},"min":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.58999999999999997}]},{"osd":5,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.65100000000000002,"15min":0.65200000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.65200000000000002,"15min":0.65800000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.83199999999999996,"5min":1.319,"15min":1.319},"last":0.53400000000000003}]},{"osd":7,"last update":"Fri Dec 1 01:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64500000000000002,"15min":0.64000000000000001},"min":{"1min":0.53500000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.52900000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.61399999999999999}]},{"osd":8,"last update":"Fri Dec 1 01:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.52000000000000002,"5min":0.502,"15min":0.502},"max":{"1min":0.95299999999999996,"5min":1.276,"15min":1.276},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.51400000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84699999999999998,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64500000000000002}]},{"osd":9,"last update":"Fri Dec 1 01:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.44900000000000001}]},{"osd":10,"last update":"Fri Dec 1 01:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.63}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":491388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.503,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.75600000000000001,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.34999999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.435}]},{"osd":2,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.54200000000000004,"15min":0.499},"min":{"1min":0.52600000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.55000000000000004,"15min":0.505},"min":{"1min":0.46700000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.90100000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.77900000000000003}]},{"osd":3,"last update":"Fri Dec 1 01:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55800000000000005,"15min":0.54200000000000004},"min":{"1min":0.36499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.41199999999999998}]},{"osd":4,"last update":"Fri Dec 1 01:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.38800000000000001,"15min":0.36599999999999999},"min":{"1min":0.27700000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.41599999999999998,"15min":0.38700000000000001},"min":{"1min":0.29799999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.495}]},{"osd":5,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.58599999999999997,"15min":0.55600000000000005},"min":{"1min":0.51600000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.60099999999999998,"15min":0.56599999999999995},"min":{"1min":0.53600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Dec 1 01:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.42999999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56100000000000005,"15min":0.55900000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.53400000000000003,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.61399999999999999}]},{"osd":8,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.56000000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.81899999999999995}]},{"osd":9,"last update":"Fri Dec 1 01:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.76900000000000002}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.85999999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":921600,"data_stored":434336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 01:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.53600000000000003,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53100000000000003,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.88700000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.35099999999999998}]},{"osd":2,"last update":"Fri Dec 1 01:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.37,"15min":0.37},"max":{"1min":0.86499999999999999,"5min":0.875,"15min":0.875},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Dec 1 01:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40799999999999997},"min":{"1min":0.251,"5min":0.249,"15min":0.249},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.46200000000000002,"15min":0.45600000000000002},"min":{"1min":0.32600000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.25600000000000001}]},{"osd":4,"last update":"Fri Dec 1 01:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55300000000000005,"15min":0.52600000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.56100000000000005,"15min":0.53200000000000003},"min":{"1min":0.44700000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.46200000000000002}]},{"osd":5,"last update":"Fri Dec 1 01:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.45000000000000001}]},{"osd":6,"last update":"Fri Dec 1 01:02:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.53400000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80700000000000005,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.60399999999999998,"15min":0.59599999999999997},"min":{"1min":0.38800000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.91700000000000004,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.31}]},{"osd":7,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.628}]},{"osd":8,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.441},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.55800000000000005}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.67500000000000004,"15min":0.69699999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.93100000000000005,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.71199999999999997,"15min":0.73399999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94799999999999995,"5min":1.024,"15min":1.024},"last":0.33000000000000002}]},{"osd":10,"last update":"Fri Dec 1 01:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.42999999999999999}]},{"osd":11,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.56799999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411385,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":917504,"data_stored":434553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.5,"15min":0.48399999999999999},"min":{"1min":0.35999999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.874,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.309,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.47399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.54600000000000004,"15min":0.52400000000000002},"min":{"1min":0.39800000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.55700000000000005}]},{"osd":3,"last update":"Fri Dec 1 01:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.53700000000000003,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89600000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54000000000000004}]},{"osd":4,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.42599999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.60199999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.754},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51200000000000001}]},{"osd":5,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.44600000000000001,"15min":0.41199999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.42599999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.877,"15min":0.877},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.48799999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.59199999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.58099999999999996,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.54500000000000004,"15min":0.53300000000000003},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.71499999999999997}]},{"osd":9,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.746},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.64000000000000001}]},{"osd":10,"last update":"Fri Dec 1 01:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.67400000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":3,"up_from":25,"seq":107374182452,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":917504,"data_stored":433388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.376,"15min":0.35199999999999998},"min":{"1min":0.312,"5min":0.245,"15min":0.245},"max":{"1min":0.61099999999999999,"5min":0.623,"15min":0.623},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.39300000000000002,"15min":0.373},"min":{"1min":0.315,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.623,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.376}]},{"osd":1,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.53900000000000003,"15min":0.505},"min":{"1min":0.435,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.84899999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.56499999999999995,"15min":0.52100000000000002},"min":{"1min":0.497,"5min":0.371,"15min":0.371},"max":{"1min":0.85199999999999998,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.46999999999999997}]},{"osd":2,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46200000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59899999999999998,"15min":0.59299999999999997},"min":{"1min":0.441,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Dec 1 01:02:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.60999999999999999,"15min":0.58099999999999996},"min":{"1min":0.504,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.60099999999999998,"15min":0.57699999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.77600000000000002}]},{"osd":5,"last update":"Fri Dec 1 01:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.623,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.495},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.621,"15min":0.59699999999999998},"min":{"1min":0.45700000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.61299999999999999}]},{"osd":6,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52300000000000002,"15min":0.51700000000000002},"min":{"1min":0.35499999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77100000000000002,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.57699999999999996,"15min":0.56000000000000005},"min":{"1min":0.41399999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.41499999999999998}]},{"osd":7,"last update":"Fri Dec 1 01:02:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.74299999999999999,"15min":0.73599999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.73099999999999998,"15min":0.71899999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.69099999999999995}]},{"osd":8,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.65200000000000002}]},{"osd":9,"last update":"Fri Dec 1 01:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.76600000000000001}]},{"osd":10,"last update":"Fri Dec 1 01:02:48 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.63},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.73499999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953520,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":946176,"data_stored":492377,"data_compressed":6441,"data_compressed_allocated":8192,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51600000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.85099999999999998,"5min":0.88,"15min":0.88},"last":0.371},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.42999999999999999}]},{"osd":1,"last update":"Fri Dec 1 01:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.376,"15min":0.36499999999999999},"min":{"1min":0.28399999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.40200000000000002,"15min":0.38300000000000001},"min":{"1min":0.30199999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64800000000000002,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.32700000000000001}]},{"osd":2,"last update":"Fri Dec 1 01:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.433,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.498},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72699999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.56299999999999994}]},{"osd":3,"last update":"Fri Dec 1 01:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.56299999999999994,"15min":0.54600000000000004},"min":{"1min":0.45500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82999999999999996,"5min":1.004,"15min":1.004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85899999999999999,"5min":0.879,"15min":0.879},"last":0.42199999999999999}]},{"osd":5,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38800000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.626},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42299999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77200000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.51600000000000001}]},{"osd":6,"last update":"Fri Dec 1 01:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93300000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.82499999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.46100000000000002}]},{"osd":7,"last update":"Fri Dec 1 01:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.55000000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.377},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.58399999999999996,"15min":0.56999999999999995},"min":{"1min":0.46600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.57999999999999996}]},{"osd":8,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.501,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.51400000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.60699999999999998}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.76300000000000001},"min":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96999999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.59999999999999998}]},{"osd":10,"last update":"Fri Dec 1 01:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.69599999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":5,"up_from":37,"seq":158913789997,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":974848,"data_stored":1025170,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.78600000000000003,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.495,"15min":0.48899999999999999},"min":{"1min":0.28999999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.82099999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.42499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74399999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38500000000000001,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.53700000000000003,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.378},{"interface":"front","average":{"1min":0.432,"5min":0.42299999999999999,"15min":0.42499999999999999},"min":{"1min":0.30399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.57199999999999995,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.443}]},{"osd":3,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.54000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76100000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Dec 1 01:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.621,"15min":0.624},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66800000000000004,"15min":0.67000000000000004},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91100000000000003,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.54400000000000004}]},{"osd":7,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88100000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.47899999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.64900000000000002}]},{"osd":8,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.35999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83199999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.374,"5min":0.37,"15min":0.37},"max":{"1min":0.71699999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.61799999999999999}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.72199999999999998,"15min":0.68200000000000005},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.673,"5min":5.673,"15min":5.673},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.01,"5min":0.77800000000000002,"15min":0.73999999999999999},"min":{"1min":0.48999999999999999,"5min":0.439,"15min":0.439},"max":{"1min":5.6390000000000002,"5min":5.6390000000000002,"15min":5.6390000000000002},"last":0.53000000000000003}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":58530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":59519,"data_compressed":6441,"data_compressed_allocated":8192,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T01:03:34.763 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph pg dump --format=json 2023-12-01T01:03:35.331 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:35.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:35 smithi026 ceph-mon[98801]: pgmap v271: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-01T01:03:35.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:35 smithi026 ceph-mon[98801]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:03:36.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:35 smithi116 ceph-mon[103554]: pgmap v271: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-01T01:03:36.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:35 smithi116 ceph-mon[103554]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:03:36.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:35 smithi093 ceph-mon[103327]: pgmap v271: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 170 B/s wr, 5 op/s 2023-12-01T01:03:36.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:35 smithi093 ceph-mon[103327]: from='client.14940 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:03:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.551+0000 7f6cee909700 1 -- 172.21.15.26:0/1653309246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ce80ffcd0 msgr2=0x7f6ce8100150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.551+0000 7f6cee909700 1 --2- 172.21.15.26:0/1653309246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ce80ffcd0 0x7f6ce8100150 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc009990 tx=0x7f6cdc009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.551+0000 7f6cee909700 1 -- 172.21.15.26:0/1653309246 shutdown_connections 2023-12-01T01:03:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.551+0000 7f6cee909700 1 --2- 172.21.15.26:0/1653309246 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ce8100690 0x7f6ce810cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.551+0000 7f6cee909700 1 --2- 172.21.15.26:0/1653309246 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce8105d80 0x7f6ce8106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.551+0000 7f6cee909700 1 --2- 172.21.15.26:0/1653309246 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ce80ffcd0 0x7f6ce8100150 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.551+0000 7f6cee909700 1 -- 172.21.15.26:0/1653309246 >> 172.21.15.26:0/1653309246 conn(0x7f6ce8076d90 msgr2=0x7f6ce80771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.551+0000 7f6cee909700 1 -- 172.21.15.26:0/1653309246 shutdown_connections 2023-12-01T01:03:36.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.551+0000 7f6cee909700 1 -- 172.21.15.26:0/1653309246 wait complete. 2023-12-01T01:03:36.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.552+0000 7f6cee909700 1 Processor -- start 2023-12-01T01:03:36.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.552+0000 7f6cee909700 1 -- start start 2023-12-01T01:03:36.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.552+0000 7f6cee909700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce80ffcd0 0x7f6ce810d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:36.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.552+0000 7f6cee909700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ce8100690 0x7f6ce810d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:36.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.552+0000 7f6cee909700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ce8105d80 0x7f6ce810dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:36.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.552+0000 7f6cee909700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce81a5460 con 0x7f6ce8100690 2023-12-01T01:03:36.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.552+0000 7f6cee909700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce81a55d0 con 0x7f6ce8105d80 2023-12-01T01:03:36.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.552+0000 7f6cee909700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce81a5790 con 0x7f6ce80ffcd0 2023-12-01T01:03:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6ce77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ce8100690 0x7f6ce810d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6ce77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ce8100690 0x7f6ce810d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54154/0 (socket says 172.21.15.26:54154) 2023-12-01T01:03:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6ce77fe700 1 -- 172.21.15.26:0/1825459516 learned_addr learned my addr 172.21.15.26:0/1825459516 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6cecea6700 1 --2- 172.21.15.26:0/1825459516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ce8105d80 0x7f6ce810dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6ce7fff700 1 --2- 172.21.15.26:0/1825459516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce80ffcd0 0x7f6ce810d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6ce77fe700 1 -- 172.21.15.26:0/1825459516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce80ffcd0 msgr2=0x7f6ce810d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6ce77fe700 1 --2- 172.21.15.26:0/1825459516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce80ffcd0 0x7f6ce810d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6ce77fe700 1 -- 172.21.15.26:0/1825459516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ce8105d80 msgr2=0x7f6ce810dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6ce77fe700 1 --2- 172.21.15.26:0/1825459516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ce8105d80 0x7f6ce810dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6ce77fe700 1 -- 172.21.15.26:0/1825459516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cdc0095f0 con 0x7f6ce8100690 2023-12-01T01:03:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6cecea6700 1 --2- 172.21.15.26:0/1825459516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ce8105d80 0x7f6ce810dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:03:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6ce77fe700 1 --2- 172.21.15.26:0/1825459516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ce8100690 0x7f6ce810d680 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc000c00 tx=0x7f6cdc00f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6ce57fa700 1 -- 172.21.15.26:0/1825459516 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc01d070 con 0x7f6ce8100690 2023-12-01T01:03:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6cee909700 1 -- 172.21.15.26:0/1825459516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce81a5a10 con 0x7f6ce8100690 2023-12-01T01:03:36.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6ce57fa700 1 -- 172.21.15.26:0/1825459516 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6cdc00bed0 con 0x7f6ce8100690 2023-12-01T01:03:36.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6ce57fa700 1 -- 172.21.15.26:0/1825459516 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc017650 con 0x7f6ce8100690 2023-12-01T01:03:36.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.553+0000 7f6cee909700 1 -- 172.21.15.26:0/1825459516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce81a5eb0 con 0x7f6ce8100690 2023-12-01T01:03:36.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.554+0000 7f6cee909700 1 -- 172.21.15.26:0/1825459516 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce804ea90 con 0x7f6ce8100690 2023-12-01T01:03:36.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.555+0000 7f6ce57fa700 1 -- 172.21.15.26:0/1825459516 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f6cdc021980 con 0x7f6ce8100690 2023-12-01T01:03:36.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.556+0000 7f6ce57fa700 1 --2- 172.21.15.26:0/1825459516 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6cd00a05b0 0x7f6cd00a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:36.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.556+0000 7f6ce7fff700 1 --2- 172.21.15.26:0/1825459516 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6cd00a05b0 0x7f6cd00a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:36.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.556+0000 7f6ce57fa700 1 -- 172.21.15.26:0/1825459516 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6cdc0ccf80 con 0x7f6ce8100690 2023-12-01T01:03:36.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.556+0000 7f6ce7fff700 1 --2- 172.21.15.26:0/1825459516 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6cd00a05b0 0x7f6cd00a2a70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8009bd0 tx=0x7f6cd8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:36.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.560+0000 7f6ce57fa700 1 -- 172.21.15.26:0/1825459516 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f6cdc096a00 con 0x7f6ce8100690 2023-12-01T01:03:36.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.754+0000 7f6cee909700 1 -- 172.21.15.26:0/1825459516 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ce80fee70 con 0x7f6cd00a05b0 2023-12-01T01:03:36.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.766+0000 7f6ce57fa700 1 -- 172.21.15.26:0/1825459516 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+339882 (secure 0 0 0) 0x7f6ce80fee70 con 0x7f6cd00a05b0 2023-12-01T01:03:36.768 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:03:36.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.769+0000 7f6cee909700 1 -- 172.21.15.26:0/1825459516 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6cd00a05b0 msgr2=0x7f6cd00a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:36.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.769+0000 7f6cee909700 1 --2- 172.21.15.26:0/1825459516 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6cd00a05b0 0x7f6cd00a2a70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8009bd0 tx=0x7f6cd8009260 comp rx=0 tx=0).stop 2023-12-01T01:03:36.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.769+0000 7f6cee909700 1 -- 172.21.15.26:0/1825459516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ce8100690 msgr2=0x7f6ce810d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:36.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.769+0000 7f6cee909700 1 --2- 172.21.15.26:0/1825459516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ce8100690 0x7f6ce810d680 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc000c00 tx=0x7f6cdc00f7c0 comp rx=0 tx=0).stop 2023-12-01T01:03:36.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.770+0000 7f6cee909700 1 -- 172.21.15.26:0/1825459516 shutdown_connections 2023-12-01T01:03:36.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.770+0000 7f6cee909700 1 --2- 172.21.15.26:0/1825459516 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6cd00a05b0 0x7f6cd00a2a70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:36.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.770+0000 7f6cee909700 1 --2- 172.21.15.26:0/1825459516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6ce8105d80 0x7f6ce810dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:36.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.770+0000 7f6cee909700 1 --2- 172.21.15.26:0/1825459516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6ce80ffcd0 0x7f6ce810d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:36.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.770+0000 7f6cee909700 1 --2- 172.21.15.26:0/1825459516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ce8100690 0x7f6ce810d680 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:36.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.770+0000 7f6cee909700 1 -- 172.21.15.26:0/1825459516 >> 172.21.15.26:0/1825459516 conn(0x7f6ce8076d90 msgr2=0x7f6ce80fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:36.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.770+0000 7f6cee909700 1 -- 172.21.15.26:0/1825459516 shutdown_connections 2023-12-01T01:03:36.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:36.770+0000 7f6cee909700 1 -- 172.21.15.26:0/1825459516 wait complete. 2023-12-01T01:03:36.777 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-12-01T01:03:37.090 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2023-12-01T01:03:35.965843+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653444,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":395,"num_read_kb":304,"num_write":333,"num_write_kb":3043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1221573,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":334436,"kb_used_data":11012,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124607388,"statfs":{"total":1151940427776,"available":1151597965312,"internally_reserved":0,"allocated":11276288,"data_stored":7154628,"data_compressed":114720,"data_compressed_allocated":143360,"data_compressed_original":1806336,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003134"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629901+0000","last_change":"2023-12-01T01:02:47.280671+0000","last_active":"2023-12-01T01:02:58.629901+0000","last_peered":"2023-12-01T01:02:58.629901+0000","last_clean":"2023-12-01T01:02:58.629901+0000","last_became_active":"2023-12-01T01:02:47.279922+0000","last_became_peered":"2023-12-01T01:02:47.279922+0000","last_unstale":"2023-12-01T01:02:58.629901+0000","last_undegraded":"2023-12-01T01:02:58.629901+0000","last_fullsized":"2023-12-01T01:02:58.629901+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:07:38.049977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.633925+0000","last_change":"2023-12-01T01:02:47.286185+0000","last_active":"2023-12-01T01:02:58.633925+0000","last_peered":"2023-12-01T01:02:58.633925+0000","last_clean":"2023-12-01T01:02:58.633925+0000","last_became_active":"2023-12-01T01:02:47.283747+0000","last_became_peered":"2023-12-01T01:02:47.283747+0000","last_unstale":"2023-12-01T01:02:58.633925+0000","last_undegraded":"2023-12-01T01:02:58.633925+0000","last_fullsized":"2023-12-01T01:02:58.633925+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:38:32.697826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.633936+0000","last_change":"2023-12-01T01:02:47.285778+0000","last_active":"2023-12-01T01:02:58.633936+0000","last_peered":"2023-12-01T01:02:58.633936+0000","last_clean":"2023-12-01T01:02:58.633936+0000","last_became_active":"2023-12-01T01:02:47.279395+0000","last_became_peered":"2023-12-01T01:02:47.279395+0000","last_unstale":"2023-12-01T01:02:58.633936+0000","last_undegraded":"2023-12-01T01:02:58.633936+0000","last_fullsized":"2023-12-01T01:02:58.633936+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:04:20.570660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.631324+0000","last_change":"2023-12-01T01:02:47.269316+0000","last_active":"2023-12-01T01:02:58.631324+0000","last_peered":"2023-12-01T01:02:58.631324+0000","last_clean":"2023-12-01T01:02:58.631324+0000","last_became_active":"2023-12-01T01:02:47.269041+0000","last_became_peered":"2023-12-01T01:02:47.269041+0000","last_unstale":"2023-12-01T01:02:58.631324+0000","last_undegraded":"2023-12-01T01:02:58.631324+0000","last_fullsized":"2023-12-01T01:02:58.631324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:24:27.951422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634558+0000","last_change":"2023-12-01T01:02:47.273802+0000","last_active":"2023-12-01T01:02:58.634558+0000","last_peered":"2023-12-01T01:02:58.634558+0000","last_clean":"2023-12-01T01:02:58.634558+0000","last_became_active":"2023-12-01T01:02:47.273450+0000","last_became_peered":"2023-12-01T01:02:47.273450+0000","last_unstale":"2023-12-01T01:02:58.634558+0000","last_undegraded":"2023-12-01T01:02:58.634558+0000","last_fullsized":"2023-12-01T01:02:58.634558+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:19:39.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.633006+0000","last_change":"2023-12-01T01:02:47.274505+0000","last_active":"2023-12-01T01:02:58.633006+0000","last_peered":"2023-12-01T01:02:58.633006+0000","last_clean":"2023-12-01T01:02:58.633006+0000","last_became_active":"2023-12-01T01:02:47.274141+0000","last_became_peered":"2023-12-01T01:02:47.274141+0000","last_unstale":"2023-12-01T01:02:58.633006+0000","last_undegraded":"2023-12-01T01:02:58.633006+0000","last_fullsized":"2023-12-01T01:02:58.633006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:27:16.589927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638314+0000","last_change":"2023-12-01T01:02:47.279480+0000","last_active":"2023-12-01T01:02:58.638314+0000","last_peered":"2023-12-01T01:02:58.638314+0000","last_clean":"2023-12-01T01:02:58.638314+0000","last_became_active":"2023-12-01T01:02:47.279147+0000","last_became_peered":"2023-12-01T01:02:47.279147+0000","last_unstale":"2023-12-01T01:02:58.638314+0000","last_undegraded":"2023-12-01T01:02:58.638314+0000","last_fullsized":"2023-12-01T01:02:58.638314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:28:37.815087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637462+0000","last_change":"2023-12-01T01:02:47.283997+0000","last_active":"2023-12-01T01:02:58.637462+0000","last_peered":"2023-12-01T01:02:58.637462+0000","last_clean":"2023-12-01T01:02:58.637462+0000","last_became_active":"2023-12-01T01:02:47.283694+0000","last_became_peered":"2023-12-01T01:02:47.283694+0000","last_unstale":"2023-12-01T01:02:58.637462+0000","last_undegraded":"2023-12-01T01:02:58.637462+0000","last_fullsized":"2023-12-01T01:02:58.637462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:49:30.154079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635350+0000","last_change":"2023-12-01T01:02:47.280113+0000","last_active":"2023-12-01T01:02:58.635350+0000","last_peered":"2023-12-01T01:02:58.635350+0000","last_clean":"2023-12-01T01:02:58.635350+0000","last_became_active":"2023-12-01T01:02:47.279844+0000","last_became_peered":"2023-12-01T01:02:47.279844+0000","last_unstale":"2023-12-01T01:02:58.635350+0000","last_undegraded":"2023-12-01T01:02:58.635350+0000","last_fullsized":"2023-12-01T01:02:58.635350+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:50:19.955146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.632570+0000","last_change":"2023-12-01T01:02:47.275575+0000","last_active":"2023-12-01T01:02:58.632570+0000","last_peered":"2023-12-01T01:02:58.632570+0000","last_clean":"2023-12-01T01:02:58.632570+0000","last_became_active":"2023-12-01T01:02:47.275283+0000","last_became_peered":"2023-12-01T01:02:47.275283+0000","last_unstale":"2023-12-01T01:02:58.632570+0000","last_undegraded":"2023-12-01T01:02:58.632570+0000","last_fullsized":"2023-12-01T01:02:58.632570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:08:41.842374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638801+0000","last_change":"2023-12-01T01:02:47.275992+0000","last_active":"2023-12-01T01:02:58.638801+0000","last_peered":"2023-12-01T01:02:58.638801+0000","last_clean":"2023-12-01T01:02:58.638801+0000","last_became_active":"2023-12-01T01:02:47.275406+0000","last_became_peered":"2023-12-01T01:02:47.275406+0000","last_unstale":"2023-12-01T01:02:58.638801+0000","last_undegraded":"2023-12-01T01:02:58.638801+0000","last_fullsized":"2023-12-01T01:02:58.638801+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:58:39.978873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.631254+0000","last_change":"2023-12-01T01:02:47.282829+0000","last_active":"2023-12-01T01:02:58.631254+0000","last_peered":"2023-12-01T01:02:58.631254+0000","last_clean":"2023-12-01T01:02:58.631254+0000","last_became_active":"2023-12-01T01:02:47.282007+0000","last_became_peered":"2023-12-01T01:02:47.282007+0000","last_unstale":"2023-12-01T01:02:58.631254+0000","last_undegraded":"2023-12-01T01:02:58.631254+0000","last_fullsized":"2023-12-01T01:02:58.631254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:55:57.394004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629377+0000","last_change":"2023-12-01T01:02:47.276769+0000","last_active":"2023-12-01T01:02:58.629377+0000","last_peered":"2023-12-01T01:02:58.629377+0000","last_clean":"2023-12-01T01:02:58.629377+0000","last_became_active":"2023-12-01T01:02:47.276355+0000","last_became_peered":"2023-12-01T01:02:47.276355+0000","last_unstale":"2023-12-01T01:02:58.629377+0000","last_undegraded":"2023-12-01T01:02:58.629377+0000","last_fullsized":"2023-12-01T01:02:58.629377+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:15:23.314516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634053+0000","last_change":"2023-12-01T01:02:47.286107+0000","last_active":"2023-12-01T01:02:58.634053+0000","last_peered":"2023-12-01T01:02:58.634053+0000","last_clean":"2023-12-01T01:02:58.634053+0000","last_became_active":"2023-12-01T01:02:47.285772+0000","last_became_peered":"2023-12-01T01:02:47.285772+0000","last_unstale":"2023-12-01T01:02:58.634053+0000","last_undegraded":"2023-12-01T01:02:58.634053+0000","last_fullsized":"2023-12-01T01:02:58.634053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:30:29.730055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.633701+0000","last_change":"2023-12-01T01:02:47.281813+0000","last_active":"2023-12-01T01:02:58.633701+0000","last_peered":"2023-12-01T01:02:58.633701+0000","last_clean":"2023-12-01T01:02:58.633701+0000","last_became_active":"2023-12-01T01:02:47.279117+0000","last_became_peered":"2023-12-01T01:02:47.279117+0000","last_unstale":"2023-12-01T01:02:58.633701+0000","last_undegraded":"2023-12-01T01:02:58.633701+0000","last_fullsized":"2023-12-01T01:02:58.633701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:11:34.646161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634802+0000","last_change":"2023-12-01T01:02:47.289596+0000","last_active":"2023-12-01T01:02:58.634802+0000","last_peered":"2023-12-01T01:02:58.634802+0000","last_clean":"2023-12-01T01:02:58.634802+0000","last_became_active":"2023-12-01T01:02:47.289273+0000","last_became_peered":"2023-12-01T01:02:47.289273+0000","last_unstale":"2023-12-01T01:02:58.634802+0000","last_undegraded":"2023-12-01T01:02:58.634802+0000","last_fullsized":"2023-12-01T01:02:58.634802+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:10:33.606237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629905+0000","last_change":"2023-12-01T01:02:47.281198+0000","last_active":"2023-12-01T01:02:58.629905+0000","last_peered":"2023-12-01T01:02:58.629905+0000","last_clean":"2023-12-01T01:02:58.629905+0000","last_became_active":"2023-12-01T01:02:47.280903+0000","last_became_peered":"2023-12-01T01:02:47.280903+0000","last_unstale":"2023-12-01T01:02:58.629905+0000","last_undegraded":"2023-12-01T01:02:58.629905+0000","last_fullsized":"2023-12-01T01:02:58.629905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:14:56.199140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634851+0000","last_change":"2023-12-01T01:02:47.281015+0000","last_active":"2023-12-01T01:02:58.634851+0000","last_peered":"2023-12-01T01:02:58.634851+0000","last_clean":"2023-12-01T01:02:58.634851+0000","last_became_active":"2023-12-01T01:02:47.280670+0000","last_became_peered":"2023-12-01T01:02:47.280670+0000","last_unstale":"2023-12-01T01:02:58.634851+0000","last_undegraded":"2023-12-01T01:02:58.634851+0000","last_fullsized":"2023-12-01T01:02:58.634851+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:13:12.686506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635315+0000","last_change":"2023-12-01T01:02:47.283444+0000","last_active":"2023-12-01T01:02:58.635315+0000","last_peered":"2023-12-01T01:02:58.635315+0000","last_clean":"2023-12-01T01:02:58.635315+0000","last_became_active":"2023-12-01T01:02:47.283131+0000","last_became_peered":"2023-12-01T01:02:47.283131+0000","last_unstale":"2023-12-01T01:02:58.635315+0000","last_undegraded":"2023-12-01T01:02:58.635315+0000","last_fullsized":"2023-12-01T01:02:58.635315+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:36:50.069639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635021+0000","last_change":"2023-12-01T01:02:46.825507+0000","last_active":"2023-12-01T01:02:58.635021+0000","last_peered":"2023-12-01T01:02:58.635021+0000","last_clean":"2023-12-01T01:02:58.635021+0000","last_became_active":"2023-12-01T01:02:46.825170+0000","last_became_peered":"2023-12-01T01:02:46.825170+0000","last_unstale":"2023-12-01T01:02:58.635021+0000","last_undegraded":"2023-12-01T01:02:58.635021+0000","last_fullsized":"2023-12-01T01:02:58.635021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:10:10.518664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:00.001703+0000","last_change":"2023-12-01T01:03:00.001168+0000","last_active":"2023-12-01T01:03:00.001703+0000","last_peered":"2023-12-01T01:03:00.001703+0000","last_clean":"2023-12-01T01:03:00.001703+0000","last_became_active":"2023-12-01T01:03:00.000826+0000","last_became_peered":"2023-12-01T01:03:00.000826+0000","last_unstale":"2023-12-01T01:03:00.001703+0000","last_undegraded":"2023-12-01T01:03:00.001703+0000","last_fullsized":"2023-12-01T01:03:00.001703+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:03:25.647589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638080+0000","last_change":"2023-12-01T01:02:46.835504+0000","last_active":"2023-12-01T01:02:58.638080+0000","last_peered":"2023-12-01T01:02:58.638080+0000","last_clean":"2023-12-01T01:02:58.638080+0000","last_became_active":"2023-12-01T01:02:46.835206+0000","last_became_peered":"2023-12-01T01:02:46.835206+0000","last_unstale":"2023-12-01T01:02:58.638080+0000","last_undegraded":"2023-12-01T01:02:58.638080+0000","last_fullsized":"2023-12-01T01:02:58.638080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:42:18.756880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634395+0000","last_change":"2023-12-01T01:02:47.286713+0000","last_active":"2023-12-01T01:02:58.634395+0000","last_peered":"2023-12-01T01:02:58.634395+0000","last_clean":"2023-12-01T01:02:58.634395+0000","last_became_active":"2023-12-01T01:02:47.285868+0000","last_became_peered":"2023-12-01T01:02:47.285868+0000","last_unstale":"2023-12-01T01:02:58.634395+0000","last_undegraded":"2023-12-01T01:02:58.634395+0000","last_fullsized":"2023-12-01T01:02:58.634395+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:16:31.496085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.648184+0000","last_change":"2023-12-01T01:02:59.647766+0000","last_active":"2023-12-01T01:02:59.648184+0000","last_peered":"2023-12-01T01:02:59.648184+0000","last_clean":"2023-12-01T01:02:59.648184+0000","last_became_active":"2023-12-01T01:02:59.641808+0000","last_became_peered":"2023-12-01T01:02:59.641808+0000","last_unstale":"2023-12-01T01:02:59.648184+0000","last_undegraded":"2023-12-01T01:02:59.648184+0000","last_fullsized":"2023-12-01T01:02:59.648184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:57:44.213111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635324+0000","last_change":"2023-12-01T01:02:47.284868+0000","last_active":"2023-12-01T01:02:58.635324+0000","last_peered":"2023-12-01T01:02:58.635324+0000","last_clean":"2023-12-01T01:02:58.635324+0000","last_became_active":"2023-12-01T01:02:47.284602+0000","last_became_peered":"2023-12-01T01:02:47.284602+0000","last_unstale":"2023-12-01T01:02:58.635324+0000","last_undegraded":"2023-12-01T01:02:58.635324+0000","last_fullsized":"2023-12-01T01:02:58.635324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:12:36.510333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634994+0000","last_change":"2023-12-01T01:02:46.832234+0000","last_active":"2023-12-01T01:02:58.634994+0000","last_peered":"2023-12-01T01:02:58.634994+0000","last_clean":"2023-12-01T01:02:58.634994+0000","last_became_active":"2023-12-01T01:02:46.831986+0000","last_became_peered":"2023-12-01T01:02:46.831986+0000","last_unstale":"2023-12-01T01:02:58.634994+0000","last_undegraded":"2023-12-01T01:02:58.634994+0000","last_fullsized":"2023-12-01T01:02:58.634994+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:49:35.773243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.639557+0000","last_change":"2023-12-01T01:02:47.275033+0000","last_active":"2023-12-01T01:02:58.639557+0000","last_peered":"2023-12-01T01:02:58.639557+0000","last_clean":"2023-12-01T01:02:58.639557+0000","last_became_active":"2023-12-01T01:02:47.274730+0000","last_became_peered":"2023-12-01T01:02:47.274730+0000","last_unstale":"2023-12-01T01:02:58.639557+0000","last_undegraded":"2023-12-01T01:02:58.639557+0000","last_fullsized":"2023-12-01T01:02:58.639557+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:48:44.959720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"81'6","reported_seq":66,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:33.399654+0000","last_change":"2023-12-01T01:02:46.827046+0000","last_active":"2023-12-01T01:03:33.399654+0000","last_peered":"2023-12-01T01:03:33.399654+0000","last_clean":"2023-12-01T01:03:33.399654+0000","last_became_active":"2023-12-01T01:02:46.826716+0000","last_became_peered":"2023-12-01T01:02:46.826716+0000","last_unstale":"2023-12-01T01:03:33.399654+0000","last_undegraded":"2023-12-01T01:03:33.399654+0000","last_fullsized":"2023-12-01T01:03:33.399654+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:06:46.195630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":967,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":46,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637058+0000","last_change":"2023-12-01T01:02:47.270299+0000","last_active":"2023-12-01T01:02:58.637058+0000","last_peered":"2023-12-01T01:02:58.637058+0000","last_clean":"2023-12-01T01:02:58.637058+0000","last_became_active":"2023-12-01T01:02:47.270016+0000","last_became_peered":"2023-12-01T01:02:47.270016+0000","last_unstale":"2023-12-01T01:02:58.637058+0000","last_undegraded":"2023-12-01T01:02:58.637058+0000","last_fullsized":"2023-12-01T01:02:58.637058+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:16:30.207449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.643802+0000","last_change":"2023-12-01T01:02:59.643802+0000","last_active":"2023-12-01T01:02:59.643802+0000","last_peered":"2023-12-01T01:02:59.643802+0000","last_clean":"2023-12-01T01:02:59.643802+0000","last_became_active":"2023-12-01T01:02:59.640951+0000","last_became_peered":"2023-12-01T01:02:59.640951+0000","last_unstale":"2023-12-01T01:02:59.643802+0000","last_undegraded":"2023-12-01T01:02:59.643802+0000","last_fullsized":"2023-12-01T01:02:59.643802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:52:32.599515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638692+0000","last_change":"2023-12-01T01:02:47.274600+0000","last_active":"2023-12-01T01:02:58.638692+0000","last_peered":"2023-12-01T01:02:58.638692+0000","last_clean":"2023-12-01T01:02:58.638692+0000","last_became_active":"2023-12-01T01:02:47.273979+0000","last_became_peered":"2023-12-01T01:02:47.273979+0000","last_unstale":"2023-12-01T01:02:58.638692+0000","last_undegraded":"2023-12-01T01:02:58.638692+0000","last_fullsized":"2023-12-01T01:02:58.638692+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:20:55.693393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629126+0000","last_change":"2023-12-01T01:02:46.821479+0000","last_active":"2023-12-01T01:02:58.629126+0000","last_peered":"2023-12-01T01:02:58.629126+0000","last_clean":"2023-12-01T01:02:58.629126+0000","last_became_active":"2023-12-01T01:02:46.821090+0000","last_became_peered":"2023-12-01T01:02:46.821090+0000","last_unstale":"2023-12-01T01:02:58.629126+0000","last_undegraded":"2023-12-01T01:02:58.629126+0000","last_fullsized":"2023-12-01T01:02:58.629126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:17:48.216217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637541+0000","last_change":"2023-12-01T01:02:47.274298+0000","last_active":"2023-12-01T01:02:58.637541+0000","last_peered":"2023-12-01T01:02:58.637541+0000","last_clean":"2023-12-01T01:02:58.637541+0000","last_became_active":"2023-12-01T01:02:47.274006+0000","last_became_peered":"2023-12-01T01:02:47.274006+0000","last_unstale":"2023-12-01T01:02:58.637541+0000","last_undegraded":"2023-12-01T01:02:58.637541+0000","last_fullsized":"2023-12-01T01:02:58.637541+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:38.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637568+0000","last_change":"2023-12-01T01:02:46.826341+0000","last_active":"2023-12-01T01:02:58.637568+0000","last_peered":"2023-12-01T01:02:58.637568+0000","last_clean":"2023-12-01T01:02:58.637568+0000","last_became_active":"2023-12-01T01:02:46.825979+0000","last_became_peered":"2023-12-01T01:02:46.825979+0000","last_unstale":"2023-12-01T01:02:58.637568+0000","last_undegraded":"2023-12-01T01:02:58.637568+0000","last_fullsized":"2023-12-01T01:02:58.637568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:29:48.681232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634567+0000","last_change":"2023-12-01T01:02:47.280989+0000","last_active":"2023-12-01T01:02:58.634567+0000","last_peered":"2023-12-01T01:02:58.634567+0000","last_clean":"2023-12-01T01:02:58.634567+0000","last_became_active":"2023-12-01T01:02:47.280649+0000","last_became_peered":"2023-12-01T01:02:47.280649+0000","last_unstale":"2023-12-01T01:02:58.634567+0000","last_undegraded":"2023-12-01T01:02:58.634567+0000","last_fullsized":"2023-12-01T01:02:58.634567+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:16:30.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'3","reported_seq":57,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:30.394702+0000","last_change":"2023-12-01T01:02:46.832304+0000","last_active":"2023-12-01T01:03:30.394702+0000","last_peered":"2023-12-01T01:03:30.394702+0000","last_clean":"2023-12-01T01:03:30.394702+0000","last_became_active":"2023-12-01T01:02:46.832014+0000","last_became_peered":"2023-12-01T01:02:46.832014+0000","last_unstale":"2023-12-01T01:03:30.394702+0000","last_undegraded":"2023-12-01T01:03:30.394702+0000","last_fullsized":"2023-12-01T01:03:30.394702+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:41:46.003527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635324+0000","last_change":"2023-12-01T01:02:47.277819+0000","last_active":"2023-12-01T01:02:58.635324+0000","last_peered":"2023-12-01T01:02:58.635324+0000","last_clean":"2023-12-01T01:02:58.635324+0000","last_became_active":"2023-12-01T01:02:47.277534+0000","last_became_peered":"2023-12-01T01:02:47.277534+0000","last_unstale":"2023-12-01T01:02:58.635324+0000","last_undegraded":"2023-12-01T01:02:58.635324+0000","last_fullsized":"2023-12-01T01:02:58.635324+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:56:15.627538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638700+0000","last_change":"2023-12-01T01:02:46.826783+0000","last_active":"2023-12-01T01:02:58.638700+0000","last_peered":"2023-12-01T01:02:58.638700+0000","last_clean":"2023-12-01T01:02:58.638700+0000","last_became_active":"2023-12-01T01:02:46.826479+0000","last_became_peered":"2023-12-01T01:02:46.826479+0000","last_unstale":"2023-12-01T01:02:58.638700+0000","last_undegraded":"2023-12-01T01:02:58.638700+0000","last_fullsized":"2023-12-01T01:02:58.638700+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:30:09.681494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:00.001466+0000","last_change":"2023-12-01T01:03:00.001466+0000","last_active":"2023-12-01T01:03:00.001466+0000","last_peered":"2023-12-01T01:03:00.001466+0000","last_clean":"2023-12-01T01:03:00.001466+0000","last_became_active":"2023-12-01T01:03:00.001077+0000","last_became_peered":"2023-12-01T01:03:00.001077+0000","last_unstale":"2023-12-01T01:03:00.001466+0000","last_undegraded":"2023-12-01T01:03:00.001466+0000","last_fullsized":"2023-12-01T01:03:00.001466+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:46:26.987257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.639542+0000","last_change":"2023-12-01T01:02:46.829332+0000","last_active":"2023-12-01T01:02:58.639542+0000","last_peered":"2023-12-01T01:02:58.639542+0000","last_clean":"2023-12-01T01:02:58.639542+0000","last_became_active":"2023-12-01T01:02:46.828828+0000","last_became_peered":"2023-12-01T01:02:46.828828+0000","last_unstale":"2023-12-01T01:02:58.639542+0000","last_undegraded":"2023-12-01T01:02:58.639542+0000","last_fullsized":"2023-12-01T01:02:58.639542+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:15:15.648138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635427+0000","last_change":"2023-12-01T01:02:47.277938+0000","last_active":"2023-12-01T01:02:58.635427+0000","last_peered":"2023-12-01T01:02:58.635427+0000","last_clean":"2023-12-01T01:02:58.635427+0000","last_became_active":"2023-12-01T01:02:47.277650+0000","last_became_peered":"2023-12-01T01:02:47.277650+0000","last_unstale":"2023-12-01T01:02:58.635427+0000","last_undegraded":"2023-12-01T01:02:58.635427+0000","last_fullsized":"2023-12-01T01:02:58.635427+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:03:46.667892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'27","reported_seq":148,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:31.051291+0000","last_change":"2023-12-01T01:03:00.008983+0000","last_active":"2023-12-01T01:03:31.051291+0000","last_peered":"2023-12-01T01:03:31.051291+0000","last_clean":"2023-12-01T01:03:31.051291+0000","last_became_active":"2023-12-01T01:03:00.001444+0000","last_became_peered":"2023-12-01T01:03:00.001444+0000","last_unstale":"2023-12-01T01:03:31.051291+0000","last_undegraded":"2023-12-01T01:03:31.051291+0000","last_fullsized":"2023-12-01T01:03:31.051291+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:29:25.347028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58530,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":91,"num_write":28,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":40837,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635297+0000","last_change":"2023-12-01T01:02:47.272049+0000","last_active":"2023-12-01T01:02:58.635297+0000","last_peered":"2023-12-01T01:02:58.635297+0000","last_clean":"2023-12-01T01:02:58.635297+0000","last_became_active":"2023-12-01T01:02:47.271726+0000","last_became_peered":"2023-12-01T01:02:47.271726+0000","last_unstale":"2023-12-01T01:02:58.635297+0000","last_undegraded":"2023-12-01T01:02:58.635297+0000","last_fullsized":"2023-12-01T01:02:58.635297+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:08:45.038989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634393+0000","last_change":"2023-12-01T01:02:46.831362+0000","last_active":"2023-12-01T01:02:58.634393+0000","last_peered":"2023-12-01T01:02:58.634393+0000","last_clean":"2023-12-01T01:02:58.634393+0000","last_became_active":"2023-12-01T01:02:46.830929+0000","last_became_peered":"2023-12-01T01:02:46.830929+0000","last_unstale":"2023-12-01T01:02:58.634393+0000","last_undegraded":"2023-12-01T01:02:58.634393+0000","last_fullsized":"2023-12-01T01:02:58.634393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:39:54.855526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629172+0000","last_change":"2023-12-01T01:02:47.275343+0000","last_active":"2023-12-01T01:02:58.629172+0000","last_peered":"2023-12-01T01:02:58.629172+0000","last_clean":"2023-12-01T01:02:58.629172+0000","last_became_active":"2023-12-01T01:02:47.275042+0000","last_became_peered":"2023-12-01T01:02:47.275042+0000","last_unstale":"2023-12-01T01:02:58.629172+0000","last_undegraded":"2023-12-01T01:02:58.629172+0000","last_fullsized":"2023-12-01T01:02:58.629172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:18:27.862601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638406+0000","last_change":"2023-12-01T01:02:46.831996+0000","last_active":"2023-12-01T01:02:58.638406+0000","last_peered":"2023-12-01T01:02:58.638406+0000","last_clean":"2023-12-01T01:02:58.638406+0000","last_became_active":"2023-12-01T01:02:46.831710+0000","last_became_peered":"2023-12-01T01:02:46.831710+0000","last_unstale":"2023-12-01T01:02:58.638406+0000","last_undegraded":"2023-12-01T01:02:58.638406+0000","last_fullsized":"2023-12-01T01:02:58.638406+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:50:42.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638845+0000","last_change":"2023-12-01T01:02:47.283771+0000","last_active":"2023-12-01T01:02:58.638845+0000","last_peered":"2023-12-01T01:02:58.638845+0000","last_clean":"2023-12-01T01:02:58.638845+0000","last_became_active":"2023-12-01T01:02:47.283363+0000","last_became_peered":"2023-12-01T01:02:47.283363+0000","last_unstale":"2023-12-01T01:02:58.638845+0000","last_undegraded":"2023-12-01T01:02:58.638845+0000","last_fullsized":"2023-12-01T01:02:58.638845+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:44:40.918161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":64,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:33.399616+0000","last_change":"2023-12-01T01:02:46.825170+0000","last_active":"2023-12-01T01:03:33.399616+0000","last_peered":"2023-12-01T01:03:33.399616+0000","last_clean":"2023-12-01T01:03:33.399616+0000","last_became_active":"2023-12-01T01:02:46.824857+0000","last_became_peered":"2023-12-01T01:02:46.824857+0000","last_unstale":"2023-12-01T01:03:33.399616+0000","last_undegraded":"2023-12-01T01:03:33.399616+0000","last_fullsized":"2023-12-01T01:03:33.399616+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:05:54.095408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":933,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638178+0000","last_change":"2023-12-01T01:02:47.279495+0000","last_active":"2023-12-01T01:02:58.638178+0000","last_peered":"2023-12-01T01:02:58.638178+0000","last_clean":"2023-12-01T01:02:58.638178+0000","last_became_active":"2023-12-01T01:02:47.279171+0000","last_became_peered":"2023-12-01T01:02:47.279171+0000","last_unstale":"2023-12-01T01:02:58.638178+0000","last_undegraded":"2023-12-01T01:02:58.638178+0000","last_fullsized":"2023-12-01T01:02:58.638178+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:29:33.298818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634745+0000","last_change":"2023-12-01T01:02:46.833837+0000","last_active":"2023-12-01T01:02:58.634745+0000","last_peered":"2023-12-01T01:02:58.634745+0000","last_clean":"2023-12-01T01:02:58.634745+0000","last_became_active":"2023-12-01T01:02:46.833549+0000","last_became_peered":"2023-12-01T01:02:46.833549+0000","last_unstale":"2023-12-01T01:02:58.634745+0000","last_undegraded":"2023-12-01T01:02:58.634745+0000","last_fullsized":"2023-12-01T01:02:58.634745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:35:02.581360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638414+0000","last_change":"2023-12-01T01:02:47.273884+0000","last_active":"2023-12-01T01:02:58.638414+0000","last_peered":"2023-12-01T01:02:58.638414+0000","last_clean":"2023-12-01T01:02:58.638414+0000","last_became_active":"2023-12-01T01:02:47.273575+0000","last_became_peered":"2023-12-01T01:02:47.273575+0000","last_unstale":"2023-12-01T01:02:58.638414+0000","last_undegraded":"2023-12-01T01:02:58.638414+0000","last_fullsized":"2023-12-01T01:02:58.638414+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:49:54.924619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635351+0000","last_change":"2023-12-01T01:02:46.832265+0000","last_active":"2023-12-01T01:02:58.635351+0000","last_peered":"2023-12-01T01:02:58.635351+0000","last_clean":"2023-12-01T01:02:58.635351+0000","last_became_active":"2023-12-01T01:02:46.831944+0000","last_became_peered":"2023-12-01T01:02:46.831944+0000","last_unstale":"2023-12-01T01:02:58.635351+0000","last_undegraded":"2023-12-01T01:02:58.635351+0000","last_fullsized":"2023-12-01T01:02:58.635351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:54:54.814744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629794+0000","last_change":"2023-12-01T01:02:47.276967+0000","last_active":"2023-12-01T01:02:58.629794+0000","last_peered":"2023-12-01T01:02:58.629794+0000","last_clean":"2023-12-01T01:02:58.629794+0000","last_became_active":"2023-12-01T01:02:47.276660+0000","last_became_peered":"2023-12-01T01:02:47.276660+0000","last_unstale":"2023-12-01T01:02:58.629794+0000","last_undegraded":"2023-12-01T01:02:58.629794+0000","last_fullsized":"2023-12-01T01:02:58.629794+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:19:16.029376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634786+0000","last_change":"2023-12-01T01:02:46.834425+0000","last_active":"2023-12-01T01:02:58.634786+0000","last_peered":"2023-12-01T01:02:58.634786+0000","last_clean":"2023-12-01T01:02:58.634786+0000","last_became_active":"2023-12-01T01:02:46.834150+0000","last_became_peered":"2023-12-01T01:02:46.834150+0000","last_unstale":"2023-12-01T01:02:58.634786+0000","last_undegraded":"2023-12-01T01:02:58.634786+0000","last_fullsized":"2023-12-01T01:02:58.634786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:52:39.619014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"81'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.632088+0000","last_change":"2023-12-01T01:02:47.276386+0000","last_active":"2023-12-01T01:02:58.632088+0000","last_peered":"2023-12-01T01:02:58.632088+0000","last_clean":"2023-12-01T01:02:58.632088+0000","last_became_active":"2023-12-01T01:02:47.276092+0000","last_became_peered":"2023-12-01T01:02:47.276092+0000","last_unstale":"2023-12-01T01:02:58.632088+0000","last_undegraded":"2023-12-01T01:02:58.632088+0000","last_fullsized":"2023-12-01T01:02:58.632088+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:33:39.707619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638513+0000","last_change":"2023-12-01T01:02:46.832778+0000","last_active":"2023-12-01T01:02:58.638513+0000","last_peered":"2023-12-01T01:02:58.638513+0000","last_clean":"2023-12-01T01:02:58.638513+0000","last_became_active":"2023-12-01T01:02:46.832406+0000","last_became_peered":"2023-12-01T01:02:46.832406+0000","last_unstale":"2023-12-01T01:02:58.638513+0000","last_undegraded":"2023-12-01T01:02:58.638513+0000","last_fullsized":"2023-12-01T01:02:58.638513+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:06:08.569651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.639129+0000","last_change":"2023-12-01T01:02:59.639129+0000","last_active":"2023-12-01T01:02:59.639129+0000","last_peered":"2023-12-01T01:02:59.639129+0000","last_clean":"2023-12-01T01:02:59.639129+0000","last_became_active":"2023-12-01T01:02:59.638745+0000","last_became_peered":"2023-12-01T01:02:59.638745+0000","last_unstale":"2023-12-01T01:02:59.639129+0000","last_undegraded":"2023-12-01T01:02:59.639129+0000","last_fullsized":"2023-12-01T01:02:59.639129+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:26:26.032297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637786+0000","last_change":"2023-12-01T01:02:47.269953+0000","last_active":"2023-12-01T01:02:58.637786+0000","last_peered":"2023-12-01T01:02:58.637786+0000","last_clean":"2023-12-01T01:02:58.637786+0000","last_became_active":"2023-12-01T01:02:47.265723+0000","last_became_peered":"2023-12-01T01:02:47.265723+0000","last_unstale":"2023-12-01T01:02:58.637786+0000","last_undegraded":"2023-12-01T01:02:58.637786+0000","last_fullsized":"2023-12-01T01:02:58.637786+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:28:44.370883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"81'4","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:34.400564+0000","last_change":"2023-12-01T01:02:46.827001+0000","last_active":"2023-12-01T01:03:34.400564+0000","last_peered":"2023-12-01T01:03:34.400564+0000","last_clean":"2023-12-01T01:03:34.400564+0000","last_became_active":"2023-12-01T01:02:46.826690+0000","last_became_peered":"2023-12-01T01:02:46.826690+0000","last_unstale":"2023-12-01T01:03:34.400564+0000","last_undegraded":"2023-12-01T01:03:34.400564+0000","last_fullsized":"2023-12-01T01:03:34.400564+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:37:38.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637983+0000","last_change":"2023-12-01T01:02:47.283372+0000","last_active":"2023-12-01T01:02:58.637983+0000","last_peered":"2023-12-01T01:02:58.637983+0000","last_clean":"2023-12-01T01:02:58.637983+0000","last_became_active":"2023-12-01T01:02:47.283075+0000","last_became_peered":"2023-12-01T01:02:47.283075+0000","last_unstale":"2023-12-01T01:02:58.637983+0000","last_undegraded":"2023-12-01T01:02:58.637983+0000","last_fullsized":"2023-12-01T01:02:58.637983+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:37:07.707284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.631280+0000","last_change":"2023-12-01T01:02:46.828490+0000","last_active":"2023-12-01T01:02:58.631280+0000","last_peered":"2023-12-01T01:02:58.631280+0000","last_clean":"2023-12-01T01:02:58.631280+0000","last_became_active":"2023-12-01T01:02:46.828129+0000","last_became_peered":"2023-12-01T01:02:46.828129+0000","last_unstale":"2023-12-01T01:02:58.631280+0000","last_undegraded":"2023-12-01T01:02:58.631280+0000","last_fullsized":"2023-12-01T01:02:58.631280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:52:17.060443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":322,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638309+0000","last_change":"2023-12-01T01:01:49.966660+0000","last_active":"2023-12-01T01:02:58.638309+0000","last_peered":"2023-12-01T01:02:58.638309+0000","last_clean":"2023-12-01T01:02:58.638309+0000","last_became_active":"2023-12-01T01:01:49.966125+0000","last_became_peered":"2023-12-01T01:01:49.966125+0000","last_unstale":"2023-12-01T01:02:58.638309+0000","last_undegraded":"2023-12-01T01:02:58.638309+0000","last_fullsized":"2023-12-01T01:02:58.638309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T00:59:06.461487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T00:59:06.461487+0000","last_clean_scrub_stamp":"2023-12-01T00:59:06.461487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:34:52.236994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629067+0000","last_change":"2023-12-01T01:02:47.282702+0000","last_active":"2023-12-01T01:02:58.629067+0000","last_peered":"2023-12-01T01:02:58.629067+0000","last_clean":"2023-12-01T01:02:58.629067+0000","last_became_active":"2023-12-01T01:02:47.282368+0000","last_became_peered":"2023-12-01T01:02:47.282368+0000","last_unstale":"2023-12-01T01:02:58.629067+0000","last_undegraded":"2023-12-01T01:02:58.629067+0000","last_fullsized":"2023-12-01T01:02:58.629067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:24:40.985055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638420+0000","last_change":"2023-12-01T01:02:46.827882+0000","last_active":"2023-12-01T01:02:58.638420+0000","last_peered":"2023-12-01T01:02:58.638420+0000","last_clean":"2023-12-01T01:02:58.638420+0000","last_became_active":"2023-12-01T01:02:46.827354+0000","last_became_peered":"2023-12-01T01:02:46.827354+0000","last_unstale":"2023-12-01T01:02:58.638420+0000","last_undegraded":"2023-12-01T01:02:58.638420+0000","last_fullsized":"2023-12-01T01:02:58.638420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:48:42.894733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635396+0000","last_change":"2023-12-01T01:02:46.833439+0000","last_active":"2023-12-01T01:02:58.635396+0000","last_peered":"2023-12-01T01:02:58.635396+0000","last_clean":"2023-12-01T01:02:58.635396+0000","last_became_active":"2023-12-01T01:02:46.833199+0000","last_became_peered":"2023-12-01T01:02:46.833199+0000","last_unstale":"2023-12-01T01:02:58.635396+0000","last_undegraded":"2023-12-01T01:02:58.635396+0000","last_fullsized":"2023-12-01T01:02:58.635396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:44:49.559138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629432+0000","last_change":"2023-12-01T01:02:47.283580+0000","last_active":"2023-12-01T01:02:58.629432+0000","last_peered":"2023-12-01T01:02:58.629432+0000","last_clean":"2023-12-01T01:02:58.629432+0000","last_became_active":"2023-12-01T01:02:47.283095+0000","last_became_peered":"2023-12-01T01:02:47.283095+0000","last_unstale":"2023-12-01T01:02:58.629432+0000","last_undegraded":"2023-12-01T01:02:58.629432+0000","last_fullsized":"2023-12-01T01:02:58.629432+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:33:12.541487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.634655+0000","last_change":"2023-12-01T01:02:46.831348+0000","last_active":"2023-12-01T01:02:59.634655+0000","last_peered":"2023-12-01T01:02:59.634655+0000","last_clean":"2023-12-01T01:02:59.634655+0000","last_became_active":"2023-12-01T01:02:46.831031+0000","last_became_peered":"2023-12-01T01:02:46.831031+0000","last_unstale":"2023-12-01T01:02:59.634655+0000","last_undegraded":"2023-12-01T01:02:59.634655+0000","last_fullsized":"2023-12-01T01:02:59.634655+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:15:53.172465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638241+0000","last_change":"2023-12-01T01:02:47.276281+0000","last_active":"2023-12-01T01:02:58.638241+0000","last_peered":"2023-12-01T01:02:58.638241+0000","last_clean":"2023-12-01T01:02:58.638241+0000","last_became_active":"2023-12-01T01:02:47.275573+0000","last_became_peered":"2023-12-01T01:02:47.275573+0000","last_unstale":"2023-12-01T01:02:58.638241+0000","last_undegraded":"2023-12-01T01:02:58.638241+0000","last_fullsized":"2023-12-01T01:02:58.638241+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:50:07.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.631688+0000","last_change":"2023-12-01T01:02:46.823053+0000","last_active":"2023-12-01T01:02:58.631688+0000","last_peered":"2023-12-01T01:02:58.631688+0000","last_clean":"2023-12-01T01:02:58.631688+0000","last_became_active":"2023-12-01T01:02:46.822772+0000","last_became_peered":"2023-12-01T01:02:46.822772+0000","last_unstale":"2023-12-01T01:02:58.631688+0000","last_undegraded":"2023-12-01T01:02:58.631688+0000","last_fullsized":"2023-12-01T01:02:58.631688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:43:22.496286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.633833+0000","last_change":"2023-12-01T01:02:47.289484+0000","last_active":"2023-12-01T01:02:58.633833+0000","last_peered":"2023-12-01T01:02:58.633833+0000","last_clean":"2023-12-01T01:02:58.633833+0000","last_became_active":"2023-12-01T01:02:47.289176+0000","last_became_peered":"2023-12-01T01:02:47.289176+0000","last_unstale":"2023-12-01T01:02:58.633833+0000","last_undegraded":"2023-12-01T01:02:58.633833+0000","last_fullsized":"2023-12-01T01:02:58.633833+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:21:52.905017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634804+0000","last_change":"2023-12-01T01:02:46.830635+0000","last_active":"2023-12-01T01:02:58.634804+0000","last_peered":"2023-12-01T01:02:58.634804+0000","last_clean":"2023-12-01T01:02:58.634804+0000","last_became_active":"2023-12-01T01:02:46.830337+0000","last_became_peered":"2023-12-01T01:02:46.830337+0000","last_unstale":"2023-12-01T01:02:58.634804+0000","last_undegraded":"2023-12-01T01:02:58.634804+0000","last_fullsized":"2023-12-01T01:02:58.634804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:02:10.017744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634870+0000","last_change":"2023-12-01T01:02:47.281923+0000","last_active":"2023-12-01T01:02:58.634870+0000","last_peered":"2023-12-01T01:02:58.634870+0000","last_clean":"2023-12-01T01:02:58.634870+0000","last_became_active":"2023-12-01T01:02:47.281598+0000","last_became_peered":"2023-12-01T01:02:47.281598+0000","last_unstale":"2023-12-01T01:02:58.634870+0000","last_undegraded":"2023-12-01T01:02:58.634870+0000","last_fullsized":"2023-12-01T01:02:58.634870+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:07:54.327023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637701+0000","last_change":"2023-12-01T01:02:46.830248+0000","last_active":"2023-12-01T01:02:58.637701+0000","last_peered":"2023-12-01T01:02:58.637701+0000","last_clean":"2023-12-01T01:02:58.637701+0000","last_became_active":"2023-12-01T01:02:46.829951+0000","last_became_peered":"2023-12-01T01:02:46.829951+0000","last_unstale":"2023-12-01T01:02:58.637701+0000","last_undegraded":"2023-12-01T01:02:58.637701+0000","last_fullsized":"2023-12-01T01:02:58.637701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:04:23.978035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629468+0000","last_change":"2023-12-01T01:02:47.280871+0000","last_active":"2023-12-01T01:02:58.629468+0000","last_peered":"2023-12-01T01:02:58.629468+0000","last_clean":"2023-12-01T01:02:58.629468+0000","last_became_active":"2023-12-01T01:02:47.280527+0000","last_became_peered":"2023-12-01T01:02:47.280527+0000","last_unstale":"2023-12-01T01:02:58.629468+0000","last_undegraded":"2023-12-01T01:02:58.629468+0000","last_fullsized":"2023-12-01T01:02:58.629468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:16:47.700500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.644414+0000","last_change":"2023-12-01T01:02:59.643980+0000","last_active":"2023-12-01T01:02:59.644414+0000","last_peered":"2023-12-01T01:02:59.644414+0000","last_clean":"2023-12-01T01:02:59.644414+0000","last_became_active":"2023-12-01T01:02:59.641039+0000","last_became_peered":"2023-12-01T01:02:59.641039+0000","last_unstale":"2023-12-01T01:02:59.644414+0000","last_undegraded":"2023-12-01T01:02:59.644414+0000","last_fullsized":"2023-12-01T01:02:59.644414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:06:23.044556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638187+0000","last_change":"2023-12-01T01:02:47.284981+0000","last_active":"2023-12-01T01:02:58.638187+0000","last_peered":"2023-12-01T01:02:58.638187+0000","last_clean":"2023-12-01T01:02:58.638187+0000","last_became_active":"2023-12-01T01:02:47.284576+0000","last_became_peered":"2023-12-01T01:02:47.284576+0000","last_unstale":"2023-12-01T01:02:58.638187+0000","last_undegraded":"2023-12-01T01:02:58.638187+0000","last_fullsized":"2023-12-01T01:02:58.638187+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:58:21.152156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634597+0000","last_change":"2023-12-01T01:02:46.828769+0000","last_active":"2023-12-01T01:02:58.634597+0000","last_peered":"2023-12-01T01:02:58.634597+0000","last_clean":"2023-12-01T01:02:58.634597+0000","last_became_active":"2023-12-01T01:02:46.828498+0000","last_became_peered":"2023-12-01T01:02:46.828498+0000","last_unstale":"2023-12-01T01:02:58.634597+0000","last_undegraded":"2023-12-01T01:02:58.634597+0000","last_fullsized":"2023-12-01T01:02:58.634597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:12:26.618082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638509+0000","last_change":"2023-12-01T01:02:47.283179+0000","last_active":"2023-12-01T01:02:58.638509+0000","last_peered":"2023-12-01T01:02:58.638509+0000","last_clean":"2023-12-01T01:02:58.638509+0000","last_became_active":"2023-12-01T01:02:47.282883+0000","last_became_peered":"2023-12-01T01:02:47.282883+0000","last_unstale":"2023-12-01T01:02:58.638509+0000","last_undegraded":"2023-12-01T01:02:58.638509+0000","last_fullsized":"2023-12-01T01:02:58.638509+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:19:47.406888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635111+0000","last_change":"2023-12-01T01:02:46.833482+0000","last_active":"2023-12-01T01:02:58.635111+0000","last_peered":"2023-12-01T01:02:58.635111+0000","last_clean":"2023-12-01T01:02:58.635111+0000","last_became_active":"2023-12-01T01:02:46.833200+0000","last_became_peered":"2023-12-01T01:02:46.833200+0000","last_unstale":"2023-12-01T01:02:58.635111+0000","last_undegraded":"2023-12-01T01:02:58.635111+0000","last_fullsized":"2023-12-01T01:02:58.635111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:52:41.480509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638880+0000","last_change":"2023-12-01T01:02:47.275802+0000","last_active":"2023-12-01T01:02:58.638880+0000","last_peered":"2023-12-01T01:02:58.638880+0000","last_clean":"2023-12-01T01:02:58.638880+0000","last_became_active":"2023-12-01T01:02:47.274837+0000","last_became_peered":"2023-12-01T01:02:47.274837+0000","last_unstale":"2023-12-01T01:02:58.638880+0000","last_undegraded":"2023-12-01T01:02:58.638880+0000","last_fullsized":"2023-12-01T01:02:58.638880+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:43:30.799999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638603+0000","last_change":"2023-12-01T01:02:46.829445+0000","last_active":"2023-12-01T01:02:58.638603+0000","last_peered":"2023-12-01T01:02:58.638603+0000","last_clean":"2023-12-01T01:02:58.638603+0000","last_became_active":"2023-12-01T01:02:46.829120+0000","last_became_peered":"2023-12-01T01:02:46.829120+0000","last_unstale":"2023-12-01T01:02:58.638603+0000","last_undegraded":"2023-12-01T01:02:58.638603+0000","last_fullsized":"2023-12-01T01:02:58.638603+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:57:44.467570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"81'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638654+0000","last_change":"2023-12-01T01:02:47.282683+0000","last_active":"2023-12-01T01:02:58.638654+0000","last_peered":"2023-12-01T01:02:58.638654+0000","last_clean":"2023-12-01T01:02:58.638654+0000","last_became_active":"2023-12-01T01:02:47.282346+0000","last_became_peered":"2023-12-01T01:02:47.282346+0000","last_unstale":"2023-12-01T01:02:58.638654+0000","last_undegraded":"2023-12-01T01:02:58.638654+0000","last_fullsized":"2023-12-01T01:02:58.638654+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:20:25.085982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629529+0000","last_change":"2023-12-01T01:02:46.828060+0000","last_active":"2023-12-01T01:02:58.629529+0000","last_peered":"2023-12-01T01:02:58.629529+0000","last_clean":"2023-12-01T01:02:58.629529+0000","last_became_active":"2023-12-01T01:02:46.827754+0000","last_became_peered":"2023-12-01T01:02:46.827754+0000","last_unstale":"2023-12-01T01:02:58.629529+0000","last_undegraded":"2023-12-01T01:02:58.629529+0000","last_fullsized":"2023-12-01T01:02:58.629529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:22.794619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638803+0000","last_change":"2023-12-01T01:02:47.269538+0000","last_active":"2023-12-01T01:02:58.638803+0000","last_peered":"2023-12-01T01:02:58.638803+0000","last_clean":"2023-12-01T01:02:58.638803+0000","last_became_active":"2023-12-01T01:02:47.269245+0000","last_became_peered":"2023-12-01T01:02:47.269245+0000","last_unstale":"2023-12-01T01:02:58.638803+0000","last_undegraded":"2023-12-01T01:02:58.638803+0000","last_fullsized":"2023-12-01T01:02:58.638803+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:49.163896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629550+0000","last_change":"2023-12-01T01:02:47.277545+0000","last_active":"2023-12-01T01:02:58.629550+0000","last_peered":"2023-12-01T01:02:58.629550+0000","last_clean":"2023-12-01T01:02:58.629550+0000","last_became_active":"2023-12-01T01:02:47.277307+0000","last_became_peered":"2023-12-01T01:02:47.277307+0000","last_unstale":"2023-12-01T01:02:58.629550+0000","last_undegraded":"2023-12-01T01:02:58.629550+0000","last_fullsized":"2023-12-01T01:02:58.629550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:08.655231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:00.001120+0000","last_change":"2023-12-01T01:03:00.001120+0000","last_active":"2023-12-01T01:03:00.001120+0000","last_peered":"2023-12-01T01:03:00.001120+0000","last_clean":"2023-12-01T01:03:00.001120+0000","last_became_active":"2023-12-01T01:03:00.000707+0000","last_became_peered":"2023-12-01T01:03:00.000707+0000","last_unstale":"2023-12-01T01:03:00.001120+0000","last_undegraded":"2023-12-01T01:03:00.001120+0000","last_fullsized":"2023-12-01T01:03:00.001120+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:12:25.500981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634166+0000","last_change":"2023-12-01T01:02:47.274775+0000","last_active":"2023-12-01T01:02:58.634166+0000","last_peered":"2023-12-01T01:02:58.634166+0000","last_clean":"2023-12-01T01:02:58.634166+0000","last_became_active":"2023-12-01T01:02:47.274459+0000","last_became_peered":"2023-12-01T01:02:47.274459+0000","last_unstale":"2023-12-01T01:02:58.634166+0000","last_undegraded":"2023-12-01T01:02:58.634166+0000","last_fullsized":"2023-12-01T01:02:58.634166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:06:01.273551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634245+0000","last_change":"2023-12-01T01:02:47.277487+0000","last_active":"2023-12-01T01:02:58.634245+0000","last_peered":"2023-12-01T01:02:58.634245+0000","last_clean":"2023-12-01T01:02:58.634245+0000","last_became_active":"2023-12-01T01:02:47.277092+0000","last_became_peered":"2023-12-01T01:02:47.277092+0000","last_unstale":"2023-12-01T01:02:58.634245+0000","last_undegraded":"2023-12-01T01:02:58.634245+0000","last_fullsized":"2023-12-01T01:02:58.634245+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:02:51.967302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629367+0000","last_change":"2023-12-01T01:02:47.283814+0000","last_active":"2023-12-01T01:02:58.629367+0000","last_peered":"2023-12-01T01:02:58.629367+0000","last_clean":"2023-12-01T01:02:58.629367+0000","last_became_active":"2023-12-01T01:02:47.283289+0000","last_became_peered":"2023-12-01T01:02:47.283289+0000","last_unstale":"2023-12-01T01:02:58.629367+0000","last_undegraded":"2023-12-01T01:02:58.629367+0000","last_fullsized":"2023-12-01T01:02:58.629367+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:42:59.523846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629683+0000","last_change":"2023-12-01T01:02:47.281748+0000","last_active":"2023-12-01T01:02:58.629683+0000","last_peered":"2023-12-01T01:02:58.629683+0000","last_clean":"2023-12-01T01:02:58.629683+0000","last_became_active":"2023-12-01T01:02:47.281445+0000","last_became_peered":"2023-12-01T01:02:47.281445+0000","last_unstale":"2023-12-01T01:02:58.629683+0000","last_undegraded":"2023-12-01T01:02:58.629683+0000","last_fullsized":"2023-12-01T01:02:58.629683+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:33:18.146911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635655+0000","last_change":"2023-12-01T01:02:47.276827+0000","last_active":"2023-12-01T01:02:58.635655+0000","last_peered":"2023-12-01T01:02:58.635655+0000","last_clean":"2023-12-01T01:02:58.635655+0000","last_became_active":"2023-12-01T01:02:47.276346+0000","last_became_peered":"2023-12-01T01:02:47.276346+0000","last_unstale":"2023-12-01T01:02:58.635655+0000","last_undegraded":"2023-12-01T01:02:58.635655+0000","last_fullsized":"2023-12-01T01:02:58.635655+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:49:23.203883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638155+0000","last_change":"2023-12-01T01:02:47.276461+0000","last_active":"2023-12-01T01:02:58.638155+0000","last_peered":"2023-12-01T01:02:58.638155+0000","last_clean":"2023-12-01T01:02:58.638155+0000","last_became_active":"2023-12-01T01:02:47.275992+0000","last_became_peered":"2023-12-01T01:02:47.275992+0000","last_unstale":"2023-12-01T01:02:58.638155+0000","last_undegraded":"2023-12-01T01:02:58.638155+0000","last_fullsized":"2023-12-01T01:02:58.638155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:14:04.629355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637658+0000","last_change":"2023-12-01T01:02:47.274018+0000","last_active":"2023-12-01T01:02:58.637658+0000","last_peered":"2023-12-01T01:02:58.637658+0000","last_clean":"2023-12-01T01:02:58.637658+0000","last_became_active":"2023-12-01T01:02:47.273714+0000","last_became_peered":"2023-12-01T01:02:47.273714+0000","last_unstale":"2023-12-01T01:02:58.637658+0000","last_undegraded":"2023-12-01T01:02:58.637658+0000","last_fullsized":"2023-12-01T01:02:58.637658+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:26:14.154249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637587+0000","last_change":"2023-12-01T01:02:47.276438+0000","last_active":"2023-12-01T01:02:58.637587+0000","last_peered":"2023-12-01T01:02:58.637587+0000","last_clean":"2023-12-01T01:02:58.637587+0000","last_became_active":"2023-12-01T01:02:47.276121+0000","last_became_peered":"2023-12-01T01:02:47.276121+0000","last_unstale":"2023-12-01T01:02:58.637587+0000","last_undegraded":"2023-12-01T01:02:58.637587+0000","last_fullsized":"2023-12-01T01:02:58.637587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:09:25.689189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635042+0000","last_change":"2023-12-01T01:02:47.275763+0000","last_active":"2023-12-01T01:02:58.635042+0000","last_peered":"2023-12-01T01:02:58.635042+0000","last_clean":"2023-12-01T01:02:58.635042+0000","last_became_active":"2023-12-01T01:02:47.275484+0000","last_became_peered":"2023-12-01T01:02:47.275484+0000","last_unstale":"2023-12-01T01:02:58.635042+0000","last_undegraded":"2023-12-01T01:02:58.635042+0000","last_fullsized":"2023-12-01T01:02:58.635042+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:38:02.612857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629342+0000","last_change":"2023-12-01T01:02:47.274122+0000","last_active":"2023-12-01T01:02:58.629342+0000","last_peered":"2023-12-01T01:02:58.629342+0000","last_clean":"2023-12-01T01:02:58.629342+0000","last_became_active":"2023-12-01T01:02:47.273005+0000","last_became_peered":"2023-12-01T01:02:47.273005+0000","last_unstale":"2023-12-01T01:02:58.629342+0000","last_undegraded":"2023-12-01T01:02:58.629342+0000","last_fullsized":"2023-12-01T01:02:58.629342+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:42:59.273076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629680+0000","last_change":"2023-12-01T01:02:47.270221+0000","last_active":"2023-12-01T01:02:58.629680+0000","last_peered":"2023-12-01T01:02:58.629680+0000","last_clean":"2023-12-01T01:02:58.629680+0000","last_became_active":"2023-12-01T01:02:47.269946+0000","last_became_peered":"2023-12-01T01:02:47.269946+0000","last_unstale":"2023-12-01T01:02:58.629680+0000","last_undegraded":"2023-12-01T01:02:58.629680+0000","last_fullsized":"2023-12-01T01:02:58.629680+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:00:01.640510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283824,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62830,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":269,"num_read_kb":195,"num_write":150,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":40837,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":188490,"data_compressed":6441,"data_compressed_allocated":8192,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514517,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":897024,"data_stored":433440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.58799999999999997}]},{"osd":1,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.55100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.72999999999999998}]},{"osd":5,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.78300000000000003}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":9,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.4259999999999999,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.89900000000000002}]},{"osd":10,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":0.84999999999999998}]}]},{"osd":10,"up_from":69,"seq":296352743449,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":1048576,"data_stored":1083802,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":1,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.436},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.829,"5min":1.829,"15min":1.829},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.66400000000000003}]},{"osd":3,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.502}]},{"osd":5,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.71799999999999997}]},{"osd":6,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.302,"5min":1.302,"15min":1.302},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.747}]},{"osd":9,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.78900000000000003}]},{"osd":11,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.77500000000000002}]}]},{"osd":9,"up_from":64,"seq":274877906972,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":913408,"data_stored":433676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.45200000000000001,"15min":0.46300000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58499999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.46800000000000003,"15min":0.47699999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64600000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.379}]},{"osd":1,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73799999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.65000000000000002,"15min":0.63100000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":4.5899999999999999,"5min":4.5899999999999999,"15min":4.5899999999999999},"last":0.46800000000000003}]},{"osd":2,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63,"15min":0.63900000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91900000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.59199999999999997,"15min":0.60799999999999998},"min":{"1min":0.317,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.748,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53500000000000003,"15min":0.54300000000000004},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.40699999999999997}]},{"osd":4,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83999999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.54800000000000004}]},{"osd":5,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.90600000000000003,"15min":0.94999999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89200000000000002,"5min":4.2309999999999999,"15min":4.2309999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":4.6200000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.64000000000000001,"15min":0.65300000000000002},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81699999999999995,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.70299999999999996,"15min":0.71899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95699999999999996,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.55600000000000005}]},{"osd":7,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.6040000000000001,"5min":4.6040000000000001,"15min":4.6040000000000001},"last":0.628},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98999999999999999,"5min":1.111,"15min":1.111},"last":0.61499999999999999}]},{"osd":8,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76300000000000001,"15min":0.77200000000000002},"min":{"1min":0.54600000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":1.071,"15min":1.1259999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.004,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.68899999999999995}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":4.6369999999999996,"5min":4.6369999999999996,"15min":4.6369999999999996},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.66800000000000004}]}]},{"osd":8,"up_from":57,"seq":244813135905,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":913408,"data_stored":433596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.621,"15min":0.63800000000000001},"min":{"1min":0.34399999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.79400000000000004,"5min":2.25,"15min":2.25},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.60899999999999999,"15min":0.61299999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":0.439}]},{"osd":1,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.67700000000000005,"15min":0.68100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.871,"5min":2.234,"15min":2.234},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.55400000000000005,"15min":0.54700000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.27700000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72199999999999998,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.53600000000000003,"15min":0.54600000000000004},"min":{"1min":0.29299999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.67900000000000005,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.38900000000000001}]},{"osd":3,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.68400000000000005,"15min":0.69599999999999995},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.78100000000000003,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.41599999999999998}]},{"osd":4,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59899999999999998,"15min":0.59999999999999998},"min":{"1min":0.435,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.77200000000000002,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.63},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.437,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84099999999999997,"5min":2.222,"15min":2.222},"last":0.625}]},{"osd":5,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.67400000000000004,"15min":0.68500000000000005},"min":{"1min":0.38,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.92300000000000004,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.501},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.55000000000000004,"15min":0.55500000000000005},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51700000000000002}]},{"osd":6,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.78000000000000003,"15min":0.79100000000000004},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.7230000000000001,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80500000000000005,"15min":0.81200000000000006},"min":{"1min":0.48399999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.625,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.78200000000000003,"15min":0.79300000000000004},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90700000000000003,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.51500000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.032,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.80200000000000005}]},{"osd":9,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.82099999999999995,"15min":0.80300000000000005},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.3259999999999996,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.85099999999999998,"15min":0.85299999999999998},"min":{"1min":0.626,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.0550000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.752}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.77500000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]},{"osd":7,"up_from":50,"seq":214748364837,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":1025831,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.39600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40200000000000002,"15min":0.40000000000000002},"min":{"1min":0.28299999999999997,"5min":0.251,"15min":0.251},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.433},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.42299999999999999,"15min":0.41799999999999998},"min":{"1min":0.27000000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.435,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.624},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.58499999999999996,"15min":0.57499999999999996},"min":{"1min":0.38400000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.383,"5min":1.383,"15min":1.383},"last":0.60999999999999999}]},{"osd":3,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.55600000000000005},"min":{"1min":0.46700000000000003,"5min":0.371,"15min":0.371},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.61199999999999999,"15min":0.60599999999999998},"min":{"1min":0.48699999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.34799999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.48699999999999999,"15min":0.48299999999999998},"min":{"1min":0.311,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.379}]},{"osd":5,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63600000000000001,"15min":0.63},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.65000000000000002,"15min":0.64800000000000002},"min":{"1min":0.501,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.48399999999999999,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66800000000000004,"15min":0.66100000000000003},"min":{"1min":0.51000000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47499999999999998}]},{"osd":8,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.54300000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71499999999999997,"15min":0.71199999999999997},"min":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88700000000000001,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.59399999999999997}]},{"osd":9,"last update":"Fri Dec 1 01:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.54200000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98199999999999998,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.52800000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.88800000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.72099999999999997}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":6,"up_from":45,"seq":193273528361,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":901120,"data_stored":433071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.45300000000000001,"15min":0.436},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":3.036,"5min":3.036,"15min":3.036},"last":0.34699999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.45400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76700000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.59699999999999998,"15min":0.57899999999999996},"min":{"1min":0.46600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":0.61099999999999999}]},{"osd":2,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.626,"15min":0.622},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33900000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.86299999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.438},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53600000000000003,"15min":0.52500000000000002},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.314},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.42799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.96299999999999997,"5min":1.248,"15min":1.248},"last":0.753},{"interface":"front","average":{"1min":0.62,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.46100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.78800000000000003,"5min":1.204,"15min":1.204},"last":0.78800000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.41999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.9950000000000001,"5min":2.9950000000000001,"15min":2.9950000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.04,"5min":1.319,"15min":1.319},"last":0.44800000000000001}]},{"osd":7,"last update":"Fri Dec 1 01:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64500000000000002,"15min":0.64000000000000001},"min":{"1min":0.53500000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.70599999999999996,"15min":0.69799999999999995},"min":{"1min":0.52900000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.82099999999999995}]},{"osd":8,"last update":"Fri Dec 1 01:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.52000000000000002,"5min":0.502,"15min":0.502},"max":{"1min":0.95299999999999996,"5min":1.276,"15min":1.276},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.51400000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84699999999999998,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.66900000000000004}]},{"osd":9,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.64900000000000002,"15min":0.66800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0629999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":3.6259999999999999,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.52200000000000002}]},{"osd":10,"last update":"Fri Dec 1 01:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.68400000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":491388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.503,"15min":0.502},"min":{"1min":0.33800000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.75600000000000001,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.627},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.52100000000000002,"15min":0.51000000000000001},"min":{"1min":0.34999999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.54200000000000004,"15min":0.499},"min":{"1min":0.52600000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.55000000000000004,"15min":0.505},"min":{"1min":0.46700000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.90100000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.88}]},{"osd":3,"last update":"Fri Dec 1 01:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.52800000000000002,"15min":0.51600000000000001},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55800000000000005,"15min":0.54200000000000004},"min":{"1min":0.36499999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.73599999999999999}]},{"osd":4,"last update":"Fri Dec 1 01:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.38800000000000001,"15min":0.36599999999999999},"min":{"1min":0.27700000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.41599999999999998,"15min":0.38700000000000001},"min":{"1min":0.29799999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.58599999999999997,"15min":0.55600000000000005},"min":{"1min":0.51600000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.60099999999999998,"15min":0.56599999999999995},"min":{"1min":0.53600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.82799999999999996}]},{"osd":6,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.59899999999999998,"15min":0.55900000000000005},"min":{"1min":0.495,"5min":0.377,"15min":0.377},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.47499999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.53400000000000003,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54900000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.76100000000000001}]},{"osd":8,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.56000000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.89100000000000001}]},{"osd":9,"last update":"Fri Dec 1 01:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.93799999999999994}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.95299999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]}]},{"osd":0,"up_from":8,"seq":34359738433,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":921600,"data_stored":434336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 01:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.53600000000000003,"15min":0.52100000000000002},"min":{"1min":0.38200000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53100000000000003,"15min":0.51400000000000001},"min":{"1min":0.35599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.88700000000000001,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.70699999999999996}]},{"osd":2,"last update":"Fri Dec 1 01:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.37,"15min":0.37},"max":{"1min":0.86499999999999999,"5min":0.875,"15min":0.875},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Dec 1 01:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.40999999999999998,"15min":0.40799999999999997},"min":{"1min":0.251,"5min":0.249,"15min":0.249},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.46200000000000002,"15min":0.45600000000000002},"min":{"1min":0.32600000000000001,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.376}]},{"osd":4,"last update":"Fri Dec 1 01:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55300000000000005,"15min":0.52600000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.56100000000000005,"15min":0.53200000000000003},"min":{"1min":0.44700000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.623}]},{"osd":5,"last update":"Fri Dec 1 01:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.54100000000000004}]},{"osd":6,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.60099999999999998}]},{"osd":7,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.628}]},{"osd":8,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.58599999999999997}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.67500000000000004,"15min":0.69699999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.93100000000000005,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.71199999999999997,"15min":0.73399999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94799999999999995,"5min":1.024,"15min":1.024},"last":0.64500000000000002}]},{"osd":10,"last update":"Fri Dec 1 01:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.68700000000000006}]},{"osd":11,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.65600000000000003}]}]},{"osd":2,"up_from":18,"seq":77309411386,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":917504,"data_stored":434553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.5,"15min":0.48399999999999999},"min":{"1min":0.35999999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.874,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.309,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.497}]},{"osd":1,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.47399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.54600000000000004,"15min":0.52400000000000002},"min":{"1min":0.39800000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.66700000000000004}]},{"osd":3,"last update":"Fri Dec 1 01:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.53700000000000003,"15min":0.51500000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.89600000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.38900000000000001,"5min":0.38,"15min":0.38},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56100000000000005}]},{"osd":4,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.42599999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.60199999999999998,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.55300000000000005},"min":{"1min":0.40500000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.69299999999999995,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.69099999999999995}]},{"osd":5,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.44600000000000001,"15min":0.41199999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.748},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.42599999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.65400000000000003}]},{"osd":6,"last update":"Fri Dec 1 01:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.53400000000000003},"min":{"1min":0.36799999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83299999999999996,"5min":0.877,"15min":0.877},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.628,"15min":0.59799999999999998},"min":{"1min":0.52000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.70399999999999996}]},{"osd":7,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.59199999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.58099999999999996,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.54500000000000004,"15min":0.53300000000000003},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.68200000000000005}]},{"osd":9,"last update":"Fri Dec 1 01:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.47499999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.52800000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.80500000000000005}]},{"osd":10,"last update":"Fri Dec 1 01:02:50 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.875},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.88600000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85199999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182453,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":917504,"data_stored":433388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.35599999999999998},"min":{"1min":0.26600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.41499999999999998,"15min":0.38100000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.46600000000000003}]},{"osd":1,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.51200000000000001},"min":{"1min":0.441,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.62},{"interface":"front","average":{"1min":0.622,"5min":0.58899999999999997,"15min":0.52900000000000003},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.56299999999999994}]},{"osd":2,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.72399999999999998}]},{"osd":4,"last update":"Fri Dec 1 01:02:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.60999999999999999,"15min":0.58099999999999996},"min":{"1min":0.504,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.60099999999999998,"15min":0.57699999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Dec 1 01:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.623,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.621,"15min":0.59699999999999998},"min":{"1min":0.45700000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.77500000000000002}]},{"osd":6,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57499999999999996,"15min":0.55900000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Dec 1 01:02:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.74299999999999999,"15min":0.73599999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.73099999999999998,"15min":0.71899999999999997},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.68999999999999995}]},{"osd":8,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.65200000000000002}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.751,"15min":0.76900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.76500000000000001,"15min":0.78900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.66300000000000003}]},{"osd":10,"last update":"Fri Dec 1 01:02:48 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":2.048,"5min":2.048,"15min":2.048},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953521,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":946176,"data_stored":492377,"data_compressed":6441,"data_compressed_allocated":8192,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51600000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.85099999999999998,"5min":0.88,"15min":0.88},"last":0.371},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.42999999999999999}]},{"osd":1,"last update":"Fri Dec 1 01:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.376,"15min":0.36499999999999999},"min":{"1min":0.28399999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.40200000000000002,"15min":0.38300000000000001},"min":{"1min":0.30199999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.64800000000000002,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.48099999999999998}]},{"osd":2,"last update":"Fri Dec 1 01:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.433,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56299999999999994,"15min":0.55100000000000005},"min":{"1min":0.39800000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72699999999999998,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.621}]},{"osd":3,"last update":"Fri Dec 1 01:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.56299999999999994,"15min":0.54600000000000004},"min":{"1min":0.45500000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82999999999999996,"5min":1.004,"15min":1.004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.85899999999999999,"5min":0.879,"15min":0.879},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.38800000000000001,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.42299999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.77200000000000002,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Dec 1 01:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93300000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.82499999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri Dec 1 01:02:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.55000000000000004,"15min":0.54200000000000004},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.58399999999999996,"15min":0.56999999999999995},"min":{"1min":0.46600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60399999999999998}]},{"osd":8,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.69399999999999995,"15min":0.68999999999999995},"min":{"1min":0.501,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.51400000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.745}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.76300000000000001},"min":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96999999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.73099999999999998}]},{"osd":10,"last update":"Fri Dec 1 01:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.58899999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]}]},{"osd":5,"up_from":37,"seq":158913789998,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":974848,"data_stored":1025170,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.49199999999999999,"15min":0.49399999999999999},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.78600000000000003,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.495,"15min":0.48899999999999999},"min":{"1min":0.28999999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.82099999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.49199999999999999}]},{"osd":1,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.52800000000000002,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.42499999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.74399999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38500000000000001,"15min":0.38},"min":{"1min":0.26700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.53700000000000003,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.378},{"interface":"front","average":{"1min":0.432,"5min":0.42299999999999999,"15min":0.42499999999999999},"min":{"1min":0.30399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.57199999999999995,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.443}]},{"osd":3,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53000000000000003,"15min":0.54000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.53400000000000003,"15min":0.53800000000000003},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.76100000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.66300000000000003}]},{"osd":6,"last update":"Fri Dec 1 01:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.621,"15min":0.624},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.66800000000000004,"15min":0.67000000000000004},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.91100000000000003,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.54400000000000004}]},{"osd":7,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.46300000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.88100000000000001,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63600000000000001,"15min":0.63400000000000001},"min":{"1min":0.47899999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.64900000000000002}]},{"osd":8,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.35999999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83199999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.374,"5min":0.37,"15min":0.37},"max":{"1min":0.71699999999999997,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.61799999999999999}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.72199999999999998,"15min":0.68200000000000005},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.673,"5min":5.673,"15min":5.673},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.01,"5min":0.77800000000000002,"15min":0.73999999999999999},"min":{"1min":0.48999999999999999,"5min":0.439,"15min":0.439},"max":{"1min":5.6390000000000002,"5min":5.6390000000000002,"15min":5.6390000000000002},"last":0.53000000000000003}]},{"osd":10,"last update":"Fri Dec 1 01:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":58530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":59519,"data_compressed":6441,"data_compressed_allocated":8192,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T01:03:37.097 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-01T01:03:37.098 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-01T01:03:37.098 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-01T01:03:37.098 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph health --format=json 2023-12-01T01:03:37.661 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:38.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:37 smithi026 ceph-mon[98801]: pgmap v272: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-12-01T01:03:38.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:37 smithi026 ceph-mon[98801]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:03:38.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:37 smithi116 ceph-mon[103554]: pgmap v272: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-12-01T01:03:38.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:37 smithi116 ceph-mon[103554]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:03:38.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:37 smithi093 ceph-mon[103327]: pgmap v272: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-12-01T01:03:38.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:37 smithi093 ceph-mon[103327]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:03:38.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.899+0000 7f608180d700 1 -- 172.21.15.26:0/3144512616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f607c100690 msgr2=0x7f607c10cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:38.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.899+0000 7f608180d700 1 --2- 172.21.15.26:0/3144512616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f607c100690 0x7f607c10cb30 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f607400b0a0 tx=0x7f607400b3b0 comp rx=0 tx=0).stop 2023-12-01T01:03:38.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.899+0000 7f608180d700 1 -- 172.21.15.26:0/3144512616 shutdown_connections 2023-12-01T01:03:38.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.899+0000 7f608180d700 1 --2- 172.21.15.26:0/3144512616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f607c100690 0x7f607c10cb30 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:38.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.899+0000 7f608180d700 1 --2- 172.21.15.26:0/3144512616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f607c105d80 0x7f607c106160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:38.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.899+0000 7f608180d700 1 --2- 172.21.15.26:0/3144512616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f607c0ffcd0 0x7f607c100150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:38.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.899+0000 7f608180d700 1 -- 172.21.15.26:0/3144512616 >> 172.21.15.26:0/3144512616 conn(0x7f607c076d90 msgr2=0x7f607c0771a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:38.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.899+0000 7f608180d700 1 -- 172.21.15.26:0/3144512616 shutdown_connections 2023-12-01T01:03:38.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.899+0000 7f608180d700 1 -- 172.21.15.26:0/3144512616 wait complete. 2023-12-01T01:03:38.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.899+0000 7f608180d700 1 Processor -- start 2023-12-01T01:03:38.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.899+0000 7f608180d700 1 -- start start 2023-12-01T01:03:38.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f608180d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f607c0ffcd0 0x7f607c197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:38.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f608180d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f607c100690 0x7f607c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:38.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f608180d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f607c105d80 0x7f607c1a2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:38.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f608180d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c1a33d0 con 0x7f607c105d80 2023-12-01T01:03:38.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f608180d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c1a3510 con 0x7f607c100690 2023-12-01T01:03:38.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f608180d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c1a3650 con 0x7f607c0ffcd0 2023-12-01T01:03:38.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f607b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f607c105d80 0x7f607c1a2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:38.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f607b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f607c105d80 0x7f607c1a2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54168/0 (socket says 172.21.15.26:54168) 2023-12-01T01:03:38.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f607b7fe700 1 -- 172.21.15.26:0/3660735159 learned_addr learned my addr 172.21.15.26:0/3660735159 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:38.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f607affd700 1 --2- 172.21.15.26:0/3660735159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f607c0ffcd0 0x7f607c197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:38.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f6073fff700 1 --2- 172.21.15.26:0/3660735159 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f607c100690 0x7f607c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:38.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f607b7fe700 1 -- 172.21.15.26:0/3660735159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f607c0ffcd0 msgr2=0x7f607c197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:38.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f607b7fe700 1 --2- 172.21.15.26:0/3660735159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f607c0ffcd0 0x7f607c197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:38.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f607b7fe700 1 -- 172.21.15.26:0/3660735159 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f607c100690 msgr2=0x7f607c198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:38.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f607b7fe700 1 --2- 172.21.15.26:0/3660735159 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f607c100690 0x7f607c198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:38.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f607b7fe700 1 -- 172.21.15.26:0/3660735159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6074009d00 con 0x7f607c105d80 2023-12-01T01:03:38.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f607affd700 1 --2- 172.21.15.26:0/3660735159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f607c0ffcd0 0x7f607c197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:03:38.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f607b7fe700 1 --2- 172.21.15.26:0/3660735159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f607c105d80 0x7f607c1a2e90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f60740062a0 tx=0x7f607400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:38.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f608080b700 1 -- 172.21.15.26:0/3660735159 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607400e040 con 0x7f607c105d80 2023-12-01T01:03:38.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f608080b700 1 -- 172.21.15.26:0/3660735159 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6074004020 con 0x7f607c105d80 2023-12-01T01:03:38.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f608180d700 1 -- 172.21.15.26:0/3660735159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f607c1a3850 con 0x7f607c105d80 2023-12-01T01:03:38.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.900+0000 7f608080b700 1 -- 172.21.15.26:0/3660735159 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f607401b690 con 0x7f607c105d80 2023-12-01T01:03:38.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.901+0000 7f608180d700 1 -- 172.21.15.26:0/3660735159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607c1a3d20 con 0x7f607c105d80 2023-12-01T01:03:38.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.901+0000 7f608180d700 1 -- 172.21.15.26:0/3660735159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607c04ea90 con 0x7f607c105d80 2023-12-01T01:03:38.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.902+0000 7f608080b700 1 -- 172.21.15.26:0/3660735159 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f6074003a00 con 0x7f607c105d80 2023-12-01T01:03:38.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.903+0000 7f608080b700 1 --2- 172.21.15.26:0/3660735159 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f60680a05b0 0x7f60680a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:38.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.903+0000 7f607affd700 1 --2- 172.21.15.26:0/3660735159 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f60680a05b0 0x7f60680a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:38.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.903+0000 7f608080b700 1 -- 172.21.15.26:0/3660735159 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f60740cd0d0 con 0x7f607c105d80 2023-12-01T01:03:38.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.904+0000 7f607affd700 1 --2- 172.21.15.26:0/3660735159 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f60680a05b0 0x7f60680a2a70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f606c005fd0 tx=0x7f606c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:38.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:38.907+0000 7f608080b700 1 -- 172.21.15.26:0/3660735159 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f6074096bb0 con 0x7f607c105d80 2023-12-01T01:03:39.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.153+0000 7f608180d700 1 -- 172.21.15.26:0/3660735159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f607c1a4070 con 0x7f607c105d80 2023-12-01T01:03:39.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.153+0000 7f608080b700 1 -- 172.21.15.26:0/3660735159 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f607409a1d0 con 0x7f607c105d80 2023-12-01T01:03:39.154 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:03:39.154 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-01T01:03:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.155+0000 7f608180d700 1 -- 172.21.15.26:0/3660735159 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f60680a05b0 msgr2=0x7f60680a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.155+0000 7f608180d700 1 --2- 172.21.15.26:0/3660735159 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f60680a05b0 0x7f60680a2a70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f606c005fd0 tx=0x7f606c005e30 comp rx=0 tx=0).stop 2023-12-01T01:03:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.155+0000 7f608180d700 1 -- 172.21.15.26:0/3660735159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f607c105d80 msgr2=0x7f607c1a2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.155+0000 7f608180d700 1 --2- 172.21.15.26:0/3660735159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f607c105d80 0x7f607c1a2e90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f60740062a0 tx=0x7f607400cf30 comp rx=0 tx=0).stop 2023-12-01T01:03:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.155+0000 7f608180d700 1 -- 172.21.15.26:0/3660735159 shutdown_connections 2023-12-01T01:03:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.155+0000 7f608180d700 1 --2- 172.21.15.26:0/3660735159 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f60680a05b0 0x7f60680a2a70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.155+0000 7f608180d700 1 --2- 172.21.15.26:0/3660735159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f607c105d80 0x7f607c1a2e90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.155+0000 7f608180d700 1 --2- 172.21.15.26:0/3660735159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f607c0ffcd0 0x7f607c197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:39.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.155+0000 7f608180d700 1 --2- 172.21.15.26:0/3660735159 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f607c100690 0x7f607c198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:39.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.155+0000 7f608180d700 1 -- 172.21.15.26:0/3660735159 >> 172.21.15.26:0/3660735159 conn(0x7f607c076d90 msgr2=0x7f607c0fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:39.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.155+0000 7f608180d700 1 -- 172.21.15.26:0/3660735159 shutdown_connections 2023-12-01T01:03:39.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.155+0000 7f608180d700 1 -- 172.21.15.26:0/3660735159 wait complete. 2023-12-01T01:03:39.522 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-01T01:03:39.523 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:03:39.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.652+0000 7fc397cbb700 1 -- 172.21.15.26:0/637430896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc390101800 msgr2=0x7fc3901080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.652+0000 7fc397cbb700 1 --2- 172.21.15.26:0/637430896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc390101800 0x7fc3901080b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc38800b0d0 tx=0x7fc38800b3e0 comp rx=0 tx=0).stop 2023-12-01T01:03:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.652+0000 7fc397cbb700 1 -- 172.21.15.26:0/637430896 shutdown_connections 2023-12-01T01:03:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.652+0000 7fc397cbb700 1 --2- 172.21.15.26:0/637430896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc390101800 0x7fc3901080b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.652+0000 7fc397cbb700 1 --2- 172.21.15.26:0/637430896 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc3900ffc70 0x7fc390100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.652+0000 7fc397cbb700 1 --2- 172.21.15.26:0/637430896 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc390100e60 0x7fc3901012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.652+0000 7fc397cbb700 1 -- 172.21.15.26:0/637430896 >> 172.21.15.26:0/637430896 conn(0x7fc3900fb1c0 msgr2=0x7fc3900fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.652+0000 7fc397cbb700 1 -- 172.21.15.26:0/637430896 shutdown_connections 2023-12-01T01:03:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.652+0000 7fc397cbb700 1 -- 172.21.15.26:0/637430896 wait complete. 2023-12-01T01:03:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.653+0000 7fc397cbb700 1 Processor -- start 2023-12-01T01:03:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.653+0000 7fc397cbb700 1 -- start start 2023-12-01T01:03:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.653+0000 7fc397cbb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3900ffc70 0x7fc390103c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:39.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.653+0000 7fc397cbb700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc390100e60 0x7fc390102240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.653+0000 7fc397cbb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc390101800 0x7fc390102780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.653+0000 7fc397cbb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39019a9f0 con 0x7fc390101800 2023-12-01T01:03:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.653+0000 7fc397cbb700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc390102cc0 con 0x7fc3900ffc70 2023-12-01T01:03:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.653+0000 7fc397cbb700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc390102e80 con 0x7fc390100e60 2023-12-01T01:03:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.653+0000 7fc396258700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc390101800 0x7fc390102780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.653+0000 7fc396258700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc390101800 0x7fc390102780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54180/0 (socket says 172.21.15.26:54180) 2023-12-01T01:03:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.653+0000 7fc396258700 1 -- 172.21.15.26:0/2609340565 learned_addr learned my addr 172.21.15.26:0/2609340565 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.653+0000 7fc395256700 1 --2- 172.21.15.26:0/2609340565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc390100e60 0x7fc390102240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.653+0000 7fc395a57700 1 --2- 172.21.15.26:0/2609340565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3900ffc70 0x7fc390103c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.654+0000 7fc396258700 1 -- 172.21.15.26:0/2609340565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc390100e60 msgr2=0x7fc390102240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.654+0000 7fc396258700 1 --2- 172.21.15.26:0/2609340565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc390100e60 0x7fc390102240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.654+0000 7fc396258700 1 -- 172.21.15.26:0/2609340565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3900ffc70 msgr2=0x7fc390103c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.654+0000 7fc396258700 1 --2- 172.21.15.26:0/2609340565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3900ffc70 0x7fc390103c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.654+0000 7fc396258700 1 -- 172.21.15.26:0/2609340565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc388009d00 con 0x7fc390101800 2023-12-01T01:03:39.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.654+0000 7fc396258700 1 --2- 172.21.15.26:0/2609340565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc390101800 0x7fc390102780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc388009fd0 tx=0x7fc388009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.654+0000 7fc386ffd700 1 -- 172.21.15.26:0/2609340565 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38800e040 con 0x7fc390101800 2023-12-01T01:03:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.654+0000 7fc386ffd700 1 -- 172.21.15.26:0/2609340565 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc388004e60 con 0x7fc390101800 2023-12-01T01:03:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.654+0000 7fc397cbb700 1 -- 172.21.15.26:0/2609340565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3901a53a0 con 0x7fc390101800 2023-12-01T01:03:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.654+0000 7fc386ffd700 1 -- 172.21.15.26:0/2609340565 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38801bac0 con 0x7fc390101800 2023-12-01T01:03:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.654+0000 7fc397cbb700 1 -- 172.21.15.26:0/2609340565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3901a5760 con 0x7fc390101800 2023-12-01T01:03:39.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.655+0000 7fc397cbb700 1 -- 172.21.15.26:0/2609340565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39010b620 con 0x7fc390101800 2023-12-01T01:03:39.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.656+0000 7fc386ffd700 1 -- 172.21.15.26:0/2609340565 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fc38801bc20 con 0x7fc390101800 2023-12-01T01:03:39.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.657+0000 7fc386ffd700 1 --2- 172.21.15.26:0/2609340565 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc37c0a0670 0x7fc37c0a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:39.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.657+0000 7fc395a57700 1 --2- 172.21.15.26:0/2609340565 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc37c0a0670 0x7fc37c0a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:39.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.657+0000 7fc386ffd700 1 -- 172.21.15.26:0/2609340565 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc3880cda00 con 0x7fc390101800 2023-12-01T01:03:39.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.657+0000 7fc395a57700 1 --2- 172.21.15.26:0/2609340565 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc37c0a0670 0x7fc37c0a2b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005fd0 tx=0x7fc38c005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:39.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.660+0000 7fc386ffd700 1 -- 172.21.15.26:0/2609340565 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc388097480 con 0x7fc390101800 2023-12-01T01:03:39.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:39 smithi026 ceph-mon[98801]: pgmap v273: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-01T01:03:39.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:39 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3660735159' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-01T01:03:39.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.869+0000 7fc397cbb700 1 -- 172.21.15.26:0/2609340565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc39010b840 con 0x7fc390101800 2023-12-01T01:03:39.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.870+0000 7fc386ffd700 1 -- 172.21.15.26:0/2609340565 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22481 (secure 0 0 0) 0x7fc38809aaa0 con 0x7fc390101800 2023-12-01T01:03:39.872 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:03:39.872 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":83,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:59.627676+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:03:39.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.872+0000 7fc397cbb700 1 -- 172.21.15.26:0/2609340565 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc37c0a0670 msgr2=0x7fc37c0a2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:39.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.872+0000 7fc397cbb700 1 --2- 172.21.15.26:0/2609340565 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc37c0a0670 0x7fc37c0a2b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc38c005fd0 tx=0x7fc38c005e50 comp rx=0 tx=0).stop 2023-12-01T01:03:39.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.872+0000 7fc397cbb700 1 -- 172.21.15.26:0/2609340565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc390101800 msgr2=0x7fc390102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:39.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.872+0000 7fc397cbb700 1 --2- 172.21.15.26:0/2609340565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc390101800 0x7fc390102780 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc388009fd0 tx=0x7fc388009300 comp rx=0 tx=0).stop 2023-12-01T01:03:39.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.872+0000 7fc397cbb700 1 -- 172.21.15.26:0/2609340565 shutdown_connections 2023-12-01T01:03:39.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.872+0000 7fc397cbb700 1 --2- 172.21.15.26:0/2609340565 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc37c0a0670 0x7fc37c0a2b30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:39.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.872+0000 7fc397cbb700 1 --2- 172.21.15.26:0/2609340565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc390101800 0x7fc390102780 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:39.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.872+0000 7fc397cbb700 1 --2- 172.21.15.26:0/2609340565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc3900ffc70 0x7fc390103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:39.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.872+0000 7fc397cbb700 1 --2- 172.21.15.26:0/2609340565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc390100e60 0x7fc390102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:39.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.872+0000 7fc397cbb700 1 -- 172.21.15.26:0/2609340565 >> 172.21.15.26:0/2609340565 conn(0x7fc3900fb1c0 msgr2=0x7fc3900fb850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:39.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.873+0000 7fc397cbb700 1 -- 172.21.15.26:0/2609340565 shutdown_connections 2023-12-01T01:03:39.875 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:39.873+0000 7fc397cbb700 1 -- 172.21.15.26:0/2609340565 wait complete. 2023-12-01T01:03:39.887 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T00:59:06.411348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T01:02:45.762784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T01:02:46.638998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T01:03:39.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T01:03:40.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.016+0000 7f2d8bb92700 1 -- 172.21.15.26:0/4166288233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d840ffcb0 msgr2=0x7f2d841000d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:40.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.016+0000 7f2d8bb92700 1 --2- 172.21.15.26:0/4166288233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d840ffcb0 0x7f2d841000d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2d800099c0 tx=0x7f2d80009cd0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.016+0000 7f2d8bb92700 1 -- 172.21.15.26:0/4166288233 shutdown_connections 2023-12-01T01:03:40.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.016+0000 7f2d8bb92700 1 --2- 172.21.15.26:0/4166288233 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2d84101840 0x7f2d841080f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.016+0000 7f2d8bb92700 1 --2- 172.21.15.26:0/4166288233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d840ffcb0 0x7f2d841000d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.016+0000 7f2d8bb92700 1 --2- 172.21.15.26:0/4166288233 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d84100ea0 0x7f2d84101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.016+0000 7f2d8bb92700 1 -- 172.21.15.26:0/4166288233 >> 172.21.15.26:0/4166288233 conn(0x7f2d840fb220 msgr2=0x7f2d840fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:40.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.016+0000 7f2d8bb92700 1 -- 172.21.15.26:0/4166288233 shutdown_connections 2023-12-01T01:03:40.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.016+0000 7f2d8bb92700 1 -- 172.21.15.26:0/4166288233 wait complete. 2023-12-01T01:03:40.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.016+0000 7f2d8bb92700 1 Processor -- start 2023-12-01T01:03:40.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8bb92700 1 -- start start 2023-12-01T01:03:40.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8bb92700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d840ffcb0 0x7f2d84069a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:40.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8bb92700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2d84100ea0 0x7f2d8419b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:40.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8bb92700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d84101840 0x7f2d8419de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:40.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8bb92700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8419e660 con 0x7f2d84101840 2023-12-01T01:03:40.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8bb92700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8419e7d0 con 0x7f2d84100ea0 2023-12-01T01:03:40.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8bb92700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8419e990 con 0x7f2d840ffcb0 2023-12-01T01:03:40.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8a12f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d84101840 0x7f2d8419de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:40.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8a12f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d84101840 0x7f2d8419de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54194/0 (socket says 172.21.15.26:54194) 2023-12-01T01:03:40.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8a12f700 1 -- 172.21.15.26:0/2065094528 learned_addr learned my addr 172.21.15.26:0/2065094528 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:40.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8912d700 1 --2- 172.21.15.26:0/2065094528 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2d84100ea0 0x7f2d8419b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:40.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8992e700 1 --2- 172.21.15.26:0/2065094528 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d840ffcb0 0x7f2d84069a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:40.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8a12f700 1 -- 172.21.15.26:0/2065094528 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d840ffcb0 msgr2=0x7f2d84069a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:40.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8a12f700 1 --2- 172.21.15.26:0/2065094528 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d840ffcb0 0x7f2d84069a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8a12f700 1 -- 172.21.15.26:0/2065094528 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2d84100ea0 msgr2=0x7f2d8419b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:40.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8a12f700 1 --2- 172.21.15.26:0/2065094528 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2d84100ea0 0x7f2d8419b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8a12f700 1 -- 172.21.15.26:0/2065094528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d800095f0 con 0x7f2d84101840 2023-12-01T01:03:40.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d8a12f700 1 --2- 172.21.15.26:0/2065094528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d84101840 0x7f2d8419de90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c007d70 tx=0x7f2d7c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:40.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.017+0000 7f2d7affd700 1 -- 172.21.15.26:0/2065094528 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c00ad40 con 0x7f2d84101840 2023-12-01T01:03:40.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.018+0000 7f2d7affd700 1 -- 172.21.15.26:0/2065094528 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2d7c012900 con 0x7f2d84101840 2023-12-01T01:03:40.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.018+0000 7f2d8bb92700 1 -- 172.21.15.26:0/2065094528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8419ec70 con 0x7f2d84101840 2023-12-01T01:03:40.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.018+0000 7f2d7affd700 1 -- 172.21.15.26:0/2065094528 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c011780 con 0x7f2d84101840 2023-12-01T01:03:40.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.018+0000 7f2d8bb92700 1 -- 172.21.15.26:0/2065094528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d8419f130 con 0x7f2d84101840 2023-12-01T01:03:40.022 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.018+0000 7f2d8bb92700 1 -- 172.21.15.26:0/2065094528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8410b600 con 0x7f2d84101840 2023-12-01T01:03:40.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.020+0000 7f2d7affd700 1 -- 172.21.15.26:0/2065094528 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f2d7c012a70 con 0x7f2d84101840 2023-12-01T01:03:40.023 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.020+0000 7f2d7affd700 1 --2- 172.21.15.26:0/2065094528 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2d700a05b0 0x7f2d700a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:40.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.020+0000 7f2d7affd700 1 -- 172.21.15.26:0/2065094528 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2d7c0cc0d0 con 0x7f2d84101840 2023-12-01T01:03:40.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.020+0000 7f2d8992e700 1 --2- 172.21.15.26:0/2065094528 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2d700a05b0 0x7f2d700a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:40.024 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.021+0000 7f2d8992e700 1 --2- 172.21.15.26:0/2065094528 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2d700a05b0 0x7f2d700a2a70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000b580 tx=0x7f2d80005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:40.025 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.024+0000 7f2d7affd700 1 -- 172.21.15.26:0/2065094528 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2d7c095c30 con 0x7f2d84101840 2023-12-01T01:03:40.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:39 smithi116 ceph-mon[103554]: pgmap v273: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-01T01:03:40.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:39 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3660735159' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-01T01:03:40.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:39 smithi093 ceph-mon[103327]: pgmap v273: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-01T01:03:40.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:39 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3660735159' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-01T01:03:40.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.226+0000 7f2d8bb92700 1 -- 172.21.15.26:0/2065094528 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d84106b10 con 0x7f2d84101840 2023-12-01T01:03:40.228 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.227+0000 7f2d7affd700 1 -- 172.21.15.26:0/2065094528 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d7c099250 con 0x7f2d84101840 2023-12-01T01:03:40.228 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-12-01T01:03:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.229+0000 7f2d8bb92700 1 -- 172.21.15.26:0/2065094528 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2d700a05b0 msgr2=0x7f2d700a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.229+0000 7f2d8bb92700 1 --2- 172.21.15.26:0/2065094528 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2d700a05b0 0x7f2d700a2a70 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000b580 tx=0x7f2d80005fb0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.229+0000 7f2d8bb92700 1 -- 172.21.15.26:0/2065094528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d84101840 msgr2=0x7f2d8419de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:40.230 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.229+0000 7f2d8bb92700 1 --2- 172.21.15.26:0/2065094528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d84101840 0x7f2d8419de90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c007d70 tx=0x7f2d7c00a340 comp rx=0 tx=0).stop 2023-12-01T01:03:40.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.229+0000 7f2d8bb92700 1 -- 172.21.15.26:0/2065094528 shutdown_connections 2023-12-01T01:03:40.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.229+0000 7f2d8bb92700 1 --2- 172.21.15.26:0/2065094528 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2d700a05b0 0x7f2d700a2a70 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.229+0000 7f2d8bb92700 1 --2- 172.21.15.26:0/2065094528 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d84101840 0x7f2d8419de90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.229+0000 7f2d8bb92700 1 --2- 172.21.15.26:0/2065094528 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2d840ffcb0 0x7f2d84069a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.229+0000 7f2d8bb92700 1 --2- 172.21.15.26:0/2065094528 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2d84100ea0 0x7f2d8419b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.229+0000 7f2d8bb92700 1 -- 172.21.15.26:0/2065094528 >> 172.21.15.26:0/2065094528 conn(0x7f2d840fb220 msgr2=0x7f2d840fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:40.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.229+0000 7f2d8bb92700 1 -- 172.21.15.26:0/2065094528 shutdown_connections 2023-12-01T01:03:40.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.229+0000 7f2d8bb92700 1 -- 172.21.15.26:0/2065094528 wait complete. 2023-12-01T01:03:40.243 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T01:03:40.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.370+0000 7f91b25cd700 1 -- 172.21.15.26:0/2347712035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac074d50 msgr2=0x7f91ac0731a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:40.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.370+0000 7f91b25cd700 1 --2- 172.21.15.26:0/2347712035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac074d50 0x7f91ac0731a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f919c009990 tx=0x7f919c009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.370+0000 7f91b25cd700 1 -- 172.21.15.26:0/2347712035 shutdown_connections 2023-12-01T01:03:40.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.370+0000 7f91b25cd700 1 --2- 172.21.15.26:0/2347712035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91ac108cb0 0x7f91ac10b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.370+0000 7f91b25cd700 1 --2- 172.21.15.26:0/2347712035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac074d50 0x7f91ac0731a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.370+0000 7f91b25cd700 1 --2- 172.21.15.26:0/2347712035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91ac073770 0x7f91ac073bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.370+0000 7f91b25cd700 1 -- 172.21.15.26:0/2347712035 >> 172.21.15.26:0/2347712035 conn(0x7f91ac0fc310 msgr2=0x7f91ac0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:40.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.370+0000 7f91b25cd700 1 -- 172.21.15.26:0/2347712035 shutdown_connections 2023-12-01T01:03:40.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.370+0000 7f91b25cd700 1 -- 172.21.15.26:0/2347712035 wait complete. 2023-12-01T01:03:40.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91b25cd700 1 Processor -- start 2023-12-01T01:03:40.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91b25cd700 1 -- start start 2023-12-01T01:03:40.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91b25cd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac073770 0x7f91ac198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:40.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91b25cd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91ac074d50 0x7f91ac1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:40.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91b25cd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91ac108cb0 0x7f91ac1a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:40.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91b25cd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac1a08e0 con 0x7f91ac073770 2023-12-01T01:03:40.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91b25cd700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac1a0a50 con 0x7f91ac108cb0 2023-12-01T01:03:40.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91b25cd700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91ac1a0c10 con 0x7f91ac074d50 2023-12-01T01:03:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91abfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac073770 0x7f91ac198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91abfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac073770 0x7f91ac198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54202/0 (socket says 172.21.15.26:54202) 2023-12-01T01:03:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91abfff700 1 -- 172.21.15.26:0/774202560 learned_addr learned my addr 172.21.15.26:0/774202560 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91ab7fe700 1 --2- 172.21.15.26:0/774202560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91ac074d50 0x7f91ac1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91b0b6a700 1 --2- 172.21.15.26:0/774202560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91ac108cb0 0x7f91ac1a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91abfff700 1 -- 172.21.15.26:0/774202560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91ac074d50 msgr2=0x7f91ac1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91abfff700 1 --2- 172.21.15.26:0/774202560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91ac074d50 0x7f91ac1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91abfff700 1 -- 172.21.15.26:0/774202560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91ac108cb0 msgr2=0x7f91ac1a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91abfff700 1 --2- 172.21.15.26:0/774202560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91ac108cb0 0x7f91ac1a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.371+0000 7f91abfff700 1 -- 172.21.15.26:0/774202560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a0009520 con 0x7f91ac073770 2023-12-01T01:03:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.372+0000 7f91abfff700 1 --2- 172.21.15.26:0/774202560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac073770 0x7f91ac198da0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f919c0059d0 tx=0x7f919c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.372+0000 7f91a97fa700 1 -- 172.21.15.26:0/774202560 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c01d070 con 0x7f91ac073770 2023-12-01T01:03:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.372+0000 7f91a97fa700 1 -- 172.21.15.26:0/774202560 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f919c00fe20 con 0x7f91ac073770 2023-12-01T01:03:40.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.372+0000 7f91b25cd700 1 -- 172.21.15.26:0/774202560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919c0095f0 con 0x7f91ac073770 2023-12-01T01:03:40.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.372+0000 7f91a97fa700 1 -- 172.21.15.26:0/774202560 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f919c017650 con 0x7f91ac073770 2023-12-01T01:03:40.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.372+0000 7f91b25cd700 1 -- 172.21.15.26:0/774202560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91ac1a1120 con 0x7f91ac073770 2023-12-01T01:03:40.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.373+0000 7f91b25cd700 1 -- 172.21.15.26:0/774202560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91ac1073b0 con 0x7f91ac073770 2023-12-01T01:03:40.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.374+0000 7f91a97fa700 1 -- 172.21.15.26:0/774202560 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f919c0229e0 con 0x7f91ac073770 2023-12-01T01:03:40.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.375+0000 7f91a97fa700 1 --2- 172.21.15.26:0/774202560 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f91940a05b0 0x7f91940a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:40.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.375+0000 7f91ab7fe700 1 --2- 172.21.15.26:0/774202560 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f91940a05b0 0x7f91940a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:40.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.375+0000 7f91a97fa700 1 -- 172.21.15.26:0/774202560 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f919c0cd240 con 0x7f91ac073770 2023-12-01T01:03:40.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.375+0000 7f91ab7fe700 1 --2- 172.21.15.26:0/774202560 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f91940a05b0 0x7f91940a2a70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009df0 tx=0x7f91a0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:40.379 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.379+0000 7f91a97fa700 1 -- 172.21.15.26:0/774202560 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f919c096d20 con 0x7f91ac073770 2023-12-01T01:03:40.586 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.586+0000 7f91b25cd700 1 -- 172.21.15.26:0/774202560 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f91ac02ce00 con 0x7f91ac073770 2023-12-01T01:03:40.587 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.586+0000 7f91a97fa700 1 -- 172.21.15.26:0/774202560 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f919c09a340 con 0x7f91ac073770 2023-12-01T01:03:40.587 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-12-01T01:03:40.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.588+0000 7f91b25cd700 1 -- 172.21.15.26:0/774202560 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f91940a05b0 msgr2=0x7f91940a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.588+0000 7f91b25cd700 1 --2- 172.21.15.26:0/774202560 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f91940a05b0 0x7f91940a2a70 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009df0 tx=0x7f91a0009260 comp rx=0 tx=0).stop 2023-12-01T01:03:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.588+0000 7f91b25cd700 1 -- 172.21.15.26:0/774202560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac073770 msgr2=0x7f91ac198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.588+0000 7f91b25cd700 1 --2- 172.21.15.26:0/774202560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac073770 0x7f91ac198da0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f919c0059d0 tx=0x7f919c00f690 comp rx=0 tx=0).stop 2023-12-01T01:03:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.588+0000 7f91b25cd700 1 -- 172.21.15.26:0/774202560 shutdown_connections 2023-12-01T01:03:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.588+0000 7f91b25cd700 1 --2- 172.21.15.26:0/774202560 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f91940a05b0 0x7f91940a2a70 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.588+0000 7f91b25cd700 1 --2- 172.21.15.26:0/774202560 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f91ac108cb0 0x7f91ac1a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.588+0000 7f91b25cd700 1 --2- 172.21.15.26:0/774202560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac073770 0x7f91ac198da0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.588+0000 7f91b25cd700 1 --2- 172.21.15.26:0/774202560 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f91ac074d50 0x7f91ac1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.589+0000 7f91b25cd700 1 -- 172.21.15.26:0/774202560 >> 172.21.15.26:0/774202560 conn(0x7f91ac0fc310 msgr2=0x7f91ac0fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.589+0000 7f91b25cd700 1 -- 172.21.15.26:0/774202560 shutdown_connections 2023-12-01T01:03:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.589+0000 7f91b25cd700 1 -- 172.21.15.26:0/774202560 wait complete. 2023-12-01T01:03:40.602 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T01:03:40.736 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.735+0000 7f95fa141700 1 -- 172.21.15.26:0/2356788322 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95f4100e70 msgr2=0x7f95f41012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:40.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.735+0000 7f95fa141700 1 --2- 172.21.15.26:0/2356788322 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95f4100e70 0x7f95f41012d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f95e80099c0 tx=0x7f95e8009cd0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.735+0000 7f95fa141700 1 -- 172.21.15.26:0/2356788322 shutdown_connections 2023-12-01T01:03:40.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.735+0000 7f95fa141700 1 --2- 172.21.15.26:0/2356788322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95f4101810 0x7f95f41080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.735+0000 7f95fa141700 1 --2- 172.21.15.26:0/2356788322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95f40ffc80 0x7f95f41000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.735+0000 7f95fa141700 1 --2- 172.21.15.26:0/2356788322 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95f4100e70 0x7f95f41012d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.735+0000 7f95fa141700 1 -- 172.21.15.26:0/2356788322 >> 172.21.15.26:0/2356788322 conn(0x7f95f40fb1f0 msgr2=0x7f95f40fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:40.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.735+0000 7f95fa141700 1 -- 172.21.15.26:0/2356788322 shutdown_connections 2023-12-01T01:03:40.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.735+0000 7f95fa141700 1 -- 172.21.15.26:0/2356788322 wait complete. 2023-12-01T01:03:40.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.736+0000 7f95fa141700 1 Processor -- start 2023-12-01T01:03:40.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.736+0000 7f95fa141700 1 -- start start 2023-12-01T01:03:40.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.736+0000 7f95fa141700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95f40ffc80 0x7f95f4195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:40.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.736+0000 7f95fa141700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95f4100e70 0x7f95f4195fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:40.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.736+0000 7f95fa141700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95f4101810 0x7f95f419d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:40.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.736+0000 7f95fa141700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f419d600 con 0x7f95f4101810 2023-12-01T01:03:40.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.736+0000 7f95fa141700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f419d740 con 0x7f95f40ffc80 2023-12-01T01:03:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.736+0000 7f95fa141700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f419d8d0 con 0x7f95f4100e70 2023-12-01T01:03:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.736+0000 7f95f3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95f4101810 0x7f95f419d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.736+0000 7f95f3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95f4101810 0x7f95f419d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54220/0 (socket says 172.21.15.26:54220) 2023-12-01T01:03:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.736+0000 7f95f3fff700 1 -- 172.21.15.26:0/2889351500 learned_addr learned my addr 172.21.15.26:0/2889351500 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.736+0000 7f95f37fe700 1 --2- 172.21.15.26:0/2889351500 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95f40ffc80 0x7f95f4195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.737+0000 7f95f2ffd700 1 --2- 172.21.15.26:0/2889351500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95f4100e70 0x7f95f4195fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.737+0000 7f95f3fff700 1 -- 172.21.15.26:0/2889351500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95f4100e70 msgr2=0x7f95f4195fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.737+0000 7f95f3fff700 1 --2- 172.21.15.26:0/2889351500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95f4100e70 0x7f95f4195fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.737+0000 7f95f3fff700 1 -- 172.21.15.26:0/2889351500 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95f40ffc80 msgr2=0x7f95f4195a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.737+0000 7f95f3fff700 1 --2- 172.21.15.26:0/2889351500 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95f40ffc80 0x7f95f4195a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.737+0000 7f95f3fff700 1 -- 172.21.15.26:0/2889351500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e80095f0 con 0x7f95f4101810 2023-12-01T01:03:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.737+0000 7f95f37fe700 1 --2- 172.21.15.26:0/2889351500 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95f40ffc80 0x7f95f4195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:03:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.737+0000 7f95f3fff700 1 --2- 172.21.15.26:0/2889351500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95f4101810 0x7f95f419d030 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00c400 tx=0x7f95ec00c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.737+0000 7f95f0ff9700 1 -- 172.21.15.26:0/2889351500 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec004bb0 con 0x7f95f4101810 2023-12-01T01:03:40.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.737+0000 7f95fa141700 1 -- 172.21.15.26:0/2889351500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f4067ef0 con 0x7f95f4101810 2023-12-01T01:03:40.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.737+0000 7f95f0ff9700 1 -- 172.21.15.26:0/2889351500 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f95ec004d10 con 0x7f95f4101810 2023-12-01T01:03:40.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.737+0000 7f95f0ff9700 1 -- 172.21.15.26:0/2889351500 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec004440 con 0x7f95f4101810 2023-12-01T01:03:40.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.737+0000 7f95fa141700 1 -- 172.21.15.26:0/2889351500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f4068400 con 0x7f95f4101810 2023-12-01T01:03:40.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.738+0000 7f95fa141700 1 -- 172.21.15.26:0/2889351500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f410b620 con 0x7f95f4101810 2023-12-01T01:03:40.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.739+0000 7f95f0ff9700 1 -- 172.21.15.26:0/2889351500 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f95ec004600 con 0x7f95f4101810 2023-12-01T01:03:40.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.740+0000 7f95f0ff9700 1 --2- 172.21.15.26:0/2889351500 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f95dc0a05b0 0x7f95dc0a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:40.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.740+0000 7f95f0ff9700 1 -- 172.21.15.26:0/2889351500 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f95ec0cf520 con 0x7f95f4101810 2023-12-01T01:03:40.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.740+0000 7f95f37fe700 1 --2- 172.21.15.26:0/2889351500 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f95dc0a05b0 0x7f95dc0a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:40.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.740+0000 7f95f37fe700 1 --2- 172.21.15.26:0/2889351500 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f95dc0a05b0 0x7f95dc0a2a70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f95f4100cd0 tx=0x7f95e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:40.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.744+0000 7f95f0ff9700 1 -- 172.21.15.26:0/2889351500 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f95ec098f70 con 0x7f95f4101810 2023-12-01T01:03:40.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.946+0000 7f95fa141700 1 -- 172.21.15.26:0/2889351500 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f95f4068bf0 con 0x7f95f4101810 2023-12-01T01:03:40.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.946+0000 7f95f0ff9700 1 -- 172.21.15.26:0/2889351500 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f95ec0048b0 con 0x7f95f4101810 2023-12-01T01:03:40.947 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-12-01T01:03:40.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.948+0000 7f95fa141700 1 -- 172.21.15.26:0/2889351500 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f95dc0a05b0 msgr2=0x7f95dc0a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:40.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.948+0000 7f95fa141700 1 --2- 172.21.15.26:0/2889351500 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f95dc0a05b0 0x7f95dc0a2a70 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f95f4100cd0 tx=0x7f95e4009260 comp rx=0 tx=0).stop 2023-12-01T01:03:40.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.948+0000 7f95fa141700 1 -- 172.21.15.26:0/2889351500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95f4101810 msgr2=0x7f95f419d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:40.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.948+0000 7f95fa141700 1 --2- 172.21.15.26:0/2889351500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95f4101810 0x7f95f419d030 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00c400 tx=0x7f95ec00c710 comp rx=0 tx=0).stop 2023-12-01T01:03:40.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.948+0000 7f95fa141700 1 -- 172.21.15.26:0/2889351500 shutdown_connections 2023-12-01T01:03:40.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.948+0000 7f95fa141700 1 --2- 172.21.15.26:0/2889351500 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f95dc0a05b0 0x7f95dc0a2a70 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.948+0000 7f95fa141700 1 --2- 172.21.15.26:0/2889351500 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95f4101810 0x7f95f419d030 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.948+0000 7f95fa141700 1 --2- 172.21.15.26:0/2889351500 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f95f40ffc80 0x7f95f4195a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.948+0000 7f95fa141700 1 --2- 172.21.15.26:0/2889351500 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f95f4100e70 0x7f95f4195fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:40.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.948+0000 7f95fa141700 1 -- 172.21.15.26:0/2889351500 >> 172.21.15.26:0/2889351500 conn(0x7f95f40fb1f0 msgr2=0x7f95f40fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:40.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.948+0000 7f95fa141700 1 -- 172.21.15.26:0/2889351500 shutdown_connections 2023-12-01T01:03:40.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:40.948+0000 7f95fa141700 1 -- 172.21.15.26:0/2889351500 wait complete. 2023-12-01T01:03:40.961 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:40 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2609340565' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:03:40.961 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:40 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2065094528' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:03:40.961 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:40 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/774202560' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:03:40.962 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:03:41.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 -- 172.21.15.26:0/1208166202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd70c0ffca0 msgr2=0x7fd70c1000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:41.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 --2- 172.21.15.26:0/1208166202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd70c0ffca0 0x7fd70c1000c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd7080099c0 tx=0x7fd708009cd0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 -- 172.21.15.26:0/1208166202 shutdown_connections 2023-12-01T01:03:41.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 --2- 172.21.15.26:0/1208166202 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd70c101830 0x7fd70c1080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.089 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 --2- 172.21.15.26:0/1208166202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd70c0ffca0 0x7fd70c1000c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 --2- 172.21.15.26:0/1208166202 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd70c100e90 0x7fd70c1012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 -- 172.21.15.26:0/1208166202 >> 172.21.15.26:0/1208166202 conn(0x7fd70c0fb210 msgr2=0x7fd70c0fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 -- 172.21.15.26:0/1208166202 shutdown_connections 2023-12-01T01:03:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 -- 172.21.15.26:0/1208166202 wait complete. 2023-12-01T01:03:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 Processor -- start 2023-12-01T01:03:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 -- start start 2023-12-01T01:03:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd70c0ffca0 0x7fd70c196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd70c100e90 0x7fd70c197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd70c101830 0x7fd70c19e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c19e660 con 0x7fd70c0ffca0 2023-12-01T01:03:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c19e7a0 con 0x7fd70c100e90 2023-12-01T01:03:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.086+0000 7fd7142b0700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c19e930 con 0x7fd70c101830 2023-12-01T01:03:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.087+0000 7fd71204c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd70c0ffca0 0x7fd70c196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.087+0000 7fd71204c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd70c0ffca0 0x7fd70c196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54228/0 (socket says 172.21.15.26:54228) 2023-12-01T01:03:41.090 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.087+0000 7fd71204c700 1 -- 172.21.15.26:0/81867115 learned_addr learned my addr 172.21.15.26:0/81867115 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.087+0000 7fd71284d700 1 --2- 172.21.15.26:0/81867115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd70c101830 0x7fd70c19e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.087+0000 7fd71184b700 1 --2- 172.21.15.26:0/81867115 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd70c100e90 0x7fd70c197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.087+0000 7fd71204c700 1 -- 172.21.15.26:0/81867115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd70c101830 msgr2=0x7fd70c19e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.087+0000 7fd71204c700 1 --2- 172.21.15.26:0/81867115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd70c101830 0x7fd70c19e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.087+0000 7fd71204c700 1 -- 172.21.15.26:0/81867115 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd70c100e90 msgr2=0x7fd70c197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.087+0000 7fd71204c700 1 --2- 172.21.15.26:0/81867115 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd70c100e90 0x7fd70c197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.087+0000 7fd71204c700 1 -- 172.21.15.26:0/81867115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7080095f0 con 0x7fd70c0ffca0 2023-12-01T01:03:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.087+0000 7fd71204c700 1 --2- 172.21.15.26:0/81867115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd70c0ffca0 0x7fd70c196ae0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd7080098e0 tx=0x7fd70800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.087+0000 7fd7037fe700 1 -- 172.21.15.26:0/81867115 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70801d070 con 0x7fd70c0ffca0 2023-12-01T01:03:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.087+0000 7fd7037fe700 1 -- 172.21.15.26:0/81867115 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd708005030 con 0x7fd70c0ffca0 2023-12-01T01:03:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.087+0000 7fd7037fe700 1 -- 172.21.15.26:0/81867115 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708004ba0 con 0x7fd70c0ffca0 2023-12-01T01:03:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.087+0000 7fd7142b0700 1 -- 172.21.15.26:0/81867115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c19ebb0 con 0x7fd70c0ffca0 2023-12-01T01:03:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.087+0000 7fd7142b0700 1 -- 172.21.15.26:0/81867115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c19ef80 con 0x7fd70c0ffca0 2023-12-01T01:03:41.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.088+0000 7fd7142b0700 1 -- 172.21.15.26:0/81867115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c10b640 con 0x7fd70c0ffca0 2023-12-01T01:03:41.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.089+0000 7fd7037fe700 1 -- 172.21.15.26:0/81867115 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fd708004d00 con 0x7fd70c0ffca0 2023-12-01T01:03:41.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.090+0000 7fd7037fe700 1 --2- 172.21.15.26:0/81867115 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd6f80a0670 0x7fd6f80a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:41.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.090+0000 7fd7037fe700 1 -- 172.21.15.26:0/81867115 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd7080ccc50 con 0x7fd70c0ffca0 2023-12-01T01:03:41.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.090+0000 7fd71184b700 1 --2- 172.21.15.26:0/81867115 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd6f80a0670 0x7fd6f80a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:41.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.090+0000 7fd71184b700 1 --2- 172.21.15.26:0/81867115 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd6f80a0670 0x7fd6f80a2b30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009c60 tx=0x7fd6fc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:41.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.093+0000 7fd7037fe700 1 -- 172.21.15.26:0/81867115 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd708096730 con 0x7fd70c0ffca0 2023-12-01T01:03:41.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:40 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2609340565' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:03:41.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:40 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2065094528' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:03:41.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:40 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/774202560' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:03:41.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:40 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2609340565' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:03:41.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:40 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2065094528' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:03:41.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:40 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/774202560' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:03:41.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.340+0000 7fd7142b0700 1 -- 172.21.15.26:0/81867115 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd70c19f530 con 0x7fd70c0ffca0 2023-12-01T01:03:41.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.340+0000 7fd7037fe700 1 -- 172.21.15.26:0/81867115 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10777 (secure 0 0 0) 0x7fd7080051a0 con 0x7fd70c0ffca0 2023-12-01T01:03:41.341 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:03:41.342 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6841/3515135915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6840","nonce":3515135915},{"type":"v1","addr":"172.21.15.26:6841","nonce":3515135915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-01T01:02:47.252972+0000","modified":"2023-12-01T01:02:52.326753+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24493,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.93:6837/3333520218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3333520218},{"type":"v1","addr":"172.21.15.93:6837","nonce":3333520218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6839/3364532241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":3364532241},{"type":"v1","addr":"172.21.15.93:6839","nonce":3364532241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T01:03:41.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.342+0000 7fd7142b0700 1 -- 172.21.15.26:0/81867115 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd6f80a0670 msgr2=0x7fd6f80a2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:41.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.342+0000 7fd7142b0700 1 --2- 172.21.15.26:0/81867115 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd6f80a0670 0x7fd6f80a2b30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009c60 tx=0x7fd6fc009260 comp rx=0 tx=0).stop 2023-12-01T01:03:41.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.342+0000 7fd7142b0700 1 -- 172.21.15.26:0/81867115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd70c0ffca0 msgr2=0x7fd70c196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:41.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.342+0000 7fd7142b0700 1 --2- 172.21.15.26:0/81867115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd70c0ffca0 0x7fd70c196ae0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd7080098e0 tx=0x7fd70800f690 comp rx=0 tx=0).stop 2023-12-01T01:03:41.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.343+0000 7fd7142b0700 1 -- 172.21.15.26:0/81867115 shutdown_connections 2023-12-01T01:03:41.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.343+0000 7fd7142b0700 1 --2- 172.21.15.26:0/81867115 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd6f80a0670 0x7fd6f80a2b30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.343+0000 7fd7142b0700 1 --2- 172.21.15.26:0/81867115 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd70c101830 0x7fd70c19e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.343+0000 7fd7142b0700 1 --2- 172.21.15.26:0/81867115 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd70c0ffca0 0x7fd70c196ae0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.343+0000 7fd7142b0700 1 --2- 172.21.15.26:0/81867115 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd70c100e90 0x7fd70c197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.343+0000 7fd7142b0700 1 -- 172.21.15.26:0/81867115 >> 172.21.15.26:0/81867115 conn(0x7fd70c0fb210 msgr2=0x7fd70c069130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:41.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.343+0000 7fd7142b0700 1 -- 172.21.15.26:0/81867115 shutdown_connections 2023-12-01T01:03:41.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.343+0000 7fd7142b0700 1 -- 172.21.15.26:0/81867115 wait complete. 2023-12-01T01:03:41.345 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 23 2023-12-01T01:03:41.357 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:03:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.482+0000 7f0e0544a700 1 -- 172.21.15.26:0/1301649209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e000fee20 msgr2=0x7f0e000ff2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.482+0000 7f0e0544a700 1 --2- 172.21.15.26:0/1301649209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e000fee20 0x7f0e000ff2a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0df4009990 tx=0x7f0df4009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.482+0000 7f0e0544a700 1 -- 172.21.15.26:0/1301649209 shutdown_connections 2023-12-01T01:03:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.482+0000 7f0e0544a700 1 --2- 172.21.15.26:0/1301649209 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e000ff7e0 0x7f0e00109390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.482+0000 7f0e0544a700 1 --2- 172.21.15.26:0/1301649209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e001023b0 0x7f0e001027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.482+0000 7f0e0544a700 1 --2- 172.21.15.26:0/1301649209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e000fee20 0x7f0e000ff2a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.482+0000 7f0e0544a700 1 -- 172.21.15.26:0/1301649209 >> 172.21.15.26:0/1301649209 conn(0x7f0e000fa9a0 msgr2=0x7f0e000fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.482+0000 7f0e0544a700 1 -- 172.21.15.26:0/1301649209 shutdown_connections 2023-12-01T01:03:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.482+0000 7f0e0544a700 1 -- 172.21.15.26:0/1301649209 wait complete. 2023-12-01T01:03:41.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.483+0000 7f0e0544a700 1 Processor -- start 2023-12-01T01:03:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.483+0000 7f0e0544a700 1 -- start start 2023-12-01T01:03:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.483+0000 7f0e0544a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e000fee20 0x7f0e00194910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:41.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.483+0000 7f0e0544a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e000ff7e0 0x7f0e00194e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.483+0000 7f0e0544a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e001023b0 0x7f0e0019bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.483+0000 7f0e0544a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0019c490 con 0x7f0e001023b0 2023-12-01T01:03:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.483+0000 7f0e0544a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0019c5d0 con 0x7f0e000ff7e0 2023-12-01T01:03:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.483+0000 7f0e0544a700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0019c760 con 0x7f0e000fee20 2023-12-01T01:03:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.483+0000 7f0dff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e001023b0 0x7f0e0019bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.484+0000 7f0dff7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e001023b0 0x7f0e0019bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54246/0 (socket says 172.21.15.26:54246) 2023-12-01T01:03:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.484+0000 7f0dff7fe700 1 -- 172.21.15.26:0/945203120 learned_addr learned my addr 172.21.15.26:0/945203120 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.484+0000 7f0dfeffd700 1 --2- 172.21.15.26:0/945203120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e000fee20 0x7f0e00194910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.484+0000 7f0dfe7fc700 1 --2- 172.21.15.26:0/945203120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e000ff7e0 0x7f0e00194e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.484+0000 7f0dff7fe700 1 -- 172.21.15.26:0/945203120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e000fee20 msgr2=0x7f0e00194910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.484+0000 7f0dff7fe700 1 --2- 172.21.15.26:0/945203120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e000fee20 0x7f0e00194910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.484+0000 7f0dff7fe700 1 -- 172.21.15.26:0/945203120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e000ff7e0 msgr2=0x7f0e00194e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.484+0000 7f0dff7fe700 1 --2- 172.21.15.26:0/945203120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e000ff7e0 0x7f0e00194e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.484+0000 7f0dff7fe700 1 -- 172.21.15.26:0/945203120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df40095f0 con 0x7f0e001023b0 2023-12-01T01:03:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.484+0000 7f0dff7fe700 1 --2- 172.21.15.26:0/945203120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e001023b0 0x7f0e0019bec0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0df800ef30 tx=0x7f0df800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.484+0000 7f0de7fff700 1 -- 172.21.15.26:0/945203120 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df8018070 con 0x7f0e001023b0 2023-12-01T01:03:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.484+0000 7f0e0544a700 1 -- 172.21.15.26:0/945203120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0019c9e0 con 0x7f0e001023b0 2023-12-01T01:03:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.484+0000 7f0de7fff700 1 -- 172.21.15.26:0/945203120 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0df800f040 con 0x7f0e001023b0 2023-12-01T01:03:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.484+0000 7f0de7fff700 1 -- 172.21.15.26:0/945203120 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df800ce00 con 0x7f0e001023b0 2023-12-01T01:03:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.484+0000 7f0e0544a700 1 -- 172.21.15.26:0/945203120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0019cea0 con 0x7f0e001023b0 2023-12-01T01:03:41.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.485+0000 7f0e0544a700 1 -- 172.21.15.26:0/945203120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e00108460 con 0x7f0e001023b0 2023-12-01T01:03:41.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.486+0000 7f0de7fff700 1 -- 172.21.15.26:0/945203120 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f0df8003a00 con 0x7f0e001023b0 2023-12-01T01:03:41.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.487+0000 7f0de7fff700 1 --2- 172.21.15.26:0/945203120 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0de80a05f0 0x7f0de80a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:41.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.487+0000 7f0dfeffd700 1 --2- 172.21.15.26:0/945203120 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0de80a05f0 0x7f0de80a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:41.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.487+0000 7f0de7fff700 1 -- 172.21.15.26:0/945203120 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0df80cb770 con 0x7f0e001023b0 2023-12-01T01:03:41.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.487+0000 7f0dfeffd700 1 --2- 172.21.15.26:0/945203120 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0de80a05f0 0x7f0de80a2ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0e00068eb0 tx=0x7f0df000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.491+0000 7f0de7fff700 1 -- 172.21.15.26:0/945203120 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0df80951f0 con 0x7f0e001023b0 2023-12-01T01:03:41.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.693+0000 7f0e0544a700 1 -- 172.21.15.26:0/945203120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e0002cee0 con 0x7f0e001023b0 2023-12-01T01:03:41.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.694+0000 7f0de7fff700 1 -- 172.21.15.26:0/945203120 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22481 (secure 0 0 0) 0x7f0df8098810 con 0x7f0e001023b0 2023-12-01T01:03:41.696 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:03:41.696 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":83,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:59.627676+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:03:41.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.697+0000 7f0e0544a700 1 -- 172.21.15.26:0/945203120 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0de80a05f0 msgr2=0x7f0de80a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:41.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.697+0000 7f0e0544a700 1 --2- 172.21.15.26:0/945203120 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0de80a05f0 0x7f0de80a2ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0e00068eb0 tx=0x7f0df000b410 comp rx=0 tx=0).stop 2023-12-01T01:03:41.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.697+0000 7f0e0544a700 1 -- 172.21.15.26:0/945203120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e001023b0 msgr2=0x7f0e0019bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:41.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.697+0000 7f0e0544a700 1 --2- 172.21.15.26:0/945203120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e001023b0 0x7f0e0019bec0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0df800ef30 tx=0x7f0df800c3a0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.697+0000 7f0e0544a700 1 -- 172.21.15.26:0/945203120 shutdown_connections 2023-12-01T01:03:41.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.697+0000 7f0e0544a700 1 --2- 172.21.15.26:0/945203120 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0de80a05f0 0x7f0de80a2ab0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.697+0000 7f0e0544a700 1 --2- 172.21.15.26:0/945203120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e001023b0 0x7f0e0019bec0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.697+0000 7f0e0544a700 1 --2- 172.21.15.26:0/945203120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0e000fee20 0x7f0e00194910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.697+0000 7f0e0544a700 1 --2- 172.21.15.26:0/945203120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0e000ff7e0 0x7f0e00194e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.697+0000 7f0e0544a700 1 -- 172.21.15.26:0/945203120 >> 172.21.15.26:0/945203120 conn(0x7f0e000fa9a0 msgr2=0x7f0e001055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:41.699 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.697+0000 7f0e0544a700 1 -- 172.21.15.26:0/945203120 shutdown_connections 2023-12-01T01:03:41.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.697+0000 7f0e0544a700 1 -- 172.21.15.26:0/945203120 wait complete. 2023-12-01T01:03:41.711 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T00:59:06.411348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T01:02:45.762784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T01:02:46.638998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T01:03:41.711 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T01:03:41.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.840+0000 7f8733408700 1 -- 172.21.15.26:0/4094956900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c102980 msgr2=0x7f872c109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:41.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.840+0000 7f8733408700 1 --2- 172.21.15.26:0/4094956900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c102980 0x7f872c109230 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f872400b0d0 tx=0x7f872400b3e0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.840+0000 7f8733408700 1 -- 172.21.15.26:0/4094956900 shutdown_connections 2023-12-01T01:03:41.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.840+0000 7f8733408700 1 --2- 172.21.15.26:0/4094956900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c102980 0x7f872c109230 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.840+0000 7f8733408700 1 --2- 172.21.15.26:0/4094956900 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f872c100df0 0x7f872c101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.840+0000 7f8733408700 1 --2- 172.21.15.26:0/4094956900 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f872c101fe0 0x7f872c102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.840+0000 7f8733408700 1 -- 172.21.15.26:0/4094956900 >> 172.21.15.26:0/4094956900 conn(0x7f872c0fc360 msgr2=0x7f872c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:41.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.840+0000 7f8733408700 1 -- 172.21.15.26:0/4094956900 shutdown_connections 2023-12-01T01:03:41.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.840+0000 7f8733408700 1 -- 172.21.15.26:0/4094956900 wait complete. 2023-12-01T01:03:41.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.841+0000 7f8733408700 1 Processor -- start 2023-12-01T01:03:41.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.841+0000 7f8733408700 1 -- start start 2023-12-01T01:03:41.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.841+0000 7f8733408700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f872c100df0 0x7f872c196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:41.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.841+0000 7f8733408700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f872c101fe0 0x7f872c1970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:41.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.841+0000 7f8733408700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c102980 0x7f872c19e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:41.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.841+0000 7f8733408700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c19e700 con 0x7f872c102980 2023-12-01T01:03:41.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.841+0000 7f8733408700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c19e840 con 0x7f872c100df0 2023-12-01T01:03:41.844 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.841+0000 7f8733408700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872c19e9d0 con 0x7f872c101fe0 2023-12-01T01:03:41.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.841+0000 7f87319a5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c102980 0x7f872c19e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:41.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.841+0000 7f87319a5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c102980 0x7f872c19e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54260/0 (socket says 172.21.15.26:54260) 2023-12-01T01:03:41.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.841+0000 7f87319a5700 1 -- 172.21.15.26:0/3310761898 learned_addr learned my addr 172.21.15.26:0/3310761898 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:41.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.841+0000 7f87311a4700 1 --2- 172.21.15.26:0/3310761898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f872c100df0 0x7f872c196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:41.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.842+0000 7f87309a3700 1 --2- 172.21.15.26:0/3310761898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f872c101fe0 0x7f872c1970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:41.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.842+0000 7f87319a5700 1 -- 172.21.15.26:0/3310761898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f872c101fe0 msgr2=0x7f872c1970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:41.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.842+0000 7f87319a5700 1 --2- 172.21.15.26:0/3310761898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f872c101fe0 0x7f872c1970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.842+0000 7f87319a5700 1 -- 172.21.15.26:0/3310761898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f872c100df0 msgr2=0x7f872c196b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:41.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.842+0000 7f87319a5700 1 --2- 172.21.15.26:0/3310761898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f872c100df0 0x7f872c196b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:41.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.842+0000 7f87319a5700 1 -- 172.21.15.26:0/3310761898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8724009d00 con 0x7f872c102980 2023-12-01T01:03:41.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.842+0000 7f87319a5700 1 --2- 172.21.15.26:0/3310761898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c102980 0x7f872c19e130 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8724007b60 tx=0x7f8724009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:41.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.842+0000 7f87227fc700 1 -- 172.21.15.26:0/3310761898 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872400e040 con 0x7f872c102980 2023-12-01T01:03:41.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.842+0000 7f87227fc700 1 -- 172.21.15.26:0/3310761898 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8724003e10 con 0x7f872c102980 2023-12-01T01:03:41.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.842+0000 7f8733408700 1 -- 172.21.15.26:0/3310761898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872c19ec50 con 0x7f872c102980 2023-12-01T01:03:41.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.842+0000 7f87227fc700 1 -- 172.21.15.26:0/3310761898 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87240055b0 con 0x7f872c102980 2023-12-01T01:03:41.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.842+0000 7f8733408700 1 -- 172.21.15.26:0/3310761898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872c19f0d0 con 0x7f872c102980 2023-12-01T01:03:41.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.843+0000 7f8733408700 1 -- 172.21.15.26:0/3310761898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f872c10c6e0 con 0x7f872c102980 2023-12-01T01:03:41.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.844+0000 7f87227fc700 1 -- 172.21.15.26:0/3310761898 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f872401bc30 con 0x7f872c102980 2023-12-01T01:03:41.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.845+0000 7f87227fc700 1 --2- 172.21.15.26:0/3310761898 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f87180a05b0 0x7f87180a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:41.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.845+0000 7f87227fc700 1 -- 172.21.15.26:0/3310761898 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f87240cd920 con 0x7f872c102980 2023-12-01T01:03:41.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.845+0000 7f87311a4700 1 --2- 172.21.15.26:0/3310761898 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f87180a05b0 0x7f87180a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:41.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.845+0000 7f87311a4700 1 --2- 172.21.15.26:0/3310761898 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f87180a05b0 0x7f87180a2a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f872c101e40 tx=0x7f871c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:41.849 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:41.848+0000 7f87227fc700 1 -- 172.21.15.26:0/3310761898 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8724097400 con 0x7f872c102980 2023-12-01T01:03:42.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:41 smithi026 ceph-mon[98801]: pgmap v274: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-01T01:03:42.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:41 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2889351500' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:03:42.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:41 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/81867115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:03:42.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:41 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/945203120' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:03:42.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.050+0000 7f8733408700 1 -- 172.21.15.26:0/3310761898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f872c107b90 con 0x7f872c102980 2023-12-01T01:03:42.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.050+0000 7f87227fc700 1 -- 172.21.15.26:0/3310761898 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f872409aa20 con 0x7f872c102980 2023-12-01T01:03:42.052 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-12-01T01:03:42.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.052+0000 7f8733408700 1 -- 172.21.15.26:0/3310761898 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f87180a05b0 msgr2=0x7f87180a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:42.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.052+0000 7f8733408700 1 --2- 172.21.15.26:0/3310761898 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f87180a05b0 0x7f87180a2a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f872c101e40 tx=0x7f871c00a380 comp rx=0 tx=0).stop 2023-12-01T01:03:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.052+0000 7f8733408700 1 -- 172.21.15.26:0/3310761898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c102980 msgr2=0x7f872c19e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.052+0000 7f8733408700 1 --2- 172.21.15.26:0/3310761898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c102980 0x7f872c19e130 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8724007b60 tx=0x7f8724009380 comp rx=0 tx=0).stop 2023-12-01T01:03:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.052+0000 7f8733408700 1 -- 172.21.15.26:0/3310761898 shutdown_connections 2023-12-01T01:03:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.052+0000 7f8733408700 1 --2- 172.21.15.26:0/3310761898 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f87180a05b0 0x7f87180a2a70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.052+0000 7f8733408700 1 --2- 172.21.15.26:0/3310761898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f872c102980 0x7f872c19e130 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.052+0000 7f8733408700 1 --2- 172.21.15.26:0/3310761898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f872c100df0 0x7f872c196b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.052+0000 7f8733408700 1 --2- 172.21.15.26:0/3310761898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f872c101fe0 0x7f872c1970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.052+0000 7f8733408700 1 -- 172.21.15.26:0/3310761898 >> 172.21.15.26:0/3310761898 conn(0x7f872c0fc360 msgr2=0x7f872c0fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.052+0000 7f8733408700 1 -- 172.21.15.26:0/3310761898 shutdown_connections 2023-12-01T01:03:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.052+0000 7f8733408700 1 -- 172.21.15.26:0/3310761898 wait complete. 2023-12-01T01:03:42.066 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T01:03:42.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:41 smithi116 ceph-mon[103554]: pgmap v274: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-01T01:03:42.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:41 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2889351500' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:03:42.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:41 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/81867115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:03:42.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:41 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/945203120' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:03:42.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.193+0000 7f243125d700 1 -- 172.21.15.26:0/2360870457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f242c100e70 msgr2=0x7f242c1012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:42.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.193+0000 7f243125d700 1 --2- 172.21.15.26:0/2360870457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f242c100e70 0x7f242c1012d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f241c0099c0 tx=0x7f241c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.193+0000 7f243125d700 1 -- 172.21.15.26:0/2360870457 shutdown_connections 2023-12-01T01:03:42.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.193+0000 7f243125d700 1 --2- 172.21.15.26:0/2360870457 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f242c101810 0x7f242c1080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.193+0000 7f243125d700 1 --2- 172.21.15.26:0/2360870457 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f242c0ffc80 0x7f242c1000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.193+0000 7f243125d700 1 --2- 172.21.15.26:0/2360870457 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f242c100e70 0x7f242c1012d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.193+0000 7f243125d700 1 -- 172.21.15.26:0/2360870457 >> 172.21.15.26:0/2360870457 conn(0x7f242c0fb1f0 msgr2=0x7f242c0fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:42.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.193+0000 7f243125d700 1 -- 172.21.15.26:0/2360870457 shutdown_connections 2023-12-01T01:03:42.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.193+0000 7f243125d700 1 -- 172.21.15.26:0/2360870457 wait complete. 2023-12-01T01:03:42.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.193+0000 7f243125d700 1 Processor -- start 2023-12-01T01:03:42.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f243125d700 1 -- start start 2023-12-01T01:03:42.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f243125d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f242c0ffc80 0x7f242c068a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:42.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f243125d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f242c100e70 0x7f242c19b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:42.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f243125d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f242c101810 0x7f242c19df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:42.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f243125d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c19e700 con 0x7f242c0ffc80 2023-12-01T01:03:42.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f243125d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c19e870 con 0x7f242c100e70 2023-12-01T01:03:42.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f243125d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c19ea30 con 0x7f242c101810 2023-12-01T01:03:42.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f242ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f242c0ffc80 0x7f242c068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:42.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f242ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f242c0ffc80 0x7f242c068a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54270/0 (socket says 172.21.15.26:54270) 2023-12-01T01:03:42.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f242ad9d700 1 -- 172.21.15.26:0/3744665665 learned_addr learned my addr 172.21.15.26:0/3744665665 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:42.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f242a59c700 1 --2- 172.21.15.26:0/3744665665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f242c100e70 0x7f242c19b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:42.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f242b59e700 1 --2- 172.21.15.26:0/3744665665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f242c101810 0x7f242c19df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:42.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f242ad9d700 1 -- 172.21.15.26:0/3744665665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f242c101810 msgr2=0x7f242c19df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:42.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f242ad9d700 1 --2- 172.21.15.26:0/3744665665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f242c101810 0x7f242c19df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f242ad9d700 1 -- 172.21.15.26:0/3744665665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f242c100e70 msgr2=0x7f242c19b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:42.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f242ad9d700 1 --2- 172.21.15.26:0/3744665665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f242c100e70 0x7f242c19b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f242ad9d700 1 -- 172.21.15.26:0/3744665665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c0095f0 con 0x7f242c0ffc80 2023-12-01T01:03:42.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.194+0000 7f242ad9d700 1 --2- 172.21.15.26:0/3744665665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f242c0ffc80 0x7f242c068a80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f241400e970 tx=0x7f241400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:42.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.195+0000 7f2423fff700 1 -- 172.21.15.26:0/3744665665 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414009790 con 0x7f242c0ffc80 2023-12-01T01:03:42.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.195+0000 7f243125d700 1 -- 172.21.15.26:0/3744665665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242c19ed10 con 0x7f242c0ffc80 2023-12-01T01:03:42.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.195+0000 7f2423fff700 1 -- 172.21.15.26:0/3744665665 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f241400ccc0 con 0x7f242c0ffc80 2023-12-01T01:03:42.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.195+0000 7f2423fff700 1 -- 172.21.15.26:0/3744665665 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414003d80 con 0x7f242c0ffc80 2023-12-01T01:03:42.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.195+0000 7f243125d700 1 -- 172.21.15.26:0/3744665665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242c19f190 con 0x7f242c0ffc80 2023-12-01T01:03:42.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.196+0000 7f243125d700 1 -- 172.21.15.26:0/3744665665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242c107210 con 0x7f242c0ffc80 2023-12-01T01:03:42.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.197+0000 7f2423fff700 1 -- 172.21.15.26:0/3744665665 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f241400c7e0 con 0x7f242c0ffc80 2023-12-01T01:03:42.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.197+0000 7f2423fff700 1 --2- 172.21.15.26:0/3744665665 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f24180a05b0 0x7f24180a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:42.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.197+0000 7f242a59c700 1 --2- 172.21.15.26:0/3744665665 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f24180a05b0 0x7f24180a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:42.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.197+0000 7f2423fff700 1 -- 172.21.15.26:0/3744665665 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2414014070 con 0x7f242c0ffc80 2023-12-01T01:03:42.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.198+0000 7f242a59c700 1 --2- 172.21.15.26:0/3744665665 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f24180a05b0 0x7f24180a2a70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f241c00b580 tx=0x7f241c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:42.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.202+0000 7f2423fff700 1 -- 172.21.15.26:0/3744665665 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2414095710 con 0x7f242c0ffc80 2023-12-01T01:03:42.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:41 smithi093 ceph-mon[103327]: pgmap v274: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-01T01:03:42.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:41 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2889351500' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:03:42.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:41 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/81867115' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:03:42.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:41 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/945203120' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:03:42.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.402+0000 7f243125d700 1 -- 172.21.15.26:0/3744665665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f242c10b690 con 0x7f242c0ffc80 2023-12-01T01:03:42.403 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.402+0000 7f2423fff700 1 -- 172.21.15.26:0/3744665665 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2414098d30 con 0x7f242c0ffc80 2023-12-01T01:03:42.403 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-12-01T01:03:42.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.405+0000 7f243125d700 1 -- 172.21.15.26:0/3744665665 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f24180a05b0 msgr2=0x7f24180a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:42.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.405+0000 7f243125d700 1 --2- 172.21.15.26:0/3744665665 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f24180a05b0 0x7f24180a2a70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f241c00b580 tx=0x7f241c0058e0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.405+0000 7f243125d700 1 -- 172.21.15.26:0/3744665665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f242c0ffc80 msgr2=0x7f242c068a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:42.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.405+0000 7f243125d700 1 --2- 172.21.15.26:0/3744665665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f242c0ffc80 0x7f242c068a80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f241400e970 tx=0x7f241400ec80 comp rx=0 tx=0).stop 2023-12-01T01:03:42.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.405+0000 7f243125d700 1 -- 172.21.15.26:0/3744665665 shutdown_connections 2023-12-01T01:03:42.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.405+0000 7f243125d700 1 --2- 172.21.15.26:0/3744665665 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f24180a05b0 0x7f24180a2a70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.405+0000 7f243125d700 1 --2- 172.21.15.26:0/3744665665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f242c101810 0x7f242c19df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.406 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.405+0000 7f243125d700 1 --2- 172.21.15.26:0/3744665665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f242c0ffc80 0x7f242c068a80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.405+0000 7f243125d700 1 --2- 172.21.15.26:0/3744665665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f242c100e70 0x7f242c19b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.405+0000 7f243125d700 1 -- 172.21.15.26:0/3744665665 >> 172.21.15.26:0/3744665665 conn(0x7f242c0fb1f0 msgr2=0x7f242c104350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:42.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.405+0000 7f243125d700 1 -- 172.21.15.26:0/3744665665 shutdown_connections 2023-12-01T01:03:42.407 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.405+0000 7f243125d700 1 -- 172.21.15.26:0/3744665665 wait complete. 2023-12-01T01:03:42.418 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T01:03:42.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.546+0000 7f93a863c700 1 -- 172.21.15.26:0/4209932624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93a00ffc80 msgr2=0x7f93a01000a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:42.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.546+0000 7f93a863c700 1 --2- 172.21.15.26:0/4209932624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93a00ffc80 0x7f93a01000a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f939c0099c0 tx=0x7f939c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.546+0000 7f93a863c700 1 -- 172.21.15.26:0/4209932624 shutdown_connections 2023-12-01T01:03:42.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.546+0000 7f93a863c700 1 --2- 172.21.15.26:0/4209932624 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f93a0101810 0x7f93a01080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.546+0000 7f93a863c700 1 --2- 172.21.15.26:0/4209932624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93a00ffc80 0x7f93a01000a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.546+0000 7f93a863c700 1 --2- 172.21.15.26:0/4209932624 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93a0100e70 0x7f93a01012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.550 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.546+0000 7f93a863c700 1 -- 172.21.15.26:0/4209932624 >> 172.21.15.26:0/4209932624 conn(0x7f93a00fb1f0 msgr2=0x7f93a00fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:42.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.547+0000 7f93a863c700 1 -- 172.21.15.26:0/4209932624 shutdown_connections 2023-12-01T01:03:42.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.547+0000 7f93a863c700 1 -- 172.21.15.26:0/4209932624 wait complete. 2023-12-01T01:03:42.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.547+0000 7f93a863c700 1 Processor -- start 2023-12-01T01:03:42.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.547+0000 7f93a863c700 1 -- start start 2023-12-01T01:03:42.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.547+0000 7f93a863c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f93a00ffc80 0x7f93a0103c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:42.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.547+0000 7f93a863c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93a0100e70 0x7f93a0102250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:42.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.547+0000 7f93a863c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93a0101810 0x7f93a0102790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:42.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.547+0000 7f93a863c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a0102f30 con 0x7f93a0100e70 2023-12-01T01:03:42.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.547+0000 7f93a863c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a01030a0 con 0x7f93a00ffc80 2023-12-01T01:03:42.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.547+0000 7f93a863c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a01a0bb0 con 0x7f93a0101810 2023-12-01T01:03:42.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.547+0000 7f93a5bd7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93a0100e70 0x7f93a0102250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:42.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.547+0000 7f93a5bd7700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93a0100e70 0x7f93a0102250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54286/0 (socket says 172.21.15.26:54286) 2023-12-01T01:03:42.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.547+0000 7f93a5bd7700 1 -- 172.21.15.26:0/999102027 learned_addr learned my addr 172.21.15.26:0/999102027 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:42.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.548+0000 7f93a63d8700 1 --2- 172.21.15.26:0/999102027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f93a00ffc80 0x7f93a0103c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:42.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.548+0000 7f93a6bd9700 1 --2- 172.21.15.26:0/999102027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93a0101810 0x7f93a0102790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:42.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.548+0000 7f93a5bd7700 1 -- 172.21.15.26:0/999102027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93a0101810 msgr2=0x7f93a0102790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:42.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.548+0000 7f93a5bd7700 1 --2- 172.21.15.26:0/999102027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93a0101810 0x7f93a0102790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.548+0000 7f93a5bd7700 1 -- 172.21.15.26:0/999102027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f93a00ffc80 msgr2=0x7f93a0103c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:42.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.548+0000 7f93a5bd7700 1 --2- 172.21.15.26:0/999102027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f93a00ffc80 0x7f93a0103c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.548+0000 7f93a5bd7700 1 -- 172.21.15.26:0/999102027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c0095f0 con 0x7f93a0100e70 2023-12-01T01:03:42.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.548+0000 7f93a5bd7700 1 --2- 172.21.15.26:0/999102027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93a0100e70 0x7f93a0102250 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f939400d950 tx=0x7f939400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:42.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.548+0000 7f93937fe700 1 -- 172.21.15.26:0/999102027 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9394009940 con 0x7f93a0100e70 2023-12-01T01:03:42.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.548+0000 7f93a863c700 1 -- 172.21.15.26:0/999102027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a01a0e90 con 0x7f93a0100e70 2023-12-01T01:03:42.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.548+0000 7f93937fe700 1 -- 172.21.15.26:0/999102027 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9394010460 con 0x7f93a0100e70 2023-12-01T01:03:42.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.548+0000 7f93937fe700 1 -- 172.21.15.26:0/999102027 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939400f620 con 0x7f93a0100e70 2023-12-01T01:03:42.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.548+0000 7f93a863c700 1 -- 172.21.15.26:0/999102027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a01a1360 con 0x7f93a0100e70 2023-12-01T01:03:42.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.549+0000 7f93a863c700 1 -- 172.21.15.26:0/999102027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a010b5d0 con 0x7f93a0100e70 2023-12-01T01:03:42.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.550+0000 7f93937fe700 1 -- 172.21.15.26:0/999102027 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f9394010960 con 0x7f93a0100e70 2023-12-01T01:03:42.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.551+0000 7f93937fe700 1 --2- 172.21.15.26:0/999102027 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f938c0a05b0 0x7f938c0a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:42.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.551+0000 7f93a63d8700 1 --2- 172.21.15.26:0/999102027 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f938c0a05b0 0x7f938c0a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:42.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.551+0000 7f93937fe700 1 -- 172.21.15.26:0/999102027 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f93940cbd70 con 0x7f93a0100e70 2023-12-01T01:03:42.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.551+0000 7f93a63d8700 1 --2- 172.21.15.26:0/999102027 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f938c0a05b0 0x7f938c0a2a70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f939c009990 tx=0x7f939c003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:42.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.554+0000 7f93937fe700 1 -- 172.21.15.26:0/999102027 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f93940957c0 con 0x7f93a0100e70 2023-12-01T01:03:42.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.756+0000 7f93a863c700 1 -- 172.21.15.26:0/999102027 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f93a01a19a0 con 0x7f93a0100e70 2023-12-01T01:03:42.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.756+0000 7f93937fe700 1 -- 172.21.15.26:0/999102027 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9394020020 con 0x7f93a0100e70 2023-12-01T01:03:42.757 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-12-01T01:03:42.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.758+0000 7f93a863c700 1 -- 172.21.15.26:0/999102027 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f938c0a05b0 msgr2=0x7f938c0a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:42.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.758+0000 7f93a863c700 1 --2- 172.21.15.26:0/999102027 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f938c0a05b0 0x7f938c0a2a70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f939c009990 tx=0x7f939c003680 comp rx=0 tx=0).stop 2023-12-01T01:03:42.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.758+0000 7f93a863c700 1 -- 172.21.15.26:0/999102027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93a0100e70 msgr2=0x7f93a0102250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:42.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.758+0000 7f93a863c700 1 --2- 172.21.15.26:0/999102027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93a0100e70 0x7f93a0102250 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f939400d950 tx=0x7f939400dc60 comp rx=0 tx=0).stop 2023-12-01T01:03:42.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.758+0000 7f93a863c700 1 -- 172.21.15.26:0/999102027 shutdown_connections 2023-12-01T01:03:42.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.758+0000 7f93a863c700 1 --2- 172.21.15.26:0/999102027 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f938c0a05b0 0x7f938c0a2a70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.758+0000 7f93a863c700 1 --2- 172.21.15.26:0/999102027 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f93a0101810 0x7f93a0102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.758+0000 7f93a863c700 1 --2- 172.21.15.26:0/999102027 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f93a00ffc80 0x7f93a0103c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.758+0000 7f93a863c700 1 --2- 172.21.15.26:0/999102027 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f93a0100e70 0x7f93a0102250 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.758+0000 7f93a863c700 1 -- 172.21.15.26:0/999102027 >> 172.21.15.26:0/999102027 conn(0x7f93a00fb1f0 msgr2=0x7f93a0067ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:42.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.758+0000 7f93a863c700 1 -- 172.21.15.26:0/999102027 shutdown_connections 2023-12-01T01:03:42.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.758+0000 7f93a863c700 1 -- 172.21.15.26:0/999102027 wait complete. 2023-12-01T01:03:42.772 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:03:42.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.898+0000 7fbb1649a700 1 -- 172.21.15.26:0/1706134454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb10101800 msgr2=0x7fbb101080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:42.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.898+0000 7fbb1649a700 1 --2- 172.21.15.26:0/1706134454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb10101800 0x7fbb101080b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800b0d0 tx=0x7fbb0800b3e0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.899 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.898+0000 7fbb1649a700 1 -- 172.21.15.26:0/1706134454 shutdown_connections 2023-12-01T01:03:42.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.898+0000 7fbb1649a700 1 --2- 172.21.15.26:0/1706134454 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb10101800 0x7fbb101080b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.898+0000 7fbb1649a700 1 --2- 172.21.15.26:0/1706134454 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb100ffc70 0x7fbb10100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.898+0000 7fbb1649a700 1 --2- 172.21.15.26:0/1706134454 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb10100e60 0x7fbb101012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.898+0000 7fbb1649a700 1 -- 172.21.15.26:0/1706134454 >> 172.21.15.26:0/1706134454 conn(0x7fbb100fb1c0 msgr2=0x7fbb100fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:42.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.898+0000 7fbb1649a700 1 -- 172.21.15.26:0/1706134454 shutdown_connections 2023-12-01T01:03:42.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.898+0000 7fbb1649a700 1 -- 172.21.15.26:0/1706134454 wait complete. 2023-12-01T01:03:42.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.899+0000 7fbb1649a700 1 Processor -- start 2023-12-01T01:03:42.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.899+0000 7fbb1649a700 1 -- start start 2023-12-01T01:03:42.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.899+0000 7fbb1649a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb100ffc70 0x7fbb10068a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:42.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.899+0000 7fbb1649a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb10100e60 0x7fbb1019b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:42.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.899+0000 7fbb1649a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb10101800 0x7fbb1019df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:42.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.899+0000 7fbb1649a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1019e700 con 0x7fbb10101800 2023-12-01T01:03:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.899+0000 7fbb1649a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1019e870 con 0x7fbb10100e60 2023-12-01T01:03:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.899+0000 7fbb1649a700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1019ea30 con 0x7fbb100ffc70 2023-12-01T01:03:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.899+0000 7fbb14a37700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb10101800 0x7fbb1019df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.899+0000 7fbb14a37700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb10101800 0x7fbb1019df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54302/0 (socket says 172.21.15.26:54302) 2023-12-01T01:03:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.899+0000 7fbb14a37700 1 -- 172.21.15.26:0/1097489887 learned_addr learned my addr 172.21.15.26:0/1097489887 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.900+0000 7fbb0f7fe700 1 --2- 172.21.15.26:0/1097489887 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb10100e60 0x7fbb1019b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.900+0000 7fbb0ffff700 1 --2- 172.21.15.26:0/1097489887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb100ffc70 0x7fbb10068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.900+0000 7fbb14a37700 1 -- 172.21.15.26:0/1097489887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb100ffc70 msgr2=0x7fbb10068a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.900+0000 7fbb14a37700 1 --2- 172.21.15.26:0/1097489887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb100ffc70 0x7fbb10068a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.900+0000 7fbb14a37700 1 -- 172.21.15.26:0/1097489887 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb10100e60 msgr2=0x7fbb1019b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.900+0000 7fbb14a37700 1 --2- 172.21.15.26:0/1097489887 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb10100e60 0x7fbb1019b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.900+0000 7fbb14a37700 1 -- 172.21.15.26:0/1097489887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb08009d00 con 0x7fbb10101800 2023-12-01T01:03:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.900+0000 7fbb14a37700 1 --2- 172.21.15.26:0/1097489887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb10101800 0x7fbb1019df30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009300 tx=0x7fbb08009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:42.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.900+0000 7fbb0d7fa700 1 -- 172.21.15.26:0/1097489887 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0800e040 con 0x7fbb10101800 2023-12-01T01:03:42.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.900+0000 7fbb1649a700 1 -- 172.21.15.26:0/1097489887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1019ecb0 con 0x7fbb10101800 2023-12-01T01:03:42.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.900+0000 7fbb0d7fa700 1 -- 172.21.15.26:0/1097489887 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbb08003e10 con 0x7fbb10101800 2023-12-01T01:03:42.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.900+0000 7fbb0d7fa700 1 -- 172.21.15.26:0/1097489887 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb080053b0 con 0x7fbb10101800 2023-12-01T01:03:42.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.900+0000 7fbb1649a700 1 -- 172.21.15.26:0/1097489887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1019f180 con 0x7fbb10101800 2023-12-01T01:03:42.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.901+0000 7fbb1649a700 1 -- 172.21.15.26:0/1097489887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb101070c0 con 0x7fbb10101800 2023-12-01T01:03:42.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.902+0000 7fbb0d7fa700 1 -- 172.21.15.26:0/1097489887 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fbb08005510 con 0x7fbb10101800 2023-12-01T01:03:42.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.903+0000 7fbb0d7fa700 1 --2- 172.21.15.26:0/1097489887 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbaf80a05f0 0x7fbaf80a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:42.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.903+0000 7fbb0ffff700 1 --2- 172.21.15.26:0/1097489887 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbaf80a05f0 0x7fbaf80a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:42.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.903+0000 7fbb0d7fa700 1 -- 172.21.15.26:0/1097489887 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbb080cd860 con 0x7fbb10101800 2023-12-01T01:03:42.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.903+0000 7fbb0ffff700 1 --2- 172.21.15.26:0/1097489887 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbaf80a05f0 0x7fbaf80a2ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbb10100cc0 tx=0x7fbb0000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:42.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:42.906+0000 7fbb0d7fa700 1 -- 172.21.15.26:0/1097489887 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fbb08097340 con 0x7fbb10101800 2023-12-01T01:03:43.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:42 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3310761898' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:03:43.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:42 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3744665665' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:03:43.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.154+0000 7fbb1649a700 1 -- 172.21.15.26:0/1097489887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb1002cc70 con 0x7fbb10101800 2023-12-01T01:03:43.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.155+0000 7fbb0d7fa700 1 -- 172.21.15.26:0/1097489887 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10777 (secure 0 0 0) 0x7fbb0809a960 con 0x7fbb10101800 2023-12-01T01:03:43.156 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:03:43.156 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6841/3515135915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6840","nonce":3515135915},{"type":"v1","addr":"172.21.15.26:6841","nonce":3515135915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-01T01:02:47.252972+0000","modified":"2023-12-01T01:02:52.326753+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24493,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.93:6837/3333520218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3333520218},{"type":"v1","addr":"172.21.15.93:6837","nonce":3333520218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6839/3364532241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":3364532241},{"type":"v1","addr":"172.21.15.93:6839","nonce":3364532241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T01:03:43.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.157+0000 7fbb1649a700 1 -- 172.21.15.26:0/1097489887 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbaf80a05f0 msgr2=0x7fbaf80a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:43.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.157+0000 7fbb1649a700 1 --2- 172.21.15.26:0/1097489887 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbaf80a05f0 0x7fbaf80a2ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbb10100cc0 tx=0x7fbb0000b410 comp rx=0 tx=0).stop 2023-12-01T01:03:43.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.157+0000 7fbb1649a700 1 -- 172.21.15.26:0/1097489887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb10101800 msgr2=0x7fbb1019df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:43.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.157+0000 7fbb1649a700 1 --2- 172.21.15.26:0/1097489887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb10101800 0x7fbb1019df30 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbb08009300 tx=0x7fbb08009330 comp rx=0 tx=0).stop 2023-12-01T01:03:43.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.157+0000 7fbb1649a700 1 -- 172.21.15.26:0/1097489887 shutdown_connections 2023-12-01T01:03:43.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.157+0000 7fbb1649a700 1 --2- 172.21.15.26:0/1097489887 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbaf80a05f0 0x7fbaf80a2ab0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.157+0000 7fbb1649a700 1 --2- 172.21.15.26:0/1097489887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb10101800 0x7fbb1019df30 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.157+0000 7fbb1649a700 1 --2- 172.21.15.26:0/1097489887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb100ffc70 0x7fbb10068a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.157+0000 7fbb1649a700 1 --2- 172.21.15.26:0/1097489887 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb10100e60 0x7fbb1019b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.157+0000 7fbb1649a700 1 -- 172.21.15.26:0/1097489887 >> 172.21.15.26:0/1097489887 conn(0x7fbb100fb1c0 msgr2=0x7fbb10104200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:43.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.158+0000 7fbb1649a700 1 -- 172.21.15.26:0/1097489887 shutdown_connections 2023-12-01T01:03:43.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.158+0000 7fbb1649a700 1 -- 172.21.15.26:0/1097489887 wait complete. 2023-12-01T01:03:43.160 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 23 2023-12-01T01:03:43.171 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:03:43.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:42 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3310761898' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:03:43.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:42 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3744665665' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:03:43.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:42 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3310761898' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:03:43.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:42 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3744665665' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:03:43.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.298+0000 7fc0fc6f2700 1 -- 172.21.15.26:0/3004140318 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f40ffcc0 msgr2=0x7fc0f41000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.298+0000 7fc0fc6f2700 1 --2- 172.21.15.26:0/3004140318 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f40ffcc0 0x7fc0f41000e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00099c0 tx=0x7fc0f0009cd0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.298+0000 7fc0fc6f2700 1 -- 172.21.15.26:0/3004140318 shutdown_connections 2023-12-01T01:03:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.298+0000 7fc0fc6f2700 1 --2- 172.21.15.26:0/3004140318 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0f4101850 0x7fc0f4108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.298+0000 7fc0fc6f2700 1 --2- 172.21.15.26:0/3004140318 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f40ffcc0 0x7fc0f41000e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.298+0000 7fc0fc6f2700 1 --2- 172.21.15.26:0/3004140318 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0f4100eb0 0x7fc0f4101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.298+0000 7fc0fc6f2700 1 -- 172.21.15.26:0/3004140318 >> 172.21.15.26:0/3004140318 conn(0x7fc0f40fb210 msgr2=0x7fc0f40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.298+0000 7fc0fc6f2700 1 -- 172.21.15.26:0/3004140318 shutdown_connections 2023-12-01T01:03:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.298+0000 7fc0fc6f2700 1 -- 172.21.15.26:0/3004140318 wait complete. 2023-12-01T01:03:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fc6f2700 1 Processor -- start 2023-12-01T01:03:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fc6f2700 1 -- start start 2023-12-01T01:03:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fc6f2700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0f40ffcc0 0x7fc0f4069a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:43.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fc6f2700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0f4100eb0 0x7fc0f419b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:43.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fc6f2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f4101850 0x7fc0f419de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:43.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fc6f2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f419e620 con 0x7fc0f4101850 2023-12-01T01:03:43.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fc6f2700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f419e790 con 0x7fc0f40ffcc0 2023-12-01T01:03:43.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fc6f2700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f419e950 con 0x7fc0f4100eb0 2023-12-01T01:03:43.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fac8f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f4101850 0x7fc0f419de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:43.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fac8f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f4101850 0x7fc0f419de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54316/0 (socket says 172.21.15.26:54316) 2023-12-01T01:03:43.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fac8f700 1 -- 172.21.15.26:0/3414114685 learned_addr learned my addr 172.21.15.26:0/3414114685 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:43.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0f9c8d700 1 --2- 172.21.15.26:0/3414114685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0f4100eb0 0x7fc0f419b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:43.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fa48e700 1 --2- 172.21.15.26:0/3414114685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0f40ffcc0 0x7fc0f4069a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:43.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fac8f700 1 -- 172.21.15.26:0/3414114685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0f4100eb0 msgr2=0x7fc0f419b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:43.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fac8f700 1 --2- 172.21.15.26:0/3414114685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0f4100eb0 0x7fc0f419b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fac8f700 1 -- 172.21.15.26:0/3414114685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0f40ffcc0 msgr2=0x7fc0f4069a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:43.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fac8f700 1 --2- 172.21.15.26:0/3414114685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0f40ffcc0 0x7fc0f4069a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.299+0000 7fc0fac8f700 1 -- 172.21.15.26:0/3414114685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f00095f0 con 0x7fc0f4101850 2023-12-01T01:03:43.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.300+0000 7fc0fac8f700 1 --2- 172.21.15.26:0/3414114685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f4101850 0x7fc0f419de80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec00ada0 tx=0x7fc0ec00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:43.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.300+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/3414114685 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec00f070 con 0x7fc0f4101850 2023-12-01T01:03:43.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.300+0000 7fc0fc6f2700 1 -- 172.21.15.26:0/3414114685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f419ec30 con 0x7fc0f4101850 2023-12-01T01:03:43.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.300+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/3414114685 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc0ec007b30 con 0x7fc0f4101850 2023-12-01T01:03:43.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.300+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/3414114685 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec0053c0 con 0x7fc0f4101850 2023-12-01T01:03:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.300+0000 7fc0fc6f2700 1 -- 172.21.15.26:0/3414114685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f419f140 con 0x7fc0f4101850 2023-12-01T01:03:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.301+0000 7fc0fc6f2700 1 -- 172.21.15.26:0/3414114685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f41071e0 con 0x7fc0f4101850 2023-12-01T01:03:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.302+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/3414114685 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fc0ec00c980 con 0x7fc0f4101850 2023-12-01T01:03:43.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.302+0000 7fc0eb7fe700 1 --2- 172.21.15.26:0/3414114685 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc0e00a05f0 0x7fc0e00a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.303+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/3414114685 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc0ec0cb4a0 con 0x7fc0f4101850 2023-12-01T01:03:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.303+0000 7fc0fa48e700 1 --2- 172.21.15.26:0/3414114685 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc0e00a05f0 0x7fc0e00a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.303+0000 7fc0fa48e700 1 --2- 172.21.15.26:0/3414114685 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc0e00a05f0 0x7fc0e00a2ab0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000b580 tx=0x7fc0f0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:43.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.306+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/3414114685 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc0ec094f20 con 0x7fc0f4101850 2023-12-01T01:03:43.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.510+0000 7fc0fc6f2700 1 -- 172.21.15.26:0/3414114685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0f402ce70 con 0x7fc0f4101850 2023-12-01T01:03:43.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.512+0000 7fc0eb7fe700 1 -- 172.21.15.26:0/3414114685 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22481 (secure 0 0 0) 0x7fc0ec098540 con 0x7fc0f4101850 2023-12-01T01:03:43.513 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:03:43.513 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":83,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:59.627676+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:03:43.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.514+0000 7fc0fc6f2700 1 -- 172.21.15.26:0/3414114685 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc0e00a05f0 msgr2=0x7fc0e00a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:43.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.514+0000 7fc0fc6f2700 1 --2- 172.21.15.26:0/3414114685 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc0e00a05f0 0x7fc0e00a2ab0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000b580 tx=0x7fc0f0005fb0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.514+0000 7fc0fc6f2700 1 -- 172.21.15.26:0/3414114685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f4101850 msgr2=0x7fc0f419de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:43.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.514+0000 7fc0fc6f2700 1 --2- 172.21.15.26:0/3414114685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f4101850 0x7fc0f419de80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec00ada0 tx=0x7fc0ec00c330 comp rx=0 tx=0).stop 2023-12-01T01:03:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.514+0000 7fc0fc6f2700 1 -- 172.21.15.26:0/3414114685 shutdown_connections 2023-12-01T01:03:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.514+0000 7fc0fc6f2700 1 --2- 172.21.15.26:0/3414114685 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc0e00a05f0 0x7fc0e00a2ab0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.514+0000 7fc0fc6f2700 1 --2- 172.21.15.26:0/3414114685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc0f4101850 0x7fc0f419de80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.514+0000 7fc0fc6f2700 1 --2- 172.21.15.26:0/3414114685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0f40ffcc0 0x7fc0f4069a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.514+0000 7fc0fc6f2700 1 --2- 172.21.15.26:0/3414114685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc0f4100eb0 0x7fc0f419b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.514+0000 7fc0fc6f2700 1 -- 172.21.15.26:0/3414114685 >> 172.21.15.26:0/3414114685 conn(0x7fc0f40fb210 msgr2=0x7fc0f4104320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.514+0000 7fc0fc6f2700 1 -- 172.21.15.26:0/3414114685 shutdown_connections 2023-12-01T01:03:43.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.514+0000 7fc0fc6f2700 1 -- 172.21.15.26:0/3414114685 wait complete. 2023-12-01T01:03:43.529 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:03:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.654+0000 7fe19debe700 1 -- 172.21.15.26:0/294472645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe198101800 msgr2=0x7fe1981080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.654+0000 7fe19debe700 1 --2- 172.21.15.26:0/294472645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe198101800 0x7fe1981080b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe19000b0d0 tx=0x7fe19000b3e0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.654+0000 7fe19debe700 1 -- 172.21.15.26:0/294472645 shutdown_connections 2023-12-01T01:03:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.654+0000 7fe19debe700 1 --2- 172.21.15.26:0/294472645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe198101800 0x7fe1981080b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.654+0000 7fe19debe700 1 --2- 172.21.15.26:0/294472645 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe1980ffc70 0x7fe198100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.654+0000 7fe19debe700 1 --2- 172.21.15.26:0/294472645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe198100e60 0x7fe1981012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.654+0000 7fe19debe700 1 -- 172.21.15.26:0/294472645 >> 172.21.15.26:0/294472645 conn(0x7fe1980fb1c0 msgr2=0x7fe1980fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.654+0000 7fe19debe700 1 -- 172.21.15.26:0/294472645 shutdown_connections 2023-12-01T01:03:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.654+0000 7fe19debe700 1 -- 172.21.15.26:0/294472645 wait complete. 2023-12-01T01:03:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.654+0000 7fe19debe700 1 Processor -- start 2023-12-01T01:03:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe19debe700 1 -- start start 2023-12-01T01:03:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe19debe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1980ffc70 0x7fe198103c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe19debe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe198100e60 0x7fe198102240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe19debe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe198101800 0x7fe198102780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe19debe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe198102f20 con 0x7fe1980ffc70 2023-12-01T01:03:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe19debe700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe198103090 con 0x7fe198100e60 2023-12-01T01:03:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe19debe700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1981a0c40 con 0x7fe198101800 2023-12-01T01:03:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe1977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1980ffc70 0x7fe198103c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe1977fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1980ffc70 0x7fe198103c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54326/0 (socket says 172.21.15.26:54326) 2023-12-01T01:03:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe1977fe700 1 -- 172.21.15.26:0/481839784 learned_addr learned my addr 172.21.15.26:0/481839784 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe197fff700 1 --2- 172.21.15.26:0/481839784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe198101800 0x7fe198102780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe196ffd700 1 --2- 172.21.15.26:0/481839784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe198100e60 0x7fe198102240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:43.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe1977fe700 1 -- 172.21.15.26:0/481839784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe198101800 msgr2=0x7fe198102780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:43.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe1977fe700 1 --2- 172.21.15.26:0/481839784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe198101800 0x7fe198102780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe1977fe700 1 -- 172.21.15.26:0/481839784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe198100e60 msgr2=0x7fe198102240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:43.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe1977fe700 1 --2- 172.21.15.26:0/481839784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe198100e60 0x7fe198102240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe1977fe700 1 -- 172.21.15.26:0/481839784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe190009d00 con 0x7fe1980ffc70 2023-12-01T01:03:43.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe196ffd700 1 --2- 172.21.15.26:0/481839784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe198100e60 0x7fe198102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:03:43.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.655+0000 7fe1977fe700 1 --2- 172.21.15.26:0/481839784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1980ffc70 0x7fe198103c00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00d980 tx=0x7fe18c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:43.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.656+0000 7fe194ff9700 1 -- 172.21.15.26:0/481839784 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c004020 con 0x7fe1980ffc70 2023-12-01T01:03:43.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.656+0000 7fe194ff9700 1 -- 172.21.15.26:0/481839784 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe18c009730 con 0x7fe1980ffc70 2023-12-01T01:03:43.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.656+0000 7fe19debe700 1 -- 172.21.15.26:0/481839784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1981a0f20 con 0x7fe1980ffc70 2023-12-01T01:03:43.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.656+0000 7fe194ff9700 1 -- 172.21.15.26:0/481839784 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c003be0 con 0x7fe1980ffc70 2023-12-01T01:03:43.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.656+0000 7fe19debe700 1 -- 172.21.15.26:0/481839784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1981a1340 con 0x7fe1980ffc70 2023-12-01T01:03:43.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.656+0000 7fe19debe700 1 -- 172.21.15.26:0/481839784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19810b640 con 0x7fe1980ffc70 2023-12-01T01:03:43.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.658+0000 7fe194ff9700 1 -- 172.21.15.26:0/481839784 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fe18c009ba0 con 0x7fe1980ffc70 2023-12-01T01:03:43.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.658+0000 7fe194ff9700 1 --2- 172.21.15.26:0/481839784 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe1800a05f0 0x7fe1800a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:43.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.659+0000 7fe196ffd700 1 --2- 172.21.15.26:0/481839784 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe1800a05f0 0x7fe1800a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:43.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.659+0000 7fe194ff9700 1 -- 172.21.15.26:0/481839784 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe18c0cbac0 con 0x7fe1980ffc70 2023-12-01T01:03:43.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.659+0000 7fe196ffd700 1 --2- 172.21.15.26:0/481839784 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe1800a05f0 0x7fe1800a2ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe188009cb0 tx=0x7fe188009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:43.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.662+0000 7fe194ff9700 1 -- 172.21.15.26:0/481839784 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe18c095510 con 0x7fe1980ffc70 2023-12-01T01:03:43.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:43 smithi026 ceph-mon[98801]: pgmap v275: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-01T01:03:43.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:43 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/999102027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:03:43.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:43 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1097489887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:03:43.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:43 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3414114685' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:03:43.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.913+0000 7fe19debe700 1 -- 172.21.15.26:0/481839784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe19810b830 con 0x7fe1980ffc70 2023-12-01T01:03:43.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.913+0000 7fe194ff9700 1 -- 172.21.15.26:0/481839784 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10777 (secure 0 0 0) 0x7fe18c098b30 con 0x7fe1980ffc70 2023-12-01T01:03:43.915 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:03:43.915 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6841/3515135915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6840","nonce":3515135915},{"type":"v1","addr":"172.21.15.26:6841","nonce":3515135915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-01T01:02:47.252972+0000","modified":"2023-12-01T01:02:52.326753+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24493,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.93:6837/3333520218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3333520218},{"type":"v1","addr":"172.21.15.93:6837","nonce":3333520218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6839/3364532241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":3364532241},{"type":"v1","addr":"172.21.15.93:6839","nonce":3364532241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T01:03:43.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.916+0000 7fe19debe700 1 -- 172.21.15.26:0/481839784 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe1800a05f0 msgr2=0x7fe1800a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:43.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.916+0000 7fe19debe700 1 --2- 172.21.15.26:0/481839784 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe1800a05f0 0x7fe1800a2ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe188009cb0 tx=0x7fe188009260 comp rx=0 tx=0).stop 2023-12-01T01:03:43.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.916+0000 7fe19debe700 1 -- 172.21.15.26:0/481839784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1980ffc70 msgr2=0x7fe198103c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:43.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.916+0000 7fe19debe700 1 --2- 172.21.15.26:0/481839784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1980ffc70 0x7fe198103c00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe18c00d980 tx=0x7fe18c00dc90 comp rx=0 tx=0).stop 2023-12-01T01:03:43.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.916+0000 7fe19debe700 1 -- 172.21.15.26:0/481839784 shutdown_connections 2023-12-01T01:03:43.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.916+0000 7fe19debe700 1 --2- 172.21.15.26:0/481839784 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe1800a05f0 0x7fe1800a2ab0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.916+0000 7fe19debe700 1 --2- 172.21.15.26:0/481839784 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe198101800 0x7fe198102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.916+0000 7fe19debe700 1 --2- 172.21.15.26:0/481839784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1980ffc70 0x7fe198103c00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.916+0000 7fe19debe700 1 --2- 172.21.15.26:0/481839784 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe198100e60 0x7fe198102240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:43.917 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.916+0000 7fe19debe700 1 -- 172.21.15.26:0/481839784 >> 172.21.15.26:0/481839784 conn(0x7fe1980fb1c0 msgr2=0x7fe198067f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:43.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.916+0000 7fe19debe700 1 -- 172.21.15.26:0/481839784 shutdown_connections 2023-12-01T01:03:43.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:43.916+0000 7fe19debe700 1 -- 172.21.15.26:0/481839784 wait complete. 2023-12-01T01:03:43.918 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 23 2023-12-01T01:03:43.930 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-12-01T01:02:47.252972+0000', 'modified': '2023-12-01T01:02:52.326753+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24509, 'mds_1': 24493, 'mds_2': 24481}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24448': {'gid': 24448, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.116:6835/1591216017', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6834', 'nonce': 1591216017}, {'type': 'v1', 'addr': '172.21.15.116:6835', 'nonce': 1591216017}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24460': {'gid': 24460, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.116:6837/1714302836', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6836', 'nonce': 1714302836}, {'type': 'v1', 'addr': '172.21.15.116:6837', 'nonce': 1714302836}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24479': {'gid': 24479, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.93:6837/3333520218', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6836', 'nonce': 3333520218}, {'type': 'v1', 'addr': '172.21.15.93:6837', 'nonce': 3333520218}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24481': {'gid': 24481, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.116:6839/261568108', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 261568108}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 261568108}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24493': {'gid': 24493, 'name': 'g', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.26:6839/1277894156', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6838', 'nonce': 1277894156}, {'type': 'v1', 'addr': '172.21.15.26:6839', 'nonce': 1277894156}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24509': {'gid': 24509, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.93:6839/3364532241', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6838', 'nonce': 3364532241}, {'type': 'v1', 'addr': '172.21.15.93:6839', 'nonce': 3364532241}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-01T01:03:43.930 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-12-01T01:03:43.930 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-12-01T01:03:44.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.056+0000 7f3fa6cf0700 1 -- 172.21.15.26:0/163153319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa0101840 msgr2=0x7f3fa01080f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.056+0000 7f3fa6cf0700 1 --2- 172.21.15.26:0/163153319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa0101840 0x7f3fa01080f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3f9800b0d0 tx=0x7f3f9800b3e0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.056+0000 7f3fa6cf0700 1 -- 172.21.15.26:0/163153319 shutdown_connections 2023-12-01T01:03:44.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.056+0000 7f3fa6cf0700 1 --2- 172.21.15.26:0/163153319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa0101840 0x7f3fa01080f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.056+0000 7f3fa6cf0700 1 --2- 172.21.15.26:0/163153319 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fa00ffcb0 0x7f3fa01000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.056+0000 7f3fa6cf0700 1 --2- 172.21.15.26:0/163153319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3fa0100ea0 0x7f3fa0101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.056+0000 7f3fa6cf0700 1 -- 172.21.15.26:0/163153319 >> 172.21.15.26:0/163153319 conn(0x7f3fa00fb220 msgr2=0x7f3fa00fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.056+0000 7f3fa6cf0700 1 -- 172.21.15.26:0/163153319 shutdown_connections 2023-12-01T01:03:44.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.056+0000 7f3fa6cf0700 1 -- 172.21.15.26:0/163153319 wait complete. 2023-12-01T01:03:44.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.056+0000 7f3fa6cf0700 1 Processor -- start 2023-12-01T01:03:44.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.056+0000 7f3fa6cf0700 1 -- start start 2023-12-01T01:03:44.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3fa6cf0700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3fa00ffcb0 0x7f3fa0103bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3fa6cf0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa0100ea0 0x7f3fa0102280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3fa6cf0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fa0101840 0x7f3fa01027c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3fa6cf0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa0102f60 con 0x7f3fa0100ea0 2023-12-01T01:03:44.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3fa6cf0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa01030d0 con 0x7f3fa0101840 2023-12-01T01:03:44.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3fa6cf0700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fa01a0ce0 con 0x7f3fa00ffcb0 2023-12-01T01:03:44.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3f9ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa0100ea0 0x7f3fa0102280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3f9ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa0100ea0 0x7f3fa0102280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54342/0 (socket says 172.21.15.26:54342) 2023-12-01T01:03:44.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3f9ffff700 1 -- 172.21.15.26:0/522592828 learned_addr learned my addr 172.21.15.26:0/522592828 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:44.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3fa4a8c700 1 --2- 172.21.15.26:0/522592828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3fa00ffcb0 0x7f3fa0103bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3fa528d700 1 --2- 172.21.15.26:0/522592828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fa0101840 0x7f3fa01027c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3f9ffff700 1 -- 172.21.15.26:0/522592828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3fa00ffcb0 msgr2=0x7f3fa0103bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3f9ffff700 1 --2- 172.21.15.26:0/522592828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3fa00ffcb0 0x7f3fa0103bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3f9ffff700 1 -- 172.21.15.26:0/522592828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fa0101840 msgr2=0x7f3fa01027c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3f9ffff700 1 --2- 172.21.15.26:0/522592828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fa0101840 0x7f3fa01027c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3f9ffff700 1 -- 172.21.15.26:0/522592828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f98009d00 con 0x7f3fa0100ea0 2023-12-01T01:03:44.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3f9ffff700 1 --2- 172.21.15.26:0/522592828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa0100ea0 0x7f3fa0102280 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00e9c0 tx=0x7f3f8c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3f9dffb700 1 -- 172.21.15.26:0/522592828 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c0097b0 con 0x7f3fa0100ea0 2023-12-01T01:03:44.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3f9dffb700 1 -- 172.21.15.26:0/522592828 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3f8c00ee60 con 0x7f3fa0100ea0 2023-12-01T01:03:44.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3fa6cf0700 1 -- 172.21.15.26:0/522592828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fa01a0f70 con 0x7f3fa0100ea0 2023-12-01T01:03:44.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.057+0000 7f3f9dffb700 1 -- 172.21.15.26:0/522592828 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c005560 con 0x7f3fa0100ea0 2023-12-01T01:03:44.061 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.058+0000 7f3fa6cf0700 1 -- 172.21.15.26:0/522592828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa01a13a0 con 0x7f3fa0100ea0 2023-12-01T01:03:44.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.060+0000 7f3f9dffb700 1 -- 172.21.15.26:0/522592828 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f3f8c004750 con 0x7f3fa0100ea0 2023-12-01T01:03:44.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.061+0000 7f3f9dffb700 1 --2- 172.21.15.26:0/522592828 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3f900a05b0 0x7f3f900a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.061+0000 7f3f9dffb700 1 -- 172.21.15.26:0/522592828 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3f8c014070 con 0x7f3fa0100ea0 2023-12-01T01:03:44.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.061+0000 7f3fa4a8c700 1 --2- 172.21.15.26:0/522592828 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3f900a05b0 0x7f3f900a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.062 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.061+0000 7f3fa4a8c700 1 --2- 172.21.15.26:0/522592828 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3f900a05b0 0x7f3f900a2a70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0100d00 tx=0x7f3f9400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3fb2e80b80 1 Processor -- start 2023-12-01T01:03:44.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3fb2e80b80 1 -- start start 2023-12-01T01:03:44.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3fb2e80b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06860a0 0x555ec06864e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3fb2e80b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec0686a20 0x555ec0684e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3fb2e80b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec06853a0 0x555ec0685820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3fb2e80b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec05dc9c0 con 0x555ec0686a20 2023-12-01T01:03:44.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3fb2e80b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec05da380 con 0x555ec06860a0 2023-12-01T01:03:44.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3fb2e80b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec05d5c70 con 0x555ec06853a0 2023-12-01T01:03:44.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3f9ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec0686a20 0x555ec0684e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3f9ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec0686a20 0x555ec0684e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54350/0 (socket says 172.21.15.26:54350) 2023-12-01T01:03:44.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3f9ffff700 1 -- 172.21.15.26:0/1890323097 learned_addr learned my addr 172.21.15.26:0/1890323097 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:44.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3fa4a8c700 1 --2- 172.21.15.26:0/1890323097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06860a0 0x555ec06864e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3fa528d700 1 --2- 172.21.15.26:0/1890323097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec06853a0 0x555ec0685820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3f9ffff700 1 -- 172.21.15.26:0/1890323097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec06853a0 msgr2=0x555ec0685820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3f9ffff700 1 --2- 172.21.15.26:0/1890323097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec06853a0 0x555ec0685820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3f9ffff700 1 -- 172.21.15.26:0/1890323097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06860a0 msgr2=0x555ec06864e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3f9ffff700 1 --2- 172.21.15.26:0/1890323097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06860a0 0x555ec06864e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3f9ffff700 1 -- 172.21.15.26:0/1890323097 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ec0403d90 con 0x555ec0686a20 2023-12-01T01:03:44.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3fa528d700 1 --2- 172.21.15.26:0/1890323097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec06853a0 0x555ec0685820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:03:44.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.062+0000 7f3f9ffff700 1 --2- 172.21.15.26:0/1890323097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec0686a20 0x555ec0684e10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0a1040 tx=0x7f3f8c099140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77ee7dafb56dfb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.063+0000 7f3f8affd700 1 -- 172.21.15.26:0/1890323097 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c09d170 con 0x555ec0686a20 2023-12-01T01:03:44.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.063+0000 7f3f8affd700 1 -- 172.21.15.26:0/1890323097 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3f8c099c00 con 0x555ec0686a20 2023-12-01T01:03:44.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.063+0000 7f3f8affd700 1 -- 172.21.15.26:0/1890323097 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c0c9b70 con 0x555ec0686a20 2023-12-01T01:03:44.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.063+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/1890323097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec0686a20 msgr2=0x555ec0684e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.063+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/1890323097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec0686a20 0x555ec0684e10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0a1040 tx=0x7f3f8c099140 comp rx=0 tx=0).stop 2023-12-01T01:03:44.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.063+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/1890323097 shutdown_connections 2023-12-01T01:03:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.063+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/1890323097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec06853a0 0x555ec0685820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.063+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/1890323097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06860a0 0x555ec06864e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.063+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/1890323097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec0686a20 0x555ec0684e10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.063+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/1890323097 >> 172.21.15.26:0/1890323097 conn(0x555ec05e4080 msgr2=0x555ec067f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.063+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/1890323097 shutdown_connections 2023-12-01T01:03:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.063+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/1890323097 wait complete. 2023-12-01T01:03:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.064+0000 7f3fb2e80b80 1 -- start start 2023-12-01T01:03:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.064+0000 7f3fb2e80b80 1 Processor -- start 2023-12-01T01:03:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.064+0000 7f3fb2e80b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06853a0 0x555ec068e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.064+0000 7f3fb2e80b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06860a0 0x555ec068ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.064+0000 7f3fb2e80b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 0x555ec0695e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.064+0000 7f3fb2e80b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec05724c0 con 0x555ec06853a0 2023-12-01T01:03:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.064+0000 7f3fb2e80b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec0572160 con 0x555ec06860a0 2023-12-01T01:03:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.064+0000 7f3fb2e80b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec04598d0 con 0x555ec0686a20 2023-12-01T01:03:44.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.064+0000 7f3fb2e80b80 10 client.0 _ll_register_callbacks cb 0x555ec04bfa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:03:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.064+0000 7f3fa4a8c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06853a0 0x555ec068e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.064+0000 7f3fa4a8c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06853a0 0x555ec068e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54354/0 (socket says 172.21.15.26:54354) 2023-12-01T01:03:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.064+0000 7f3fa4a8c700 1 -- 172.21.15.26:0/2872208125 learned_addr learned my addr 172.21.15.26:0/2872208125 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.064+0000 7f3f9ffff700 1 --2- 172.21.15.26:0/2872208125 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06860a0 0x555ec068ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3fa528d700 1 --2- 172.21.15.26:0/2872208125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 0x555ec0695e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3fa4a8c700 1 -- 172.21.15.26:0/2872208125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 msgr2=0x555ec0695e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3fa4a8c700 1 --2- 172.21.15.26:0/2872208125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 0x555ec0695e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3fa4a8c700 1 -- 172.21.15.26:0/2872208125 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06860a0 msgr2=0x555ec068ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3fa4a8c700 1 --2- 172.21.15.26:0/2872208125 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06860a0 0x555ec068ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3fa4a8c700 1 -- 172.21.15.26:0/2872208125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fa01a13a0 con 0x555ec06853a0 2023-12-01T01:03:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3fa528d700 1 --2- 172.21.15.26:0/2872208125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 0x555ec0695e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:03:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3fa4a8c700 1 --2- 172.21.15.26:0/2872208125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06853a0 0x555ec068e8c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400bfd0 tx=0x7f3f940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67b176a84905f72b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3f7ffff700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:03:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3f7ffff700 1 -- 172.21.15.26:0/2872208125 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94028670 con 0x555ec06853a0 2023-12-01T01:03:44.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3f7ffff700 1 -- 172.21.15.26:0/2872208125 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3f94017070 con 0x555ec06853a0 2023-12-01T01:03:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/2872208125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555ec0600cc0 con 0x555ec06853a0 2023-12-01T01:03:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3f7ffff700 1 -- 172.21.15.26:0/2872208125 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f94011e10 con 0x555ec06853a0 2023-12-01T01:03:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3fb2e80b80 10 client.15036 fetch_fsmap learned FSMap version 23 2023-12-01T01:03:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/2872208125 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x555ec03ecc10 con 0x555ec06853a0 2023-12-01T01:03:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3f7ffff700 1 -- 172.21.15.26:0/2872208125 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x555ec0600cc0 con 0x555ec06853a0 2023-12-01T01:03:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3f7ffff700 1 -- 172.21.15.26:0/2872208125 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f3f94031070 con 0x555ec06853a0 2023-12-01T01:03:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.065+0000 7f3fb2e80b80 10 client.15036 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:03:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.066+0000 7f3fb2e80b80 10 client.15036 resolve_mds: resolved name 'i' to daemon mds.i 2023-12-01T01:03:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.066+0000 7f3fb2e80b80 20 client.15036 populate_metadata read hostname 'smithi026' 2023-12-01T01:03:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.066+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/2872208125 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x555ec0699b40 0x555ec0698f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.066+0000 7f3fb2e80b80 4 client.15036 mds_command: new command op to 24481 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:03:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.066+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/2872208125 --> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555ec0653dc0 con 0x555ec0699b40 2023-12-01T01:03:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.066+0000 7f3f9ffff700 1 --2- 172.21.15.26:0/2872208125 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x555ec0699b40 0x555ec0698f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.066+0000 7f3f7ffff700 10 client.15036 ms_handle_connect on v2:172.21.15.116:6838/261568108 2023-12-01T01:03:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.066+0000 7f3f9ffff700 1 --2- 172.21.15.26:0/2872208125 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x555ec0699b40 0x555ec0698f10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a800a2816359f774 server_cookie=9b3fe11790a88215 in_seq=0 out_seq=0 2023-12-01T01:03:44.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.067+0000 7f3f7ffff700 1 -- 172.21.15.26:0/2872208125 <== mds.2 v2:172.21.15.116:6838/261568108 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x555ec0653dc0 con 0x555ec0699b40 2023-12-01T01:03:44.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.067+0000 7f3f7ffff700 10 client.15036 handle_command_reply: tid=0 2023-12-01T01:03:44.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.067+0000 7f3fb2e80b80 1 client.15036 shutdown 2023-12-01T01:03:44.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.067+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/2872208125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06853a0 msgr2=0x555ec068e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.067+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/2872208125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06853a0 0x555ec068e8c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400bfd0 tx=0x7f3f940047c0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.067+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/2872208125 shutdown_connections 2023-12-01T01:03:44.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.067+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/2872208125 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 0x555ec0695e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.067+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/2872208125 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06853a0 0x555ec068e8c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.067+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/2872208125 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x555ec0699b40 0x555ec0698f10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.067+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/2872208125 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06860a0 0x555ec068ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.067+0000 7f3f7ffff700 0 client.15036 ms_handle_reset on v2:172.21.15.116:6838/261568108 2023-12-01T01:03:44.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.067+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/2872208125 >> 172.21.15.26:0/2872208125 conn(0x555ec05e4080 msgr2=0x555ec067f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.067+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/2872208125 shutdown_connections 2023-12-01T01:03:44.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.067+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/2872208125 wait complete. 2023-12-01T01:03:44.074 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.067+0000 7f3fb2e80b80 20 client.15036 trim_cache size 0 max 16384 2023-12-01T01:03:44.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fb2e80b80 1 Processor -- start 2023-12-01T01:03:44.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fb2e80b80 1 -- start start 2023-12-01T01:03:44.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fb2e80b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06853a0 0x555ec0684e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fb2e80b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06860a0 0x555ec06a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.091 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fb2e80b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 0x555ec06892c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fb2e80b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec0600cc0 con 0x555ec06853a0 2023-12-01T01:03:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fb2e80b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec057f830 con 0x555ec06860a0 2023-12-01T01:03:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fb2e80b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec05dacf0 con 0x555ec0686a20 2023-12-01T01:03:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fa4a8c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06853a0 0x555ec0684e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fa4a8c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06853a0 0x555ec0684e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54362/0 (socket says 172.21.15.26:54362) 2023-12-01T01:03:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fa4a8c700 1 -- 172.21.15.26:0/409324613 learned_addr learned my addr 172.21.15.26:0/409324613 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fa528d700 1 --2- 172.21.15.26:0/409324613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 0x555ec06892c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fa4a8c700 1 -- 172.21.15.26:0/409324613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 msgr2=0x555ec06892c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fa4a8c700 1 --2- 172.21.15.26:0/409324613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 0x555ec06892c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fa4a8c700 1 -- 172.21.15.26:0/409324613 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06860a0 msgr2=0x555ec06a28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fa4a8c700 1 --2- 172.21.15.26:0/409324613 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06860a0 0x555ec06a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fa4a8c700 1 -- 172.21.15.26:0/409324613 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ec042a200 con 0x555ec06853a0 2023-12-01T01:03:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fa528d700 1 --2- 172.21.15.26:0/409324613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 0x555ec06892c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:03:44.092 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3fa4a8c700 1 --2- 172.21.15.26:0/409324613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06853a0 0x555ec0684e10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400ba60 tx=0x7f3f94010ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132902fc06622626 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.085+0000 7f3f8b7fe700 1 -- 172.21.15.26:0/409324613 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94011a50 con 0x555ec06853a0 2023-12-01T01:03:44.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.086+0000 7f3f8b7fe700 1 -- 172.21.15.26:0/409324613 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3f9402e070 con 0x555ec06853a0 2023-12-01T01:03:44.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.086+0000 7f3f8b7fe700 1 -- 172.21.15.26:0/409324613 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94028dd0 con 0x555ec06853a0 2023-12-01T01:03:44.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.086+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/409324613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06853a0 msgr2=0x555ec0684e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.086+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/409324613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06853a0 0x555ec0684e10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400ba60 tx=0x7f3f94010ee0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.086+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/409324613 shutdown_connections 2023-12-01T01:03:44.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.086+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/409324613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 0x555ec06892c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.086+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/409324613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06853a0 0x555ec0684e10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.086+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/409324613 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06860a0 0x555ec06a28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.086+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/409324613 >> 172.21.15.26:0/409324613 conn(0x555ec05e4080 msgr2=0x555ec0698f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.086+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/409324613 shutdown_connections 2023-12-01T01:03:44.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.086+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/409324613 wait complete. 2023-12-01T01:03:44.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.086+0000 7f3fb2e80b80 1 -- start start 2023-12-01T01:03:44.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3fb2e80b80 1 Processor -- start 2023-12-01T01:03:44.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3fb2e80b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06853a0 0x555ec069db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.093 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3fb2e80b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06860a0 0x555ec069e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3fb2e80b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 0x555ec06a1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3fb2e80b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec06a15c0 con 0x555ec06860a0 2023-12-01T01:03:44.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3fb2e80b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec06a1730 con 0x555ec06853a0 2023-12-01T01:03:44.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3fb2e80b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ec06a18f0 con 0x555ec0686a20 2023-12-01T01:03:44.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3fb2e80b80 10 client.0 _ll_register_callbacks cb 0x7f3f94010d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:03:44.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3f9ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06860a0 0x555ec069e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3f9ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06860a0 0x555ec069e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54370/0 (socket says 172.21.15.26:54370) 2023-12-01T01:03:44.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3f9ffff700 1 -- 172.21.15.26:0/3386606719 learned_addr learned my addr 172.21.15.26:0/3386606719 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:44.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3fa4a8c700 1 --2- 172.21.15.26:0/3386606719 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06853a0 0x555ec069db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3fa528d700 1 --2- 172.21.15.26:0/3386606719 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 0x555ec06a1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3f9ffff700 1 -- 172.21.15.26:0/3386606719 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 msgr2=0x555ec06a1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3f9ffff700 1 --2- 172.21.15.26:0/3386606719 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 0x555ec06a1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3f9ffff700 1 -- 172.21.15.26:0/3386606719 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06853a0 msgr2=0x555ec069db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3f9ffff700 1 --2- 172.21.15.26:0/3386606719 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06853a0 0x555ec069db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3f9ffff700 1 -- 172.21.15.26:0/3386606719 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ec03ecc10 con 0x555ec06860a0 2023-12-01T01:03:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.087+0000 7f3fa4a8c700 1 --2- 172.21.15.26:0/3386606719 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06853a0 0x555ec069db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:03:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3f9ffff700 1 --2- 172.21.15.26:0/3386606719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06860a0 0x555ec069e060 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c095f70 tx=0x7f3f8c098f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ceca01fd28d975 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3f7ffff700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:03:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3f7ffff700 1 -- 172.21.15.26:0/3386606719 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c099500 con 0x555ec06860a0 2023-12-01T01:03:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3f7ffff700 1 -- 172.21.15.26:0/3386606719 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3f8c09d330 con 0x555ec06860a0 2023-12-01T01:03:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/3386606719 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f8c099c00 con 0x555ec06860a0 2023-12-01T01:03:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3f7ffff700 1 -- 172.21.15.26:0/3386606719 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f8c065250 con 0x555ec06860a0 2023-12-01T01:03:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3fb2e80b80 10 client.15042 fetch_fsmap learned FSMap version 23 2023-12-01T01:03:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/3386606719 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x555ec0402260 con 0x555ec06860a0 2023-12-01T01:03:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3f7ffff700 1 -- 172.21.15.26:0/3386606719 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3f8c099c00 con 0x555ec06860a0 2023-12-01T01:03:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3f7ffff700 1 -- 172.21.15.26:0/3386606719 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f3f8c099880 con 0x555ec06860a0 2023-12-01T01:03:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3fb2e80b80 10 client.15042 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:03:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3fb2e80b80 10 client.15042 resolve_mds: resolved name 'i' to daemon mds.i 2023-12-01T01:03:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3fb2e80b80 20 client.15042 populate_metadata read hostname 'smithi026' 2023-12-01T01:03:44.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/3386606719 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x555ec06f08c0 0x555ec06ed660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3fb2e80b80 4 client.15042 mds_command: new command op to 24481 tid=0[{"prefix": "status"}] 2023-12-01T01:03:44.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/3386606719 --> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555ec05cecf0 con 0x555ec06f08c0 2023-12-01T01:03:44.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.088+0000 7f3fa4a8c700 1 --2- 172.21.15.26:0/3386606719 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x555ec06f08c0 0x555ec06ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3f7ffff700 10 client.15042 ms_handle_connect on v2:172.21.15.116:6838/261568108 2023-12-01T01:03:44.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3fa4a8c700 1 --2- 172.21.15.26:0/3386606719 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x555ec06f08c0 0x555ec06ed660 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bfac2de10342797c server_cookie=43ffa3ae78a8e84a in_seq=0 out_seq=0 2023-12-01T01:03:44.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3f7ffff700 1 -- 172.21.15.26:0/3386606719 <== mds.2 v2:172.21.15.116:6838/261568108 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x555ec05cecf0 con 0x555ec06f08c0 2023-12-01T01:03:44.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3f7ffff700 10 client.15042 handle_command_reply: tid=0 2023-12-01T01:03:44.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3fb2e80b80 1 client.15042 shutdown 2023-12-01T01:03:44.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/3386606719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06860a0 msgr2=0x555ec069e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/3386606719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06860a0 0x555ec069e060 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c095f70 tx=0x7f3f8c098f90 comp rx=0 tx=0).stop 2023-12-01T01:03:44.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/3386606719 shutdown_connections 2023-12-01T01:03:44.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/3386606719 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x555ec0686a20 0x555ec06a1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/3386606719 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x555ec06f08c0 0x555ec06ed660 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/3386606719 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x555ec06853a0 0x555ec069db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3fb2e80b80 1 --2- 172.21.15.26:0/3386606719 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555ec06860a0 0x555ec069e060 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3f7ffff700 0 client.15042 ms_handle_reset on v2:172.21.15.116:6838/261568108 2023-12-01T01:03:44.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/3386606719 >> 172.21.15.26:0/3386606719 conn(0x555ec05e4080 msgr2=0x555ec06892c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/3386606719 shutdown_connections 2023-12-01T01:03:44.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3fb2e80b80 1 -- 172.21.15.26:0/3386606719 wait complete. 2023-12-01T01:03:44.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.089+0000 7f3fb2e80b80 20 client.15042 trim_cache size 0 max 16384 2023-12-01T01:03:44.097 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:03:44.097 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "48bff570-8fe4-11ee-95a2-87774f69a715", 2023-12-01T01:03:44.097 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 2, 2023-12-01T01:03:44.097 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 24481, 2023-12-01T01:03:44.097 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-12-01T01:03:44.097 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-12-01T01:03:44.098 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-12-01T01:03:44.098 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 52.765981140000001, 2023-12-01T01:03:44.098 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 23, 2023-12-01T01:03:44.098 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 83, 2023-12-01T01:03:44.098 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 81, 2023-12-01T01:03:44.098 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 69.827239277000004 2023-12-01T01:03:44.098 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:03:44.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.090+0000 7f3fa6cf0700 1 -- 172.21.15.26:0/522592828 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3f900a05b0 msgr2=0x7f3f900a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.090+0000 7f3fa6cf0700 1 --2- 172.21.15.26:0/522592828 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3f900a05b0 0x7f3f900a2a70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0100d00 tx=0x7f3f9400b410 comp rx=0 tx=0).stop 2023-12-01T01:03:44.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.090+0000 7f3fa6cf0700 1 -- 172.21.15.26:0/522592828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa0100ea0 msgr2=0x7f3fa0102280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.090+0000 7f3fa6cf0700 1 --2- 172.21.15.26:0/522592828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa0100ea0 0x7f3fa0102280 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00e9c0 tx=0x7f3f8c00ecd0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.090+0000 7f3fa6cf0700 1 -- 172.21.15.26:0/522592828 shutdown_connections 2023-12-01T01:03:44.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.090+0000 7f3fa6cf0700 1 --2- 172.21.15.26:0/522592828 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3f900a05b0 0x7f3f900a2a70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.090+0000 7f3fa6cf0700 1 --2- 172.21.15.26:0/522592828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fa0101840 0x7f3fa01027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.090+0000 7f3fa6cf0700 1 --2- 172.21.15.26:0/522592828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3fa00ffcb0 0x7f3fa0103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.090+0000 7f3fa6cf0700 1 --2- 172.21.15.26:0/522592828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3fa0100ea0 0x7f3fa0102280 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.090+0000 7f3fa6cf0700 1 -- 172.21.15.26:0/522592828 >> 172.21.15.26:0/522592828 conn(0x7f3fa00fb220 msgr2=0x7f3fa0068e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.090+0000 7f3fa6cf0700 1 -- 172.21.15.26:0/522592828 shutdown_connections 2023-12-01T01:03:44.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.090+0000 7f3fa6cf0700 1 -- 172.21.15.26:0/522592828 wait complete. 2023-12-01T01:03:44.103 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.g status 2023-12-01T01:03:44.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:43 smithi116 ceph-mon[103554]: pgmap v275: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-01T01:03:44.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:43 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/999102027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:03:44.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:43 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1097489887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:03:44.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:43 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3414114685' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:03:44.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:43 smithi093 ceph-mon[103327]: pgmap v275: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-01T01:03:44.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:43 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/999102027' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:03:44.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:43 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1097489887' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:03:44.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:43 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3414114685' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:03:44.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.229+0000 7fecd048a700 1 -- 172.21.15.26:0/647360310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc8101830 msgr2=0x7fecc81080e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.229+0000 7fecd048a700 1 --2- 172.21.15.26:0/647360310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc8101830 0x7fecc81080e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fecc000b0d0 tx=0x7fecc000b3e0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.229+0000 7fecd048a700 1 -- 172.21.15.26:0/647360310 shutdown_connections 2023-12-01T01:03:44.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.229+0000 7fecd048a700 1 --2- 172.21.15.26:0/647360310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc8101830 0x7fecc81080e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.229+0000 7fecd048a700 1 --2- 172.21.15.26:0/647360310 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecc80ffca0 0x7fecc81000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.229+0000 7fecd048a700 1 --2- 172.21.15.26:0/647360310 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecc8100e90 0x7fecc81012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.229+0000 7fecd048a700 1 -- 172.21.15.26:0/647360310 >> 172.21.15.26:0/647360310 conn(0x7fecc80fb250 msgr2=0x7fecc80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.229+0000 7fecd048a700 1 -- 172.21.15.26:0/647360310 shutdown_connections 2023-12-01T01:03:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.229+0000 7fecd048a700 1 -- 172.21.15.26:0/647360310 wait complete. 2023-12-01T01:03:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.229+0000 7fecd048a700 1 Processor -- start 2023-12-01T01:03:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.229+0000 7fecd048a700 1 -- start start 2023-12-01T01:03:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.229+0000 7fecd048a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc80ffca0 0x7fecc8069c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecd048a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecc8100e90 0x7fecc819dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecd048a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecc8101830 0x7fecc81a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecd048a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc81a0990 con 0x7fecc80ffca0 2023-12-01T01:03:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecd048a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc81a0b00 con 0x7fecc8100e90 2023-12-01T01:03:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecd048a700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc81a0cc0 con 0x7fecc8101830 2023-12-01T01:03:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecce226700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc80ffca0 0x7fecc8069c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecce226700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc80ffca0 0x7fecc8069c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54382/0 (socket says 172.21.15.26:54382) 2023-12-01T01:03:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecce226700 1 -- 172.21.15.26:0/172216720 learned_addr learned my addr 172.21.15.26:0/172216720 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7feccea27700 1 --2- 172.21.15.26:0/172216720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecc8101830 0x7fecc81a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7feccda25700 1 --2- 172.21.15.26:0/172216720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecc8100e90 0x7fecc819dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecce226700 1 -- 172.21.15.26:0/172216720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecc8101830 msgr2=0x7fecc81a02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecce226700 1 --2- 172.21.15.26:0/172216720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecc8101830 0x7fecc81a02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecce226700 1 -- 172.21.15.26:0/172216720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecc8100e90 msgr2=0x7fecc819dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecce226700 1 --2- 172.21.15.26:0/172216720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecc8100e90 0x7fecc819dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecce226700 1 -- 172.21.15.26:0/172216720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc0009d00 con 0x7fecc80ffca0 2023-12-01T01:03:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7feccea27700 1 --2- 172.21.15.26:0/172216720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecc8101830 0x7fecc81a02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:03:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecce226700 1 --2- 172.21.15.26:0/172216720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc80ffca0 0x7fecc8069c50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fecc400d980 tx=0x7fecc400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecbf7fe700 1 -- 172.21.15.26:0/172216720 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc400de60 con 0x7fecc80ffca0 2023-12-01T01:03:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecbf7fe700 1 -- 172.21.15.26:0/172216720 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fecc4004500 con 0x7fecc80ffca0 2023-12-01T01:03:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecd048a700 1 -- 172.21.15.26:0/172216720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecc81a0fa0 con 0x7fecc80ffca0 2023-12-01T01:03:44.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecbf7fe700 1 -- 172.21.15.26:0/172216720 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4003ce0 con 0x7fecc80ffca0 2023-12-01T01:03:44.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.230+0000 7fecd048a700 1 -- 172.21.15.26:0/172216720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc81a13d0 con 0x7fecc80ffca0 2023-12-01T01:03:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.232+0000 7fecbf7fe700 1 -- 172.21.15.26:0/172216720 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fecc4009cb0 con 0x7fecc80ffca0 2023-12-01T01:03:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.233+0000 7fecbf7fe700 1 --2- 172.21.15.26:0/172216720 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fecb40a0630 0x7fecb40a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.234+0000 7feccda25700 1 --2- 172.21.15.26:0/172216720 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fecb40a0630 0x7fecb40a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.234+0000 7fecbf7fe700 1 -- 172.21.15.26:0/172216720 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fecc40cb760 con 0x7fecc80ffca0 2023-12-01T01:03:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.234+0000 7feccda25700 1 --2- 172.21.15.26:0/172216720 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fecb40a0630 0x7fecb40a2af0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fecb8005950 tx=0x7fecb80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.234+0000 7fecdc61ab80 1 Processor -- start 2023-12-01T01:03:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7fecdc61ab80 1 -- start start 2023-12-01T01:03:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7fecdc61ab80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b84b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7fecdc61ab80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84ba20 0x56003b849e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7fecdc61ab80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 0x56003b84a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7fecdc61ab80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003b7a19c0 con 0x56003b84b0a0 2023-12-01T01:03:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7fecdc61ab80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003b79f380 con 0x56003b84a3a0 2023-12-01T01:03:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7fecdc61ab80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003b79ac70 con 0x56003b84ba20 2023-12-01T01:03:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7fecce226700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b84b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7fecce226700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b84b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54390/0 (socket says 172.21.15.26:54390) 2023-12-01T01:03:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7fecce226700 1 -- 172.21.15.26:0/1517857277 learned_addr learned my addr 172.21.15.26:0/1517857277 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7feccda25700 1 --2- 172.21.15.26:0/1517857277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84ba20 0x56003b849e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7fecce226700 1 -- 172.21.15.26:0/1517857277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84ba20 msgr2=0x56003b849e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7feccea27700 1 --2- 172.21.15.26:0/1517857277 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 0x56003b84a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7fecce226700 1 --2- 172.21.15.26:0/1517857277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84ba20 0x56003b849e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7fecce226700 1 -- 172.21.15.26:0/1517857277 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 msgr2=0x56003b84a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7fecce226700 1 --2- 172.21.15.26:0/1517857277 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 0x56003b84a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7fecce226700 1 -- 172.21.15.26:0/1517857277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56003b5c8d90 con 0x56003b84b0a0 2023-12-01T01:03:44.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7feccea27700 1 --2- 172.21.15.26:0/1517857277 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 0x56003b84a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:03:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.235+0000 7fecce226700 1 --2- 172.21.15.26:0/1517857277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b84b4e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fecc40a0990 tx=0x7fecc40987b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b5013171f05b54 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.236+0000 7fecbcda9700 1 -- 172.21.15.26:0/1517857277 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4098e50 con 0x56003b84b0a0 2023-12-01T01:03:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.236+0000 7fecbcda9700 1 -- 172.21.15.26:0/1517857277 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fecc409cc80 con 0x56003b84b0a0 2023-12-01T01:03:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.236+0000 7fecbcda9700 1 -- 172.21.15.26:0/1517857277 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4023550 con 0x56003b84b0a0 2023-12-01T01:03:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.236+0000 7fecdc61ab80 1 -- 172.21.15.26:0/1517857277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 msgr2=0x56003b84b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.236+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/1517857277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b84b4e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fecc40a0990 tx=0x7fecc40987b0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.236+0000 7fecdc61ab80 1 -- 172.21.15.26:0/1517857277 shutdown_connections 2023-12-01T01:03:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.236+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/1517857277 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 0x56003b84a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.236+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/1517857277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b84b4e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.236+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/1517857277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84ba20 0x56003b849e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.236+0000 7fecdc61ab80 1 -- 172.21.15.26:0/1517857277 >> 172.21.15.26:0/1517857277 conn(0x56003b7a9080 msgr2=0x56003b8448f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.236+0000 7fecdc61ab80 1 -- 172.21.15.26:0/1517857277 shutdown_connections 2023-12-01T01:03:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.236+0000 7fecdc61ab80 1 -- 172.21.15.26:0/1517857277 wait complete. 2023-12-01T01:03:44.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.237+0000 7fecdc61ab80 1 -- start start 2023-12-01T01:03:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.237+0000 7fecdc61ab80 1 Processor -- start 2023-12-01T01:03:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.237+0000 7fecdc61ab80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 0x56003b853950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.237+0000 7fecdc61ab80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b853e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.237+0000 7fecdc61ab80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84ba20 0x56003b85aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.237+0000 7fecdc61ab80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003b7374c0 con 0x56003b84b0a0 2023-12-01T01:03:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.237+0000 7fecdc61ab80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003b737160 con 0x56003b84a3a0 2023-12-01T01:03:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.237+0000 7fecdc61ab80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003b61e8d0 con 0x56003b84ba20 2023-12-01T01:03:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.237+0000 7fecdc61ab80 10 client.0 _ll_register_callbacks cb 0x56003b684a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:03:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.237+0000 7feccda25700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b853e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.237+0000 7feccda25700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b853e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54396/0 (socket says 172.21.15.26:54396) 2023-12-01T01:03:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.237+0000 7feccda25700 1 -- 172.21.15.26:0/692456433 learned_addr learned my addr 172.21.15.26:0/692456433 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.237+0000 7feccea27700 1 --2- 172.21.15.26:0/692456433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84ba20 0x56003b85aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.237+0000 7fecce226700 1 --2- 172.21.15.26:0/692456433 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 0x56003b853950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7feccda25700 1 -- 172.21.15.26:0/692456433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84ba20 msgr2=0x56003b85aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7feccda25700 1 --2- 172.21.15.26:0/692456433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84ba20 0x56003b85aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7feccda25700 1 -- 172.21.15.26:0/692456433 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 msgr2=0x56003b853950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7feccda25700 1 --2- 172.21.15.26:0/692456433 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 0x56003b853950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7feccda25700 1 -- 172.21.15.26:0/692456433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc81a13d0 con 0x56003b84b0a0 2023-12-01T01:03:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7fecce226700 1 --2- 172.21.15.26:0/692456433 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 0x56003b853950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:03:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7feccda25700 1 --2- 172.21.15.26:0/692456433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b853e90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fecb800ff50 tx=0x7fecb8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fc5e9df75e982f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7fecb1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:03:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7fecb1ffb700 1 -- 172.21.15.26:0/692456433 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb8028670 con 0x56003b84b0a0 2023-12-01T01:03:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7fecb1ffb700 1 -- 172.21.15.26:0/692456433 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fecb80287d0 con 0x56003b84b0a0 2023-12-01T01:03:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7fecdc61ab80 1 -- 172.21.15.26:0/692456433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56003b7c5cc0 con 0x56003b84b0a0 2023-12-01T01:03:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7fecb1ffb700 1 -- 172.21.15.26:0/692456433 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecb802e030 con 0x56003b84b0a0 2023-12-01T01:03:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7fecdc61ab80 10 client.15054 fetch_fsmap learned FSMap version 23 2023-12-01T01:03:44.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7fecdc61ab80 1 -- 172.21.15.26:0/692456433 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56003b5b1c10 con 0x56003b84b0a0 2023-12-01T01:03:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7fecb1ffb700 1 -- 172.21.15.26:0/692456433 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x56003b7c5cc0 con 0x56003b84b0a0 2023-12-01T01:03:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7fecb1ffb700 1 -- 172.21.15.26:0/692456433 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fecb801e4c0 con 0x56003b84b0a0 2023-12-01T01:03:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7fecdc61ab80 10 client.15054 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:03:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7fecdc61ab80 10 client.15054 resolve_mds: resolved name 'g' to daemon mds.g 2023-12-01T01:03:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7fecdc61ab80 20 client.15054 populate_metadata read hostname 'smithi026' 2023-12-01T01:03:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/692456433 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x56003b85ec50 0x56003b85dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7fecdc61ab80 4 client.15054 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:03:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.238+0000 7fecdc61ab80 1 -- 172.21.15.26:0/692456433 --> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56003b818dc0 con 0x56003b85ec50 2023-12-01T01:03:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.239+0000 7fecce226700 1 --2- 172.21.15.26:0/692456433 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x56003b85ec50 0x56003b85dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.239+0000 7fecce226700 1 --2- 172.21.15.26:0/692456433 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x56003b85ec50 0x56003b85dff0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c8bfc9612b803772 server_cookie=aa7b6fc671e39ef1 in_seq=0 out_seq=0 2023-12-01T01:03:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.239+0000 7fecb1ffb700 10 client.15054 ms_handle_connect on v2:172.21.15.26:6838/1277894156 2023-12-01T01:03:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.240+0000 7fecb1ffb700 1 -- 172.21.15.26:0/692456433 <== mds.1 v2:172.21.15.26:6838/1277894156 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x56003b818dc0 con 0x56003b85ec50 2023-12-01T01:03:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.240+0000 7fecb1ffb700 10 client.15054 handle_command_reply: tid=0 2023-12-01T01:03:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.240+0000 7fecdc61ab80 1 client.15054 shutdown 2023-12-01T01:03:44.247 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.240+0000 7fecdc61ab80 1 -- 172.21.15.26:0/692456433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 msgr2=0x56003b853e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.240+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/692456433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b853e90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fecb800ff50 tx=0x7fecb8004750 comp rx=0 tx=0).stop 2023-12-01T01:03:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.240+0000 7fecdc61ab80 1 -- 172.21.15.26:0/692456433 shutdown_connections 2023-12-01T01:03:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.240+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/692456433 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84ba20 0x56003b85aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.240+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/692456433 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 0x56003b853950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.240+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/692456433 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x56003b85ec50 0x56003b85dff0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.240+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/692456433 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b853e90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.240+0000 7fecdc61ab80 1 -- 172.21.15.26:0/692456433 >> 172.21.15.26:0/692456433 conn(0x56003b7a9080 msgr2=0x56003b844060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.240+0000 7fecb1ffb700 0 client.15054 ms_handle_reset on v2:172.21.15.26:6838/1277894156 2023-12-01T01:03:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.240+0000 7fecdc61ab80 1 -- 172.21.15.26:0/692456433 shutdown_connections 2023-12-01T01:03:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.240+0000 7fecdc61ab80 1 -- 172.21.15.26:0/692456433 wait complete. 2023-12-01T01:03:44.248 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.240+0000 7fecdc61ab80 20 client.15054 trim_cache size 0 max 16384 2023-12-01T01:03:44.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.257+0000 7fecdc61ab80 1 Processor -- start 2023-12-01T01:03:44.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.257+0000 7fecdc61ab80 1 -- start start 2023-12-01T01:03:44.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7fecdc61ab80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84a3a0 0x56003b849e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7fecdc61ab80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84b0a0 0x56003b8679a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7fecdc61ab80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84ba20 0x56003b851780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7fecdc61ab80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003b853520 con 0x56003b84ba20 2023-12-01T01:03:44.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7fecdc61ab80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003b818dc0 con 0x56003b84b0a0 2023-12-01T01:03:44.264 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7fecdc61ab80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003b7650b0 con 0x56003b84a3a0 2023-12-01T01:03:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7feccea27700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84ba20 0x56003b851780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7feccea27700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84ba20 0x56003b851780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54408/0 (socket says 172.21.15.26:54408) 2023-12-01T01:03:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7feccea27700 1 -- 172.21.15.26:0/514092848 learned_addr learned my addr 172.21.15.26:0/514092848 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7fecce226700 1 --2- 172.21.15.26:0/514092848 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84a3a0 0x56003b849e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7feccea27700 1 -- 172.21.15.26:0/514092848 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84a3a0 msgr2=0x56003b849e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7feccea27700 1 --2- 172.21.15.26:0/514092848 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84a3a0 0x56003b849e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7feccea27700 1 -- 172.21.15.26:0/514092848 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84b0a0 msgr2=0x56003b8679a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7feccea27700 1 --2- 172.21.15.26:0/514092848 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84b0a0 0x56003b8679a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7feccea27700 1 -- 172.21.15.26:0/514092848 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56003b5ef200 con 0x56003b84ba20 2023-12-01T01:03:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7fecce226700 1 --2- 172.21.15.26:0/514092848 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84a3a0 0x56003b849e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:03:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7feccea27700 1 --2- 172.21.15.26:0/514092848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84ba20 0x56003b851780 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009c50 tx=0x7fecc0009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68031407242511f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7fecbd5aa700 1 -- 172.21.15.26:0/514092848 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc000e070 con 0x56003b84ba20 2023-12-01T01:03:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7fecbd5aa700 1 -- 172.21.15.26:0/514092848 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fecc0020070 con 0x56003b84ba20 2023-12-01T01:03:44.265 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.258+0000 7fecbd5aa700 1 -- 172.21.15.26:0/514092848 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc0005260 con 0x56003b84ba20 2023-12-01T01:03:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.259+0000 7fecdc61ab80 1 -- 172.21.15.26:0/514092848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84ba20 msgr2=0x56003b851780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.259+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/514092848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84ba20 0x56003b851780 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fecc0009c50 tx=0x7fecc0009c80 comp rx=0 tx=0).stop 2023-12-01T01:03:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.259+0000 7fecdc61ab80 1 -- 172.21.15.26:0/514092848 shutdown_connections 2023-12-01T01:03:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.259+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/514092848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84ba20 0x56003b851780 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.259+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/514092848 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84a3a0 0x56003b849e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.259+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/514092848 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84b0a0 0x56003b8679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.259+0000 7fecdc61ab80 1 -- 172.21.15.26:0/514092848 >> 172.21.15.26:0/514092848 conn(0x56003b7a9080 msgr2=0x56003b852630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.259+0000 7fecdc61ab80 1 -- 172.21.15.26:0/514092848 shutdown_connections 2023-12-01T01:03:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.259+0000 7fecdc61ab80 1 -- 172.21.15.26:0/514092848 wait complete. 2023-12-01T01:03:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.259+0000 7fecdc61ab80 1 -- start start 2023-12-01T01:03:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.259+0000 7fecdc61ab80 1 Processor -- start 2023-12-01T01:03:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.259+0000 7fecdc61ab80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 0x56003b866c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.259+0000 7fecdc61ab80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b867170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7fecdc61ab80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84ba20 0x56003b867730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.266 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7fecdc61ab80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003b8b0720 con 0x56003b84b0a0 2023-12-01T01:03:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7fecdc61ab80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003b8b0860 con 0x56003b84a3a0 2023-12-01T01:03:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7fecdc61ab80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003b8b09d0 con 0x56003b84ba20 2023-12-01T01:03:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7fecdc61ab80 10 client.0 _ll_register_callbacks cb 0x56003b684a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:03:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7feccda25700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b867170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7feccda25700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b867170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54412/0 (socket says 172.21.15.26:54412) 2023-12-01T01:03:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7feccda25700 1 -- 172.21.15.26:0/4014821593 learned_addr learned my addr 172.21.15.26:0/4014821593 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7fecce226700 1 --2- 172.21.15.26:0/4014821593 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 0x56003b866c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7feccda25700 1 -- 172.21.15.26:0/4014821593 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84ba20 msgr2=0x56003b867730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7feccda25700 1 --2- 172.21.15.26:0/4014821593 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84ba20 0x56003b867730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7feccda25700 1 -- 172.21.15.26:0/4014821593 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 msgr2=0x56003b866c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7feccda25700 1 --2- 172.21.15.26:0/4014821593 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 0x56003b866c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7feccda25700 1 -- 172.21.15.26:0/4014821593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc8108a30 con 0x56003b84b0a0 2023-12-01T01:03:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7feccda25700 1 --2- 172.21.15.26:0/4014821593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b867170 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fecb8014040 tx=0x7fecb8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae4eb6bcaa7702e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7fecb1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:03:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7fecb1ffb700 1 -- 172.21.15.26:0/4014821593 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb802e040 con 0x56003b84b0a0 2023-12-01T01:03:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7fecdc61ab80 1 -- 172.21.15.26:0/4014821593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fecc409cc80 con 0x56003b84b0a0 2023-12-01T01:03:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7fecb1ffb700 1 -- 172.21.15.26:0/4014821593 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fecb802f070 con 0x56003b84b0a0 2023-12-01T01:03:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7fecb1ffb700 1 -- 172.21.15.26:0/4014821593 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecb801ec00 con 0x56003b84b0a0 2023-12-01T01:03:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7fecdc61ab80 10 client.15060 fetch_fsmap learned FSMap version 23 2023-12-01T01:03:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.260+0000 7fecdc61ab80 1 -- 172.21.15.26:0/4014821593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56003b5c7260 con 0x56003b84b0a0 2023-12-01T01:03:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.261+0000 7fecb1ffb700 1 -- 172.21.15.26:0/4014821593 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fecc409cc80 con 0x56003b84b0a0 2023-12-01T01:03:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.261+0000 7fecb1ffb700 1 -- 172.21.15.26:0/4014821593 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fecb8028470 con 0x56003b84b0a0 2023-12-01T01:03:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.261+0000 7fecdc61ab80 10 client.15060 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:03:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.261+0000 7fecdc61ab80 10 client.15060 resolve_mds: resolved name 'g' to daemon mds.g 2023-12-01T01:03:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.261+0000 7fecdc61ab80 20 client.15060 populate_metadata read hostname 'smithi026' 2023-12-01T01:03:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.261+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/4014821593 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x56003b8b5790 0x56003b8b2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.261+0000 7fecdc61ab80 4 client.15060 mds_command: new command op to 24493 tid=0[{"prefix": "status"}] 2023-12-01T01:03:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.261+0000 7fecdc61ab80 1 -- 172.21.15.26:0/4014821593 --> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56003b793cf0 con 0x56003b8b5790 2023-12-01T01:03:44.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.261+0000 7fecce226700 1 --2- 172.21.15.26:0/4014821593 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x56003b8b5790 0x56003b8b2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.261+0000 7fecb1ffb700 10 client.15060 ms_handle_connect on v2:172.21.15.26:6838/1277894156 2023-12-01T01:03:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.261+0000 7fecce226700 1 --2- 172.21.15.26:0/4014821593 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x56003b8b5790 0x56003b8b2080 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=157c27cabe40b95f server_cookie=cc508729c474b08f in_seq=0 out_seq=0 2023-12-01T01:03:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.261+0000 7fecb1ffb700 1 -- 172.21.15.26:0/4014821593 <== mds.1 v2:172.21.15.26:6838/1277894156 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x56003b793cf0 con 0x56003b8b5790 2023-12-01T01:03:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.261+0000 7fecb1ffb700 10 client.15060 handle_command_reply: tid=0 2023-12-01T01:03:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.261+0000 7fecdc61ab80 1 client.15060 shutdown 2023-12-01T01:03:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecdc61ab80 1 -- 172.21.15.26:0/4014821593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 msgr2=0x56003b867170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/4014821593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b867170 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fecb8014040 tx=0x7fecb8011ab0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecdc61ab80 1 -- 172.21.15.26:0/4014821593 shutdown_connections 2023-12-01T01:03:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/4014821593 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56003b84ba20 0x56003b867730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/4014821593 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56003b84a3a0 0x56003b866c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/4014821593 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x56003b8b5790 0x56003b8b2080 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecdc61ab80 1 --2- 172.21.15.26:0/4014821593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56003b84b0a0 0x56003b867170 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecb1ffb700 0 client.15060 ms_handle_reset on v2:172.21.15.26:6838/1277894156 2023-12-01T01:03:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecdc61ab80 1 -- 172.21.15.26:0/4014821593 >> 172.21.15.26:0/4014821593 conn(0x56003b7a9080 msgr2=0x56003b851780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecdc61ab80 1 -- 172.21.15.26:0/4014821593 shutdown_connections 2023-12-01T01:03:44.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecdc61ab80 1 -- 172.21.15.26:0/4014821593 wait complete. 2023-12-01T01:03:44.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecdc61ab80 20 client.15060 trim_cache size 0 max 16384 2023-12-01T01:03:44.270 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:03:44.270 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "48bff570-8fe4-11ee-95a2-87774f69a715", 2023-12-01T01:03:44.270 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 1, 2023-12-01T01:03:44.270 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 24493, 2023-12-01T01:03:44.270 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-12-01T01:03:44.270 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-12-01T01:03:44.270 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-12-01T01:03:44.270 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 53.944801527999999, 2023-12-01T01:03:44.270 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 23, 2023-12-01T01:03:44.270 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 83, 2023-12-01T01:03:44.271 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 81, 2023-12-01T01:03:44.271 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 67.767910057999998 2023-12-01T01:03:44.271 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:03:44.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecd048a700 1 -- 172.21.15.26:0/172216720 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fecb40a0630 msgr2=0x7fecb40a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecd048a700 1 --2- 172.21.15.26:0/172216720 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fecb40a0630 0x7fecb40a2af0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fecb8005950 tx=0x7fecb80058e0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecd048a700 1 -- 172.21.15.26:0/172216720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc80ffca0 msgr2=0x7fecc8069c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecd048a700 1 --2- 172.21.15.26:0/172216720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc80ffca0 0x7fecc8069c50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fecc400d980 tx=0x7fecc400dd40 comp rx=0 tx=0).stop 2023-12-01T01:03:44.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecd048a700 1 -- 172.21.15.26:0/172216720 shutdown_connections 2023-12-01T01:03:44.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecd048a700 1 --2- 172.21.15.26:0/172216720 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fecb40a0630 0x7fecb40a2af0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecd048a700 1 --2- 172.21.15.26:0/172216720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fecc8101830 0x7fecc81a02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecd048a700 1 --2- 172.21.15.26:0/172216720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fecc80ffca0 0x7fecc8069c50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecd048a700 1 --2- 172.21.15.26:0/172216720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecc8100e90 0x7fecc819dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.262+0000 7fecd048a700 1 -- 172.21.15.26:0/172216720 >> 172.21.15.26:0/172216720 conn(0x7fecc80fb250 msgr2=0x7fecc80fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.263+0000 7fecd048a700 1 -- 172.21.15.26:0/172216720 shutdown_connections 2023-12-01T01:03:44.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.263+0000 7fecd048a700 1 -- 172.21.15.26:0/172216720 wait complete. 2023-12-01T01:03:44.276 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-01T01:03:44.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.402+0000 7fbe2b02f700 1 -- 172.21.15.26:0/819846702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24100ea0 msgr2=0x7fbe24101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.402+0000 7fbe2b02f700 1 --2- 172.21.15.26:0/819846702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24100ea0 0x7fbe24101300 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbe100099c0 tx=0x7fbe10009cd0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.402+0000 7fbe2b02f700 1 -- 172.21.15.26:0/819846702 shutdown_connections 2023-12-01T01:03:44.414 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.402+0000 7fbe2b02f700 1 --2- 172.21.15.26:0/819846702 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe24101840 0x7fbe241080f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.402+0000 7fbe2b02f700 1 --2- 172.21.15.26:0/819846702 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe240ffcb0 0x7fbe241000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.402+0000 7fbe2b02f700 1 --2- 172.21.15.26:0/819846702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24100ea0 0x7fbe24101300 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.402+0000 7fbe2b02f700 1 -- 172.21.15.26:0/819846702 >> 172.21.15.26:0/819846702 conn(0x7fbe240fb220 msgr2=0x7fbe240fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.402+0000 7fbe2b02f700 1 -- 172.21.15.26:0/819846702 shutdown_connections 2023-12-01T01:03:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.402+0000 7fbe2b02f700 1 -- 172.21.15.26:0/819846702 wait complete. 2023-12-01T01:03:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.402+0000 7fbe2b02f700 1 Processor -- start 2023-12-01T01:03:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe2b02f700 1 -- start start 2023-12-01T01:03:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe2b02f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe240ffcb0 0x7fbe24196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe2b02f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24100ea0 0x7fbe24197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe2b02f700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe24101840 0x7fbe2419e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe2b02f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2419e670 con 0x7fbe24100ea0 2023-12-01T01:03:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe2b02f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2419e7b0 con 0x7fbe240ffcb0 2023-12-01T01:03:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe2b02f700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2419e940 con 0x7fbe24101840 2023-12-01T01:03:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe23fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24100ea0 0x7fbe24197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe23fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24100ea0 0x7fbe24197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54426/0 (socket says 172.21.15.26:54426) 2023-12-01T01:03:44.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe23fff700 1 -- 172.21.15.26:0/3419601867 learned_addr learned my addr 172.21.15.26:0/3419601867 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:44.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe295cc700 1 --2- 172.21.15.26:0/3419601867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe24101840 0x7fbe2419e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe28dcb700 1 --2- 172.21.15.26:0/3419601867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe240ffcb0 0x7fbe24196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe23fff700 1 -- 172.21.15.26:0/3419601867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe24101840 msgr2=0x7fbe2419e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe23fff700 1 --2- 172.21.15.26:0/3419601867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe24101840 0x7fbe2419e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe23fff700 1 -- 172.21.15.26:0/3419601867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe240ffcb0 msgr2=0x7fbe24196af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe23fff700 1 --2- 172.21.15.26:0/3419601867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe240ffcb0 0x7fbe24196af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe23fff700 1 -- 172.21.15.26:0/3419601867 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe100095f0 con 0x7fbe24100ea0 2023-12-01T01:03:44.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe23fff700 1 --2- 172.21.15.26:0/3419601867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24100ea0 0x7fbe24197030 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000c010 tx=0x7fbe10009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe21ffb700 1 -- 172.21.15.26:0/3419601867 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1001d070 con 0x7fbe24100ea0 2023-12-01T01:03:44.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe21ffb700 1 -- 172.21.15.26:0/3419601867 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbe10022470 con 0x7fbe24100ea0 2023-12-01T01:03:44.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe2b02f700 1 -- 172.21.15.26:0/3419601867 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2419ebc0 con 0x7fbe24100ea0 2023-12-01T01:03:44.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.403+0000 7fbe21ffb700 1 -- 172.21.15.26:0/3419601867 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe10017630 con 0x7fbe24100ea0 2023-12-01T01:03:44.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.404+0000 7fbe2b02f700 1 -- 172.21.15.26:0/3419601867 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2419f040 con 0x7fbe24100ea0 2023-12-01T01:03:44.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.406+0000 7fbe21ffb700 1 -- 172.21.15.26:0/3419601867 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fbe10022950 con 0x7fbe24100ea0 2023-12-01T01:03:44.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.406+0000 7fbe21ffb700 1 --2- 172.21.15.26:0/3419601867 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe140a0630 0x7fbe140a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.406+0000 7fbe21ffb700 1 -- 172.21.15.26:0/3419601867 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbe100ccc60 con 0x7fbe24100ea0 2023-12-01T01:03:44.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.407+0000 7fbe28dcb700 1 --2- 172.21.15.26:0/3419601867 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe140a0630 0x7fbe140a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.407+0000 7fbe28dcb700 1 --2- 172.21.15.26:0/3419601867 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe140a0630 0x7fbe140a2af0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbe24100d00 tx=0x7fbe18009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.407+0000 7fbe371bfb80 1 Processor -- start 2023-12-01T01:03:44.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.407+0000 7fbe371bfb80 1 -- start start 2023-12-01T01:03:44.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.407+0000 7fbe371bfb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d10a0 0x55a82a1d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.407+0000 7fbe371bfb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d1a20 0x55a82a1cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.407+0000 7fbe371bfb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d03a0 0x55a82a1d0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.407+0000 7fbe371bfb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82a1279c0 con 0x55a82a1d1a20 2023-12-01T01:03:44.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.407+0000 7fbe371bfb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82a125380 con 0x55a82a1d03a0 2023-12-01T01:03:44.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.407+0000 7fbe371bfb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82a120c70 con 0x55a82a1d10a0 2023-12-01T01:03:44.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.407+0000 7fbe23fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d1a20 0x55a82a1cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.407+0000 7fbe23fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d1a20 0x55a82a1cfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54434/0 (socket says 172.21.15.26:54434) 2023-12-01T01:03:44.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.407+0000 7fbe23fff700 1 -- 172.21.15.26:0/1939122226 learned_addr learned my addr 172.21.15.26:0/1939122226 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:44.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.408+0000 7fbe295cc700 1 --2- 172.21.15.26:0/1939122226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d03a0 0x55a82a1d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.408+0000 7fbe23fff700 1 -- 172.21.15.26:0/1939122226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d10a0 msgr2=0x55a82a1d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.408+0000 7fbe23fff700 1 --2- 172.21.15.26:0/1939122226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d10a0 0x55a82a1d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.408+0000 7fbe23fff700 1 -- 172.21.15.26:0/1939122226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d03a0 msgr2=0x55a82a1d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.408+0000 7fbe23fff700 1 --2- 172.21.15.26:0/1939122226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d03a0 0x55a82a1d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.408+0000 7fbe23fff700 1 -- 172.21.15.26:0/1939122226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a829f4ed90 con 0x55a82a1d1a20 2023-12-01T01:03:44.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.408+0000 7fbe295cc700 1 --2- 172.21.15.26:0/1939122226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d03a0 0x55a82a1d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:03:44.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.408+0000 7fbe23fff700 1 --2- 172.21.15.26:0/1939122226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d1a20 0x55a82a1cfe10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbe100a1f70 tx=0x7fbe1009a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f6523d314b0df server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.408+0000 7fbe0effd700 1 -- 172.21.15.26:0/1939122226 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1009e120 con 0x55a82a1d1a20 2023-12-01T01:03:44.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.408+0000 7fbe0effd700 1 -- 172.21.15.26:0/1939122226 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbe1009abc0 con 0x55a82a1d1a20 2023-12-01T01:03:44.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.408+0000 7fbe0effd700 1 -- 172.21.15.26:0/1939122226 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe10099c10 con 0x55a82a1d1a20 2023-12-01T01:03:44.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.409+0000 7fbe371bfb80 1 -- 172.21.15.26:0/1939122226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d1a20 msgr2=0x55a82a1cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.409+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/1939122226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d1a20 0x55a82a1cfe10 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbe100a1f70 tx=0x7fbe1009a360 comp rx=0 tx=0).stop 2023-12-01T01:03:44.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.409+0000 7fbe371bfb80 1 -- 172.21.15.26:0/1939122226 shutdown_connections 2023-12-01T01:03:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.409+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/1939122226 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d03a0 0x55a82a1d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.409+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/1939122226 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d10a0 0x55a82a1d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.409+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/1939122226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d1a20 0x55a82a1cfe10 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.409+0000 7fbe371bfb80 1 -- 172.21.15.26:0/1939122226 >> 172.21.15.26:0/1939122226 conn(0x55a82a12f080 msgr2=0x55a82a1ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.409+0000 7fbe371bfb80 1 -- 172.21.15.26:0/1939122226 shutdown_connections 2023-12-01T01:03:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.409+0000 7fbe371bfb80 1 -- 172.21.15.26:0/1939122226 wait complete. 2023-12-01T01:03:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.409+0000 7fbe371bfb80 1 -- start start 2023-12-01T01:03:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.409+0000 7fbe371bfb80 1 Processor -- start 2023-12-01T01:03:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe371bfb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d03a0 0x55a82a1d95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe371bfb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d10a0 0x55a82a1d9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe371bfb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d1a20 0x55a82a1e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe371bfb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82a0bd4c0 con 0x55a82a1d03a0 2023-12-01T01:03:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe371bfb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82a0bd160 con 0x55a82a1d10a0 2023-12-01T01:03:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe371bfb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a829fa48d0 con 0x55a82a1d1a20 2023-12-01T01:03:44.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe28dcb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d03a0 0x55a82a1d95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe371bfb80 10 client.0 _ll_register_callbacks cb 0x55a82a00aa30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:03:44.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe28dcb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d03a0 0x55a82a1d95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54438/0 (socket says 172.21.15.26:54438) 2023-12-01T01:03:44.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe28dcb700 1 -- 172.21.15.26:0/4062641210 learned_addr learned my addr 172.21.15.26:0/4062641210 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:44.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe295cc700 1 --2- 172.21.15.26:0/4062641210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d1a20 0x55a82a1e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe23fff700 1 --2- 172.21.15.26:0/4062641210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d10a0 0x55a82a1d9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe28dcb700 1 -- 172.21.15.26:0/4062641210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d1a20 msgr2=0x55a82a1e0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe28dcb700 1 --2- 172.21.15.26:0/4062641210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d1a20 0x55a82a1e0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe28dcb700 1 -- 172.21.15.26:0/4062641210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d10a0 msgr2=0x55a82a1d9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe28dcb700 1 --2- 172.21.15.26:0/4062641210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d10a0 0x55a82a1d9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe28dcb700 1 -- 172.21.15.26:0/4062641210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2419f040 con 0x55a82a1d03a0 2023-12-01T01:03:44.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe23fff700 1 --2- 172.21.15.26:0/4062641210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d10a0 0x55a82a1d9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:03:44.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe28dcb700 1 --2- 172.21.15.26:0/4062641210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d03a0 0x55a82a1d95c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800e700 tx=0x7fbe18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73afea82761a5f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe03fff700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:03:44.420 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe03fff700 1 -- 172.21.15.26:0/4062641210 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe18004220 con 0x55a82a1d03a0 2023-12-01T01:03:44.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe03fff700 1 -- 172.21.15.26:0/4062641210 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbe18004380 con 0x55a82a1d03a0 2023-12-01T01:03:44.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.410+0000 7fbe371bfb80 1 -- 172.21.15.26:0/4062641210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a82a14bcc0 con 0x55a82a1d03a0 2023-12-01T01:03:44.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.411+0000 7fbe03fff700 1 -- 172.21.15.26:0/4062641210 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe1802c030 con 0x55a82a1d03a0 2023-12-01T01:03:44.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.411+0000 7fbe371bfb80 10 client.15072 fetch_fsmap learned FSMap version 23 2023-12-01T01:03:44.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.411+0000 7fbe371bfb80 1 -- 172.21.15.26:0/4062641210 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55a829f37c10 con 0x55a82a1d03a0 2023-12-01T01:03:44.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.411+0000 7fbe03fff700 1 -- 172.21.15.26:0/4062641210 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55a82a14bcc0 con 0x55a82a1d03a0 2023-12-01T01:03:44.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.411+0000 7fbe03fff700 1 -- 172.21.15.26:0/4062641210 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fbe18026750 con 0x55a82a1d03a0 2023-12-01T01:03:44.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.411+0000 7fbe371bfb80 10 client.15072 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:03:44.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.411+0000 7fbe371bfb80 10 client.15072 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-01T01:03:44.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.411+0000 7fbe371bfb80 20 client.15072 populate_metadata read hostname 'smithi026' 2023-12-01T01:03:44.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.411+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/4062641210 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a82a1e4e50 0x55a82a1e3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.411+0000 7fbe371bfb80 4 client.15072 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:03:44.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.411+0000 7fbe371bfb80 1 -- 172.21.15.26:0/4062641210 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a82a19edc0 con 0x55a82a1e4e50 2023-12-01T01:03:44.421 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.411+0000 7fbe23fff700 1 --2- 172.21.15.26:0/4062641210 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a82a1e4e50 0x55a82a1e3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.412+0000 7fbe03fff700 10 client.15072 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:03:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.412+0000 7fbe23fff700 1 --2- 172.21.15.26:0/4062641210 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a82a1e4e50 0x55a82a1e3ca0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8a84d1d602023d0 server_cookie=98a9d193075735a1 in_seq=0 out_seq=0 2023-12-01T01:03:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.412+0000 7fbe03fff700 1 -- 172.21.15.26:0/4062641210 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55a82a19edc0 con 0x55a82a1e4e50 2023-12-01T01:03:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.412+0000 7fbe03fff700 10 client.15072 handle_command_reply: tid=0 2023-12-01T01:03:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.412+0000 7fbe371bfb80 1 client.15072 shutdown 2023-12-01T01:03:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.412+0000 7fbe371bfb80 1 -- 172.21.15.26:0/4062641210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d03a0 msgr2=0x55a82a1d95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.412+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/4062641210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d03a0 0x55a82a1d95c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800e700 tx=0x7fbe18004750 comp rx=0 tx=0).stop 2023-12-01T01:03:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.412+0000 7fbe371bfb80 1 -- 172.21.15.26:0/4062641210 shutdown_connections 2023-12-01T01:03:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.413+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/4062641210 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a82a1e4e50 0x55a82a1e3ca0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.413+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/4062641210 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d1a20 0x55a82a1e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.413+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/4062641210 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d03a0 0x55a82a1d95c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.413+0000 7fbe03fff700 0 client.15072 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:03:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.413+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/4062641210 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d10a0 0x55a82a1d9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.413+0000 7fbe371bfb80 1 -- 172.21.15.26:0/4062641210 >> 172.21.15.26:0/4062641210 conn(0x55a82a12f080 msgr2=0x55a82a1ca060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.413+0000 7fbe371bfb80 1 -- 172.21.15.26:0/4062641210 shutdown_connections 2023-12-01T01:03:44.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.413+0000 7fbe371bfb80 1 -- 172.21.15.26:0/4062641210 wait complete. 2023-12-01T01:03:44.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.413+0000 7fbe371bfb80 20 client.15072 trim_cache size 0 max 16384 2023-12-01T01:03:44.438 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe371bfb80 1 Processor -- start 2023-12-01T01:03:44.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe371bfb80 1 -- start start 2023-12-01T01:03:44.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe371bfb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d03a0 0x55a82a1e3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe371bfb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d10a0 0x55a82a1e41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe371bfb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d1a20 0x55a82a1ed5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe371bfb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82a1cb4c0 con 0x55a82a1d10a0 2023-12-01T01:03:44.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe371bfb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82a0ca830 con 0x55a82a1d03a0 2023-12-01T01:03:44.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe371bfb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82a0eb0b0 con 0x55a82a1d1a20 2023-12-01T01:03:44.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe23fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d10a0 0x55a82a1e41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe23fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d10a0 0x55a82a1e41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54448/0 (socket says 172.21.15.26:54448) 2023-12-01T01:03:44.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe23fff700 1 -- 172.21.15.26:0/907200941 learned_addr learned my addr 172.21.15.26:0/907200941 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:44.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe295cc700 1 --2- 172.21.15.26:0/907200941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d1a20 0x55a82a1ed5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe28dcb700 1 --2- 172.21.15.26:0/907200941 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d03a0 0x55a82a1e3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe23fff700 1 -- 172.21.15.26:0/907200941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d1a20 msgr2=0x55a82a1ed5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe23fff700 1 --2- 172.21.15.26:0/907200941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d1a20 0x55a82a1ed5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe23fff700 1 -- 172.21.15.26:0/907200941 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d03a0 msgr2=0x55a82a1e3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe23fff700 1 --2- 172.21.15.26:0/907200941 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d03a0 0x55a82a1e3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.430+0000 7fbe23fff700 1 -- 172.21.15.26:0/907200941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a829f75200 con 0x55a82a1d10a0 2023-12-01T01:03:44.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.431+0000 7fbe295cc700 1 --2- 172.21.15.26:0/907200941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d1a20 0x55a82a1ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:03:44.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.431+0000 7fbe23fff700 1 --2- 172.21.15.26:0/907200941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d10a0 0x55a82a1e41e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbe10096f30 tx=0x7fbe1001a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aef57c463199ba4 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.431+0000 7fbe0f7fe700 1 -- 172.21.15.26:0/907200941 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe10098960 con 0x55a82a1d10a0 2023-12-01T01:03:44.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.431+0000 7fbe0f7fe700 1 -- 172.21.15.26:0/907200941 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbe1009a4c0 con 0x55a82a1d10a0 2023-12-01T01:03:44.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.431+0000 7fbe0f7fe700 1 -- 172.21.15.26:0/907200941 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100cabd0 con 0x55a82a1d10a0 2023-12-01T01:03:44.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.431+0000 7fbe371bfb80 1 -- 172.21.15.26:0/907200941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d10a0 msgr2=0x55a82a1e41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.431+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/907200941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d10a0 0x55a82a1e41e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbe10096f30 tx=0x7fbe1001a040 comp rx=0 tx=0).stop 2023-12-01T01:03:44.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.431+0000 7fbe371bfb80 1 -- 172.21.15.26:0/907200941 shutdown_connections 2023-12-01T01:03:44.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.431+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/907200941 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d1a20 0x55a82a1ed5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.431+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/907200941 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d03a0 0x55a82a1e3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.431+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/907200941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d10a0 0x55a82a1e41e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.431+0000 7fbe371bfb80 1 -- 172.21.15.26:0/907200941 >> 172.21.15.26:0/907200941 conn(0x55a82a12f080 msgr2=0x55a82a1d8230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.431+0000 7fbe371bfb80 1 -- 172.21.15.26:0/907200941 shutdown_connections 2023-12-01T01:03:44.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.431+0000 7fbe371bfb80 1 -- 172.21.15.26:0/907200941 wait complete. 2023-12-01T01:03:44.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.432+0000 7fbe371bfb80 1 -- start start 2023-12-01T01:03:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.432+0000 7fbe371bfb80 1 Processor -- start 2023-12-01T01:03:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.432+0000 7fbe371bfb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d03a0 0x55a82a1ea7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.432+0000 7fbe371bfb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d10a0 0x55a82a1ead10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.432+0000 7fbe371bfb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d1a20 0x55a82a1ebd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.432+0000 7fbe371bfb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82a1ec260 con 0x55a82a1d10a0 2023-12-01T01:03:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.432+0000 7fbe371bfb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82a1ec3d0 con 0x55a82a1d1a20 2023-12-01T01:03:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.432+0000 7fbe371bfb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82a1ec590 con 0x55a82a1d03a0 2023-12-01T01:03:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.432+0000 7fbe371bfb80 10 client.0 _ll_register_callbacks cb 0x7fbe18011ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:03:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.432+0000 7fbe23fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d10a0 0x55a82a1ead10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.432+0000 7fbe23fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d10a0 0x55a82a1ead10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54454/0 (socket says 172.21.15.26:54454) 2023-12-01T01:03:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.432+0000 7fbe23fff700 1 -- 172.21.15.26:0/3884221730 learned_addr learned my addr 172.21.15.26:0/3884221730 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.432+0000 7fbe28dcb700 1 --2- 172.21.15.26:0/3884221730 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d03a0 0x55a82a1ea7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.432+0000 7fbe295cc700 1 --2- 172.21.15.26:0/3884221730 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d1a20 0x55a82a1ebd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe23fff700 1 -- 172.21.15.26:0/3884221730 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d03a0 msgr2=0x55a82a1ea7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe23fff700 1 --2- 172.21.15.26:0/3884221730 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d03a0 0x55a82a1ea7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe23fff700 1 -- 172.21.15.26:0/3884221730 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d1a20 msgr2=0x55a82a1ebd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:03:44.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe23fff700 1 --2- 172.21.15.26:0/3884221730 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d1a20 0x55a82a1ebd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe23fff700 1 -- 172.21.15.26:0/3884221730 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a829f4ed90 con 0x55a82a1d10a0 2023-12-01T01:03:44.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe295cc700 1 --2- 172.21.15.26:0/3884221730 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d1a20 0x55a82a1ebd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:03:44.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe23fff700 1 --2- 172.21.15.26:0/3884221730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d10a0 0x55a82a1ead10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbe1009a1c0 tx=0x7fbe1009a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6029f7734790e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:44.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe03fff700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:03:44.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe03fff700 1 -- 172.21.15.26:0/3884221730 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe100b6070 con 0x55a82a1d10a0 2023-12-01T01:03:44.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe03fff700 1 -- 172.21.15.26:0/3884221730 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbe100b82b0 con 0x55a82a1d10a0 2023-12-01T01:03:44.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe371bfb80 1 -- 172.21.15.26:0/3884221730 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe1009abc0 con 0x55a82a1d10a0 2023-12-01T01:03:44.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe03fff700 1 -- 172.21.15.26:0/3884221730 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe100226a0 con 0x55a82a1d10a0 2023-12-01T01:03:44.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe371bfb80 10 client.15078 fetch_fsmap learned FSMap version 23 2023-12-01T01:03:44.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe371bfb80 1 -- 172.21.15.26:0/3884221730 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55a829f4d260 con 0x55a82a1d10a0 2023-12-01T01:03:44.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe03fff700 1 -- 172.21.15.26:0/3884221730 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbe1009abc0 con 0x55a82a1d10a0 2023-12-01T01:03:44.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe03fff700 1 -- 172.21.15.26:0/3884221730 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fbe100b2bd0 con 0x55a82a1d10a0 2023-12-01T01:03:44.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe371bfb80 10 client.15078 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:03:44.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe371bfb80 10 client.15078 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-01T01:03:44.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe371bfb80 20 client.15078 populate_metadata read hostname 'smithi026' 2023-12-01T01:03:44.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/3884221730 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a82a23b490 0x55a82a238340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:44.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe371bfb80 4 client.15078 mds_command: new command op to 24509 tid=0[{"prefix": "status"}] 2023-12-01T01:03:44.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.433+0000 7fbe371bfb80 1 -- 172.21.15.26:0/3884221730 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a82a119cf0 con 0x55a82a23b490 2023-12-01T01:03:44.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.434+0000 7fbe28dcb700 1 --2- 172.21.15.26:0/3884221730 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a82a23b490 0x55a82a238340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:44.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.434+0000 7fbe03fff700 10 client.15078 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:03:44.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.434+0000 7fbe28dcb700 1 --2- 172.21.15.26:0/3884221730 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a82a23b490 0x55a82a238340 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d92d48f67370aa03 server_cookie=b6b3b4af456ad1d4 in_seq=0 out_seq=0 2023-12-01T01:03:44.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.434+0000 7fbe03fff700 1 -- 172.21.15.26:0/3884221730 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55a82a119cf0 con 0x55a82a23b490 2023-12-01T01:03:44.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.434+0000 7fbe03fff700 10 client.15078 handle_command_reply: tid=0 2023-12-01T01:03:44.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.434+0000 7fbe371bfb80 1 client.15078 shutdown 2023-12-01T01:03:44.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe371bfb80 1 -- 172.21.15.26:0/3884221730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d10a0 msgr2=0x55a82a1ead10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/3884221730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d10a0 0x55a82a1ead10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbe1009a1c0 tx=0x7fbe1009a360 comp rx=0 tx=0).stop 2023-12-01T01:03:44.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe371bfb80 1 -- 172.21.15.26:0/3884221730 shutdown_connections 2023-12-01T01:03:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/3884221730 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a82a23b490 0x55a82a238340 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/3884221730 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a82a1d1a20 0x55a82a1ebd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe03fff700 0 client.15078 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:03:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/3884221730 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a82a1d03a0 0x55a82a1ea7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe371bfb80 1 --2- 172.21.15.26:0/3884221730 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a82a1d10a0 0x55a82a1ead10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe371bfb80 1 -- 172.21.15.26:0/3884221730 >> 172.21.15.26:0/3884221730 conn(0x55a82a12f080 msgr2=0x55a82a1d4360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe371bfb80 1 -- 172.21.15.26:0/3884221730 shutdown_connections 2023-12-01T01:03:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe371bfb80 1 -- 172.21.15.26:0/3884221730 wait complete. 2023-12-01T01:03:44.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe371bfb80 20 client.15078 trim_cache size 0 max 16384 2023-12-01T01:03:44.445 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:03:44.445 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "48bff570-8fe4-11ee-95a2-87774f69a715", 2023-12-01T01:03:44.446 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-12-01T01:03:44.446 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 24509, 2023-12-01T01:03:44.446 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-12-01T01:03:44.446 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-12-01T01:03:44.447 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-12-01T01:03:44.447 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 57.179539427999998, 2023-12-01T01:03:44.447 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 23, 2023-12-01T01:03:44.447 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 83, 2023-12-01T01:03:44.447 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 81, 2023-12-01T01:03:44.447 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 63.438556474999999 2023-12-01T01:03:44.447 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:03:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe2b02f700 1 -- 172.21.15.26:0/3419601867 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe140a0630 msgr2=0x7fbe140a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe2b02f700 1 --2- 172.21.15.26:0/3419601867 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe140a0630 0x7fbe140a2af0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbe24100d00 tx=0x7fbe18009260 comp rx=0 tx=0).stop 2023-12-01T01:03:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe2b02f700 1 -- 172.21.15.26:0/3419601867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24100ea0 msgr2=0x7fbe24197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe2b02f700 1 --2- 172.21.15.26:0/3419601867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24100ea0 0x7fbe24197030 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000c010 tx=0x7fbe10009580 comp rx=0 tx=0).stop 2023-12-01T01:03:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe2b02f700 1 -- 172.21.15.26:0/3419601867 shutdown_connections 2023-12-01T01:03:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe2b02f700 1 --2- 172.21.15.26:0/3419601867 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbe140a0630 0x7fbe140a2af0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe2b02f700 1 --2- 172.21.15.26:0/3419601867 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbe24101840 0x7fbe2419e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe2b02f700 1 --2- 172.21.15.26:0/3419601867 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbe240ffcb0 0x7fbe24196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe2b02f700 1 --2- 172.21.15.26:0/3419601867 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24100ea0 0x7fbe24197030 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe2b02f700 1 -- 172.21.15.26:0/3419601867 >> 172.21.15.26:0/3419601867 conn(0x7fbe240fb220 msgr2=0x7fbe241042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.435+0000 7fbe2b02f700 1 -- 172.21.15.26:0/3419601867 shutdown_connections 2023-12-01T01:03:44.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:44.436+0000 7fbe2b02f700 1 -- 172.21.15.26:0/3419601867 wait complete. 2023-12-01T01:03:44.450 INFO:tasks.cephadm:Setup complete, yielding 2023-12-01T01:03:44.450 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-01T01:03:44.459 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi026.front.sepia.ceph.com 2023-12-01T01:03:44.460 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- bash -c 'ceph orch status' 2023-12-01T01:03:45.018 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:45.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:44 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/481839784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:03:45.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:44 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/481839784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:03:45.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:44 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/481839784' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:03:46.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:45 smithi026 ceph-mon[98801]: pgmap v276: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-01T01:03:46.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:45 smithi116 ceph-mon[103554]: pgmap v276: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-01T01:03:46.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:45 smithi093 ceph-mon[103327]: pgmap v276: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-01T01:03:46.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.342+0000 7fe35143d700 1 -- 172.21.15.26:0/4263021496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c1041e0 msgr2=0x7fe34c1065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:46.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.342+0000 7fe35143d700 1 --2- 172.21.15.26:0/4263021496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c1041e0 0x7fe34c1065d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009990 tx=0x7fe33c009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:46.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.342+0000 7fe35143d700 1 -- 172.21.15.26:0/4263021496 shutdown_connections 2023-12-01T01:03:46.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.342+0000 7fe35143d700 1 --2- 172.21.15.26:0/4263021496 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe34c106b10 0x7fe34c108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:46.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.342+0000 7fe35143d700 1 --2- 172.21.15.26:0/4263021496 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c1018b0 0x7fe34c103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:46.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.342+0000 7fe35143d700 1 --2- 172.21.15.26:0/4263021496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c1041e0 0x7fe34c1065d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:46.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.342+0000 7fe35143d700 1 -- 172.21.15.26:0/4263021496 >> 172.21.15.26:0/4263021496 conn(0x7fe34c0fb2a0 msgr2=0x7fe34c0fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:46.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.342+0000 7fe35143d700 1 -- 172.21.15.26:0/4263021496 shutdown_connections 2023-12-01T01:03:46.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.342+0000 7fe35143d700 1 -- 172.21.15.26:0/4263021496 wait complete. 2023-12-01T01:03:46.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.342+0000 7fe35143d700 1 Processor -- start 2023-12-01T01:03:46.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe35143d700 1 -- start start 2023-12-01T01:03:46.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe35143d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe34c1018b0 0x7fe34c196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:46.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe35143d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c1041e0 0x7fe34c1970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:46.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe35143d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c106b10 0x7fe34c19e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:46.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe35143d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c19e700 con 0x7fe34c1041e0 2023-12-01T01:03:46.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe35143d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c19e840 con 0x7fe34c106b10 2023-12-01T01:03:46.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe35143d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34c19e9d0 con 0x7fe34c1018b0 2023-12-01T01:03:46.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe34a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c1041e0 0x7fe34c1970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:46.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe34a7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c1041e0 0x7fe34c1970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54468/0 (socket says 172.21.15.26:54468) 2023-12-01T01:03:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe34a7fc700 1 -- 172.21.15.26:0/4218924859 learned_addr learned my addr 172.21.15.26:0/4218924859 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe34b7fe700 1 --2- 172.21.15.26:0/4218924859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c106b10 0x7fe34c19e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe34affd700 1 --2- 172.21.15.26:0/4218924859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe34c1018b0 0x7fe34c196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe34a7fc700 1 -- 172.21.15.26:0/4218924859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe34c1018b0 msgr2=0x7fe34c196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe34a7fc700 1 --2- 172.21.15.26:0/4218924859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe34c1018b0 0x7fe34c196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe34a7fc700 1 -- 172.21.15.26:0/4218924859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c106b10 msgr2=0x7fe34c19e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe34a7fc700 1 --2- 172.21.15.26:0/4218924859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c106b10 0x7fe34c19e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe34a7fc700 1 -- 172.21.15.26:0/4218924859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c0095f0 con 0x7fe34c1041e0 2023-12-01T01:03:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.343+0000 7fe34a7fc700 1 --2- 172.21.15.26:0/4218924859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c1041e0 0x7fe34c1970b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe33c006010 tx=0x7fe33c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.344+0000 7fe343fff700 1 -- 172.21.15.26:0/4218924859 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c01d070 con 0x7fe34c1041e0 2023-12-01T01:03:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.344+0000 7fe35143d700 1 -- 172.21.15.26:0/4218924859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe34c19ec50 con 0x7fe34c1041e0 2023-12-01T01:03:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.344+0000 7fe343fff700 1 -- 172.21.15.26:0/4218924859 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe33c00fb40 con 0x7fe34c1041e0 2023-12-01T01:03:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.344+0000 7fe343fff700 1 -- 172.21.15.26:0/4218924859 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33c017650 con 0x7fe34c1041e0 2023-12-01T01:03:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.344+0000 7fe35143d700 1 -- 172.21.15.26:0/4218924859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34c19f0c0 con 0x7fe34c1041e0 2023-12-01T01:03:46.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.345+0000 7fe35143d700 1 -- 172.21.15.26:0/4218924859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe34c10c770 con 0x7fe34c1041e0 2023-12-01T01:03:46.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.346+0000 7fe343fff700 1 -- 172.21.15.26:0/4218924859 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fe33c00fcb0 con 0x7fe34c1041e0 2023-12-01T01:03:46.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.346+0000 7fe343fff700 1 --2- 172.21.15.26:0/4218924859 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe3380a0630 0x7fe3380a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:46.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.347+0000 7fe34affd700 1 --2- 172.21.15.26:0/4218924859 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe3380a0630 0x7fe3380a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:46.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.347+0000 7fe343fff700 1 -- 172.21.15.26:0/4218924859 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe33c0cd620 con 0x7fe34c1041e0 2023-12-01T01:03:46.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.347+0000 7fe34affd700 1 --2- 172.21.15.26:0/4218924859 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe3380a0630 0x7fe3380a2af0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe334005fd0 tx=0x7fe33400a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:46.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.350+0000 7fe343fff700 1 -- 172.21.15.26:0/4218924859 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe33c097210 con 0x7fe34c1041e0 2023-12-01T01:03:46.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.566+0000 7fe35143d700 1 -- 172.21.15.26:0/4218924859 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe34c103450 con 0x7fe3380a0630 2023-12-01T01:03:46.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.567+0000 7fe343fff700 1 -- 172.21.15.26:0/4218924859 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe34c103450 con 0x7fe3380a0630 2023-12-01T01:03:46.574 INFO:teuthology.orchestra.run.smithi026.stdout:Backend: cephadm 2023-12-01T01:03:46.574 INFO:teuthology.orchestra.run.smithi026.stdout:Available: Yes 2023-12-01T01:03:46.574 INFO:teuthology.orchestra.run.smithi026.stdout:Paused: No 2023-12-01T01:03:46.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.569+0000 7fe35143d700 1 -- 172.21.15.26:0/4218924859 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe3380a0630 msgr2=0x7fe3380a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:46.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.569+0000 7fe35143d700 1 --2- 172.21.15.26:0/4218924859 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe3380a0630 0x7fe3380a2af0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe334005fd0 tx=0x7fe33400a560 comp rx=0 tx=0).stop 2023-12-01T01:03:46.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.569+0000 7fe35143d700 1 -- 172.21.15.26:0/4218924859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c1041e0 msgr2=0x7fe34c1970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:46.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.569+0000 7fe35143d700 1 --2- 172.21.15.26:0/4218924859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c1041e0 0x7fe34c1970b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe33c006010 tx=0x7fe33c00f690 comp rx=0 tx=0).stop 2023-12-01T01:03:46.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.569+0000 7fe35143d700 1 -- 172.21.15.26:0/4218924859 shutdown_connections 2023-12-01T01:03:46.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.569+0000 7fe35143d700 1 --2- 172.21.15.26:0/4218924859 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe3380a0630 0x7fe3380a2af0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:46.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.569+0000 7fe35143d700 1 --2- 172.21.15.26:0/4218924859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe34c106b10 0x7fe34c19e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:46.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.569+0000 7fe35143d700 1 --2- 172.21.15.26:0/4218924859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe34c1018b0 0x7fe34c196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:46.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.569+0000 7fe35143d700 1 --2- 172.21.15.26:0/4218924859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c1041e0 0x7fe34c1970b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:46.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.569+0000 7fe35143d700 1 -- 172.21.15.26:0/4218924859 >> 172.21.15.26:0/4218924859 conn(0x7fe34c0fb2a0 msgr2=0x7fe34c102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:46.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.569+0000 7fe35143d700 1 -- 172.21.15.26:0/4218924859 shutdown_connections 2023-12-01T01:03:46.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:46.570+0000 7fe35143d700 1 -- 172.21.15.26:0/4218924859 wait complete. 2023-12-01T01:03:46.976 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-01T01:03:47.537 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:48.032 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:47 smithi026 ceph-mon[98801]: pgmap v277: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-12-01T01:03:48.033 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:47 smithi026 ceph-mon[98801]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:03:48.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:47 smithi116 ceph-mon[103554]: pgmap v277: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-12-01T01:03:48.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:47 smithi116 ceph-mon[103554]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:03:48.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:47 smithi093 ceph-mon[103327]: pgmap v277: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-12-01T01:03:48.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:47 smithi093 ceph-mon[103327]: from='client.15084 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:03:48.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.746+0000 7f01fcfb6700 1 -- 172.21.15.26:0/2608064445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f8100f20 msgr2=0x7f01f8101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:48.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.746+0000 7f01fcfb6700 1 --2- 172.21.15.26:0/2608064445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f8100f20 0x7f01f8101380 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f01ec0099c0 tx=0x7f01ec009cd0 comp rx=0 tx=0).stop 2023-12-01T01:03:48.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.747+0000 7f01fcfb6700 1 -- 172.21.15.26:0/2608064445 shutdown_connections 2023-12-01T01:03:48.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.747+0000 7f01fcfb6700 1 --2- 172.21.15.26:0/2608064445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01f81018c0 0x7f01f8108170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:48.749 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.747+0000 7f01fcfb6700 1 --2- 172.21.15.26:0/2608064445 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01f80ffd20 0x7f01f8100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.747+0000 7f01fcfb6700 1 --2- 172.21.15.26:0/2608064445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f8100f20 0x7f01f8101380 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.747+0000 7f01fcfb6700 1 -- 172.21.15.26:0/2608064445 >> 172.21.15.26:0/2608064445 conn(0x7f01f80fb2a0 msgr2=0x7f01f80fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.747+0000 7f01fcfb6700 1 -- 172.21.15.26:0/2608064445 shutdown_connections 2023-12-01T01:03:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.747+0000 7f01fcfb6700 1 -- 172.21.15.26:0/2608064445 wait complete. 2023-12-01T01:03:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.747+0000 7f01fcfb6700 1 Processor -- start 2023-12-01T01:03:48.750 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.747+0000 7f01fcfb6700 1 -- start start 2023-12-01T01:03:48.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01fcfb6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f80ffd20 0x7f01f8103cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:48.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01fcfb6700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01f8100f20 0x7f01f8102300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:48.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01fcfb6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01f81018c0 0x7f01f8102840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:48.751 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01fcfb6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f8102fc0 con 0x7f01f80ffd20 2023-12-01T01:03:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01fcfb6700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f8103130 con 0x7f01f81018c0 2023-12-01T01:03:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01fcfb6700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01f81a0bf0 con 0x7f01f8100f20 2023-12-01T01:03:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01f659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f80ffd20 0x7f01f8103cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01f659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f80ffd20 0x7f01f8103cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54480/0 (socket says 172.21.15.26:54480) 2023-12-01T01:03:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01f659c700 1 -- 172.21.15.26:0/4156574183 learned_addr learned my addr 172.21.15.26:0/4156574183 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01f5d9b700 1 --2- 172.21.15.26:0/4156574183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01f8100f20 0x7f01f8102300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01f6d9d700 1 --2- 172.21.15.26:0/4156574183 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01f81018c0 0x7f01f8102840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01f659c700 1 -- 172.21.15.26:0/4156574183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01f8100f20 msgr2=0x7f01f8102300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01f659c700 1 --2- 172.21.15.26:0/4156574183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01f8100f20 0x7f01f8102300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01f659c700 1 -- 172.21.15.26:0/4156574183 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01f81018c0 msgr2=0x7f01f8102840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01f659c700 1 --2- 172.21.15.26:0/4156574183 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01f81018c0 0x7f01f8102840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01f659c700 1 -- 172.21.15.26:0/4156574183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec0095f0 con 0x7f01f80ffd20 2023-12-01T01:03:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01f659c700 1 --2- 172.21.15.26:0/4156574183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f80ffd20 0x7f01f8103cb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f01e800e970 tx=0x7f01e800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01e77fe700 1 -- 172.21.15.26:0/4156574183 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e8009790 con 0x7f01f80ffd20 2023-12-01T01:03:48.752 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01e77fe700 1 -- 172.21.15.26:0/4156574183 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f01e800ccc0 con 0x7f01f80ffd20 2023-12-01T01:03:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01fcfb6700 1 -- 172.21.15.26:0/4156574183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01f81a0ed0 con 0x7f01f80ffd20 2023-12-01T01:03:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.748+0000 7f01e77fe700 1 -- 172.21.15.26:0/4156574183 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e8003d80 con 0x7f01f80ffd20 2023-12-01T01:03:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.749+0000 7f01fcfb6700 1 -- 172.21.15.26:0/4156574183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01f81a12e0 con 0x7f01f80ffd20 2023-12-01T01:03:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.749+0000 7f01fcfb6700 1 -- 172.21.15.26:0/4156574183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01f810b660 con 0x7f01f80ffd20 2023-12-01T01:03:48.753 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.751+0000 7f01e77fe700 1 -- 172.21.15.26:0/4156574183 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f01e800c7e0 con 0x7f01f80ffd20 2023-12-01T01:03:48.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.752+0000 7f01e77fe700 1 --2- 172.21.15.26:0/4156574183 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f01e00a05b0 0x7f01e00a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:48.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.752+0000 7f01f5d9b700 1 --2- 172.21.15.26:0/4156574183 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f01e00a05b0 0x7f01e00a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:48.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.752+0000 7f01e77fe700 1 -- 172.21.15.26:0/4156574183 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f01e8014070 con 0x7f01f80ffd20 2023-12-01T01:03:48.754 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.752+0000 7f01f5d9b700 1 --2- 172.21.15.26:0/4156574183 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f01e00a05b0 0x7f01e00a2a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f01ec000c00 tx=0x7f01ec005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:48.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.755+0000 7f01e77fe700 1 -- 172.21.15.26:0/4156574183 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f01e80957a0 con 0x7f01f80ffd20 2023-12-01T01:03:48.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:48.979+0000 7f01fcfb6700 1 -- 172.21.15.26:0/4156574183 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f01f8068fe0 con 0x7f01e00a05b0 2023-12-01T01:03:49.003 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:49.001+0000 7f01e77fe700 1 -- 172.21.15.26:0/4156574183 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f01f8068fe0 con 0x7f01e00a05b0 2023-12-01T01:03:49.003 INFO:teuthology.orchestra.run.smithi026.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-01T01:03:49.003 INFO:teuthology.orchestra.run.smithi026.stdout:mds.a smithi026 running (70s) 61s ago 70s 14.1M - 18.2.0-1249-ga6f82997 96d837748436 95c853087e18 2023-12-01T01:03:49.004 INFO:teuthology.orchestra.run.smithi026.stdout:mds.b smithi093 running (68s) 61s ago 67s 13.4M - 18.2.0-1249-ga6f82997 96d837748436 3708cec20340 2023-12-01T01:03:49.004 INFO:teuthology.orchestra.run.smithi026.stdout:mds.c smithi116 running (79s) 61s ago 78s 13.4M - 18.2.0-1249-ga6f82997 96d837748436 e90813430685 2023-12-01T01:03:49.004 INFO:teuthology.orchestra.run.smithi026.stdout:mds.d smithi026 running (85s) 61s ago 85s 16.7M - 18.2.0-1249-ga6f82997 96d837748436 ddf87e2e4d72 2023-12-01T01:03:49.004 INFO:teuthology.orchestra.run.smithi026.stdout:mds.e smithi093 running (83s) 61s ago 82s 15.8M - 18.2.0-1249-ga6f82997 96d837748436 b8c8b7103ffe 2023-12-01T01:03:49.004 INFO:teuthology.orchestra.run.smithi026.stdout:mds.f smithi116 running (81s) 61s ago 80s 14.1M - 18.2.0-1249-ga6f82997 96d837748436 4c49480c5e9a 2023-12-01T01:03:49.004 INFO:teuthology.orchestra.run.smithi026.stdout:mds.g smithi026 running (72s) 61s ago 72s 13.3M - 18.2.0-1249-ga6f82997 96d837748436 66caad904af7 2023-12-01T01:03:49.004 INFO:teuthology.orchestra.run.smithi026.stdout:mds.h smithi093 running (77s) 61s ago 76s 14.1M - 18.2.0-1249-ga6f82997 96d837748436 daed2d4db20b 2023-12-01T01:03:49.004 INFO:teuthology.orchestra.run.smithi026.stdout:mds.i smithi116 running (75s) 61s ago 74s 14.0M - 18.2.0-1249-ga6f82997 96d837748436 b2f1b44701db 2023-12-01T01:03:49.004 INFO:teuthology.orchestra.run.smithi026.stdout:mds.j smithi026 running (87s) 61s ago 87s 13.5M - 18.2.0-1249-ga6f82997 96d837748436 0e14b5c6defd 2023-12-01T01:03:49.004 INFO:teuthology.orchestra.run.smithi026.stdout:mds.k smithi093 running (89s) 61s ago 89s 16.7M - 18.2.0-1249-ga6f82997 96d837748436 0570ad131f7e 2023-12-01T01:03:49.004 INFO:teuthology.orchestra.run.smithi026.stdout:mds.l smithi116 running (91s) 61s ago 91s 14.4M - 18.2.0-1249-ga6f82997 96d837748436 845bc277ee72 2023-12-01T01:03:49.004 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.x smithi026 *:9283,8765 running (7m) 61s ago 7m 514M - 18.2.0-1249-ga6f82997 96d837748436 f480fc700e77 2023-12-01T01:03:49.004 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.y smithi093 *:8443,8765 running (5m) 61s ago 5m 449M - 18.2.0-1249-ga6f82997 96d837748436 f2a97e82b346 2023-12-01T01:03:49.004 INFO:teuthology.orchestra.run.smithi026.stdout:mgr.z smithi116 *:8443,8765 running (5m) 61s ago 5m 447M - 18.2.0-1249-ga6f82997 96d837748436 746bac22f939 2023-12-01T01:03:49.005 INFO:teuthology.orchestra.run.smithi026.stdout:mon.a smithi026 running (7m) 61s ago 7m 84.5M 2048M 18.2.0-1249-ga6f82997 96d837748436 eea3c91803a7 2023-12-01T01:03:49.005 INFO:teuthology.orchestra.run.smithi026.stdout:mon.b smithi093 running (6m) 61s ago 6m 57.3M 2048M 18.2.0-1249-ga6f82997 96d837748436 1afe908b974b 2023-12-01T01:03:49.005 INFO:teuthology.orchestra.run.smithi026.stdout:mon.c smithi116 running (6m) 61s ago 6m 58.5M 2048M 18.2.0-1249-ga6f82997 96d837748436 3740ceadb663 2023-12-01T01:03:49.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 smithi026 running (5m) 61s ago 5m 58.2M 4293M 18.2.0-1249-ga6f82997 96d837748436 3cfccd3749e3 2023-12-01T01:03:49.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 smithi093 running (5m) 61s ago 5m 64.5M 4292M 18.2.0-1249-ga6f82997 96d837748436 c96880ba2b62 2023-12-01T01:03:49.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 smithi116 running (4m) 61s ago 4m 56.9M 4292M 18.2.0-1249-ga6f82997 96d837748436 0cb0fcc8be60 2023-12-01T01:03:49.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 smithi026 running (4m) 61s ago 4m 49.8M 4293M 18.2.0-1249-ga6f82997 96d837748436 cbeebd6701aa 2023-12-01T01:03:49.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 smithi093 running (4m) 61s ago 4m 47.2M 4292M 18.2.0-1249-ga6f82997 96d837748436 266cdcb011ab 2023-12-01T01:03:49.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 smithi116 running (3m) 61s ago 3m 52.2M 4292M 18.2.0-1249-ga6f82997 96d837748436 662af1772a9a 2023-12-01T01:03:49.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.6 smithi026 running (3m) 61s ago 3m 45.6M 4293M 18.2.0-1249-ga6f82997 96d837748436 5cd48c4d8a84 2023-12-01T01:03:49.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.7 smithi093 running (3m) 61s ago 3m 51.6M 4292M 18.2.0-1249-ga6f82997 96d837748436 d7c935ad26fe 2023-12-01T01:03:49.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.8 smithi116 running (2m) 61s ago 2m 47.3M 4292M 18.2.0-1249-ga6f82997 96d837748436 ddc2119892a4 2023-12-01T01:03:49.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.9 smithi026 running (2m) 61s ago 2m 44.9M 4293M 18.2.0-1249-ga6f82997 96d837748436 806ff731e8d0 2023-12-01T01:03:49.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.10 smithi093 running (2m) 61s ago 2m 46.2M 4292M 18.2.0-1249-ga6f82997 96d837748436 fedd53901448 2023-12-01T01:03:49.005 INFO:teuthology.orchestra.run.smithi026.stdout:osd.11 smithi116 running (109s) 61s ago 109s 43.3M 4292M 18.2.0-1249-ga6f82997 96d837748436 e20807cddc37 2023-12-01T01:03:49.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:49.003+0000 7f01fcfb6700 1 -- 172.21.15.26:0/4156574183 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f01e00a05b0 msgr2=0x7f01e00a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:49.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:49.003+0000 7f01fcfb6700 1 --2- 172.21.15.26:0/4156574183 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f01e00a05b0 0x7f01e00a2a70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f01ec000c00 tx=0x7f01ec005fb0 comp rx=0 tx=0).stop 2023-12-01T01:03:49.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:49.003+0000 7f01fcfb6700 1 -- 172.21.15.26:0/4156574183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f80ffd20 msgr2=0x7f01f8103cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:49.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:49.003+0000 7f01fcfb6700 1 --2- 172.21.15.26:0/4156574183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f80ffd20 0x7f01f8103cb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f01e800e970 tx=0x7f01e800ec80 comp rx=0 tx=0).stop 2023-12-01T01:03:49.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:49.003+0000 7f01fcfb6700 1 -- 172.21.15.26:0/4156574183 shutdown_connections 2023-12-01T01:03:49.006 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:49.003+0000 7f01fcfb6700 1 --2- 172.21.15.26:0/4156574183 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f01e00a05b0 0x7f01e00a2a70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:49.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:49.003+0000 7f01fcfb6700 1 --2- 172.21.15.26:0/4156574183 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01f81018c0 0x7f01f8102840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:49.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:49.003+0000 7f01fcfb6700 1 --2- 172.21.15.26:0/4156574183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01f80ffd20 0x7f01f8103cb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:49.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:49.003+0000 7f01fcfb6700 1 --2- 172.21.15.26:0/4156574183 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f01f8100f20 0x7f01f8102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:49.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:49.003+0000 7f01fcfb6700 1 -- 172.21.15.26:0/4156574183 >> 172.21.15.26:0/4156574183 conn(0x7f01f80fb2a0 msgr2=0x7f01f80688d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:49.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:49.003+0000 7f01fcfb6700 1 -- 172.21.15.26:0/4156574183 shutdown_connections 2023-12-01T01:03:49.007 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:49.003+0000 7f01fcfb6700 1 -- 172.21.15.26:0/4156574183 wait complete. 2023-12-01T01:03:49.030 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:48 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:03:49.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:48 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:03:49.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:48 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:03:49.401 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-01T01:03:50.023 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:50.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:49 smithi026 ceph-mon[98801]: pgmap v278: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-01T01:03:50.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:49 smithi116 ceph-mon[103554]: pgmap v278: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-01T01:03:50.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:49 smithi093 ceph-mon[103327]: pgmap v278: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-01T01:03:51.039 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:50 smithi026 ceph-mon[98801]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:03:51.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:50 smithi116 ceph-mon[103554]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:03:51.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:50 smithi093 ceph-mon[103327]: from='client.15090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:03:51.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.225+0000 7fbb675ad700 1 -- 172.21.15.26:0/3841316905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb60101910 msgr2=0x7fbb60103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:51.231 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.225+0000 7fbb675ad700 1 --2- 172.21.15.26:0/3841316905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb60101910 0x7fbb60103d00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c009990 tx=0x7fbb5c009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:51.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.225+0000 7fbb675ad700 1 -- 172.21.15.26:0/3841316905 shutdown_connections 2023-12-01T01:03:51.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.225+0000 7fbb675ad700 1 --2- 172.21.15.26:0/3841316905 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb60106b70 0x7fbb60108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:51.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.225+0000 7fbb675ad700 1 --2- 172.21.15.26:0/3841316905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb60101910 0x7fbb60103d00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:51.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.225+0000 7fbb675ad700 1 --2- 172.21.15.26:0/3841316905 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb60104240 0x7fbb60106630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:51.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.225+0000 7fbb675ad700 1 -- 172.21.15.26:0/3841316905 >> 172.21.15.26:0/3841316905 conn(0x7fbb600fb2a0 msgr2=0x7fbb600fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:51.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.225+0000 7fbb675ad700 1 -- 172.21.15.26:0/3841316905 shutdown_connections 2023-12-01T01:03:51.232 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.225+0000 7fbb675ad700 1 -- 172.21.15.26:0/3841316905 wait complete. 2023-12-01T01:03:51.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.226+0000 7fbb675ad700 1 Processor -- start 2023-12-01T01:03:51.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.226+0000 7fbb675ad700 1 -- start start 2023-12-01T01:03:51.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.226+0000 7fbb675ad700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb60101910 0x7fbb60196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:51.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.226+0000 7fbb675ad700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb60104240 0x7fbb601970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:51.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.226+0000 7fbb675ad700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb60106b70 0x7fbb6019e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:51.233 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.226+0000 7fbb675ad700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6019e6f0 con 0x7fbb60101910 2023-12-01T01:03:51.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.226+0000 7fbb675ad700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6019e830 con 0x7fbb60104240 2023-12-01T01:03:51.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.226+0000 7fbb675ad700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6019e9c0 con 0x7fbb60106b70 2023-12-01T01:03:51.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.226+0000 7fbb65349700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb60101910 0x7fbb60196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:51.234 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.226+0000 7fbb65349700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb60101910 0x7fbb60196b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54494/0 (socket says 172.21.15.26:54494) 2023-12-01T01:03:51.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.226+0000 7fbb64b48700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb60104240 0x7fbb601970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:51.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.226+0000 7fbb65349700 1 -- 172.21.15.26:0/2838271181 learned_addr learned my addr 172.21.15.26:0/2838271181 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:51.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.227+0000 7fbb65b4a700 1 --2- 172.21.15.26:0/2838271181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb60106b70 0x7fbb6019e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:51.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.227+0000 7fbb65349700 1 -- 172.21.15.26:0/2838271181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb60106b70 msgr2=0x7fbb6019e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:51.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.227+0000 7fbb65349700 1 --2- 172.21.15.26:0/2838271181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb60106b70 0x7fbb6019e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:51.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.227+0000 7fbb65349700 1 -- 172.21.15.26:0/2838271181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb60104240 msgr2=0x7fbb601970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:51.235 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.227+0000 7fbb65349700 1 --2- 172.21.15.26:0/2838271181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb60104240 0x7fbb601970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:51.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.227+0000 7fbb65349700 1 -- 172.21.15.26:0/2838271181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c0095f0 con 0x7fbb60101910 2023-12-01T01:03:51.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.227+0000 7fbb65b4a700 1 --2- 172.21.15.26:0/2838271181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb60106b70 0x7fbb6019e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:03:51.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.227+0000 7fbb64b48700 1 --2- 172.21.15.26:0/2838271181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb60104240 0x7fbb601970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:03:51.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.227+0000 7fbb65349700 1 --2- 172.21.15.26:0/2838271181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb60101910 0x7fbb60196b60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c006010 tx=0x7fbb5c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:51.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.227+0000 7fbb567fc700 1 -- 172.21.15.26:0/2838271181 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c01d070 con 0x7fbb60101910 2023-12-01T01:03:51.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.227+0000 7fbb567fc700 1 -- 172.21.15.26:0/2838271181 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbb5c022470 con 0x7fbb60101910 2023-12-01T01:03:51.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.227+0000 7fbb675ad700 1 -- 172.21.15.26:0/2838271181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6019ec40 con 0x7fbb60101910 2023-12-01T01:03:51.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.227+0000 7fbb567fc700 1 -- 172.21.15.26:0/2838271181 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5c017650 con 0x7fbb60101910 2023-12-01T01:03:51.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.227+0000 7fbb675ad700 1 -- 172.21.15.26:0/2838271181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6019f050 con 0x7fbb60101910 2023-12-01T01:03:51.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.228+0000 7fbb675ad700 1 -- 172.21.15.26:0/2838271181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb600fce20 con 0x7fbb60101910 2023-12-01T01:03:51.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.229+0000 7fbb567fc700 1 -- 172.21.15.26:0/2838271181 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fbb5c0225e0 con 0x7fbb60101910 2023-12-01T01:03:51.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.230+0000 7fbb567fc700 1 --2- 172.21.15.26:0/2838271181 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbb4c0a05b0 0x7fbb4c0a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:51.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.230+0000 7fbb64b48700 1 --2- 172.21.15.26:0/2838271181 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbb4c0a05b0 0x7fbb4c0a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:51.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.230+0000 7fbb567fc700 1 -- 172.21.15.26:0/2838271181 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbb5c0ccf00 con 0x7fbb60101910 2023-12-01T01:03:51.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.230+0000 7fbb64b48700 1 --2- 172.21.15.26:0/2838271181 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbb4c0a05b0 0x7fbb4c0a2a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbb50005950 tx=0x7fbb5000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:51.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.234+0000 7fbb567fc700 1 -- 172.21.15.26:0/2838271181 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fbb5c096b00 con 0x7fbb60101910 2023-12-01T01:03:51.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.449+0000 7fbb675ad700 1 -- 172.21.15.26:0/2838271181 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fbb600611d0 con 0x7fbb4c0a05b0 2023-12-01T01:03:51.463 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.461+0000 7fbb567fc700 1 -- 172.21.15.26:0/2838271181 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7fbb600611d0 con 0x7fbb4c0a05b0 2023-12-01T01:03:51.463 INFO:teuthology.orchestra.run.smithi026.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-01T01:03:51.463 INFO:teuthology.orchestra.run.smithi026.stdout:mds.all 12/12 63s ago 96s smithi026=a;smithi026=d;smithi026=g;smithi026=j;smithi093=b;smithi093=e;smithi093=h;smithi093=k;smithi116=c;smithi116=f;smithi116=i;smithi116=l;count:12 2023-12-01T01:03:51.464 INFO:teuthology.orchestra.run.smithi026.stdout:mgr 3/3 63s ago 5m smithi026=x;smithi093=y;smithi116=z;count:3 2023-12-01T01:03:51.464 INFO:teuthology.orchestra.run.smithi026.stdout:mon 3/3 63s ago 6m smithi026:172.21.15.26=a;smithi093:172.21.15.93=b;smithi116:172.21.15.116=c;count:3 2023-12-01T01:03:51.464 INFO:teuthology.orchestra.run.smithi026.stdout:osd 12 63s ago - 2023-12-01T01:03:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.464+0000 7fbb675ad700 1 -- 172.21.15.26:0/2838271181 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbb4c0a05b0 msgr2=0x7fbb4c0a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.464+0000 7fbb675ad700 1 --2- 172.21.15.26:0/2838271181 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbb4c0a05b0 0x7fbb4c0a2a70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbb50005950 tx=0x7fbb5000b410 comp rx=0 tx=0).stop 2023-12-01T01:03:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.464+0000 7fbb675ad700 1 -- 172.21.15.26:0/2838271181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb60101910 msgr2=0x7fbb60196b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.464+0000 7fbb675ad700 1 --2- 172.21.15.26:0/2838271181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb60101910 0x7fbb60196b60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c006010 tx=0x7fbb5c00f690 comp rx=0 tx=0).stop 2023-12-01T01:03:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.464+0000 7fbb675ad700 1 -- 172.21.15.26:0/2838271181 shutdown_connections 2023-12-01T01:03:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.464+0000 7fbb675ad700 1 --2- 172.21.15.26:0/2838271181 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbb4c0a05b0 0x7fbb4c0a2a70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.464+0000 7fbb675ad700 1 --2- 172.21.15.26:0/2838271181 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbb60106b70 0x7fbb6019e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.464+0000 7fbb675ad700 1 --2- 172.21.15.26:0/2838271181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb60101910 0x7fbb60196b60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.464+0000 7fbb675ad700 1 --2- 172.21.15.26:0/2838271181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbb60104240 0x7fbb601970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.464+0000 7fbb675ad700 1 -- 172.21.15.26:0/2838271181 >> 172.21.15.26:0/2838271181 conn(0x7fbb600fb2a0 msgr2=0x7fbb60102580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.464+0000 7fbb675ad700 1 -- 172.21.15.26:0/2838271181 shutdown_connections 2023-12-01T01:03:51.466 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:51.464+0000 7fbb675ad700 1 -- 172.21.15.26:0/2838271181 wait complete. 2023-12-01T01:03:51.883 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-01T01:03:52.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:51 smithi026 ceph-mon[98801]: pgmap v279: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-01T01:03:52.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:51 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:51 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:51 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:51 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:51 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:51 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:51 smithi116 ceph-mon[103554]: pgmap v279: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-01T01:03:52.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:51 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:51 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:51 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:51 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:51 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:51 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:51 smithi093 ceph-mon[103327]: pgmap v279: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-12-01T01:03:52.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:51 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:52.450 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:52.983 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:52 smithi026 ceph-mon[98801]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:03:52.983 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:03:52.983 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:03:52.983 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:52 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:53.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:52 smithi116 ceph-mon[103554]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:03:53.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:03:53.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:03:53.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:52 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:53.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:52 smithi093 ceph-mon[103327]: from='client.15096 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:03:53.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:03:53.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:03:53.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:52 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:03:53.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.766+0000 7f1da4bd3700 1 -- 172.21.15.26:0/3401779307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1da00ffd20 msgr2=0x7f1da0100140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:53.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.766+0000 7f1da4bd3700 1 --2- 172.21.15.26:0/3401779307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1da00ffd20 0x7f1da0100140 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f1d880099c0 tx=0x7f1d88009cd0 comp rx=0 tx=0).stop 2023-12-01T01:03:53.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.766+0000 7f1da4bd3700 1 -- 172.21.15.26:0/3401779307 shutdown_connections 2023-12-01T01:03:53.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.766+0000 7f1da4bd3700 1 --2- 172.21.15.26:0/3401779307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1da01018c0 0x7f1da0108170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:53.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.766+0000 7f1da4bd3700 1 --2- 172.21.15.26:0/3401779307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1da00ffd20 0x7f1da0100140 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:53.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.766+0000 7f1da4bd3700 1 --2- 172.21.15.26:0/3401779307 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1da0100f20 0x7f1da0101380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:53.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.766+0000 7f1da4bd3700 1 -- 172.21.15.26:0/3401779307 >> 172.21.15.26:0/3401779307 conn(0x7f1da00fb2a0 msgr2=0x7f1da00fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:53.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.766+0000 7f1da4bd3700 1 -- 172.21.15.26:0/3401779307 shutdown_connections 2023-12-01T01:03:53.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.766+0000 7f1da4bd3700 1 -- 172.21.15.26:0/3401779307 wait complete. 2023-12-01T01:03:53.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.767+0000 7f1da4bd3700 1 Processor -- start 2023-12-01T01:03:53.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.767+0000 7f1da4bd3700 1 -- start start 2023-12-01T01:03:53.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.767+0000 7f1da4bd3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1da00ffd20 0x7f1da00693d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:53.771 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.767+0000 7f1da4bd3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1da0100f20 0x7f1da019b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.767+0000 7f1da4bd3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1da01018c0 0x7f1da019dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.767+0000 7f1da4bd3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da019e750 con 0x7f1da0100f20 2023-12-01T01:03:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.767+0000 7f1da4bd3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da019e8c0 con 0x7f1da00ffd20 2023-12-01T01:03:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.767+0000 7f1da4bd3700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da019ea80 con 0x7f1da01018c0 2023-12-01T01:03:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.768+0000 7f1d9dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1da0100f20 0x7f1da019b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.768+0000 7f1d9dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1da0100f20 0x7f1da019b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54508/0 (socket says 172.21.15.26:54508) 2023-12-01T01:03:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.768+0000 7f1d9dd9b700 1 -- 172.21.15.26:0/600673863 learned_addr learned my addr 172.21.15.26:0/600673863 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.768+0000 7f1d9e59c700 1 --2- 172.21.15.26:0/600673863 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1da00ffd20 0x7f1da00693d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.768+0000 7f1d9ed9d700 1 --2- 172.21.15.26:0/600673863 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1da01018c0 0x7f1da019dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.768+0000 7f1d9dd9b700 1 -- 172.21.15.26:0/600673863 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1da01018c0 msgr2=0x7f1da019dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.768+0000 7f1d9dd9b700 1 --2- 172.21.15.26:0/600673863 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1da01018c0 0x7f1da019dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.768+0000 7f1d9dd9b700 1 -- 172.21.15.26:0/600673863 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1da00ffd20 msgr2=0x7f1da00693d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.768+0000 7f1d9dd9b700 1 --2- 172.21.15.26:0/600673863 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1da00ffd20 0x7f1da00693d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.768+0000 7f1d9dd9b700 1 -- 172.21.15.26:0/600673863 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d880095f0 con 0x7f1da0100f20 2023-12-01T01:03:53.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.768+0000 7f1d9dd9b700 1 --2- 172.21.15.26:0/600673863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1da0100f20 0x7f1da019b960 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000b530 tx=0x7f1d9000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:53.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.768+0000 7f1d977fe700 1 -- 172.21.15.26:0/600673863 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90011830 con 0x7f1da0100f20 2023-12-01T01:03:53.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.768+0000 7f1da4bd3700 1 -- 172.21.15.26:0/600673863 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da019ed60 con 0x7f1da0100f20 2023-12-01T01:03:53.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.768+0000 7f1d977fe700 1 -- 172.21.15.26:0/600673863 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1d90011e70 con 0x7f1da0100f20 2023-12-01T01:03:53.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.768+0000 7f1d977fe700 1 -- 172.21.15.26:0/600673863 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9000f300 con 0x7f1da0100f20 2023-12-01T01:03:53.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.768+0000 7f1da4bd3700 1 -- 172.21.15.26:0/600673863 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da019f250 con 0x7f1da0100f20 2023-12-01T01:03:53.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.769+0000 7f1da4bd3700 1 -- 172.21.15.26:0/600673863 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da010b6e0 con 0x7f1da0100f20 2023-12-01T01:03:53.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.770+0000 7f1d977fe700 1 -- 172.21.15.26:0/600673863 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7f1d900106d0 con 0x7f1da0100f20 2023-12-01T01:03:53.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.771+0000 7f1d977fe700 1 --2- 172.21.15.26:0/600673863 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1d8c0a05b0 0x7f1d8c0a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:53.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.771+0000 7f1d977fe700 1 -- 172.21.15.26:0/600673863 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1d900cba00 con 0x7f1da0100f20 2023-12-01T01:03:53.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.771+0000 7f1d9e59c700 1 --2- 172.21.15.26:0/600673863 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1d8c0a05b0 0x7f1d8c0a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:53.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.771+0000 7f1d9e59c700 1 --2- 172.21.15.26:0/600673863 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1d8c0a05b0 0x7f1d8c0a2a70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1d88009990 tx=0x7f1d8800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:53.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.774+0000 7f1d977fe700 1 -- 172.21.15.26:0/600673863 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1d90095560 con 0x7f1da0100f20 2023-12-01T01:03:53.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.979+0000 7f1da4bd3700 1 -- 172.21.15.26:0/600673863 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f1da00611d0 con 0x7f1d8c0a05b0 2023-12-01T01:03:53.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.981+0000 7f1d977fe700 1 -- 172.21.15.26:0/600673863 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f1da00611d0 con 0x7f1d8c0a05b0 2023-12-01T01:03:53.983 INFO:teuthology.orchestra.run.smithi026.stdout:HOST ADDR LABELS STATUS 2023-12-01T01:03:53.983 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026 172.21.15.26 2023-12-01T01:03:53.983 INFO:teuthology.orchestra.run.smithi026.stdout:smithi093 172.21.15.93 2023-12-01T01:03:53.983 INFO:teuthology.orchestra.run.smithi026.stdout:smithi116 172.21.15.116 2023-12-01T01:03:53.984 INFO:teuthology.orchestra.run.smithi026.stdout:3 hosts in cluster 2023-12-01T01:03:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.983+0000 7f1da4bd3700 1 -- 172.21.15.26:0/600673863 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1d8c0a05b0 msgr2=0x7f1d8c0a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.983+0000 7f1da4bd3700 1 --2- 172.21.15.26:0/600673863 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1d8c0a05b0 0x7f1d8c0a2a70 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1d88009990 tx=0x7f1d8800b540 comp rx=0 tx=0).stop 2023-12-01T01:03:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.983+0000 7f1da4bd3700 1 -- 172.21.15.26:0/600673863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1da0100f20 msgr2=0x7f1da019b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.983+0000 7f1da4bd3700 1 --2- 172.21.15.26:0/600673863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1da0100f20 0x7f1da019b960 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000b530 tx=0x7f1d9000b840 comp rx=0 tx=0).stop 2023-12-01T01:03:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.983+0000 7f1da4bd3700 1 -- 172.21.15.26:0/600673863 shutdown_connections 2023-12-01T01:03:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.983+0000 7f1da4bd3700 1 --2- 172.21.15.26:0/600673863 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1d8c0a05b0 0x7f1d8c0a2a70 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.983+0000 7f1da4bd3700 1 --2- 172.21.15.26:0/600673863 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1da01018c0 0x7f1da019dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.983+0000 7f1da4bd3700 1 --2- 172.21.15.26:0/600673863 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1da00ffd20 0x7f1da00693d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.983+0000 7f1da4bd3700 1 --2- 172.21.15.26:0/600673863 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1da0100f20 0x7f1da019b960 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.983+0000 7f1da4bd3700 1 -- 172.21.15.26:0/600673863 >> 172.21.15.26:0/600673863 conn(0x7f1da00fb2a0 msgr2=0x7f1da00fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.983+0000 7f1da4bd3700 1 -- 172.21.15.26:0/600673863 shutdown_connections 2023-12-01T01:03:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:53.983+0000 7f1da4bd3700 1 -- 172.21.15.26:0/600673863 wait complete. 2023-12-01T01:03:54.009 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:53 smithi026 ceph-mon[98801]: pgmap v280: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-01T01:03:54.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:53 smithi116 ceph-mon[103554]: pgmap v280: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-01T01:03:54.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:53 smithi093 ceph-mon[103327]: pgmap v280: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-12-01T01:03:54.408 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-01T01:03:54.969 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:56.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:55 smithi026 ceph-mon[98801]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-01T01:03:56.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:55 smithi026 ceph-mon[98801]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:03:56.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:55 smithi116 ceph-mon[103554]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-01T01:03:56.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:55 smithi116 ceph-mon[103554]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:03:56.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.179+0000 7fb08217e700 1 -- 172.21.15.26:0/1234404566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c101930 msgr2=0x7fb07c103d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:56.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.179+0000 7fb08217e700 1 --2- 172.21.15.26:0/1234404566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c101930 0x7fb07c103d20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb06c009990 tx=0x7fb06c009ca0 comp rx=0 tx=0).stop 2023-12-01T01:03:56.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.179+0000 7fb08217e700 1 -- 172.21.15.26:0/1234404566 shutdown_connections 2023-12-01T01:03:56.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.179+0000 7fb08217e700 1 --2- 172.21.15.26:0/1234404566 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb07c106b90 0x7fb07c108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:56.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.179+0000 7fb08217e700 1 --2- 172.21.15.26:0/1234404566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c101930 0x7fb07c103d20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:56.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.179+0000 7fb08217e700 1 --2- 172.21.15.26:0/1234404566 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb07c104260 0x7fb07c106650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:56.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.179+0000 7fb08217e700 1 -- 172.21.15.26:0/1234404566 >> 172.21.15.26:0/1234404566 conn(0x7fb07c0fb2a0 msgr2=0x7fb07c0fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:56.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.179+0000 7fb08217e700 1 -- 172.21.15.26:0/1234404566 shutdown_connections 2023-12-01T01:03:56.181 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.179+0000 7fb08217e700 1 -- 172.21.15.26:0/1234404566 wait complete. 2023-12-01T01:03:56.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb08217e700 1 Processor -- start 2023-12-01T01:03:56.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb08217e700 1 -- start start 2023-12-01T01:03:56.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb08217e700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb07c101930 0x7fb07c101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:56.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb08217e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb07c104260 0x7fb07c0ff8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:56.183 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb08217e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c106b90 0x7fb07c0ffe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:56.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb08217e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c1005a0 con 0x7fb07c106b90 2023-12-01T01:03:56.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb08217e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c100710 con 0x7fb07c104260 2023-12-01T01:03:56.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb08217e700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c1a0c80 con 0x7fb07c101930 2023-12-01T01:03:56.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb07bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c106b90 0x7fb07c0ffe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:56.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb07bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c106b90 0x7fb07c0ffe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54524/0 (socket says 172.21.15.26:54524) 2023-12-01T01:03:56.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb07bfff700 1 -- 172.21.15.26:0/644759455 learned_addr learned my addr 172.21.15.26:0/644759455 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:56.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb07b7fe700 1 --2- 172.21.15.26:0/644759455 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb07c101930 0x7fb07c101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:56.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb07affd700 1 --2- 172.21.15.26:0/644759455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb07c104260 0x7fb07c0ff8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:56.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb07bfff700 1 -- 172.21.15.26:0/644759455 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb07c101930 msgr2=0x7fb07c101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:56.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb07bfff700 1 --2- 172.21.15.26:0/644759455 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb07c101930 0x7fb07c101290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:56.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb07bfff700 1 -- 172.21.15.26:0/644759455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb07c104260 msgr2=0x7fb07c0ff8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:56.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb07bfff700 1 --2- 172.21.15.26:0/644759455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb07c104260 0x7fb07c0ff8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:56.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.180+0000 7fb07bfff700 1 -- 172.21.15.26:0/644759455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0095f0 con 0x7fb07c106b90 2023-12-01T01:03:56.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.181+0000 7fb07bfff700 1 --2- 172.21.15.26:0/644759455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c106b90 0x7fb07c0ffe20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb07400ada0 tx=0x7fb07400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:56.184 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.181+0000 7fb078ff9700 1 -- 172.21.15.26:0/644759455 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07400f070 con 0x7fb07c106b90 2023-12-01T01:03:56.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.181+0000 7fb08217e700 1 -- 172.21.15.26:0/644759455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c1a0f60 con 0x7fb07c106b90 2023-12-01T01:03:56.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.181+0000 7fb078ff9700 1 -- 172.21.15.26:0/644759455 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb074007b00 con 0x7fb07c106b90 2023-12-01T01:03:56.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.181+0000 7fb078ff9700 1 -- 172.21.15.26:0/644759455 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0740053a0 con 0x7fb07c106b90 2023-12-01T01:03:56.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.181+0000 7fb08217e700 1 -- 172.21.15.26:0/644759455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c1a13d0 con 0x7fb07c106b90 2023-12-01T01:03:56.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.182+0000 7fb08217e700 1 -- 172.21.15.26:0/644759455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c0fce20 con 0x7fb07c106b90 2023-12-01T01:03:56.185 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.183+0000 7fb078ff9700 1 -- 172.21.15.26:0/644759455 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fb07400c8d0 con 0x7fb07c106b90 2023-12-01T01:03:56.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.183+0000 7fb078ff9700 1 --2- 172.21.15.26:0/644759455 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb0640a05b0 0x7fb0640a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:56.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.184+0000 7fb07b7fe700 1 --2- 172.21.15.26:0/644759455 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb0640a05b0 0x7fb0640a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:56.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.184+0000 7fb078ff9700 1 -- 172.21.15.26:0/644759455 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb0740cafb0 con 0x7fb07c106b90 2023-12-01T01:03:56.186 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.184+0000 7fb07b7fe700 1 --2- 172.21.15.26:0/644759455 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb0640a05b0 0x7fb0640a2a70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb06c000c00 tx=0x7fb06c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:56.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.188+0000 7fb078ff9700 1 -- 172.21.15.26:0/644759455 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb0740fe0e0 con 0x7fb07c106b90 2023-12-01T01:03:56.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:55 smithi093 ceph-mon[103327]: pgmap v281: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-01T01:03:56.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:55 smithi093 ceph-mon[103327]: from='client.15102 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:03:56.396 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.394+0000 7fb08217e700 1 -- 172.21.15.26:0/644759455 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb07c0611d0 con 0x7fb0640a05b0 2023-12-01T01:03:56.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.396+0000 7fb078ff9700 1 -- 172.21.15.26:0/644759455 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7fb07c0611d0 con 0x7fb0640a05b0 2023-12-01T01:03:56.398 INFO:teuthology.orchestra.run.smithi026.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-01T01:03:56.398 INFO:teuthology.orchestra.run.smithi026.stdout:smithi026 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB74760020480DGN 447G No 2m ago Has a FileSystem, LVM detected 2023-12-01T01:03:56.398 INFO:teuthology.orchestra.run.smithi026.stdout:smithi093 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040150400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-12-01T01:03:56.398 INFO:teuthology.orchestra.run.smithi026.stdout:smithi116 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400VJ400BGN 372G No 111s ago Has a FileSystem, LVM detected 2023-12-01T01:03:56.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.398+0000 7fb08217e700 1 -- 172.21.15.26:0/644759455 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb0640a05b0 msgr2=0x7fb0640a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:56.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.398+0000 7fb08217e700 1 --2- 172.21.15.26:0/644759455 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb0640a05b0 0x7fb0640a2a70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb06c000c00 tx=0x7fb06c005fb0 comp rx=0 tx=0).stop 2023-12-01T01:03:56.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.398+0000 7fb08217e700 1 -- 172.21.15.26:0/644759455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c106b90 msgr2=0x7fb07c0ffe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:56.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.398+0000 7fb08217e700 1 --2- 172.21.15.26:0/644759455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c106b90 0x7fb07c0ffe20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb07400ada0 tx=0x7fb07400c330 comp rx=0 tx=0).stop 2023-12-01T01:03:56.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.398+0000 7fb08217e700 1 -- 172.21.15.26:0/644759455 shutdown_connections 2023-12-01T01:03:56.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.398+0000 7fb08217e700 1 --2- 172.21.15.26:0/644759455 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb0640a05b0 0x7fb0640a2a70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:56.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.398+0000 7fb08217e700 1 --2- 172.21.15.26:0/644759455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb07c106b90 0x7fb07c0ffe20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:56.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.398+0000 7fb08217e700 1 --2- 172.21.15.26:0/644759455 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb07c101930 0x7fb07c101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:56.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.398+0000 7fb08217e700 1 --2- 172.21.15.26:0/644759455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb07c104260 0x7fb07c0ff8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:56.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.398+0000 7fb08217e700 1 -- 172.21.15.26:0/644759455 >> 172.21.15.26:0/644759455 conn(0x7fb07c0fb2a0 msgr2=0x7fb07c1025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.398+0000 7fb08217e700 1 -- 172.21.15.26:0/644759455 shutdown_connections 2023-12-01T01:03:56.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:56.398+0000 7fb08217e700 1 -- 172.21.15.26:0/644759455 wait complete. 2023-12-01T01:03:56.720 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-01T01:03:56.730 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi026.front.sepia.ceph.com 2023-12-01T01:03:56.730 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-01T01:03:57.290 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:03:58.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:57 smithi026 ceph-mon[98801]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-12-01T01:03:58.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:57 smithi026 ceph-mon[98801]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:03:58.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:57 smithi116 ceph-mon[103554]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-12-01T01:03:58.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:57 smithi116 ceph-mon[103554]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:03:58.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:57 smithi093 ceph-mon[103327]: pgmap v282: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2023-12-01T01:03:58.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:57 smithi093 ceph-mon[103327]: from='client.15108 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-01T01:03:58.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.469+0000 7fdb51cb1700 1 -- 172.21.15.26:0/1758158870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb4c102970 msgr2=0x7fdb4c109290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:58.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.469+0000 7fdb51cb1700 1 --2- 172.21.15.26:0/1758158870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb4c102970 0x7fdb4c109290 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400b0a0 tx=0x7fdb4400b3b0 comp rx=0 tx=0).stop 2023-12-01T01:03:58.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.470+0000 7fdb51cb1700 1 -- 172.21.15.26:0/1758158870 shutdown_connections 2023-12-01T01:03:58.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.470+0000 7fdb51cb1700 1 --2- 172.21.15.26:0/1758158870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb4c102970 0x7fdb4c109290 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:58.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.470+0000 7fdb51cb1700 1 --2- 172.21.15.26:0/1758158870 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb4c100e50 0x7fdb4c101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:58.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.470+0000 7fdb51cb1700 1 --2- 172.21.15.26:0/1758158870 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb4c101fb0 0x7fdb4c102430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:58.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.470+0000 7fdb51cb1700 1 -- 172.21.15.26:0/1758158870 >> 172.21.15.26:0/1758158870 conn(0x7fdb4c0fc410 msgr2=0x7fdb4c0fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:58.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.470+0000 7fdb51cb1700 1 -- 172.21.15.26:0/1758158870 shutdown_connections 2023-12-01T01:03:58.472 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.470+0000 7fdb51cb1700 1 -- 172.21.15.26:0/1758158870 wait complete. 2023-12-01T01:03:58.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.470+0000 7fdb51cb1700 1 Processor -- start 2023-12-01T01:03:58.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.470+0000 7fdb51cb1700 1 -- start start 2023-12-01T01:03:58.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb51cb1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb4c100e50 0x7fdb4c196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:58.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb51cb1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb4c101fb0 0x7fdb4c1971f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:58.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb51cb1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb4c102970 0x7fdb4c19e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:58.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb51cb1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c19e830 con 0x7fdb4c102970 2023-12-01T01:03:58.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb51cb1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c19e970 con 0x7fdb4c100e50 2023-12-01T01:03:58.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb51cb1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4c19eb30 con 0x7fdb4c101fb0 2023-12-01T01:03:58.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb4bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb4c102970 0x7fdb4c19e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:58.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb4bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb4c102970 0x7fdb4c19e260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54536/0 (socket says 172.21.15.26:54536) 2023-12-01T01:03:58.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb4bfff700 1 -- 172.21.15.26:0/1842392859 learned_addr learned my addr 172.21.15.26:0/1842392859 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:03:58.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb4affd700 1 --2- 172.21.15.26:0/1842392859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb4c101fb0 0x7fdb4c1971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:58.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb4b7fe700 1 --2- 172.21.15.26:0/1842392859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb4c100e50 0x7fdb4c196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:58.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb4bfff700 1 -- 172.21.15.26:0/1842392859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb4c101fb0 msgr2=0x7fdb4c1971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:58.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb4bfff700 1 --2- 172.21.15.26:0/1842392859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb4c101fb0 0x7fdb4c1971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:58.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb4bfff700 1 -- 172.21.15.26:0/1842392859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb4c100e50 msgr2=0x7fdb4c196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:58.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb4bfff700 1 --2- 172.21.15.26:0/1842392859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb4c100e50 0x7fdb4c196cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:58.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb4bfff700 1 -- 172.21.15.26:0/1842392859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb44009d00 con 0x7fdb4c102970 2023-12-01T01:03:58.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb4affd700 1 --2- 172.21.15.26:0/1842392859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb4c101fb0 0x7fdb4c1971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:03:58.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb4b7fe700 1 --2- 172.21.15.26:0/1842392859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb4c100e50 0x7fdb4c196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:03:58.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb4bfff700 1 --2- 172.21.15.26:0/1842392859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb4c102970 0x7fdb4c19e260 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdb44004ce0 tx=0x7fdb44004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:58.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb48ff9700 1 -- 172.21.15.26:0/1842392859 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4400e040 con 0x7fdb4c102970 2023-12-01T01:03:58.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb48ff9700 1 -- 172.21.15.26:0/1842392859 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdb44009440 con 0x7fdb4c102970 2023-12-01T01:03:58.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb51cb1700 1 -- 172.21.15.26:0/1842392859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4c19edb0 con 0x7fdb4c102970 2023-12-01T01:03:58.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb48ff9700 1 -- 172.21.15.26:0/1842392859 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4401baa0 con 0x7fdb4c102970 2023-12-01T01:03:58.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.471+0000 7fdb51cb1700 1 -- 172.21.15.26:0/1842392859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4c19f1c0 con 0x7fdb4c102970 2023-12-01T01:03:58.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.472+0000 7fdb51cb1700 1 -- 172.21.15.26:0/1842392859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4c108350 con 0x7fdb4c102970 2023-12-01T01:03:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.473+0000 7fdb48ff9700 1 -- 172.21.15.26:0/1842392859 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 17) v1 ==== 135121+0+0 (secure 0 0 0) 0x7fdb4401bc00 con 0x7fdb4c102970 2023-12-01T01:03:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.474+0000 7fdb48ff9700 1 --2- 172.21.15.26:0/1842392859 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdb340a05b0 0x7fdb340a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:03:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.474+0000 7fdb4b7fe700 1 --2- 172.21.15.26:0/1842392859 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdb340a05b0 0x7fdb340a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:03:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.474+0000 7fdb48ff9700 1 -- 172.21.15.26:0/1842392859 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdb440ce0d0 con 0x7fdb4c102970 2023-12-01T01:03:58.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.474+0000 7fdb4b7fe700 1 --2- 172.21.15.26:0/1842392859 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdb340a05b0 0x7fdb340a2a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c005fd0 tx=0x7fdb3c005de0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:03:58.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.478+0000 7fdb48ff9700 1 -- 172.21.15.26:0/1842392859 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fdb44097bb0 con 0x7fdb4c102970 2023-12-01T01:03:58.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.720+0000 7fdb51cb1700 1 -- 172.21.15.26:0/1842392859 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdb4c02cc70 con 0x7fdb4c102970 2023-12-01T01:03:58.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.721+0000 7fdb48ff9700 1 -- 172.21.15.26:0/1842392859 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+2874 (secure 0 0 0) 0x7fdb44021b50 con 0x7fdb4c102970 2023-12-01T01:03:58.723 INFO:teuthology.orchestra.run.smithi026.stdout:e23 2023-12-01T01:03:58.723 INFO:teuthology.orchestra.run.smithi026.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-01T01:03:58.723 INFO:teuthology.orchestra.run.smithi026.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-01T01:03:58.723 INFO:teuthology.orchestra.run.smithi026.stdout:legacy client fscid: 1 2023-12-01T01:03:58.723 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:03:58.723 INFO:teuthology.orchestra.run.smithi026.stdout:Filesystem 'cephfs' (1) 2023-12-01T01:03:58.723 INFO:teuthology.orchestra.run.smithi026.stdout:fs_name cephfs 2023-12-01T01:03:58.723 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 23 2023-12-01T01:03:58.723 INFO:teuthology.orchestra.run.smithi026.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-01T01:03:58.723 INFO:teuthology.orchestra.run.smithi026.stdout:created 2023-12-01T01:02:47.252972+0000 2023-12-01T01:03:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2023-12-01T01:02:52.326753+0000 2023-12-01T01:03:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:tableserver 0 2023-12-01T01:03:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:root 0 2023-12-01T01:03:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:session_timeout 300 2023-12-01T01:03:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:session_autoclose 300 2023-12-01T01:03:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:max_file_size 1099511627776 2023-12-01T01:03:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:required_client_features {} 2023-12-01T01:03:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure 0 2023-12-01T01:03:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:last_failure_osd_epoch 0 2023-12-01T01:03:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-12-01T01:03:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:max_mds 3 2023-12-01T01:03:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:in 0,1,2 2023-12-01T01:03:58.724 INFO:teuthology.orchestra.run.smithi026.stdout:up {0=24509,1=24493,2=24481} 2023-12-01T01:03:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:failed 2023-12-01T01:03:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:damaged 2023-12-01T01:03:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:stopped 2023-12-01T01:03:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:data_pools [3] 2023-12-01T01:03:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:metadata_pool 2 2023-12-01T01:03:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:inline_data disabled 2023-12-01T01:03:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:balancer 2023-12-01T01:03:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:bal_rank_mask -1 2023-12-01T01:03:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:standby_count_wanted 0 2023-12-01T01:03:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b{0:24509} state up:active seq 3 addr [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] compat {c=[1],r=[1],i=[7ff]}] 2023-12-01T01:03:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.h{0:24479} state up:standby-replay seq 1 addr [v2:172.21.15.93:6836/3333520218,v1:172.21.15.93:6837/3333520218] compat {c=[1],r=[1],i=[7ff]}] 2023-12-01T01:03:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.g{1:24493} state up:active seq 5 addr [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] compat {c=[1],r=[1],i=[7ff]}] 2023-12-01T01:03:58.726 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c{1:24460} state up:standby-replay seq 1 addr [v2:172.21.15.116:6836/1714302836,v1:172.21.15.116:6837/1714302836] compat {c=[1],r=[1],i=[7ff]}] 2023-12-01T01:03:58.726 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.i{2:24481} state up:active seq 6 addr [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] compat {c=[1],r=[1],i=[7ff]}] 2023-12-01T01:03:58.726 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.f{2:24448} state up:standby-replay seq 1 addr [v2:172.21.15.116:6834/1591216017,v1:172.21.15.116:6835/1591216017] compat {c=[1],r=[1],i=[7ff]}] 2023-12-01T01:03:58.726 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:03:58.726 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:03:58.726 INFO:teuthology.orchestra.run.smithi026.stdout:Standby daemons: 2023-12-01T01:03:58.726 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:03:58.726 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.j{-1:14541} state up:standby seq 1 addr [v2:172.21.15.26:6834/3831137706,v1:172.21.15.26:6835/3831137706] compat {c=[1],r=[1],i=[7ff]}] 2023-12-01T01:03:58.726 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d{-1:14553} state up:standby seq 1 addr [v2:172.21.15.26:6836/1419946505,v1:172.21.15.26:6837/1419946505] compat {c=[1],r=[1],i=[7ff]}] 2023-12-01T01:03:58.726 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a{-1:14622} state up:standby seq 1 addr [v2:172.21.15.26:6840/3515135915,v1:172.21.15.26:6841/3515135915] compat {c=[1],r=[1],i=[7ff]}] 2023-12-01T01:03:58.726 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.l{-1:24406} state up:standby seq 1 addr [v2:172.21.15.116:6832/2596033158,v1:172.21.15.116:6833/2596033158] compat {c=[1],r=[1],i=[7ff]}] 2023-12-01T01:03:58.726 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.k{-1:24422} state up:standby seq 1 addr [v2:172.21.15.93:6832/2298418641,v1:172.21.15.93:6833/2298418641] compat {c=[1],r=[1],i=[7ff]}] 2023-12-01T01:03:58.726 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.e{-1:24446} state up:standby seq 1 addr [v2:172.21.15.93:6834/2286202770,v1:172.21.15.93:6835/2286202770] compat {c=[1],r=[1],i=[7ff]}] 2023-12-01T01:03:58.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.723+0000 7fdb51cb1700 1 -- 172.21.15.26:0/1842392859 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdb340a05b0 msgr2=0x7fdb340a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:58.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.723+0000 7fdb51cb1700 1 --2- 172.21.15.26:0/1842392859 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdb340a05b0 0x7fdb340a2a70 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c005fd0 tx=0x7fdb3c005de0 comp rx=0 tx=0).stop 2023-12-01T01:03:58.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.723+0000 7fdb51cb1700 1 -- 172.21.15.26:0/1842392859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb4c102970 msgr2=0x7fdb4c19e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:03:58.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.723+0000 7fdb51cb1700 1 --2- 172.21.15.26:0/1842392859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb4c102970 0x7fdb4c19e260 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdb44004ce0 tx=0x7fdb44004dc0 comp rx=0 tx=0).stop 2023-12-01T01:03:58.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.723+0000 7fdb51cb1700 1 -- 172.21.15.26:0/1842392859 shutdown_connections 2023-12-01T01:03:58.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.723+0000 7fdb51cb1700 1 --2- 172.21.15.26:0/1842392859 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdb340a05b0 0x7fdb340a2a70 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:58.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.723+0000 7fdb51cb1700 1 --2- 172.21.15.26:0/1842392859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdb4c102970 0x7fdb4c19e260 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:58.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.723+0000 7fdb51cb1700 1 --2- 172.21.15.26:0/1842392859 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdb4c100e50 0x7fdb4c196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:58.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.723+0000 7fdb51cb1700 1 --2- 172.21.15.26:0/1842392859 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdb4c101fb0 0x7fdb4c1971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:03:58.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.723+0000 7fdb51cb1700 1 -- 172.21.15.26:0/1842392859 >> 172.21.15.26:0/1842392859 conn(0x7fdb4c0fc410 msgr2=0x7fdb4c105490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:03:58.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.723+0000 7fdb51cb1700 1 -- 172.21.15.26:0/1842392859 shutdown_connections 2023-12-01T01:03:58.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:03:58.723+0000 7fdb51cb1700 1 -- 172.21.15.26:0/1842392859 wait complete. 2023-12-01T01:03:58.728 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 23 2023-12-01T01:03:59.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:58 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1842392859' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-01T01:03:59.135 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- bash -c 'ceph osd dump' 2023-12-01T01:03:59.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:58 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1842392859' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-01T01:03:59.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:58 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1842392859' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-01T01:03:59.696 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:04:00.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:59 smithi026 ceph-mon[98801]: pgmap v283: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-01T01:04:00.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:03:59 smithi026 ceph-mon[98801]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-12-01T01:04:00.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:59 smithi116 ceph-mon[103554]: pgmap v283: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-01T01:04:00.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:03:59 smithi116 ceph-mon[103554]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-12-01T01:04:00.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:59 smithi093 ceph-mon[103327]: pgmap v283: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-12-01T01:04:00.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:03:59 smithi093 ceph-mon[103327]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-12-01T01:04:00.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.861+0000 7fccc7c21700 1 -- 172.21.15.26:0/3890163701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc0100f20 msgr2=0x7fccc0101380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:00.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.861+0000 7fccc7c21700 1 --2- 172.21.15.26:0/3890163701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc0100f20 0x7fccc0101380 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fccbc0099c0 tx=0x7fccbc009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:00.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.861+0000 7fccc7c21700 1 -- 172.21.15.26:0/3890163701 shutdown_connections 2023-12-01T01:04:00.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.861+0000 7fccc7c21700 1 --2- 172.21.15.26:0/3890163701 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccc01018c0 0x7fccc0108170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:00.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.861+0000 7fccc7c21700 1 --2- 172.21.15.26:0/3890163701 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccc00ffd20 0x7fccc0100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:00.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.861+0000 7fccc7c21700 1 --2- 172.21.15.26:0/3890163701 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc0100f20 0x7fccc0101380 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:00.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.861+0000 7fccc7c21700 1 -- 172.21.15.26:0/3890163701 >> 172.21.15.26:0/3890163701 conn(0x7fccc00fb2a0 msgr2=0x7fccc00fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:00.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.861+0000 7fccc7c21700 1 -- 172.21.15.26:0/3890163701 shutdown_connections 2023-12-01T01:04:00.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.861+0000 7fccc7c21700 1 -- 172.21.15.26:0/3890163701 wait complete. 2023-12-01T01:04:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.862+0000 7fccc7c21700 1 Processor -- start 2023-12-01T01:04:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.862+0000 7fccc7c21700 1 -- start start 2023-12-01T01:04:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.862+0000 7fccc7c21700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccc00ffd20 0x7fccc0195b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.862+0000 7fccc7c21700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccc0100f20 0x7fccc0196060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.862+0000 7fccc7c21700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc01018c0 0x7fccc019d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.862+0000 7fccc7c21700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc019d6b0 con 0x7fccc01018c0 2023-12-01T01:04:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.862+0000 7fccc7c21700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc019d7f0 con 0x7fccc00ffd20 2023-12-01T01:04:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.862+0000 7fccc7c21700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc019d980 con 0x7fccc0100f20 2023-12-01T01:04:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.862+0000 7fccc61be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc01018c0 0x7fccc019d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.862+0000 7fccc61be700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc01018c0 0x7fccc019d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54550/0 (socket says 172.21.15.26:54550) 2023-12-01T01:04:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.862+0000 7fccc61be700 1 -- 172.21.15.26:0/802878348 learned_addr learned my addr 172.21.15.26:0/802878348 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.862+0000 7fccc59bd700 1 --2- 172.21.15.26:0/802878348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccc00ffd20 0x7fccc0195b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.862+0000 7fccc51bc700 1 --2- 172.21.15.26:0/802878348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccc0100f20 0x7fccc0196060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:00.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.862+0000 7fccc61be700 1 -- 172.21.15.26:0/802878348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccc0100f20 msgr2=0x7fccc0196060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.862+0000 7fccc61be700 1 --2- 172.21.15.26:0/802878348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccc0100f20 0x7fccc0196060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.863+0000 7fccc61be700 1 -- 172.21.15.26:0/802878348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccc00ffd20 msgr2=0x7fccc0195b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.863+0000 7fccc61be700 1 --2- 172.21.15.26:0/802878348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccc00ffd20 0x7fccc0195b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.863+0000 7fccc61be700 1 -- 172.21.15.26:0/802878348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc0095f0 con 0x7fccc01018c0 2023-12-01T01:04:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.863+0000 7fccc61be700 1 --2- 172.21.15.26:0/802878348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc01018c0 0x7fccc019d0e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fccb8007f10 tx=0x7fccb800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.863+0000 7fccb6ffd700 1 -- 172.21.15.26:0/802878348 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8017070 con 0x7fccc01018c0 2023-12-01T01:04:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.863+0000 7fccc7c21700 1 -- 172.21.15.26:0/802878348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc019dc60 con 0x7fccc01018c0 2023-12-01T01:04:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.863+0000 7fccb6ffd700 1 -- 172.21.15.26:0/802878348 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fccb800f040 con 0x7fccc01018c0 2023-12-01T01:04:00.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.863+0000 7fccb6ffd700 1 -- 172.21.15.26:0/802878348 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb8005630 con 0x7fccc01018c0 2023-12-01T01:04:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.863+0000 7fccc7c21700 1 -- 172.21.15.26:0/802878348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc019e110 con 0x7fccc01018c0 2023-12-01T01:04:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.864+0000 7fccc7c21700 1 -- 172.21.15.26:0/802878348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc0107270 con 0x7fccc01018c0 2023-12-01T01:04:00.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.865+0000 7fccb6ffd700 1 -- 172.21.15.26:0/802878348 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fccb8005790 con 0x7fccc01018c0 2023-12-01T01:04:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.865+0000 7fccb6ffd700 1 --2- 172.21.15.26:0/802878348 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fccac0a0520 0x7fccac0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.866+0000 7fccb6ffd700 1 -- 172.21.15.26:0/802878348 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fccb80cb0e0 con 0x7fccc01018c0 2023-12-01T01:04:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.866+0000 7fccc59bd700 1 --2- 172.21.15.26:0/802878348 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fccac0a0520 0x7fccac0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:00.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.866+0000 7fccc59bd700 1 --2- 172.21.15.26:0/802878348 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fccac0a0520 0x7fccac0a29e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fccc0100d80 tx=0x7fccb0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:00.870+0000 7fccb6ffd700 1 -- 172.21.15.26:0/802878348 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fccb8094c30 con 0x7fccc01018c0 2023-12-01T01:04:01.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.070+0000 7fccc7c21700 1 -- 172.21.15.26:0/802878348 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7fccc002cc70 con 0x7fccc01018c0 2023-12-01T01:04:01.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.071+0000 7fccb6ffd700 1 -- 172.21.15.26:0/802878348 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v83) v1 ==== 56+0+5259 (secure 0 0 0) 0x7fccb8004ad0 con 0x7fccc01018c0 2023-12-01T01:04:01.073 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 83 2023-12-01T01:04:01.073 INFO:teuthology.orchestra.run.smithi026.stdout:fsid 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T01:04:01.073 INFO:teuthology.orchestra.run.smithi026.stdout:created 2023-12-01T00:55:57.221894+0000 2023-12-01T01:04:01.073 INFO:teuthology.orchestra.run.smithi026.stdout:modified 2023-12-01T01:02:59.627676+0000 2023-12-01T01:04:01.074 INFO:teuthology.orchestra.run.smithi026.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-12-01T01:04:01.074 INFO:teuthology.orchestra.run.smithi026.stdout:crush_version 26 2023-12-01T01:04:01.074 INFO:teuthology.orchestra.run.smithi026.stdout:full_ratio 0.95 2023-12-01T01:04:01.074 INFO:teuthology.orchestra.run.smithi026.stdout:backfillfull_ratio 0.9 2023-12-01T01:04:01.074 INFO:teuthology.orchestra.run.smithi026.stdout:nearfull_ratio 0.85 2023-12-01T01:04:01.074 INFO:teuthology.orchestra.run.smithi026.stdout:require_min_compat_client luminous 2023-12-01T01:04:01.074 INFO:teuthology.orchestra.run.smithi026.stdout:min_compat_client luminous 2023-12-01T01:04:01.074 INFO:teuthology.orchestra.run.smithi026.stdout:require_osd_release reef 2023-12-01T01:04:01.074 INFO:teuthology.orchestra.run.smithi026.stdout:stretch_mode_enabled false 2023-12-01T01:04:01.074 INFO:teuthology.orchestra.run.smithi026.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-12-01T01:04:01.074 INFO:teuthology.orchestra.run.smithi026.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-12-01T01:04:01.074 INFO:teuthology.orchestra.run.smithi026.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-12-01T01:04:01.074 INFO:teuthology.orchestra.run.smithi026.stdout:max_osd 12 2023-12-01T01:04:01.074 INFO:teuthology.orchestra.run.smithi026.stdout:osd.0 up in weight 1 up_from 8 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.26:6802/3366878148,v1:172.21.15.26:6803/3366878148] [v2:172.21.15.26:6804/3366878148,v1:172.21.15.26:6805/3366878148] exists,up 4b914664-c721-4904-8454-92092f5ea9d1 2023-12-01T01:04:01.075 INFO:teuthology.orchestra.run.smithi026.stdout:osd.1 up in weight 1 up_from 13 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.93:6800/1078035045,v1:172.21.15.93:6801/1078035045] [v2:172.21.15.93:6802/1078035045,v1:172.21.15.93:6803/1078035045] exists,up 0b539f82-17c1-4f64-8246-fcd50237089c 2023-12-01T01:04:01.075 INFO:teuthology.orchestra.run.smithi026.stdout:osd.2 up in weight 1 up_from 18 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6800/859484820,v1:172.21.15.116:6801/859484820] [v2:172.21.15.116:6802/859484820,v1:172.21.15.116:6803/859484820] exists,up c20d1850-e656-46c4-a25c-cf114bf23377 2023-12-01T01:04:01.075 INFO:teuthology.orchestra.run.smithi026.stdout:osd.3 up in weight 1 up_from 25 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.26:6810/63607137,v1:172.21.15.26:6811/63607137] [v2:172.21.15.26:6812/63607137,v1:172.21.15.26:6813/63607137] exists,up 12dbd39e-b304-4d90-b9bc-a277f9a774e0 2023-12-01T01:04:01.075 INFO:teuthology.orchestra.run.smithi026.stdout:osd.4 up in weight 1 up_from 32 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.93:6808/4081534363,v1:172.21.15.93:6809/4081534363] [v2:172.21.15.93:6810/4081534363,v1:172.21.15.93:6811/4081534363] exists,up d18c3e93-6ffc-4ef6-94d6-99fb3753ded3 2023-12-01T01:04:01.075 INFO:teuthology.orchestra.run.smithi026.stdout:osd.5 up in weight 1 up_from 37 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6808/2687669413,v1:172.21.15.116:6809/2687669413] [v2:172.21.15.116:6810/2687669413,v1:172.21.15.116:6811/2687669413] exists,up 32151c1a-3530-4ae9-a9e0-a71e47ad5a57 2023-12-01T01:04:01.075 INFO:teuthology.orchestra.run.smithi026.stdout:osd.6 up in weight 1 up_from 45 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.26:6818/1321295002,v1:172.21.15.26:6819/1321295002] [v2:172.21.15.26:6820/1321295002,v1:172.21.15.26:6821/1321295002] exists,up 684e9975-f289-494d-b861-2411c8a3c7a1 2023-12-01T01:04:01.075 INFO:teuthology.orchestra.run.smithi026.stdout:osd.7 up in weight 1 up_from 50 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.93:6816/671599702,v1:172.21.15.93:6817/671599702] [v2:172.21.15.93:6818/671599702,v1:172.21.15.93:6819/671599702] exists,up 0f2745f6-611e-4176-8022-85d5e1942478 2023-12-01T01:04:01.075 INFO:teuthology.orchestra.run.smithi026.stdout:osd.8 up in weight 1 up_from 57 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6816/3617757980,v1:172.21.15.116:6817/3617757980] [v2:172.21.15.116:6818/3617757980,v1:172.21.15.116:6819/3617757980] exists,up c25114ab-8b08-4a55-a459-57b4f63a31d2 2023-12-01T01:04:01.075 INFO:teuthology.orchestra.run.smithi026.stdout:osd.9 up in weight 1 up_from 64 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.26:6826/499283189,v1:172.21.15.26:6827/499283189] [v2:172.21.15.26:6828/499283189,v1:172.21.15.26:6829/499283189] exists,up 92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37 2023-12-01T01:04:01.075 INFO:teuthology.orchestra.run.smithi026.stdout:osd.10 up in weight 1 up_from 69 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.93:6824/1905842175,v1:172.21.15.93:6825/1905842175] [v2:172.21.15.93:6826/1905842175,v1:172.21.15.93:6827/1905842175] exists,up 28902f77-02c2-43ec-b419-476eecd5aa77 2023-12-01T01:04:01.075 INFO:teuthology.orchestra.run.smithi026.stdout:osd.11 up in weight 1 up_from 76 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.116:6824/3877607198,v1:172.21.15.116:6825/3877607198] [v2:172.21.15.116:6826/3877607198,v1:172.21.15.116:6827/3877607198] exists,up 114b3337-37f0-41e0-b0ab-5b77682584c4 2023-12-01T01:04:01.075 INFO:teuthology.orchestra.run.smithi026.stdout:pg_upmap_items 2.a [2,11] 2023-12-01T01:04:01.075 INFO:teuthology.orchestra.run.smithi026.stdout:pg_upmap_items 2.14 [2,4] 2023-12-01T01:04:01.075 INFO:teuthology.orchestra.run.smithi026.stdout:pg_upmap_items 2.1a [8,1] 2023-12-01T01:04:01.075 INFO:teuthology.orchestra.run.smithi026.stdout:pg_upmap_items 2.1d [8,11] 2023-12-01T01:04:01.076 INFO:teuthology.orchestra.run.smithi026.stdout:pg_upmap_items 3.3 [4,9] 2023-12-01T01:04:01.076 INFO:teuthology.orchestra.run.smithi026.stdout:pg_upmap_items 3.17 [4,8] 2023-12-01T01:04:01.076 INFO:teuthology.orchestra.run.smithi026.stdout:pg_upmap_items 3.1e [3,9] 2023-12-01T01:04:01.076 INFO:teuthology.orchestra.run.smithi026.stdout:pg_upmap_items 3.21 [5,9] 2023-12-01T01:04:01.076 INFO:teuthology.orchestra.run.smithi026.stdout:blocklist 172.21.15.26:0/11604977 expires 2023-12-02T00:56:57.879870+0000 2023-12-01T01:04:01.076 INFO:teuthology.orchestra.run.smithi026.stdout:blocklist 172.21.15.26:6801/2565806966 expires 2023-12-02T00:56:57.879870+0000 2023-12-01T01:04:01.076 INFO:teuthology.orchestra.run.smithi026.stdout:blocklist 172.21.15.26:6800/2565806966 expires 2023-12-02T00:56:57.879870+0000 2023-12-01T01:04:01.076 INFO:teuthology.orchestra.run.smithi026.stdout:blocklist 172.21.15.26:6801/4102663452 expires 2023-12-02T00:56:31.503558+0000 2023-12-01T01:04:01.076 INFO:teuthology.orchestra.run.smithi026.stdout:blocklist 172.21.15.26:0/3703480237 expires 2023-12-02T00:56:31.503558+0000 2023-12-01T01:04:01.076 INFO:teuthology.orchestra.run.smithi026.stdout:blocklist 172.21.15.26:0/2854821205 expires 2023-12-02T00:56:57.879870+0000 2023-12-01T01:04:01.076 INFO:teuthology.orchestra.run.smithi026.stdout:blocklist 172.21.15.26:6800/4102663452 expires 2023-12-02T00:56:31.503558+0000 2023-12-01T01:04:01.076 INFO:teuthology.orchestra.run.smithi026.stdout:blocklist 172.21.15.26:0/3514831989 expires 2023-12-02T00:56:57.879870+0000 2023-12-01T01:04:01.076 INFO:teuthology.orchestra.run.smithi026.stdout:blocklist 172.21.15.26:0/3968181141 expires 2023-12-02T00:56:31.503558+0000 2023-12-01T01:04:01.076 INFO:teuthology.orchestra.run.smithi026.stdout:blocklist 172.21.15.26:0/3742997211 expires 2023-12-02T00:56:31.503558+0000 2023-12-01T01:04:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.073+0000 7fccc7c21700 1 -- 172.21.15.26:0/802878348 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fccac0a0520 msgr2=0x7fccac0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.073+0000 7fccc7c21700 1 --2- 172.21.15.26:0/802878348 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fccac0a0520 0x7fccac0a29e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fccc0100d80 tx=0x7fccb0009190 comp rx=0 tx=0).stop 2023-12-01T01:04:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.073+0000 7fccc7c21700 1 -- 172.21.15.26:0/802878348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc01018c0 msgr2=0x7fccc019d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.073+0000 7fccc7c21700 1 --2- 172.21.15.26:0/802878348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc01018c0 0x7fccc019d0e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fccb8007f10 tx=0x7fccb800d3b0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.073+0000 7fccc7c21700 1 -- 172.21.15.26:0/802878348 shutdown_connections 2023-12-01T01:04:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.073+0000 7fccc7c21700 1 --2- 172.21.15.26:0/802878348 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fccac0a0520 0x7fccac0a29e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.073+0000 7fccc7c21700 1 --2- 172.21.15.26:0/802878348 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fccc01018c0 0x7fccc019d0e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.073+0000 7fccc7c21700 1 --2- 172.21.15.26:0/802878348 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fccc00ffd20 0x7fccc0195b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.073+0000 7fccc7c21700 1 --2- 172.21.15.26:0/802878348 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fccc0100f20 0x7fccc0196060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.073+0000 7fccc7c21700 1 -- 172.21.15.26:0/802878348 >> 172.21.15.26:0/802878348 conn(0x7fccc00fb2a0 msgr2=0x7fccc01043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:01.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.074+0000 7fccc7c21700 1 -- 172.21.15.26:0/802878348 shutdown_connections 2023-12-01T01:04:01.078 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.074+0000 7fccc7c21700 1 -- 172.21.15.26:0/802878348 wait complete. 2023-12-01T01:04:01.445 INFO:teuthology.run_tasks:Running task fs.ready... 2023-12-01T01:04:01.456 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:04:01.589 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.584+0000 7fc8f8d38700 1 -- 172.21.15.26:0/3499764419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f4100e60 msgr2=0x7fc8f41012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:01.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.584+0000 7fc8f8d38700 1 --2- 172.21.15.26:0/3499764419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f4100e60 0x7fc8f41012c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc8e80099c0 tx=0x7fc8e8009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.584+0000 7fc8f8d38700 1 -- 172.21.15.26:0/3499764419 shutdown_connections 2023-12-01T01:04:01.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.584+0000 7fc8f8d38700 1 --2- 172.21.15.26:0/3499764419 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8f4101800 0x7fc8f41080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.584+0000 7fc8f8d38700 1 --2- 172.21.15.26:0/3499764419 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8f40ffc70 0x7fc8f4100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.584+0000 7fc8f8d38700 1 --2- 172.21.15.26:0/3499764419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f4100e60 0x7fc8f41012c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.584+0000 7fc8f8d38700 1 -- 172.21.15.26:0/3499764419 >> 172.21.15.26:0/3499764419 conn(0x7fc8f40fb1c0 msgr2=0x7fc8f40fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:01.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.585+0000 7fc8f8d38700 1 -- 172.21.15.26:0/3499764419 shutdown_connections 2023-12-01T01:04:01.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.585+0000 7fc8f8d38700 1 -- 172.21.15.26:0/3499764419 wait complete. 2023-12-01T01:04:01.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.585+0000 7fc8f8d38700 1 Processor -- start 2023-12-01T01:04:01.590 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.585+0000 7fc8f8d38700 1 -- start start 2023-12-01T01:04:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.585+0000 7fc8f8d38700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8f40ffc70 0x7fc8f4196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.585+0000 7fc8f8d38700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8f4100e60 0x7fc8f4196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.585+0000 7fc8f8d38700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f4101800 0x7fc8f419dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.585+0000 7fc8f8d38700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f419e5b0 con 0x7fc8f4101800 2023-12-01T01:04:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.585+0000 7fc8f8d38700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f419e6f0 con 0x7fc8f4100e60 2023-12-01T01:04:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.585+0000 7fc8f8d38700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f419e880 con 0x7fc8f40ffc70 2023-12-01T01:04:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.586+0000 7fc8f2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f4101800 0x7fc8f419dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.586+0000 7fc8f2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f4101800 0x7fc8f419dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54564/0 (socket says 172.21.15.26:54564) 2023-12-01T01:04:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.586+0000 7fc8f2d9d700 1 -- 172.21.15.26:0/1914645611 learned_addr learned my addr 172.21.15.26:0/1914645611 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.586+0000 7fc8f259c700 1 --2- 172.21.15.26:0/1914645611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8f40ffc70 0x7fc8f4196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.586+0000 7fc8f1d9b700 1 --2- 172.21.15.26:0/1914645611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8f4100e60 0x7fc8f4196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.586+0000 7fc8f2d9d700 1 -- 172.21.15.26:0/1914645611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8f40ffc70 msgr2=0x7fc8f4196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.586+0000 7fc8f2d9d700 1 --2- 172.21.15.26:0/1914645611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8f40ffc70 0x7fc8f4196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.586+0000 7fc8f2d9d700 1 -- 172.21.15.26:0/1914645611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8f4100e60 msgr2=0x7fc8f4196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.586+0000 7fc8f2d9d700 1 --2- 172.21.15.26:0/1914645611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8f4100e60 0x7fc8f4196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.586+0000 7fc8f2d9d700 1 -- 172.21.15.26:0/1914645611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80095f0 con 0x7fc8f4101800 2023-12-01T01:04:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.586+0000 7fc8f2d9d700 1 --2- 172.21.15.26:0/1914645611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f4101800 0x7fc8f419dfe0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec007ee0 tx=0x7fc8ec00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.586+0000 7fc8e37fe700 1 -- 172.21.15.26:0/1914645611 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec00dd20 con 0x7fc8f4101800 2023-12-01T01:04:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.586+0000 7fc8e37fe700 1 -- 172.21.15.26:0/1914645611 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc8ec00f040 con 0x7fc8f4101800 2023-12-01T01:04:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.586+0000 7fc8f8d38700 1 -- 172.21.15.26:0/1914645611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f419eb60 con 0x7fc8f4101800 2023-12-01T01:04:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.586+0000 7fc8e37fe700 1 -- 172.21.15.26:0/1914645611 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ec015400 con 0x7fc8f4101800 2023-12-01T01:04:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.586+0000 7fc8f8d38700 1 -- 172.21.15.26:0/1914645611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f419f070 con 0x7fc8f4101800 2023-12-01T01:04:01.592 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.587+0000 7fc8f8d38700 1 -- 172.21.15.26:0/1914645611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f410c700 con 0x7fc8f4101800 2023-12-01T01:04:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.588+0000 7fc8e37fe700 1 -- 172.21.15.26:0/1914645611 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fc8ec003a00 con 0x7fc8f4101800 2023-12-01T01:04:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.589+0000 7fc8e37fe700 1 --2- 172.21.15.26:0/1914645611 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc8dc0a05f0 0x7fc8dc0a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.589+0000 7fc8e37fe700 1 -- 172.21.15.26:0/1914645611 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc8ec0cb120 con 0x7fc8f4101800 2023-12-01T01:04:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.589+0000 7fc8f259c700 1 --2- 172.21.15.26:0/1914645611 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc8dc0a05f0 0x7fc8dc0a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.589+0000 7fc8f259c700 1 --2- 172.21.15.26:0/1914645611 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc8dc0a05f0 0x7fc8dc0a2ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4100cc0 tx=0x7fc8e400a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:01.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.593+0000 7fc8e37fe700 1 -- 172.21.15.26:0/1914645611 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc8ec094cd0 con 0x7fc8f4101800 2023-12-01T01:04:01.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.799+0000 7fc8f8d38700 1 -- 172.21.15.26:0/1914645611 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc8f410c8f0 con 0x7fc8f4101800 2023-12-01T01:04:01.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.801+0000 7fc8e37fe700 1 -- 172.21.15.26:0/1914645611 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22481 (secure 0 0 0) 0x7fc8ec0982f0 con 0x7fc8f4101800 2023-12-01T01:04:01.803 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:04:01.803 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":83,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:59.627676+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:04:01.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.803+0000 7fc8f8d38700 1 -- 172.21.15.26:0/1914645611 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc8dc0a05f0 msgr2=0x7fc8dc0a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:01.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.803+0000 7fc8f8d38700 1 --2- 172.21.15.26:0/1914645611 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc8dc0a05f0 0x7fc8dc0a2ab0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4100cc0 tx=0x7fc8e400a3b0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.803+0000 7fc8f8d38700 1 -- 172.21.15.26:0/1914645611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f4101800 msgr2=0x7fc8f419dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:01.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.803+0000 7fc8f8d38700 1 --2- 172.21.15.26:0/1914645611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f4101800 0x7fc8f419dfe0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec007ee0 tx=0x7fc8ec00d3b0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.803+0000 7fc8f8d38700 1 -- 172.21.15.26:0/1914645611 shutdown_connections 2023-12-01T01:04:01.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.803+0000 7fc8f8d38700 1 --2- 172.21.15.26:0/1914645611 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc8dc0a05f0 0x7fc8dc0a2ab0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.803+0000 7fc8f8d38700 1 --2- 172.21.15.26:0/1914645611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f4101800 0x7fc8f419dfe0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.803+0000 7fc8f8d38700 1 --2- 172.21.15.26:0/1914645611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8f40ffc70 0x7fc8f4196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.803+0000 7fc8f8d38700 1 --2- 172.21.15.26:0/1914645611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8f4100e60 0x7fc8f4196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.803+0000 7fc8f8d38700 1 -- 172.21.15.26:0/1914645611 >> 172.21.15.26:0/1914645611 conn(0x7fc8f40fb1c0 msgr2=0x7fc8f40fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:01.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.803+0000 7fc8f8d38700 1 -- 172.21.15.26:0/1914645611 shutdown_connections 2023-12-01T01:04:01.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.803+0000 7fc8f8d38700 1 -- 172.21.15.26:0/1914645611 wait complete. 2023-12-01T01:04:01.818 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T00:59:06.411348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T01:02:45.762784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T01:02:46.638998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T01:04:01.819 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T01:04:01.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.946+0000 7f87021d0700 1 -- 172.21.15.26:0/2998788912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc102910 msgr2=0x7f86fc1091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:01.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.946+0000 7f87021d0700 1 --2- 172.21.15.26:0/2998788912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc102910 0x7f86fc1091c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f86f400b0d0 tx=0x7f86f400b3e0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.946+0000 7f87021d0700 1 -- 172.21.15.26:0/2998788912 shutdown_connections 2023-12-01T01:04:01.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.946+0000 7f87021d0700 1 --2- 172.21.15.26:0/2998788912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc102910 0x7f86fc1091c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.946+0000 7f87021d0700 1 --2- 172.21.15.26:0/2998788912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86fc100d80 0x7f86fc1011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.946+0000 7f87021d0700 1 --2- 172.21.15.26:0/2998788912 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86fc101f70 0x7f86fc1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.946+0000 7f87021d0700 1 -- 172.21.15.26:0/2998788912 >> 172.21.15.26:0/2998788912 conn(0x7f86fc0fc310 msgr2=0x7f86fc0fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:01.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.946+0000 7f87021d0700 1 -- 172.21.15.26:0/2998788912 shutdown_connections 2023-12-01T01:04:01.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.946+0000 7f87021d0700 1 -- 172.21.15.26:0/2998788912 wait complete. 2023-12-01T01:04:01.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f87021d0700 1 Processor -- start 2023-12-01T01:04:01.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f87021d0700 1 -- start start 2023-12-01T01:04:01.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f87021d0700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86fc100d80 0x7f86fc074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:01.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f87021d0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86fc101f70 0x7f86fc073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:01.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f87021d0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc102910 0x7f86fc0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:01.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f87021d0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc073e60 con 0x7f86fc102910 2023-12-01T01:04:01.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f87021d0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc073fd0 con 0x7f86fc101f70 2023-12-01T01:04:01.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f87021d0700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc1a0cd0 con 0x7f86fc100d80 2023-12-01T01:04:01.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f86fbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc102910 0x7f86fc0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:01.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f86fbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc102910 0x7f86fc0736c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54578/0 (socket says 172.21.15.26:54578) 2023-12-01T01:04:01.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f86fbfff700 1 -- 172.21.15.26:0/3774021887 learned_addr learned my addr 172.21.15.26:0/3774021887 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:01.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f86fb7fe700 1 --2- 172.21.15.26:0/3774021887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86fc100d80 0x7f86fc074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:01.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f86faffd700 1 --2- 172.21.15.26:0/3774021887 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86fc101f70 0x7f86fc073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:01.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f86fbfff700 1 -- 172.21.15.26:0/3774021887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86fc100d80 msgr2=0x7f86fc074b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:01.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f86fbfff700 1 --2- 172.21.15.26:0/3774021887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86fc100d80 0x7f86fc074b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f86fbfff700 1 -- 172.21.15.26:0/3774021887 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86fc101f70 msgr2=0x7f86fc073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:01.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f86fbfff700 1 --2- 172.21.15.26:0/3774021887 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86fc101f70 0x7f86fc073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:01.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f86fbfff700 1 -- 172.21.15.26:0/3774021887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f4009d00 con 0x7f86fc102910 2023-12-01T01:04:01.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.947+0000 7f86faffd700 1 --2- 172.21.15.26:0/3774021887 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86fc101f70 0x7f86fc073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:01.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.948+0000 7f86fbfff700 1 --2- 172.21.15.26:0/3774021887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc102910 0x7f86fc0736c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f86f4009300 tx=0x7f86f4009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:01.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.948+0000 7f86f8ff9700 1 -- 172.21.15.26:0/3774021887 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f400e040 con 0x7f86fc102910 2023-12-01T01:04:01.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.948+0000 7f86f8ff9700 1 -- 172.21.15.26:0/3774021887 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f86f4003e10 con 0x7f86fc102910 2023-12-01T01:04:01.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.948+0000 7f87021d0700 1 -- 172.21.15.26:0/3774021887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86fc1a0f50 con 0x7f86fc102910 2023-12-01T01:04:01.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.948+0000 7f86f8ff9700 1 -- 172.21.15.26:0/3774021887 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f4005440 con 0x7f86fc102910 2023-12-01T01:04:01.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.948+0000 7f87021d0700 1 -- 172.21.15.26:0/3774021887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86fc1a1320 con 0x7f86fc102910 2023-12-01T01:04:01.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.949+0000 7f87021d0700 1 -- 172.21.15.26:0/3774021887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86fc107bc0 con 0x7f86fc102910 2023-12-01T01:04:01.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.950+0000 7f86f8ff9700 1 -- 172.21.15.26:0/3774021887 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f86f401ba30 con 0x7f86fc102910 2023-12-01T01:04:01.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.951+0000 7f86f8ff9700 1 --2- 172.21.15.26:0/3774021887 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f86e40a0520 0x7f86e40a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:01.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.951+0000 7f86fb7fe700 1 --2- 172.21.15.26:0/3774021887 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f86e40a0520 0x7f86e40a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:01.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.951+0000 7f86f8ff9700 1 -- 172.21.15.26:0/3774021887 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f86f40cd470 con 0x7f86fc102910 2023-12-01T01:04:01.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.951+0000 7f86fb7fe700 1 --2- 172.21.15.26:0/3774021887 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f86e40a0520 0x7f86e40a29e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f86f0005950 tx=0x7f86f000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:01.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:01.955+0000 7f86f8ff9700 1 -- 172.21.15.26:0/3774021887 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f86f40970b0 con 0x7f86fc102910 2023-12-01T01:04:02.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:01 smithi026 ceph-mon[98801]: pgmap v284: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-01T01:04:02.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:01 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/802878348' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-12-01T01:04:02.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.156+0000 7f87021d0700 1 -- 172.21.15.26:0/3774021887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86fc02ce00 con 0x7f86fc102910 2023-12-01T01:04:02.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.156+0000 7f86f8ff9700 1 -- 172.21.15.26:0/3774021887 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86f409a6d0 con 0x7f86fc102910 2023-12-01T01:04:02.158 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-12-01T01:04:02.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.158+0000 7f87021d0700 1 -- 172.21.15.26:0/3774021887 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f86e40a0520 msgr2=0x7f86e40a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:02.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.158+0000 7f87021d0700 1 --2- 172.21.15.26:0/3774021887 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f86e40a0520 0x7f86e40a29e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f86f0005950 tx=0x7f86f000a300 comp rx=0 tx=0).stop 2023-12-01T01:04:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.158+0000 7f87021d0700 1 -- 172.21.15.26:0/3774021887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc102910 msgr2=0x7f86fc0736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.158+0000 7f87021d0700 1 --2- 172.21.15.26:0/3774021887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc102910 0x7f86fc0736c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f86f4009300 tx=0x7f86f4009330 comp rx=0 tx=0).stop 2023-12-01T01:04:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.158+0000 7f87021d0700 1 -- 172.21.15.26:0/3774021887 shutdown_connections 2023-12-01T01:04:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.158+0000 7f87021d0700 1 --2- 172.21.15.26:0/3774021887 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f86e40a0520 0x7f86e40a29e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.158+0000 7f87021d0700 1 --2- 172.21.15.26:0/3774021887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86fc102910 0x7f86fc0736c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.158+0000 7f87021d0700 1 --2- 172.21.15.26:0/3774021887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f86fc100d80 0x7f86fc074b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.158+0000 7f87021d0700 1 --2- 172.21.15.26:0/3774021887 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f86fc101f70 0x7f86fc073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.158+0000 7f87021d0700 1 -- 172.21.15.26:0/3774021887 >> 172.21.15.26:0/3774021887 conn(0x7f86fc0fc310 msgr2=0x7f86fc0fe490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.159+0000 7f87021d0700 1 -- 172.21.15.26:0/3774021887 shutdown_connections 2023-12-01T01:04:02.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.159+0000 7f87021d0700 1 -- 172.21.15.26:0/3774021887 wait complete. 2023-12-01T01:04:02.173 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T01:04:02.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:01 smithi116 ceph-mon[103554]: pgmap v284: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-01T01:04:02.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:01 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/802878348' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-12-01T01:04:02.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:01 smithi093 ceph-mon[103327]: pgmap v284: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2023-12-01T01:04:02.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:01 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/802878348' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-12-01T01:04:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.299+0000 7f0f73654700 1 -- 172.21.15.26:0/3974256601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f6c101f70 msgr2=0x7f0f6c1023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.299+0000 7f0f73654700 1 --2- 172.21.15.26:0/3974256601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f6c101f70 0x7f0f6c1023d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0f680099c0 tx=0x7f0f68009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.299+0000 7f0f73654700 1 -- 172.21.15.26:0/3974256601 shutdown_connections 2023-12-01T01:04:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.299+0000 7f0f73654700 1 --2- 172.21.15.26:0/3974256601 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f6c102910 0x7f0f6c1091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.299+0000 7f0f73654700 1 --2- 172.21.15.26:0/3974256601 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f6c100d80 0x7f0f6c1011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.299+0000 7f0f73654700 1 --2- 172.21.15.26:0/3974256601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f6c101f70 0x7f0f6c1023d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.299+0000 7f0f73654700 1 -- 172.21.15.26:0/3974256601 >> 172.21.15.26:0/3974256601 conn(0x7f0f6c0fc310 msgr2=0x7f0f6c0fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.299+0000 7f0f73654700 1 -- 172.21.15.26:0/3974256601 shutdown_connections 2023-12-01T01:04:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.299+0000 7f0f73654700 1 -- 172.21.15.26:0/3974256601 wait complete. 2023-12-01T01:04:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f73654700 1 Processor -- start 2023-12-01T01:04:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f73654700 1 -- start start 2023-12-01T01:04:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f73654700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f6c100d80 0x7f0f6c074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f73654700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f6c101f70 0x7f0f6c073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f73654700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f6c102910 0x7f0f6c0736c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f73654700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c073e60 con 0x7f0f6c100d80 2023-12-01T01:04:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f73654700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c073fd0 con 0x7f0f6c101f70 2023-12-01T01:04:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f73654700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c1a0bd0 con 0x7f0f6c102910 2023-12-01T01:04:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f713f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f6c100d80 0x7f0f6c074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:02.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f713f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f6c100d80 0x7f0f6c074b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54588/0 (socket says 172.21.15.26:54588) 2023-12-01T01:04:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f713f0700 1 -- 172.21.15.26:0/991968499 learned_addr learned my addr 172.21.15.26:0/991968499 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f70bef700 1 --2- 172.21.15.26:0/991968499 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f6c101f70 0x7f0f6c073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f71bf1700 1 --2- 172.21.15.26:0/991968499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f6c102910 0x7f0f6c0736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f713f0700 1 -- 172.21.15.26:0/991968499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f6c102910 msgr2=0x7f0f6c0736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f713f0700 1 --2- 172.21.15.26:0/991968499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f6c102910 0x7f0f6c0736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f713f0700 1 -- 172.21.15.26:0/991968499 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f6c101f70 msgr2=0x7f0f6c073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f713f0700 1 --2- 172.21.15.26:0/991968499 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f6c101f70 0x7f0f6c073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.300+0000 7f0f713f0700 1 -- 172.21.15.26:0/991968499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f680095f0 con 0x7f0f6c100d80 2023-12-01T01:04:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.301+0000 7f0f713f0700 1 --2- 172.21.15.26:0/991968499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f6c100d80 0x7f0f6c074b40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00d980 tx=0x7f0f5c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.301+0000 7f0f627fc700 1 -- 172.21.15.26:0/991968499 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00bb60 con 0x7f0f6c100d80 2023-12-01T01:04:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.301+0000 7f0f627fc700 1 -- 172.21.15.26:0/991968499 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0f5c007620 con 0x7f0f6c100d80 2023-12-01T01:04:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.301+0000 7f0f73654700 1 -- 172.21.15.26:0/991968499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6c1a0eb0 con 0x7f0f6c100d80 2023-12-01T01:04:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.301+0000 7f0f627fc700 1 -- 172.21.15.26:0/991968499 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00f620 con 0x7f0f6c100d80 2023-12-01T01:04:02.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.301+0000 7f0f73654700 1 -- 172.21.15.26:0/991968499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6c1a12d0 con 0x7f0f6c100d80 2023-12-01T01:04:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.302+0000 7f0f73654700 1 -- 172.21.15.26:0/991968499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c1082f0 con 0x7f0f6c100d80 2023-12-01T01:04:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.303+0000 7f0f627fc700 1 -- 172.21.15.26:0/991968499 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f0f5c010460 con 0x7f0f6c100d80 2023-12-01T01:04:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.303+0000 7f0f627fc700 1 --2- 172.21.15.26:0/991968499 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0f580a0520 0x7f0f580a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:02.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.303+0000 7f0f627fc700 1 -- 172.21.15.26:0/991968499 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0f5c0cb8f0 con 0x7f0f6c100d80 2023-12-01T01:04:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.304+0000 7f0f70bef700 1 --2- 172.21.15.26:0/991968499 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0f580a0520 0x7f0f580a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:02.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.304+0000 7f0f70bef700 1 --2- 172.21.15.26:0/991968499 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0f580a0520 0x7f0f580a29e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0f68000c00 tx=0x7f0f68005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:02.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.308+0000 7f0f627fc700 1 -- 172.21.15.26:0/991968499 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0f5c0954a0 con 0x7f0f6c100d80 2023-12-01T01:04:02.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.513+0000 7f0f73654700 1 -- 172.21.15.26:0/991968499 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0f6c061ab0 con 0x7f0f6c100d80 2023-12-01T01:04:02.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.513+0000 7f0f627fc700 1 -- 172.21.15.26:0/991968499 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0f5c00de60 con 0x7f0f6c100d80 2023-12-01T01:04:02.515 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-12-01T01:04:02.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.516+0000 7f0f73654700 1 -- 172.21.15.26:0/991968499 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0f580a0520 msgr2=0x7f0f580a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:02.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.516+0000 7f0f73654700 1 --2- 172.21.15.26:0/991968499 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0f580a0520 0x7f0f580a29e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0f68000c00 tx=0x7f0f68005fb0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.516+0000 7f0f73654700 1 -- 172.21.15.26:0/991968499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f6c100d80 msgr2=0x7f0f6c074b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:02.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.516+0000 7f0f73654700 1 --2- 172.21.15.26:0/991968499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f6c100d80 0x7f0f6c074b40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00d980 tx=0x7f0f5c00dd40 comp rx=0 tx=0).stop 2023-12-01T01:04:02.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.516+0000 7f0f73654700 1 -- 172.21.15.26:0/991968499 shutdown_connections 2023-12-01T01:04:02.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.516+0000 7f0f73654700 1 --2- 172.21.15.26:0/991968499 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0f580a0520 0x7f0f580a29e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.516+0000 7f0f73654700 1 --2- 172.21.15.26:0/991968499 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0f6c102910 0x7f0f6c0736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.516+0000 7f0f73654700 1 --2- 172.21.15.26:0/991968499 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f6c100d80 0x7f0f6c074b40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.516+0000 7f0f73654700 1 --2- 172.21.15.26:0/991968499 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0f6c101f70 0x7f0f6c073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.516+0000 7f0f73654700 1 -- 172.21.15.26:0/991968499 >> 172.21.15.26:0/991968499 conn(0x7f0f6c0fc310 msgr2=0x7f0f6c105430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:02.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.516+0000 7f0f73654700 1 -- 172.21.15.26:0/991968499 shutdown_connections 2023-12-01T01:04:02.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.516+0000 7f0f73654700 1 -- 172.21.15.26:0/991968499 wait complete. 2023-12-01T01:04:02.530 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T01:04:02.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.656+0000 7fb54f8cf700 1 -- 172.21.15.26:0/2437297044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb548101200 msgr2=0x7fb548101620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:02.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.656+0000 7fb54f8cf700 1 --2- 172.21.15.26:0/2437297044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb548101200 0x7fb548101620 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb538009990 tx=0x7fb538009ca0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.656+0000 7fb54f8cf700 1 -- 172.21.15.26:0/2437297044 shutdown_connections 2023-12-01T01:04:02.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.656+0000 7fb54f8cf700 1 --2- 172.21.15.26:0/2437297044 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb5481008d0 0x7fb548108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.656+0000 7fb54f8cf700 1 --2- 172.21.15.26:0/2437297044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb548101200 0x7fb548101620 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.656+0000 7fb54f8cf700 1 --2- 172.21.15.26:0/2437297044 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb5480fff30 0x7fb548100390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.656+0000 7fb54f8cf700 1 -- 172.21.15.26:0/2437297044 >> 172.21.15.26:0/2437297044 conn(0x7fb5480fa960 msgr2=0x7fb5480fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.656+0000 7fb54f8cf700 1 -- 172.21.15.26:0/2437297044 shutdown_connections 2023-12-01T01:04:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.656+0000 7fb54f8cf700 1 -- 172.21.15.26:0/2437297044 wait complete. 2023-12-01T01:04:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.657+0000 7fb54f8cf700 1 Processor -- start 2023-12-01T01:04:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.657+0000 7fb54f8cf700 1 -- start start 2023-12-01T01:04:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.657+0000 7fb54f8cf700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb5480fff30 0x7fb548198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.657+0000 7fb54f8cf700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5481008d0 0x7fb5481992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.657+0000 7fb54f8cf700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb548101200 0x7fb5481a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.657+0000 7fb54f8cf700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5481a08e0 con 0x7fb5481008d0 2023-12-01T01:04:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.657+0000 7fb54f8cf700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5481a0a50 con 0x7fb5480fff30 2023-12-01T01:04:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.657+0000 7fb54f8cf700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5481a0c10 con 0x7fb548101200 2023-12-01T01:04:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.657+0000 7fb54ce6a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5481008d0 0x7fb5481992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:02.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.657+0000 7fb54ce6a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5481008d0 0x7fb5481992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54602/0 (socket says 172.21.15.26:54602) 2023-12-01T01:04:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.657+0000 7fb54ce6a700 1 -- 172.21.15.26:0/4090878035 learned_addr learned my addr 172.21.15.26:0/4090878035 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.657+0000 7fb54d66b700 1 --2- 172.21.15.26:0/4090878035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb5480fff30 0x7fb548198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.658+0000 7fb54de6c700 1 --2- 172.21.15.26:0/4090878035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb548101200 0x7fb5481a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.658+0000 7fb54ce6a700 1 -- 172.21.15.26:0/4090878035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb548101200 msgr2=0x7fb5481a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.658+0000 7fb54ce6a700 1 --2- 172.21.15.26:0/4090878035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb548101200 0x7fb5481a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.658+0000 7fb54ce6a700 1 -- 172.21.15.26:0/4090878035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb5480fff30 msgr2=0x7fb548198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.658+0000 7fb54ce6a700 1 --2- 172.21.15.26:0/4090878035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb5480fff30 0x7fb548198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.658+0000 7fb54ce6a700 1 -- 172.21.15.26:0/4090878035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5380095f0 con 0x7fb5481008d0 2023-12-01T01:04:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.658+0000 7fb54ce6a700 1 --2- 172.21.15.26:0/4090878035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5481008d0 0x7fb5481992e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb54400d950 tx=0x7fb54400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.658+0000 7fb53e7fc700 1 -- 172.21.15.26:0/4090878035 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544009940 con 0x7fb5481008d0 2023-12-01T01:04:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.658+0000 7fb53e7fc700 1 -- 172.21.15.26:0/4090878035 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb544010460 con 0x7fb5481008d0 2023-12-01T01:04:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.658+0000 7fb54f8cf700 1 -- 172.21.15.26:0/4090878035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5481a0ef0 con 0x7fb5481008d0 2023-12-01T01:04:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.658+0000 7fb53e7fc700 1 -- 172.21.15.26:0/4090878035 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400f620 con 0x7fb5481008d0 2023-12-01T01:04:02.662 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.658+0000 7fb54f8cf700 1 -- 172.21.15.26:0/4090878035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5481a1370 con 0x7fb5481008d0 2023-12-01T01:04:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.659+0000 7fb54f8cf700 1 -- 172.21.15.26:0/4090878035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54810b5a0 con 0x7fb5481008d0 2023-12-01T01:04:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.660+0000 7fb53e7fc700 1 -- 172.21.15.26:0/4090878035 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fb544010960 con 0x7fb5481008d0 2023-12-01T01:04:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.661+0000 7fb53e7fc700 1 --2- 172.21.15.26:0/4090878035 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb5340a05a0 0x7fb5340a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.661+0000 7fb54d66b700 1 --2- 172.21.15.26:0/4090878035 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb5340a05a0 0x7fb5340a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.661+0000 7fb53e7fc700 1 -- 172.21.15.26:0/4090878035 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb5440cb820 con 0x7fb5481008d0 2023-12-01T01:04:02.663 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.661+0000 7fb54d66b700 1 --2- 172.21.15.26:0/4090878035 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb5340a05a0 0x7fb5340a2a60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb54819a270 tx=0x7fb538005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:02.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.665+0000 7fb53e7fc700 1 -- 172.21.15.26:0/4090878035 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb544095370 con 0x7fb5481008d0 2023-12-01T01:04:02.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.868+0000 7fb54f8cf700 1 -- 172.21.15.26:0/4090878035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb5481a19b0 con 0x7fb5481008d0 2023-12-01T01:04:02.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.869+0000 7fb53e7fc700 1 -- 172.21.15.26:0/4090878035 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb544098990 con 0x7fb5481008d0 2023-12-01T01:04:02.871 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-12-01T01:04:02.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.871+0000 7fb54f8cf700 1 -- 172.21.15.26:0/4090878035 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb5340a05a0 msgr2=0x7fb5340a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:02.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.871+0000 7fb54f8cf700 1 --2- 172.21.15.26:0/4090878035 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb5340a05a0 0x7fb5340a2a60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb54819a270 tx=0x7fb538005fb0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.873 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.871+0000 7fb54f8cf700 1 -- 172.21.15.26:0/4090878035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5481008d0 msgr2=0x7fb5481992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:02.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.871+0000 7fb54f8cf700 1 --2- 172.21.15.26:0/4090878035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5481008d0 0x7fb5481992e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb54400d950 tx=0x7fb54400dc60 comp rx=0 tx=0).stop 2023-12-01T01:04:02.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.871+0000 7fb54f8cf700 1 -- 172.21.15.26:0/4090878035 shutdown_connections 2023-12-01T01:04:02.874 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.871+0000 7fb54f8cf700 1 --2- 172.21.15.26:0/4090878035 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb5340a05a0 0x7fb5340a2a60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.871+0000 7fb54f8cf700 1 --2- 172.21.15.26:0/4090878035 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb548101200 0x7fb5481a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.871+0000 7fb54f8cf700 1 --2- 172.21.15.26:0/4090878035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb5480fff30 0x7fb548198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.871+0000 7fb54f8cf700 1 --2- 172.21.15.26:0/4090878035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb5481008d0 0x7fb5481992e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:02.877 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.871+0000 7fb54f8cf700 1 -- 172.21.15.26:0/4090878035 >> 172.21.15.26:0/4090878035 conn(0x7fb5480fa960 msgr2=0x7fb5480fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:02.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.871+0000 7fb54f8cf700 1 -- 172.21.15.26:0/4090878035 shutdown_connections 2023-12-01T01:04:02.878 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:02.871+0000 7fb54f8cf700 1 -- 172.21.15.26:0/4090878035 wait complete. 2023-12-01T01:04:02.885 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:04:03.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.009+0000 7f7a65782700 1 -- 172.21.15.26:0/1022549581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a60100fd0 msgr2=0x7f7a60107880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:03.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.009+0000 7f7a65782700 1 --2- 172.21.15.26:0/1022549581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a60100fd0 0x7f7a60107880 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800c240 tx=0x7f7a5800c550 comp rx=0 tx=0).stop 2023-12-01T01:04:03.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.009+0000 7f7a65782700 1 -- 172.21.15.26:0/1022549581 shutdown_connections 2023-12-01T01:04:03.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.009+0000 7f7a65782700 1 --2- 172.21.15.26:0/1022549581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a60100fd0 0x7f7a60107880 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.009+0000 7f7a65782700 1 --2- 172.21.15.26:0/1022549581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a600ff440 0x7f7a600ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.009+0000 7f7a65782700 1 --2- 172.21.15.26:0/1022549581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a60100630 0x7f7a60100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.010+0000 7f7a65782700 1 -- 172.21.15.26:0/1022549581 >> 172.21.15.26:0/1022549581 conn(0x7f7a600fa9f0 msgr2=0x7f7a600fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:03.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.010+0000 7f7a65782700 1 -- 172.21.15.26:0/1022549581 shutdown_connections 2023-12-01T01:04:03.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.010+0000 7f7a65782700 1 -- 172.21.15.26:0/1022549581 wait complete. 2023-12-01T01:04:03.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.010+0000 7f7a65782700 1 Processor -- start 2023-12-01T01:04:03.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.010+0000 7f7a65782700 1 -- start start 2023-12-01T01:04:03.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.010+0000 7f7a65782700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a600ff440 0x7f7a601949c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:03.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.010+0000 7f7a65782700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a60100630 0x7f7a60194f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:03.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a65782700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a60100fd0 0x7f7a6019bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a65782700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6019c540 con 0x7f7a60100630 2023-12-01T01:04:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a65782700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6019c680 con 0x7f7a60100fd0 2023-12-01T01:04:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a65782700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a6019c810 con 0x7f7a600ff440 2023-12-01T01:04:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a5e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a60100630 0x7f7a60194f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a5e7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a60100630 0x7f7a60194f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54618/0 (socket says 172.21.15.26:54618) 2023-12-01T01:04:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a5e7fc700 1 -- 172.21.15.26:0/3276848631 learned_addr learned my addr 172.21.15.26:0/3276848631 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a5effd700 1 --2- 172.21.15.26:0/3276848631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a600ff440 0x7f7a601949c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a5f7fe700 1 --2- 172.21.15.26:0/3276848631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a60100fd0 0x7f7a6019bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a5e7fc700 1 -- 172.21.15.26:0/3276848631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a600ff440 msgr2=0x7f7a601949c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a5e7fc700 1 --2- 172.21.15.26:0/3276848631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a600ff440 0x7f7a601949c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a5e7fc700 1 -- 172.21.15.26:0/3276848631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a60100fd0 msgr2=0x7f7a6019bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a5e7fc700 1 --2- 172.21.15.26:0/3276848631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a60100fd0 0x7f7a6019bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a5e7fc700 1 -- 172.21.15.26:0/3276848631 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5800ae10 con 0x7f7a60100630 2023-12-01T01:04:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a5e7fc700 1 --2- 172.21.15.26:0/3276848631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a60100630 0x7f7a60194f00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400d950 tx=0x7f7a5400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:03.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a47fff700 1 -- 172.21.15.26:0/3276848631 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54009940 con 0x7f7a60100630 2023-12-01T01:04:03.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a47fff700 1 -- 172.21.15.26:0/3276848631 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7a54010460 con 0x7f7a60100630 2023-12-01T01:04:03.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a47fff700 1 -- 172.21.15.26:0/3276848631 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5400f620 con 0x7f7a60100630 2023-12-01T01:04:03.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a65782700 1 -- 172.21.15.26:0/3276848631 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a6019caf0 con 0x7f7a60100630 2023-12-01T01:04:03.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.011+0000 7f7a65782700 1 -- 172.21.15.26:0/3276848631 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a6019cfb0 con 0x7f7a60100630 2023-12-01T01:04:03.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.012+0000 7f7a65782700 1 -- 172.21.15.26:0/3276848631 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a6010a580 con 0x7f7a60100630 2023-12-01T01:04:03.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.014+0000 7f7a47fff700 1 -- 172.21.15.26:0/3276848631 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f7a54010960 con 0x7f7a60100630 2023-12-01T01:04:03.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.014+0000 7f7a47fff700 1 --2- 172.21.15.26:0/3276848631 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7a480a0570 0x7f7a480a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:03.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.014+0000 7f7a47fff700 1 -- 172.21.15.26:0/3276848631 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7a540cb840 con 0x7f7a60100630 2023-12-01T01:04:03.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.014+0000 7f7a5effd700 1 --2- 172.21.15.26:0/3276848631 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7a480a0570 0x7f7a480a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:03.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.015+0000 7f7a5effd700 1 --2- 172.21.15.26:0/3276848631 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7a480a0570 0x7f7a480a2a30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7a60100490 tx=0x7f7a50009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:03.019 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.018+0000 7f7a47fff700 1 -- 172.21.15.26:0/3276848631 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7a540953f0 con 0x7f7a60100630 2023-12-01T01:04:03.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:02 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1914645611' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:03.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:02 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3774021887' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:04:03.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:02 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/991968499' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:04:03.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:02 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1914645611' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:03.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:02 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3774021887' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:04:03.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:02 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/991968499' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:04:03.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.267+0000 7f7a65782700 1 -- 172.21.15.26:0/3276848631 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a6010a740 con 0x7f7a60100630 2023-12-01T01:04:03.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.268+0000 7f7a47fff700 1 -- 172.21.15.26:0/3276848631 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10777 (secure 0 0 0) 0x7f7a54020090 con 0x7f7a60100630 2023-12-01T01:04:03.270 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:04:03.270 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6841/3515135915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6840","nonce":3515135915},{"type":"v1","addr":"172.21.15.26:6841","nonce":3515135915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-01T01:02:47.252972+0000","modified":"2023-12-01T01:02:52.326753+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24493,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.93:6837/3333520218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3333520218},{"type":"v1","addr":"172.21.15.93:6837","nonce":3333520218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6839/3364532241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":3364532241},{"type":"v1","addr":"172.21.15.93:6839","nonce":3364532241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T01:04:03.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.270+0000 7f7a65782700 1 -- 172.21.15.26:0/3276848631 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7a480a0570 msgr2=0x7f7a480a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:03.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.270+0000 7f7a65782700 1 --2- 172.21.15.26:0/3276848631 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7a480a0570 0x7f7a480a2a30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7a60100490 tx=0x7f7a50009260 comp rx=0 tx=0).stop 2023-12-01T01:04:03.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.270+0000 7f7a65782700 1 -- 172.21.15.26:0/3276848631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a60100630 msgr2=0x7f7a60194f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:03.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.270+0000 7f7a65782700 1 --2- 172.21.15.26:0/3276848631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a60100630 0x7f7a60194f00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400d950 tx=0x7f7a5400dc60 comp rx=0 tx=0).stop 2023-12-01T01:04:03.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.270+0000 7f7a65782700 1 -- 172.21.15.26:0/3276848631 shutdown_connections 2023-12-01T01:04:03.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.270+0000 7f7a65782700 1 --2- 172.21.15.26:0/3276848631 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7a480a0570 0x7f7a480a2a30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.270+0000 7f7a65782700 1 --2- 172.21.15.26:0/3276848631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a60100fd0 0x7f7a6019bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.270+0000 7f7a65782700 1 --2- 172.21.15.26:0/3276848631 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a600ff440 0x7f7a601949c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.270+0000 7f7a65782700 1 --2- 172.21.15.26:0/3276848631 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a60100630 0x7f7a60194f00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.270+0000 7f7a65782700 1 -- 172.21.15.26:0/3276848631 >> 172.21.15.26:0/3276848631 conn(0x7f7a600fa9f0 msgr2=0x7f7a600fca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:03.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.271+0000 7f7a65782700 1 -- 172.21.15.26:0/3276848631 shutdown_connections 2023-12-01T01:04:03.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.271+0000 7f7a65782700 1 -- 172.21.15.26:0/3276848631 wait complete. 2023-12-01T01:04:03.274 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 23 2023-12-01T01:04:03.284 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:02 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1914645611' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:03.284 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:02 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3774021887' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:04:03.284 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:02 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/991968499' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:04:03.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:04:03.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.409+0000 7fcbc9b21700 1 -- 172.21.15.26:0/1961346383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc40ffc70 msgr2=0x7fcbc4100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:03.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.409+0000 7fcbc9b21700 1 --2- 172.21.15.26:0/1961346383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc40ffc70 0x7fcbc4100090 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40099c0 tx=0x7fcbb4009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.409+0000 7fcbc9b21700 1 -- 172.21.15.26:0/1961346383 shutdown_connections 2023-12-01T01:04:03.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.409+0000 7fcbc9b21700 1 --2- 172.21.15.26:0/1961346383 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbc4101800 0x7fcbc41080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.409+0000 7fcbc9b21700 1 --2- 172.21.15.26:0/1961346383 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc40ffc70 0x7fcbc4100090 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.415 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.409+0000 7fcbc9b21700 1 --2- 172.21.15.26:0/1961346383 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbc4100e60 0x7fcbc41012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.409+0000 7fcbc9b21700 1 -- 172.21.15.26:0/1961346383 >> 172.21.15.26:0/1961346383 conn(0x7fcbc40fb1c0 msgr2=0x7fcbc40fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:03.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.409+0000 7fcbc9b21700 1 -- 172.21.15.26:0/1961346383 shutdown_connections 2023-12-01T01:04:03.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.409+0000 7fcbc9b21700 1 -- 172.21.15.26:0/1961346383 wait complete. 2023-12-01T01:04:03.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.410+0000 7fcbc9b21700 1 Processor -- start 2023-12-01T01:04:03.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.410+0000 7fcbc9b21700 1 -- start start 2023-12-01T01:04:03.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.410+0000 7fcbc9b21700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbc40ffc70 0x7fcbc4068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:03.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.410+0000 7fcbc9b21700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbc4100e60 0x7fcbc419dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:03.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.410+0000 7fcbc9b21700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc4101800 0x7fcbc41a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:03.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.410+0000 7fcbc9b21700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc41a0880 con 0x7fcbc4101800 2023-12-01T01:04:03.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.410+0000 7fcbc9b21700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc41a09f0 con 0x7fcbc4100e60 2023-12-01T01:04:03.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.410+0000 7fcbc9b21700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc41a0bb0 con 0x7fcbc40ffc70 2023-12-01T01:04:03.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.410+0000 7fcbc3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc4101800 0x7fcbc41a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:03.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.410+0000 7fcbc3fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc4101800 0x7fcbc41a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54634/0 (socket says 172.21.15.26:54634) 2023-12-01T01:04:03.416 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.410+0000 7fcbc3fff700 1 -- 172.21.15.26:0/2853357687 learned_addr learned my addr 172.21.15.26:0/2853357687 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:03.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.410+0000 7fcbc2ffd700 1 --2- 172.21.15.26:0/2853357687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbc4100e60 0x7fcbc419dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:03.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.410+0000 7fcbc37fe700 1 --2- 172.21.15.26:0/2853357687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbc40ffc70 0x7fcbc4068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:03.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.411+0000 7fcbc3fff700 1 -- 172.21.15.26:0/2853357687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbc40ffc70 msgr2=0x7fcbc4068a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:03.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.411+0000 7fcbc3fff700 1 --2- 172.21.15.26:0/2853357687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbc40ffc70 0x7fcbc4068a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.411+0000 7fcbc3fff700 1 -- 172.21.15.26:0/2853357687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbc4100e60 msgr2=0x7fcbc419dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:03.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.411+0000 7fcbc3fff700 1 --2- 172.21.15.26:0/2853357687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbc4100e60 0x7fcbc419dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.411+0000 7fcbc3fff700 1 -- 172.21.15.26:0/2853357687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb40095f0 con 0x7fcbc4101800 2023-12-01T01:04:03.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.411+0000 7fcbc37fe700 1 --2- 172.21.15.26:0/2853357687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbc40ffc70 0x7fcbc4068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:03.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.411+0000 7fcbc3fff700 1 --2- 172.21.15.26:0/2853357687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc4101800 0x7fcbc41a01d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc007ee0 tx=0x7fcbbc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:03.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.411+0000 7fcbc0ff9700 1 -- 172.21.15.26:0/2853357687 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc017070 con 0x7fcbc4101800 2023-12-01T01:04:03.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.411+0000 7fcbc0ff9700 1 -- 172.21.15.26:0/2853357687 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcbbc00f040 con 0x7fcbc4101800 2023-12-01T01:04:03.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.411+0000 7fcbc9b21700 1 -- 172.21.15.26:0/2853357687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc41a0e90 con 0x7fcbc4101800 2023-12-01T01:04:03.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.411+0000 7fcbc0ff9700 1 -- 172.21.15.26:0/2853357687 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc005760 con 0x7fcbc4101800 2023-12-01T01:04:03.417 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.411+0000 7fcbc9b21700 1 -- 172.21.15.26:0/2853357687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc41a1310 con 0x7fcbc4101800 2023-12-01T01:04:03.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.412+0000 7fcbc9b21700 1 -- 172.21.15.26:0/2853357687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc41071c0 con 0x7fcbc4101800 2023-12-01T01:04:03.418 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.414+0000 7fcbc0ff9700 1 -- 172.21.15.26:0/2853357687 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fcbbc0058c0 con 0x7fcbc4101800 2023-12-01T01:04:03.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.414+0000 7fcbc0ff9700 1 --2- 172.21.15.26:0/2853357687 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcbac0a0570 0x7fcbac0a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:03.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.414+0000 7fcbc37fe700 1 --2- 172.21.15.26:0/2853357687 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcbac0a0570 0x7fcbac0a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:03.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.414+0000 7fcbc0ff9700 1 -- 172.21.15.26:0/2853357687 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fcbbc0cb6e0 con 0x7fcbc4101800 2023-12-01T01:04:03.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.415+0000 7fcbc37fe700 1 --2- 172.21.15.26:0/2853357687 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcbac0a0570 0x7fcbac0a2a30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400b580 tx=0x7fcbb4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:03.419 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.418+0000 7fcbc0ff9700 1 -- 172.21.15.26:0/2853357687 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fcbbc095290 con 0x7fcbc4101800 2023-12-01T01:04:03.625 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.623+0000 7fcbc9b21700 1 -- 172.21.15.26:0/2853357687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbc402cec0 con 0x7fcbc4101800 2023-12-01T01:04:03.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.624+0000 7fcbc0ff9700 1 -- 172.21.15.26:0/2853357687 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22481 (secure 0 0 0) 0x7fcbbc009390 con 0x7fcbc4101800 2023-12-01T01:04:03.627 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:04:03.627 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":83,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:59.627676+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:04:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.626+0000 7fcbc9b21700 1 -- 172.21.15.26:0/2853357687 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcbac0a0570 msgr2=0x7fcbac0a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.626+0000 7fcbc9b21700 1 --2- 172.21.15.26:0/2853357687 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcbac0a0570 0x7fcbac0a2a30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400b580 tx=0x7fcbb4005fb0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.626+0000 7fcbc9b21700 1 -- 172.21.15.26:0/2853357687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc4101800 msgr2=0x7fcbc41a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.626+0000 7fcbc9b21700 1 --2- 172.21.15.26:0/2853357687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc4101800 0x7fcbc41a01d0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc007ee0 tx=0x7fcbbc00d3b0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.627+0000 7fcbc9b21700 1 -- 172.21.15.26:0/2853357687 shutdown_connections 2023-12-01T01:04:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.627+0000 7fcbc9b21700 1 --2- 172.21.15.26:0/2853357687 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcbac0a0570 0x7fcbac0a2a30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.627+0000 7fcbc9b21700 1 --2- 172.21.15.26:0/2853357687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcbc4101800 0x7fcbc41a01d0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.627+0000 7fcbc9b21700 1 --2- 172.21.15.26:0/2853357687 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcbc40ffc70 0x7fcbc4068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.627+0000 7fcbc9b21700 1 --2- 172.21.15.26:0/2853357687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbc4100e60 0x7fcbc419dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.627+0000 7fcbc9b21700 1 -- 172.21.15.26:0/2853357687 >> 172.21.15.26:0/2853357687 conn(0x7fcbc40fb1c0 msgr2=0x7fcbc4104300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.627+0000 7fcbc9b21700 1 -- 172.21.15.26:0/2853357687 shutdown_connections 2023-12-01T01:04:03.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.627+0000 7fcbc9b21700 1 -- 172.21.15.26:0/2853357687 wait complete. 2023-12-01T01:04:03.642 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T00:59:06.411348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T01:02:45.762784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T01:02:46.638998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T01:04:03.642 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T01:04:03.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.768+0000 7fbecdf9f700 1 -- 172.21.15.26:0/3121166227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbec80ffe70 msgr2=0x7fbec81002f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:03.772 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.768+0000 7fbecdf9f700 1 --2- 172.21.15.26:0/3121166227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbec80ffe70 0x7fbec81002f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0009990 tx=0x7fbeb0009ca0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.768+0000 7fbecdf9f700 1 -- 172.21.15.26:0/3121166227 shutdown_connections 2023-12-01T01:04:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.768+0000 7fbecdf9f700 1 --2- 172.21.15.26:0/3121166227 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbec8100830 0x7fbec81080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.768+0000 7fbecdf9f700 1 --2- 172.21.15.26:0/3121166227 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbec8101220 0x7fbec8101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.768+0000 7fbecdf9f700 1 --2- 172.21.15.26:0/3121166227 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbec80ffe70 0x7fbec81002f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.768+0000 7fbecdf9f700 1 -- 172.21.15.26:0/3121166227 >> 172.21.15.26:0/3121166227 conn(0x7fbec80fa960 msgr2=0x7fbec80fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.768+0000 7fbecdf9f700 1 -- 172.21.15.26:0/3121166227 shutdown_connections 2023-12-01T01:04:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.768+0000 7fbecdf9f700 1 -- 172.21.15.26:0/3121166227 wait complete. 2023-12-01T01:04:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.769+0000 7fbecdf9f700 1 Processor -- start 2023-12-01T01:04:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.769+0000 7fbecdf9f700 1 -- start start 2023-12-01T01:04:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.769+0000 7fbecdf9f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbec80ffe70 0x7fbec80ff8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.769+0000 7fbecdf9f700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbec8100830 0x7fbec819b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.769+0000 7fbecdf9f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbec8101220 0x7fbec819df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.769+0000 7fbecdf9f700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec819e6e0 con 0x7fbec80ffe70 2023-12-01T01:04:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.769+0000 7fbecdf9f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec819e850 con 0x7fbec8101220 2023-12-01T01:04:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.769+0000 7fbecdf9f700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec819ea10 con 0x7fbec8100830 2023-12-01T01:04:03.773 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.769+0000 7fbec77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbec80ffe70 0x7fbec80ff8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.769+0000 7fbec77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbec80ffe70 0x7fbec80ff8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54644/0 (socket says 172.21.15.26:54644) 2023-12-01T01:04:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.769+0000 7fbec77fe700 1 -- 172.21.15.26:0/44105016 learned_addr learned my addr 172.21.15.26:0/44105016 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.769+0000 7fbec7fff700 1 --2- 172.21.15.26:0/44105016 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbec8101220 0x7fbec819df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.769+0000 7fbec6ffd700 1 --2- 172.21.15.26:0/44105016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbec8100830 0x7fbec819b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.770+0000 7fbec77fe700 1 -- 172.21.15.26:0/44105016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbec8100830 msgr2=0x7fbec819b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.770+0000 7fbec77fe700 1 --2- 172.21.15.26:0/44105016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbec8100830 0x7fbec819b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.770+0000 7fbec77fe700 1 -- 172.21.15.26:0/44105016 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbec8101220 msgr2=0x7fbec819df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.770+0000 7fbec77fe700 1 --2- 172.21.15.26:0/44105016 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbec8101220 0x7fbec819df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.770+0000 7fbec77fe700 1 -- 172.21.15.26:0/44105016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb00095f0 con 0x7fbec80ffe70 2023-12-01T01:04:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.770+0000 7fbec77fe700 1 --2- 172.21.15.26:0/44105016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbec80ffe70 0x7fbec80ff8d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800c920 tx=0x7fbeb800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.770+0000 7fbec4ff9700 1 -- 172.21.15.26:0/44105016 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8007b00 con 0x7fbec80ffe70 2023-12-01T01:04:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.770+0000 7fbecdf9f700 1 -- 172.21.15.26:0/44105016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec819ecf0 con 0x7fbec80ffe70 2023-12-01T01:04:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.770+0000 7fbec4ff9700 1 -- 172.21.15.26:0/44105016 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbeb800ce70 con 0x7fbec80ffe70 2023-12-01T01:04:03.774 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.770+0000 7fbec4ff9700 1 -- 172.21.15.26:0/44105016 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb8005520 con 0x7fbec80ffe70 2023-12-01T01:04:03.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.770+0000 7fbecdf9f700 1 -- 172.21.15.26:0/44105016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec819f1a0 con 0x7fbec80ffe70 2023-12-01T01:04:03.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.771+0000 7fbecdf9f700 1 -- 172.21.15.26:0/44105016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec8106c10 con 0x7fbec80ffe70 2023-12-01T01:04:03.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.772+0000 7fbec4ff9700 1 -- 172.21.15.26:0/44105016 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fbeb8004750 con 0x7fbec80ffe70 2023-12-01T01:04:03.775 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.773+0000 7fbec4ff9700 1 --2- 172.21.15.26:0/44105016 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbeb40a0520 0x7fbeb40a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.773+0000 7fbec6ffd700 1 --2- 172.21.15.26:0/44105016 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbeb40a0520 0x7fbeb40a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.773+0000 7fbec4ff9700 1 -- 172.21.15.26:0/44105016 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbeb80cb5b0 con 0x7fbec80ffe70 2023-12-01T01:04:03.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.773+0000 7fbec6ffd700 1 --2- 172.21.15.26:0/44105016 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbeb40a0520 0x7fbeb40a29e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000b5c0 tx=0x7fbeb0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:03.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.777+0000 7fbec4ff9700 1 -- 172.21.15.26:0/44105016 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fbeb8095160 con 0x7fbec80ffe70 2023-12-01T01:04:03.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.978+0000 7fbecdf9f700 1 -- 172.21.15.26:0/44105016 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbec8061a40 con 0x7fbec80ffe70 2023-12-01T01:04:03.980 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.978+0000 7fbec4ff9700 1 -- 172.21.15.26:0/44105016 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbeb8098780 con 0x7fbec80ffe70 2023-12-01T01:04:03.980 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-12-01T01:04:03.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.980+0000 7fbecdf9f700 1 -- 172.21.15.26:0/44105016 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbeb40a0520 msgr2=0x7fbeb40a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:03.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.980+0000 7fbecdf9f700 1 --2- 172.21.15.26:0/44105016 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbeb40a0520 0x7fbeb40a29e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000b5c0 tx=0x7fbeb0005fb0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.980+0000 7fbecdf9f700 1 -- 172.21.15.26:0/44105016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbec80ffe70 msgr2=0x7fbec80ff8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:03.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.980+0000 7fbecdf9f700 1 --2- 172.21.15.26:0/44105016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbec80ffe70 0x7fbec80ff8d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbeb800c920 tx=0x7fbeb800cc30 comp rx=0 tx=0).stop 2023-12-01T01:04:03.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.980+0000 7fbecdf9f700 1 -- 172.21.15.26:0/44105016 shutdown_connections 2023-12-01T01:04:03.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.980+0000 7fbecdf9f700 1 --2- 172.21.15.26:0/44105016 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbeb40a0520 0x7fbeb40a29e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.980+0000 7fbecdf9f700 1 --2- 172.21.15.26:0/44105016 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbec8101220 0x7fbec819df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.980+0000 7fbecdf9f700 1 --2- 172.21.15.26:0/44105016 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbec80ffe70 0x7fbec80ff8d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.980+0000 7fbecdf9f700 1 --2- 172.21.15.26:0/44105016 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbec8100830 0x7fbec819b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:03.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.980+0000 7fbecdf9f700 1 -- 172.21.15.26:0/44105016 >> 172.21.15.26:0/44105016 conn(0x7fbec80fa960 msgr2=0x7fbec80fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:03.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.981+0000 7fbecdf9f700 1 -- 172.21.15.26:0/44105016 shutdown_connections 2023-12-01T01:04:03.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:03.981+0000 7fbecdf9f700 1 -- 172.21.15.26:0/44105016 wait complete. 2023-12-01T01:04:03.994 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:03 smithi026 ceph-mon[98801]: pgmap v285: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:04:03.994 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:03 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/4090878035' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:04:03.994 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:03 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3276848631' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:04:03.994 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:03 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2853357687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:03.995 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T01:04:04.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.122+0000 7f8c0f5b0700 1 -- 172.21.15.26:0/621707305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c08101860 msgr2=0x7f8c081080f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:04.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.122+0000 7f8c0f5b0700 1 --2- 172.21.15.26:0/621707305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c08101860 0x7f8c081080f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8c0000b0a0 tx=0x7f8c0000b3b0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.122+0000 7f8c0f5b0700 1 -- 172.21.15.26:0/621707305 shutdown_connections 2023-12-01T01:04:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.122+0000 7f8c0f5b0700 1 --2- 172.21.15.26:0/621707305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c08101860 0x7f8c081080f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.122+0000 7f8c0f5b0700 1 --2- 172.21.15.26:0/621707305 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c08100190 0x7f8c081005b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.122+0000 7f8c0f5b0700 1 --2- 172.21.15.26:0/621707305 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c08100ea0 0x7f8c08101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.122+0000 7f8c0f5b0700 1 -- 172.21.15.26:0/621707305 >> 172.21.15.26:0/621707305 conn(0x7f8c080fa960 msgr2=0x7f8c080fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.122+0000 7f8c0f5b0700 1 -- 172.21.15.26:0/621707305 shutdown_connections 2023-12-01T01:04:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.122+0000 7f8c0f5b0700 1 -- 172.21.15.26:0/621707305 wait complete. 2023-12-01T01:04:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0f5b0700 1 Processor -- start 2023-12-01T01:04:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0f5b0700 1 -- start start 2023-12-01T01:04:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0f5b0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c08100190 0x7f8c08194a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0f5b0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c08100ea0 0x7f8c08194f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0f5b0700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c08101860 0x7f8c0819bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0f5b0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0819c590 con 0x7f8c08100ea0 2023-12-01T01:04:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0f5b0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0819c6d0 con 0x7f8c08100190 2023-12-01T01:04:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0f5b0700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0819c860 con 0x7f8c08101860 2023-12-01T01:04:04.127 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0cb4b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c08100ea0 0x7f8c08194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0cb4b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c08100ea0 0x7f8c08194f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54660/0 (socket says 172.21.15.26:54660) 2023-12-01T01:04:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0cb4b700 1 -- 172.21.15.26:0/3757936346 learned_addr learned my addr 172.21.15.26:0/3757936346 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0db4d700 1 --2- 172.21.15.26:0/3757936346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c08101860 0x7f8c0819bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0d34c700 1 --2- 172.21.15.26:0/3757936346 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c08100190 0x7f8c08194a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0cb4b700 1 -- 172.21.15.26:0/3757936346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c08101860 msgr2=0x7f8c0819bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0cb4b700 1 --2- 172.21.15.26:0/3757936346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c08101860 0x7f8c0819bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0cb4b700 1 -- 172.21.15.26:0/3757936346 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c08100190 msgr2=0x7f8c08194a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0cb4b700 1 --2- 172.21.15.26:0/3757936346 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c08100190 0x7f8c08194a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.123+0000 7f8c0cb4b700 1 -- 172.21.15.26:0/3757936346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c00009d00 con 0x7f8c08100ea0 2023-12-01T01:04:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.124+0000 7f8c0cb4b700 1 --2- 172.21.15.26:0/3757936346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c08100ea0 0x7f8c08194f50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009c70 tx=0x7f8bfc009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.124+0000 7f8bfa7fc700 1 -- 172.21.15.26:0/3757936346 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc01d070 con 0x7f8c08100ea0 2023-12-01T01:04:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.124+0000 7f8bfa7fc700 1 -- 172.21.15.26:0/3757936346 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8bfc015040 con 0x7f8c08100ea0 2023-12-01T01:04:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.124+0000 7f8c0f5b0700 1 -- 172.21.15.26:0/3757936346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0819cb40 con 0x7f8c08100ea0 2023-12-01T01:04:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.124+0000 7f8bfa7fc700 1 -- 172.21.15.26:0/3757936346 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0039f0 con 0x7f8c08100ea0 2023-12-01T01:04:04.128 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.124+0000 7f8c0f5b0700 1 -- 172.21.15.26:0/3757936346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0819d050 con 0x7f8c08100ea0 2023-12-01T01:04:04.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.125+0000 7f8c0f5b0700 1 -- 172.21.15.26:0/3757936346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c08106b90 con 0x7f8c08100ea0 2023-12-01T01:04:04.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.126+0000 7f8bfa7fc700 1 -- 172.21.15.26:0/3757936346 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f8bfc003b70 con 0x7f8c08100ea0 2023-12-01T01:04:04.129 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.126+0000 7f8bfa7fc700 1 --2- 172.21.15.26:0/3757936346 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8bf40a0520 0x7f8bf40a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:04.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.127+0000 7f8bfa7fc700 1 -- 172.21.15.26:0/3757936346 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8bfc0cefa0 con 0x7f8c08100ea0 2023-12-01T01:04:04.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.127+0000 7f8c0d34c700 1 --2- 172.21.15.26:0/3757936346 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8bf40a0520 0x7f8bf40a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:04.130 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.127+0000 7f8c0d34c700 1 --2- 172.21.15.26:0/3757936346 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8bf40a0520 0x7f8bf40a29e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8c08067a60 tx=0x7f8c0400d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:04.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.130+0000 7f8bfa7fc700 1 -- 172.21.15.26:0/3757936346 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8bfc098c80 con 0x7f8c08100ea0 2023-12-01T01:04:04.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:03 smithi116 ceph-mon[103554]: pgmap v285: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:04:04.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:03 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/4090878035' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:04:04.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:03 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3276848631' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:04:04.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:03 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2853357687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:04.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:03 smithi093 ceph-mon[103327]: pgmap v285: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:04:04.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:03 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/4090878035' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:04:04.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:03 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3276848631' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:04:04.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:03 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2853357687' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:04.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.336+0000 7f8c0f5b0700 1 -- 172.21.15.26:0/3757936346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c0802cec0 con 0x7f8c08100ea0 2023-12-01T01:04:04.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.336+0000 7f8bfa7fc700 1 -- 172.21.15.26:0/3757936346 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8bfc09c2a0 con 0x7f8c08100ea0 2023-12-01T01:04:04.338 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-12-01T01:04:04.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.338+0000 7f8c0f5b0700 1 -- 172.21.15.26:0/3757936346 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8bf40a0520 msgr2=0x7f8bf40a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.338+0000 7f8c0f5b0700 1 --2- 172.21.15.26:0/3757936346 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8bf40a0520 0x7f8bf40a29e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8c08067a60 tx=0x7f8c0400d040 comp rx=0 tx=0).stop 2023-12-01T01:04:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.338+0000 7f8c0f5b0700 1 -- 172.21.15.26:0/3757936346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c08100ea0 msgr2=0x7f8c08194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.338+0000 7f8c0f5b0700 1 --2- 172.21.15.26:0/3757936346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c08100ea0 0x7f8c08194f50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009c70 tx=0x7f8bfc009f80 comp rx=0 tx=0).stop 2023-12-01T01:04:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.338+0000 7f8c0f5b0700 1 -- 172.21.15.26:0/3757936346 shutdown_connections 2023-12-01T01:04:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.338+0000 7f8c0f5b0700 1 --2- 172.21.15.26:0/3757936346 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8bf40a0520 0x7f8bf40a29e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.338+0000 7f8c0f5b0700 1 --2- 172.21.15.26:0/3757936346 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8c08101860 0x7f8c0819bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.338+0000 7f8c0f5b0700 1 --2- 172.21.15.26:0/3757936346 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c08100190 0x7f8c08194a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.338+0000 7f8c0f5b0700 1 --2- 172.21.15.26:0/3757936346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8c08100ea0 0x7f8c08194f50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.338+0000 7f8c0f5b0700 1 -- 172.21.15.26:0/3757936346 >> 172.21.15.26:0/3757936346 conn(0x7f8c080fa960 msgr2=0x7f8c080fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.338+0000 7f8c0f5b0700 1 -- 172.21.15.26:0/3757936346 shutdown_connections 2023-12-01T01:04:04.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.338+0000 7f8c0f5b0700 1 -- 172.21.15.26:0/3757936346 wait complete. 2023-12-01T01:04:04.353 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T01:04:04.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.480+0000 7f5b692bb700 1 -- 172.21.15.26:0/331927077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b64101810 msgr2=0x7f5b641080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.480+0000 7f5b692bb700 1 --2- 172.21.15.26:0/331927077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b64101810 0x7f5b641080c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00b0d0 tx=0x7f5b5c00b3e0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.480+0000 7f5b692bb700 1 -- 172.21.15.26:0/331927077 shutdown_connections 2023-12-01T01:04:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.480+0000 7f5b692bb700 1 --2- 172.21.15.26:0/331927077 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b64101810 0x7f5b641080c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.480+0000 7f5b692bb700 1 --2- 172.21.15.26:0/331927077 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b640ffc80 0x7f5b641000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.480+0000 7f5b692bb700 1 --2- 172.21.15.26:0/331927077 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b64100e70 0x7f5b641012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.480+0000 7f5b692bb700 1 -- 172.21.15.26:0/331927077 >> 172.21.15.26:0/331927077 conn(0x7f5b640fb1f0 msgr2=0x7f5b640fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.480+0000 7f5b692bb700 1 -- 172.21.15.26:0/331927077 shutdown_connections 2023-12-01T01:04:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.480+0000 7f5b692bb700 1 -- 172.21.15.26:0/331927077 wait complete. 2023-12-01T01:04:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b692bb700 1 Processor -- start 2023-12-01T01:04:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b692bb700 1 -- start start 2023-12-01T01:04:04.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b692bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b640ffc80 0x7f5b64196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b692bb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b64100e70 0x7f5b641970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b692bb700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b64101810 0x7f5b6419e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b692bb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6419e720 con 0x7f5b640ffc80 2023-12-01T01:04:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b692bb700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6419e860 con 0x7f5b64100e70 2023-12-01T01:04:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b692bb700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6419e9f0 con 0x7f5b64101810 2023-12-01T01:04:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b62ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b640ffc80 0x7f5b64196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b62ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b640ffc80 0x7f5b64196ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54672/0 (socket says 172.21.15.26:54672) 2023-12-01T01:04:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b62ffd700 1 -- 172.21.15.26:0/2494071853 learned_addr learned my addr 172.21.15.26:0/2494071853 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b627fc700 1 --2- 172.21.15.26:0/2494071853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b64100e70 0x7f5b641970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b637fe700 1 --2- 172.21.15.26:0/2494071853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b64101810 0x7f5b6419e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b62ffd700 1 -- 172.21.15.26:0/2494071853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b64101810 msgr2=0x7f5b6419e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:04.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b62ffd700 1 --2- 172.21.15.26:0/2494071853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b64101810 0x7f5b6419e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b62ffd700 1 -- 172.21.15.26:0/2494071853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b64100e70 msgr2=0x7f5b641970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b62ffd700 1 --2- 172.21.15.26:0/2494071853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b64100e70 0x7f5b641970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b62ffd700 1 -- 172.21.15.26:0/2494071853 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b5c009d00 con 0x7f5b640ffc80 2023-12-01T01:04:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.481+0000 7f5b637fe700 1 --2- 172.21.15.26:0/2494071853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b64101810 0x7f5b6419e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.482+0000 7f5b62ffd700 1 --2- 172.21.15.26:0/2494071853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b640ffc80 0x7f5b64196ba0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400d980 tx=0x7f5b5400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.482+0000 7f5b4bfff700 1 -- 172.21.15.26:0/2494071853 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54004020 con 0x7f5b640ffc80 2023-12-01T01:04:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.482+0000 7f5b692bb700 1 -- 172.21.15.26:0/2494071853 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6419ecd0 con 0x7f5b640ffc80 2023-12-01T01:04:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.482+0000 7f5b4bfff700 1 -- 172.21.15.26:0/2494071853 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f5b54009730 con 0x7f5b640ffc80 2023-12-01T01:04:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.482+0000 7f5b4bfff700 1 -- 172.21.15.26:0/2494071853 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b54003be0 con 0x7f5b640ffc80 2023-12-01T01:04:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.482+0000 7f5b692bb700 1 -- 172.21.15.26:0/2494071853 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6419f190 con 0x7f5b640ffc80 2023-12-01T01:04:04.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.483+0000 7f5b692bb700 1 -- 172.21.15.26:0/2494071853 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b64107c10 con 0x7f5b640ffc80 2023-12-01T01:04:04.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.484+0000 7f5b4bfff700 1 -- 172.21.15.26:0/2494071853 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f5b54009ba0 con 0x7f5b640ffc80 2023-12-01T01:04:04.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.484+0000 7f5b4bfff700 1 --2- 172.21.15.26:0/2494071853 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5b4c0a0520 0x7f5b4c0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:04.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.485+0000 7f5b627fc700 1 --2- 172.21.15.26:0/2494071853 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5b4c0a0520 0x7f5b4c0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:04.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.485+0000 7f5b4bfff700 1 -- 172.21.15.26:0/2494071853 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f5b540cb660 con 0x7f5b640ffc80 2023-12-01T01:04:04.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.485+0000 7f5b627fc700 1 --2- 172.21.15.26:0/2494071853 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5b4c0a0520 0x7f5b4c0a29e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800ac50 tx=0x7f5b5800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:04.490 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.489+0000 7f5b4bfff700 1 -- 172.21.15.26:0/2494071853 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5b540951b0 con 0x7f5b640ffc80 2023-12-01T01:04:04.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.693+0000 7f5b692bb700 1 -- 172.21.15.26:0/2494071853 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b6402cc70 con 0x7f5b640ffc80 2023-12-01T01:04:04.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.693+0000 7f5b4bfff700 1 -- 172.21.15.26:0/2494071853 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b540987d0 con 0x7f5b640ffc80 2023-12-01T01:04:04.695 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-12-01T01:04:04.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.695+0000 7f5b692bb700 1 -- 172.21.15.26:0/2494071853 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5b4c0a0520 msgr2=0x7f5b4c0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:04.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.695+0000 7f5b692bb700 1 --2- 172.21.15.26:0/2494071853 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5b4c0a0520 0x7f5b4c0a29e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800ac50 tx=0x7f5b5800a380 comp rx=0 tx=0).stop 2023-12-01T01:04:04.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.695+0000 7f5b692bb700 1 -- 172.21.15.26:0/2494071853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b640ffc80 msgr2=0x7f5b64196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:04.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.695+0000 7f5b692bb700 1 --2- 172.21.15.26:0/2494071853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b640ffc80 0x7f5b64196ba0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400d980 tx=0x7f5b5400dc90 comp rx=0 tx=0).stop 2023-12-01T01:04:04.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.695+0000 7f5b692bb700 1 -- 172.21.15.26:0/2494071853 shutdown_connections 2023-12-01T01:04:04.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.695+0000 7f5b692bb700 1 --2- 172.21.15.26:0/2494071853 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f5b4c0a0520 0x7f5b4c0a29e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.696+0000 7f5b692bb700 1 --2- 172.21.15.26:0/2494071853 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5b64101810 0x7f5b6419e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.696+0000 7f5b692bb700 1 --2- 172.21.15.26:0/2494071853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5b640ffc80 0x7f5b64196ba0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.696+0000 7f5b692bb700 1 --2- 172.21.15.26:0/2494071853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b64100e70 0x7f5b641970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.696+0000 7f5b692bb700 1 -- 172.21.15.26:0/2494071853 >> 172.21.15.26:0/2494071853 conn(0x7f5b640fb1f0 msgr2=0x7f5b640fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:04.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.696+0000 7f5b692bb700 1 -- 172.21.15.26:0/2494071853 shutdown_connections 2023-12-01T01:04:04.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.696+0000 7f5b692bb700 1 -- 172.21.15.26:0/2494071853 wait complete. 2023-12-01T01:04:04.711 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:04:04.839 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.834+0000 7f534c891700 1 -- 172.21.15.26:0/873743686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5348100e60 msgr2=0x7f53481012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.834+0000 7f534c891700 1 --2- 172.21.15.26:0/873743686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5348100e60 0x7f53481012c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f533c0099c0 tx=0x7f533c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.835+0000 7f534c891700 1 -- 172.21.15.26:0/873743686 shutdown_connections 2023-12-01T01:04:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.835+0000 7f534c891700 1 --2- 172.21.15.26:0/873743686 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5348101800 0x7f53481080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.835+0000 7f534c891700 1 --2- 172.21.15.26:0/873743686 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53480ffc70 0x7f5348100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.835+0000 7f534c891700 1 --2- 172.21.15.26:0/873743686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5348100e60 0x7f53481012c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.835+0000 7f534c891700 1 -- 172.21.15.26:0/873743686 >> 172.21.15.26:0/873743686 conn(0x7f53480fb1c0 msgr2=0x7f53480fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.835+0000 7f534c891700 1 -- 172.21.15.26:0/873743686 shutdown_connections 2023-12-01T01:04:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.835+0000 7f534c891700 1 -- 172.21.15.26:0/873743686 wait complete. 2023-12-01T01:04:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.835+0000 7f534c891700 1 Processor -- start 2023-12-01T01:04:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.835+0000 7f534c891700 1 -- start start 2023-12-01T01:04:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f534c891700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53480ffc70 0x7f5348068a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:04.840 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f534c891700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5348100e60 0x7f534819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f534c891700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5348101800 0x7f534819de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f534c891700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534819e640 con 0x7f5348101800 2023-12-01T01:04:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f534c891700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534819e7b0 con 0x7f53480ffc70 2023-12-01T01:04:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f534c891700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534819e970 con 0x7f5348100e60 2023-12-01T01:04:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f5346d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5348101800 0x7f534819de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f5346d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5348101800 0x7f534819de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54690/0 (socket says 172.21.15.26:54690) 2023-12-01T01:04:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f5346d9d700 1 -- 172.21.15.26:0/3908103972 learned_addr learned my addr 172.21.15.26:0/3908103972 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f534659c700 1 --2- 172.21.15.26:0/3908103972 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53480ffc70 0x7f5348068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f5345d9b700 1 --2- 172.21.15.26:0/3908103972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5348100e60 0x7f534819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f5346d9d700 1 -- 172.21.15.26:0/3908103972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5348100e60 msgr2=0x7f534819b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f5346d9d700 1 --2- 172.21.15.26:0/3908103972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5348100e60 0x7f534819b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f5346d9d700 1 -- 172.21.15.26:0/3908103972 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53480ffc70 msgr2=0x7f5348068a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f5346d9d700 1 --2- 172.21.15.26:0/3908103972 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53480ffc70 0x7f5348068a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:04.841 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f5346d9d700 1 -- 172.21.15.26:0/3908103972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c0095f0 con 0x7f5348101800 2023-12-01T01:04:04.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f5346d9d700 1 --2- 172.21.15.26:0/3908103972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5348101800 0x7f534819de70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f534000ef30 tx=0x7f534000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:04.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f53377fe700 1 -- 172.21.15.26:0/3908103972 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5340018070 con 0x7f5348101800 2023-12-01T01:04:04.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f53377fe700 1 -- 172.21.15.26:0/3908103972 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f534000f040 con 0x7f5348101800 2023-12-01T01:04:04.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f534c891700 1 -- 172.21.15.26:0/3908103972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f534819ebf0 con 0x7f5348101800 2023-12-01T01:04:04.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f53377fe700 1 -- 172.21.15.26:0/3908103972 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534000ce00 con 0x7f5348101800 2023-12-01T01:04:04.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.836+0000 7f534c891700 1 -- 172.21.15.26:0/3908103972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f534819f120 con 0x7f5348101800 2023-12-01T01:04:04.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.837+0000 7f534c891700 1 -- 172.21.15.26:0/3908103972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53481071b0 con 0x7f5348101800 2023-12-01T01:04:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.838+0000 7f53377fe700 1 -- 172.21.15.26:0/3908103972 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f5340003a00 con 0x7f5348101800 2023-12-01T01:04:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.839+0000 7f53377fe700 1 --2- 172.21.15.26:0/3908103972 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f53300a05f0 0x7f53300a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.839+0000 7f534659c700 1 --2- 172.21.15.26:0/3908103972 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f53300a05f0 0x7f53300a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.839+0000 7f53377fe700 1 -- 172.21.15.26:0/3908103972 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f53400cb4c0 con 0x7f5348101800 2023-12-01T01:04:04.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.839+0000 7f534659c700 1 --2- 172.21.15.26:0/3908103972 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f53300a05f0 0x7f53300a2ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5348100cc0 tx=0x7f5338007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:04.845 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:04.843+0000 7f53377fe700 1 -- 172.21.15.26:0/3908103972 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f53400950a0 con 0x7f5348101800 2023-12-01T01:04:05.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:04 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/44105016' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:04:05.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:04 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3757936346' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:04:05.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:04 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2494071853' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:04:05.094 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.092+0000 7f534c891700 1 -- 172.21.15.26:0/3908103972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f534802cc70 con 0x7f5348101800 2023-12-01T01:04:05.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.093+0000 7f53377fe700 1 -- 172.21.15.26:0/3908103972 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10777 (secure 0 0 0) 0x7f53400986c0 con 0x7f5348101800 2023-12-01T01:04:05.095 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:04:05.095 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6841/3515135915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6840","nonce":3515135915},{"type":"v1","addr":"172.21.15.26:6841","nonce":3515135915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-01T01:02:47.252972+0000","modified":"2023-12-01T01:02:52.326753+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24493,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.93:6837/3333520218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3333520218},{"type":"v1","addr":"172.21.15.93:6837","nonce":3333520218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6839/3364532241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":3364532241},{"type":"v1","addr":"172.21.15.93:6839","nonce":3364532241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T01:04:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.095+0000 7f534c891700 1 -- 172.21.15.26:0/3908103972 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f53300a05f0 msgr2=0x7f53300a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.095+0000 7f534c891700 1 --2- 172.21.15.26:0/3908103972 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f53300a05f0 0x7f53300a2ab0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5348100cc0 tx=0x7f5338007400 comp rx=0 tx=0).stop 2023-12-01T01:04:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.095+0000 7f534c891700 1 -- 172.21.15.26:0/3908103972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5348101800 msgr2=0x7f534819de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.095+0000 7f534c891700 1 --2- 172.21.15.26:0/3908103972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5348101800 0x7f534819de70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f534000ef30 tx=0x7f534000c3a0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.095+0000 7f534c891700 1 -- 172.21.15.26:0/3908103972 shutdown_connections 2023-12-01T01:04:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.095+0000 7f534c891700 1 --2- 172.21.15.26:0/3908103972 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f53300a05f0 0x7f53300a2ab0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.095+0000 7f534c891700 1 --2- 172.21.15.26:0/3908103972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5348101800 0x7f534819de70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.095+0000 7f534c891700 1 --2- 172.21.15.26:0/3908103972 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f53480ffc70 0x7f5348068a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.095+0000 7f534c891700 1 --2- 172.21.15.26:0/3908103972 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f5348100e60 0x7f534819b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.096+0000 7f534c891700 1 -- 172.21.15.26:0/3908103972 >> 172.21.15.26:0/3908103972 conn(0x7f53480fb1c0 msgr2=0x7f53481042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.096+0000 7f534c891700 1 -- 172.21.15.26:0/3908103972 shutdown_connections 2023-12-01T01:04:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.096+0000 7f534c891700 1 -- 172.21.15.26:0/3908103972 wait complete. 2023-12-01T01:04:05.099 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 23 2023-12-01T01:04:05.111 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:04:05.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:04 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/44105016' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:04:05.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:04 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3757936346' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:04:05.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:04 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2494071853' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:04:05.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:04 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/44105016' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:04:05.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:04 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3757936346' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:04:05.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:04 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2494071853' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:04:05.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.234+0000 7f99aa7a5700 1 -- 172.21.15.26:0/860353604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99a40ffc70 msgr2=0x7f99a4100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.234+0000 7f99aa7a5700 1 --2- 172.21.15.26:0/860353604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99a40ffc70 0x7f99a4100090 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f99940099c0 tx=0x7f9994009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.234+0000 7f99aa7a5700 1 -- 172.21.15.26:0/860353604 shutdown_connections 2023-12-01T01:04:05.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.234+0000 7f99aa7a5700 1 --2- 172.21.15.26:0/860353604 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99a4101800 0x7f99a41080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.234+0000 7f99aa7a5700 1 --2- 172.21.15.26:0/860353604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99a40ffc70 0x7f99a4100090 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.234+0000 7f99aa7a5700 1 --2- 172.21.15.26:0/860353604 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99a4100e60 0x7f99a41012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.234+0000 7f99aa7a5700 1 -- 172.21.15.26:0/860353604 >> 172.21.15.26:0/860353604 conn(0x7f99a40fb1c0 msgr2=0x7f99a40fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.234+0000 7f99aa7a5700 1 -- 172.21.15.26:0/860353604 shutdown_connections 2023-12-01T01:04:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.234+0000 7f99aa7a5700 1 -- 172.21.15.26:0/860353604 wait complete. 2023-12-01T01:04:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.234+0000 7f99aa7a5700 1 Processor -- start 2023-12-01T01:04:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.234+0000 7f99aa7a5700 1 -- start start 2023-12-01T01:04:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99aa7a5700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99a40ffc70 0x7f99a4068a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99aa7a5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99a4100e60 0x7f99a419b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99aa7a5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99a4101800 0x7f99a419de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99aa7a5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a419e600 con 0x7f99a4101800 2023-12-01T01:04:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99aa7a5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a419e770 con 0x7f99a4100e60 2023-12-01T01:04:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99aa7a5700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a419e930 con 0x7f99a40ffc70 2023-12-01T01:04:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99a8d42700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99a4101800 0x7f99a419de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99a8d42700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99a4101800 0x7f99a419de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54704/0 (socket says 172.21.15.26:54704) 2023-12-01T01:04:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99a8d42700 1 -- 172.21.15.26:0/803269306 learned_addr learned my addr 172.21.15.26:0/803269306 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99a3fff700 1 --2- 172.21.15.26:0/803269306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99a40ffc70 0x7f99a4068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99a37fe700 1 --2- 172.21.15.26:0/803269306 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99a4100e60 0x7f99a419b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99a8d42700 1 -- 172.21.15.26:0/803269306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99a40ffc70 msgr2=0x7f99a4068a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99a8d42700 1 --2- 172.21.15.26:0/803269306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99a40ffc70 0x7f99a4068a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99a8d42700 1 -- 172.21.15.26:0/803269306 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99a4100e60 msgr2=0x7f99a419b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99a8d42700 1 --2- 172.21.15.26:0/803269306 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99a4100e60 0x7f99a419b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99a8d42700 1 -- 172.21.15.26:0/803269306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99940095f0 con 0x7f99a4101800 2023-12-01T01:04:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99a37fe700 1 --2- 172.21.15.26:0/803269306 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99a4100e60 0x7f99a419b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.235+0000 7f99a8d42700 1 --2- 172.21.15.26:0/803269306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99a4101800 0x7f99a419de30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f999c00ada0 tx=0x7f999c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.236+0000 7f99a17fa700 1 -- 172.21.15.26:0/803269306 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c00f070 con 0x7f99a4101800 2023-12-01T01:04:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.236+0000 7f99aa7a5700 1 -- 172.21.15.26:0/803269306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a419ec10 con 0x7f99a4101800 2023-12-01T01:04:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.236+0000 7f99a17fa700 1 -- 172.21.15.26:0/803269306 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f999c007b30 con 0x7f99a4101800 2023-12-01T01:04:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.236+0000 7f99a17fa700 1 -- 172.21.15.26:0/803269306 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c0053c0 con 0x7f99a4101800 2023-12-01T01:04:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.236+0000 7f99aa7a5700 1 -- 172.21.15.26:0/803269306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a419f120 con 0x7f99a4101800 2023-12-01T01:04:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.237+0000 7f99aa7a5700 1 -- 172.21.15.26:0/803269306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a410b5c0 con 0x7f99a4101800 2023-12-01T01:04:05.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.239+0000 7f99a17fa700 1 -- 172.21.15.26:0/803269306 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f999c00c980 con 0x7f99a4101800 2023-12-01T01:04:05.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.239+0000 7f99a17fa700 1 --2- 172.21.15.26:0/803269306 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f998c0a0570 0x7f998c0a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.240+0000 7f99a3fff700 1 --2- 172.21.15.26:0/803269306 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f998c0a0570 0x7f998c0a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.240+0000 7f99a17fa700 1 -- 172.21.15.26:0/803269306 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f999c0cb570 con 0x7f99a4101800 2023-12-01T01:04:05.243 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.240+0000 7f99a3fff700 1 --2- 172.21.15.26:0/803269306 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f998c0a0570 0x7f998c0a2a30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9994009990 tx=0x7f999400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.243+0000 7f99a17fa700 1 -- 172.21.15.26:0/803269306 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f999c095150 con 0x7f99a4101800 2023-12-01T01:04:05.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.446+0000 7f99aa7a5700 1 -- 172.21.15.26:0/803269306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99a4106ab0 con 0x7f99a4101800 2023-12-01T01:04:05.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.448+0000 7f99a17fa700 1 -- 172.21.15.26:0/803269306 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22481 (secure 0 0 0) 0x7f999c098770 con 0x7f99a4101800 2023-12-01T01:04:05.451 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:04:05.451 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":83,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:59.627676+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:04:05.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.450+0000 7f99aa7a5700 1 -- 172.21.15.26:0/803269306 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f998c0a0570 msgr2=0x7f998c0a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.450+0000 7f99aa7a5700 1 --2- 172.21.15.26:0/803269306 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f998c0a0570 0x7f998c0a2a30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9994009990 tx=0x7f999400b540 comp rx=0 tx=0).stop 2023-12-01T01:04:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.450+0000 7f99aa7a5700 1 -- 172.21.15.26:0/803269306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99a4101800 msgr2=0x7f99a419de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.450+0000 7f99aa7a5700 1 --2- 172.21.15.26:0/803269306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99a4101800 0x7f99a419de30 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f999c00ada0 tx=0x7f999c00c330 comp rx=0 tx=0).stop 2023-12-01T01:04:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.450+0000 7f99aa7a5700 1 -- 172.21.15.26:0/803269306 shutdown_connections 2023-12-01T01:04:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.450+0000 7f99aa7a5700 1 --2- 172.21.15.26:0/803269306 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f998c0a0570 0x7f998c0a2a30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.450+0000 7f99aa7a5700 1 --2- 172.21.15.26:0/803269306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99a4101800 0x7f99a419de30 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.450+0000 7f99aa7a5700 1 --2- 172.21.15.26:0/803269306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f99a40ffc70 0x7f99a4068a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.450+0000 7f99aa7a5700 1 --2- 172.21.15.26:0/803269306 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f99a4100e60 0x7f99a419b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.450+0000 7f99aa7a5700 1 -- 172.21.15.26:0/803269306 >> 172.21.15.26:0/803269306 conn(0x7f99a40fb1c0 msgr2=0x7f99a40fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.450+0000 7f99aa7a5700 1 -- 172.21.15.26:0/803269306 shutdown_connections 2023-12-01T01:04:05.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.451+0000 7f99aa7a5700 1 -- 172.21.15.26:0/803269306 wait complete. 2023-12-01T01:04:05.466 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-12-01T01:02:47.252972+0000', 'modified': '2023-12-01T01:02:52.326753+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24509, 'mds_1': 24493, 'mds_2': 24481}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24448': {'gid': 24448, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.116:6835/1591216017', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6834', 'nonce': 1591216017}, {'type': 'v1', 'addr': '172.21.15.116:6835', 'nonce': 1591216017}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24460': {'gid': 24460, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.116:6837/1714302836', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6836', 'nonce': 1714302836}, {'type': 'v1', 'addr': '172.21.15.116:6837', 'nonce': 1714302836}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24479': {'gid': 24479, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.93:6837/3333520218', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6836', 'nonce': 3333520218}, {'type': 'v1', 'addr': '172.21.15.93:6837', 'nonce': 3333520218}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24481': {'gid': 24481, 'name': 'i', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.116:6839/261568108', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.116:6838', 'nonce': 261568108}, {'type': 'v1', 'addr': '172.21.15.116:6839', 'nonce': 261568108}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24493': {'gid': 24493, 'name': 'g', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.26:6839/1277894156', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6838', 'nonce': 1277894156}, {'type': 'v1', 'addr': '172.21.15.26:6839', 'nonce': 1277894156}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24509': {'gid': 24509, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.93:6839/3364532241', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.93:6838', 'nonce': 3364532241}, {'type': 'v1', 'addr': '172.21.15.93:6839', 'nonce': 3364532241}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-01T01:04:05.466 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-12-01T01:04:05.466 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-12-01T01:04:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.590+0000 7f80268b6700 1 -- 172.21.15.26:0/4277156960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020101810 msgr2=0x7f80201080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.590+0000 7f80268b6700 1 --2- 172.21.15.26:0/4277156960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020101810 0x7f80201080c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f801800b0d0 tx=0x7f801800b3e0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.590+0000 7f80268b6700 1 -- 172.21.15.26:0/4277156960 shutdown_connections 2023-12-01T01:04:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.590+0000 7f80268b6700 1 --2- 172.21.15.26:0/4277156960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020101810 0x7f80201080c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.590+0000 7f80268b6700 1 --2- 172.21.15.26:0/4277156960 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f80200ffc80 0x7f80201000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.590+0000 7f80268b6700 1 --2- 172.21.15.26:0/4277156960 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8020100e70 0x7f80201012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.590+0000 7f80268b6700 1 -- 172.21.15.26:0/4277156960 >> 172.21.15.26:0/4277156960 conn(0x7f80200fb1f0 msgr2=0x7f80200fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.590+0000 7f80268b6700 1 -- 172.21.15.26:0/4277156960 shutdown_connections 2023-12-01T01:04:05.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.590+0000 7f80268b6700 1 -- 172.21.15.26:0/4277156960 wait complete. 2023-12-01T01:04:05.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.591+0000 7f80268b6700 1 Processor -- start 2023-12-01T01:04:05.596 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.591+0000 7f80268b6700 1 -- start start 2023-12-01T01:04:05.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.591+0000 7f80268b6700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f80200ffc80 0x7f8020196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.591+0000 7f80268b6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8020100e70 0x7f8020197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.591+0000 7f80268b6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020101810 0x7f802019e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.591+0000 7f80268b6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802019e780 con 0x7f8020101810 2023-12-01T01:04:05.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.591+0000 7f80268b6700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802019e8f0 con 0x7f8020100e70 2023-12-01T01:04:05.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.591+0000 7f80268b6700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802019eab0 con 0x7f80200ffc80 2023-12-01T01:04:05.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.591+0000 7f8024e53700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020101810 0x7f802019e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.591+0000 7f8024e53700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020101810 0x7f802019e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54718/0 (socket says 172.21.15.26:54718) 2023-12-01T01:04:05.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.591+0000 7f8024e53700 1 -- 172.21.15.26:0/2218685995 learned_addr learned my addr 172.21.15.26:0/2218685995 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:05.597 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.592+0000 7f801f7fe700 1 --2- 172.21.15.26:0/2218685995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8020100e70 0x7f8020197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.592+0000 7f8024e53700 1 -- 172.21.15.26:0/2218685995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f80200ffc80 msgr2=0x7f8020196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.592+0000 7f8024e53700 1 --2- 172.21.15.26:0/2218685995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f80200ffc80 0x7f8020196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.592+0000 7f8024e53700 1 -- 172.21.15.26:0/2218685995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8020100e70 msgr2=0x7f8020197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.592+0000 7f8024e53700 1 --2- 172.21.15.26:0/2218685995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8020100e70 0x7f8020197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.592+0000 7f8024e53700 1 -- 172.21.15.26:0/2218685995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8018009d00 con 0x7f8020101810 2023-12-01T01:04:05.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.592+0000 7f8024e53700 1 --2- 172.21.15.26:0/2218685995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020101810 0x7f802019e1b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8018009300 tx=0x7f8018009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.592+0000 7f801d7fa700 1 -- 172.21.15.26:0/2218685995 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801800e040 con 0x7f8020101810 2023-12-01T01:04:05.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.592+0000 7f80268b6700 1 -- 172.21.15.26:0/2218685995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802019ed30 con 0x7f8020101810 2023-12-01T01:04:05.598 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.592+0000 7f801d7fa700 1 -- 172.21.15.26:0/2218685995 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8018003e10 con 0x7f8020101810 2023-12-01T01:04:05.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.592+0000 7f801d7fa700 1 -- 172.21.15.26:0/2218685995 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8018005440 con 0x7f8020101810 2023-12-01T01:04:05.599 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.592+0000 7f80268b6700 1 -- 172.21.15.26:0/2218685995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802019f1b0 con 0x7f8020101810 2023-12-01T01:04:05.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.595+0000 7f801d7fa700 1 -- 172.21.15.26:0/2218685995 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f801801ba30 con 0x7f8020101810 2023-12-01T01:04:05.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f801d7fa700 1 --2- 172.21.15.26:0/2218685995 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f80080a0520 0x7f80080a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.606 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f801d7fa700 1 -- 172.21.15.26:0/2218685995 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f80180ccfd0 con 0x7f8020101810 2023-12-01T01:04:05.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f801ffff700 1 --2- 172.21.15.26:0/2218685995 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f80080a0520 0x7f80080a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f801ffff700 1 --2- 172.21.15.26:0/2218685995 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f80080a0520 0x7f80080a29e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8020198110 tx=0x7f8010009470 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f8032a46b80 1 Processor -- start 2023-12-01T01:04:05.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f8032a46b80 1 -- start start 2023-12-01T01:04:05.607 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f8032a46b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7df4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f8032a46b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f7dfa20 0x55d62f7dde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f8032a46b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 0x55d62f7de820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f8032a46b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62f7359c0 con 0x55d62f7df0a0 2023-12-01T01:04:05.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f8032a46b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62f733380 con 0x55d62f7de3a0 2023-12-01T01:04:05.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f8032a46b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62f72ec70 con 0x55d62f7dfa20 2023-12-01T01:04:05.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f801ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7df4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f801ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7df4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54722/0 (socket says 172.21.15.26:54722) 2023-12-01T01:04:05.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f801ffff700 1 -- 172.21.15.26:0/4059526547 learned_addr learned my addr 172.21.15.26:0/4059526547 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:05.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f801f7fe700 1 --2- 172.21.15.26:0/4059526547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f7dfa20 0x55d62f7dde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f801ffff700 1 -- 172.21.15.26:0/4059526547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f7dfa20 msgr2=0x55d62f7dde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f801ffff700 1 --2- 172.21.15.26:0/4059526547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f7dfa20 0x55d62f7dde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.608 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f801ffff700 1 -- 172.21.15.26:0/4059526547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 msgr2=0x55d62f7de820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f801ffff700 1 --2- 172.21.15.26:0/4059526547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 0x55d62f7de820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f801ffff700 1 -- 172.21.15.26:0/4059526547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d62f55cd90 con 0x55d62f7df0a0 2023-12-01T01:04:05.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.596+0000 7f801ffff700 1 --2- 172.21.15.26:0/4059526547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7df4e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8010009270 tx=0x7f8010010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c524dba0db50c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.597+0000 7f80067fc700 1 -- 172.21.15.26:0/4059526547 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8010010af0 con 0x55d62f7df0a0 2023-12-01T01:04:05.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.597+0000 7f80067fc700 1 -- 172.21.15.26:0/4059526547 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8010010c50 con 0x55d62f7df0a0 2023-12-01T01:04:05.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.597+0000 7f80067fc700 1 -- 172.21.15.26:0/4059526547 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801000f6d0 con 0x55d62f7df0a0 2023-12-01T01:04:05.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.597+0000 7f8032a46b80 1 -- 172.21.15.26:0/4059526547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 msgr2=0x55d62f7df4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.597+0000 7f8032a46b80 1 --2- 172.21.15.26:0/4059526547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7df4e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8010009270 tx=0x7f8010010000 comp rx=0 tx=0).stop 2023-12-01T01:04:05.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.597+0000 7f8032a46b80 1 -- 172.21.15.26:0/4059526547 shutdown_connections 2023-12-01T01:04:05.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.597+0000 7f8032a46b80 1 --2- 172.21.15.26:0/4059526547 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 0x55d62f7de820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.597+0000 7f8032a46b80 1 --2- 172.21.15.26:0/4059526547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7df4e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.597+0000 7f8032a46b80 1 --2- 172.21.15.26:0/4059526547 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f7dfa20 0x55d62f7dde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.597+0000 7f8032a46b80 1 -- 172.21.15.26:0/4059526547 >> 172.21.15.26:0/4059526547 conn(0x55d62f73d080 msgr2=0x55d62f7d88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.609 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.597+0000 7f8032a46b80 1 -- 172.21.15.26:0/4059526547 shutdown_connections 2023-12-01T01:04:05.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.597+0000 7f8032a46b80 1 -- 172.21.15.26:0/4059526547 wait complete. 2023-12-01T01:04:05.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.598+0000 7f8032a46b80 1 -- start start 2023-12-01T01:04:05.610 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.598+0000 7f8032a46b80 1 Processor -- start 2023-12-01T01:04:05.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.598+0000 7f8032a46b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 0x55d62f7e7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.598+0000 7f8032a46b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7e7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.598+0000 7f8032a46b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f7dfa20 0x55d62f7eeed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.598+0000 7f8032a46b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62f6cb4c0 con 0x55d62f7df0a0 2023-12-01T01:04:05.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.598+0000 7f8032a46b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62f6cb160 con 0x55d62f7de3a0 2023-12-01T01:04:05.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.598+0000 7f8032a46b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62f5b28d0 con 0x55d62f7dfa20 2023-12-01T01:04:05.611 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.598+0000 7f8032a46b80 10 client.0 _ll_register_callbacks cb 0x55d62f618a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.598+0000 7f801f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7e7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.598+0000 7f801f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7e7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54730/0 (socket says 172.21.15.26:54730) 2023-12-01T01:04:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.598+0000 7f801f7fe700 1 -- 172.21.15.26:0/988665232 learned_addr learned my addr 172.21.15.26:0/988665232 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.598+0000 7f801ffff700 1 --2- 172.21.15.26:0/988665232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 0x55d62f7e7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.599+0000 7f8024e53700 1 --2- 172.21.15.26:0/988665232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f7dfa20 0x55d62f7eeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.599+0000 7f801f7fe700 1 -- 172.21.15.26:0/988665232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f7dfa20 msgr2=0x55d62f7eeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.599+0000 7f801f7fe700 1 --2- 172.21.15.26:0/988665232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f7dfa20 0x55d62f7eeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.599+0000 7f801f7fe700 1 -- 172.21.15.26:0/988665232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 msgr2=0x55d62f7e7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.599+0000 7f801f7fe700 1 --2- 172.21.15.26:0/988665232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 0x55d62f7e7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.599+0000 7f801f7fe700 1 -- 172.21.15.26:0/988665232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801000d880 con 0x55d62f7df0a0 2023-12-01T01:04:05.612 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.599+0000 7f801f7fe700 1 --2- 172.21.15.26:0/988665232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7e7e90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f801400bac0 tx=0x7f801400bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11db4cd461ddcb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.599+0000 7f7fff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.599+0000 7f7fff7fe700 1 -- 172.21.15.26:0/988665232 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014004830 con 0x55d62f7df0a0 2023-12-01T01:04:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.599+0000 7f7fff7fe700 1 -- 172.21.15.26:0/988665232 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8014004990 con 0x55d62f7df0a0 2023-12-01T01:04:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.599+0000 7f8032a46b80 1 -- 172.21.15.26:0/988665232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d62f759cc0 con 0x55d62f7df0a0 2023-12-01T01:04:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.599+0000 7f7fff7fe700 1 -- 172.21.15.26:0/988665232 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8014020030 con 0x55d62f7df0a0 2023-12-01T01:04:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.599+0000 7f8032a46b80 10 client.15198 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.599+0000 7f8032a46b80 1 -- 172.21.15.26:0/988665232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55d62f545c10 con 0x55d62f7df0a0 2023-12-01T01:04:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.599+0000 7f7fff7fe700 1 -- 172.21.15.26:0/988665232 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55d62f759cc0 con 0x55d62f7df0a0 2023-12-01T01:04:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.599+0000 7f7fff7fe700 1 -- 172.21.15.26:0/988665232 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f80140104f0 con 0x55d62f7df0a0 2023-12-01T01:04:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.600+0000 7f8032a46b80 10 client.15198 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.600+0000 7f8032a46b80 10 client.15198 resolve_mds: resolved name 'i' to daemon mds.i 2023-12-01T01:04:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.600+0000 7f8032a46b80 20 client.15198 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.600+0000 7f8032a46b80 1 --2- 172.21.15.26:0/988665232 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x55d62f7f2c30 0x55d62f7f2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.600+0000 7f8032a46b80 4 client.15198 mds_command: new command op to 24481 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:04:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.600+0000 7f8032a46b80 1 -- 172.21.15.26:0/988665232 --> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d62f7acdc0 con 0x55d62f7f2c30 2023-12-01T01:04:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.600+0000 7f801ffff700 1 --2- 172.21.15.26:0/988665232 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x55d62f7f2c30 0x55d62f7f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.600+0000 7f7fff7fe700 10 client.15198 ms_handle_connect on v2:172.21.15.116:6838/261568108 2023-12-01T01:04:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.600+0000 7f801ffff700 1 --2- 172.21.15.26:0/988665232 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x55d62f7f2c30 0x55d62f7f2030 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d25f198ff9957be7 server_cookie=aebd3a4d578e98d in_seq=0 out_seq=0 2023-12-01T01:04:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.601+0000 7f7fff7fe700 1 -- 172.21.15.26:0/988665232 <== mds.2 v2:172.21.15.116:6838/261568108 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55d62f7acdc0 con 0x55d62f7f2c30 2023-12-01T01:04:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.601+0000 7f7fff7fe700 10 client.15198 handle_command_reply: tid=0 2023-12-01T01:04:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.601+0000 7f8032a46b80 1 client.15198 shutdown 2023-12-01T01:04:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.601+0000 7f8032a46b80 1 -- 172.21.15.26:0/988665232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 msgr2=0x55d62f7e7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.601+0000 7f8032a46b80 1 --2- 172.21.15.26:0/988665232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7e7e90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f801400bac0 tx=0x7f801400bdd0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.601+0000 7f8032a46b80 1 -- 172.21.15.26:0/988665232 shutdown_connections 2023-12-01T01:04:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.601+0000 7f8032a46b80 1 --2- 172.21.15.26:0/988665232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f7dfa20 0x55d62f7eeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.601+0000 7f8032a46b80 1 --2- 172.21.15.26:0/988665232 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x55d62f7f2c30 0x55d62f7f2030 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.601+0000 7f8032a46b80 1 --2- 172.21.15.26:0/988665232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 0x55d62f7e7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.601+0000 7f8032a46b80 1 --2- 172.21.15.26:0/988665232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7e7e90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.601+0000 7f7fff7fe700 0 client.15198 ms_handle_reset on v2:172.21.15.116:6838/261568108 2023-12-01T01:04:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.601+0000 7f8032a46b80 1 -- 172.21.15.26:0/988665232 >> 172.21.15.26:0/988665232 conn(0x55d62f73d080 msgr2=0x55d62f7d8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.601+0000 7f8032a46b80 1 -- 172.21.15.26:0/988665232 shutdown_connections 2023-12-01T01:04:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.601+0000 7f8032a46b80 1 -- 172.21.15.26:0/988665232 wait complete. 2023-12-01T01:04:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.601+0000 7f8032a46b80 20 client.15198 trim_cache size 0 max 16384 2023-12-01T01:04:05.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f8032a46b80 1 Processor -- start 2023-12-01T01:04:05.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f8032a46b80 1 -- start start 2023-12-01T01:04:05.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f8032a46b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f73d080 0x55d62f7e23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.626 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f8032a46b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 0x55d62f7fb960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f8032a46b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f7df0a0 0x55d62f7e2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f8032a46b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62f7acdc0 con 0x55d62f73d080 2023-12-01T01:04:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f8032a46b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62f759cc0 con 0x55d62f7de3a0 2023-12-01T01:04:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f8032a46b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62f7e8b40 con 0x55d62f7df0a0 2023-12-01T01:04:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f801ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f73d080 0x55d62f7e23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f801ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f73d080 0x55d62f7e23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54736/0 (socket says 172.21.15.26:54736) 2023-12-01T01:04:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f801ffff700 1 -- 172.21.15.26:0/3987294589 learned_addr learned my addr 172.21.15.26:0/3987294589 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f801ffff700 1 -- 172.21.15.26:0/3987294589 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f7df0a0 msgr2=0x55d62f7e2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f8024e53700 1 --2- 172.21.15.26:0/3987294589 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f7df0a0 0x55d62f7e2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f801ffff700 1 --2- 172.21.15.26:0/3987294589 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f7df0a0 0x55d62f7e2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f801ffff700 1 -- 172.21.15.26:0/3987294589 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 msgr2=0x55d62f7fb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f801ffff700 1 --2- 172.21.15.26:0/3987294589 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 0x55d62f7fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f801ffff700 1 -- 172.21.15.26:0/3987294589 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d62f583200 con 0x55d62f73d080 2023-12-01T01:04:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f801ffff700 1 --2- 172.21.15.26:0/3987294589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f73d080 0x55d62f7e23c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8010012040 tx=0x7f80100097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115af2968e6d7675 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f8006ffd700 1 -- 172.21.15.26:0/3987294589 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801002c040 con 0x55d62f73d080 2023-12-01T01:04:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f8006ffd700 1 -- 172.21.15.26:0/3987294589 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8010037070 con 0x55d62f73d080 2023-12-01T01:04:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.619+0000 7f8006ffd700 1 -- 172.21.15.26:0/3987294589 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801001d8a0 con 0x55d62f73d080 2023-12-01T01:04:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.620+0000 7f8032a46b80 1 -- 172.21.15.26:0/3987294589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f73d080 msgr2=0x55d62f7e23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.620+0000 7f8032a46b80 1 --2- 172.21.15.26:0/3987294589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f73d080 0x55d62f7e23c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f8010012040 tx=0x7f80100097d0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.620+0000 7f8032a46b80 1 -- 172.21.15.26:0/3987294589 shutdown_connections 2023-12-01T01:04:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.620+0000 7f8032a46b80 1 --2- 172.21.15.26:0/3987294589 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f7df0a0 0x55d62f7e2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.620+0000 7f8032a46b80 1 --2- 172.21.15.26:0/3987294589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f73d080 0x55d62f7e23c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.620+0000 7f8032a46b80 1 --2- 172.21.15.26:0/3987294589 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 0x55d62f7fb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.620+0000 7f8032a46b80 1 -- 172.21.15.26:0/3987294589 >> 172.21.15.26:0/3987294589 conn(0x55d62f7d8c20 msgr2=0x55d62f7f2030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.620+0000 7f8032a46b80 1 -- 172.21.15.26:0/3987294589 shutdown_connections 2023-12-01T01:04:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.620+0000 7f8032a46b80 1 -- 172.21.15.26:0/3987294589 wait complete. 2023-12-01T01:04:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.620+0000 7f8032a46b80 1 -- start start 2023-12-01T01:04:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8032a46b80 1 Processor -- start 2023-12-01T01:04:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8032a46b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f73d080 0x55d62f7f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8032a46b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 0x55d62f7f9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8032a46b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7fa240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8032a46b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62f7fa780 con 0x55d62f7df0a0 2023-12-01T01:04:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8032a46b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62f7fa8f0 con 0x55d62f7de3a0 2023-12-01T01:04:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8032a46b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d62f7faab0 con 0x55d62f73d080 2023-12-01T01:04:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8032a46b80 10 client.0 _ll_register_callbacks cb 0x7f8014004320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8024e53700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7fa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8024e53700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7fa240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54746/0 (socket says 172.21.15.26:54746) 2023-12-01T01:04:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8024e53700 1 -- 172.21.15.26:0/732381313 learned_addr learned my addr 172.21.15.26:0/732381313 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f801ffff700 1 --2- 172.21.15.26:0/732381313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f73d080 0x55d62f7f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f801f7fe700 1 --2- 172.21.15.26:0/732381313 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 0x55d62f7f9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8024e53700 1 -- 172.21.15.26:0/732381313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f73d080 msgr2=0x55d62f7f8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8024e53700 1 --2- 172.21.15.26:0/732381313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f73d080 0x55d62f7f8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8024e53700 1 -- 172.21.15.26:0/732381313 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 msgr2=0x55d62f7f9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8024e53700 1 --2- 172.21.15.26:0/732381313 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 0x55d62f7f9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8024e53700 1 -- 172.21.15.26:0/732381313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d62f55cd90 con 0x55d62f7df0a0 2023-12-01T01:04:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f8024e53700 1 --2- 172.21.15.26:0/732381313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7fa240 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f801809a800 tx=0x7f801809a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b366ce6b79c430 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.621+0000 7f7fff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.622+0000 7f7fff7fe700 1 -- 172.21.15.26:0/732381313 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801809acd0 con 0x55d62f7df0a0 2023-12-01T01:04:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.622+0000 7f7fff7fe700 1 -- 172.21.15.26:0/732381313 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f801801a3b0 con 0x55d62f7df0a0 2023-12-01T01:04:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.622+0000 7f8032a46b80 1 -- 172.21.15.26:0/732381313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8010010c50 con 0x55d62f7df0a0 2023-12-01T01:04:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.622+0000 7f7fff7fe700 1 -- 172.21.15.26:0/732381313 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f801809af70 con 0x55d62f7df0a0 2023-12-01T01:04:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.622+0000 7f8032a46b80 10 client.15204 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.622+0000 7f8032a46b80 1 -- 172.21.15.26:0/732381313 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55d62f55b260 con 0x55d62f7df0a0 2023-12-01T01:04:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.622+0000 7f7fff7fe700 1 -- 172.21.15.26:0/732381313 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8018064020 con 0x55d62f7df0a0 2023-12-01T01:04:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.622+0000 7f7fff7fe700 1 -- 172.21.15.26:0/732381313 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f8018099d60 con 0x55d62f7df0a0 2023-12-01T01:04:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.622+0000 7f8032a46b80 10 client.15204 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:05.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.622+0000 7f8032a46b80 10 client.15204 resolve_mds: resolved name 'i' to daemon mds.i 2023-12-01T01:04:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.622+0000 7f8032a46b80 20 client.15204 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.622+0000 7f8032a46b80 1 --2- 172.21.15.26:0/732381313 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x55d62f7dfa20 0x55d62f8467e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.622+0000 7f8032a46b80 4 client.15204 mds_command: new command op to 24481 tid=0[{"prefix": "status"}] 2023-12-01T01:04:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.622+0000 7f8032a46b80 1 -- 172.21.15.26:0/732381313 --> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d62f727cf0 con 0x55d62f7dfa20 2023-12-01T01:04:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.622+0000 7f801ffff700 1 --2- 172.21.15.26:0/732381313 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x55d62f7dfa20 0x55d62f8467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f7fff7fe700 10 client.15204 ms_handle_connect on v2:172.21.15.116:6838/261568108 2023-12-01T01:04:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f801ffff700 1 --2- 172.21.15.26:0/732381313 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x55d62f7dfa20 0x55d62f8467e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f8f8eeeeda3d2f9b server_cookie=1e8bcee95f4bacfb in_seq=0 out_seq=0 2023-12-01T01:04:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f7fff7fe700 1 -- 172.21.15.26:0/732381313 <== mds.2 v2:172.21.15.116:6838/261568108 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55d62f727cf0 con 0x55d62f7dfa20 2023-12-01T01:04:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f7fff7fe700 10 client.15204 handle_command_reply: tid=0 2023-12-01T01:04:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f8032a46b80 1 client.15204 shutdown 2023-12-01T01:04:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f8032a46b80 1 -- 172.21.15.26:0/732381313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 msgr2=0x55d62f7fa240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f8032a46b80 1 --2- 172.21.15.26:0/732381313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7fa240 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f801809a800 tx=0x7f801809a6c0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f8032a46b80 1 -- 172.21.15.26:0/732381313 shutdown_connections 2023-12-01T01:04:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f8032a46b80 1 --2- 172.21.15.26:0/732381313 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d62f7df0a0 0x55d62f7fa240 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f8032a46b80 1 --2- 172.21.15.26:0/732381313 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55d62f73d080 0x55d62f7f8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f8032a46b80 1 --2- 172.21.15.26:0/732381313 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x55d62f7dfa20 0x55d62f8467e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f8032a46b80 1 --2- 172.21.15.26:0/732381313 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55d62f7de3a0 0x55d62f7f9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f8032a46b80 1 -- 172.21.15.26:0/732381313 >> 172.21.15.26:0/732381313 conn(0x55d62f7d8c20 msgr2=0x55d62f7e23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f7fff7fe700 0 client.15204 ms_handle_reset on v2:172.21.15.116:6838/261568108 2023-12-01T01:04:05.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f8032a46b80 1 -- 172.21.15.26:0/732381313 shutdown_connections 2023-12-01T01:04:05.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f8032a46b80 1 -- 172.21.15.26:0/732381313 wait complete. 2023-12-01T01:04:05.632 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.623+0000 7f8032a46b80 20 client.15204 trim_cache size 0 max 16384 2023-12-01T01:04:05.632 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:04:05.632 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "48bff570-8fe4-11ee-95a2-87774f69a715", 2023-12-01T01:04:05.632 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 2, 2023-12-01T01:04:05.632 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 24481, 2023-12-01T01:04:05.632 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-12-01T01:04:05.633 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-12-01T01:04:05.633 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-12-01T01:04:05.633 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 74.300926976, 2023-12-01T01:04:05.633 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 23, 2023-12-01T01:04:05.633 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 83, 2023-12-01T01:04:05.633 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 81, 2023-12-01T01:04:05.633 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 91.362184932999995 2023-12-01T01:04:05.633 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:04:05.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.624+0000 7f80268b6700 1 -- 172.21.15.26:0/2218685995 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f80080a0520 msgr2=0x7f80080a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.624+0000 7f80268b6700 1 --2- 172.21.15.26:0/2218685995 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f80080a0520 0x7f80080a29e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8020198110 tx=0x7f8010009470 comp rx=0 tx=0).stop 2023-12-01T01:04:05.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.624+0000 7f80268b6700 1 -- 172.21.15.26:0/2218685995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020101810 msgr2=0x7f802019e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.624+0000 7f80268b6700 1 --2- 172.21.15.26:0/2218685995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020101810 0x7f802019e1b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8018009300 tx=0x7f8018009330 comp rx=0 tx=0).stop 2023-12-01T01:04:05.634 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.624+0000 7f80268b6700 1 -- 172.21.15.26:0/2218685995 shutdown_connections 2023-12-01T01:04:05.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.624+0000 7f80268b6700 1 --2- 172.21.15.26:0/2218685995 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f80080a0520 0x7f80080a29e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.624+0000 7f80268b6700 1 --2- 172.21.15.26:0/2218685995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8020101810 0x7f802019e1b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.624+0000 7f80268b6700 1 --2- 172.21.15.26:0/2218685995 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f80200ffc80 0x7f8020196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.624+0000 7f80268b6700 1 --2- 172.21.15.26:0/2218685995 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8020100e70 0x7f8020197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.624+0000 7f80268b6700 1 -- 172.21.15.26:0/2218685995 >> 172.21.15.26:0/2218685995 conn(0x7f80200fb1f0 msgr2=0x7f80200fb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.624+0000 7f80268b6700 1 -- 172.21.15.26:0/2218685995 shutdown_connections 2023-12-01T01:04:05.635 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.624+0000 7f80268b6700 1 -- 172.21.15.26:0/2218685995 wait complete. 2023-12-01T01:04:05.638 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.g status 2023-12-01T01:04:05.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.762+0000 7f79ff1d9700 1 -- 172.21.15.26:0/2843596058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f8100e70 msgr2=0x7f79f81012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.762+0000 7f79ff1d9700 1 --2- 172.21.15.26:0/2843596058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f8100e70 0x7f79f81012d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f79e40099c0 tx=0x7f79e4009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.762+0000 7f79ff1d9700 1 -- 172.21.15.26:0/2843596058 shutdown_connections 2023-12-01T01:04:05.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.762+0000 7f79ff1d9700 1 --2- 172.21.15.26:0/2843596058 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79f8101810 0x7f79f81080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.762+0000 7f79ff1d9700 1 --2- 172.21.15.26:0/2843596058 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79f80ffc80 0x7f79f81000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.762+0000 7f79ff1d9700 1 --2- 172.21.15.26:0/2843596058 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f8100e70 0x7f79f81012d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.762+0000 7f79ff1d9700 1 -- 172.21.15.26:0/2843596058 >> 172.21.15.26:0/2843596058 conn(0x7f79f80fb1f0 msgr2=0x7f79f80fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.762+0000 7f79ff1d9700 1 -- 172.21.15.26:0/2843596058 shutdown_connections 2023-12-01T01:04:05.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.762+0000 7f79ff1d9700 1 -- 172.21.15.26:0/2843596058 wait complete. 2023-12-01T01:04:05.767 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79ff1d9700 1 Processor -- start 2023-12-01T01:04:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79ff1d9700 1 -- start start 2023-12-01T01:04:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79ff1d9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79f80ffc80 0x7f79f8196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79ff1d9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f8100e70 0x7f79f8197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79ff1d9700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79f8101810 0x7f79f819e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79ff1d9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f819e750 con 0x7f79f8100e70 2023-12-01T01:04:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79ff1d9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f819e890 con 0x7f79f80ffc80 2023-12-01T01:04:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79ff1d9700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f819ea20 con 0x7f79f8101810 2023-12-01T01:04:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f8100e70 0x7f79f8197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f8100e70 0x7f79f8197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54756/0 (socket says 172.21.15.26:54756) 2023-12-01T01:04:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79f7fff700 1 -- 172.21.15.26:0/2761573465 learned_addr learned my addr 172.21.15.26:0/2761573465 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79fcf75700 1 --2- 172.21.15.26:0/2761573465 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79f80ffc80 0x7f79f8196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79f7fff700 1 -- 172.21.15.26:0/2761573465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79f8101810 msgr2=0x7f79f819e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.768 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79fd776700 1 --2- 172.21.15.26:0/2761573465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79f8101810 0x7f79f819e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79f7fff700 1 --2- 172.21.15.26:0/2761573465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79f8101810 0x7f79f819e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79f7fff700 1 -- 172.21.15.26:0/2761573465 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79f80ffc80 msgr2=0x7f79f8196bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79f7fff700 1 --2- 172.21.15.26:0/2761573465 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79f80ffc80 0x7f79f8196bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79f7fff700 1 -- 172.21.15.26:0/2761573465 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e40095f0 con 0x7f79f8100e70 2023-12-01T01:04:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79fcf75700 1 --2- 172.21.15.26:0/2761573465 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79f80ffc80 0x7f79f8196bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.763+0000 7f79fd776700 1 --2- 172.21.15.26:0/2761573465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79f8101810 0x7f79f819e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.764+0000 7f79f7fff700 1 --2- 172.21.15.26:0/2761573465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f8100e70 0x7f79f8197110 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f79e400c010 tx=0x7f79e4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.764+0000 7f79f5ffb700 1 -- 172.21.15.26:0/2761573465 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e401d070 con 0x7f79f8100e70 2023-12-01T01:04:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.764+0000 7f79f5ffb700 1 -- 172.21.15.26:0/2761573465 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f79e400fbf0 con 0x7f79f8100e70 2023-12-01T01:04:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.764+0000 7f79ff1d9700 1 -- 172.21.15.26:0/2761573465 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f819eca0 con 0x7f79f8100e70 2023-12-01T01:04:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.764+0000 7f79f5ffb700 1 -- 172.21.15.26:0/2761573465 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4017650 con 0x7f79f8100e70 2023-12-01T01:04:05.769 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.764+0000 7f79ff1d9700 1 -- 172.21.15.26:0/2761573465 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f819f120 con 0x7f79f8100e70 2023-12-01T01:04:05.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.766+0000 7f79f5ffb700 1 -- 172.21.15.26:0/2761573465 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f79e4022470 con 0x7f79f8100e70 2023-12-01T01:04:05.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.767+0000 7f79f5ffb700 1 --2- 172.21.15.26:0/2761573465 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f79e80a05a0 0x7f79e80a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.767+0000 7f79fcf75700 1 --2- 172.21.15.26:0/2761573465 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f79e80a05a0 0x7f79e80a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.767+0000 7f79f5ffb700 1 -- 172.21.15.26:0/2761573465 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f79e40ccc90 con 0x7f79f8100e70 2023-12-01T01:04:05.776 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f79fcf75700 1 --2- 172.21.15.26:0/2761573465 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f79e80a05a0 0x7f79e80a2a60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f79f8100cd0 tx=0x7f79ec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f7a0b369b80 1 Processor -- start 2023-12-01T01:04:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f7a0b369b80 1 -- start start 2023-12-01T01:04:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f7a0b369b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5654798180a0 0x5654798184e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f7a0b369b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x565479818a20 0x565479816e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f7a0b369b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5654798173a0 0x565479817820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f7a0b369b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56547976e9c0 con 0x565479818a20 2023-12-01T01:04:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f7a0b369b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56547976c380 con 0x5654798173a0 2023-12-01T01:04:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f7a0b369b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x565479767c70 con 0x5654798180a0 2023-12-01T01:04:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x565479818a20 0x565479816e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x565479818a20 0x565479816e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54764/0 (socket says 172.21.15.26:54764) 2023-12-01T01:04:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f79f7fff700 1 -- 172.21.15.26:0/1819771714 learned_addr learned my addr 172.21.15.26:0/1819771714 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f79f7fff700 1 -- 172.21.15.26:0/1819771714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5654798180a0 msgr2=0x5654798184e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f79f7fff700 1 --2- 172.21.15.26:0/1819771714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5654798180a0 0x5654798184e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f79f7fff700 1 -- 172.21.15.26:0/1819771714 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5654798173a0 msgr2=0x565479817820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f79fd776700 1 --2- 172.21.15.26:0/1819771714 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5654798173a0 0x565479817820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f79f7fff700 1 --2- 172.21.15.26:0/1819771714 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5654798173a0 0x565479817820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.768+0000 7f79f7fff700 1 -- 172.21.15.26:0/1819771714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565479595d90 con 0x565479818a20 2023-12-01T01:04:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.769+0000 7f79f7fff700 1 --2- 172.21.15.26:0/1819771714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x565479818a20 0x565479816e10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f79e409a520 tx=0x7f79e4005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf308b669b60d214 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.769+0000 7f79e2ffd700 1 -- 172.21.15.26:0/1819771714 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e409e3c0 con 0x565479818a20 2023-12-01T01:04:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.769+0000 7f79e2ffd700 1 -- 172.21.15.26:0/1819771714 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f79e4022e90 con 0x565479818a20 2023-12-01T01:04:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.769+0000 7f79e2ffd700 1 -- 172.21.15.26:0/1819771714 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4099a80 con 0x565479818a20 2023-12-01T01:04:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.769+0000 7f7a0b369b80 1 -- 172.21.15.26:0/1819771714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x565479818a20 msgr2=0x565479816e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.769+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/1819771714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x565479818a20 0x565479816e10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f79e409a520 tx=0x7f79e4005f10 comp rx=0 tx=0).stop 2023-12-01T01:04:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.769+0000 7f7a0b369b80 1 -- 172.21.15.26:0/1819771714 shutdown_connections 2023-12-01T01:04:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.769+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/1819771714 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5654798173a0 0x565479817820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.769+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/1819771714 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5654798180a0 0x5654798184e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.769+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/1819771714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x565479818a20 0x565479816e10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.769+0000 7f7a0b369b80 1 -- 172.21.15.26:0/1819771714 >> 172.21.15.26:0/1819771714 conn(0x565479776080 msgr2=0x5654798118f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.769+0000 7f7a0b369b80 1 -- 172.21.15.26:0/1819771714 shutdown_connections 2023-12-01T01:04:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.770+0000 7f7a0b369b80 1 -- 172.21.15.26:0/1819771714 wait complete. 2023-12-01T01:04:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.770+0000 7f7a0b369b80 1 -- start start 2023-12-01T01:04:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.770+0000 7f7a0b369b80 1 Processor -- start 2023-12-01T01:04:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.770+0000 7f7a0b369b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5654798173a0 0x5654798206b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.770+0000 7f7a0b369b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798180a0 0x565479820bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.770+0000 7f7a0b369b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x565479818a20 0x565479827c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.770+0000 7f7a0b369b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654797044c0 con 0x5654798180a0 2023-12-01T01:04:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.770+0000 7f7a0b369b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x565479704160 con 0x565479818a20 2023-12-01T01:04:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.770+0000 7f7a0b369b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654795eb8d0 con 0x5654798173a0 2023-12-01T01:04:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.770+0000 7f7a0b369b80 10 client.0 _ll_register_callbacks cb 0x565479651a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.770+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798180a0 0x565479820bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.770+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798180a0 0x565479820bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54770/0 (socket says 172.21.15.26:54770) 2023-12-01T01:04:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.770+0000 7f79f7fff700 1 -- 172.21.15.26:0/4271646931 learned_addr learned my addr 172.21.15.26:0/4271646931 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:05.779 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f79fcf75700 1 --2- 172.21.15.26:0/4271646931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5654798173a0 0x5654798206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f79fd776700 1 --2- 172.21.15.26:0/4271646931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x565479818a20 0x565479827c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f79f7fff700 1 -- 172.21.15.26:0/4271646931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5654798173a0 msgr2=0x5654798206b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f79f7fff700 1 --2- 172.21.15.26:0/4271646931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5654798173a0 0x5654798206b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f79f7fff700 1 -- 172.21.15.26:0/4271646931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x565479818a20 msgr2=0x565479827c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f79f7fff700 1 --2- 172.21.15.26:0/4271646931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x565479818a20 0x565479827c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f79f7fff700 1 -- 172.21.15.26:0/4271646931 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f819f120 con 0x5654798180a0 2023-12-01T01:04:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f79f7fff700 1 --2- 172.21.15.26:0/4271646931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798180a0 0x565479820bf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f79e409a290 tx=0x7f79e4098930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1704e526a8ad8b8a server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f79d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f79d7fff700 1 -- 172.21.15.26:0/4271646931 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400fe20 con 0x5654798180a0 2023-12-01T01:04:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f79d7fff700 1 -- 172.21.15.26:0/4271646931 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f79e40a20e0 con 0x5654798180a0 2023-12-01T01:04:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f7a0b369b80 1 -- 172.21.15.26:0/4271646931 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565479792cc0 con 0x5654798180a0 2023-12-01T01:04:05.780 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f79d7fff700 1 -- 172.21.15.26:0/4271646931 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79e40a22a0 con 0x5654798180a0 2023-12-01T01:04:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f7a0b369b80 10 client.15216 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f7a0b369b80 1 -- 172.21.15.26:0/4271646931 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56547957ec10 con 0x5654798180a0 2023-12-01T01:04:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f79d7fff700 1 -- 172.21.15.26:0/4271646931 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f79e407d080 con 0x5654798180a0 2023-12-01T01:04:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.771+0000 7f79d7fff700 1 -- 172.21.15.26:0/4271646931 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f79e40b81d0 con 0x5654798180a0 2023-12-01T01:04:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.772+0000 7f7a0b369b80 10 client.15216 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.772+0000 7f7a0b369b80 10 client.15216 resolve_mds: resolved name 'g' to daemon mds.g 2023-12-01T01:04:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.772+0000 7f7a0b369b80 20 client.15216 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.772+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/4271646931 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x56547982ba50 0x56547982ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.772+0000 7f7a0b369b80 4 client.15216 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:04:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.772+0000 7f7a0b369b80 1 -- 172.21.15.26:0/4271646931 --> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654797e5dc0 con 0x56547982ba50 2023-12-01T01:04:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.772+0000 7f79fcf75700 1 --2- 172.21.15.26:0/4271646931 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x56547982ba50 0x56547982ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.772+0000 7f79d7fff700 10 client.15216 ms_handle_connect on v2:172.21.15.26:6838/1277894156 2023-12-01T01:04:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.772+0000 7f79fcf75700 1 --2- 172.21.15.26:0/4271646931 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x56547982ba50 0x56547982ab60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=92aad9d3d2dcd545 server_cookie=db7349b66e0f23d8 in_seq=0 out_seq=0 2023-12-01T01:04:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.773+0000 7f79d7fff700 1 -- 172.21.15.26:0/4271646931 <== mds.1 v2:172.21.15.26:6838/1277894156 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5654797e5dc0 con 0x56547982ba50 2023-12-01T01:04:05.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.773+0000 7f79d7fff700 10 client.15216 handle_command_reply: tid=0 2023-12-01T01:04:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.773+0000 7f7a0b369b80 1 client.15216 shutdown 2023-12-01T01:04:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.773+0000 7f7a0b369b80 1 -- 172.21.15.26:0/4271646931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798180a0 msgr2=0x565479820bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.773+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/4271646931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798180a0 0x565479820bf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f79e409a290 tx=0x7f79e4098930 comp rx=0 tx=0).stop 2023-12-01T01:04:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.773+0000 7f7a0b369b80 1 -- 172.21.15.26:0/4271646931 shutdown_connections 2023-12-01T01:04:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.773+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/4271646931 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x565479818a20 0x565479827c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.773+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/4271646931 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5654798173a0 0x5654798206b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.773+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/4271646931 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x56547982ba50 0x56547982ab60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.773+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/4271646931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798180a0 0x565479820bf0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.773+0000 7f79d7fff700 0 client.15216 ms_handle_reset on v2:172.21.15.26:6838/1277894156 2023-12-01T01:04:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.773+0000 7f7a0b369b80 1 -- 172.21.15.26:0/4271646931 >> 172.21.15.26:0/4271646931 conn(0x565479776080 msgr2=0x565479811060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.773+0000 7f7a0b369b80 1 -- 172.21.15.26:0/4271646931 shutdown_connections 2023-12-01T01:04:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.773+0000 7f7a0b369b80 1 -- 172.21.15.26:0/4271646931 wait complete. 2023-12-01T01:04:05.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.773+0000 7f7a0b369b80 20 client.15216 trim_cache size 0 max 16384 2023-12-01T01:04:05.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f7a0b369b80 1 Processor -- start 2023-12-01T01:04:05.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f7a0b369b80 1 -- start start 2023-12-01T01:04:05.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f7a0b369b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565479776080 0x56547981b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f7a0b369b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798173a0 0x565479834170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f7a0b369b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5654798180a0 0x56547981b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f7a0b369b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56547976e9c0 con 0x5654798173a0 2023-12-01T01:04:05.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f7a0b369b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x565479817c20 con 0x5654798180a0 2023-12-01T01:04:05.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f7a0b369b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x565479711830 con 0x565479776080 2023-12-01T01:04:05.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798173a0 0x565479834170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f79f7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798173a0 0x565479834170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54778/0 (socket says 172.21.15.26:54778) 2023-12-01T01:04:05.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f79f7fff700 1 -- 172.21.15.26:0/2722150357 learned_addr learned my addr 172.21.15.26:0/2722150357 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:05.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f79fcf75700 1 --2- 172.21.15.26:0/2722150357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565479776080 0x56547981b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f79f7fff700 1 -- 172.21.15.26:0/2722150357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565479776080 msgr2=0x56547981b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f79f7fff700 1 --2- 172.21.15.26:0/2722150357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565479776080 0x56547981b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f79fd776700 1 --2- 172.21.15.26:0/2722150357 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5654798180a0 0x56547981b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f79f7fff700 1 -- 172.21.15.26:0/2722150357 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5654798180a0 msgr2=0x56547981b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f79f7fff700 1 --2- 172.21.15.26:0/2722150357 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5654798180a0 0x56547981b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f79f7fff700 1 -- 172.21.15.26:0/2722150357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654795bc200 con 0x5654798173a0 2023-12-01T01:04:05.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f79fcf75700 1 --2- 172.21.15.26:0/2722150357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565479776080 0x56547981b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:05.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f79f7fff700 1 --2- 172.21.15.26:0/2722150357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798173a0 0x565479834170 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f79e40988e0 tx=0x7f79e4009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cedf78ca2781bae server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f79e37fe700 1 -- 172.21.15.26:0/2722150357 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400fe20 con 0x5654798173a0 2023-12-01T01:04:05.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f79e37fe700 1 -- 172.21.15.26:0/2722150357 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x565479792cc0 con 0x5654798173a0 2023-12-01T01:04:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.791+0000 7f79e37fe700 1 -- 172.21.15.26:0/2722150357 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4096700 con 0x5654798173a0 2023-12-01T01:04:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.792+0000 7f7a0b369b80 1 -- 172.21.15.26:0/2722150357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798173a0 msgr2=0x565479834170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.792+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/2722150357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798173a0 0x565479834170 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f79e40988e0 tx=0x7f79e4009310 comp rx=0 tx=0).stop 2023-12-01T01:04:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.792+0000 7f7a0b369b80 1 -- 172.21.15.26:0/2722150357 shutdown_connections 2023-12-01T01:04:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.792+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/2722150357 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5654798180a0 0x56547981b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.792+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/2722150357 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x565479776080 0x56547981b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.792+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/2722150357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798173a0 0x565479834170 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.792+0000 7f7a0b369b80 1 -- 172.21.15.26:0/2722150357 >> 172.21.15.26:0/2722150357 conn(0x565479811c20 msgr2=0x56547982ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.792+0000 7f7a0b369b80 1 -- 172.21.15.26:0/2722150357 shutdown_connections 2023-12-01T01:04:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.792+0000 7f7a0b369b80 1 -- 172.21.15.26:0/2722150357 wait complete. 2023-12-01T01:04:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.792+0000 7f7a0b369b80 1 -- start start 2023-12-01T01:04:05.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f7a0b369b80 1 Processor -- start 2023-12-01T01:04:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f7a0b369b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x565479776080 0x565479831a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f7a0b369b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5654798173a0 0x565479831f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f7a0b369b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798180a0 0x565479832f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f7a0b369b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654798334c0 con 0x5654798180a0 2023-12-01T01:04:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f7a0b369b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x565479833630 con 0x565479776080 2023-12-01T01:04:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f7a0b369b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654798337f0 con 0x5654798173a0 2023-12-01T01:04:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f7a0b369b80 10 client.0 _ll_register_callbacks cb 0x565479651a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f79fd776700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798180a0 0x565479832f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f79fd776700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798180a0 0x565479832f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54786/0 (socket says 172.21.15.26:54786) 2023-12-01T01:04:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f79fd776700 1 -- 172.21.15.26:0/17730703 learned_addr learned my addr 172.21.15.26:0/17730703 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f79f7fff700 1 --2- 172.21.15.26:0/17730703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5654798173a0 0x565479831f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f79fcf75700 1 --2- 172.21.15.26:0/17730703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x565479776080 0x565479831a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f79fd776700 1 -- 172.21.15.26:0/17730703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5654798173a0 msgr2=0x565479831f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f79fd776700 1 --2- 172.21.15.26:0/17730703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5654798173a0 0x565479831f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f79fd776700 1 -- 172.21.15.26:0/17730703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x565479776080 msgr2=0x565479831a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f79fd776700 1 --2- 172.21.15.26:0/17730703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x565479776080 0x565479831a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f79fd776700 1 -- 172.21.15.26:0/17730703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56547957ec10 con 0x5654798180a0 2023-12-01T01:04:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.793+0000 7f79fcf75700 1 --2- 172.21.15.26:0/17730703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x565479776080 0x565479831a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.794+0000 7f79fd776700 1 --2- 172.21.15.26:0/17730703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798180a0 0x565479832f80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f79f0008740 tx=0x7f79f0008b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17486a7ec9aae5f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.794+0000 7f79d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.794+0000 7f79d7fff700 1 -- 172.21.15.26:0/17730703 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f0016890 con 0x5654798180a0 2023-12-01T01:04:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.794+0000 7f79d7fff700 1 -- 172.21.15.26:0/17730703 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f79f00169f0 con 0x5654798180a0 2023-12-01T01:04:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.794+0000 7f7a0b369b80 1 -- 172.21.15.26:0/17730703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f79e4022e90 con 0x5654798180a0 2023-12-01T01:04:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.794+0000 7f79d7fff700 1 -- 172.21.15.26:0/17730703 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79f0016bb0 con 0x5654798180a0 2023-12-01T01:04:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.794+0000 7f7a0b369b80 10 client.15222 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.794+0000 7f7a0b369b80 1 -- 172.21.15.26:0/17730703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x565479594260 con 0x5654798180a0 2023-12-01T01:04:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.794+0000 7f79d7fff700 1 -- 172.21.15.26:0/17730703 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f79e4022e90 con 0x5654798180a0 2023-12-01T01:04:05.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.794+0000 7f79d7fff700 1 -- 172.21.15.26:0/17730703 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f79f00114f0 con 0x5654798180a0 2023-12-01T01:04:05.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.794+0000 7f7a0b369b80 10 client.15222 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:05.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.794+0000 7f7a0b369b80 10 client.15222 resolve_mds: resolved name 'g' to daemon mds.g 2023-12-01T01:04:05.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.794+0000 7f7a0b369b80 20 client.15222 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:05.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.794+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/17730703 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x565479818a20 0x56547987f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.794+0000 7f7a0b369b80 4 client.15222 mds_command: new command op to 24493 tid=0[{"prefix": "status"}] 2023-12-01T01:04:05.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.794+0000 7f7a0b369b80 1 -- 172.21.15.26:0/17730703 --> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] -- command(tid 0: {"prefix": "status"}) v1 -- 0x565479760cf0 con 0x565479818a20 2023-12-01T01:04:05.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.795+0000 7f79fcf75700 1 --2- 172.21.15.26:0/17730703 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x565479818a20 0x56547987f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.795+0000 7f79d7fff700 10 client.15222 ms_handle_connect on v2:172.21.15.26:6838/1277894156 2023-12-01T01:04:05.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.795+0000 7f79fcf75700 1 --2- 172.21.15.26:0/17730703 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x565479818a20 0x56547987f7e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d50e8b5907863dc2 server_cookie=e51d5860beb8aa8b in_seq=0 out_seq=0 2023-12-01T01:04:05.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.795+0000 7f79d7fff700 1 -- 172.21.15.26:0/17730703 <== mds.1 v2:172.21.15.26:6838/1277894156 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x565479760cf0 con 0x565479818a20 2023-12-01T01:04:05.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.795+0000 7f79d7fff700 10 client.15222 handle_command_reply: tid=0 2023-12-01T01:04:05.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.795+0000 7f7a0b369b80 1 client.15222 shutdown 2023-12-01T01:04:05.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.795+0000 7f7a0b369b80 1 -- 172.21.15.26:0/17730703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798180a0 msgr2=0x565479832f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.795+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/17730703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798180a0 0x565479832f80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f79f0008740 tx=0x7f79f0008b00 comp rx=0 tx=0).stop 2023-12-01T01:04:05.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.795+0000 7f7a0b369b80 1 -- 172.21.15.26:0/17730703 shutdown_connections 2023-12-01T01:04:05.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.795+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/17730703 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x565479818a20 0x56547987f7e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.795+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/17730703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5654798180a0 0x565479832f80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.795+0000 7f79d7fff700 0 client.15222 ms_handle_reset on v2:172.21.15.26:6838/1277894156 2023-12-01T01:04:05.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.795+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/17730703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x565479776080 0x565479831a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.795+0000 7f7a0b369b80 1 --2- 172.21.15.26:0/17730703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5654798173a0 0x565479831f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.795+0000 7f7a0b369b80 1 -- 172.21.15.26:0/17730703 >> 172.21.15.26:0/17730703 conn(0x565479811c20 msgr2=0x56547981b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.796+0000 7f7a0b369b80 1 -- 172.21.15.26:0/17730703 shutdown_connections 2023-12-01T01:04:05.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.796+0000 7f7a0b369b80 1 -- 172.21.15.26:0/17730703 wait complete. 2023-12-01T01:04:05.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.796+0000 7f7a0b369b80 20 client.15222 trim_cache size 0 max 16384 2023-12-01T01:04:05.806 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:04:05.806 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "48bff570-8fe4-11ee-95a2-87774f69a715", 2023-12-01T01:04:05.806 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 1, 2023-12-01T01:04:05.806 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 24493, 2023-12-01T01:04:05.806 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-12-01T01:04:05.806 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-12-01T01:04:05.806 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-12-01T01:04:05.806 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 75.479503191999996, 2023-12-01T01:04:05.806 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 23, 2023-12-01T01:04:05.806 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 83, 2023-12-01T01:04:05.806 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 81, 2023-12-01T01:04:05.806 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 89.302612069999995 2023-12-01T01:04:05.806 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:04:05.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.796+0000 7f79ff1d9700 1 -- 172.21.15.26:0/2761573465 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f79e80a05a0 msgr2=0x7f79e80a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.796+0000 7f79ff1d9700 1 --2- 172.21.15.26:0/2761573465 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f79e80a05a0 0x7f79e80a2a60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f79f8100cd0 tx=0x7f79ec009260 comp rx=0 tx=0).stop 2023-12-01T01:04:05.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.796+0000 7f79ff1d9700 1 -- 172.21.15.26:0/2761573465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f8100e70 msgr2=0x7f79f8197110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.796+0000 7f79ff1d9700 1 --2- 172.21.15.26:0/2761573465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f8100e70 0x7f79f8197110 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f79e400c010 tx=0x7f79e4009580 comp rx=0 tx=0).stop 2023-12-01T01:04:05.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.796+0000 7f79ff1d9700 1 -- 172.21.15.26:0/2761573465 shutdown_connections 2023-12-01T01:04:05.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.796+0000 7f79ff1d9700 1 --2- 172.21.15.26:0/2761573465 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f79e80a05a0 0x7f79e80a2a60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.796+0000 7f79ff1d9700 1 --2- 172.21.15.26:0/2761573465 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f79f8101810 0x7f79f819e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.796+0000 7f79ff1d9700 1 --2- 172.21.15.26:0/2761573465 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79f80ffc80 0x7f79f8196bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.796+0000 7f79ff1d9700 1 --2- 172.21.15.26:0/2761573465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79f8100e70 0x7f79f8197110 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.796+0000 7f79ff1d9700 1 -- 172.21.15.26:0/2761573465 >> 172.21.15.26:0/2761573465 conn(0x7f79f80fb1f0 msgr2=0x7f79f8104360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.796+0000 7f79ff1d9700 1 -- 172.21.15.26:0/2761573465 shutdown_connections 2023-12-01T01:04:05.808 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.796+0000 7f79ff1d9700 1 -- 172.21.15.26:0/2761573465 wait complete. 2023-12-01T01:04:05.810 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-01T01:04:05.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.934+0000 7f02b0f19700 1 -- 172.21.15.26:0/1302900281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02ac100d80 msgr2=0x7f02ac1011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.934+0000 7f02b0f19700 1 --2- 172.21.15.26:0/1302900281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02ac100d80 0x7f02ac1011a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f029c0099c0 tx=0x7f029c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.934+0000 7f02b0f19700 1 -- 172.21.15.26:0/1302900281 shutdown_connections 2023-12-01T01:04:05.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.934+0000 7f02b0f19700 1 --2- 172.21.15.26:0/1302900281 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02ac102910 0x7f02ac1091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.934+0000 7f02b0f19700 1 --2- 172.21.15.26:0/1302900281 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02ac100d80 0x7f02ac1011a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.934+0000 7f02b0f19700 1 --2- 172.21.15.26:0/1302900281 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02ac101f70 0x7f02ac1023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.934+0000 7f02b0f19700 1 -- 172.21.15.26:0/1302900281 >> 172.21.15.26:0/1302900281 conn(0x7f02ac0fc310 msgr2=0x7f02ac0fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.935+0000 7f02b0f19700 1 -- 172.21.15.26:0/1302900281 shutdown_connections 2023-12-01T01:04:05.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.935+0000 7f02b0f19700 1 -- 172.21.15.26:0/1302900281 wait complete. 2023-12-01T01:04:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.935+0000 7f02b0f19700 1 Processor -- start 2023-12-01T01:04:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02b0f19700 1 -- start start 2023-12-01T01:04:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02b0f19700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02ac100d80 0x7f02ac196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02b0f19700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02ac101f70 0x7f02ac197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02b0f19700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02ac102910 0x7f02ac19e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02b0f19700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac19e6c0 con 0x7f02ac101f70 2023-12-01T01:04:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02b0f19700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac19e800 con 0x7f02ac102910 2023-12-01T01:04:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02b0f19700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ac19e990 con 0x7f02ac100d80 2023-12-01T01:04:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02a9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02ac101f70 0x7f02ac197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02a9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02ac101f70 0x7f02ac197080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54798/0 (socket says 172.21.15.26:54798) 2023-12-01T01:04:05.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02a9d9b700 1 -- 172.21.15.26:0/695284501 learned_addr learned my addr 172.21.15.26:0/695284501 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:05.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02aa59c700 1 --2- 172.21.15.26:0/695284501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02ac100d80 0x7f02ac196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02aad9d700 1 --2- 172.21.15.26:0/695284501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02ac102910 0x7f02ac19e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02a9d9b700 1 -- 172.21.15.26:0/695284501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02ac100d80 msgr2=0x7f02ac196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02a9d9b700 1 --2- 172.21.15.26:0/695284501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02ac100d80 0x7f02ac196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02a9d9b700 1 -- 172.21.15.26:0/695284501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02ac102910 msgr2=0x7f02ac19e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02a9d9b700 1 --2- 172.21.15.26:0/695284501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02ac102910 0x7f02ac19e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02a9d9b700 1 -- 172.21.15.26:0/695284501 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c0095f0 con 0x7f02ac101f70 2023-12-01T01:04:05.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02a9d9b700 1 --2- 172.21.15.26:0/695284501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02ac101f70 0x7f02ac197080 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f029400d980 tx=0x7f029400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.936+0000 7f02a37fe700 1 -- 172.21.15.26:0/695284501 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294004220 con 0x7f02ac101f70 2023-12-01T01:04:05.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.937+0000 7f02b0f19700 1 -- 172.21.15.26:0/695284501 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ac19ec70 con 0x7f02ac101f70 2023-12-01T01:04:05.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.937+0000 7f02a37fe700 1 -- 172.21.15.26:0/695284501 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0294007640 con 0x7f02ac101f70 2023-12-01T01:04:05.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.937+0000 7f02a37fe700 1 -- 172.21.15.26:0/695284501 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029400f690 con 0x7f02ac101f70 2023-12-01T01:04:05.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.937+0000 7f02b0f19700 1 -- 172.21.15.26:0/695284501 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ac19f1d0 con 0x7f02ac101f70 2023-12-01T01:04:05.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.939+0000 7f02a37fe700 1 -- 172.21.15.26:0/695284501 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f0294004410 con 0x7f02ac101f70 2023-12-01T01:04:05.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.939+0000 7f02a37fe700 1 --2- 172.21.15.26:0/695284501 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f02980a0520 0x7f02980a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.940+0000 7f02a37fe700 1 -- 172.21.15.26:0/695284501 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f02940cb7a0 con 0x7f02ac101f70 2023-12-01T01:04:05.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.940+0000 7f02aa59c700 1 --2- 172.21.15.26:0/695284501 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f02980a0520 0x7f02980a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.940+0000 7f02aa59c700 1 --2- 172.21.15.26:0/695284501 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f02980a0520 0x7f02980a29e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f029c009990 tx=0x7f029c003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.940+0000 7f02bd0a9b80 1 Processor -- start 2023-12-01T01:04:05.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.940+0000 7f02bd0a9b80 1 -- start start 2023-12-01T01:04:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02bd0a9b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107da30a0 0x55f107da34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02bd0a9b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da3a20 0x55f107da1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02bd0a9b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107da23a0 0x55f107da2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02bd0a9b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f107cf99c0 con 0x55f107da3a20 2023-12-01T01:04:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02bd0a9b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f107cf7380 con 0x55f107da30a0 2023-12-01T01:04:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02bd0a9b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f107cf2c70 con 0x55f107da23a0 2023-12-01T01:04:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02a9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da3a20 0x55f107da1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02a9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da3a20 0x55f107da1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54806/0 (socket says 172.21.15.26:54806) 2023-12-01T01:04:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02a9d9b700 1 -- 172.21.15.26:0/3092946982 learned_addr learned my addr 172.21.15.26:0/3092946982 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02aad9d700 1 --2- 172.21.15.26:0/3092946982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107da23a0 0x55f107da2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02aa59c700 1 --2- 172.21.15.26:0/3092946982 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107da30a0 0x55f107da34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02a9d9b700 1 -- 172.21.15.26:0/3092946982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107da23a0 msgr2=0x55f107da2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02a9d9b700 1 --2- 172.21.15.26:0/3092946982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107da23a0 0x55f107da2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02a9d9b700 1 -- 172.21.15.26:0/3092946982 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107da30a0 msgr2=0x55f107da34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02a9d9b700 1 --2- 172.21.15.26:0/3092946982 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107da30a0 0x55f107da34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02a9d9b700 1 -- 172.21.15.26:0/3092946982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f107b20d90 con 0x55f107da3a20 2023-12-01T01:04:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02aad9d700 1 --2- 172.21.15.26:0/3092946982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107da23a0 0x55f107da2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02a9d9b700 1 --2- 172.21.15.26:0/3092946982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da3a20 0x55f107da1e10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f02940a0b50 tx=0x7f0294098a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f9978ab4b2444c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02a0ff9700 1 -- 172.21.15.26:0/3092946982 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02940a1080 con 0x55f107da3a20 2023-12-01T01:04:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02a0ff9700 1 -- 172.21.15.26:0/3092946982 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f02940973b0 con 0x55f107da3a20 2023-12-01T01:04:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.941+0000 7f02a0ff9700 1 -- 172.21.15.26:0/3092946982 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02940a0bf0 con 0x55f107da3a20 2023-12-01T01:04:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.942+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/3092946982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da3a20 msgr2=0x55f107da1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.942+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/3092946982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da3a20 0x55f107da1e10 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f02940a0b50 tx=0x7f0294098a40 comp rx=0 tx=0).stop 2023-12-01T01:04:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.942+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/3092946982 shutdown_connections 2023-12-01T01:04:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.942+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/3092946982 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107da23a0 0x55f107da2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.942+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/3092946982 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107da30a0 0x55f107da34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.942+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/3092946982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da3a20 0x55f107da1e10 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.942+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/3092946982 >> 172.21.15.26:0/3092946982 conn(0x55f107d01080 msgr2=0x55f107d9c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.942+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/3092946982 shutdown_connections 2023-12-01T01:04:05.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.942+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/3092946982 wait complete. 2023-12-01T01:04:05.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.942+0000 7f02bd0a9b80 1 -- start start 2023-12-01T01:04:05.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02bd0a9b80 1 Processor -- start 2023-12-01T01:04:05.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02bd0a9b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107da23a0 0x55f107daba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02bd0a9b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107da30a0 0x55f107dabf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02bd0a9b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da3a20 0x55f107db2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02bd0a9b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f107c8f4c0 con 0x55f107da3a20 2023-12-01T01:04:05.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02bd0a9b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f107c8f160 con 0x55f107da23a0 2023-12-01T01:04:05.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02bd0a9b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f107b768d0 con 0x55f107da30a0 2023-12-01T01:04:05.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02bd0a9b80 10 client.0 _ll_register_callbacks cb 0x55f107bdca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:05.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02aad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da3a20 0x55f107db2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02aad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da3a20 0x55f107db2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54814/0 (socket says 172.21.15.26:54814) 2023-12-01T01:04:05.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02aad9d700 1 -- 172.21.15.26:0/1287308368 learned_addr learned my addr 172.21.15.26:0/1287308368 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:05.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02a9d9b700 1 --2- 172.21.15.26:0/1287308368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107da30a0 0x55f107dabf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02aa59c700 1 --2- 172.21.15.26:0/1287308368 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107da23a0 0x55f107daba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02aad9d700 1 -- 172.21.15.26:0/1287308368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107da30a0 msgr2=0x55f107dabf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02aad9d700 1 --2- 172.21.15.26:0/1287308368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107da30a0 0x55f107dabf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02aad9d700 1 -- 172.21.15.26:0/1287308368 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107da23a0 msgr2=0x55f107daba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02aad9d700 1 --2- 172.21.15.26:0/1287308368 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107da23a0 0x55f107daba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02aad9d700 1 -- 172.21.15.26:0/1287308368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ac19f1d0 con 0x55f107da3a20 2023-12-01T01:04:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02aa59c700 1 --2- 172.21.15.26:0/1287308368 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107da23a0 0x55f107daba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f02aad9d700 1 --2- 172.21.15.26:0/1287308368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da3a20 0x55f107db2fc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f02a4008e60 tx=0x7f02a40114a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ca97d0f8423a9b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.943+0000 7f0291ffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.944+0000 7f0291ffb700 1 -- 172.21.15.26:0/1287308368 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a400f050 con 0x55f107da3a20 2023-12-01T01:04:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.944+0000 7f0291ffb700 1 -- 172.21.15.26:0/1287308368 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f02a4011cb0 con 0x55f107da3a20 2023-12-01T01:04:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.944+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/1287308368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f107d1dcc0 con 0x55f107da3a20 2023-12-01T01:04:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.944+0000 7f0291ffb700 1 -- 172.21.15.26:0/1287308368 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02a4011eb0 con 0x55f107da3a20 2023-12-01T01:04:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.944+0000 7f02bd0a9b80 10 client.15234 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.944+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/1287308368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55f107b09c10 con 0x55f107da3a20 2023-12-01T01:04:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.944+0000 7f0291ffb700 1 -- 172.21.15.26:0/1287308368 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55f107d1dcc0 con 0x55f107da3a20 2023-12-01T01:04:05.957 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.944+0000 7f0291ffb700 1 -- 172.21.15.26:0/1287308368 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f02a401f650 con 0x55f107da3a20 2023-12-01T01:04:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.944+0000 7f02bd0a9b80 10 client.15234 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.944+0000 7f02bd0a9b80 10 client.15234 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-01T01:04:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.944+0000 7f02bd0a9b80 20 client.15234 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.944+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/1287308368 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f107db6d10 0x55f107db6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.944+0000 7f02bd0a9b80 4 client.15234 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:04:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.944+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/1287308368 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f107d70dc0 con 0x55f107db6d10 2023-12-01T01:04:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.945+0000 7f02aa59c700 1 --2- 172.21.15.26:0/1287308368 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f107db6d10 0x55f107db6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.945+0000 7f0291ffb700 10 client.15234 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.945+0000 7f02aa59c700 1 --2- 172.21.15.26:0/1287308368 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f107db6d10 0x55f107db6110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d241d9d279831682 server_cookie=ac6c02b59c9e6704 in_seq=0 out_seq=0 2023-12-01T01:04:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.947+0000 7f0291ffb700 1 -- 172.21.15.26:0/1287308368 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55f107d70dc0 con 0x55f107db6d10 2023-12-01T01:04:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.947+0000 7f0291ffb700 10 client.15234 handle_command_reply: tid=0 2023-12-01T01:04:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.947+0000 7f02bd0a9b80 1 client.15234 shutdown 2023-12-01T01:04:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.947+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/1287308368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da3a20 msgr2=0x55f107db2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.947+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/1287308368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da3a20 0x55f107db2fc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f02a4008e60 tx=0x7f02a40114a0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.947+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/1287308368 shutdown_connections 2023-12-01T01:04:05.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.947+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/1287308368 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f107db6d10 0x55f107db6110 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.947+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/1287308368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da3a20 0x55f107db2fc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.947+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/1287308368 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107da23a0 0x55f107daba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.947+0000 7f0291ffb700 0 client.15234 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:05.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.947+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/1287308368 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107da30a0 0x55f107dabf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.947+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/1287308368 >> 172.21.15.26:0/1287308368 conn(0x55f107d01080 msgr2=0x55f107d9c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.947+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/1287308368 shutdown_connections 2023-12-01T01:04:05.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.947+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/1287308368 wait complete. 2023-12-01T01:04:05.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.947+0000 7f02bd0a9b80 20 client.15234 trim_cache size 0 max 16384 2023-12-01T01:04:05.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02bd0a9b80 1 Processor -- start 2023-12-01T01:04:05.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02bd0a9b80 1 -- start start 2023-12-01T01:04:05.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02bd0a9b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107d01080 0x55f107da63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02bd0a9b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da23a0 0x55f107dbfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02bd0a9b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107da30a0 0x55f107da68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02bd0a9b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f107d9e480 con 0x55f107da23a0 2023-12-01T01:04:05.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02bd0a9b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f107da2c20 con 0x55f107d01080 2023-12-01T01:04:05.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02bd0a9b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f107d70dc0 con 0x55f107da30a0 2023-12-01T01:04:05.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02a9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da23a0 0x55f107dbfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02a9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da23a0 0x55f107dbfa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54820/0 (socket says 172.21.15.26:54820) 2023-12-01T01:04:05.972 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02a9d9b700 1 -- 172.21.15.26:0/4032469960 learned_addr learned my addr 172.21.15.26:0/4032469960 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02a9d9b700 1 -- 172.21.15.26:0/4032469960 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107da30a0 msgr2=0x55f107da68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02a9d9b700 1 --2- 172.21.15.26:0/4032469960 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107da30a0 0x55f107da68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02a9d9b700 1 -- 172.21.15.26:0/4032469960 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107d01080 msgr2=0x55f107da63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02aa59c700 1 --2- 172.21.15.26:0/4032469960 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107d01080 0x55f107da63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02a9d9b700 1 --2- 172.21.15.26:0/4032469960 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107d01080 0x55f107da63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02a9d9b700 1 -- 172.21.15.26:0/4032469960 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f107b47200 con 0x55f107da23a0 2023-12-01T01:04:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02a9d9b700 1 --2- 172.21.15.26:0/4032469960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da23a0 0x55f107dbfa40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f02940998c0 tx=0x7f02940cb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d7384a9004829e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02a17fa700 1 -- 172.21.15.26:0/4032469960 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02940a1080 con 0x55f107da23a0 2023-12-01T01:04:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02a17fa700 1 -- 172.21.15.26:0/4032469960 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f02940985e0 con 0x55f107da23a0 2023-12-01T01:04:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.964+0000 7f02a17fa700 1 -- 172.21.15.26:0/4032469960 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02940acad0 con 0x55f107da23a0 2023-12-01T01:04:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.965+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/4032469960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da23a0 msgr2=0x55f107dbfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.965+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/4032469960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da23a0 0x55f107dbfa40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f02940998c0 tx=0x7f02940cb040 comp rx=0 tx=0).stop 2023-12-01T01:04:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.965+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/4032469960 shutdown_connections 2023-12-01T01:04:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.965+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/4032469960 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107da30a0 0x55f107da68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.973 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.965+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/4032469960 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107d01080 0x55f107da63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.965+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/4032469960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da23a0 0x55f107dbfa40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.965+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/4032469960 >> 172.21.15.26:0/4032469960 conn(0x55f107d9cc20 msgr2=0x55f107db6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.965+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/4032469960 shutdown_connections 2023-12-01T01:04:05.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.965+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/4032469960 wait complete. 2023-12-01T01:04:05.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.965+0000 7f02bd0a9b80 1 -- start start 2023-12-01T01:04:05.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.965+0000 7f02bd0a9b80 1 Processor -- start 2023-12-01T01:04:05.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02bd0a9b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107d01080 0x55f107dbccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02bd0a9b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da30a0 0x55f107dbd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02bd0a9b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107da3a20 0x55f107dbe220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02bd0a9b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f107dbe760 con 0x55f107da30a0 2023-12-01T01:04:05.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02bd0a9b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f107dbe8d0 con 0x55f107da3a20 2023-12-01T01:04:05.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02bd0a9b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f107dbea90 con 0x55f107d01080 2023-12-01T01:04:05.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02bd0a9b80 10 client.0 _ll_register_callbacks cb 0x55f107bdca30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:05.974 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02a9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da30a0 0x55f107dbd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02a9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da30a0 0x55f107dbd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54826/0 (socket says 172.21.15.26:54826) 2023-12-01T01:04:05.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02a9d9b700 1 -- 172.21.15.26:0/4105839191 learned_addr learned my addr 172.21.15.26:0/4105839191 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:05.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02aad9d700 1 --2- 172.21.15.26:0/4105839191 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107da3a20 0x55f107dbe220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02aa59c700 1 --2- 172.21.15.26:0/4105839191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107d01080 0x55f107dbccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02a9d9b700 1 -- 172.21.15.26:0/4105839191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107d01080 msgr2=0x55f107dbccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02a9d9b700 1 --2- 172.21.15.26:0/4105839191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107d01080 0x55f107dbccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02a9d9b700 1 -- 172.21.15.26:0/4105839191 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107da3a20 msgr2=0x55f107dbe220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:05.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02a9d9b700 1 --2- 172.21.15.26:0/4105839191 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107da3a20 0x55f107dbe220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02a9d9b700 1 -- 172.21.15.26:0/4105839191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f107b20d90 con 0x55f107da30a0 2023-12-01T01:04:05.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02a9d9b700 1 --2- 172.21.15.26:0/4105839191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da30a0 0x55f107dbd210 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0294007e80 tx=0x7f029409cfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd2d882afbe5f88 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:05.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f0291ffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:05.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f0291ffb700 1 -- 172.21.15.26:0/4105839191 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294094e00 con 0x55f107da30a0 2023-12-01T01:04:05.975 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f0291ffb700 1 -- 172.21.15.26:0/4105839191 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0294094f60 con 0x55f107da30a0 2023-12-01T01:04:05.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/4105839191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f02940973b0 con 0x55f107da30a0 2023-12-01T01:04:05.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f0291ffb700 1 -- 172.21.15.26:0/4105839191 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0294095120 con 0x55f107da30a0 2023-12-01T01:04:05.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02bd0a9b80 10 client.15240 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:05.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.966+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/4105839191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55f107b1f260 con 0x55f107da30a0 2023-12-01T01:04:05.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.967+0000 7f0291ffb700 1 -- 172.21.15.26:0/4105839191 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f02940973b0 con 0x55f107da30a0 2023-12-01T01:04:05.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.967+0000 7f0291ffb700 1 -- 172.21.15.26:0/4105839191 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f0294098000 con 0x55f107da30a0 2023-12-01T01:04:05.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.967+0000 7f02bd0a9b80 10 client.15240 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:05.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.967+0000 7f02bd0a9b80 10 client.15240 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-01T01:04:05.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.967+0000 7f02bd0a9b80 20 client.15240 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:05.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.967+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/4105839191 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f107e0da70 0x55f107e0a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:05.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.967+0000 7f02bd0a9b80 4 client.15240 mds_command: new command op to 24509 tid=0[{"prefix": "status"}] 2023-12-01T01:04:05.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.967+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/4105839191 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f107cebcf0 con 0x55f107e0da70 2023-12-01T01:04:05.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.967+0000 7f02aa59c700 1 --2- 172.21.15.26:0/4105839191 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f107e0da70 0x55f107e0a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:05.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.967+0000 7f0291ffb700 10 client.15240 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:05.976 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.967+0000 7f02aa59c700 1 --2- 172.21.15.26:0/4105839191 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f107e0da70 0x55f107e0a7d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=201a0b1f9b38f9d5 server_cookie=3e45de894113736c in_seq=0 out_seq=0 2023-12-01T01:04:05.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f0291ffb700 1 -- 172.21.15.26:0/4105839191 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55f107cebcf0 con 0x55f107e0da70 2023-12-01T01:04:05.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f0291ffb700 10 client.15240 handle_command_reply: tid=0 2023-12-01T01:04:05.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02bd0a9b80 1 client.15240 shutdown 2023-12-01T01:04:05.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/4105839191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da30a0 msgr2=0x55f107dbd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/4105839191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da30a0 0x55f107dbd210 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0294007e80 tx=0x7f029409cfb0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/4105839191 shutdown_connections 2023-12-01T01:04:05.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/4105839191 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f107e0da70 0x55f107e0a7d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/4105839191 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f107da3a20 0x55f107dbe220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f0291ffb700 0 client.15240 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:05.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/4105839191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f107d01080 0x55f107dbccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02bd0a9b80 1 --2- 172.21.15.26:0/4105839191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f107da30a0 0x55f107dbd210 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/4105839191 >> 172.21.15.26:0/4105839191 conn(0x55f107d9cc20 msgr2=0x55f107da63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/4105839191 shutdown_connections 2023-12-01T01:04:05.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02bd0a9b80 1 -- 172.21.15.26:0/4105839191 wait complete. 2023-12-01T01:04:05.977 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02bd0a9b80 20 client.15240 trim_cache size 0 max 16384 2023-12-01T01:04:05.978 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:04:05.978 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "48bff570-8fe4-11ee-95a2-87774f69a715", 2023-12-01T01:04:05.978 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2023-12-01T01:04:05.978 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 24509, 2023-12-01T01:04:05.978 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2023-12-01T01:04:05.978 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2023-12-01T01:04:05.978 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2023-12-01T01:04:05.978 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 78.713749995000001, 2023-12-01T01:04:05.978 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 23, 2023-12-01T01:04:05.978 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 83, 2023-12-01T01:04:05.979 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 81, 2023-12-01T01:04:05.979 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 84.972765972000005 2023-12-01T01:04:05.979 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:04:05.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02b0f19700 1 -- 172.21.15.26:0/695284501 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f02980a0520 msgr2=0x7f02980a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.981 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02b0f19700 1 --2- 172.21.15.26:0/695284501 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f02980a0520 0x7f02980a29e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f029c009990 tx=0x7f029c003680 comp rx=0 tx=0).stop 2023-12-01T01:04:05.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02b0f19700 1 -- 172.21.15.26:0/695284501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02ac101f70 msgr2=0x7f02ac197080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:05.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02b0f19700 1 --2- 172.21.15.26:0/695284501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02ac101f70 0x7f02ac197080 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f029400d980 tx=0x7f029400dc90 comp rx=0 tx=0).stop 2023-12-01T01:04:05.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02b0f19700 1 -- 172.21.15.26:0/695284501 shutdown_connections 2023-12-01T01:04:05.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02b0f19700 1 --2- 172.21.15.26:0/695284501 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f02980a0520 0x7f02980a29e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.968+0000 7f02b0f19700 1 --2- 172.21.15.26:0/695284501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02ac102910 0x7f02ac19e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.969+0000 7f02b0f19700 1 --2- 172.21.15.26:0/695284501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f02ac100d80 0x7f02ac196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.969+0000 7f02b0f19700 1 --2- 172.21.15.26:0/695284501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02ac101f70 0x7f02ac197080 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:05.982 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.969+0000 7f02b0f19700 1 -- 172.21.15.26:0/695284501 >> 172.21.15.26:0/695284501 conn(0x7f02ac0fc310 msgr2=0x7f02ac105450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:05.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.969+0000 7f02b0f19700 1 -- 172.21.15.26:0/695284501 shutdown_connections 2023-12-01T01:04:05.983 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:05.969+0000 7f02b0f19700 1 -- 172.21.15.26:0/695284501 wait complete. 2023-12-01T01:04:05.984 INFO:teuthology.run_tasks:Running task kclient... 2023-12-01T01:04:06.014 INFO:tasks.kclient:Mounting kernel clients... 2023-12-01T01:04:06.015 INFO:tasks.kclient:config is {'client.0': {}} 2023-12-01T01:04:06.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:06.015 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-12-01T01:04:06.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:06.033 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2023-12-01T01:04:06.096 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:05 smithi026 ceph-mon[98801]: pgmap v286: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-01T01:04:06.097 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:05 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3908103972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:04:06.097 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:05 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/803269306' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:06.102 INFO:teuthology.orchestra.run.smithi026.stderr:Cannot find device "ceph-brx" 2023-12-01T01:04:06.103 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T01:04:06.104 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=crc', 'wsync'], 'rbytes': False, 'syntax': 'v1', 'mount_subvol_num': 1} 2023-12-01T01:04:06.104 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-01T01:04:06.104 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-01T01:04:06.104 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph fs ls 2023-12-01T01:04:06.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:05 smithi116 ceph-mon[103554]: pgmap v286: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-01T01:04:06.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:05 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3908103972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:04:06.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:05 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/803269306' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:06.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:05 smithi093 ceph-mon[103327]: pgmap v286: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-01T01:04:06.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:05 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3908103972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:04:06.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:05 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/803269306' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:06.702 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:04:08.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.041+0000 7f44d50aa700 1 -- 172.21.15.26:0/1877220142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44d01022b0 msgr2=0x7f44d010cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:08.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.041+0000 7f44d50aa700 1 --2- 172.21.15.26:0/1877220142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44d01022b0 0x7f44d010cc90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f44c800b0d0 tx=0x7f44c800b3e0 comp rx=0 tx=0).stop 2023-12-01T01:04:08.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.041+0000 7f44d50aa700 1 -- 172.21.15.26:0/1877220142 shutdown_connections 2023-12-01T01:04:08.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.041+0000 7f44d50aa700 1 --2- 172.21.15.26:0/1877220142 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44d01022b0 0x7f44d010cc90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:08.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.041+0000 7f44d50aa700 1 --2- 172.21.15.26:0/1877220142 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44d0100010 0x7f44d01003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:08.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.041+0000 7f44d50aa700 1 --2- 172.21.15.26:0/1877220142 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44d01018f0 0x7f44d0101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:08.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.041+0000 7f44d50aa700 1 -- 172.21.15.26:0/1877220142 >> 172.21.15.26:0/1877220142 conn(0x7f44d0076d80 msgr2=0x7f44d0077190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:08.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.041+0000 7f44d50aa700 1 -- 172.21.15.26:0/1877220142 shutdown_connections 2023-12-01T01:04:08.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.041+0000 7f44d50aa700 1 -- 172.21.15.26:0/1877220142 wait complete. 2023-12-01T01:04:08.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.041+0000 7f44d50aa700 1 Processor -- start 2023-12-01T01:04:08.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44d50aa700 1 -- start start 2023-12-01T01:04:08.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44d50aa700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44d0100010 0x7f44d0197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:08.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44d50aa700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44d01018f0 0x7f44d01984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:08.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44d50aa700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44d01022b0 0x7f44d01a3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:08.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44d50aa700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d0198df0 con 0x7f44d0100010 2023-12-01T01:04:08.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44d50aa700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d01a3560 con 0x7f44d01022b0 2023-12-01T01:04:08.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44d50aa700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d01a36d0 con 0x7f44d01018f0 2023-12-01T01:04:08.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44ced9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44d0100010 0x7f44d0197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:08.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44ced9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44d0100010 0x7f44d0197fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54838/0 (socket says 172.21.15.26:54838) 2023-12-01T01:04:08.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44ced9d700 1 -- 172.21.15.26:0/3155766536 learned_addr learned my addr 172.21.15.26:0/3155766536 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:08.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44cf59e700 1 --2- 172.21.15.26:0/3155766536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44d01022b0 0x7f44d01a3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:08.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44ce59c700 1 --2- 172.21.15.26:0/3155766536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44d01018f0 0x7f44d01984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:08.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44ced9d700 1 -- 172.21.15.26:0/3155766536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44d01018f0 msgr2=0x7f44d01984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:08.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44ced9d700 1 --2- 172.21.15.26:0/3155766536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44d01018f0 0x7f44d01984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:08.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44ced9d700 1 -- 172.21.15.26:0/3155766536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44d01022b0 msgr2=0x7f44d01a3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:08.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44ced9d700 1 --2- 172.21.15.26:0/3155766536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44d01022b0 0x7f44d01a3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:08.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.042+0000 7f44ced9d700 1 -- 172.21.15.26:0/3155766536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c8009d00 con 0x7f44d0100010 2023-12-01T01:04:08.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.043+0000 7f44ced9d700 1 --2- 172.21.15.26:0/3155766536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44d0100010 0x7f44d0197fa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f44c000c920 tx=0x7f44c000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:08.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.043+0000 7f44b7fff700 1 -- 172.21.15.26:0/3155766536 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0004a30 con 0x7f44d0100010 2023-12-01T01:04:08.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.043+0000 7f44b7fff700 1 -- 172.21.15.26:0/3155766536 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f44c0005500 con 0x7f44d0100010 2023-12-01T01:04:08.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.043+0000 7f44d50aa700 1 -- 172.21.15.26:0/3155766536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d01a39b0 con 0x7f44d0100010 2023-12-01T01:04:08.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.043+0000 7f44b7fff700 1 -- 172.21.15.26:0/3155766536 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c0007cd0 con 0x7f44d0100010 2023-12-01T01:04:08.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.043+0000 7f44d50aa700 1 -- 172.21.15.26:0/3155766536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d01a3f30 con 0x7f44d0100010 2023-12-01T01:04:08.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.044+0000 7f44d50aa700 1 -- 172.21.15.26:0/3155766536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d004ea90 con 0x7f44d0100010 2023-12-01T01:04:08.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.045+0000 7f44b7fff700 1 -- 172.21.15.26:0/3155766536 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f44c0005000 con 0x7f44d0100010 2023-12-01T01:04:08.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.045+0000 7f44b7fff700 1 --2- 172.21.15.26:0/3155766536 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f44b80a0520 0x7f44b80a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:08.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.046+0000 7f44ce59c700 1 --2- 172.21.15.26:0/3155766536 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f44b80a0520 0x7f44b80a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:08.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.046+0000 7f44b7fff700 1 -- 172.21.15.26:0/3155766536 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f44c00cb850 con 0x7f44d0100010 2023-12-01T01:04:08.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.046+0000 7f44ce59c700 1 --2- 172.21.15.26:0/3155766536 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f44b80a0520 0x7f44b80a29e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f44d0069990 tx=0x7f44c4009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:08.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.049+0000 7f44b7fff700 1 -- 172.21.15.26:0/3155766536 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f44c0095400 con 0x7f44d0100010 2023-12-01T01:04:08.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:07 smithi116 ceph-mon[103554]: pgmap v287: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-01T01:04:08.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:07 smithi093 ceph-mon[103327]: pgmap v287: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-01T01:04:08.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.292+0000 7f44d50aa700 1 -- 172.21.15.26:0/3155766536 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f44d00696d0 con 0x7f44d0100010 2023-12-01T01:04:08.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.292+0000 7f44b7fff700 1 -- 172.21.15.26:0/3155766536 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f44c001d020 con 0x7f44d0100010 2023-12-01T01:04:08.293 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-01T01:04:08.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.294+0000 7f44d50aa700 1 -- 172.21.15.26:0/3155766536 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f44b80a0520 msgr2=0x7f44b80a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:08.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.294+0000 7f44d50aa700 1 --2- 172.21.15.26:0/3155766536 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f44b80a0520 0x7f44b80a29e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f44d0069990 tx=0x7f44c4009190 comp rx=0 tx=0).stop 2023-12-01T01:04:08.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.294+0000 7f44d50aa700 1 -- 172.21.15.26:0/3155766536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44d0100010 msgr2=0x7f44d0197fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:08.295 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.294+0000 7f44d50aa700 1 --2- 172.21.15.26:0/3155766536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44d0100010 0x7f44d0197fa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f44c000c920 tx=0x7f44c000cc30 comp rx=0 tx=0).stop 2023-12-01T01:04:08.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.294+0000 7f44d50aa700 1 -- 172.21.15.26:0/3155766536 shutdown_connections 2023-12-01T01:04:08.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.294+0000 7f44d50aa700 1 --2- 172.21.15.26:0/3155766536 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f44b80a0520 0x7f44b80a29e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:08.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.294+0000 7f44d50aa700 1 --2- 172.21.15.26:0/3155766536 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f44d01022b0 0x7f44d01a3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:08.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.294+0000 7f44d50aa700 1 --2- 172.21.15.26:0/3155766536 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f44d0100010 0x7f44d0197fa0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:08.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.294+0000 7f44d50aa700 1 --2- 172.21.15.26:0/3155766536 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f44d01018f0 0x7f44d01984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:08.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.294+0000 7f44d50aa700 1 -- 172.21.15.26:0/3155766536 >> 172.21.15.26:0/3155766536 conn(0x7f44d0076d80 msgr2=0x7f44d00fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:08.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.294+0000 7f44d50aa700 1 -- 172.21.15.26:0/3155766536 shutdown_connections 2023-12-01T01:04:08.296 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:08.294+0000 7f44d50aa700 1 -- 172.21.15.26:0/3155766536 wait complete. 2023-12-01T01:04:08.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:07 smithi026 ceph-mon[98801]: pgmap v287: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-01T01:04:08.666 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-01T01:04:08.666 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-01T01:04:08.666 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2023-12-01T01:04:08.666 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-01T01:04:08.666 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-01T01:04:08.666 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-01T01:04:08.666 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-01T01:04:08.666 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-01T01:04:08.666 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-01T01:04:08.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:08.667 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2023-12-01T01:04:08.685 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-01T01:04:08.686 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-01T01:04:08.686 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2023-12-01T01:04:08.686 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-12-01T01:04:08.686 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2023-12-01T01:04:08.686 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-12-01T01:04:08.686 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-01T01:04:08.686 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2023-12-01T01:04:08.686 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-01T01:04:08.686 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2023-12-01T01:04:08.686 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-01T01:04:08.687 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2023-12-01T01:04:08.687 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-01T01:04:08.687 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 41872sec preferred_lft 41872sec 2023-12-01T01:04:08.687 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2023-12-01T01:04:08.687 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2023-12-01T01:04:08.687 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-01T01:04:08.687 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2023-12-01T01:04:08.688 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-01T01:04:08.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:08.688 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-12-01T01:04:08.688 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-12-01T01:04:08.688 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add name ceph-brx type bridge 2023-12-01T01:04:08.688 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr flush dev ceph-brx 2023-12-01T01:04:08.688 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set ceph-brx up 2023-12-01T01:04:08.689 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-01T01:04:08.689 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-12-01T01:04:08.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:08.880 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-01T01:04:08.910 INFO:teuthology.orchestra.run.smithi026.stdout:1 2023-12-01T01:04:08.910 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:08 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3155766536' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-01T01:04:08.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:08.912 DEBUG:teuthology.orchestra.run.smithi026:> route 2023-12-01T01:04:08.982 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2023-12-01T01:04:08.982 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-01T01:04:08.982 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-01T01:04:08.982 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-01T01:04:08.982 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-01T01:04:08.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:08.983 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-12-01T01:04:08.983 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-12-01T01:04:08.983 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-01T01:04:08.983 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-01T01:04:08.983 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-01T01:04:08.983 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-12-01T01:04:09.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:08 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3155766536' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-01T01:04:09.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:08 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3155766536' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-12-01T01:04:09.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:09.249 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-12-01T01:04:09.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:09.267 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2023-12-01T01:04:09.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:09.324 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-12-01T01:04:09.324 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-12-01T01:04:09.324 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T01:04:09.324 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-01T01:04:09.324 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-12-01T01:04:09.421 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-01T01:04:09.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:09.421 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-12-01T01:04:09.421 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-12-01T01:04:09.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-01T01:04:09.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-01T01:04:09.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-01T01:04:09.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-01T01:04:09.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-01T01:04:09.422 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-12-01T01:04:09.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:09.639 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec bash -c ' 2023-12-01T01:04:09.639 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2023-12-01T01:04:09.639 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2023-12-01T01:04:09.639 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.0 master ceph-brx 2023-12-01T01:04:09.639 DEBUG:teuthology.orchestra.run.smithi026:> ') 2023-12-01T01:04:09.739 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-01T01:04:09.739 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-01T01:04:09.756 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-01T01:04:09.757 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-01T01:04:09.757 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-01T01:04:09.814 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2023-12-01T01:04:09.814 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2023-12-01T01:04:09.814 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50 2023-12-01T01:04:09.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:09.814 DEBUG:teuthology.orchestra.run.smithi026:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2023-12-01T01:04:09.914 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2023-12-01T01:04:09.914 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2023-12-01T01:04:09.914 INFO:teuthology.orchestra.run.smithi026.stdout:invalid new device string format 2023-12-01T01:04:09.948 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:09 smithi026 ceph-mon[98801]: pgmap v288: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-01T01:04:10.068 INFO:teuthology.orchestra.run.smithi026.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync 2023-12-01T01:04:10.068 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync". 2023-12-01T01:04:10.068 INFO:teuthology.orchestra.run.smithi026.stdout:invalid new device string format 2023-12-01T01:04:10.068 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: resolved to: "172.21.15.26:3300,172.21.15.93:3300,172.21.15.116:3300" 2023-12-01T01:04:10.068 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.26:3300,172.21.15.93:3300,172.21.15.116:3300:/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50 2023-12-01T01:04:10.068 INFO:teuthology.orchestra.run.smithi026.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=crc,wsync,key=0,fsid=48bff570-8fe4-11ee-95a2-87774f69a715" will pass to kernel 2023-12-01T01:04:10.071 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-01T01:04:10.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:10.071 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-01T01:04:10.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:10.101 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-01T01:04:10.174 INFO:teuthology.orchestra.run.smithi026.stdout:client24964 2023-12-01T01:04:10.175 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T01:04:10.175 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-01T01:04:10.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:09 smithi116 ceph-mon[103554]: pgmap v288: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-01T01:04:10.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:09 smithi093 ceph-mon[103327]: pgmap v288: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 7 op/s 2023-12-01T01:04:10.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:10.233 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-01T01:04:10.307 INFO:teuthology.orchestra.run.smithi026.stdout:client24964 2023-12-01T01:04:10.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:10.308 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-01T01:04:10.381 INFO:teuthology.orchestra.run.smithi026.stdout:client24964 2023-12-01T01:04:10.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:04:10.381 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/48bff570-8fe4-11ee-95a2-87774f69a715.client24964/status') 2023-12-01T01:04:10.465 INFO:teuthology.orchestra.run.smithi026.stdout:instance: client.24964 (3)172.21.15.26:0/3797386186 2023-12-01T01:04:10.466 INFO:teuthology.orchestra.run.smithi026.stdout:blocklisted: false 2023-12-01T01:04:10.466 INFO:teuthology.orchestra.run.smithi026.stderr:0+1 records in 2023-12-01T01:04:10.467 INFO:teuthology.orchestra.run.smithi026.stderr:0+1 records out 2023-12-01T01:04:10.467 INFO:teuthology.orchestra.run.smithi026.stderr:71 bytes copied, 2.4705e-05 s, 2.9 MB/s 2023-12-01T01:04:10.467 INFO:teuthology.run_tasks:Running task check-counter... 2023-12-01T01:04:10.478 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-12-01T01:04:10.525 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:04:10.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.651+0000 7f516d3a0700 1 -- 172.21.15.26:0/910489948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51681010a0 msgr2=0x7f51681014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:10.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.651+0000 7f516d3a0700 1 --2- 172.21.15.26:0/910489948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51681010a0 0x7f51681014c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5158009990 tx=0x7f5158009ca0 comp rx=0 tx=0).stop 2023-12-01T01:04:10.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.651+0000 7f516d3a0700 1 -- 172.21.15.26:0/910489948 shutdown_connections 2023-12-01T01:04:10.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.651+0000 7f516d3a0700 1 --2- 172.21.15.26:0/910489948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f51681006b0 0x7f5168107f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:10.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.651+0000 7f516d3a0700 1 --2- 172.21.15.26:0/910489948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51681010a0 0x7f51681014c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:10.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.651+0000 7f516d3a0700 1 --2- 172.21.15.26:0/910489948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51680ffcf0 0x7f5168100170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:10.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.651+0000 7f516d3a0700 1 -- 172.21.15.26:0/910489948 >> 172.21.15.26:0/910489948 conn(0x7f51680fa800 msgr2=0x7f51680fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:10.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.651+0000 7f516d3a0700 1 -- 172.21.15.26:0/910489948 shutdown_connections 2023-12-01T01:04:10.653 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.651+0000 7f516d3a0700 1 -- 172.21.15.26:0/910489948 wait complete. 2023-12-01T01:04:10.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.652+0000 7f516d3a0700 1 Processor -- start 2023-12-01T01:04:10.654 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.652+0000 7f516d3a0700 1 -- start start 2023-12-01T01:04:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.652+0000 7f516d3a0700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f51680ffcf0 0x7f51680ff750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.652+0000 7f516d3a0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51681006b0 0x7f516819b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.652+0000 7f516d3a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51681010a0 0x7f516819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.652+0000 7f516d3a0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516819e390 con 0x7f51681010a0 2023-12-01T01:04:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.652+0000 7f516d3a0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516819e500 con 0x7f51681006b0 2023-12-01T01:04:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.652+0000 7f516d3a0700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f516819e6c0 con 0x7f51680ffcf0 2023-12-01T01:04:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.653+0000 7f516cb9f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51681010a0 0x7f516819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.653+0000 7f516cb9f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51681010a0 0x7f516819dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54860/0 (socket says 172.21.15.26:54860) 2023-12-01T01:04:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.653+0000 7f516cb9f700 1 -- 172.21.15.26:0/2105064665 learned_addr learned my addr 172.21.15.26:0/2105064665 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.653+0000 7f5167fff700 1 --2- 172.21.15.26:0/2105064665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f51680ffcf0 0x7f51680ff750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.653+0000 7f51677fe700 1 --2- 172.21.15.26:0/2105064665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51681006b0 0x7f516819b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.653+0000 7f516cb9f700 1 -- 172.21.15.26:0/2105064665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f51680ffcf0 msgr2=0x7f51680ff750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.653+0000 7f516cb9f700 1 --2- 172.21.15.26:0/2105064665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f51680ffcf0 0x7f51680ff750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:10.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.653+0000 7f516cb9f700 1 -- 172.21.15.26:0/2105064665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51681006b0 msgr2=0x7f516819b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:10.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.653+0000 7f516cb9f700 1 --2- 172.21.15.26:0/2105064665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51681006b0 0x7f516819b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:10.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.653+0000 7f516cb9f700 1 -- 172.21.15.26:0/2105064665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51580095f0 con 0x7f51681010a0 2023-12-01T01:04:10.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.653+0000 7f516cb9f700 1 --2- 172.21.15.26:0/2105064665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51681010a0 0x7f516819dbf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5160007ee0 tx=0x7f516000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:10.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.653+0000 7f51657fa700 1 -- 172.21.15.26:0/2105064665 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160017070 con 0x7f51681010a0 2023-12-01T01:04:10.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.653+0000 7f51657fa700 1 -- 172.21.15.26:0/2105064665 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f516000f040 con 0x7f51681010a0 2023-12-01T01:04:10.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.653+0000 7f516d3a0700 1 -- 172.21.15.26:0/2105064665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f516819e9a0 con 0x7f51681010a0 2023-12-01T01:04:10.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.653+0000 7f51657fa700 1 -- 172.21.15.26:0/2105064665 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160005610 con 0x7f51681010a0 2023-12-01T01:04:10.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.653+0000 7f516d3a0700 1 -- 172.21.15.26:0/2105064665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f516819ee60 con 0x7f51681010a0 2023-12-01T01:04:10.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.654+0000 7f516d3a0700 1 -- 172.21.15.26:0/2105064665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f516810b470 con 0x7f51681010a0 2023-12-01T01:04:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.655+0000 7f51657fa700 1 -- 172.21.15.26:0/2105064665 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f5160005770 con 0x7f51681010a0 2023-12-01T01:04:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.656+0000 7f51657fa700 1 --2- 172.21.15.26:0/2105064665 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f51540a0610 0x7f51540a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.656+0000 7f5167fff700 1 --2- 172.21.15.26:0/2105064665 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f51540a0610 0x7f51540a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.657+0000 7f51657fa700 1 -- 172.21.15.26:0/2105064665 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f51600cb6b0 con 0x7f51681010a0 2023-12-01T01:04:10.658 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.657+0000 7f5167fff700 1 --2- 172.21.15.26:0/2105064665 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f51540a0610 0x7f51540a2ad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f515800b5c0 tx=0x7f5158005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:10.661 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.660+0000 7f51657fa700 1 -- 172.21.15.26:0/2105064665 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5160095260 con 0x7f51681010a0 2023-12-01T01:04:10.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.865+0000 7f516d3a0700 1 -- 172.21.15.26:0/2105064665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5168106840 con 0x7f51681010a0 2023-12-01T01:04:10.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.866+0000 7f51657fa700 1 -- 172.21.15.26:0/2105064665 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22481 (secure 0 0 0) 0x7f5160009390 con 0x7f51681010a0 2023-12-01T01:04:10.867 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:04:10.868 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":83,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:59.627676+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:04:10.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.868+0000 7f516d3a0700 1 -- 172.21.15.26:0/2105064665 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f51540a0610 msgr2=0x7f51540a2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:10.869 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.868+0000 7f516d3a0700 1 --2- 172.21.15.26:0/2105064665 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f51540a0610 0x7f51540a2ad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f515800b5c0 tx=0x7f5158005fb0 comp rx=0 tx=0).stop 2023-12-01T01:04:10.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.868+0000 7f516d3a0700 1 -- 172.21.15.26:0/2105064665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51681010a0 msgr2=0x7f516819dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:10.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.868+0000 7f516d3a0700 1 --2- 172.21.15.26:0/2105064665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51681010a0 0x7f516819dbf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5160007ee0 tx=0x7f516000d3b0 comp rx=0 tx=0).stop 2023-12-01T01:04:10.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.868+0000 7f516d3a0700 1 -- 172.21.15.26:0/2105064665 shutdown_connections 2023-12-01T01:04:10.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.868+0000 7f516d3a0700 1 --2- 172.21.15.26:0/2105064665 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f51540a0610 0x7f51540a2ad0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:10.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.868+0000 7f516d3a0700 1 --2- 172.21.15.26:0/2105064665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51681010a0 0x7f516819dbf0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:10.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.868+0000 7f516d3a0700 1 --2- 172.21.15.26:0/2105064665 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f51680ffcf0 0x7f51680ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:10.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.868+0000 7f516d3a0700 1 --2- 172.21.15.26:0/2105064665 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51681006b0 0x7f516819b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:10.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.868+0000 7f516d3a0700 1 -- 172.21.15.26:0/2105064665 >> 172.21.15.26:0/2105064665 conn(0x7f51680fa800 msgr2=0x7f51680fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:10.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.868+0000 7f516d3a0700 1 -- 172.21.15.26:0/2105064665 shutdown_connections 2023-12-01T01:04:10.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:10.868+0000 7f516d3a0700 1 -- 172.21.15.26:0/2105064665 wait complete. 2023-12-01T01:04:10.882 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T00:59:06.411348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T01:02:45.762784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T01:02:46.638998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T01:04:10.883 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T01:04:11.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.011+0000 7f625860c700 1 -- 172.21.15.26:0/1214407461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6250101f90 msgr2=0x7f62501023f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:11.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.011+0000 7f625860c700 1 --2- 172.21.15.26:0/1214407461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6250101f90 0x7f62501023f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f624c0099c0 tx=0x7f624c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.011+0000 7f625860c700 1 -- 172.21.15.26:0/1214407461 shutdown_connections 2023-12-01T01:04:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.011+0000 7f625860c700 1 --2- 172.21.15.26:0/1214407461 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6250102930 0x7f62501091e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.011+0000 7f625860c700 1 --2- 172.21.15.26:0/1214407461 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6250100da0 0x7f62501011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.011+0000 7f625860c700 1 --2- 172.21.15.26:0/1214407461 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6250101f90 0x7f62501023f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.011+0000 7f625860c700 1 -- 172.21.15.26:0/1214407461 >> 172.21.15.26:0/1214407461 conn(0x7f62500fc310 msgr2=0x7f62500fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.011+0000 7f625860c700 1 -- 172.21.15.26:0/1214407461 shutdown_connections 2023-12-01T01:04:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.011+0000 7f625860c700 1 -- 172.21.15.26:0/1214407461 wait complete. 2023-12-01T01:04:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f625860c700 1 Processor -- start 2023-12-01T01:04:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f625860c700 1 -- start start 2023-12-01T01:04:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f625860c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6250100da0 0x7f6250074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f625860c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6250101f90 0x7f6250073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f625860c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6250102930 0x7f62500736c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f625860c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6250073e60 con 0x7f6250102930 2023-12-01T01:04:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f625860c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6250073fd0 con 0x7f6250100da0 2023-12-01T01:04:11.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f625860c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62501a0be0 con 0x7f6250101f90 2023-12-01T01:04:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f6256ba9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6250102930 0x7f62500736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f6256ba9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6250102930 0x7f62500736c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54874/0 (socket says 172.21.15.26:54874) 2023-12-01T01:04:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f6256ba9700 1 -- 172.21.15.26:0/1055262572 learned_addr learned my addr 172.21.15.26:0/1055262572 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f6255ba7700 1 --2- 172.21.15.26:0/1055262572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6250101f90 0x7f6250073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f62563a8700 1 --2- 172.21.15.26:0/1055262572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6250100da0 0x7f6250074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f6256ba9700 1 -- 172.21.15.26:0/1055262572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6250101f90 msgr2=0x7f6250073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f6256ba9700 1 --2- 172.21.15.26:0/1055262572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6250101f90 0x7f6250073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f6256ba9700 1 -- 172.21.15.26:0/1055262572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6250100da0 msgr2=0x7f6250074b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f6256ba9700 1 --2- 172.21.15.26:0/1055262572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6250100da0 0x7f6250074b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.012+0000 7f6256ba9700 1 -- 172.21.15.26:0/1055262572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c0095f0 con 0x7f6250102930 2023-12-01T01:04:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.013+0000 7f6256ba9700 1 --2- 172.21.15.26:0/1055262572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6250102930 0x7f62500736c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f624800ef30 tx=0x7f624800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.013+0000 7f62477fe700 1 -- 172.21.15.26:0/1055262572 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248018070 con 0x7f6250102930 2023-12-01T01:04:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.013+0000 7f62477fe700 1 -- 172.21.15.26:0/1055262572 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f624800f040 con 0x7f6250102930 2023-12-01T01:04:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.013+0000 7f625860c700 1 -- 172.21.15.26:0/1055262572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62501a0e60 con 0x7f6250102930 2023-12-01T01:04:11.016 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.013+0000 7f62477fe700 1 -- 172.21.15.26:0/1055262572 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624800ce00 con 0x7f6250102930 2023-12-01T01:04:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.013+0000 7f625860c700 1 -- 172.21.15.26:0/1055262572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62501a1330 con 0x7f6250102930 2023-12-01T01:04:11.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.014+0000 7f625860c700 1 -- 172.21.15.26:0/1055262572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625010c740 con 0x7f6250102930 2023-12-01T01:04:11.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.015+0000 7f62477fe700 1 -- 172.21.15.26:0/1055262572 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f6248003a00 con 0x7f6250102930 2023-12-01T01:04:11.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.015+0000 7f62477fe700 1 --2- 172.21.15.26:0/1055262572 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f623c0a05a0 0x7f623c0a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:11.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.016+0000 7f62563a8700 1 --2- 172.21.15.26:0/1055262572 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f623c0a05a0 0x7f623c0a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:11.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.016+0000 7f62477fe700 1 -- 172.21.15.26:0/1055262572 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f62480cb4b0 con 0x7f6250102930 2023-12-01T01:04:11.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.016+0000 7f62563a8700 1 --2- 172.21.15.26:0/1055262572 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f623c0a05a0 0x7f623c0a2a60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6250101df0 tx=0x7f6240009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:11.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.020+0000 7f62477fe700 1 -- 172.21.15.26:0/1055262572 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f62480950f0 con 0x7f6250102930 2023-12-01T01:04:11.223 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.222+0000 7f625860c700 1 -- 172.21.15.26:0/1055262572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6250107c30 con 0x7f6250102930 2023-12-01T01:04:11.224 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.223+0000 7f62477fe700 1 -- 172.21.15.26:0/1055262572 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6248098710 con 0x7f6250102930 2023-12-01T01:04:11.224 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-12-01T01:04:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.225+0000 7f625860c700 1 -- 172.21.15.26:0/1055262572 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f623c0a05a0 msgr2=0x7f623c0a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.225+0000 7f625860c700 1 --2- 172.21.15.26:0/1055262572 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f623c0a05a0 0x7f623c0a2a60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6250101df0 tx=0x7f6240009260 comp rx=0 tx=0).stop 2023-12-01T01:04:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.225+0000 7f625860c700 1 -- 172.21.15.26:0/1055262572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6250102930 msgr2=0x7f62500736c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.225+0000 7f625860c700 1 --2- 172.21.15.26:0/1055262572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6250102930 0x7f62500736c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f624800ef30 tx=0x7f624800c3a0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.226 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.225+0000 7f625860c700 1 -- 172.21.15.26:0/1055262572 shutdown_connections 2023-12-01T01:04:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.225+0000 7f625860c700 1 --2- 172.21.15.26:0/1055262572 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f623c0a05a0 0x7f623c0a2a60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.225+0000 7f625860c700 1 --2- 172.21.15.26:0/1055262572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6250102930 0x7f62500736c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.225+0000 7f625860c700 1 --2- 172.21.15.26:0/1055262572 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6250100da0 0x7f6250074b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.225+0000 7f625860c700 1 --2- 172.21.15.26:0/1055262572 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6250101f90 0x7f6250073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.225+0000 7f625860c700 1 -- 172.21.15.26:0/1055262572 >> 172.21.15.26:0/1055262572 conn(0x7f62500fc310 msgr2=0x7f62500fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.225+0000 7f625860c700 1 -- 172.21.15.26:0/1055262572 shutdown_connections 2023-12-01T01:04:11.227 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.225+0000 7f625860c700 1 -- 172.21.15.26:0/1055262572 wait complete. 2023-12-01T01:04:11.239 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T01:04:11.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.367+0000 7f0ae590a700 1 -- 172.21.15.26:0/2930477654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae0101890 msgr2=0x7f0ae0103c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:11.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.367+0000 7f0ae590a700 1 --2- 172.21.15.26:0/2930477654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae0101890 0x7f0ae0103c80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009990 tx=0x7f0ad0009ca0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.367+0000 7f0ae590a700 1 -- 172.21.15.26:0/2930477654 shutdown_connections 2023-12-01T01:04:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.367+0000 7f0ae590a700 1 --2- 172.21.15.26:0/2930477654 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae0106af0 0x7f0ae0108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.367+0000 7f0ae590a700 1 --2- 172.21.15.26:0/2930477654 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae0101890 0x7f0ae0103c80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.367+0000 7f0ae590a700 1 --2- 172.21.15.26:0/2930477654 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae01041c0 0x7f0ae01065b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.367+0000 7f0ae590a700 1 -- 172.21.15.26:0/2930477654 >> 172.21.15.26:0/2930477654 conn(0x7f0ae00fb220 msgr2=0x7f0ae00fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.367+0000 7f0ae590a700 1 -- 172.21.15.26:0/2930477654 shutdown_connections 2023-12-01T01:04:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.367+0000 7f0ae590a700 1 -- 172.21.15.26:0/2930477654 wait complete. 2023-12-01T01:04:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.367+0000 7f0ae590a700 1 Processor -- start 2023-12-01T01:04:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0ae590a700 1 -- start start 2023-12-01T01:04:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0ae590a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae0101890 0x7f0ae0196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0ae590a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae01041c0 0x7f0ae01970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0ae590a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae0106af0 0x7f0ae019e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0ae590a700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae019e700 con 0x7f0ae0106af0 2023-12-01T01:04:11.371 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0ae590a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae019e840 con 0x7f0ae01041c0 2023-12-01T01:04:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0ae590a700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae019e9d0 con 0x7f0ae0101890 2023-12-01T01:04:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0adf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae0106af0 0x7f0ae019e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0adf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae0106af0 0x7f0ae019e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54888/0 (socket says 172.21.15.26:54888) 2023-12-01T01:04:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0adf7fe700 1 -- 172.21.15.26:0/894263338 learned_addr learned my addr 172.21.15.26:0/894263338 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0adeffd700 1 --2- 172.21.15.26:0/894263338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae0101890 0x7f0ae0196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0ade7fc700 1 --2- 172.21.15.26:0/894263338 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae01041c0 0x7f0ae01970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0adf7fe700 1 -- 172.21.15.26:0/894263338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae0101890 msgr2=0x7f0ae0196b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0adf7fe700 1 --2- 172.21.15.26:0/894263338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae0101890 0x7f0ae0196b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0adf7fe700 1 -- 172.21.15.26:0/894263338 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae01041c0 msgr2=0x7f0ae01970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0adf7fe700 1 --2- 172.21.15.26:0/894263338 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae01041c0 0x7f0ae01970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.368+0000 7f0adf7fe700 1 -- 172.21.15.26:0/894263338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad00095f0 con 0x7f0ae0106af0 2023-12-01T01:04:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.369+0000 7f0adf7fe700 1 --2- 172.21.15.26:0/894263338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae0106af0 0x7f0ae019e130 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800ef30 tx=0x7f0ad800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.369+0000 7f0ae4908700 1 -- 172.21.15.26:0/894263338 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8018070 con 0x7f0ae0106af0 2023-12-01T01:04:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.369+0000 7f0ae590a700 1 -- 172.21.15.26:0/894263338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae019ec50 con 0x7f0ae0106af0 2023-12-01T01:04:11.372 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.369+0000 7f0ae4908700 1 -- 172.21.15.26:0/894263338 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0ad800f040 con 0x7f0ae0106af0 2023-12-01T01:04:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.369+0000 7f0ae4908700 1 -- 172.21.15.26:0/894263338 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad800cd50 con 0x7f0ae0106af0 2023-12-01T01:04:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.369+0000 7f0ae590a700 1 -- 172.21.15.26:0/894263338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae019f160 con 0x7f0ae0106af0 2023-12-01T01:04:11.373 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.370+0000 7f0ae590a700 1 -- 172.21.15.26:0/894263338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae00fcda0 con 0x7f0ae0106af0 2023-12-01T01:04:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.371+0000 7f0ae4908700 1 -- 172.21.15.26:0/894263338 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f0ad8003a00 con 0x7f0ae0106af0 2023-12-01T01:04:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.372+0000 7f0ae4908700 1 --2- 172.21.15.26:0/894263338 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0acc0a0520 0x7f0acc0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.372+0000 7f0ae4908700 1 -- 172.21.15.26:0/894263338 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0ad80cbe70 con 0x7f0ae0106af0 2023-12-01T01:04:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.372+0000 7f0adeffd700 1 --2- 172.21.15.26:0/894263338 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0acc0a0520 0x7f0acc0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:11.374 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.373+0000 7f0adeffd700 1 --2- 172.21.15.26:0/894263338 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0acc0a0520 0x7f0acc0a29e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000b2e0 tx=0x7f0ad0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:11.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.376+0000 7f0ae4908700 1 -- 172.21.15.26:0/894263338 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0ad8095a50 con 0x7f0ae0106af0 2023-12-01T01:04:11.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.579+0000 7f0ae590a700 1 -- 172.21.15.26:0/894263338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ae002ce00 con 0x7f0ae0106af0 2023-12-01T01:04:11.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.579+0000 7f0ae4908700 1 -- 172.21.15.26:0/894263338 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ad8099070 con 0x7f0ae0106af0 2023-12-01T01:04:11.580 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-12-01T01:04:11.582 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.581+0000 7f0ae590a700 1 -- 172.21.15.26:0/894263338 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0acc0a0520 msgr2=0x7f0acc0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:11.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.581+0000 7f0ae590a700 1 --2- 172.21.15.26:0/894263338 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0acc0a0520 0x7f0acc0a29e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0ad000b2e0 tx=0x7f0ad0005fb0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.581+0000 7f0ae590a700 1 -- 172.21.15.26:0/894263338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae0106af0 msgr2=0x7f0ae019e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:11.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.581+0000 7f0ae590a700 1 --2- 172.21.15.26:0/894263338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae0106af0 0x7f0ae019e130 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800ef30 tx=0x7f0ad800c3a0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.581+0000 7f0ae590a700 1 -- 172.21.15.26:0/894263338 shutdown_connections 2023-12-01T01:04:11.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.581+0000 7f0ae590a700 1 --2- 172.21.15.26:0/894263338 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0acc0a0520 0x7f0acc0a29e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.581+0000 7f0ae590a700 1 --2- 172.21.15.26:0/894263338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0ae0106af0 0x7f0ae019e130 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.581+0000 7f0ae590a700 1 --2- 172.21.15.26:0/894263338 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0ae0101890 0x7f0ae0196b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.581+0000 7f0ae590a700 1 --2- 172.21.15.26:0/894263338 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0ae01041c0 0x7f0ae01970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.581+0000 7f0ae590a700 1 -- 172.21.15.26:0/894263338 >> 172.21.15.26:0/894263338 conn(0x7f0ae00fb220 msgr2=0x7f0ae01025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:11.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.582+0000 7f0ae590a700 1 -- 172.21.15.26:0/894263338 shutdown_connections 2023-12-01T01:04:11.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.582+0000 7f0ae590a700 1 -- 172.21.15.26:0/894263338 wait complete. 2023-12-01T01:04:11.595 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T01:04:11.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.723+0000 7fb45a5b3700 1 -- 172.21.15.26:0/2701410239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb454108c70 msgr2=0x7fb45410b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:11.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.723+0000 7fb45a5b3700 1 --2- 172.21.15.26:0/2701410239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb454108c70 0x7fb45410b100 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb44c00b0a0 tx=0x7fb44c00b3b0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.723+0000 7fb45a5b3700 1 -- 172.21.15.26:0/2701410239 shutdown_connections 2023-12-01T01:04:11.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.723+0000 7fb45a5b3700 1 --2- 172.21.15.26:0/2701410239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb454108c70 0x7fb45410b100 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.723+0000 7fb45a5b3700 1 --2- 172.21.15.26:0/2701410239 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb454074d50 0x7fb4540731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.723+0000 7fb45a5b3700 1 --2- 172.21.15.26:0/2701410239 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb454073770 0x7fb454073bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.723+0000 7fb45a5b3700 1 -- 172.21.15.26:0/2701410239 >> 172.21.15.26:0/2701410239 conn(0x7fb4540fc310 msgr2=0x7fb4540fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:11.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.723+0000 7fb45a5b3700 1 -- 172.21.15.26:0/2701410239 shutdown_connections 2023-12-01T01:04:11.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.723+0000 7fb45a5b3700 1 -- 172.21.15.26:0/2701410239 wait complete. 2023-12-01T01:04:11.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.724+0000 7fb45a5b3700 1 Processor -- start 2023-12-01T01:04:11.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.724+0000 7fb45a5b3700 1 -- start start 2023-12-01T01:04:11.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.724+0000 7fb45a5b3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb454073770 0x7fb454198e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:11.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.724+0000 7fb45a5b3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb454074d50 0x7fb4541993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:11.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.724+0000 7fb45a5b3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb454108c70 0x7fb4541a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:11.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.724+0000 7fb45a5b3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4541a09f0 con 0x7fb454074d50 2023-12-01T01:04:11.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.724+0000 7fb45a5b3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4541a0b30 con 0x7fb454108c70 2023-12-01T01:04:11.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.724+0000 7fb45a5b3700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4541a0cc0 con 0x7fb454073770 2023-12-01T01:04:11.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.724+0000 7fb4537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb454074d50 0x7fb4541993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:11.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.724+0000 7fb4537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb454074d50 0x7fb4541993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54908/0 (socket says 172.21.15.26:54908) 2023-12-01T01:04:11.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.725+0000 7fb4537fe700 1 -- 172.21.15.26:0/3621681537 learned_addr learned my addr 172.21.15.26:0/3621681537 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.725+0000 7fb458b50700 1 --2- 172.21.15.26:0/3621681537 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb454108c70 0x7fb4541a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.725+0000 7fb453fff700 1 --2- 172.21.15.26:0/3621681537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb454073770 0x7fb454198e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.725+0000 7fb4537fe700 1 -- 172.21.15.26:0/3621681537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb454073770 msgr2=0x7fb454198e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.725+0000 7fb4537fe700 1 --2- 172.21.15.26:0/3621681537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb454073770 0x7fb454198e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.725+0000 7fb4537fe700 1 -- 172.21.15.26:0/3621681537 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb454108c70 msgr2=0x7fb4541a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.725+0000 7fb4537fe700 1 --2- 172.21.15.26:0/3621681537 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb454108c70 0x7fb4541a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.725+0000 7fb4537fe700 1 -- 172.21.15.26:0/3621681537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c009d00 con 0x7fb454074d50 2023-12-01T01:04:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.725+0000 7fb4537fe700 1 --2- 172.21.15.26:0/3621681537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb454074d50 0x7fb4541993b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb44800d950 tx=0x7fb44800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.725+0000 7fb4517fa700 1 -- 172.21.15.26:0/3621681537 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44800f890 con 0x7fb454074d50 2023-12-01T01:04:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.725+0000 7fb4517fa700 1 -- 172.21.15.26:0/3621681537 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb448010460 con 0x7fb454074d50 2023-12-01T01:04:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.725+0000 7fb4517fa700 1 -- 172.21.15.26:0/3621681537 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44800e610 con 0x7fb454074d50 2023-12-01T01:04:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.725+0000 7fb45a5b3700 1 -- 172.21.15.26:0/3621681537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4541a0fa0 con 0x7fb454074d50 2023-12-01T01:04:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.725+0000 7fb45a5b3700 1 -- 172.21.15.26:0/3621681537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4541a1420 con 0x7fb454074d50 2023-12-01T01:04:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.726+0000 7fb45a5b3700 1 -- 172.21.15.26:0/3621681537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb454107370 con 0x7fb454074d50 2023-12-01T01:04:11.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.727+0000 7fb4517fa700 1 -- 172.21.15.26:0/3621681537 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fb448010960 con 0x7fb454074d50 2023-12-01T01:04:11.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.728+0000 7fb4517fa700 1 --2- 172.21.15.26:0/3621681537 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb43c0a05a0 0x7fb43c0a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:11.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.728+0000 7fb453fff700 1 --2- 172.21.15.26:0/3621681537 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb43c0a05a0 0x7fb43c0a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:11.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.728+0000 7fb4517fa700 1 -- 172.21.15.26:0/3621681537 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb4480cb690 con 0x7fb454074d50 2023-12-01T01:04:11.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.729+0000 7fb453fff700 1 --2- 172.21.15.26:0/3621681537 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb43c0a05a0 0x7fb43c0a2a60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb444005950 tx=0x7fb44400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:11.732 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.732+0000 7fb4517fa700 1 -- 172.21.15.26:0/3621681537 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb448095240 con 0x7fb454074d50 2023-12-01T01:04:11.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.937+0000 7fb45a5b3700 1 -- 172.21.15.26:0/3621681537 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb45402cec0 con 0x7fb454074d50 2023-12-01T01:04:11.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.937+0000 7fb4517fa700 1 -- 172.21.15.26:0/3621681537 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4480200a0 con 0x7fb454074d50 2023-12-01T01:04:11.938 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-12-01T01:04:11.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.939+0000 7fb45a5b3700 1 -- 172.21.15.26:0/3621681537 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb43c0a05a0 msgr2=0x7fb43c0a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:11.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.939+0000 7fb45a5b3700 1 --2- 172.21.15.26:0/3621681537 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb43c0a05a0 0x7fb43c0a2a60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb444005950 tx=0x7fb44400b410 comp rx=0 tx=0).stop 2023-12-01T01:04:11.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.939+0000 7fb45a5b3700 1 -- 172.21.15.26:0/3621681537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb454074d50 msgr2=0x7fb4541993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:11.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.939+0000 7fb45a5b3700 1 --2- 172.21.15.26:0/3621681537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb454074d50 0x7fb4541993b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb44800d950 tx=0x7fb44800dc60 comp rx=0 tx=0).stop 2023-12-01T01:04:11.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.939+0000 7fb45a5b3700 1 -- 172.21.15.26:0/3621681537 shutdown_connections 2023-12-01T01:04:11.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.939+0000 7fb45a5b3700 1 --2- 172.21.15.26:0/3621681537 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb43c0a05a0 0x7fb43c0a2a60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.939+0000 7fb45a5b3700 1 --2- 172.21.15.26:0/3621681537 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb454108c70 0x7fb4541a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.939+0000 7fb45a5b3700 1 --2- 172.21.15.26:0/3621681537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb454073770 0x7fb454198e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.939+0000 7fb45a5b3700 1 --2- 172.21.15.26:0/3621681537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb454074d50 0x7fb4541993b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:11.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.939+0000 7fb45a5b3700 1 -- 172.21.15.26:0/3621681537 >> 172.21.15.26:0/3621681537 conn(0x7fb4540fc310 msgr2=0x7fb4540fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:11.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.940+0000 7fb45a5b3700 1 -- 172.21.15.26:0/3621681537 shutdown_connections 2023-12-01T01:04:11.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:11.940+0000 7fb45a5b3700 1 -- 172.21.15.26:0/3621681537 wait complete. 2023-12-01T01:04:11.952 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:11 smithi026 ceph-mon[98801]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-01T01:04:11.952 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:11 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2105064665' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:11.952 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:11 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1055262572' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:04:11.952 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:11 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/894263338' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:04:11.953 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:04:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.078+0000 7f1c85ef5700 1 -- 172.21.15.26:0/1942290986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c80100e60 msgr2=0x7f1c801012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.078+0000 7f1c85ef5700 1 --2- 172.21.15.26:0/1942290986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c80100e60 0x7f1c801012c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1c740099c0 tx=0x7f1c74009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.078+0000 7f1c85ef5700 1 -- 172.21.15.26:0/1942290986 shutdown_connections 2023-12-01T01:04:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.078+0000 7f1c85ef5700 1 --2- 172.21.15.26:0/1942290986 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c80101800 0x7f1c801080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.078+0000 7f1c85ef5700 1 --2- 172.21.15.26:0/1942290986 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c800ffc70 0x7f1c80100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.078+0000 7f1c85ef5700 1 --2- 172.21.15.26:0/1942290986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c80100e60 0x7f1c801012c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.078+0000 7f1c85ef5700 1 -- 172.21.15.26:0/1942290986 >> 172.21.15.26:0/1942290986 conn(0x7f1c800fb1c0 msgr2=0x7f1c800fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.078+0000 7f1c85ef5700 1 -- 172.21.15.26:0/1942290986 shutdown_connections 2023-12-01T01:04:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.078+0000 7f1c85ef5700 1 -- 172.21.15.26:0/1942290986 wait complete. 2023-12-01T01:04:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.079+0000 7f1c85ef5700 1 Processor -- start 2023-12-01T01:04:12.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.079+0000 7f1c85ef5700 1 -- start start 2023-12-01T01:04:12.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.079+0000 7f1c85ef5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c800ffc70 0x7f1c80196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:12.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.079+0000 7f1c85ef5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c80100e60 0x7f1c80197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.079+0000 7f1c85ef5700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c80101800 0x7f1c8019e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.079+0000 7f1c85ef5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8019e6a0 con 0x7f1c800ffc70 2023-12-01T01:04:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.079+0000 7f1c85ef5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8019e7e0 con 0x7f1c80100e60 2023-12-01T01:04:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.079+0000 7f1c85ef5700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8019e970 con 0x7f1c80101800 2023-12-01T01:04:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.079+0000 7f1c7f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c800ffc70 0x7f1c80196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.079+0000 7f1c7f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c800ffc70 0x7f1c80196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54920/0 (socket says 172.21.15.26:54920) 2023-12-01T01:04:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.079+0000 7f1c7f7fe700 1 -- 172.21.15.26:0/4163882628 learned_addr learned my addr 172.21.15.26:0/4163882628 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.079+0000 7f1c7effd700 1 --2- 172.21.15.26:0/4163882628 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c80100e60 0x7f1c80197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.080+0000 7f1c7ffff700 1 --2- 172.21.15.26:0/4163882628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c80101800 0x7f1c8019e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.080+0000 7f1c7f7fe700 1 -- 172.21.15.26:0/4163882628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c80101800 msgr2=0x7f1c8019e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.080+0000 7f1c7f7fe700 1 --2- 172.21.15.26:0/4163882628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c80101800 0x7f1c8019e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.080+0000 7f1c7f7fe700 1 -- 172.21.15.26:0/4163882628 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c80100e60 msgr2=0x7f1c80197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.080+0000 7f1c7f7fe700 1 --2- 172.21.15.26:0/4163882628 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c80100e60 0x7f1c80197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.080+0000 7f1c7f7fe700 1 -- 172.21.15.26:0/4163882628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c740095f0 con 0x7f1c800ffc70 2023-12-01T01:04:12.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.080+0000 7f1c7ffff700 1 --2- 172.21.15.26:0/4163882628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c80101800 0x7f1c8019e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:12.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.080+0000 7f1c7f7fe700 1 --2- 172.21.15.26:0/4163882628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c800ffc70 0x7f1c80196b20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000d980 tx=0x7f1c7000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:12.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.080+0000 7f1c7cff9700 1 -- 172.21.15.26:0/4163882628 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70004020 con 0x7f1c800ffc70 2023-12-01T01:04:12.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.080+0000 7f1c7cff9700 1 -- 172.21.15.26:0/4163882628 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1c70009730 con 0x7f1c800ffc70 2023-12-01T01:04:12.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.080+0000 7f1c85ef5700 1 -- 172.21.15.26:0/4163882628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8019ec50 con 0x7f1c800ffc70 2023-12-01T01:04:12.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.080+0000 7f1c7cff9700 1 -- 172.21.15.26:0/4163882628 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70003be0 con 0x7f1c800ffc70 2023-12-01T01:04:12.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.080+0000 7f1c85ef5700 1 -- 172.21.15.26:0/4163882628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8019f160 con 0x7f1c800ffc70 2023-12-01T01:04:12.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.081+0000 7f1c85ef5700 1 -- 172.21.15.26:0/4163882628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c80107d00 con 0x7f1c800ffc70 2023-12-01T01:04:12.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.082+0000 7f1c7cff9700 1 -- 172.21.15.26:0/4163882628 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f1c70009ba0 con 0x7f1c800ffc70 2023-12-01T01:04:12.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.083+0000 7f1c7cff9700 1 --2- 172.21.15.26:0/4163882628 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1c680a0570 0x7f1c680a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:12.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.083+0000 7f1c7effd700 1 --2- 172.21.15.26:0/4163882628 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1c680a0570 0x7f1c680a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:12.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.083+0000 7f1c7cff9700 1 -- 172.21.15.26:0/4163882628 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1c700cb660 con 0x7f1c800ffc70 2023-12-01T01:04:12.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.083+0000 7f1c7effd700 1 --2- 172.21.15.26:0/4163882628 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1c680a0570 0x7f1c680a2a30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1c74006010 tx=0x7f1c74005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:12.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.087+0000 7f1c7cff9700 1 -- 172.21.15.26:0/4163882628 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1c700951b0 con 0x7f1c800ffc70 2023-12-01T01:04:12.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:11 smithi116 ceph-mon[103554]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-01T01:04:12.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:11 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2105064665' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:12.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:11 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1055262572' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:04:12.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:11 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/894263338' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:04:12.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:11 smithi093 ceph-mon[103327]: pgmap v289: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-01T01:04:12.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:11 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2105064665' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:12.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:11 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1055262572' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:04:12.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:11 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/894263338' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:04:12.293 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.292+0000 7f1c85ef5700 1 -- 172.21.15.26:0/4163882628 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c8002cc70 con 0x7f1c800ffc70 2023-12-01T01:04:12.294 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.294+0000 7f1c7cff9700 1 -- 172.21.15.26:0/4163882628 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22481 (secure 0 0 0) 0x7f1c700987d0 con 0x7f1c800ffc70 2023-12-01T01:04:12.295 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:04:12.295 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":83,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:59.627676+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:04:12.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.296+0000 7f1c85ef5700 1 -- 172.21.15.26:0/4163882628 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1c680a0570 msgr2=0x7f1c680a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:12.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.296+0000 7f1c85ef5700 1 --2- 172.21.15.26:0/4163882628 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1c680a0570 0x7f1c680a2a30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1c74006010 tx=0x7f1c74005a90 comp rx=0 tx=0).stop 2023-12-01T01:04:12.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.296+0000 7f1c85ef5700 1 -- 172.21.15.26:0/4163882628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c800ffc70 msgr2=0x7f1c80196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:12.297 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.296+0000 7f1c85ef5700 1 --2- 172.21.15.26:0/4163882628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c800ffc70 0x7f1c80196b20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000d980 tx=0x7f1c7000dc90 comp rx=0 tx=0).stop 2023-12-01T01:04:12.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.296+0000 7f1c85ef5700 1 -- 172.21.15.26:0/4163882628 shutdown_connections 2023-12-01T01:04:12.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.296+0000 7f1c85ef5700 1 --2- 172.21.15.26:0/4163882628 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1c680a0570 0x7f1c680a2a30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.296+0000 7f1c85ef5700 1 --2- 172.21.15.26:0/4163882628 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1c80101800 0x7f1c8019e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.296+0000 7f1c85ef5700 1 --2- 172.21.15.26:0/4163882628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1c800ffc70 0x7f1c80196b20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.296+0000 7f1c85ef5700 1 --2- 172.21.15.26:0/4163882628 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1c80100e60 0x7f1c80197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.296+0000 7f1c85ef5700 1 -- 172.21.15.26:0/4163882628 >> 172.21.15.26:0/4163882628 conn(0x7f1c800fb1c0 msgr2=0x7f1c800fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:12.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.296+0000 7f1c85ef5700 1 -- 172.21.15.26:0/4163882628 shutdown_connections 2023-12-01T01:04:12.298 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.296+0000 7f1c85ef5700 1 -- 172.21.15.26:0/4163882628 wait complete. 2023-12-01T01:04:12.311 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T00:59:06.411348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T01:02:45.762784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T01:02:46.638998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T01:04:12.311 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T01:04:12.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.439+0000 7f1f57910700 1 -- 172.21.15.26:0/3375641095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f50101830 msgr2=0x7f1f50103c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:12.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.439+0000 7f1f57910700 1 --2- 172.21.15.26:0/3375641095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f50101830 0x7f1f50103c20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1f40009990 tx=0x7f1f40009ca0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.439+0000 7f1f57910700 1 -- 172.21.15.26:0/3375641095 shutdown_connections 2023-12-01T01:04:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.439+0000 7f1f57910700 1 --2- 172.21.15.26:0/3375641095 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f50106a90 0x7f1f50108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.439+0000 7f1f57910700 1 --2- 172.21.15.26:0/3375641095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f50101830 0x7f1f50103c20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.439+0000 7f1f57910700 1 --2- 172.21.15.26:0/3375641095 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f50104160 0x7f1f50106550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.439+0000 7f1f57910700 1 -- 172.21.15.26:0/3375641095 >> 172.21.15.26:0/3375641095 conn(0x7f1f500fb220 msgr2=0x7f1f500fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.439+0000 7f1f57910700 1 -- 172.21.15.26:0/3375641095 shutdown_connections 2023-12-01T01:04:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.439+0000 7f1f57910700 1 -- 172.21.15.26:0/3375641095 wait complete. 2023-12-01T01:04:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.440+0000 7f1f57910700 1 Processor -- start 2023-12-01T01:04:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.440+0000 7f1f57910700 1 -- start start 2023-12-01T01:04:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.440+0000 7f1f57910700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f50101830 0x7f1f50196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.440+0000 7f1f57910700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f50104160 0x7f1f50197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.440+0000 7f1f57910700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f50106a90 0x7f1f5019e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.440+0000 7f1f57910700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5019e740 con 0x7f1f50106a90 2023-12-01T01:04:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.440+0000 7f1f57910700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5019e880 con 0x7f1f50101830 2023-12-01T01:04:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.440+0000 7f1f57910700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5019ea10 con 0x7f1f50104160 2023-12-01T01:04:12.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.440+0000 7f1f55ead700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f50106a90 0x7f1f5019e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:12.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.440+0000 7f1f55ead700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f50106a90 0x7f1f5019e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54938/0 (socket says 172.21.15.26:54938) 2023-12-01T01:04:12.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.440+0000 7f1f55ead700 1 -- 172.21.15.26:0/1174825874 learned_addr learned my addr 172.21.15.26:0/1174825874 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:12.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.440+0000 7f1f556ac700 1 --2- 172.21.15.26:0/1174825874 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f50101830 0x7f1f50196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:12.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.440+0000 7f1f54eab700 1 --2- 172.21.15.26:0/1174825874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f50104160 0x7f1f50197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:12.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.441+0000 7f1f55ead700 1 -- 172.21.15.26:0/1174825874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f50104160 msgr2=0x7f1f50197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:12.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.441+0000 7f1f55ead700 1 --2- 172.21.15.26:0/1174825874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f50104160 0x7f1f50197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.441+0000 7f1f55ead700 1 -- 172.21.15.26:0/1174825874 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f50101830 msgr2=0x7f1f50196bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:12.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.441+0000 7f1f55ead700 1 --2- 172.21.15.26:0/1174825874 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f50101830 0x7f1f50196bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.441+0000 7f1f55ead700 1 -- 172.21.15.26:0/1174825874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f400095f0 con 0x7f1f50106a90 2023-12-01T01:04:12.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.441+0000 7f1f55ead700 1 --2- 172.21.15.26:0/1174825874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f50106a90 0x7f1f5019e170 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800b970 tx=0x7f1f4800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:12.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.441+0000 7f1f467fc700 1 -- 172.21.15.26:0/1174825874 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4800c930 con 0x7f1f50106a90 2023-12-01T01:04:12.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.441+0000 7f1f57910700 1 -- 172.21.15.26:0/1174825874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5019ecf0 con 0x7f1f50106a90 2023-12-01T01:04:12.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.441+0000 7f1f467fc700 1 -- 172.21.15.26:0/1174825874 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1f48014440 con 0x7f1f50106a90 2023-12-01T01:04:12.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.441+0000 7f1f467fc700 1 -- 172.21.15.26:0/1174825874 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f480075d0 con 0x7f1f50106a90 2023-12-01T01:04:12.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.441+0000 7f1f57910700 1 -- 172.21.15.26:0/1174825874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5019f1b0 con 0x7f1f50106a90 2023-12-01T01:04:12.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.442+0000 7f1f57910700 1 -- 172.21.15.26:0/1174825874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f500fcda0 con 0x7f1f50106a90 2023-12-01T01:04:12.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.443+0000 7f1f467fc700 1 -- 172.21.15.26:0/1174825874 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f1f480145b0 con 0x7f1f50106a90 2023-12-01T01:04:12.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.443+0000 7f1f467fc700 1 --2- 172.21.15.26:0/1174825874 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1f3c0a0520 0x7f1f3c0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:12.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.444+0000 7f1f467fc700 1 -- 172.21.15.26:0/1174825874 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1f480cb250 con 0x7f1f50106a90 2023-12-01T01:04:12.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.444+0000 7f1f556ac700 1 --2- 172.21.15.26:0/1174825874 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1f3c0a0520 0x7f1f3c0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:12.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.444+0000 7f1f556ac700 1 --2- 172.21.15.26:0/1174825874 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1f3c0a0520 0x7f1f3c0a29e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1f40003790 tx=0x7f1f40005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:12.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.447+0000 7f1f467fc700 1 -- 172.21.15.26:0/1174825874 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1f48094e00 con 0x7f1f50106a90 2023-12-01T01:04:12.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.645+0000 7f1f57910700 1 -- 172.21.15.26:0/1174825874 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f5002ce00 con 0x7f1f50106a90 2023-12-01T01:04:12.648 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.646+0000 7f1f467fc700 1 -- 172.21.15.26:0/1174825874 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f48023020 con 0x7f1f50106a90 2023-12-01T01:04:12.648 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-12-01T01:04:12.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.648+0000 7f1f57910700 1 -- 172.21.15.26:0/1174825874 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1f3c0a0520 msgr2=0x7f1f3c0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:12.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.648+0000 7f1f57910700 1 --2- 172.21.15.26:0/1174825874 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1f3c0a0520 0x7f1f3c0a29e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1f40003790 tx=0x7f1f40005fd0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.649 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.648+0000 7f1f57910700 1 -- 172.21.15.26:0/1174825874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f50106a90 msgr2=0x7f1f5019e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:12.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.648+0000 7f1f57910700 1 --2- 172.21.15.26:0/1174825874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f50106a90 0x7f1f5019e170 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1f4800b970 tx=0x7f1f4800bc80 comp rx=0 tx=0).stop 2023-12-01T01:04:12.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.648+0000 7f1f57910700 1 -- 172.21.15.26:0/1174825874 shutdown_connections 2023-12-01T01:04:12.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.648+0000 7f1f57910700 1 --2- 172.21.15.26:0/1174825874 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1f3c0a0520 0x7f1f3c0a29e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.648+0000 7f1f57910700 1 --2- 172.21.15.26:0/1174825874 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1f50106a90 0x7f1f5019e170 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.648+0000 7f1f57910700 1 --2- 172.21.15.26:0/1174825874 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1f50101830 0x7f1f50196bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.648+0000 7f1f57910700 1 --2- 172.21.15.26:0/1174825874 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1f50104160 0x7f1f50197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.648+0000 7f1f57910700 1 -- 172.21.15.26:0/1174825874 >> 172.21.15.26:0/1174825874 conn(0x7f1f500fb220 msgr2=0x7f1f501024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:12.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.648+0000 7f1f57910700 1 -- 172.21.15.26:0/1174825874 shutdown_connections 2023-12-01T01:04:12.650 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.648+0000 7f1f57910700 1 -- 172.21.15.26:0/1174825874 wait complete. 2023-12-01T01:04:12.662 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T01:04:12.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.797+0000 7f089b8c3700 1 -- 172.21.15.26:0/3780972501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0894100e70 msgr2=0x7f08941012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:12.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.797+0000 7f089b8c3700 1 --2- 172.21.15.26:0/3780972501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0894100e70 0x7f08941012d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f08900099c0 tx=0x7f0890009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.797+0000 7f089b8c3700 1 -- 172.21.15.26:0/3780972501 shutdown_connections 2023-12-01T01:04:12.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.797+0000 7f089b8c3700 1 --2- 172.21.15.26:0/3780972501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0894101810 0x7f08941080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.797+0000 7f089b8c3700 1 --2- 172.21.15.26:0/3780972501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08940ffc80 0x7f08941000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.797+0000 7f089b8c3700 1 --2- 172.21.15.26:0/3780972501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0894100e70 0x7f08941012d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.797+0000 7f089b8c3700 1 -- 172.21.15.26:0/3780972501 >> 172.21.15.26:0/3780972501 conn(0x7f08940fb1f0 msgr2=0x7f08940fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:12.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.797+0000 7f089b8c3700 1 -- 172.21.15.26:0/3780972501 shutdown_connections 2023-12-01T01:04:12.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.797+0000 7f089b8c3700 1 -- 172.21.15.26:0/3780972501 wait complete. 2023-12-01T01:04:12.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f089b8c3700 1 Processor -- start 2023-12-01T01:04:12.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f089b8c3700 1 -- start start 2023-12-01T01:04:12.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f089b8c3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08940ffc80 0x7f0894068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:12.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f089b8c3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0894100e70 0x7f089419b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:12.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f089b8c3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0894101810 0x7f089419de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:12.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f089b8c3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089419e5c0 con 0x7f0894101810 2023-12-01T01:04:12.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f089b8c3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089419e730 con 0x7f08940ffc80 2023-12-01T01:04:12.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f089b8c3700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089419e8f0 con 0x7f0894100e70 2023-12-01T01:04:12.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f0899e60700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0894101810 0x7f089419de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:12.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f0899e60700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0894101810 0x7f089419de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54952/0 (socket says 172.21.15.26:54952) 2023-12-01T01:04:12.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f0899e60700 1 -- 172.21.15.26:0/3782581402 learned_addr learned my addr 172.21.15.26:0/3782581402 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:12.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f0898e5e700 1 --2- 172.21.15.26:0/3782581402 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0894100e70 0x7f089419b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:12.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f089965f700 1 --2- 172.21.15.26:0/3782581402 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08940ffc80 0x7f0894068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:12.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f0899e60700 1 -- 172.21.15.26:0/3782581402 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0894100e70 msgr2=0x7f089419b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:12.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f0899e60700 1 --2- 172.21.15.26:0/3782581402 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0894100e70 0x7f089419b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f0899e60700 1 -- 172.21.15.26:0/3782581402 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08940ffc80 msgr2=0x7f0894068a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:12.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f0899e60700 1 --2- 172.21.15.26:0/3782581402 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08940ffc80 0x7f0894068a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:12.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f0899e60700 1 -- 172.21.15.26:0/3782581402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08900095f0 con 0x7f0894101810 2023-12-01T01:04:12.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f0898e5e700 1 --2- 172.21.15.26:0/3782581402 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0894100e70 0x7f089419b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:12.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.798+0000 7f0899e60700 1 --2- 172.21.15.26:0/3782581402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0894101810 0x7f089419de20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f088c007ee0 tx=0x7f088c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:12.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.799+0000 7f08867fc700 1 -- 172.21.15.26:0/3782581402 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c017070 con 0x7f0894101810 2023-12-01T01:04:12.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.799+0000 7f089b8c3700 1 -- 172.21.15.26:0/3782581402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f089419ebd0 con 0x7f0894101810 2023-12-01T01:04:12.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.799+0000 7f08867fc700 1 -- 172.21.15.26:0/3782581402 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f088c00f040 con 0x7f0894101810 2023-12-01T01:04:12.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.799+0000 7f08867fc700 1 -- 172.21.15.26:0/3782581402 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c005740 con 0x7f0894101810 2023-12-01T01:04:12.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.799+0000 7f089b8c3700 1 -- 172.21.15.26:0/3782581402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f089419f090 con 0x7f0894101810 2023-12-01T01:04:12.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.800+0000 7f089b8c3700 1 -- 172.21.15.26:0/3782581402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0894106b10 con 0x7f0894101810 2023-12-01T01:04:12.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.801+0000 7f08867fc700 1 -- 172.21.15.26:0/3782581402 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f088c0058e0 con 0x7f0894101810 2023-12-01T01:04:12.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.801+0000 7f08867fc700 1 --2- 172.21.15.26:0/3782581402 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f08800a0520 0x7f08800a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:12.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.802+0000 7f08867fc700 1 -- 172.21.15.26:0/3782581402 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f088c0cb1a0 con 0x7f0894101810 2023-12-01T01:04:12.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.802+0000 7f089965f700 1 --2- 172.21.15.26:0/3782581402 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f08800a0520 0x7f08800a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:12.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.802+0000 7f089965f700 1 --2- 172.21.15.26:0/3782581402 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f08800a0520 0x7f08800a29e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0894100cd0 tx=0x7f0888005d70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:12.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:12.806+0000 7f08867fc700 1 -- 172.21.15.26:0/3782581402 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f088c094d50 con 0x7f0894101810 2023-12-01T01:04:13.011 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.010+0000 7f089b8c3700 1 -- 172.21.15.26:0/3782581402 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f08940619d0 con 0x7f0894101810 2023-12-01T01:04:13.012 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.011+0000 7f08867fc700 1 -- 172.21.15.26:0/3782581402 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f088c098370 con 0x7f0894101810 2023-12-01T01:04:13.012 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-12-01T01:04:13.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.013+0000 7f089b8c3700 1 -- 172.21.15.26:0/3782581402 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f08800a0520 msgr2=0x7f08800a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:13.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.013+0000 7f089b8c3700 1 --2- 172.21.15.26:0/3782581402 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f08800a0520 0x7f08800a29e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0894100cd0 tx=0x7f0888005d70 comp rx=0 tx=0).stop 2023-12-01T01:04:13.014 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.013+0000 7f089b8c3700 1 -- 172.21.15.26:0/3782581402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0894101810 msgr2=0x7f089419de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:13.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.013+0000 7f089b8c3700 1 --2- 172.21.15.26:0/3782581402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0894101810 0x7f089419de20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f088c007ee0 tx=0x7f088c00d3b0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.013+0000 7f089b8c3700 1 -- 172.21.15.26:0/3782581402 shutdown_connections 2023-12-01T01:04:13.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.013+0000 7f089b8c3700 1 --2- 172.21.15.26:0/3782581402 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f08800a0520 0x7f08800a29e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.013+0000 7f089b8c3700 1 --2- 172.21.15.26:0/3782581402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0894101810 0x7f089419de20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.013+0000 7f089b8c3700 1 --2- 172.21.15.26:0/3782581402 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f08940ffc80 0x7f0894068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.013+0000 7f089b8c3700 1 --2- 172.21.15.26:0/3782581402 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0894100e70 0x7f089419b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.013+0000 7f089b8c3700 1 -- 172.21.15.26:0/3782581402 >> 172.21.15.26:0/3782581402 conn(0x7f08940fb1f0 msgr2=0x7f08940fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:13.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.013+0000 7f089b8c3700 1 -- 172.21.15.26:0/3782581402 shutdown_connections 2023-12-01T01:04:13.015 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.013+0000 7f089b8c3700 1 -- 172.21.15.26:0/3782581402 wait complete. 2023-12-01T01:04:13.026 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:12 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3621681537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:04:13.026 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:12 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/4163882628' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:13.026 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:12 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1174825874' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:04:13.027 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T01:04:13.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.155+0000 7fe79b437700 1 -- 172.21.15.26:0/3464992608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe794100e70 msgr2=0x7fe7941012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:13.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.155+0000 7fe79b437700 1 --2- 172.21.15.26:0/3464992608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe794100e70 0x7fe7941012d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe7900099c0 tx=0x7fe790009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.155+0000 7fe79b437700 1 -- 172.21.15.26:0/3464992608 shutdown_connections 2023-12-01T01:04:13.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.155+0000 7fe79b437700 1 --2- 172.21.15.26:0/3464992608 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe794101810 0x7fe7941080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.155+0000 7fe79b437700 1 --2- 172.21.15.26:0/3464992608 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe7940ffc80 0x7fe7941000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.155+0000 7fe79b437700 1 --2- 172.21.15.26:0/3464992608 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe794100e70 0x7fe7941012d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.155+0000 7fe79b437700 1 -- 172.21.15.26:0/3464992608 >> 172.21.15.26:0/3464992608 conn(0x7fe7940fb1f0 msgr2=0x7fe7940fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:13.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.155+0000 7fe79b437700 1 -- 172.21.15.26:0/3464992608 shutdown_connections 2023-12-01T01:04:13.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.155+0000 7fe79b437700 1 -- 172.21.15.26:0/3464992608 wait complete. 2023-12-01T01:04:13.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.156+0000 7fe79b437700 1 Processor -- start 2023-12-01T01:04:13.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.156+0000 7fe79b437700 1 -- start start 2023-12-01T01:04:13.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.156+0000 7fe79b437700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7940ffc80 0x7fe794068a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:13.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.156+0000 7fe79b437700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe794100e70 0x7fe79419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:13.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.156+0000 7fe79b437700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe794101810 0x7fe79419def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:13.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.156+0000 7fe79b437700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79419e6c0 con 0x7fe794101810 2023-12-01T01:04:13.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.156+0000 7fe79b437700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79419e830 con 0x7fe794100e70 2023-12-01T01:04:13.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.156+0000 7fe79b437700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79419e9f0 con 0x7fe7940ffc80 2023-12-01T01:04:13.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.156+0000 7fe7999d4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe794101810 0x7fe79419def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:13.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.156+0000 7fe7999d4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe794101810 0x7fe79419def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54966/0 (socket says 172.21.15.26:54966) 2023-12-01T01:04:13.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.156+0000 7fe7999d4700 1 -- 172.21.15.26:0/1512757289 learned_addr learned my addr 172.21.15.26:0/1512757289 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:13.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.156+0000 7fe7989d2700 1 --2- 172.21.15.26:0/1512757289 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe794100e70 0x7fe79419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:13.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.156+0000 7fe7991d3700 1 --2- 172.21.15.26:0/1512757289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7940ffc80 0x7fe794068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:13.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.157+0000 7fe7999d4700 1 -- 172.21.15.26:0/1512757289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7940ffc80 msgr2=0x7fe794068a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:13.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.157+0000 7fe7999d4700 1 --2- 172.21.15.26:0/1512757289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7940ffc80 0x7fe794068a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.157+0000 7fe7999d4700 1 -- 172.21.15.26:0/1512757289 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe794100e70 msgr2=0x7fe79419b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:13.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.157+0000 7fe7999d4700 1 --2- 172.21.15.26:0/1512757289 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe794100e70 0x7fe79419b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.157+0000 7fe7999d4700 1 -- 172.21.15.26:0/1512757289 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7900095f0 con 0x7fe794101810 2023-12-01T01:04:13.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.157+0000 7fe7989d2700 1 --2- 172.21.15.26:0/1512757289 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe794100e70 0x7fe79419b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:13.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.157+0000 7fe7999d4700 1 --2- 172.21.15.26:0/1512757289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe794101810 0x7fe79419def0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00ef30 tx=0x7fe78c00c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:13.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.157+0000 7fe78a7fc700 1 -- 172.21.15.26:0/1512757289 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c018070 con 0x7fe794101810 2023-12-01T01:04:13.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.157+0000 7fe78a7fc700 1 -- 172.21.15.26:0/1512757289 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe78c00f040 con 0x7fe794101810 2023-12-01T01:04:13.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.157+0000 7fe79b437700 1 -- 172.21.15.26:0/1512757289 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79419ec70 con 0x7fe794101810 2023-12-01T01:04:13.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.157+0000 7fe78a7fc700 1 -- 172.21.15.26:0/1512757289 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78c004020 con 0x7fe794101810 2023-12-01T01:04:13.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.157+0000 7fe79b437700 1 -- 172.21.15.26:0/1512757289 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79419f130 con 0x7fe794101810 2023-12-01T01:04:13.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.158+0000 7fe79b437700 1 -- 172.21.15.26:0/1512757289 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79410b5d0 con 0x7fe794101810 2023-12-01T01:04:13.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.159+0000 7fe78a7fc700 1 -- 172.21.15.26:0/1512757289 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fe78c00caa0 con 0x7fe794101810 2023-12-01T01:04:13.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.160+0000 7fe78a7fc700 1 --2- 172.21.15.26:0/1512757289 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe7800a0520 0x7fe7800a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:13.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.160+0000 7fe78a7fc700 1 -- 172.21.15.26:0/1512757289 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe78c0cbf50 con 0x7fe794101810 2023-12-01T01:04:13.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.160+0000 7fe7991d3700 1 --2- 172.21.15.26:0/1512757289 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe7800a0520 0x7fe7800a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:13.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.160+0000 7fe7991d3700 1 --2- 172.21.15.26:0/1512757289 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe7800a0520 0x7fe7800a29e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe794100cd0 tx=0x7fe784009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:13.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.163+0000 7fe78a7fc700 1 -- 172.21.15.26:0/1512757289 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe78c095b90 con 0x7fe794101810 2023-12-01T01:04:13.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:12 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3621681537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:04:13.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:12 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/4163882628' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:13.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:12 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1174825874' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:04:13.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:12 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3621681537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:04:13.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:12 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/4163882628' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:13.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:12 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1174825874' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:04:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.366+0000 7fe79b437700 1 -- 172.21.15.26:0/1512757289 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe794106b60 con 0x7fe794101810 2023-12-01T01:04:13.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.366+0000 7fe78a7fc700 1 -- 172.21.15.26:0/1512757289 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe78c0991b0 con 0x7fe794101810 2023-12-01T01:04:13.367 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-12-01T01:04:13.369 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.368+0000 7fe79b437700 1 -- 172.21.15.26:0/1512757289 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe7800a0520 msgr2=0x7fe7800a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:13.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.368+0000 7fe79b437700 1 --2- 172.21.15.26:0/1512757289 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe7800a0520 0x7fe7800a29e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe794100cd0 tx=0x7fe784009260 comp rx=0 tx=0).stop 2023-12-01T01:04:13.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.368+0000 7fe79b437700 1 -- 172.21.15.26:0/1512757289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe794101810 msgr2=0x7fe79419def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:13.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.368+0000 7fe79b437700 1 --2- 172.21.15.26:0/1512757289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe794101810 0x7fe79419def0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00ef30 tx=0x7fe78c00c450 comp rx=0 tx=0).stop 2023-12-01T01:04:13.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.369+0000 7fe79b437700 1 -- 172.21.15.26:0/1512757289 shutdown_connections 2023-12-01T01:04:13.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.369+0000 7fe79b437700 1 --2- 172.21.15.26:0/1512757289 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe7800a0520 0x7fe7800a29e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.369+0000 7fe79b437700 1 --2- 172.21.15.26:0/1512757289 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe794101810 0x7fe79419def0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.369+0000 7fe79b437700 1 --2- 172.21.15.26:0/1512757289 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe7940ffc80 0x7fe794068a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.369+0000 7fe79b437700 1 --2- 172.21.15.26:0/1512757289 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe794100e70 0x7fe79419b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.369+0000 7fe79b437700 1 -- 172.21.15.26:0/1512757289 >> 172.21.15.26:0/1512757289 conn(0x7fe7940fb1f0 msgr2=0x7fe7940fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:13.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.369+0000 7fe79b437700 1 -- 172.21.15.26:0/1512757289 shutdown_connections 2023-12-01T01:04:13.370 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.369+0000 7fe79b437700 1 -- 172.21.15.26:0/1512757289 wait complete. 2023-12-01T01:04:13.382 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-12-01T01:04:13.382 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:04:13.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.507+0000 7f399a281700 1 -- 172.21.15.26:0/4100563102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3994101800 msgr2=0x7f39941080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:13.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.507+0000 7f399a281700 1 --2- 172.21.15.26:0/4100563102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3994101800 0x7f39941080b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f398c00b0d0 tx=0x7f398c00b3e0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.507+0000 7f399a281700 1 -- 172.21.15.26:0/4100563102 shutdown_connections 2023-12-01T01:04:13.510 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.507+0000 7f399a281700 1 --2- 172.21.15.26:0/4100563102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3994101800 0x7f39941080b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.507+0000 7f399a281700 1 --2- 172.21.15.26:0/4100563102 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f39940ffc70 0x7f3994100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.507+0000 7f399a281700 1 --2- 172.21.15.26:0/4100563102 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3994100e60 0x7f39941012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.507+0000 7f399a281700 1 -- 172.21.15.26:0/4100563102 >> 172.21.15.26:0/4100563102 conn(0x7f39940fb1c0 msgr2=0x7f39940fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.507+0000 7f399a281700 1 -- 172.21.15.26:0/4100563102 shutdown_connections 2023-12-01T01:04:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.507+0000 7f399a281700 1 -- 172.21.15.26:0/4100563102 wait complete. 2023-12-01T01:04:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.508+0000 7f399a281700 1 Processor -- start 2023-12-01T01:04:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.508+0000 7f399a281700 1 -- start start 2023-12-01T01:04:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.508+0000 7f399a281700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39940ffc70 0x7f3994068a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.508+0000 7f399a281700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3994100e60 0x7f399419b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.508+0000 7f399a281700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3994101800 0x7f399419df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.508+0000 7f399a281700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399419e760 con 0x7f39940ffc70 2023-12-01T01:04:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.508+0000 7f399a281700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399419e8d0 con 0x7f3994100e60 2023-12-01T01:04:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.508+0000 7f399a281700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399419ea90 con 0x7f3994101800 2023-12-01T01:04:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.508+0000 7f3993fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39940ffc70 0x7f3994068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:13.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.508+0000 7f3993fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39940ffc70 0x7f3994068a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54976/0 (socket says 172.21.15.26:54976) 2023-12-01T01:04:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.508+0000 7f3993fff700 1 -- 172.21.15.26:0/2056096224 learned_addr learned my addr 172.21.15.26:0/2056096224 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.508+0000 7f399881e700 1 --2- 172.21.15.26:0/2056096224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3994101800 0x7f399419df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.508+0000 7f398bfff700 1 --2- 172.21.15.26:0/2056096224 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3994100e60 0x7f399419b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.508+0000 7f3993fff700 1 -- 172.21.15.26:0/2056096224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3994101800 msgr2=0x7f399419df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.509+0000 7f3993fff700 1 --2- 172.21.15.26:0/2056096224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3994101800 0x7f399419df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.509+0000 7f3993fff700 1 -- 172.21.15.26:0/2056096224 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3994100e60 msgr2=0x7f399419b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.509+0000 7f3993fff700 1 --2- 172.21.15.26:0/2056096224 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3994100e60 0x7f399419b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.509+0000 7f3993fff700 1 -- 172.21.15.26:0/2056096224 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c009d00 con 0x7f39940ffc70 2023-12-01T01:04:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.509+0000 7f398bfff700 1 --2- 172.21.15.26:0/2056096224 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3994100e60 0x7f399419b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.509+0000 7f3993fff700 1 --2- 172.21.15.26:0/2056096224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39940ffc70 0x7f3994068a80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f398400d980 tx=0x7f398400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.509+0000 7f3991ffb700 1 -- 172.21.15.26:0/2056096224 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984004020 con 0x7f39940ffc70 2023-12-01T01:04:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.509+0000 7f399a281700 1 -- 172.21.15.26:0/2056096224 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399419ed70 con 0x7f39940ffc70 2023-12-01T01:04:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.509+0000 7f3991ffb700 1 -- 172.21.15.26:0/2056096224 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3984009730 con 0x7f39940ffc70 2023-12-01T01:04:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.509+0000 7f3991ffb700 1 -- 172.21.15.26:0/2056096224 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3984003be0 con 0x7f39940ffc70 2023-12-01T01:04:13.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.509+0000 7f399a281700 1 -- 172.21.15.26:0/2056096224 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f399419f1d0 con 0x7f39940ffc70 2023-12-01T01:04:13.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.510+0000 7f399a281700 1 -- 172.21.15.26:0/2056096224 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f399410b640 con 0x7f39940ffc70 2023-12-01T01:04:13.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.511+0000 7f3991ffb700 1 -- 172.21.15.26:0/2056096224 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f3984009ba0 con 0x7f39940ffc70 2023-12-01T01:04:13.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.511+0000 7f3991ffb700 1 --2- 172.21.15.26:0/2056096224 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f39800a0570 0x7f39800a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:13.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.512+0000 7f398bfff700 1 --2- 172.21.15.26:0/2056096224 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f39800a0570 0x7f39800a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:13.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.512+0000 7f3991ffb700 1 -- 172.21.15.26:0/2056096224 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f39840cb920 con 0x7f39940ffc70 2023-12-01T01:04:13.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.512+0000 7f398bfff700 1 --2- 172.21.15.26:0/2056096224 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f39800a0570 0x7f39800a2a30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f397c005950 tx=0x7f397c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:13.515 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.515+0000 7f3991ffb700 1 -- 172.21.15.26:0/2056096224 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f39840954d0 con 0x7f39940ffc70 2023-12-01T01:04:13.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.761+0000 7f399a281700 1 -- 172.21.15.26:0/2056096224 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f399410b830 con 0x7f39940ffc70 2023-12-01T01:04:13.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.762+0000 7f3991ffb700 1 -- 172.21.15.26:0/2056096224 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10777 (secure 0 0 0) 0x7f3984098af0 con 0x7f39940ffc70 2023-12-01T01:04:13.763 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:04:13.763 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6841/3515135915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6840","nonce":3515135915},{"type":"v1","addr":"172.21.15.26:6841","nonce":3515135915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-01T01:02:47.252972+0000","modified":"2023-12-01T01:02:52.326753+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24493,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.93:6837/3333520218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3333520218},{"type":"v1","addr":"172.21.15.93:6837","nonce":3333520218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6839/3364532241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":3364532241},{"type":"v1","addr":"172.21.15.93:6839","nonce":3364532241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T01:04:13.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.764+0000 7f399a281700 1 -- 172.21.15.26:0/2056096224 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f39800a0570 msgr2=0x7f39800a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:13.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.764+0000 7f399a281700 1 --2- 172.21.15.26:0/2056096224 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f39800a0570 0x7f39800a2a30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f397c005950 tx=0x7f397c0058e0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.764+0000 7f399a281700 1 -- 172.21.15.26:0/2056096224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39940ffc70 msgr2=0x7f3994068a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:13.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.764+0000 7f399a281700 1 --2- 172.21.15.26:0/2056096224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39940ffc70 0x7f3994068a80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f398400d980 tx=0x7f398400dc90 comp rx=0 tx=0).stop 2023-12-01T01:04:13.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.764+0000 7f399a281700 1 -- 172.21.15.26:0/2056096224 shutdown_connections 2023-12-01T01:04:13.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.764+0000 7f399a281700 1 --2- 172.21.15.26:0/2056096224 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f39800a0570 0x7f39800a2a30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.764+0000 7f399a281700 1 --2- 172.21.15.26:0/2056096224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3994101800 0x7f399419df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.764+0000 7f399a281700 1 --2- 172.21.15.26:0/2056096224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f39940ffc70 0x7f3994068a80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.764+0000 7f399a281700 1 --2- 172.21.15.26:0/2056096224 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3994100e60 0x7f399419b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.764+0000 7f399a281700 1 -- 172.21.15.26:0/2056096224 >> 172.21.15.26:0/2056096224 conn(0x7f39940fb1c0 msgr2=0x7f39940fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:13.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.764+0000 7f399a281700 1 -- 172.21.15.26:0/2056096224 shutdown_connections 2023-12-01T01:04:13.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.764+0000 7f399a281700 1 -- 172.21.15.26:0/2056096224 wait complete. 2023-12-01T01:04:13.766 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 23 2023-12-01T01:04:13.778 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-12-01T01:04:13.778 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-12-01T01:04:13.778 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T01:04:13.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.905+0000 7f43c825e700 1 -- 172.21.15.26:0/987077530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c0101fa0 msgr2=0x7f43c0102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:13.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.905+0000 7f43c825e700 1 --2- 172.21.15.26:0/987077530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c0101fa0 0x7f43c0102400 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f43b00099c0 tx=0x7f43b0009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.905+0000 7f43c825e700 1 -- 172.21.15.26:0/987077530 shutdown_connections 2023-12-01T01:04:13.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.905+0000 7f43c825e700 1 --2- 172.21.15.26:0/987077530 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43c0102940 0x7f43c01091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.905+0000 7f43c825e700 1 --2- 172.21.15.26:0/987077530 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43c0100db0 0x7f43c01011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.905+0000 7f43c825e700 1 --2- 172.21.15.26:0/987077530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c0101fa0 0x7f43c0102400 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.905+0000 7f43c825e700 1 -- 172.21.15.26:0/987077530 >> 172.21.15.26:0/987077530 conn(0x7f43c00fc300 msgr2=0x7f43c00fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:13.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.905+0000 7f43c825e700 1 -- 172.21.15.26:0/987077530 shutdown_connections 2023-12-01T01:04:13.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.905+0000 7f43c825e700 1 -- 172.21.15.26:0/987077530 wait complete. 2023-12-01T01:04:13.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.905+0000 7f43c825e700 1 Processor -- start 2023-12-01T01:04:13.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.905+0000 7f43c825e700 1 -- start start 2023-12-01T01:04:13.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c825e700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43c0100db0 0x7f43c0196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c825e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43c0101fa0 0x7f43c0197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c825e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c0102940 0x7f43c019e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c825e700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c019e6c0 con 0x7f43c0102940 2023-12-01T01:04:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c825e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c019e800 con 0x7f43c0101fa0 2023-12-01T01:04:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c825e700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c019e990 con 0x7f43c0100db0 2023-12-01T01:04:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c67fb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c0102940 0x7f43c019e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c5ffa700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43c0100db0 0x7f43c0196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c67fb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c0102940 0x7f43c019e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54994/0 (socket says 172.21.15.26:54994) 2023-12-01T01:04:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c67fb700 1 -- 172.21.15.26:0/3287957140 learned_addr learned my addr 172.21.15.26:0/3287957140 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c57f9700 1 --2- 172.21.15.26:0/3287957140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43c0101fa0 0x7f43c0197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c67fb700 1 -- 172.21.15.26:0/3287957140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43c0100db0 msgr2=0x7f43c0196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c67fb700 1 --2- 172.21.15.26:0/3287957140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43c0100db0 0x7f43c0196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c67fb700 1 -- 172.21.15.26:0/3287957140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43c0101fa0 msgr2=0x7f43c0197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c67fb700 1 --2- 172.21.15.26:0/3287957140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43c0101fa0 0x7f43c0197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:13.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c67fb700 1 -- 172.21.15.26:0/3287957140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b00095f0 con 0x7f43c0102940 2023-12-01T01:04:13.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43c67fb700 1 --2- 172.21.15.26:0/3287957140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c0102940 0x7f43c019e0f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f43b800ada0 tx=0x7f43b800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:13.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.906+0000 7f43b6ffd700 1 -- 172.21.15.26:0/3287957140 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800f070 con 0x7f43c0102940 2023-12-01T01:04:13.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.907+0000 7f43b6ffd700 1 -- 172.21.15.26:0/3287957140 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f43b8007b30 con 0x7f43c0102940 2023-12-01T01:04:13.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.907+0000 7f43c825e700 1 -- 172.21.15.26:0/3287957140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c019ec70 con 0x7f43c0102940 2023-12-01T01:04:13.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.907+0000 7f43b6ffd700 1 -- 172.21.15.26:0/3287957140 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b80053e0 con 0x7f43c0102940 2023-12-01T01:04:13.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.907+0000 7f43c825e700 1 -- 172.21.15.26:0/3287957140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c019f180 con 0x7f43c0102940 2023-12-01T01:04:13.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.907+0000 7f43c825e700 1 -- 172.21.15.26:0/3287957140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c010c750 con 0x7f43c0102940 2023-12-01T01:04:13.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.909+0000 7f43b6ffd700 1 -- 172.21.15.26:0/3287957140 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f43b8005540 con 0x7f43c0102940 2023-12-01T01:04:13.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.909+0000 7f43b6ffd700 1 --2- 172.21.15.26:0/3287957140 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f43ac0a0570 0x7f43ac0a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:13.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.909+0000 7f43c5ffa700 1 --2- 172.21.15.26:0/3287957140 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f43ac0a0570 0x7f43ac0a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:13.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.909+0000 7f43b6ffd700 1 -- 172.21.15.26:0/3287957140 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f43b80cb460 con 0x7f43c0102940 2023-12-01T01:04:13.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.910+0000 7f43c5ffa700 1 --2- 172.21.15.26:0/3287957140 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f43ac0a0570 0x7f43ac0a2a30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f43c0101e00 tx=0x7f43bc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:13.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:13.913+0000 7f43b6ffd700 1 -- 172.21.15.26:0/3287957140 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f43b80950a0 con 0x7f43c0102940 2023-12-01T01:04:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:13 smithi026 ceph-mon[98801]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-01T01:04:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:13 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3782581402' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:04:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:13 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1512757289' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:04:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:13 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2056096224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:04:14.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.112+0000 7f43c825e700 1 -- 172.21.15.26:0/3287957140 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43c00611d0 con 0x7f43ac0a0570 2023-12-01T01:04:14.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.125+0000 7f43b6ffd700 1 -- 172.21.15.26:0/3287957140 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343920 (secure 0 0 0) 0x7f43c00611d0 con 0x7f43ac0a0570 2023-12-01T01:04:14.131 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:04:14.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.128+0000 7f43c825e700 1 -- 172.21.15.26:0/3287957140 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f43ac0a0570 msgr2=0x7f43ac0a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:14.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.128+0000 7f43c825e700 1 --2- 172.21.15.26:0/3287957140 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f43ac0a0570 0x7f43ac0a2a30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f43c0101e00 tx=0x7f43bc00b410 comp rx=0 tx=0).stop 2023-12-01T01:04:14.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.128+0000 7f43c825e700 1 -- 172.21.15.26:0/3287957140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c0102940 msgr2=0x7f43c019e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:14.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.128+0000 7f43c825e700 1 --2- 172.21.15.26:0/3287957140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c0102940 0x7f43c019e0f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f43b800ada0 tx=0x7f43b800c330 comp rx=0 tx=0).stop 2023-12-01T01:04:14.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.128+0000 7f43c825e700 1 -- 172.21.15.26:0/3287957140 shutdown_connections 2023-12-01T01:04:14.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.128+0000 7f43c825e700 1 --2- 172.21.15.26:0/3287957140 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f43ac0a0570 0x7f43ac0a2a30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.128+0000 7f43c825e700 1 --2- 172.21.15.26:0/3287957140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c0102940 0x7f43c019e0f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.128+0000 7f43c825e700 1 --2- 172.21.15.26:0/3287957140 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f43c0100db0 0x7f43c0196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.128+0000 7f43c825e700 1 --2- 172.21.15.26:0/3287957140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43c0101fa0 0x7f43c0197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.128+0000 7f43c825e700 1 -- 172.21.15.26:0/3287957140 >> 172.21.15.26:0/3287957140 conn(0x7f43c00fc300 msgr2=0x7f43c00fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:14.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.129+0000 7f43c825e700 1 -- 172.21.15.26:0/3287957140 shutdown_connections 2023-12-01T01:04:14.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.129+0000 7f43c825e700 1 -- 172.21.15.26:0/3287957140 wait complete. 2023-12-01T01:04:14.135 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-12-01T01:04:14.142 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2023-12-01T01:04:13.976581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659672,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":624,"num_read_kb":428,"num_write":346,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1221573,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":782,"ondisk_log_size":782,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":334440,"kb_used_data":11016,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124607384,"statfs":{"total":1151940427776,"available":1151597961216,"internally_reserved":0,"allocated":11280384,"data_stored":7161918,"data_compressed":114720,"data_compressed_allocated":143360,"data_compressed_original":1806336,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5946,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":48,"num_write":8,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002985"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006469+0000","last_change":"2023-12-01T01:02:47.280671+0000","last_active":"2023-12-01T01:03:58.006469+0000","last_peered":"2023-12-01T01:03:58.006469+0000","last_clean":"2023-12-01T01:03:58.006469+0000","last_became_active":"2023-12-01T01:02:47.279922+0000","last_became_peered":"2023-12-01T01:02:47.279922+0000","last_unstale":"2023-12-01T01:03:58.006469+0000","last_undegraded":"2023-12-01T01:03:58.006469+0000","last_fullsized":"2023-12-01T01:03:58.006469+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:07:38.049977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.995520+0000","last_change":"2023-12-01T01:02:47.286185+0000","last_active":"2023-12-01T01:03:57.995520+0000","last_peered":"2023-12-01T01:03:57.995520+0000","last_clean":"2023-12-01T01:03:57.995520+0000","last_became_active":"2023-12-01T01:02:47.283747+0000","last_became_peered":"2023-12-01T01:02:47.283747+0000","last_unstale":"2023-12-01T01:03:57.995520+0000","last_undegraded":"2023-12-01T01:03:57.995520+0000","last_fullsized":"2023-12-01T01:03:57.995520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:38:32.697826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.005701+0000","last_change":"2023-12-01T01:02:47.285778+0000","last_active":"2023-12-01T01:03:58.005701+0000","last_peered":"2023-12-01T01:03:58.005701+0000","last_clean":"2023-12-01T01:03:58.005701+0000","last_became_active":"2023-12-01T01:02:47.279395+0000","last_became_peered":"2023-12-01T01:02:47.279395+0000","last_unstale":"2023-12-01T01:03:58.005701+0000","last_undegraded":"2023-12-01T01:03:58.005701+0000","last_fullsized":"2023-12-01T01:03:58.005701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:04:20.570660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996769+0000","last_change":"2023-12-01T01:02:47.269316+0000","last_active":"2023-12-01T01:03:57.996769+0000","last_peered":"2023-12-01T01:03:57.996769+0000","last_clean":"2023-12-01T01:03:57.996769+0000","last_became_active":"2023-12-01T01:02:47.269041+0000","last_became_peered":"2023-12-01T01:02:47.269041+0000","last_unstale":"2023-12-01T01:03:57.996769+0000","last_undegraded":"2023-12-01T01:03:57.996769+0000","last_fullsized":"2023-12-01T01:03:57.996769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:24:27.951422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.991431+0000","last_change":"2023-12-01T01:02:47.273802+0000","last_active":"2023-12-01T01:03:57.991431+0000","last_peered":"2023-12-01T01:03:57.991431+0000","last_clean":"2023-12-01T01:03:57.991431+0000","last_became_active":"2023-12-01T01:02:47.273450+0000","last_became_peered":"2023-12-01T01:02:47.273450+0000","last_unstale":"2023-12-01T01:03:57.991431+0000","last_undegraded":"2023-12-01T01:03:57.991431+0000","last_fullsized":"2023-12-01T01:03:57.991431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:19:39.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.003491+0000","last_change":"2023-12-01T01:02:47.274505+0000","last_active":"2023-12-01T01:03:58.003491+0000","last_peered":"2023-12-01T01:03:58.003491+0000","last_clean":"2023-12-01T01:03:58.003491+0000","last_became_active":"2023-12-01T01:02:47.274141+0000","last_became_peered":"2023-12-01T01:02:47.274141+0000","last_unstale":"2023-12-01T01:03:58.003491+0000","last_undegraded":"2023-12-01T01:03:58.003491+0000","last_fullsized":"2023-12-01T01:03:58.003491+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:27:16.589927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999308+0000","last_change":"2023-12-01T01:02:47.279480+0000","last_active":"2023-12-01T01:03:57.999308+0000","last_peered":"2023-12-01T01:03:57.999308+0000","last_clean":"2023-12-01T01:03:57.999308+0000","last_became_active":"2023-12-01T01:02:47.279147+0000","last_became_peered":"2023-12-01T01:02:47.279147+0000","last_unstale":"2023-12-01T01:03:57.999308+0000","last_undegraded":"2023-12-01T01:03:57.999308+0000","last_fullsized":"2023-12-01T01:03:57.999308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:28:37.815087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997337+0000","last_change":"2023-12-01T01:02:47.283997+0000","last_active":"2023-12-01T01:03:57.997337+0000","last_peered":"2023-12-01T01:03:57.997337+0000","last_clean":"2023-12-01T01:03:57.997337+0000","last_became_active":"2023-12-01T01:02:47.283694+0000","last_became_peered":"2023-12-01T01:02:47.283694+0000","last_unstale":"2023-12-01T01:03:57.997337+0000","last_undegraded":"2023-12-01T01:03:57.997337+0000","last_fullsized":"2023-12-01T01:03:57.997337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:49:30.154079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.001593+0000","last_change":"2023-12-01T01:02:47.280113+0000","last_active":"2023-12-01T01:03:58.001593+0000","last_peered":"2023-12-01T01:03:58.001593+0000","last_clean":"2023-12-01T01:03:58.001593+0000","last_became_active":"2023-12-01T01:02:47.279844+0000","last_became_peered":"2023-12-01T01:02:47.279844+0000","last_unstale":"2023-12-01T01:03:58.001593+0000","last_undegraded":"2023-12-01T01:03:58.001593+0000","last_fullsized":"2023-12-01T01:03:58.001593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:50:19.955146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.003221+0000","last_change":"2023-12-01T01:02:47.275575+0000","last_active":"2023-12-01T01:03:58.003221+0000","last_peered":"2023-12-01T01:03:58.003221+0000","last_clean":"2023-12-01T01:03:58.003221+0000","last_became_active":"2023-12-01T01:02:47.275283+0000","last_became_peered":"2023-12-01T01:02:47.275283+0000","last_unstale":"2023-12-01T01:03:58.003221+0000","last_undegraded":"2023-12-01T01:03:58.003221+0000","last_fullsized":"2023-12-01T01:03:58.003221+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:08:41.842374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.007450+0000","last_change":"2023-12-01T01:02:47.275992+0000","last_active":"2023-12-01T01:03:58.007450+0000","last_peered":"2023-12-01T01:03:58.007450+0000","last_clean":"2023-12-01T01:03:58.007450+0000","last_became_active":"2023-12-01T01:02:47.275406+0000","last_became_peered":"2023-12-01T01:02:47.275406+0000","last_unstale":"2023-12-01T01:03:58.007450+0000","last_undegraded":"2023-12-01T01:03:58.007450+0000","last_fullsized":"2023-12-01T01:03:58.007450+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:58:39.978873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.000303+0000","last_change":"2023-12-01T01:02:47.282829+0000","last_active":"2023-12-01T01:03:58.000303+0000","last_peered":"2023-12-01T01:03:58.000303+0000","last_clean":"2023-12-01T01:03:58.000303+0000","last_became_active":"2023-12-01T01:02:47.282007+0000","last_became_peered":"2023-12-01T01:02:47.282007+0000","last_unstale":"2023-12-01T01:03:58.000303+0000","last_undegraded":"2023-12-01T01:03:58.000303+0000","last_fullsized":"2023-12-01T01:03:58.000303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:55:57.394004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999813+0000","last_change":"2023-12-01T01:02:47.276769+0000","last_active":"2023-12-01T01:03:57.999813+0000","last_peered":"2023-12-01T01:03:57.999813+0000","last_clean":"2023-12-01T01:03:57.999813+0000","last_became_active":"2023-12-01T01:02:47.276355+0000","last_became_peered":"2023-12-01T01:02:47.276355+0000","last_unstale":"2023-12-01T01:03:57.999813+0000","last_undegraded":"2023-12-01T01:03:57.999813+0000","last_fullsized":"2023-12-01T01:03:57.999813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:15:23.314516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996245+0000","last_change":"2023-12-01T01:02:47.286107+0000","last_active":"2023-12-01T01:03:57.996245+0000","last_peered":"2023-12-01T01:03:57.996245+0000","last_clean":"2023-12-01T01:03:57.996245+0000","last_became_active":"2023-12-01T01:02:47.285772+0000","last_became_peered":"2023-12-01T01:02:47.285772+0000","last_unstale":"2023-12-01T01:03:57.996245+0000","last_undegraded":"2023-12-01T01:03:57.996245+0000","last_fullsized":"2023-12-01T01:03:57.996245+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:30:29.730055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.992497+0000","last_change":"2023-12-01T01:02:47.281813+0000","last_active":"2023-12-01T01:03:57.992497+0000","last_peered":"2023-12-01T01:03:57.992497+0000","last_clean":"2023-12-01T01:03:57.992497+0000","last_became_active":"2023-12-01T01:02:47.279117+0000","last_became_peered":"2023-12-01T01:02:47.279117+0000","last_unstale":"2023-12-01T01:03:57.992497+0000","last_undegraded":"2023-12-01T01:03:57.992497+0000","last_fullsized":"2023-12-01T01:03:57.992497+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:11:34.646161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.002762+0000","last_change":"2023-12-01T01:02:47.289596+0000","last_active":"2023-12-01T01:03:58.002762+0000","last_peered":"2023-12-01T01:03:58.002762+0000","last_clean":"2023-12-01T01:03:58.002762+0000","last_became_active":"2023-12-01T01:02:47.289273+0000","last_became_peered":"2023-12-01T01:02:47.289273+0000","last_unstale":"2023-12-01T01:03:58.002762+0000","last_undegraded":"2023-12-01T01:03:58.002762+0000","last_fullsized":"2023-12-01T01:03:58.002762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:10:33.606237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006622+0000","last_change":"2023-12-01T01:02:47.281198+0000","last_active":"2023-12-01T01:03:58.006622+0000","last_peered":"2023-12-01T01:03:58.006622+0000","last_clean":"2023-12-01T01:03:58.006622+0000","last_became_active":"2023-12-01T01:02:47.280903+0000","last_became_peered":"2023-12-01T01:02:47.280903+0000","last_unstale":"2023-12-01T01:03:58.006622+0000","last_undegraded":"2023-12-01T01:03:58.006622+0000","last_fullsized":"2023-12-01T01:03:58.006622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:14:56.199140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.000335+0000","last_change":"2023-12-01T01:02:47.281015+0000","last_active":"2023-12-01T01:03:58.000335+0000","last_peered":"2023-12-01T01:03:58.000335+0000","last_clean":"2023-12-01T01:03:58.000335+0000","last_became_active":"2023-12-01T01:02:47.280670+0000","last_became_peered":"2023-12-01T01:02:47.280670+0000","last_unstale":"2023-12-01T01:03:58.000335+0000","last_undegraded":"2023-12-01T01:03:58.000335+0000","last_fullsized":"2023-12-01T01:03:58.000335+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:13:12.686506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997595+0000","last_change":"2023-12-01T01:02:47.283444+0000","last_active":"2023-12-01T01:03:57.997595+0000","last_peered":"2023-12-01T01:03:57.997595+0000","last_clean":"2023-12-01T01:03:57.997595+0000","last_became_active":"2023-12-01T01:02:47.283131+0000","last_became_peered":"2023-12-01T01:02:47.283131+0000","last_unstale":"2023-12-01T01:03:57.997595+0000","last_undegraded":"2023-12-01T01:03:57.997595+0000","last_fullsized":"2023-12-01T01:03:57.997595+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:36:50.069639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635021+0000","last_change":"2023-12-01T01:02:46.825507+0000","last_active":"2023-12-01T01:02:58.635021+0000","last_peered":"2023-12-01T01:02:58.635021+0000","last_clean":"2023-12-01T01:02:58.635021+0000","last_became_active":"2023-12-01T01:02:46.825170+0000","last_became_peered":"2023-12-01T01:02:46.825170+0000","last_unstale":"2023-12-01T01:02:58.635021+0000","last_undegraded":"2023-12-01T01:02:58.635021+0000","last_fullsized":"2023-12-01T01:02:58.635021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:10:10.518664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.987626+0000","last_change":"2023-12-01T01:03:00.001168+0000","last_active":"2023-12-01T01:03:57.987626+0000","last_peered":"2023-12-01T01:03:57.987626+0000","last_clean":"2023-12-01T01:03:57.987626+0000","last_became_active":"2023-12-01T01:03:00.000826+0000","last_became_peered":"2023-12-01T01:03:00.000826+0000","last_unstale":"2023-12-01T01:03:57.987626+0000","last_undegraded":"2023-12-01T01:03:57.987626+0000","last_fullsized":"2023-12-01T01:03:57.987626+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:03:25.647589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638080+0000","last_change":"2023-12-01T01:02:46.835504+0000","last_active":"2023-12-01T01:02:58.638080+0000","last_peered":"2023-12-01T01:02:58.638080+0000","last_clean":"2023-12-01T01:02:58.638080+0000","last_became_active":"2023-12-01T01:02:46.835206+0000","last_became_peered":"2023-12-01T01:02:46.835206+0000","last_unstale":"2023-12-01T01:02:58.638080+0000","last_undegraded":"2023-12-01T01:02:58.638080+0000","last_fullsized":"2023-12-01T01:02:58.638080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:42:18.756880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006507+0000","last_change":"2023-12-01T01:02:47.286713+0000","last_active":"2023-12-01T01:03:58.006507+0000","last_peered":"2023-12-01T01:03:58.006507+0000","last_clean":"2023-12-01T01:03:58.006507+0000","last_became_active":"2023-12-01T01:02:47.285868+0000","last_became_peered":"2023-12-01T01:02:47.285868+0000","last_unstale":"2023-12-01T01:03:58.006507+0000","last_undegraded":"2023-12-01T01:03:58.006507+0000","last_fullsized":"2023-12-01T01:03:58.006507+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:16:31.496085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.648184+0000","last_change":"2023-12-01T01:02:59.647766+0000","last_active":"2023-12-01T01:02:59.648184+0000","last_peered":"2023-12-01T01:02:59.648184+0000","last_clean":"2023-12-01T01:02:59.648184+0000","last_became_active":"2023-12-01T01:02:59.641808+0000","last_became_peered":"2023-12-01T01:02:59.641808+0000","last_unstale":"2023-12-01T01:02:59.648184+0000","last_undegraded":"2023-12-01T01:02:59.648184+0000","last_fullsized":"2023-12-01T01:02:59.648184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:57:44.213111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.005710+0000","last_change":"2023-12-01T01:02:47.284868+0000","last_active":"2023-12-01T01:03:58.005710+0000","last_peered":"2023-12-01T01:03:58.005710+0000","last_clean":"2023-12-01T01:03:58.005710+0000","last_became_active":"2023-12-01T01:02:47.284602+0000","last_became_peered":"2023-12-01T01:02:47.284602+0000","last_unstale":"2023-12-01T01:03:58.005710+0000","last_undegraded":"2023-12-01T01:03:58.005710+0000","last_fullsized":"2023-12-01T01:03:58.005710+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:12:36.510333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634994+0000","last_change":"2023-12-01T01:02:46.832234+0000","last_active":"2023-12-01T01:02:58.634994+0000","last_peered":"2023-12-01T01:02:58.634994+0000","last_clean":"2023-12-01T01:02:58.634994+0000","last_became_active":"2023-12-01T01:02:46.831986+0000","last_became_peered":"2023-12-01T01:02:46.831986+0000","last_unstale":"2023-12-01T01:02:58.634994+0000","last_undegraded":"2023-12-01T01:02:58.634994+0000","last_fullsized":"2023-12-01T01:02:58.634994+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:49:35.773243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.004824+0000","last_change":"2023-12-01T01:02:47.275033+0000","last_active":"2023-12-01T01:03:58.004824+0000","last_peered":"2023-12-01T01:03:58.004824+0000","last_clean":"2023-12-01T01:03:58.004824+0000","last_became_active":"2023-12-01T01:02:47.274730+0000","last_became_peered":"2023-12-01T01:02:47.274730+0000","last_unstale":"2023-12-01T01:03:58.004824+0000","last_undegraded":"2023-12-01T01:03:58.004824+0000","last_fullsized":"2023-12-01T01:03:58.004824+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:48:44.959720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'7","reported_seq":103,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:08.450577+0000","last_change":"2023-12-01T01:02:46.827046+0000","last_active":"2023-12-01T01:04:08.450577+0000","last_peered":"2023-12-01T01:04:08.450577+0000","last_clean":"2023-12-01T01:04:08.450577+0000","last_became_active":"2023-12-01T01:02:46.826716+0000","last_became_peered":"2023-12-01T01:02:46.826716+0000","last_unstale":"2023-12-01T01:04:08.450577+0000","last_undegraded":"2023-12-01T01:04:08.450577+0000","last_fullsized":"2023-12-01T01:04:08.450577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:06:46.195630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1108,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.987198+0000","last_change":"2023-12-01T01:02:47.270299+0000","last_active":"2023-12-01T01:03:57.987198+0000","last_peered":"2023-12-01T01:03:57.987198+0000","last_clean":"2023-12-01T01:03:57.987198+0000","last_became_active":"2023-12-01T01:02:47.270016+0000","last_became_peered":"2023-12-01T01:02:47.270016+0000","last_unstale":"2023-12-01T01:03:57.987198+0000","last_undegraded":"2023-12-01T01:03:57.987198+0000","last_fullsized":"2023-12-01T01:03:57.987198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:16:30.207449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.643802+0000","last_change":"2023-12-01T01:02:59.643802+0000","last_active":"2023-12-01T01:02:59.643802+0000","last_peered":"2023-12-01T01:02:59.643802+0000","last_clean":"2023-12-01T01:02:59.643802+0000","last_became_active":"2023-12-01T01:02:59.640951+0000","last_became_peered":"2023-12-01T01:02:59.640951+0000","last_unstale":"2023-12-01T01:02:59.643802+0000","last_undegraded":"2023-12-01T01:02:59.643802+0000","last_fullsized":"2023-12-01T01:02:59.643802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:52:32.599515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999994+0000","last_change":"2023-12-01T01:02:47.274600+0000","last_active":"2023-12-01T01:03:57.999994+0000","last_peered":"2023-12-01T01:03:57.999994+0000","last_clean":"2023-12-01T01:03:57.999994+0000","last_became_active":"2023-12-01T01:02:47.273979+0000","last_became_peered":"2023-12-01T01:02:47.273979+0000","last_unstale":"2023-12-01T01:03:57.999994+0000","last_undegraded":"2023-12-01T01:03:57.999994+0000","last_fullsized":"2023-12-01T01:03:57.999994+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:20:55.693393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629126+0000","last_change":"2023-12-01T01:02:46.821479+0000","last_active":"2023-12-01T01:02:58.629126+0000","last_peered":"2023-12-01T01:02:58.629126+0000","last_clean":"2023-12-01T01:02:58.629126+0000","last_became_active":"2023-12-01T01:02:46.821090+0000","last_became_peered":"2023-12-01T01:02:46.821090+0000","last_unstale":"2023-12-01T01:02:58.629126+0000","last_undegraded":"2023-12-01T01:02:58.629126+0000","last_fullsized":"2023-12-01T01:02:58.629126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:17:48.216217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.994530+0000","last_change":"2023-12-01T01:02:47.274298+0000","last_active":"2023-12-01T01:03:57.994530+0000","last_peered":"2023-12-01T01:03:57.994530+0000","last_clean":"2023-12-01T01:03:57.994530+0000","last_became_active":"2023-12-01T01:02:47.274006+0000","last_became_peered":"2023-12-01T01:02:47.274006+0000","last_unstale":"2023-12-01T01:03:57.994530+0000","last_undegraded":"2023-12-01T01:03:57.994530+0000","last_fullsized":"2023-12-01T01:03:57.994530+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:38.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637568+0000","last_change":"2023-12-01T01:02:46.826341+0000","last_active":"2023-12-01T01:02:58.637568+0000","last_peered":"2023-12-01T01:02:58.637568+0000","last_clean":"2023-12-01T01:02:58.637568+0000","last_became_active":"2023-12-01T01:02:46.825979+0000","last_became_peered":"2023-12-01T01:02:46.825979+0000","last_unstale":"2023-12-01T01:02:58.637568+0000","last_undegraded":"2023-12-01T01:02:58.637568+0000","last_fullsized":"2023-12-01T01:02:58.637568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:29:48.681232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.992738+0000","last_change":"2023-12-01T01:02:47.280989+0000","last_active":"2023-12-01T01:03:57.992738+0000","last_peered":"2023-12-01T01:03:57.992738+0000","last_clean":"2023-12-01T01:03:57.992738+0000","last_became_active":"2023-12-01T01:02:47.280649+0000","last_became_peered":"2023-12-01T01:02:47.280649+0000","last_unstale":"2023-12-01T01:03:57.992738+0000","last_undegraded":"2023-12-01T01:03:57.992738+0000","last_fullsized":"2023-12-01T01:03:57.992738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:16:30.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":98,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:10.452968+0000","last_change":"2023-12-01T01:02:46.832304+0000","last_active":"2023-12-01T01:04:10.452968+0000","last_peered":"2023-12-01T01:04:10.452968+0000","last_clean":"2023-12-01T01:04:10.452968+0000","last_became_active":"2023-12-01T01:02:46.832014+0000","last_became_peered":"2023-12-01T01:02:46.832014+0000","last_unstale":"2023-12-01T01:04:10.452968+0000","last_undegraded":"2023-12-01T01:04:10.452968+0000","last_fullsized":"2023-12-01T01:04:10.452968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:41:46.003527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.005234+0000","last_change":"2023-12-01T01:02:47.277819+0000","last_active":"2023-12-01T01:03:58.005234+0000","last_peered":"2023-12-01T01:03:58.005234+0000","last_clean":"2023-12-01T01:03:58.005234+0000","last_became_active":"2023-12-01T01:02:47.277534+0000","last_became_peered":"2023-12-01T01:02:47.277534+0000","last_unstale":"2023-12-01T01:03:58.005234+0000","last_undegraded":"2023-12-01T01:03:58.005234+0000","last_fullsized":"2023-12-01T01:03:58.005234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:56:15.627538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638700+0000","last_change":"2023-12-01T01:02:46.826783+0000","last_active":"2023-12-01T01:02:58.638700+0000","last_peered":"2023-12-01T01:02:58.638700+0000","last_clean":"2023-12-01T01:02:58.638700+0000","last_became_active":"2023-12-01T01:02:46.826479+0000","last_became_peered":"2023-12-01T01:02:46.826479+0000","last_unstale":"2023-12-01T01:02:58.638700+0000","last_undegraded":"2023-12-01T01:02:58.638700+0000","last_fullsized":"2023-12-01T01:02:58.638700+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:30:09.681494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997740+0000","last_change":"2023-12-01T01:03:00.001466+0000","last_active":"2023-12-01T01:03:57.997740+0000","last_peered":"2023-12-01T01:03:57.997740+0000","last_clean":"2023-12-01T01:03:57.997740+0000","last_became_active":"2023-12-01T01:03:00.001077+0000","last_became_peered":"2023-12-01T01:03:00.001077+0000","last_unstale":"2023-12-01T01:03:57.997740+0000","last_undegraded":"2023-12-01T01:03:57.997740+0000","last_fullsized":"2023-12-01T01:03:57.997740+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:46:26.987257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.639542+0000","last_change":"2023-12-01T01:02:46.829332+0000","last_active":"2023-12-01T01:02:58.639542+0000","last_peered":"2023-12-01T01:02:58.639542+0000","last_clean":"2023-12-01T01:02:58.639542+0000","last_became_active":"2023-12-01T01:02:46.828828+0000","last_became_peered":"2023-12-01T01:02:46.828828+0000","last_unstale":"2023-12-01T01:02:58.639542+0000","last_undegraded":"2023-12-01T01:02:58.639542+0000","last_fullsized":"2023-12-01T01:02:58.639542+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:15:15.648138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006501+0000","last_change":"2023-12-01T01:02:47.277938+0000","last_active":"2023-12-01T01:03:58.006501+0000","last_peered":"2023-12-01T01:03:58.006501+0000","last_clean":"2023-12-01T01:03:58.006501+0000","last_became_active":"2023-12-01T01:02:47.277650+0000","last_became_peered":"2023-12-01T01:02:47.277650+0000","last_unstale":"2023-12-01T01:03:58.006501+0000","last_undegraded":"2023-12-01T01:03:58.006501+0000","last_fullsized":"2023-12-01T01:03:58.006501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:03:46.667892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'32","reported_seq":236,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:11.111956+0000","last_change":"2023-12-01T01:03:00.008983+0000","last_active":"2023-12-01T01:04:11.111956+0000","last_peered":"2023-12-01T01:04:11.111956+0000","last_clean":"2023-12-01T01:04:11.111956+0000","last_became_active":"2023-12-01T01:03:00.001444+0000","last_became_peered":"2023-12-01T01:03:00.001444+0000","last_unstale":"2023-12-01T01:04:11.111956+0000","last_undegraded":"2023-12-01T01:04:11.111956+0000","last_fullsized":"2023-12-01T01:04:11.111956+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:29:25.347028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64476,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":162,"num_read_kb":139,"num_write":33,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":40837,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.995106+0000","last_change":"2023-12-01T01:02:47.272049+0000","last_active":"2023-12-01T01:03:57.995106+0000","last_peered":"2023-12-01T01:03:57.995106+0000","last_clean":"2023-12-01T01:03:57.995106+0000","last_became_active":"2023-12-01T01:02:47.271726+0000","last_became_peered":"2023-12-01T01:02:47.271726+0000","last_unstale":"2023-12-01T01:03:57.995106+0000","last_undegraded":"2023-12-01T01:03:57.995106+0000","last_fullsized":"2023-12-01T01:03:57.995106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:08:45.038989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634393+0000","last_change":"2023-12-01T01:02:46.831362+0000","last_active":"2023-12-01T01:02:58.634393+0000","last_peered":"2023-12-01T01:02:58.634393+0000","last_clean":"2023-12-01T01:02:58.634393+0000","last_became_active":"2023-12-01T01:02:46.830929+0000","last_became_peered":"2023-12-01T01:02:46.830929+0000","last_unstale":"2023-12-01T01:02:58.634393+0000","last_undegraded":"2023-12-01T01:02:58.634393+0000","last_fullsized":"2023-12-01T01:02:58.634393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:39:54.855526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997351+0000","last_change":"2023-12-01T01:02:47.275343+0000","last_active":"2023-12-01T01:03:57.997351+0000","last_peered":"2023-12-01T01:03:57.997351+0000","last_clean":"2023-12-01T01:03:57.997351+0000","last_became_active":"2023-12-01T01:02:47.275042+0000","last_became_peered":"2023-12-01T01:02:47.275042+0000","last_unstale":"2023-12-01T01:03:57.997351+0000","last_undegraded":"2023-12-01T01:03:57.997351+0000","last_fullsized":"2023-12-01T01:03:57.997351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:18:27.862601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638406+0000","last_change":"2023-12-01T01:02:46.831996+0000","last_active":"2023-12-01T01:02:58.638406+0000","last_peered":"2023-12-01T01:02:58.638406+0000","last_clean":"2023-12-01T01:02:58.638406+0000","last_became_active":"2023-12-01T01:02:46.831710+0000","last_became_peered":"2023-12-01T01:02:46.831710+0000","last_unstale":"2023-12-01T01:02:58.638406+0000","last_undegraded":"2023-12-01T01:02:58.638406+0000","last_fullsized":"2023-12-01T01:02:58.638406+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:50:42.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006191+0000","last_change":"2023-12-01T01:02:47.283771+0000","last_active":"2023-12-01T01:03:58.006191+0000","last_peered":"2023-12-01T01:03:58.006191+0000","last_clean":"2023-12-01T01:03:58.006191+0000","last_became_active":"2023-12-01T01:02:47.283363+0000","last_became_peered":"2023-12-01T01:02:47.283363+0000","last_unstale":"2023-12-01T01:03:58.006191+0000","last_undegraded":"2023-12-01T01:03:58.006191+0000","last_fullsized":"2023-12-01T01:03:58.006191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:44:40.918161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":101,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:08.450146+0000","last_change":"2023-12-01T01:02:46.825170+0000","last_active":"2023-12-01T01:04:08.450146+0000","last_peered":"2023-12-01T01:04:08.450146+0000","last_clean":"2023-12-01T01:04:08.450146+0000","last_became_active":"2023-12-01T01:02:46.824857+0000","last_became_peered":"2023-12-01T01:02:46.824857+0000","last_unstale":"2023-12-01T01:04:08.450146+0000","last_undegraded":"2023-12-01T01:04:08.450146+0000","last_fullsized":"2023-12-01T01:04:08.450146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:05:54.095408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":83,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997749+0000","last_change":"2023-12-01T01:02:47.279495+0000","last_active":"2023-12-01T01:03:57.997749+0000","last_peered":"2023-12-01T01:03:57.997749+0000","last_clean":"2023-12-01T01:03:57.997749+0000","last_became_active":"2023-12-01T01:02:47.279171+0000","last_became_peered":"2023-12-01T01:02:47.279171+0000","last_unstale":"2023-12-01T01:03:57.997749+0000","last_undegraded":"2023-12-01T01:03:57.997749+0000","last_fullsized":"2023-12-01T01:03:57.997749+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:29:33.298818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634745+0000","last_change":"2023-12-01T01:02:46.833837+0000","last_active":"2023-12-01T01:02:58.634745+0000","last_peered":"2023-12-01T01:02:58.634745+0000","last_clean":"2023-12-01T01:02:58.634745+0000","last_became_active":"2023-12-01T01:02:46.833549+0000","last_became_peered":"2023-12-01T01:02:46.833549+0000","last_unstale":"2023-12-01T01:02:58.634745+0000","last_undegraded":"2023-12-01T01:02:58.634745+0000","last_fullsized":"2023-12-01T01:02:58.634745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:35:02.581360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.000743+0000","last_change":"2023-12-01T01:02:47.273884+0000","last_active":"2023-12-01T01:03:58.000743+0000","last_peered":"2023-12-01T01:03:58.000743+0000","last_clean":"2023-12-01T01:03:58.000743+0000","last_became_active":"2023-12-01T01:02:47.273575+0000","last_became_peered":"2023-12-01T01:02:47.273575+0000","last_unstale":"2023-12-01T01:03:58.000743+0000","last_undegraded":"2023-12-01T01:03:58.000743+0000","last_fullsized":"2023-12-01T01:03:58.000743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:49:54.924619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635351+0000","last_change":"2023-12-01T01:02:46.832265+0000","last_active":"2023-12-01T01:02:58.635351+0000","last_peered":"2023-12-01T01:02:58.635351+0000","last_clean":"2023-12-01T01:02:58.635351+0000","last_became_active":"2023-12-01T01:02:46.831944+0000","last_became_peered":"2023-12-01T01:02:46.831944+0000","last_unstale":"2023-12-01T01:02:58.635351+0000","last_undegraded":"2023-12-01T01:02:58.635351+0000","last_fullsized":"2023-12-01T01:02:58.635351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:54:54.814744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996133+0000","last_change":"2023-12-01T01:02:47.276967+0000","last_active":"2023-12-01T01:03:57.996133+0000","last_peered":"2023-12-01T01:03:57.996133+0000","last_clean":"2023-12-01T01:03:57.996133+0000","last_became_active":"2023-12-01T01:02:47.276660+0000","last_became_peered":"2023-12-01T01:02:47.276660+0000","last_unstale":"2023-12-01T01:03:57.996133+0000","last_undegraded":"2023-12-01T01:03:57.996133+0000","last_fullsized":"2023-12-01T01:03:57.996133+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:19:16.029376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634786+0000","last_change":"2023-12-01T01:02:46.834425+0000","last_active":"2023-12-01T01:02:58.634786+0000","last_peered":"2023-12-01T01:02:58.634786+0000","last_clean":"2023-12-01T01:02:58.634786+0000","last_became_active":"2023-12-01T01:02:46.834150+0000","last_became_peered":"2023-12-01T01:02:46.834150+0000","last_unstale":"2023-12-01T01:02:58.634786+0000","last_undegraded":"2023-12-01T01:02:58.634786+0000","last_fullsized":"2023-12-01T01:02:58.634786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:52:39.619014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996630+0000","last_change":"2023-12-01T01:02:47.276386+0000","last_active":"2023-12-01T01:03:57.996630+0000","last_peered":"2023-12-01T01:03:57.996630+0000","last_clean":"2023-12-01T01:03:57.996630+0000","last_became_active":"2023-12-01T01:02:47.276092+0000","last_became_peered":"2023-12-01T01:02:47.276092+0000","last_unstale":"2023-12-01T01:03:57.996630+0000","last_undegraded":"2023-12-01T01:03:57.996630+0000","last_fullsized":"2023-12-01T01:03:57.996630+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:33:39.707619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638513+0000","last_change":"2023-12-01T01:02:46.832778+0000","last_active":"2023-12-01T01:02:58.638513+0000","last_peered":"2023-12-01T01:02:58.638513+0000","last_clean":"2023-12-01T01:02:58.638513+0000","last_became_active":"2023-12-01T01:02:46.832406+0000","last_became_peered":"2023-12-01T01:02:46.832406+0000","last_unstale":"2023-12-01T01:02:58.638513+0000","last_undegraded":"2023-12-01T01:02:58.638513+0000","last_fullsized":"2023-12-01T01:02:58.638513+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:06:08.569651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996321+0000","last_change":"2023-12-01T01:02:59.639129+0000","last_active":"2023-12-01T01:03:57.996321+0000","last_peered":"2023-12-01T01:03:57.996321+0000","last_clean":"2023-12-01T01:03:57.996321+0000","last_became_active":"2023-12-01T01:02:59.638745+0000","last_became_peered":"2023-12-01T01:02:59.638745+0000","last_unstale":"2023-12-01T01:03:57.996321+0000","last_undegraded":"2023-12-01T01:03:57.996321+0000","last_fullsized":"2023-12-01T01:03:57.996321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:26:26.032297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.003323+0000","last_change":"2023-12-01T01:02:47.269953+0000","last_active":"2023-12-01T01:03:58.003323+0000","last_peered":"2023-12-01T01:03:58.003323+0000","last_clean":"2023-12-01T01:03:58.003323+0000","last_became_active":"2023-12-01T01:02:47.265723+0000","last_became_peered":"2023-12-01T01:02:47.265723+0000","last_unstale":"2023-12-01T01:03:58.003323+0000","last_undegraded":"2023-12-01T01:03:58.003323+0000","last_fullsized":"2023-12-01T01:03:58.003323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:28:44.370883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:08.449625+0000","last_change":"2023-12-01T01:02:46.827001+0000","last_active":"2023-12-01T01:04:08.449625+0000","last_peered":"2023-12-01T01:04:08.449625+0000","last_clean":"2023-12-01T01:04:08.449625+0000","last_became_active":"2023-12-01T01:02:46.826690+0000","last_became_peered":"2023-12-01T01:02:46.826690+0000","last_unstale":"2023-12-01T01:04:08.449625+0000","last_undegraded":"2023-12-01T01:04:08.449625+0000","last_fullsized":"2023-12-01T01:04:08.449625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:37:38.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006285+0000","last_change":"2023-12-01T01:02:47.283372+0000","last_active":"2023-12-01T01:03:58.006285+0000","last_peered":"2023-12-01T01:03:58.006285+0000","last_clean":"2023-12-01T01:03:58.006285+0000","last_became_active":"2023-12-01T01:02:47.283075+0000","last_became_peered":"2023-12-01T01:02:47.283075+0000","last_unstale":"2023-12-01T01:03:58.006285+0000","last_undegraded":"2023-12-01T01:03:58.006285+0000","last_fullsized":"2023-12-01T01:03:58.006285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:37:07.707284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.631280+0000","last_change":"2023-12-01T01:02:46.828490+0000","last_active":"2023-12-01T01:02:58.631280+0000","last_peered":"2023-12-01T01:02:58.631280+0000","last_clean":"2023-12-01T01:02:58.631280+0000","last_became_active":"2023-12-01T01:02:46.828129+0000","last_became_peered":"2023-12-01T01:02:46.828129+0000","last_unstale":"2023-12-01T01:02:58.631280+0000","last_undegraded":"2023-12-01T01:02:58.631280+0000","last_fullsized":"2023-12-01T01:02:58.631280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:52:17.060443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":322,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638309+0000","last_change":"2023-12-01T01:01:49.966660+0000","last_active":"2023-12-01T01:02:58.638309+0000","last_peered":"2023-12-01T01:02:58.638309+0000","last_clean":"2023-12-01T01:02:58.638309+0000","last_became_active":"2023-12-01T01:01:49.966125+0000","last_became_peered":"2023-12-01T01:01:49.966125+0000","last_unstale":"2023-12-01T01:02:58.638309+0000","last_undegraded":"2023-12-01T01:02:58.638309+0000","last_fullsized":"2023-12-01T01:02:58.638309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T00:59:06.461487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T00:59:06.461487+0000","last_clean_scrub_stamp":"2023-12-01T00:59:06.461487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:34:52.236994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.994773+0000","last_change":"2023-12-01T01:02:47.282702+0000","last_active":"2023-12-01T01:03:57.994773+0000","last_peered":"2023-12-01T01:03:57.994773+0000","last_clean":"2023-12-01T01:03:57.994773+0000","last_became_active":"2023-12-01T01:02:47.282368+0000","last_became_peered":"2023-12-01T01:02:47.282368+0000","last_unstale":"2023-12-01T01:03:57.994773+0000","last_undegraded":"2023-12-01T01:03:57.994773+0000","last_fullsized":"2023-12-01T01:03:57.994773+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:24:40.985055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638420+0000","last_change":"2023-12-01T01:02:46.827882+0000","last_active":"2023-12-01T01:02:58.638420+0000","last_peered":"2023-12-01T01:02:58.638420+0000","last_clean":"2023-12-01T01:02:58.638420+0000","last_became_active":"2023-12-01T01:02:46.827354+0000","last_became_peered":"2023-12-01T01:02:46.827354+0000","last_unstale":"2023-12-01T01:02:58.638420+0000","last_undegraded":"2023-12-01T01:02:58.638420+0000","last_fullsized":"2023-12-01T01:02:58.638420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:48:42.894733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635396+0000","last_change":"2023-12-01T01:02:46.833439+0000","last_active":"2023-12-01T01:02:58.635396+0000","last_peered":"2023-12-01T01:02:58.635396+0000","last_clean":"2023-12-01T01:02:58.635396+0000","last_became_active":"2023-12-01T01:02:46.833199+0000","last_became_peered":"2023-12-01T01:02:46.833199+0000","last_unstale":"2023-12-01T01:02:58.635396+0000","last_undegraded":"2023-12-01T01:02:58.635396+0000","last_fullsized":"2023-12-01T01:02:58.635396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:44:49.559138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999313+0000","last_change":"2023-12-01T01:02:47.283580+0000","last_active":"2023-12-01T01:03:57.999313+0000","last_peered":"2023-12-01T01:03:57.999313+0000","last_clean":"2023-12-01T01:03:57.999313+0000","last_became_active":"2023-12-01T01:02:47.283095+0000","last_became_peered":"2023-12-01T01:02:47.283095+0000","last_unstale":"2023-12-01T01:03:57.999313+0000","last_undegraded":"2023-12-01T01:03:57.999313+0000","last_fullsized":"2023-12-01T01:03:57.999313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:33:12.541487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:01.002114+0000","last_change":"2023-12-01T01:02:46.831348+0000","last_active":"2023-12-01T01:04:01.002114+0000","last_peered":"2023-12-01T01:04:01.002114+0000","last_clean":"2023-12-01T01:04:01.002114+0000","last_became_active":"2023-12-01T01:02:46.831031+0000","last_became_peered":"2023-12-01T01:02:46.831031+0000","last_unstale":"2023-12-01T01:04:01.002114+0000","last_undegraded":"2023-12-01T01:04:01.002114+0000","last_fullsized":"2023-12-01T01:04:01.002114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:15:53.172465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996739+0000","last_change":"2023-12-01T01:02:47.276281+0000","last_active":"2023-12-01T01:03:57.996739+0000","last_peered":"2023-12-01T01:03:57.996739+0000","last_clean":"2023-12-01T01:03:57.996739+0000","last_became_active":"2023-12-01T01:02:47.275573+0000","last_became_peered":"2023-12-01T01:02:47.275573+0000","last_unstale":"2023-12-01T01:03:57.996739+0000","last_undegraded":"2023-12-01T01:03:57.996739+0000","last_fullsized":"2023-12-01T01:03:57.996739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:50:07.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.631688+0000","last_change":"2023-12-01T01:02:46.823053+0000","last_active":"2023-12-01T01:02:58.631688+0000","last_peered":"2023-12-01T01:02:58.631688+0000","last_clean":"2023-12-01T01:02:58.631688+0000","last_became_active":"2023-12-01T01:02:46.822772+0000","last_became_peered":"2023-12-01T01:02:46.822772+0000","last_unstale":"2023-12-01T01:02:58.631688+0000","last_undegraded":"2023-12-01T01:02:58.631688+0000","last_fullsized":"2023-12-01T01:02:58.631688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:43:22.496286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996524+0000","last_change":"2023-12-01T01:02:47.289484+0000","last_active":"2023-12-01T01:03:57.996524+0000","last_peered":"2023-12-01T01:03:57.996524+0000","last_clean":"2023-12-01T01:03:57.996524+0000","last_became_active":"2023-12-01T01:02:47.289176+0000","last_became_peered":"2023-12-01T01:02:47.289176+0000","last_unstale":"2023-12-01T01:03:57.996524+0000","last_undegraded":"2023-12-01T01:03:57.996524+0000","last_fullsized":"2023-12-01T01:03:57.996524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:21:52.905017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634804+0000","last_change":"2023-12-01T01:02:46.830635+0000","last_active":"2023-12-01T01:02:58.634804+0000","last_peered":"2023-12-01T01:02:58.634804+0000","last_clean":"2023-12-01T01:02:58.634804+0000","last_became_active":"2023-12-01T01:02:46.830337+0000","last_became_peered":"2023-12-01T01:02:46.830337+0000","last_unstale":"2023-12-01T01:02:58.634804+0000","last_undegraded":"2023-12-01T01:02:58.634804+0000","last_fullsized":"2023-12-01T01:02:58.634804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:02:10.017744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.964199+0000","last_change":"2023-12-01T01:02:47.281923+0000","last_active":"2023-12-01T01:03:57.964199+0000","last_peered":"2023-12-01T01:03:57.964199+0000","last_clean":"2023-12-01T01:03:57.964199+0000","last_became_active":"2023-12-01T01:02:47.281598+0000","last_became_peered":"2023-12-01T01:02:47.281598+0000","last_unstale":"2023-12-01T01:03:57.964199+0000","last_undegraded":"2023-12-01T01:03:57.964199+0000","last_fullsized":"2023-12-01T01:03:57.964199+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:07:54.327023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637701+0000","last_change":"2023-12-01T01:02:46.830248+0000","last_active":"2023-12-01T01:02:58.637701+0000","last_peered":"2023-12-01T01:02:58.637701+0000","last_clean":"2023-12-01T01:02:58.637701+0000","last_became_active":"2023-12-01T01:02:46.829951+0000","last_became_peered":"2023-12-01T01:02:46.829951+0000","last_unstale":"2023-12-01T01:02:58.637701+0000","last_undegraded":"2023-12-01T01:02:58.637701+0000","last_fullsized":"2023-12-01T01:02:58.637701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:04:23.978035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.992005+0000","last_change":"2023-12-01T01:02:47.280871+0000","last_active":"2023-12-01T01:03:57.992005+0000","last_peered":"2023-12-01T01:03:57.992005+0000","last_clean":"2023-12-01T01:03:57.992005+0000","last_became_active":"2023-12-01T01:02:47.280527+0000","last_became_peered":"2023-12-01T01:02:47.280527+0000","last_unstale":"2023-12-01T01:03:57.992005+0000","last_undegraded":"2023-12-01T01:03:57.992005+0000","last_fullsized":"2023-12-01T01:03:57.992005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:16:47.700500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.644414+0000","last_change":"2023-12-01T01:02:59.643980+0000","last_active":"2023-12-01T01:02:59.644414+0000","last_peered":"2023-12-01T01:02:59.644414+0000","last_clean":"2023-12-01T01:02:59.644414+0000","last_became_active":"2023-12-01T01:02:59.641039+0000","last_became_peered":"2023-12-01T01:02:59.641039+0000","last_unstale":"2023-12-01T01:02:59.644414+0000","last_undegraded":"2023-12-01T01:02:59.644414+0000","last_fullsized":"2023-12-01T01:02:59.644414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:06:23.044556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996416+0000","last_change":"2023-12-01T01:02:47.284981+0000","last_active":"2023-12-01T01:03:57.996416+0000","last_peered":"2023-12-01T01:03:57.996416+0000","last_clean":"2023-12-01T01:03:57.996416+0000","last_became_active":"2023-12-01T01:02:47.284576+0000","last_became_peered":"2023-12-01T01:02:47.284576+0000","last_unstale":"2023-12-01T01:03:57.996416+0000","last_undegraded":"2023-12-01T01:03:57.996416+0000","last_fullsized":"2023-12-01T01:03:57.996416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:58:21.152156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634597+0000","last_change":"2023-12-01T01:02:46.828769+0000","last_active":"2023-12-01T01:02:58.634597+0000","last_peered":"2023-12-01T01:02:58.634597+0000","last_clean":"2023-12-01T01:02:58.634597+0000","last_became_active":"2023-12-01T01:02:46.828498+0000","last_became_peered":"2023-12-01T01:02:46.828498+0000","last_unstale":"2023-12-01T01:02:58.634597+0000","last_undegraded":"2023-12-01T01:02:58.634597+0000","last_fullsized":"2023-12-01T01:02:58.634597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:12:26.618082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006850+0000","last_change":"2023-12-01T01:02:47.283179+0000","last_active":"2023-12-01T01:03:58.006850+0000","last_peered":"2023-12-01T01:03:58.006850+0000","last_clean":"2023-12-01T01:03:58.006850+0000","last_became_active":"2023-12-01T01:02:47.282883+0000","last_became_peered":"2023-12-01T01:02:47.282883+0000","last_unstale":"2023-12-01T01:03:58.006850+0000","last_undegraded":"2023-12-01T01:03:58.006850+0000","last_fullsized":"2023-12-01T01:03:58.006850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:19:47.406888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635111+0000","last_change":"2023-12-01T01:02:46.833482+0000","last_active":"2023-12-01T01:02:58.635111+0000","last_peered":"2023-12-01T01:02:58.635111+0000","last_clean":"2023-12-01T01:02:58.635111+0000","last_became_active":"2023-12-01T01:02:46.833200+0000","last_became_peered":"2023-12-01T01:02:46.833200+0000","last_unstale":"2023-12-01T01:02:58.635111+0000","last_undegraded":"2023-12-01T01:02:58.635111+0000","last_fullsized":"2023-12-01T01:02:58.635111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:52:41.480509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.007582+0000","last_change":"2023-12-01T01:02:47.275802+0000","last_active":"2023-12-01T01:03:58.007582+0000","last_peered":"2023-12-01T01:03:58.007582+0000","last_clean":"2023-12-01T01:03:58.007582+0000","last_became_active":"2023-12-01T01:02:47.274837+0000","last_became_peered":"2023-12-01T01:02:47.274837+0000","last_unstale":"2023-12-01T01:03:58.007582+0000","last_undegraded":"2023-12-01T01:03:58.007582+0000","last_fullsized":"2023-12-01T01:03:58.007582+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:43:30.799999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638603+0000","last_change":"2023-12-01T01:02:46.829445+0000","last_active":"2023-12-01T01:02:58.638603+0000","last_peered":"2023-12-01T01:02:58.638603+0000","last_clean":"2023-12-01T01:02:58.638603+0000","last_became_active":"2023-12-01T01:02:46.829120+0000","last_became_peered":"2023-12-01T01:02:46.829120+0000","last_unstale":"2023-12-01T01:02:58.638603+0000","last_undegraded":"2023-12-01T01:02:58.638603+0000","last_fullsized":"2023-12-01T01:02:58.638603+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:57:44.467570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997242+0000","last_change":"2023-12-01T01:02:47.282683+0000","last_active":"2023-12-01T01:03:57.997242+0000","last_peered":"2023-12-01T01:03:57.997242+0000","last_clean":"2023-12-01T01:03:57.997242+0000","last_became_active":"2023-12-01T01:02:47.282346+0000","last_became_peered":"2023-12-01T01:02:47.282346+0000","last_unstale":"2023-12-01T01:03:57.997242+0000","last_undegraded":"2023-12-01T01:03:57.997242+0000","last_fullsized":"2023-12-01T01:03:57.997242+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:20:25.085982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629529+0000","last_change":"2023-12-01T01:02:46.828060+0000","last_active":"2023-12-01T01:02:58.629529+0000","last_peered":"2023-12-01T01:02:58.629529+0000","last_clean":"2023-12-01T01:02:58.629529+0000","last_became_active":"2023-12-01T01:02:46.827754+0000","last_became_peered":"2023-12-01T01:02:46.827754+0000","last_unstale":"2023-12-01T01:02:58.629529+0000","last_undegraded":"2023-12-01T01:02:58.629529+0000","last_fullsized":"2023-12-01T01:02:58.629529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:22.794619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999191+0000","last_change":"2023-12-01T01:02:47.269538+0000","last_active":"2023-12-01T01:03:57.999191+0000","last_peered":"2023-12-01T01:03:57.999191+0000","last_clean":"2023-12-01T01:03:57.999191+0000","last_became_active":"2023-12-01T01:02:47.269245+0000","last_became_peered":"2023-12-01T01:02:47.269245+0000","last_unstale":"2023-12-01T01:03:57.999191+0000","last_undegraded":"2023-12-01T01:03:57.999191+0000","last_fullsized":"2023-12-01T01:03:57.999191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:49.163896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997229+0000","last_change":"2023-12-01T01:02:47.277545+0000","last_active":"2023-12-01T01:03:57.997229+0000","last_peered":"2023-12-01T01:03:57.997229+0000","last_clean":"2023-12-01T01:03:57.997229+0000","last_became_active":"2023-12-01T01:02:47.277307+0000","last_became_peered":"2023-12-01T01:02:47.277307+0000","last_unstale":"2023-12-01T01:03:57.997229+0000","last_undegraded":"2023-12-01T01:03:57.997229+0000","last_fullsized":"2023-12-01T01:03:57.997229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:08.655231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.003980+0000","last_change":"2023-12-01T01:03:00.001120+0000","last_active":"2023-12-01T01:03:58.003980+0000","last_peered":"2023-12-01T01:03:58.003980+0000","last_clean":"2023-12-01T01:03:58.003980+0000","last_became_active":"2023-12-01T01:03:00.000707+0000","last_became_peered":"2023-12-01T01:03:00.000707+0000","last_unstale":"2023-12-01T01:03:58.003980+0000","last_undegraded":"2023-12-01T01:03:58.003980+0000","last_fullsized":"2023-12-01T01:03:58.003980+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:12:25.500981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.994726+0000","last_change":"2023-12-01T01:02:47.274775+0000","last_active":"2023-12-01T01:03:57.994726+0000","last_peered":"2023-12-01T01:03:57.994726+0000","last_clean":"2023-12-01T01:03:57.994726+0000","last_became_active":"2023-12-01T01:02:47.274459+0000","last_became_peered":"2023-12-01T01:02:47.274459+0000","last_unstale":"2023-12-01T01:03:57.994726+0000","last_undegraded":"2023-12-01T01:03:57.994726+0000","last_fullsized":"2023-12-01T01:03:57.994726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:06:01.273551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.993086+0000","last_change":"2023-12-01T01:02:47.277487+0000","last_active":"2023-12-01T01:03:57.993086+0000","last_peered":"2023-12-01T01:03:57.993086+0000","last_clean":"2023-12-01T01:03:57.993086+0000","last_became_active":"2023-12-01T01:02:47.277092+0000","last_became_peered":"2023-12-01T01:02:47.277092+0000","last_unstale":"2023-12-01T01:03:57.993086+0000","last_undegraded":"2023-12-01T01:03:57.993086+0000","last_fullsized":"2023-12-01T01:03:57.993086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:02:51.967302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.004024+0000","last_change":"2023-12-01T01:02:47.283814+0000","last_active":"2023-12-01T01:03:58.004024+0000","last_peered":"2023-12-01T01:03:58.004024+0000","last_clean":"2023-12-01T01:03:58.004024+0000","last_became_active":"2023-12-01T01:02:47.283289+0000","last_became_peered":"2023-12-01T01:02:47.283289+0000","last_unstale":"2023-12-01T01:03:58.004024+0000","last_undegraded":"2023-12-01T01:03:58.004024+0000","last_fullsized":"2023-12-01T01:03:58.004024+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:42:59.523846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.989722+0000","last_change":"2023-12-01T01:02:47.281748+0000","last_active":"2023-12-01T01:03:57.989722+0000","last_peered":"2023-12-01T01:03:57.989722+0000","last_clean":"2023-12-01T01:03:57.989722+0000","last_became_active":"2023-12-01T01:02:47.281445+0000","last_became_peered":"2023-12-01T01:02:47.281445+0000","last_unstale":"2023-12-01T01:03:57.989722+0000","last_undegraded":"2023-12-01T01:03:57.989722+0000","last_fullsized":"2023-12-01T01:03:57.989722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:33:18.146911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999814+0000","last_change":"2023-12-01T01:02:47.276827+0000","last_active":"2023-12-01T01:03:57.999814+0000","last_peered":"2023-12-01T01:03:57.999814+0000","last_clean":"2023-12-01T01:03:57.999814+0000","last_became_active":"2023-12-01T01:02:47.276346+0000","last_became_peered":"2023-12-01T01:02:47.276346+0000","last_unstale":"2023-12-01T01:03:57.999814+0000","last_undegraded":"2023-12-01T01:03:57.999814+0000","last_fullsized":"2023-12-01T01:03:57.999814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:49:23.203883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.991150+0000","last_change":"2023-12-01T01:02:47.276461+0000","last_active":"2023-12-01T01:03:57.991150+0000","last_peered":"2023-12-01T01:03:57.991150+0000","last_clean":"2023-12-01T01:03:57.991150+0000","last_became_active":"2023-12-01T01:02:47.275992+0000","last_became_peered":"2023-12-01T01:02:47.275992+0000","last_unstale":"2023-12-01T01:03:57.991150+0000","last_undegraded":"2023-12-01T01:03:57.991150+0000","last_fullsized":"2023-12-01T01:03:57.991150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:14:04.629355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.995810+0000","last_change":"2023-12-01T01:02:47.274018+0000","last_active":"2023-12-01T01:03:57.995810+0000","last_peered":"2023-12-01T01:03:57.995810+0000","last_clean":"2023-12-01T01:03:57.995810+0000","last_became_active":"2023-12-01T01:02:47.273714+0000","last_became_peered":"2023-12-01T01:02:47.273714+0000","last_unstale":"2023-12-01T01:03:57.995810+0000","last_undegraded":"2023-12-01T01:03:57.995810+0000","last_fullsized":"2023-12-01T01:03:57.995810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:26:14.154249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.993679+0000","last_change":"2023-12-01T01:02:47.276438+0000","last_active":"2023-12-01T01:03:57.993679+0000","last_peered":"2023-12-01T01:03:57.993679+0000","last_clean":"2023-12-01T01:03:57.993679+0000","last_became_active":"2023-12-01T01:02:47.276121+0000","last_became_peered":"2023-12-01T01:02:47.276121+0000","last_unstale":"2023-12-01T01:03:57.993679+0000","last_undegraded":"2023-12-01T01:03:57.993679+0000","last_fullsized":"2023-12-01T01:03:57.993679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:09:25.689189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.004961+0000","last_change":"2023-12-01T01:02:47.275763+0000","last_active":"2023-12-01T01:03:58.004961+0000","last_peered":"2023-12-01T01:03:58.004961+0000","last_clean":"2023-12-01T01:03:58.004961+0000","last_became_active":"2023-12-01T01:02:47.275484+0000","last_became_peered":"2023-12-01T01:02:47.275484+0000","last_unstale":"2023-12-01T01:03:58.004961+0000","last_undegraded":"2023-12-01T01:03:58.004961+0000","last_fullsized":"2023-12-01T01:03:58.004961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:38:02.612857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006906+0000","last_change":"2023-12-01T01:02:47.274122+0000","last_active":"2023-12-01T01:03:58.006906+0000","last_peered":"2023-12-01T01:03:58.006906+0000","last_clean":"2023-12-01T01:03:58.006906+0000","last_became_active":"2023-12-01T01:02:47.273005+0000","last_became_peered":"2023-12-01T01:02:47.273005+0000","last_unstale":"2023-12-01T01:03:58.006906+0000","last_undegraded":"2023-12-01T01:03:58.006906+0000","last_fullsized":"2023-12-01T01:03:58.006906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:42:59.273076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.992330+0000","last_change":"2023-12-01T01:02:47.270221+0000","last_active":"2023-12-01T01:03:57.992330+0000","last_peered":"2023-12-01T01:03:57.992330+0000","last_clean":"2023-12-01T01:03:57.992330+0000","last_became_active":"2023-12-01T01:02:47.269946+0000","last_became_peered":"2023-12-01T01:02:47.269946+0000","last_unstale":"2023-12-01T01:03:57.992330+0000","last_undegraded":"2023-12-01T01:03:57.992330+0000","last_fullsized":"2023-12-01T01:03:57.992330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:00:01.640510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283824,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69058,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":498,"num_read_kb":319,"num_write":163,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":40837,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":196416,"data_compressed":6441,"data_compressed_allocated":8192,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514525,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":897024,"data_stored":433440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.502,"15min":0.504},"min":{"1min":0.38300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.54400000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.36799999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.60099999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61499999999999999,"15min":0.60899999999999999},"min":{"1min":0.5,"5min":0.371,"15min":0.371},"max":{"1min":0.83599999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.45900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81499999999999995,"5min":1.167,"15min":1.167},"last":0.498}]},{"osd":2,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53000000000000003,"15min":0.53200000000000003},"min":{"1min":0.379,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76900000000000002,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52000000000000002,"15min":0.51300000000000001},"min":{"1min":0.39200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.434}]},{"osd":3,"last update":"Fri Dec 1 01:04:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54200000000000004}]},{"osd":4,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67700000000000005,"15min":0.67300000000000004},"min":{"1min":0.56899999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.875,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.752},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.625},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79200000000000004,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.56399999999999995}]},{"osd":5,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64300000000000002,"15min":0.63500000000000001},"min":{"1min":0.501,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89100000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.877,"5min":1.103,"15min":1.103},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.59099999999999997,"5min":0.502,"15min":0.502},"max":{"1min":0.97699999999999998,"5min":1.153,"15min":1.153},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89400000000000002,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.64300000000000002}]},{"osd":8,"last update":"Fri Dec 1 01:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.79100000000000004}]},{"osd":9,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":0.98099999999999998,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.77400000000000002,"15min":0.76800000000000002},"min":{"1min":0.66400000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.94499999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.85399999999999998}]},{"osd":10,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.63500000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.86099999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.80600000000000005,"15min":0.80300000000000005},"min":{"1min":0.66100000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0109999999999999,"5min":1.482,"15min":1.482},"last":0.73899999999999999}]}]},{"osd":10,"up_from":69,"seq":296352743457,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":1052672,"data_stored":1089889,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.443,"15min":0.443},"min":{"1min":0.29699999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.503},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.30099999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69699999999999995,"5min":1.829,"15min":1.829},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77900000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84399999999999997,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.64900000000000002,"15min":0.66100000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91600000000000004,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.47699999999999998}]},{"osd":4,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.32600000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.80700000000000005,"5min":1.234,"15min":1.234},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.82699999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63100000000000001,"15min":0.623},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.90700000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98099999999999998,"5min":1.173,"15min":1.173},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.40699999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88900000000000001,"5min":1.302,"15min":1.302},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96399999999999997,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0569999999999999,"5min":1.198,"15min":1.198},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.53400000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95199999999999996,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72799999999999998}]},{"osd":9,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81899999999999995,"15min":0.82399999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.753,"15min":0.75900000000000001},"min":{"1min":0.48599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92700000000000005,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64500000000000002}]},{"osd":11,"last update":"Fri Dec 1 01:04:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68200000000000005,"15min":0.67600000000000005},"min":{"1min":0.54200000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71099999999999997,"15min":0.70099999999999996},"min":{"1min":0.53200000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.66700000000000004}]}]},{"osd":9,"up_from":64,"seq":274877906980,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":913408,"data_stored":433676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.45200000000000001,"15min":0.46300000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58499999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.318},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.46800000000000003,"15min":0.47699999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64600000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.372}]},{"osd":1,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73799999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.65000000000000002,"15min":0.63100000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":4.5899999999999999,"5min":4.5899999999999999,"15min":4.5899999999999999},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63,"15min":0.63900000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91900000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.46800000000000003}]},{"osd":3,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.59199999999999997,"15min":0.60799999999999998},"min":{"1min":0.317,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.748,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53500000000000003,"15min":0.54300000000000004},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83999999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.90600000000000003,"15min":0.94999999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89200000000000002,"5min":4.2309999999999999,"15min":4.2309999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":4.6200000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.64000000000000001,"15min":0.65300000000000002},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81699999999999995,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.70299999999999996,"15min":0.71899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95699999999999996,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.6040000000000001,"5min":4.6040000000000001,"15min":4.6040000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98999999999999999,"5min":1.111,"15min":1.111},"last":0.61799999999999999}]},{"osd":8,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76300000000000001,"15min":0.77200000000000002},"min":{"1min":0.54600000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":1.071,"15min":1.1259999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.004,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.502}]},{"osd":10,"last update":"Fri Dec 1 01:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.55500000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.88600000000000001,"5min":4.6369999999999996,"15min":4.6369999999999996},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.92700000000000005,"15min":0.96499999999999997},"min":{"1min":0.57899999999999996,"5min":0.504,"15min":0.504},"max":{"1min":0.84799999999999998,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.67800000000000005}]}]},{"osd":8,"up_from":57,"seq":244813135912,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":913408,"data_stored":433596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60799999999999998,"15min":0.63400000000000001},"min":{"1min":0.41299999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.745,"5min":2.25,"15min":2.25},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":2.234,"15min":2.234},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96999999999999997,"5min":2.234,"15min":2.234},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58599999999999997}]},{"osd":2,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72899999999999998,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52700000000000002,"15min":0.54300000000000004},"min":{"1min":0.29299999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.80700000000000005,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67200000000000004,"15min":0.69199999999999995},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86299999999999999,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81999999999999995,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.748}]},{"osd":4,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.60999999999999999,"15min":0.60399999999999998},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79600000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82699999999999996,"5min":2.222,"15min":2.222},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65800000000000003,"15min":0.68000000000000005},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84499999999999997,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.41399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.78000000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.78400000000000003},"min":{"1min":0.439,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89100000000000001,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.80100000000000005,"15min":0.81100000000000005},"min":{"1min":0.54600000000000004,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4299999999999999,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.84499999999999997}]},{"osd":7,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.79100000000000004},"min":{"1min":0.46500000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98399999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.51900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0029999999999999,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.96599999999999997}]},{"osd":9,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.82099999999999995,"15min":0.80300000000000005},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.3259999999999996,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.85099999999999998,"15min":0.85299999999999998},"min":{"1min":0.626,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.0550000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.92800000000000005}]},{"osd":10,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78400000000000003,"15min":0.78200000000000003},"min":{"1min":0.5,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.101,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82099999999999995,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0629999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.876}]},{"osd":11,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.94199999999999995}]}]},{"osd":7,"up_from":50,"seq":214748364844,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":1026113,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.39600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.36199999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.58599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.434,"15min":0.42199999999999999},"min":{"1min":0.34200000000000003,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.75700000000000001}]},{"osd":2,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.44500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82099999999999995,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60299999999999998,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85199999999999998,"5min":1.383,"15min":1.383},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.627},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80000000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.67000000000000004}]},{"osd":4,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.39100000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73999999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.379,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64600000000000002,"15min":0.63300000000000001},"min":{"1min":0.49299999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86599999999999999,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.59999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84799999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90500000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.77600000000000002}]},{"osd":8,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.54300000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71499999999999997,"15min":0.71199999999999997},"min":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88700000000000001,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.82699999999999996}]},{"osd":9,"last update":"Fri Dec 1 01:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.54200000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98199999999999998,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.52800000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.88800000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83699999999999997}]},{"osd":10,"last update":"Fri Dec 1 01:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.52500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.012,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.68500000000000005,"15min":0.67700000000000005},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.873}]},{"osd":11,"last update":"Fri Dec 1 01:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.90900000000000003}]}]},{"osd":6,"up_from":45,"seq":193273528368,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":901120,"data_stored":433071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.45300000000000001,"15min":0.436},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":3.036,"5min":3.036,"15min":3.036},"last":0.317}]},{"osd":1,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.45400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76700000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.59699999999999998,"15min":0.57899999999999996},"min":{"1min":0.46600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.626,"15min":0.622},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.439}]},{"osd":3,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33900000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.86299999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53600000000000003,"15min":0.52500000000000002},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.314},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.42799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.96299999999999997,"5min":1.248,"15min":1.248},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.62,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.46100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.78800000000000003,"5min":1.204,"15min":1.204},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.41999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.9950000000000001,"5min":2.9950000000000001,"15min":2.9950000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.04,"5min":1.319,"15min":1.319},"last":0.48699999999999999}]},{"osd":7,"last update":"Fri Dec 1 01:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.53600000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93300000000000005,"5min":1.149,"15min":1.149},"last":0.55300000000000005}]},{"osd":8,"last update":"Fri Dec 1 01:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.52000000000000002,"5min":0.502,"15min":0.502},"max":{"1min":0.95299999999999996,"5min":1.276,"15min":1.276},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.51400000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84699999999999998,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.499}]},{"osd":9,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.64900000000000002,"15min":0.66800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0629999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":3.6259999999999999,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.57399999999999995}]},{"osd":10,"last update":"Fri Dec 1 01:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.51100000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98299999999999998,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.86199999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":491637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51500000000000001,"15min":0.50600000000000001},"min":{"1min":0.40999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53400000000000003,"15min":0.51400000000000001},"min":{"1min":0.36299999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.54200000000000004,"15min":0.499},"min":{"1min":0.52600000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.55000000000000004,"15min":0.505},"min":{"1min":0.46700000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.90100000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.77800000000000002}]},{"osd":3,"last update":"Fri Dec 1 01:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52900000000000003,"15min":0.51600000000000001},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67300000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57499999999999996,"15min":0.54800000000000004},"min":{"1min":0.41199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Dec 1 01:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.434,"15min":0.38200000000000001},"min":{"1min":0.35999999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.46000000000000002,"15min":0.40200000000000002},"min":{"1min":0.39900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.40400000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.58599999999999997,"15min":0.55600000000000005},"min":{"1min":0.51600000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.60099999999999998,"15min":0.56599999999999995},"min":{"1min":0.53600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.59899999999999998,"15min":0.55900000000000005},"min":{"1min":0.495,"5min":0.377,"15min":0.377},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.47499999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.58899999999999997,"15min":0.53600000000000003},"min":{"1min":0.50600000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.58399999999999996,"15min":0.55400000000000005},"min":{"1min":0.44900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63}]},{"osd":8,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.56000000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.66300000000000003}]},{"osd":9,"last update":"Fri Dec 1 01:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.745}]},{"osd":10,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.53000000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.77400000000000002,"15min":0.75700000000000001},"min":{"1min":0.67500000000000004,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.80700000000000005}]},{"osd":11,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.83299999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":921600,"data_stored":434336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 01:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53600000000000003,"15min":0.52100000000000002},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65000000000000002,"5min":1.131,"15min":1.131},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.70699999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.42899999999999999}]},{"osd":2,"last update":"Fri Dec 1 01:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.37,"15min":0.37},"max":{"1min":0.86499999999999999,"5min":0.875,"15min":0.875},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.33500000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55500000000000005,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68400000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55900000000000005,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66300000000000003,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.41499999999999998}]},{"osd":5,"last update":"Fri Dec 1 01:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.628}]},{"osd":8,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.63800000000000001}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.67500000000000004,"15min":0.69699999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.93100000000000005,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.71199999999999997,"15min":0.73399999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94799999999999995,"5min":1.024,"15min":1.024},"last":0.495}]},{"osd":10,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.75800000000000001,"15min":0.77600000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.878,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.73999999999999999,"15min":0.76000000000000001},"min":{"1min":0.42999999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89600000000000002,"5min":1.175,"15min":1.175},"last":0.503}]},{"osd":11,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.628},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.56399999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":917504,"data_stored":434694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.5,"15min":0.48399999999999999},"min":{"1min":0.35999999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.874,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.309,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.47399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.54600000000000004,"15min":0.52400000000000002},"min":{"1min":0.39800000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.70399999999999996}]},{"osd":3,"last update":"Fri Dec 1 01:03:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55600000000000005,"15min":0.52100000000000002},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.628},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.52700000000000002},"min":{"1min":0.42999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.60099999999999998}]},{"osd":4,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.44600000000000001,"15min":0.41199999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.442},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.42599999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.46300000000000002}]},{"osd":6,"last update":"Fri Dec 1 01:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.53400000000000003},"min":{"1min":0.36799999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83299999999999996,"5min":0.877,"15min":0.877},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.628,"15min":0.59799999999999998},"min":{"1min":0.52000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.59199999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.58099999999999996,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.54500000000000004,"15min":0.53300000000000003},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.64000000000000001}]},{"osd":9,"last update":"Fri Dec 1 01:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.47499999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.52800000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.69299999999999995}]},{"osd":10,"last update":"Fri Dec 1 01:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.55600000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.61499999999999999}]},{"osd":11,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68400000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182460,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":917504,"data_stored":433388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.35599999999999998},"min":{"1min":0.26600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.41499999999999998,"15min":0.38100000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.32100000000000001}]},{"osd":1,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.51200000000000001},"min":{"1min":0.441,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.58899999999999997,"15min":0.52900000000000003},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.71199999999999997}]},{"osd":2,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Dec 1 01:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.47499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60599999999999998,"15min":0.57799999999999996},"min":{"1min":0.39600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77600000000000002,"5min":1.976,"15min":1.976},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Dec 1 01:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.623,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.621,"15min":0.59699999999999998},"min":{"1min":0.45700000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57499999999999996,"15min":0.55900000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.41499999999999998}]},{"osd":7,"last update":"Fri Dec 1 01:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.72299999999999998,"15min":0.72899999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81999999999999995,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.52900000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.872,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.66700000000000004}]},{"osd":8,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.65200000000000002}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.751,"15min":0.76900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.442},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.76500000000000001,"15min":0.78900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.61199999999999999}]},{"osd":10,"last update":"Fri Dec 1 01:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.86099999999999999,"15min":0.89300000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.81599999999999995,"5min":2.048,"15min":2.048},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.84999999999999998,"15min":0.88},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90200000000000002,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.63}]},{"osd":11,"last update":"Fri Dec 1 01:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.68000000000000005}]}]},{"osd":4,"up_from":32,"seq":137438953528,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":946176,"data_stored":492767,"data_compressed":6441,"data_compressed_allocated":8192,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51600000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.85099999999999998,"5min":0.88,"15min":0.88},"last":0.371},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.42999999999999999}]},{"osd":1,"last update":"Fri Dec 1 01:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.38800000000000001,"15min":0.36899999999999999},"min":{"1min":0.28100000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.61199999999999999,"5min":0.627,"15min":0.627},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.38800000000000001},"min":{"1min":0.32700000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63200000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.437}]},{"osd":2,"last update":"Fri Dec 1 01:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.63700000000000001,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":6.0110000000000001,"5min":6.0110000000000001,"15min":6.0110000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57399999999999995,"15min":0.55400000000000005},"min":{"1min":0.38800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Dec 1 01:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57699999999999996,"15min":0.55100000000000005},"min":{"1min":0.379,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75,"5min":1.004,"15min":1.004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80600000000000005,"5min":0.879,"15min":0.879},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59999999999999998,"15min":0.57799999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76600000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Dec 1 01:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93300000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.82499999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.64200000000000002}]},{"osd":7,"last update":"Fri Dec 1 01:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.872,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.57399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80200000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.72999999999999998}]},{"osd":8,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.93400000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.006,"5min":0.77800000000000002,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":6.0419999999999998,"5min":6.0419999999999998,"15min":6.0419999999999998},"last":0.66500000000000004}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.76300000000000001},"min":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96999999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.74199999999999999}]},{"osd":10,"last update":"Fri Dec 1 01:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.745,"15min":0.74099999999999999},"min":{"1min":0.55000000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.80200000000000005}]},{"osd":11,"last update":"Fri Dec 1 01:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.76200000000000001}]}]},{"osd":5,"up_from":37,"seq":158913790005,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":974848,"data_stored":1025311,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.49199999999999999},"min":{"1min":0.374,"5min":0.249,"15min":0.249},"max":{"1min":0.73199999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.495,"15min":0.48899999999999999},"min":{"1min":0.35299999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69799999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.443}]},{"osd":1,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53000000000000003},"min":{"1min":0.45700000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.56899999999999995,"15min":0.54100000000000004},"min":{"1min":0.47299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79100000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39700000000000002,"15min":0.38400000000000001},"min":{"1min":0.30399999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.436,"15min":0.42899999999999999},"min":{"1min":0.28799999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.315,"5min":0.309,"15min":0.309},"max":{"1min":0.626,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.626},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.378,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60699999999999998,"15min":0.58699999999999997},"min":{"1min":0.46899999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.81799999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.59299999999999997,"15min":0.57699999999999996},"min":{"1min":0.54200000000000004,"5min":0.318,"15min":0.318},"max":{"1min":0.77700000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Dec 1 01:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.40500000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.42899999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97199999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Dec 1 01:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63700000000000001,"15min":0.623},"min":{"1min":0.5,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.86099999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81399999999999995,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71599999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.41799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.57499999999999996,"15min":0.56699999999999995},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.66800000000000004}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.72199999999999998,"15min":0.68200000000000005},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.673,"5min":5.673,"15min":5.673},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.01,"5min":0.77800000000000002,"15min":0.73999999999999999},"min":{"1min":0.48999999999999999,"5min":0.439,"15min":0.439},"max":{"1min":5.6390000000000002,"5min":5.6390000000000002,"15min":5.6390000000000002},"last":0.79400000000000004}]},{"osd":10,"last update":"Fri Dec 1 01:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67100000000000004,"15min":0.66300000000000003},"min":{"1min":0.59499999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83399999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.68799999999999994,"15min":0.68200000000000005},"min":{"1min":0.57499999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84699999999999998,"5min":1.004,"15min":1.004},"last":0.754}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":58779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":60227,"data_compressed":6441,"data_compressed_allocated":8192,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T01:04:14.148 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T01:04:14.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:13 smithi116 ceph-mon[103554]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-01T01:04:14.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:13 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3782581402' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:04:14.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:13 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1512757289' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:04:14.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:13 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2056096224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:04:14.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:13 smithi093 ceph-mon[103327]: pgmap v290: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-01T01:04:14.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:13 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3782581402' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:04:14.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:13 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1512757289' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:04:14.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:13 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2056096224' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:04:14.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.307+0000 7f6f044bd700 1 -- 172.21.15.26:0/2078930894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6efc101800 msgr2=0x7f6efc1080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:14.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.307+0000 7f6f044bd700 1 --2- 172.21.15.26:0/2078930894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6efc101800 0x7f6efc1080b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400b0d0 tx=0x7f6ef400b3e0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.307+0000 7f6f044bd700 1 -- 172.21.15.26:0/2078930894 shutdown_connections 2023-12-01T01:04:14.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.307+0000 7f6f044bd700 1 --2- 172.21.15.26:0/2078930894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6efc101800 0x7f6efc1080b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.307+0000 7f6f044bd700 1 --2- 172.21.15.26:0/2078930894 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0ffc70 0x7f6efc100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.307+0000 7f6f044bd700 1 --2- 172.21.15.26:0/2078930894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6efc100e60 0x7f6efc1012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.307+0000 7f6f044bd700 1 -- 172.21.15.26:0/2078930894 >> 172.21.15.26:0/2078930894 conn(0x7f6efc0fb1c0 msgr2=0x7f6efc0fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:14.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.307+0000 7f6f044bd700 1 -- 172.21.15.26:0/2078930894 shutdown_connections 2023-12-01T01:04:14.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.307+0000 7f6f044bd700 1 -- 172.21.15.26:0/2078930894 wait complete. 2023-12-01T01:04:14.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f044bd700 1 Processor -- start 2023-12-01T01:04:14.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f044bd700 1 -- start start 2023-12-01T01:04:14.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f044bd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0ffc70 0x7f6efc198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:14.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f044bd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6efc100e60 0x7f6efc199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:14.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f044bd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6efc101800 0x7f6efc1a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f044bd700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc1a0940 con 0x7f6efc101800 2023-12-01T01:04:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f044bd700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc1a0a80 con 0x7f6efc0ffc70 2023-12-01T01:04:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f044bd700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc1a0c10 con 0x7f6efc100e60 2023-12-01T01:04:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f02a5a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6efc101800 0x7f6efc1a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f02a5a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6efc101800 0x7f6efc1a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55008/0 (socket says 172.21.15.26:55008) 2023-12-01T01:04:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f02a5a700 1 -- 172.21.15.26:0/3110515254 learned_addr learned my addr 172.21.15.26:0/3110515254 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f01a58700 1 --2- 172.21.15.26:0/3110515254 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6efc100e60 0x7f6efc199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f02259700 1 --2- 172.21.15.26:0/3110515254 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0ffc70 0x7f6efc198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f02a5a700 1 -- 172.21.15.26:0/3110515254 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6efc100e60 msgr2=0x7f6efc199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f02a5a700 1 --2- 172.21.15.26:0/3110515254 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6efc100e60 0x7f6efc199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f02a5a700 1 -- 172.21.15.26:0/3110515254 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0ffc70 msgr2=0x7f6efc198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f02a5a700 1 --2- 172.21.15.26:0/3110515254 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0ffc70 0x7f6efc198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f02a5a700 1 -- 172.21.15.26:0/3110515254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef4009d00 con 0x7f6efc101800 2023-12-01T01:04:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f02259700 1 --2- 172.21.15.26:0/3110515254 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0ffc70 0x7f6efc198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:14.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.308+0000 7f6f02a5a700 1 --2- 172.21.15.26:0/3110515254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6efc101800 0x7f6efc1a0370 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400d010 tx=0x7f6ef400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:14.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.309+0000 7f6eef7fe700 1 -- 172.21.15.26:0/3110515254 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef400e040 con 0x7f6efc101800 2023-12-01T01:04:14.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.309+0000 7f6eef7fe700 1 -- 172.21.15.26:0/3110515254 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6ef401dd70 con 0x7f6efc101800 2023-12-01T01:04:14.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.309+0000 7f6f044bd700 1 -- 172.21.15.26:0/3110515254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6efc1a0e90 con 0x7f6efc101800 2023-12-01T01:04:14.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.309+0000 7f6eef7fe700 1 -- 172.21.15.26:0/3110515254 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef4012e80 con 0x7f6efc101800 2023-12-01T01:04:14.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.309+0000 7f6f044bd700 1 -- 172.21.15.26:0/3110515254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6efc1a1260 con 0x7f6efc101800 2023-12-01T01:04:14.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.310+0000 7f6f044bd700 1 -- 172.21.15.26:0/3110515254 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6efc10b5d0 con 0x7f6efc101800 2023-12-01T01:04:14.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.311+0000 7f6eef7fe700 1 -- 172.21.15.26:0/3110515254 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f6ef4012470 con 0x7f6efc101800 2023-12-01T01:04:14.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.311+0000 7f6eef7fe700 1 --2- 172.21.15.26:0/3110515254 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6ee80a0570 0x7f6ee80a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:14.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.311+0000 7f6f02259700 1 --2- 172.21.15.26:0/3110515254 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6ee80a0570 0x7f6ee80a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:14.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.311+0000 7f6eef7fe700 1 -- 172.21.15.26:0/3110515254 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6ef40cd6d0 con 0x7f6efc101800 2023-12-01T01:04:14.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.312+0000 7f6f02259700 1 --2- 172.21.15.26:0/3110515254 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6ee80a0570 0x7f6ee80a2a30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6efc100cc0 tx=0x7f6ef0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:14.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.315+0000 7f6eef7fe700 1 -- 172.21.15.26:0/3110515254 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f6ef4097310 con 0x7f6efc101800 2023-12-01T01:04:14.516 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.515+0000 7f6f044bd700 1 -- 172.21.15.26:0/3110515254 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6efc068600 con 0x7f6ee80a0570 2023-12-01T01:04:14.527 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.527+0000 7f6eef7fe700 1 -- 172.21.15.26:0/3110515254 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343920 (secure 0 0 0) 0x7f6efc068600 con 0x7f6ee80a0570 2023-12-01T01:04:14.532 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:04:14.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.530+0000 7f6f044bd700 1 -- 172.21.15.26:0/3110515254 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6ee80a0570 msgr2=0x7f6ee80a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:14.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.530+0000 7f6f044bd700 1 --2- 172.21.15.26:0/3110515254 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6ee80a0570 0x7f6ee80a2a30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6efc100cc0 tx=0x7f6ef0009260 comp rx=0 tx=0).stop 2023-12-01T01:04:14.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.530+0000 7f6f044bd700 1 -- 172.21.15.26:0/3110515254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6efc101800 msgr2=0x7f6efc1a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:14.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.530+0000 7f6f044bd700 1 --2- 172.21.15.26:0/3110515254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6efc101800 0x7f6efc1a0370 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f6ef400d010 tx=0x7f6ef400bd50 comp rx=0 tx=0).stop 2023-12-01T01:04:14.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.530+0000 7f6f044bd700 1 -- 172.21.15.26:0/3110515254 shutdown_connections 2023-12-01T01:04:14.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.530+0000 7f6f044bd700 1 --2- 172.21.15.26:0/3110515254 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6ee80a0570 0x7f6ee80a2a30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.530+0000 7f6f044bd700 1 --2- 172.21.15.26:0/3110515254 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6efc101800 0x7f6efc1a0370 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.530+0000 7f6f044bd700 1 --2- 172.21.15.26:0/3110515254 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0ffc70 0x7f6efc198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.530+0000 7f6f044bd700 1 --2- 172.21.15.26:0/3110515254 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6efc100e60 0x7f6efc199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.530+0000 7f6f044bd700 1 -- 172.21.15.26:0/3110515254 >> 172.21.15.26:0/3110515254 conn(0x7f6efc0fb1c0 msgr2=0x7f6efc067ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:14.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.530+0000 7f6f044bd700 1 -- 172.21.15.26:0/3110515254 shutdown_connections 2023-12-01T01:04:14.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.531+0000 7f6f044bd700 1 -- 172.21.15.26:0/3110515254 wait complete. 2023-12-01T01:04:14.535 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-12-01T01:04:14.544 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2023-12-01T01:04:13.976581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659672,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":624,"num_read_kb":428,"num_write":346,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1221573,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":782,"ondisk_log_size":782,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":334440,"kb_used_data":11016,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124607384,"statfs":{"total":1151940427776,"available":1151597961216,"internally_reserved":0,"allocated":11280384,"data_stored":7161918,"data_compressed":114720,"data_compressed_allocated":143360,"data_compressed_original":1806336,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5946,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":48,"num_write":8,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002985"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006469+0000","last_change":"2023-12-01T01:02:47.280671+0000","last_active":"2023-12-01T01:03:58.006469+0000","last_peered":"2023-12-01T01:03:58.006469+0000","last_clean":"2023-12-01T01:03:58.006469+0000","last_became_active":"2023-12-01T01:02:47.279922+0000","last_became_peered":"2023-12-01T01:02:47.279922+0000","last_unstale":"2023-12-01T01:03:58.006469+0000","last_undegraded":"2023-12-01T01:03:58.006469+0000","last_fullsized":"2023-12-01T01:03:58.006469+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:07:38.049977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.995520+0000","last_change":"2023-12-01T01:02:47.286185+0000","last_active":"2023-12-01T01:03:57.995520+0000","last_peered":"2023-12-01T01:03:57.995520+0000","last_clean":"2023-12-01T01:03:57.995520+0000","last_became_active":"2023-12-01T01:02:47.283747+0000","last_became_peered":"2023-12-01T01:02:47.283747+0000","last_unstale":"2023-12-01T01:03:57.995520+0000","last_undegraded":"2023-12-01T01:03:57.995520+0000","last_fullsized":"2023-12-01T01:03:57.995520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:38:32.697826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.005701+0000","last_change":"2023-12-01T01:02:47.285778+0000","last_active":"2023-12-01T01:03:58.005701+0000","last_peered":"2023-12-01T01:03:58.005701+0000","last_clean":"2023-12-01T01:03:58.005701+0000","last_became_active":"2023-12-01T01:02:47.279395+0000","last_became_peered":"2023-12-01T01:02:47.279395+0000","last_unstale":"2023-12-01T01:03:58.005701+0000","last_undegraded":"2023-12-01T01:03:58.005701+0000","last_fullsized":"2023-12-01T01:03:58.005701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:04:20.570660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996769+0000","last_change":"2023-12-01T01:02:47.269316+0000","last_active":"2023-12-01T01:03:57.996769+0000","last_peered":"2023-12-01T01:03:57.996769+0000","last_clean":"2023-12-01T01:03:57.996769+0000","last_became_active":"2023-12-01T01:02:47.269041+0000","last_became_peered":"2023-12-01T01:02:47.269041+0000","last_unstale":"2023-12-01T01:03:57.996769+0000","last_undegraded":"2023-12-01T01:03:57.996769+0000","last_fullsized":"2023-12-01T01:03:57.996769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:24:27.951422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.991431+0000","last_change":"2023-12-01T01:02:47.273802+0000","last_active":"2023-12-01T01:03:57.991431+0000","last_peered":"2023-12-01T01:03:57.991431+0000","last_clean":"2023-12-01T01:03:57.991431+0000","last_became_active":"2023-12-01T01:02:47.273450+0000","last_became_peered":"2023-12-01T01:02:47.273450+0000","last_unstale":"2023-12-01T01:03:57.991431+0000","last_undegraded":"2023-12-01T01:03:57.991431+0000","last_fullsized":"2023-12-01T01:03:57.991431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:19:39.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.003491+0000","last_change":"2023-12-01T01:02:47.274505+0000","last_active":"2023-12-01T01:03:58.003491+0000","last_peered":"2023-12-01T01:03:58.003491+0000","last_clean":"2023-12-01T01:03:58.003491+0000","last_became_active":"2023-12-01T01:02:47.274141+0000","last_became_peered":"2023-12-01T01:02:47.274141+0000","last_unstale":"2023-12-01T01:03:58.003491+0000","last_undegraded":"2023-12-01T01:03:58.003491+0000","last_fullsized":"2023-12-01T01:03:58.003491+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:27:16.589927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999308+0000","last_change":"2023-12-01T01:02:47.279480+0000","last_active":"2023-12-01T01:03:57.999308+0000","last_peered":"2023-12-01T01:03:57.999308+0000","last_clean":"2023-12-01T01:03:57.999308+0000","last_became_active":"2023-12-01T01:02:47.279147+0000","last_became_peered":"2023-12-01T01:02:47.279147+0000","last_unstale":"2023-12-01T01:03:57.999308+0000","last_undegraded":"2023-12-01T01:03:57.999308+0000","last_fullsized":"2023-12-01T01:03:57.999308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:28:37.815087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997337+0000","last_change":"2023-12-01T01:02:47.283997+0000","last_active":"2023-12-01T01:03:57.997337+0000","last_peered":"2023-12-01T01:03:57.997337+0000","last_clean":"2023-12-01T01:03:57.997337+0000","last_became_active":"2023-12-01T01:02:47.283694+0000","last_became_peered":"2023-12-01T01:02:47.283694+0000","last_unstale":"2023-12-01T01:03:57.997337+0000","last_undegraded":"2023-12-01T01:03:57.997337+0000","last_fullsized":"2023-12-01T01:03:57.997337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:49:30.154079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.001593+0000","last_change":"2023-12-01T01:02:47.280113+0000","last_active":"2023-12-01T01:03:58.001593+0000","last_peered":"2023-12-01T01:03:58.001593+0000","last_clean":"2023-12-01T01:03:58.001593+0000","last_became_active":"2023-12-01T01:02:47.279844+0000","last_became_peered":"2023-12-01T01:02:47.279844+0000","last_unstale":"2023-12-01T01:03:58.001593+0000","last_undegraded":"2023-12-01T01:03:58.001593+0000","last_fullsized":"2023-12-01T01:03:58.001593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:50:19.955146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.003221+0000","last_change":"2023-12-01T01:02:47.275575+0000","last_active":"2023-12-01T01:03:58.003221+0000","last_peered":"2023-12-01T01:03:58.003221+0000","last_clean":"2023-12-01T01:03:58.003221+0000","last_became_active":"2023-12-01T01:02:47.275283+0000","last_became_peered":"2023-12-01T01:02:47.275283+0000","last_unstale":"2023-12-01T01:03:58.003221+0000","last_undegraded":"2023-12-01T01:03:58.003221+0000","last_fullsized":"2023-12-01T01:03:58.003221+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:08:41.842374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.007450+0000","last_change":"2023-12-01T01:02:47.275992+0000","last_active":"2023-12-01T01:03:58.007450+0000","last_peered":"2023-12-01T01:03:58.007450+0000","last_clean":"2023-12-01T01:03:58.007450+0000","last_became_active":"2023-12-01T01:02:47.275406+0000","last_became_peered":"2023-12-01T01:02:47.275406+0000","last_unstale":"2023-12-01T01:03:58.007450+0000","last_undegraded":"2023-12-01T01:03:58.007450+0000","last_fullsized":"2023-12-01T01:03:58.007450+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:58:39.978873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.000303+0000","last_change":"2023-12-01T01:02:47.282829+0000","last_active":"2023-12-01T01:03:58.000303+0000","last_peered":"2023-12-01T01:03:58.000303+0000","last_clean":"2023-12-01T01:03:58.000303+0000","last_became_active":"2023-12-01T01:02:47.282007+0000","last_became_peered":"2023-12-01T01:02:47.282007+0000","last_unstale":"2023-12-01T01:03:58.000303+0000","last_undegraded":"2023-12-01T01:03:58.000303+0000","last_fullsized":"2023-12-01T01:03:58.000303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:55:57.394004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999813+0000","last_change":"2023-12-01T01:02:47.276769+0000","last_active":"2023-12-01T01:03:57.999813+0000","last_peered":"2023-12-01T01:03:57.999813+0000","last_clean":"2023-12-01T01:03:57.999813+0000","last_became_active":"2023-12-01T01:02:47.276355+0000","last_became_peered":"2023-12-01T01:02:47.276355+0000","last_unstale":"2023-12-01T01:03:57.999813+0000","last_undegraded":"2023-12-01T01:03:57.999813+0000","last_fullsized":"2023-12-01T01:03:57.999813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:15:23.314516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996245+0000","last_change":"2023-12-01T01:02:47.286107+0000","last_active":"2023-12-01T01:03:57.996245+0000","last_peered":"2023-12-01T01:03:57.996245+0000","last_clean":"2023-12-01T01:03:57.996245+0000","last_became_active":"2023-12-01T01:02:47.285772+0000","last_became_peered":"2023-12-01T01:02:47.285772+0000","last_unstale":"2023-12-01T01:03:57.996245+0000","last_undegraded":"2023-12-01T01:03:57.996245+0000","last_fullsized":"2023-12-01T01:03:57.996245+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:30:29.730055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.992497+0000","last_change":"2023-12-01T01:02:47.281813+0000","last_active":"2023-12-01T01:03:57.992497+0000","last_peered":"2023-12-01T01:03:57.992497+0000","last_clean":"2023-12-01T01:03:57.992497+0000","last_became_active":"2023-12-01T01:02:47.279117+0000","last_became_peered":"2023-12-01T01:02:47.279117+0000","last_unstale":"2023-12-01T01:03:57.992497+0000","last_undegraded":"2023-12-01T01:03:57.992497+0000","last_fullsized":"2023-12-01T01:03:57.992497+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:11:34.646161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.002762+0000","last_change":"2023-12-01T01:02:47.289596+0000","last_active":"2023-12-01T01:03:58.002762+0000","last_peered":"2023-12-01T01:03:58.002762+0000","last_clean":"2023-12-01T01:03:58.002762+0000","last_became_active":"2023-12-01T01:02:47.289273+0000","last_became_peered":"2023-12-01T01:02:47.289273+0000","last_unstale":"2023-12-01T01:03:58.002762+0000","last_undegraded":"2023-12-01T01:03:58.002762+0000","last_fullsized":"2023-12-01T01:03:58.002762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:10:33.606237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006622+0000","last_change":"2023-12-01T01:02:47.281198+0000","last_active":"2023-12-01T01:03:58.006622+0000","last_peered":"2023-12-01T01:03:58.006622+0000","last_clean":"2023-12-01T01:03:58.006622+0000","last_became_active":"2023-12-01T01:02:47.280903+0000","last_became_peered":"2023-12-01T01:02:47.280903+0000","last_unstale":"2023-12-01T01:03:58.006622+0000","last_undegraded":"2023-12-01T01:03:58.006622+0000","last_fullsized":"2023-12-01T01:03:58.006622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:14:56.199140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.000335+0000","last_change":"2023-12-01T01:02:47.281015+0000","last_active":"2023-12-01T01:03:58.000335+0000","last_peered":"2023-12-01T01:03:58.000335+0000","last_clean":"2023-12-01T01:03:58.000335+0000","last_became_active":"2023-12-01T01:02:47.280670+0000","last_became_peered":"2023-12-01T01:02:47.280670+0000","last_unstale":"2023-12-01T01:03:58.000335+0000","last_undegraded":"2023-12-01T01:03:58.000335+0000","last_fullsized":"2023-12-01T01:03:58.000335+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:13:12.686506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997595+0000","last_change":"2023-12-01T01:02:47.283444+0000","last_active":"2023-12-01T01:03:57.997595+0000","last_peered":"2023-12-01T01:03:57.997595+0000","last_clean":"2023-12-01T01:03:57.997595+0000","last_became_active":"2023-12-01T01:02:47.283131+0000","last_became_peered":"2023-12-01T01:02:47.283131+0000","last_unstale":"2023-12-01T01:03:57.997595+0000","last_undegraded":"2023-12-01T01:03:57.997595+0000","last_fullsized":"2023-12-01T01:03:57.997595+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:36:50.069639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635021+0000","last_change":"2023-12-01T01:02:46.825507+0000","last_active":"2023-12-01T01:02:58.635021+0000","last_peered":"2023-12-01T01:02:58.635021+0000","last_clean":"2023-12-01T01:02:58.635021+0000","last_became_active":"2023-12-01T01:02:46.825170+0000","last_became_peered":"2023-12-01T01:02:46.825170+0000","last_unstale":"2023-12-01T01:02:58.635021+0000","last_undegraded":"2023-12-01T01:02:58.635021+0000","last_fullsized":"2023-12-01T01:02:58.635021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:10:10.518664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.987626+0000","last_change":"2023-12-01T01:03:00.001168+0000","last_active":"2023-12-01T01:03:57.987626+0000","last_peered":"2023-12-01T01:03:57.987626+0000","last_clean":"2023-12-01T01:03:57.987626+0000","last_became_active":"2023-12-01T01:03:00.000826+0000","last_became_peered":"2023-12-01T01:03:00.000826+0000","last_unstale":"2023-12-01T01:03:57.987626+0000","last_undegraded":"2023-12-01T01:03:57.987626+0000","last_fullsized":"2023-12-01T01:03:57.987626+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:03:25.647589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638080+0000","last_change":"2023-12-01T01:02:46.835504+0000","last_active":"2023-12-01T01:02:58.638080+0000","last_peered":"2023-12-01T01:02:58.638080+0000","last_clean":"2023-12-01T01:02:58.638080+0000","last_became_active":"2023-12-01T01:02:46.835206+0000","last_became_peered":"2023-12-01T01:02:46.835206+0000","last_unstale":"2023-12-01T01:02:58.638080+0000","last_undegraded":"2023-12-01T01:02:58.638080+0000","last_fullsized":"2023-12-01T01:02:58.638080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:42:18.756880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006507+0000","last_change":"2023-12-01T01:02:47.286713+0000","last_active":"2023-12-01T01:03:58.006507+0000","last_peered":"2023-12-01T01:03:58.006507+0000","last_clean":"2023-12-01T01:03:58.006507+0000","last_became_active":"2023-12-01T01:02:47.285868+0000","last_became_peered":"2023-12-01T01:02:47.285868+0000","last_unstale":"2023-12-01T01:03:58.006507+0000","last_undegraded":"2023-12-01T01:03:58.006507+0000","last_fullsized":"2023-12-01T01:03:58.006507+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:16:31.496085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.648184+0000","last_change":"2023-12-01T01:02:59.647766+0000","last_active":"2023-12-01T01:02:59.648184+0000","last_peered":"2023-12-01T01:02:59.648184+0000","last_clean":"2023-12-01T01:02:59.648184+0000","last_became_active":"2023-12-01T01:02:59.641808+0000","last_became_peered":"2023-12-01T01:02:59.641808+0000","last_unstale":"2023-12-01T01:02:59.648184+0000","last_undegraded":"2023-12-01T01:02:59.648184+0000","last_fullsized":"2023-12-01T01:02:59.648184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:57:44.213111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.005710+0000","last_change":"2023-12-01T01:02:47.284868+0000","last_active":"2023-12-01T01:03:58.005710+0000","last_peered":"2023-12-01T01:03:58.005710+0000","last_clean":"2023-12-01T01:03:58.005710+0000","last_became_active":"2023-12-01T01:02:47.284602+0000","last_became_peered":"2023-12-01T01:02:47.284602+0000","last_unstale":"2023-12-01T01:03:58.005710+0000","last_undegraded":"2023-12-01T01:03:58.005710+0000","last_fullsized":"2023-12-01T01:03:58.005710+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:12:36.510333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634994+0000","last_change":"2023-12-01T01:02:46.832234+0000","last_active":"2023-12-01T01:02:58.634994+0000","last_peered":"2023-12-01T01:02:58.634994+0000","last_clean":"2023-12-01T01:02:58.634994+0000","last_became_active":"2023-12-01T01:02:46.831986+0000","last_became_peered":"2023-12-01T01:02:46.831986+0000","last_unstale":"2023-12-01T01:02:58.634994+0000","last_undegraded":"2023-12-01T01:02:58.634994+0000","last_fullsized":"2023-12-01T01:02:58.634994+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:49:35.773243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.004824+0000","last_change":"2023-12-01T01:02:47.275033+0000","last_active":"2023-12-01T01:03:58.004824+0000","last_peered":"2023-12-01T01:03:58.004824+0000","last_clean":"2023-12-01T01:03:58.004824+0000","last_became_active":"2023-12-01T01:02:47.274730+0000","last_became_peered":"2023-12-01T01:02:47.274730+0000","last_unstale":"2023-12-01T01:03:58.004824+0000","last_undegraded":"2023-12-01T01:03:58.004824+0000","last_fullsized":"2023-12-01T01:03:58.004824+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:48:44.959720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'7","reported_seq":103,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:08.450577+0000","last_change":"2023-12-01T01:02:46.827046+0000","last_active":"2023-12-01T01:04:08.450577+0000","last_peered":"2023-12-01T01:04:08.450577+0000","last_clean":"2023-12-01T01:04:08.450577+0000","last_became_active":"2023-12-01T01:02:46.826716+0000","last_became_peered":"2023-12-01T01:02:46.826716+0000","last_unstale":"2023-12-01T01:04:08.450577+0000","last_undegraded":"2023-12-01T01:04:08.450577+0000","last_fullsized":"2023-12-01T01:04:08.450577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:06:46.195630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1108,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.987198+0000","last_change":"2023-12-01T01:02:47.270299+0000","last_active":"2023-12-01T01:03:57.987198+0000","last_peered":"2023-12-01T01:03:57.987198+0000","last_clean":"2023-12-01T01:03:57.987198+0000","last_became_active":"2023-12-01T01:02:47.270016+0000","last_became_peered":"2023-12-01T01:02:47.270016+0000","last_unstale":"2023-12-01T01:03:57.987198+0000","last_undegraded":"2023-12-01T01:03:57.987198+0000","last_fullsized":"2023-12-01T01:03:57.987198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:16:30.207449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.643802+0000","last_change":"2023-12-01T01:02:59.643802+0000","last_active":"2023-12-01T01:02:59.643802+0000","last_peered":"2023-12-01T01:02:59.643802+0000","last_clean":"2023-12-01T01:02:59.643802+0000","last_became_active":"2023-12-01T01:02:59.640951+0000","last_became_peered":"2023-12-01T01:02:59.640951+0000","last_unstale":"2023-12-01T01:02:59.643802+0000","last_undegraded":"2023-12-01T01:02:59.643802+0000","last_fullsized":"2023-12-01T01:02:59.643802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:52:32.599515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999994+0000","last_change":"2023-12-01T01:02:47.274600+0000","last_active":"2023-12-01T01:03:57.999994+0000","last_peered":"2023-12-01T01:03:57.999994+0000","last_clean":"2023-12-01T01:03:57.999994+0000","last_became_active":"2023-12-01T01:02:47.273979+0000","last_became_peered":"2023-12-01T01:02:47.273979+0000","last_unstale":"2023-12-01T01:03:57.999994+0000","last_undegraded":"2023-12-01T01:03:57.999994+0000","last_fullsized":"2023-12-01T01:03:57.999994+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:20:55.693393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629126+0000","last_change":"2023-12-01T01:02:46.821479+0000","last_active":"2023-12-01T01:02:58.629126+0000","last_peered":"2023-12-01T01:02:58.629126+0000","last_clean":"2023-12-01T01:02:58.629126+0000","last_became_active":"2023-12-01T01:02:46.821090+0000","last_became_peered":"2023-12-01T01:02:46.821090+0000","last_unstale":"2023-12-01T01:02:58.629126+0000","last_undegraded":"2023-12-01T01:02:58.629126+0000","last_fullsized":"2023-12-01T01:02:58.629126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:17:48.216217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.994530+0000","last_change":"2023-12-01T01:02:47.274298+0000","last_active":"2023-12-01T01:03:57.994530+0000","last_peered":"2023-12-01T01:03:57.994530+0000","last_clean":"2023-12-01T01:03:57.994530+0000","last_became_active":"2023-12-01T01:02:47.274006+0000","last_became_peered":"2023-12-01T01:02:47.274006+0000","last_unstale":"2023-12-01T01:03:57.994530+0000","last_undegraded":"2023-12-01T01:03:57.994530+0000","last_fullsized":"2023-12-01T01:03:57.994530+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:38.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637568+0000","last_change":"2023-12-01T01:02:46.826341+0000","last_active":"2023-12-01T01:02:58.637568+0000","last_peered":"2023-12-01T01:02:58.637568+0000","last_clean":"2023-12-01T01:02:58.637568+0000","last_became_active":"2023-12-01T01:02:46.825979+0000","last_became_peered":"2023-12-01T01:02:46.825979+0000","last_unstale":"2023-12-01T01:02:58.637568+0000","last_undegraded":"2023-12-01T01:02:58.637568+0000","last_fullsized":"2023-12-01T01:02:58.637568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:29:48.681232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.992738+0000","last_change":"2023-12-01T01:02:47.280989+0000","last_active":"2023-12-01T01:03:57.992738+0000","last_peered":"2023-12-01T01:03:57.992738+0000","last_clean":"2023-12-01T01:03:57.992738+0000","last_became_active":"2023-12-01T01:02:47.280649+0000","last_became_peered":"2023-12-01T01:02:47.280649+0000","last_unstale":"2023-12-01T01:03:57.992738+0000","last_undegraded":"2023-12-01T01:03:57.992738+0000","last_fullsized":"2023-12-01T01:03:57.992738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:16:30.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":98,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:10.452968+0000","last_change":"2023-12-01T01:02:46.832304+0000","last_active":"2023-12-01T01:04:10.452968+0000","last_peered":"2023-12-01T01:04:10.452968+0000","last_clean":"2023-12-01T01:04:10.452968+0000","last_became_active":"2023-12-01T01:02:46.832014+0000","last_became_peered":"2023-12-01T01:02:46.832014+0000","last_unstale":"2023-12-01T01:04:10.452968+0000","last_undegraded":"2023-12-01T01:04:10.452968+0000","last_fullsized":"2023-12-01T01:04:10.452968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:41:46.003527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.005234+0000","last_change":"2023-12-01T01:02:47.277819+0000","last_active":"2023-12-01T01:03:58.005234+0000","last_peered":"2023-12-01T01:03:58.005234+0000","last_clean":"2023-12-01T01:03:58.005234+0000","last_became_active":"2023-12-01T01:02:47.277534+0000","last_became_peered":"2023-12-01T01:02:47.277534+0000","last_unstale":"2023-12-01T01:03:58.005234+0000","last_undegraded":"2023-12-01T01:03:58.005234+0000","last_fullsized":"2023-12-01T01:03:58.005234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:56:15.627538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638700+0000","last_change":"2023-12-01T01:02:46.826783+0000","last_active":"2023-12-01T01:02:58.638700+0000","last_peered":"2023-12-01T01:02:58.638700+0000","last_clean":"2023-12-01T01:02:58.638700+0000","last_became_active":"2023-12-01T01:02:46.826479+0000","last_became_peered":"2023-12-01T01:02:46.826479+0000","last_unstale":"2023-12-01T01:02:58.638700+0000","last_undegraded":"2023-12-01T01:02:58.638700+0000","last_fullsized":"2023-12-01T01:02:58.638700+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:30:09.681494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997740+0000","last_change":"2023-12-01T01:03:00.001466+0000","last_active":"2023-12-01T01:03:57.997740+0000","last_peered":"2023-12-01T01:03:57.997740+0000","last_clean":"2023-12-01T01:03:57.997740+0000","last_became_active":"2023-12-01T01:03:00.001077+0000","last_became_peered":"2023-12-01T01:03:00.001077+0000","last_unstale":"2023-12-01T01:03:57.997740+0000","last_undegraded":"2023-12-01T01:03:57.997740+0000","last_fullsized":"2023-12-01T01:03:57.997740+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:46:26.987257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.639542+0000","last_change":"2023-12-01T01:02:46.829332+0000","last_active":"2023-12-01T01:02:58.639542+0000","last_peered":"2023-12-01T01:02:58.639542+0000","last_clean":"2023-12-01T01:02:58.639542+0000","last_became_active":"2023-12-01T01:02:46.828828+0000","last_became_peered":"2023-12-01T01:02:46.828828+0000","last_unstale":"2023-12-01T01:02:58.639542+0000","last_undegraded":"2023-12-01T01:02:58.639542+0000","last_fullsized":"2023-12-01T01:02:58.639542+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:15:15.648138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006501+0000","last_change":"2023-12-01T01:02:47.277938+0000","last_active":"2023-12-01T01:03:58.006501+0000","last_peered":"2023-12-01T01:03:58.006501+0000","last_clean":"2023-12-01T01:03:58.006501+0000","last_became_active":"2023-12-01T01:02:47.277650+0000","last_became_peered":"2023-12-01T01:02:47.277650+0000","last_unstale":"2023-12-01T01:03:58.006501+0000","last_undegraded":"2023-12-01T01:03:58.006501+0000","last_fullsized":"2023-12-01T01:03:58.006501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:03:46.667892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'32","reported_seq":236,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:11.111956+0000","last_change":"2023-12-01T01:03:00.008983+0000","last_active":"2023-12-01T01:04:11.111956+0000","last_peered":"2023-12-01T01:04:11.111956+0000","last_clean":"2023-12-01T01:04:11.111956+0000","last_became_active":"2023-12-01T01:03:00.001444+0000","last_became_peered":"2023-12-01T01:03:00.001444+0000","last_unstale":"2023-12-01T01:04:11.111956+0000","last_undegraded":"2023-12-01T01:04:11.111956+0000","last_fullsized":"2023-12-01T01:04:11.111956+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:29:25.347028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64476,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":162,"num_read_kb":139,"num_write":33,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":40837,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.995106+0000","last_change":"2023-12-01T01:02:47.272049+0000","last_active":"2023-12-01T01:03:57.995106+0000","last_peered":"2023-12-01T01:03:57.995106+0000","last_clean":"2023-12-01T01:03:57.995106+0000","last_became_active":"2023-12-01T01:02:47.271726+0000","last_became_peered":"2023-12-01T01:02:47.271726+0000","last_unstale":"2023-12-01T01:03:57.995106+0000","last_undegraded":"2023-12-01T01:03:57.995106+0000","last_fullsized":"2023-12-01T01:03:57.995106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:08:45.038989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634393+0000","last_change":"2023-12-01T01:02:46.831362+0000","last_active":"2023-12-01T01:02:58.634393+0000","last_peered":"2023-12-01T01:02:58.634393+0000","last_clean":"2023-12-01T01:02:58.634393+0000","last_became_active":"2023-12-01T01:02:46.830929+0000","last_became_peered":"2023-12-01T01:02:46.830929+0000","last_unstale":"2023-12-01T01:02:58.634393+0000","last_undegraded":"2023-12-01T01:02:58.634393+0000","last_fullsized":"2023-12-01T01:02:58.634393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:39:54.855526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997351+0000","last_change":"2023-12-01T01:02:47.275343+0000","last_active":"2023-12-01T01:03:57.997351+0000","last_peered":"2023-12-01T01:03:57.997351+0000","last_clean":"2023-12-01T01:03:57.997351+0000","last_became_active":"2023-12-01T01:02:47.275042+0000","last_became_peered":"2023-12-01T01:02:47.275042+0000","last_unstale":"2023-12-01T01:03:57.997351+0000","last_undegraded":"2023-12-01T01:03:57.997351+0000","last_fullsized":"2023-12-01T01:03:57.997351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:18:27.862601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638406+0000","last_change":"2023-12-01T01:02:46.831996+0000","last_active":"2023-12-01T01:02:58.638406+0000","last_peered":"2023-12-01T01:02:58.638406+0000","last_clean":"2023-12-01T01:02:58.638406+0000","last_became_active":"2023-12-01T01:02:46.831710+0000","last_became_peered":"2023-12-01T01:02:46.831710+0000","last_unstale":"2023-12-01T01:02:58.638406+0000","last_undegraded":"2023-12-01T01:02:58.638406+0000","last_fullsized":"2023-12-01T01:02:58.638406+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:50:42.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006191+0000","last_change":"2023-12-01T01:02:47.283771+0000","last_active":"2023-12-01T01:03:58.006191+0000","last_peered":"2023-12-01T01:03:58.006191+0000","last_clean":"2023-12-01T01:03:58.006191+0000","last_became_active":"2023-12-01T01:02:47.283363+0000","last_became_peered":"2023-12-01T01:02:47.283363+0000","last_unstale":"2023-12-01T01:03:58.006191+0000","last_undegraded":"2023-12-01T01:03:58.006191+0000","last_fullsized":"2023-12-01T01:03:58.006191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:44:40.918161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":101,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:08.450146+0000","last_change":"2023-12-01T01:02:46.825170+0000","last_active":"2023-12-01T01:04:08.450146+0000","last_peered":"2023-12-01T01:04:08.450146+0000","last_clean":"2023-12-01T01:04:08.450146+0000","last_became_active":"2023-12-01T01:02:46.824857+0000","last_became_peered":"2023-12-01T01:02:46.824857+0000","last_unstale":"2023-12-01T01:04:08.450146+0000","last_undegraded":"2023-12-01T01:04:08.450146+0000","last_fullsized":"2023-12-01T01:04:08.450146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:05:54.095408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":83,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997749+0000","last_change":"2023-12-01T01:02:47.279495+0000","last_active":"2023-12-01T01:03:57.997749+0000","last_peered":"2023-12-01T01:03:57.997749+0000","last_clean":"2023-12-01T01:03:57.997749+0000","last_became_active":"2023-12-01T01:02:47.279171+0000","last_became_peered":"2023-12-01T01:02:47.279171+0000","last_unstale":"2023-12-01T01:03:57.997749+0000","last_undegraded":"2023-12-01T01:03:57.997749+0000","last_fullsized":"2023-12-01T01:03:57.997749+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:29:33.298818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634745+0000","last_change":"2023-12-01T01:02:46.833837+0000","last_active":"2023-12-01T01:02:58.634745+0000","last_peered":"2023-12-01T01:02:58.634745+0000","last_clean":"2023-12-01T01:02:58.634745+0000","last_became_active":"2023-12-01T01:02:46.833549+0000","last_became_peered":"2023-12-01T01:02:46.833549+0000","last_unstale":"2023-12-01T01:02:58.634745+0000","last_undegraded":"2023-12-01T01:02:58.634745+0000","last_fullsized":"2023-12-01T01:02:58.634745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:35:02.581360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.000743+0000","last_change":"2023-12-01T01:02:47.273884+0000","last_active":"2023-12-01T01:03:58.000743+0000","last_peered":"2023-12-01T01:03:58.000743+0000","last_clean":"2023-12-01T01:03:58.000743+0000","last_became_active":"2023-12-01T01:02:47.273575+0000","last_became_peered":"2023-12-01T01:02:47.273575+0000","last_unstale":"2023-12-01T01:03:58.000743+0000","last_undegraded":"2023-12-01T01:03:58.000743+0000","last_fullsized":"2023-12-01T01:03:58.000743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:49:54.924619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635351+0000","last_change":"2023-12-01T01:02:46.832265+0000","last_active":"2023-12-01T01:02:58.635351+0000","last_peered":"2023-12-01T01:02:58.635351+0000","last_clean":"2023-12-01T01:02:58.635351+0000","last_became_active":"2023-12-01T01:02:46.831944+0000","last_became_peered":"2023-12-01T01:02:46.831944+0000","last_unstale":"2023-12-01T01:02:58.635351+0000","last_undegraded":"2023-12-01T01:02:58.635351+0000","last_fullsized":"2023-12-01T01:02:58.635351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:54:54.814744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996133+0000","last_change":"2023-12-01T01:02:47.276967+0000","last_active":"2023-12-01T01:03:57.996133+0000","last_peered":"2023-12-01T01:03:57.996133+0000","last_clean":"2023-12-01T01:03:57.996133+0000","last_became_active":"2023-12-01T01:02:47.276660+0000","last_became_peered":"2023-12-01T01:02:47.276660+0000","last_unstale":"2023-12-01T01:03:57.996133+0000","last_undegraded":"2023-12-01T01:03:57.996133+0000","last_fullsized":"2023-12-01T01:03:57.996133+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:19:16.029376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634786+0000","last_change":"2023-12-01T01:02:46.834425+0000","last_active":"2023-12-01T01:02:58.634786+0000","last_peered":"2023-12-01T01:02:58.634786+0000","last_clean":"2023-12-01T01:02:58.634786+0000","last_became_active":"2023-12-01T01:02:46.834150+0000","last_became_peered":"2023-12-01T01:02:46.834150+0000","last_unstale":"2023-12-01T01:02:58.634786+0000","last_undegraded":"2023-12-01T01:02:58.634786+0000","last_fullsized":"2023-12-01T01:02:58.634786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:52:39.619014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996630+0000","last_change":"2023-12-01T01:02:47.276386+0000","last_active":"2023-12-01T01:03:57.996630+0000","last_peered":"2023-12-01T01:03:57.996630+0000","last_clean":"2023-12-01T01:03:57.996630+0000","last_became_active":"2023-12-01T01:02:47.276092+0000","last_became_peered":"2023-12-01T01:02:47.276092+0000","last_unstale":"2023-12-01T01:03:57.996630+0000","last_undegraded":"2023-12-01T01:03:57.996630+0000","last_fullsized":"2023-12-01T01:03:57.996630+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:33:39.707619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638513+0000","last_change":"2023-12-01T01:02:46.832778+0000","last_active":"2023-12-01T01:02:58.638513+0000","last_peered":"2023-12-01T01:02:58.638513+0000","last_clean":"2023-12-01T01:02:58.638513+0000","last_became_active":"2023-12-01T01:02:46.832406+0000","last_became_peered":"2023-12-01T01:02:46.832406+0000","last_unstale":"2023-12-01T01:02:58.638513+0000","last_undegraded":"2023-12-01T01:02:58.638513+0000","last_fullsized":"2023-12-01T01:02:58.638513+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:06:08.569651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996321+0000","last_change":"2023-12-01T01:02:59.639129+0000","last_active":"2023-12-01T01:03:57.996321+0000","last_peered":"2023-12-01T01:03:57.996321+0000","last_clean":"2023-12-01T01:03:57.996321+0000","last_became_active":"2023-12-01T01:02:59.638745+0000","last_became_peered":"2023-12-01T01:02:59.638745+0000","last_unstale":"2023-12-01T01:03:57.996321+0000","last_undegraded":"2023-12-01T01:03:57.996321+0000","last_fullsized":"2023-12-01T01:03:57.996321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:26:26.032297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.003323+0000","last_change":"2023-12-01T01:02:47.269953+0000","last_active":"2023-12-01T01:03:58.003323+0000","last_peered":"2023-12-01T01:03:58.003323+0000","last_clean":"2023-12-01T01:03:58.003323+0000","last_became_active":"2023-12-01T01:02:47.265723+0000","last_became_peered":"2023-12-01T01:02:47.265723+0000","last_unstale":"2023-12-01T01:03:58.003323+0000","last_undegraded":"2023-12-01T01:03:58.003323+0000","last_fullsized":"2023-12-01T01:03:58.003323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:28:44.370883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:08.449625+0000","last_change":"2023-12-01T01:02:46.827001+0000","last_active":"2023-12-01T01:04:08.449625+0000","last_peered":"2023-12-01T01:04:08.449625+0000","last_clean":"2023-12-01T01:04:08.449625+0000","last_became_active":"2023-12-01T01:02:46.826690+0000","last_became_peered":"2023-12-01T01:02:46.826690+0000","last_unstale":"2023-12-01T01:04:08.449625+0000","last_undegraded":"2023-12-01T01:04:08.449625+0000","last_fullsized":"2023-12-01T01:04:08.449625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:37:38.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006285+0000","last_change":"2023-12-01T01:02:47.283372+0000","last_active":"2023-12-01T01:03:58.006285+0000","last_peered":"2023-12-01T01:03:58.006285+0000","last_clean":"2023-12-01T01:03:58.006285+0000","last_became_active":"2023-12-01T01:02:47.283075+0000","last_became_peered":"2023-12-01T01:02:47.283075+0000","last_unstale":"2023-12-01T01:03:58.006285+0000","last_undegraded":"2023-12-01T01:03:58.006285+0000","last_fullsized":"2023-12-01T01:03:58.006285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:37:07.707284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.631280+0000","last_change":"2023-12-01T01:02:46.828490+0000","last_active":"2023-12-01T01:02:58.631280+0000","last_peered":"2023-12-01T01:02:58.631280+0000","last_clean":"2023-12-01T01:02:58.631280+0000","last_became_active":"2023-12-01T01:02:46.828129+0000","last_became_peered":"2023-12-01T01:02:46.828129+0000","last_unstale":"2023-12-01T01:02:58.631280+0000","last_undegraded":"2023-12-01T01:02:58.631280+0000","last_fullsized":"2023-12-01T01:02:58.631280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:52:17.060443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":322,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638309+0000","last_change":"2023-12-01T01:01:49.966660+0000","last_active":"2023-12-01T01:02:58.638309+0000","last_peered":"2023-12-01T01:02:58.638309+0000","last_clean":"2023-12-01T01:02:58.638309+0000","last_became_active":"2023-12-01T01:01:49.966125+0000","last_became_peered":"2023-12-01T01:01:49.966125+0000","last_unstale":"2023-12-01T01:02:58.638309+0000","last_undegraded":"2023-12-01T01:02:58.638309+0000","last_fullsized":"2023-12-01T01:02:58.638309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T00:59:06.461487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T00:59:06.461487+0000","last_clean_scrub_stamp":"2023-12-01T00:59:06.461487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:34:52.236994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.994773+0000","last_change":"2023-12-01T01:02:47.282702+0000","last_active":"2023-12-01T01:03:57.994773+0000","last_peered":"2023-12-01T01:03:57.994773+0000","last_clean":"2023-12-01T01:03:57.994773+0000","last_became_active":"2023-12-01T01:02:47.282368+0000","last_became_peered":"2023-12-01T01:02:47.282368+0000","last_unstale":"2023-12-01T01:03:57.994773+0000","last_undegraded":"2023-12-01T01:03:57.994773+0000","last_fullsized":"2023-12-01T01:03:57.994773+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:24:40.985055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638420+0000","last_change":"2023-12-01T01:02:46.827882+0000","last_active":"2023-12-01T01:02:58.638420+0000","last_peered":"2023-12-01T01:02:58.638420+0000","last_clean":"2023-12-01T01:02:58.638420+0000","last_became_active":"2023-12-01T01:02:46.827354+0000","last_became_peered":"2023-12-01T01:02:46.827354+0000","last_unstale":"2023-12-01T01:02:58.638420+0000","last_undegraded":"2023-12-01T01:02:58.638420+0000","last_fullsized":"2023-12-01T01:02:58.638420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:48:42.894733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635396+0000","last_change":"2023-12-01T01:02:46.833439+0000","last_active":"2023-12-01T01:02:58.635396+0000","last_peered":"2023-12-01T01:02:58.635396+0000","last_clean":"2023-12-01T01:02:58.635396+0000","last_became_active":"2023-12-01T01:02:46.833199+0000","last_became_peered":"2023-12-01T01:02:46.833199+0000","last_unstale":"2023-12-01T01:02:58.635396+0000","last_undegraded":"2023-12-01T01:02:58.635396+0000","last_fullsized":"2023-12-01T01:02:58.635396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:44:49.559138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999313+0000","last_change":"2023-12-01T01:02:47.283580+0000","last_active":"2023-12-01T01:03:57.999313+0000","last_peered":"2023-12-01T01:03:57.999313+0000","last_clean":"2023-12-01T01:03:57.999313+0000","last_became_active":"2023-12-01T01:02:47.283095+0000","last_became_peered":"2023-12-01T01:02:47.283095+0000","last_unstale":"2023-12-01T01:03:57.999313+0000","last_undegraded":"2023-12-01T01:03:57.999313+0000","last_fullsized":"2023-12-01T01:03:57.999313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:33:12.541487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:01.002114+0000","last_change":"2023-12-01T01:02:46.831348+0000","last_active":"2023-12-01T01:04:01.002114+0000","last_peered":"2023-12-01T01:04:01.002114+0000","last_clean":"2023-12-01T01:04:01.002114+0000","last_became_active":"2023-12-01T01:02:46.831031+0000","last_became_peered":"2023-12-01T01:02:46.831031+0000","last_unstale":"2023-12-01T01:04:01.002114+0000","last_undegraded":"2023-12-01T01:04:01.002114+0000","last_fullsized":"2023-12-01T01:04:01.002114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:15:53.172465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996739+0000","last_change":"2023-12-01T01:02:47.276281+0000","last_active":"2023-12-01T01:03:57.996739+0000","last_peered":"2023-12-01T01:03:57.996739+0000","last_clean":"2023-12-01T01:03:57.996739+0000","last_became_active":"2023-12-01T01:02:47.275573+0000","last_became_peered":"2023-12-01T01:02:47.275573+0000","last_unstale":"2023-12-01T01:03:57.996739+0000","last_undegraded":"2023-12-01T01:03:57.996739+0000","last_fullsized":"2023-12-01T01:03:57.996739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:50:07.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.631688+0000","last_change":"2023-12-01T01:02:46.823053+0000","last_active":"2023-12-01T01:02:58.631688+0000","last_peered":"2023-12-01T01:02:58.631688+0000","last_clean":"2023-12-01T01:02:58.631688+0000","last_became_active":"2023-12-01T01:02:46.822772+0000","last_became_peered":"2023-12-01T01:02:46.822772+0000","last_unstale":"2023-12-01T01:02:58.631688+0000","last_undegraded":"2023-12-01T01:02:58.631688+0000","last_fullsized":"2023-12-01T01:02:58.631688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:43:22.496286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996524+0000","last_change":"2023-12-01T01:02:47.289484+0000","last_active":"2023-12-01T01:03:57.996524+0000","last_peered":"2023-12-01T01:03:57.996524+0000","last_clean":"2023-12-01T01:03:57.996524+0000","last_became_active":"2023-12-01T01:02:47.289176+0000","last_became_peered":"2023-12-01T01:02:47.289176+0000","last_unstale":"2023-12-01T01:03:57.996524+0000","last_undegraded":"2023-12-01T01:03:57.996524+0000","last_fullsized":"2023-12-01T01:03:57.996524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:21:52.905017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634804+0000","last_change":"2023-12-01T01:02:46.830635+0000","last_active":"2023-12-01T01:02:58.634804+0000","last_peered":"2023-12-01T01:02:58.634804+0000","last_clean":"2023-12-01T01:02:58.634804+0000","last_became_active":"2023-12-01T01:02:46.830337+0000","last_became_peered":"2023-12-01T01:02:46.830337+0000","last_unstale":"2023-12-01T01:02:58.634804+0000","last_undegraded":"2023-12-01T01:02:58.634804+0000","last_fullsized":"2023-12-01T01:02:58.634804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:02:10.017744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.964199+0000","last_change":"2023-12-01T01:02:47.281923+0000","last_active":"2023-12-01T01:03:57.964199+0000","last_peered":"2023-12-01T01:03:57.964199+0000","last_clean":"2023-12-01T01:03:57.964199+0000","last_became_active":"2023-12-01T01:02:47.281598+0000","last_became_peered":"2023-12-01T01:02:47.281598+0000","last_unstale":"2023-12-01T01:03:57.964199+0000","last_undegraded":"2023-12-01T01:03:57.964199+0000","last_fullsized":"2023-12-01T01:03:57.964199+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:07:54.327023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637701+0000","last_change":"2023-12-01T01:02:46.830248+0000","last_active":"2023-12-01T01:02:58.637701+0000","last_peered":"2023-12-01T01:02:58.637701+0000","last_clean":"2023-12-01T01:02:58.637701+0000","last_became_active":"2023-12-01T01:02:46.829951+0000","last_became_peered":"2023-12-01T01:02:46.829951+0000","last_unstale":"2023-12-01T01:02:58.637701+0000","last_undegraded":"2023-12-01T01:02:58.637701+0000","last_fullsized":"2023-12-01T01:02:58.637701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:04:23.978035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.992005+0000","last_change":"2023-12-01T01:02:47.280871+0000","last_active":"2023-12-01T01:03:57.992005+0000","last_peered":"2023-12-01T01:03:57.992005+0000","last_clean":"2023-12-01T01:03:57.992005+0000","last_became_active":"2023-12-01T01:02:47.280527+0000","last_became_peered":"2023-12-01T01:02:47.280527+0000","last_unstale":"2023-12-01T01:03:57.992005+0000","last_undegraded":"2023-12-01T01:03:57.992005+0000","last_fullsized":"2023-12-01T01:03:57.992005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:16:47.700500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.644414+0000","last_change":"2023-12-01T01:02:59.643980+0000","last_active":"2023-12-01T01:02:59.644414+0000","last_peered":"2023-12-01T01:02:59.644414+0000","last_clean":"2023-12-01T01:02:59.644414+0000","last_became_active":"2023-12-01T01:02:59.641039+0000","last_became_peered":"2023-12-01T01:02:59.641039+0000","last_unstale":"2023-12-01T01:02:59.644414+0000","last_undegraded":"2023-12-01T01:02:59.644414+0000","last_fullsized":"2023-12-01T01:02:59.644414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:06:23.044556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996416+0000","last_change":"2023-12-01T01:02:47.284981+0000","last_active":"2023-12-01T01:03:57.996416+0000","last_peered":"2023-12-01T01:03:57.996416+0000","last_clean":"2023-12-01T01:03:57.996416+0000","last_became_active":"2023-12-01T01:02:47.284576+0000","last_became_peered":"2023-12-01T01:02:47.284576+0000","last_unstale":"2023-12-01T01:03:57.996416+0000","last_undegraded":"2023-12-01T01:03:57.996416+0000","last_fullsized":"2023-12-01T01:03:57.996416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:58:21.152156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634597+0000","last_change":"2023-12-01T01:02:46.828769+0000","last_active":"2023-12-01T01:02:58.634597+0000","last_peered":"2023-12-01T01:02:58.634597+0000","last_clean":"2023-12-01T01:02:58.634597+0000","last_became_active":"2023-12-01T01:02:46.828498+0000","last_became_peered":"2023-12-01T01:02:46.828498+0000","last_unstale":"2023-12-01T01:02:58.634597+0000","last_undegraded":"2023-12-01T01:02:58.634597+0000","last_fullsized":"2023-12-01T01:02:58.634597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:12:26.618082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006850+0000","last_change":"2023-12-01T01:02:47.283179+0000","last_active":"2023-12-01T01:03:58.006850+0000","last_peered":"2023-12-01T01:03:58.006850+0000","last_clean":"2023-12-01T01:03:58.006850+0000","last_became_active":"2023-12-01T01:02:47.282883+0000","last_became_peered":"2023-12-01T01:02:47.282883+0000","last_unstale":"2023-12-01T01:03:58.006850+0000","last_undegraded":"2023-12-01T01:03:58.006850+0000","last_fullsized":"2023-12-01T01:03:58.006850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:19:47.406888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635111+0000","last_change":"2023-12-01T01:02:46.833482+0000","last_active":"2023-12-01T01:02:58.635111+0000","last_peered":"2023-12-01T01:02:58.635111+0000","last_clean":"2023-12-01T01:02:58.635111+0000","last_became_active":"2023-12-01T01:02:46.833200+0000","last_became_peered":"2023-12-01T01:02:46.833200+0000","last_unstale":"2023-12-01T01:02:58.635111+0000","last_undegraded":"2023-12-01T01:02:58.635111+0000","last_fullsized":"2023-12-01T01:02:58.635111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:52:41.480509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.007582+0000","last_change":"2023-12-01T01:02:47.275802+0000","last_active":"2023-12-01T01:03:58.007582+0000","last_peered":"2023-12-01T01:03:58.007582+0000","last_clean":"2023-12-01T01:03:58.007582+0000","last_became_active":"2023-12-01T01:02:47.274837+0000","last_became_peered":"2023-12-01T01:02:47.274837+0000","last_unstale":"2023-12-01T01:03:58.007582+0000","last_undegraded":"2023-12-01T01:03:58.007582+0000","last_fullsized":"2023-12-01T01:03:58.007582+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:43:30.799999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638603+0000","last_change":"2023-12-01T01:02:46.829445+0000","last_active":"2023-12-01T01:02:58.638603+0000","last_peered":"2023-12-01T01:02:58.638603+0000","last_clean":"2023-12-01T01:02:58.638603+0000","last_became_active":"2023-12-01T01:02:46.829120+0000","last_became_peered":"2023-12-01T01:02:46.829120+0000","last_unstale":"2023-12-01T01:02:58.638603+0000","last_undegraded":"2023-12-01T01:02:58.638603+0000","last_fullsized":"2023-12-01T01:02:58.638603+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:57:44.467570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997242+0000","last_change":"2023-12-01T01:02:47.282683+0000","last_active":"2023-12-01T01:03:57.997242+0000","last_peered":"2023-12-01T01:03:57.997242+0000","last_clean":"2023-12-01T01:03:57.997242+0000","last_became_active":"2023-12-01T01:02:47.282346+0000","last_became_peered":"2023-12-01T01:02:47.282346+0000","last_unstale":"2023-12-01T01:03:57.997242+0000","last_undegraded":"2023-12-01T01:03:57.997242+0000","last_fullsized":"2023-12-01T01:03:57.997242+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:20:25.085982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629529+0000","last_change":"2023-12-01T01:02:46.828060+0000","last_active":"2023-12-01T01:02:58.629529+0000","last_peered":"2023-12-01T01:02:58.629529+0000","last_clean":"2023-12-01T01:02:58.629529+0000","last_became_active":"2023-12-01T01:02:46.827754+0000","last_became_peered":"2023-12-01T01:02:46.827754+0000","last_unstale":"2023-12-01T01:02:58.629529+0000","last_undegraded":"2023-12-01T01:02:58.629529+0000","last_fullsized":"2023-12-01T01:02:58.629529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:22.794619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999191+0000","last_change":"2023-12-01T01:02:47.269538+0000","last_active":"2023-12-01T01:03:57.999191+0000","last_peered":"2023-12-01T01:03:57.999191+0000","last_clean":"2023-12-01T01:03:57.999191+0000","last_became_active":"2023-12-01T01:02:47.269245+0000","last_became_peered":"2023-12-01T01:02:47.269245+0000","last_unstale":"2023-12-01T01:03:57.999191+0000","last_undegraded":"2023-12-01T01:03:57.999191+0000","last_fullsized":"2023-12-01T01:03:57.999191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:49.163896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997229+0000","last_change":"2023-12-01T01:02:47.277545+0000","last_active":"2023-12-01T01:03:57.997229+0000","last_peered":"2023-12-01T01:03:57.997229+0000","last_clean":"2023-12-01T01:03:57.997229+0000","last_became_active":"2023-12-01T01:02:47.277307+0000","last_became_peered":"2023-12-01T01:02:47.277307+0000","last_unstale":"2023-12-01T01:03:57.997229+0000","last_undegraded":"2023-12-01T01:03:57.997229+0000","last_fullsized":"2023-12-01T01:03:57.997229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:08.655231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.003980+0000","last_change":"2023-12-01T01:03:00.001120+0000","last_active":"2023-12-01T01:03:58.003980+0000","last_peered":"2023-12-01T01:03:58.003980+0000","last_clean":"2023-12-01T01:03:58.003980+0000","last_became_active":"2023-12-01T01:03:00.000707+0000","last_became_peered":"2023-12-01T01:03:00.000707+0000","last_unstale":"2023-12-01T01:03:58.003980+0000","last_undegraded":"2023-12-01T01:03:58.003980+0000","last_fullsized":"2023-12-01T01:03:58.003980+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:12:25.500981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.994726+0000","last_change":"2023-12-01T01:02:47.274775+0000","last_active":"2023-12-01T01:03:57.994726+0000","last_peered":"2023-12-01T01:03:57.994726+0000","last_clean":"2023-12-01T01:03:57.994726+0000","last_became_active":"2023-12-01T01:02:47.274459+0000","last_became_peered":"2023-12-01T01:02:47.274459+0000","last_unstale":"2023-12-01T01:03:57.994726+0000","last_undegraded":"2023-12-01T01:03:57.994726+0000","last_fullsized":"2023-12-01T01:03:57.994726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:06:01.273551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.993086+0000","last_change":"2023-12-01T01:02:47.277487+0000","last_active":"2023-12-01T01:03:57.993086+0000","last_peered":"2023-12-01T01:03:57.993086+0000","last_clean":"2023-12-01T01:03:57.993086+0000","last_became_active":"2023-12-01T01:02:47.277092+0000","last_became_peered":"2023-12-01T01:02:47.277092+0000","last_unstale":"2023-12-01T01:03:57.993086+0000","last_undegraded":"2023-12-01T01:03:57.993086+0000","last_fullsized":"2023-12-01T01:03:57.993086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:02:51.967302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.004024+0000","last_change":"2023-12-01T01:02:47.283814+0000","last_active":"2023-12-01T01:03:58.004024+0000","last_peered":"2023-12-01T01:03:58.004024+0000","last_clean":"2023-12-01T01:03:58.004024+0000","last_became_active":"2023-12-01T01:02:47.283289+0000","last_became_peered":"2023-12-01T01:02:47.283289+0000","last_unstale":"2023-12-01T01:03:58.004024+0000","last_undegraded":"2023-12-01T01:03:58.004024+0000","last_fullsized":"2023-12-01T01:03:58.004024+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:42:59.523846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.989722+0000","last_change":"2023-12-01T01:02:47.281748+0000","last_active":"2023-12-01T01:03:57.989722+0000","last_peered":"2023-12-01T01:03:57.989722+0000","last_clean":"2023-12-01T01:03:57.989722+0000","last_became_active":"2023-12-01T01:02:47.281445+0000","last_became_peered":"2023-12-01T01:02:47.281445+0000","last_unstale":"2023-12-01T01:03:57.989722+0000","last_undegraded":"2023-12-01T01:03:57.989722+0000","last_fullsized":"2023-12-01T01:03:57.989722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:33:18.146911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999814+0000","last_change":"2023-12-01T01:02:47.276827+0000","last_active":"2023-12-01T01:03:57.999814+0000","last_peered":"2023-12-01T01:03:57.999814+0000","last_clean":"2023-12-01T01:03:57.999814+0000","last_became_active":"2023-12-01T01:02:47.276346+0000","last_became_peered":"2023-12-01T01:02:47.276346+0000","last_unstale":"2023-12-01T01:03:57.999814+0000","last_undegraded":"2023-12-01T01:03:57.999814+0000","last_fullsized":"2023-12-01T01:03:57.999814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:49:23.203883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.991150+0000","last_change":"2023-12-01T01:02:47.276461+0000","last_active":"2023-12-01T01:03:57.991150+0000","last_peered":"2023-12-01T01:03:57.991150+0000","last_clean":"2023-12-01T01:03:57.991150+0000","last_became_active":"2023-12-01T01:02:47.275992+0000","last_became_peered":"2023-12-01T01:02:47.275992+0000","last_unstale":"2023-12-01T01:03:57.991150+0000","last_undegraded":"2023-12-01T01:03:57.991150+0000","last_fullsized":"2023-12-01T01:03:57.991150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:14:04.629355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.995810+0000","last_change":"2023-12-01T01:02:47.274018+0000","last_active":"2023-12-01T01:03:57.995810+0000","last_peered":"2023-12-01T01:03:57.995810+0000","last_clean":"2023-12-01T01:03:57.995810+0000","last_became_active":"2023-12-01T01:02:47.273714+0000","last_became_peered":"2023-12-01T01:02:47.273714+0000","last_unstale":"2023-12-01T01:03:57.995810+0000","last_undegraded":"2023-12-01T01:03:57.995810+0000","last_fullsized":"2023-12-01T01:03:57.995810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:26:14.154249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.993679+0000","last_change":"2023-12-01T01:02:47.276438+0000","last_active":"2023-12-01T01:03:57.993679+0000","last_peered":"2023-12-01T01:03:57.993679+0000","last_clean":"2023-12-01T01:03:57.993679+0000","last_became_active":"2023-12-01T01:02:47.276121+0000","last_became_peered":"2023-12-01T01:02:47.276121+0000","last_unstale":"2023-12-01T01:03:57.993679+0000","last_undegraded":"2023-12-01T01:03:57.993679+0000","last_fullsized":"2023-12-01T01:03:57.993679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:09:25.689189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.004961+0000","last_change":"2023-12-01T01:02:47.275763+0000","last_active":"2023-12-01T01:03:58.004961+0000","last_peered":"2023-12-01T01:03:58.004961+0000","last_clean":"2023-12-01T01:03:58.004961+0000","last_became_active":"2023-12-01T01:02:47.275484+0000","last_became_peered":"2023-12-01T01:02:47.275484+0000","last_unstale":"2023-12-01T01:03:58.004961+0000","last_undegraded":"2023-12-01T01:03:58.004961+0000","last_fullsized":"2023-12-01T01:03:58.004961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:38:02.612857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006906+0000","last_change":"2023-12-01T01:02:47.274122+0000","last_active":"2023-12-01T01:03:58.006906+0000","last_peered":"2023-12-01T01:03:58.006906+0000","last_clean":"2023-12-01T01:03:58.006906+0000","last_became_active":"2023-12-01T01:02:47.273005+0000","last_became_peered":"2023-12-01T01:02:47.273005+0000","last_unstale":"2023-12-01T01:03:58.006906+0000","last_undegraded":"2023-12-01T01:03:58.006906+0000","last_fullsized":"2023-12-01T01:03:58.006906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:42:59.273076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.992330+0000","last_change":"2023-12-01T01:02:47.270221+0000","last_active":"2023-12-01T01:03:57.992330+0000","last_peered":"2023-12-01T01:03:57.992330+0000","last_clean":"2023-12-01T01:03:57.992330+0000","last_became_active":"2023-12-01T01:02:47.269946+0000","last_became_peered":"2023-12-01T01:02:47.269946+0000","last_unstale":"2023-12-01T01:03:57.992330+0000","last_undegraded":"2023-12-01T01:03:57.992330+0000","last_fullsized":"2023-12-01T01:03:57.992330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:00:01.640510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283824,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69058,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":498,"num_read_kb":319,"num_write":163,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":40837,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":196416,"data_compressed":6441,"data_compressed_allocated":8192,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514525,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":897024,"data_stored":433440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.502,"15min":0.504},"min":{"1min":0.38300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.54400000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.36799999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.60099999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61499999999999999,"15min":0.60899999999999999},"min":{"1min":0.5,"5min":0.371,"15min":0.371},"max":{"1min":0.83599999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.45900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81499999999999995,"5min":1.167,"15min":1.167},"last":0.498}]},{"osd":2,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53000000000000003,"15min":0.53200000000000003},"min":{"1min":0.379,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76900000000000002,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52000000000000002,"15min":0.51300000000000001},"min":{"1min":0.39200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.434}]},{"osd":3,"last update":"Fri Dec 1 01:04:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54200000000000004}]},{"osd":4,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67700000000000005,"15min":0.67300000000000004},"min":{"1min":0.56899999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.875,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.752},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.625},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79200000000000004,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.56399999999999995}]},{"osd":5,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64300000000000002,"15min":0.63500000000000001},"min":{"1min":0.501,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89100000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.877,"5min":1.103,"15min":1.103},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.59099999999999997,"5min":0.502,"15min":0.502},"max":{"1min":0.97699999999999998,"5min":1.153,"15min":1.153},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89400000000000002,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.64300000000000002}]},{"osd":8,"last update":"Fri Dec 1 01:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.79100000000000004}]},{"osd":9,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":0.98099999999999998,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.77400000000000002,"15min":0.76800000000000002},"min":{"1min":0.66400000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.94499999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.85399999999999998}]},{"osd":10,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.63500000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.86099999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.80600000000000005,"15min":0.80300000000000005},"min":{"1min":0.66100000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0109999999999999,"5min":1.482,"15min":1.482},"last":0.73899999999999999}]}]},{"osd":10,"up_from":69,"seq":296352743457,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":1052672,"data_stored":1089889,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.443,"15min":0.443},"min":{"1min":0.29699999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.503},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.30099999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69699999999999995,"5min":1.829,"15min":1.829},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77900000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84399999999999997,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.64900000000000002,"15min":0.66100000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91600000000000004,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.47699999999999998}]},{"osd":4,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.32600000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.80700000000000005,"5min":1.234,"15min":1.234},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.82699999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63100000000000001,"15min":0.623},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.90700000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98099999999999998,"5min":1.173,"15min":1.173},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.40699999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88900000000000001,"5min":1.302,"15min":1.302},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96399999999999997,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0569999999999999,"5min":1.198,"15min":1.198},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.53400000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95199999999999996,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72799999999999998}]},{"osd":9,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81899999999999995,"15min":0.82399999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.753,"15min":0.75900000000000001},"min":{"1min":0.48599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92700000000000005,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64500000000000002}]},{"osd":11,"last update":"Fri Dec 1 01:04:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68200000000000005,"15min":0.67600000000000005},"min":{"1min":0.54200000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71099999999999997,"15min":0.70099999999999996},"min":{"1min":0.53200000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.66700000000000004}]}]},{"osd":9,"up_from":64,"seq":274877906980,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":913408,"data_stored":433676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.45200000000000001,"15min":0.46300000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58499999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.318},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.46800000000000003,"15min":0.47699999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64600000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.372}]},{"osd":1,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73799999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.65000000000000002,"15min":0.63100000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":4.5899999999999999,"5min":4.5899999999999999,"15min":4.5899999999999999},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63,"15min":0.63900000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91900000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.46800000000000003}]},{"osd":3,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.59199999999999997,"15min":0.60799999999999998},"min":{"1min":0.317,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.748,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53500000000000003,"15min":0.54300000000000004},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83999999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.90600000000000003,"15min":0.94999999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89200000000000002,"5min":4.2309999999999999,"15min":4.2309999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":4.6200000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.64000000000000001,"15min":0.65300000000000002},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81699999999999995,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.70299999999999996,"15min":0.71899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95699999999999996,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.6040000000000001,"5min":4.6040000000000001,"15min":4.6040000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98999999999999999,"5min":1.111,"15min":1.111},"last":0.61799999999999999}]},{"osd":8,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76300000000000001,"15min":0.77200000000000002},"min":{"1min":0.54600000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":1.071,"15min":1.1259999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.004,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.502}]},{"osd":10,"last update":"Fri Dec 1 01:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.55500000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.88600000000000001,"5min":4.6369999999999996,"15min":4.6369999999999996},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.92700000000000005,"15min":0.96499999999999997},"min":{"1min":0.57899999999999996,"5min":0.504,"15min":0.504},"max":{"1min":0.84799999999999998,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.67800000000000005}]}]},{"osd":8,"up_from":57,"seq":244813135912,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":913408,"data_stored":433596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60799999999999998,"15min":0.63400000000000001},"min":{"1min":0.41299999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.745,"5min":2.25,"15min":2.25},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":2.234,"15min":2.234},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96999999999999997,"5min":2.234,"15min":2.234},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58599999999999997}]},{"osd":2,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72899999999999998,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52700000000000002,"15min":0.54300000000000004},"min":{"1min":0.29299999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.80700000000000005,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67200000000000004,"15min":0.69199999999999995},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86299999999999999,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81999999999999995,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.748}]},{"osd":4,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.60999999999999999,"15min":0.60399999999999998},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79600000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82699999999999996,"5min":2.222,"15min":2.222},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65800000000000003,"15min":0.68000000000000005},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84499999999999997,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.41399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.78000000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.78400000000000003},"min":{"1min":0.439,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89100000000000001,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.80100000000000005,"15min":0.81100000000000005},"min":{"1min":0.54600000000000004,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4299999999999999,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.84499999999999997}]},{"osd":7,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.79100000000000004},"min":{"1min":0.46500000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98399999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.51900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0029999999999999,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.96599999999999997}]},{"osd":9,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.82099999999999995,"15min":0.80300000000000005},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.3259999999999996,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.85099999999999998,"15min":0.85299999999999998},"min":{"1min":0.626,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.0550000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.92800000000000005}]},{"osd":10,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78400000000000003,"15min":0.78200000000000003},"min":{"1min":0.5,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.101,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82099999999999995,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0629999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.876}]},{"osd":11,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.94199999999999995}]}]},{"osd":7,"up_from":50,"seq":214748364844,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":1026113,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.39600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.36199999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.58599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.434,"15min":0.42199999999999999},"min":{"1min":0.34200000000000003,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.75700000000000001}]},{"osd":2,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.44500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82099999999999995,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60299999999999998,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85199999999999998,"5min":1.383,"15min":1.383},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.627},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80000000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.67000000000000004}]},{"osd":4,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.39100000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73999999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.379,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64600000000000002,"15min":0.63300000000000001},"min":{"1min":0.49299999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86599999999999999,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.59999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84799999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90500000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.77600000000000002}]},{"osd":8,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.54300000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71499999999999997,"15min":0.71199999999999997},"min":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88700000000000001,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.82699999999999996}]},{"osd":9,"last update":"Fri Dec 1 01:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.54200000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98199999999999998,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.52800000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.88800000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83699999999999997}]},{"osd":10,"last update":"Fri Dec 1 01:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.52500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.012,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.68500000000000005,"15min":0.67700000000000005},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.873}]},{"osd":11,"last update":"Fri Dec 1 01:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.90900000000000003}]}]},{"osd":6,"up_from":45,"seq":193273528368,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":901120,"data_stored":433071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.45300000000000001,"15min":0.436},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":3.036,"5min":3.036,"15min":3.036},"last":0.317}]},{"osd":1,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.45400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76700000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.59699999999999998,"15min":0.57899999999999996},"min":{"1min":0.46600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.626,"15min":0.622},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.439}]},{"osd":3,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33900000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.86299999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53600000000000003,"15min":0.52500000000000002},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.314},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.42799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.96299999999999997,"5min":1.248,"15min":1.248},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.62,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.46100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.78800000000000003,"5min":1.204,"15min":1.204},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.41999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.9950000000000001,"5min":2.9950000000000001,"15min":2.9950000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.04,"5min":1.319,"15min":1.319},"last":0.48699999999999999}]},{"osd":7,"last update":"Fri Dec 1 01:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.53600000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93300000000000005,"5min":1.149,"15min":1.149},"last":0.55300000000000005}]},{"osd":8,"last update":"Fri Dec 1 01:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.52000000000000002,"5min":0.502,"15min":0.502},"max":{"1min":0.95299999999999996,"5min":1.276,"15min":1.276},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.51400000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84699999999999998,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.499}]},{"osd":9,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.64900000000000002,"15min":0.66800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0629999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":3.6259999999999999,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.57399999999999995}]},{"osd":10,"last update":"Fri Dec 1 01:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.51100000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98299999999999998,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.86199999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":491637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51500000000000001,"15min":0.50600000000000001},"min":{"1min":0.40999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53400000000000003,"15min":0.51400000000000001},"min":{"1min":0.36299999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.54200000000000004,"15min":0.499},"min":{"1min":0.52600000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.55000000000000004,"15min":0.505},"min":{"1min":0.46700000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.90100000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.77800000000000002}]},{"osd":3,"last update":"Fri Dec 1 01:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52900000000000003,"15min":0.51600000000000001},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67300000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57499999999999996,"15min":0.54800000000000004},"min":{"1min":0.41199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Dec 1 01:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.434,"15min":0.38200000000000001},"min":{"1min":0.35999999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.46000000000000002,"15min":0.40200000000000002},"min":{"1min":0.39900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.40400000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.58599999999999997,"15min":0.55600000000000005},"min":{"1min":0.51600000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.60099999999999998,"15min":0.56599999999999995},"min":{"1min":0.53600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.59899999999999998,"15min":0.55900000000000005},"min":{"1min":0.495,"5min":0.377,"15min":0.377},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.47499999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.58899999999999997,"15min":0.53600000000000003},"min":{"1min":0.50600000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.58399999999999996,"15min":0.55400000000000005},"min":{"1min":0.44900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63}]},{"osd":8,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.56000000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.66300000000000003}]},{"osd":9,"last update":"Fri Dec 1 01:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.745}]},{"osd":10,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.53000000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.77400000000000002,"15min":0.75700000000000001},"min":{"1min":0.67500000000000004,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.80700000000000005}]},{"osd":11,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.83299999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":921600,"data_stored":434336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 01:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53600000000000003,"15min":0.52100000000000002},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65000000000000002,"5min":1.131,"15min":1.131},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.70699999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.42899999999999999}]},{"osd":2,"last update":"Fri Dec 1 01:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.37,"15min":0.37},"max":{"1min":0.86499999999999999,"5min":0.875,"15min":0.875},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.33500000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55500000000000005,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68400000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55900000000000005,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66300000000000003,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.41499999999999998}]},{"osd":5,"last update":"Fri Dec 1 01:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.628}]},{"osd":8,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.63800000000000001}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.67500000000000004,"15min":0.69699999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.93100000000000005,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.71199999999999997,"15min":0.73399999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94799999999999995,"5min":1.024,"15min":1.024},"last":0.495}]},{"osd":10,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.75800000000000001,"15min":0.77600000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.878,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.73999999999999999,"15min":0.76000000000000001},"min":{"1min":0.42999999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89600000000000002,"5min":1.175,"15min":1.175},"last":0.503}]},{"osd":11,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.628},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.56399999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":917504,"data_stored":434694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.5,"15min":0.48399999999999999},"min":{"1min":0.35999999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.874,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.309,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.47399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.54600000000000004,"15min":0.52400000000000002},"min":{"1min":0.39800000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.70399999999999996}]},{"osd":3,"last update":"Fri Dec 1 01:03:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55600000000000005,"15min":0.52100000000000002},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.628},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.52700000000000002},"min":{"1min":0.42999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.60099999999999998}]},{"osd":4,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.44600000000000001,"15min":0.41199999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.442},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.42599999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.46300000000000002}]},{"osd":6,"last update":"Fri Dec 1 01:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.53400000000000003},"min":{"1min":0.36799999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83299999999999996,"5min":0.877,"15min":0.877},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.628,"15min":0.59799999999999998},"min":{"1min":0.52000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.59199999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.58099999999999996,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.54500000000000004,"15min":0.53300000000000003},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.64000000000000001}]},{"osd":9,"last update":"Fri Dec 1 01:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.47499999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.52800000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.69299999999999995}]},{"osd":10,"last update":"Fri Dec 1 01:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.55600000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.61499999999999999}]},{"osd":11,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68400000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182460,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":917504,"data_stored":433388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.35599999999999998},"min":{"1min":0.26600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.41499999999999998,"15min":0.38100000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.32100000000000001}]},{"osd":1,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.51200000000000001},"min":{"1min":0.441,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.58899999999999997,"15min":0.52900000000000003},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.71199999999999997}]},{"osd":2,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Dec 1 01:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.47499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60599999999999998,"15min":0.57799999999999996},"min":{"1min":0.39600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77600000000000002,"5min":1.976,"15min":1.976},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Dec 1 01:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.623,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.621,"15min":0.59699999999999998},"min":{"1min":0.45700000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57499999999999996,"15min":0.55900000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.41499999999999998}]},{"osd":7,"last update":"Fri Dec 1 01:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.72299999999999998,"15min":0.72899999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81999999999999995,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.52900000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.872,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.66700000000000004}]},{"osd":8,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.65200000000000002}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.751,"15min":0.76900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.442},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.76500000000000001,"15min":0.78900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.61199999999999999}]},{"osd":10,"last update":"Fri Dec 1 01:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.86099999999999999,"15min":0.89300000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.81599999999999995,"5min":2.048,"15min":2.048},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.84999999999999998,"15min":0.88},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90200000000000002,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.63}]},{"osd":11,"last update":"Fri Dec 1 01:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.68000000000000005}]}]},{"osd":4,"up_from":32,"seq":137438953528,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":946176,"data_stored":492767,"data_compressed":6441,"data_compressed_allocated":8192,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51600000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.85099999999999998,"5min":0.88,"15min":0.88},"last":0.371},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.42999999999999999}]},{"osd":1,"last update":"Fri Dec 1 01:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.38800000000000001,"15min":0.36899999999999999},"min":{"1min":0.28100000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.61199999999999999,"5min":0.627,"15min":0.627},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.38800000000000001},"min":{"1min":0.32700000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63200000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.437}]},{"osd":2,"last update":"Fri Dec 1 01:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.63700000000000001,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":6.0110000000000001,"5min":6.0110000000000001,"15min":6.0110000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57399999999999995,"15min":0.55400000000000005},"min":{"1min":0.38800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Dec 1 01:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57699999999999996,"15min":0.55100000000000005},"min":{"1min":0.379,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75,"5min":1.004,"15min":1.004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80600000000000005,"5min":0.879,"15min":0.879},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59999999999999998,"15min":0.57799999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76600000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Dec 1 01:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93300000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.82499999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.64200000000000002}]},{"osd":7,"last update":"Fri Dec 1 01:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.872,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.57399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80200000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.72999999999999998}]},{"osd":8,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.93400000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.006,"5min":0.77800000000000002,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":6.0419999999999998,"5min":6.0419999999999998,"15min":6.0419999999999998},"last":0.66500000000000004}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.76300000000000001},"min":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96999999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.74199999999999999}]},{"osd":10,"last update":"Fri Dec 1 01:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.745,"15min":0.74099999999999999},"min":{"1min":0.55000000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.80200000000000005}]},{"osd":11,"last update":"Fri Dec 1 01:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.76200000000000001}]}]},{"osd":5,"up_from":37,"seq":158913790005,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":974848,"data_stored":1025311,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.49199999999999999},"min":{"1min":0.374,"5min":0.249,"15min":0.249},"max":{"1min":0.73199999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.495,"15min":0.48899999999999999},"min":{"1min":0.35299999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69799999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.443}]},{"osd":1,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53000000000000003},"min":{"1min":0.45700000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.56899999999999995,"15min":0.54100000000000004},"min":{"1min":0.47299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79100000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39700000000000002,"15min":0.38400000000000001},"min":{"1min":0.30399999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.436,"15min":0.42899999999999999},"min":{"1min":0.28799999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.315,"5min":0.309,"15min":0.309},"max":{"1min":0.626,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.626},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.378,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60699999999999998,"15min":0.58699999999999997},"min":{"1min":0.46899999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.81799999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.59299999999999997,"15min":0.57699999999999996},"min":{"1min":0.54200000000000004,"5min":0.318,"15min":0.318},"max":{"1min":0.77700000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Dec 1 01:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.40500000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.42899999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97199999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Dec 1 01:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63700000000000001,"15min":0.623},"min":{"1min":0.5,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.86099999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81399999999999995,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71599999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.41799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.57499999999999996,"15min":0.56699999999999995},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.66800000000000004}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.72199999999999998,"15min":0.68200000000000005},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.673,"5min":5.673,"15min":5.673},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.01,"5min":0.77800000000000002,"15min":0.73999999999999999},"min":{"1min":0.48999999999999999,"5min":0.439,"15min":0.439},"max":{"1min":5.6390000000000002,"5min":5.6390000000000002,"15min":5.6390000000000002},"last":0.79400000000000004}]},{"osd":10,"last update":"Fri Dec 1 01:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67100000000000004,"15min":0.66300000000000003},"min":{"1min":0.59499999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83399999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.68799999999999994,"15min":0.68200000000000005},"min":{"1min":0.57499999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84699999999999998,"5min":1.004,"15min":1.004},"last":0.754}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":58779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":60227,"data_compressed":6441,"data_compressed_allocated":8192,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T01:04:14.550 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-12-01T01:04:14.550 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-01T01:04:14.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.709+0000 7f7a7854d700 1 -- 172.21.15.26:0/2930245087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a700ffc70 msgr2=0x7f7a70100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:14.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.709+0000 7f7a7854d700 1 --2- 172.21.15.26:0/2930245087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a700ffc70 0x7f7a70100090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00d960 tx=0x7f7a6c00dc70 comp rx=0 tx=0).stop 2023-12-01T01:04:14.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.709+0000 7f7a7854d700 1 -- 172.21.15.26:0/2930245087 shutdown_connections 2023-12-01T01:04:14.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.709+0000 7f7a7854d700 1 --2- 172.21.15.26:0/2930245087 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a70101800 0x7f7a701080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.709+0000 7f7a7854d700 1 --2- 172.21.15.26:0/2930245087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a700ffc70 0x7f7a70100090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.709+0000 7f7a7854d700 1 --2- 172.21.15.26:0/2930245087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a70100e60 0x7f7a701012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.709+0000 7f7a7854d700 1 -- 172.21.15.26:0/2930245087 >> 172.21.15.26:0/2930245087 conn(0x7f7a700fb1c0 msgr2=0x7f7a700fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:14.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.709+0000 7f7a7854d700 1 -- 172.21.15.26:0/2930245087 shutdown_connections 2023-12-01T01:04:14.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.709+0000 7f7a7854d700 1 -- 172.21.15.26:0/2930245087 wait complete. 2023-12-01T01:04:14.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.710+0000 7f7a7854d700 1 Processor -- start 2023-12-01T01:04:14.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.710+0000 7f7a7854d700 1 -- start start 2023-12-01T01:04:14.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.710+0000 7f7a7854d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a700ffc70 0x7f7a701949b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:14.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.710+0000 7f7a7854d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a70100e60 0x7f7a70194ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:14.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.710+0000 7f7a7854d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a70101800 0x7f7a7019bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:14.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.710+0000 7f7a7854d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7019c530 con 0x7f7a70101800 2023-12-01T01:04:14.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.710+0000 7f7a7854d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7019c670 con 0x7f7a700ffc70 2023-12-01T01:04:14.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.710+0000 7f7a7854d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7019c800 con 0x7f7a70100e60 2023-12-01T01:04:14.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.710+0000 7f7a76aea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a70101800 0x7f7a7019bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:14.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.710+0000 7f7a762e9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a700ffc70 0x7f7a701949b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:14.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.710+0000 7f7a76aea700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a70101800 0x7f7a7019bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55022/0 (socket says 172.21.15.26:55022) 2023-12-01T01:04:14.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.710+0000 7f7a76aea700 1 -- 172.21.15.26:0/1158387557 learned_addr learned my addr 172.21.15.26:0/1158387557 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:14.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.710+0000 7f7a75ae8700 1 --2- 172.21.15.26:0/1158387557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a70100e60 0x7f7a70194ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:14.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.711+0000 7f7a76aea700 1 -- 172.21.15.26:0/1158387557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a70100e60 msgr2=0x7f7a70194ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:14.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.711+0000 7f7a76aea700 1 --2- 172.21.15.26:0/1158387557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a70100e60 0x7f7a70194ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.711+0000 7f7a76aea700 1 -- 172.21.15.26:0/1158387557 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a700ffc70 msgr2=0x7f7a701949b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:14.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.711+0000 7f7a76aea700 1 --2- 172.21.15.26:0/1158387557 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a700ffc70 0x7f7a701949b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.711+0000 7f7a76aea700 1 -- 172.21.15.26:0/1158387557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a600095f0 con 0x7f7a70101800 2023-12-01T01:04:14.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.711+0000 7f7a762e9700 1 --2- 172.21.15.26:0/1158387557 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a700ffc70 0x7f7a701949b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:04:14.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.711+0000 7f7a76aea700 1 --2- 172.21.15.26:0/1158387557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a70101800 0x7f7a7019bf60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800ef30 tx=0x7f7a6800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:14.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.711+0000 7f7a677fe700 1 -- 172.21.15.26:0/1158387557 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68018070 con 0x7f7a70101800 2023-12-01T01:04:14.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.711+0000 7f7a7854d700 1 -- 172.21.15.26:0/1158387557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a6c00d590 con 0x7f7a70101800 2023-12-01T01:04:14.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.711+0000 7f7a677fe700 1 -- 172.21.15.26:0/1158387557 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7a6800f040 con 0x7f7a70101800 2023-12-01T01:04:14.714 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.711+0000 7f7a677fe700 1 -- 172.21.15.26:0/1158387557 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6800cd00 con 0x7f7a70101800 2023-12-01T01:04:14.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.711+0000 7f7a7854d700 1 -- 172.21.15.26:0/1158387557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7019ce00 con 0x7f7a70101800 2023-12-01T01:04:14.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.712+0000 7f7a7854d700 1 -- 172.21.15.26:0/1158387557 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a70107200 con 0x7f7a70101800 2023-12-01T01:04:14.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.713+0000 7f7a677fe700 1 -- 172.21.15.26:0/1158387557 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f7a68003a00 con 0x7f7a70101800 2023-12-01T01:04:14.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.714+0000 7f7a677fe700 1 --2- 172.21.15.26:0/1158387557 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7a5c0a0570 0x7f7a5c0a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:14.715 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.714+0000 7f7a762e9700 1 --2- 172.21.15.26:0/1158387557 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7a5c0a0570 0x7f7a5c0a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:14.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.714+0000 7f7a677fe700 1 -- 172.21.15.26:0/1158387557 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7a680cbdd0 con 0x7f7a70101800 2023-12-01T01:04:14.716 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.714+0000 7f7a762e9700 1 --2- 172.21.15.26:0/1158387557 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7a5c0a0570 0x7f7a5c0a2a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009230 tx=0x7f7a6c005040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:14.718 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.717+0000 7f7a677fe700 1 -- 172.21.15.26:0/1158387557 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7a68095a10 con 0x7f7a70101800 2023-12-01T01:04:14.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.919+0000 7f7a7854d700 1 -- 172.21.15.26:0/1158387557 --> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a700611d0 con 0x7f7a5c0a0570 2023-12-01T01:04:14.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.931+0000 7f7a677fe700 1 -- 172.21.15.26:0/1158387557 <== mgr.14152 v2:172.21.15.26:6800/4255346255 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343920 (secure 0 0 0) 0x7f7a700611d0 con 0x7f7a5c0a0570 2023-12-01T01:04:14.936 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:04:14.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.935+0000 7f7a7854d700 1 -- 172.21.15.26:0/1158387557 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7a5c0a0570 msgr2=0x7f7a5c0a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:14.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.935+0000 7f7a7854d700 1 --2- 172.21.15.26:0/1158387557 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7a5c0a0570 0x7f7a5c0a2a30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009230 tx=0x7f7a6c005040 comp rx=0 tx=0).stop 2023-12-01T01:04:14.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.935+0000 7f7a7854d700 1 -- 172.21.15.26:0/1158387557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a70101800 msgr2=0x7f7a7019bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:14.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.935+0000 7f7a7854d700 1 --2- 172.21.15.26:0/1158387557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a70101800 0x7f7a7019bf60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800ef30 tx=0x7f7a6800c3a0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.935+0000 7f7a7854d700 1 -- 172.21.15.26:0/1158387557 shutdown_connections 2023-12-01T01:04:14.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.935+0000 7f7a7854d700 1 --2- 172.21.15.26:0/1158387557 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7a5c0a0570 0x7f7a5c0a2a30 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.935+0000 7f7a7854d700 1 --2- 172.21.15.26:0/1158387557 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a70101800 0x7f7a7019bf60 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.935+0000 7f7a7854d700 1 --2- 172.21.15.26:0/1158387557 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7a700ffc70 0x7f7a701949b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.935+0000 7f7a7854d700 1 --2- 172.21.15.26:0/1158387557 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7a70100e60 0x7f7a70194ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:14.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.935+0000 7f7a7854d700 1 -- 172.21.15.26:0/1158387557 >> 172.21.15.26:0/1158387557 conn(0x7f7a700fb1c0 msgr2=0x7f7a70104340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:14.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.935+0000 7f7a7854d700 1 -- 172.21.15.26:0/1158387557 shutdown_connections 2023-12-01T01:04:14.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:14.935+0000 7f7a7854d700 1 -- 172.21.15.26:0/1158387557 wait complete. 2023-12-01T01:04:14.940 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2023-12-01T01:04:14.948 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2023-12-01T01:04:13.976581+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":659672,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":624,"num_read_kb":428,"num_write":346,"num_write_kb":3058,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1221573,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":782,"ondisk_log_size":782,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":334440,"kb_used_data":11016,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124607384,"statfs":{"total":1151940427776,"available":1151597961216,"internally_reserved":0,"allocated":11280384,"data_stored":7161918,"data_compressed":114720,"data_compressed_allocated":143360,"data_compressed_original":1806336,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5946,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":48,"num_write":8,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002985"},"pg_stats":[{"pgid":"3.3f","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006469+0000","last_change":"2023-12-01T01:02:47.280671+0000","last_active":"2023-12-01T01:03:58.006469+0000","last_peered":"2023-12-01T01:03:58.006469+0000","last_clean":"2023-12-01T01:03:58.006469+0000","last_became_active":"2023-12-01T01:02:47.279922+0000","last_became_peered":"2023-12-01T01:02:47.279922+0000","last_unstale":"2023-12-01T01:03:58.006469+0000","last_undegraded":"2023-12-01T01:03:58.006469+0000","last_fullsized":"2023-12-01T01:03:58.006469+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:07:38.049977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.995520+0000","last_change":"2023-12-01T01:02:47.286185+0000","last_active":"2023-12-01T01:03:57.995520+0000","last_peered":"2023-12-01T01:03:57.995520+0000","last_clean":"2023-12-01T01:03:57.995520+0000","last_became_active":"2023-12-01T01:02:47.283747+0000","last_became_peered":"2023-12-01T01:02:47.283747+0000","last_unstale":"2023-12-01T01:03:57.995520+0000","last_undegraded":"2023-12-01T01:03:57.995520+0000","last_fullsized":"2023-12-01T01:03:57.995520+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:38:32.697826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.005701+0000","last_change":"2023-12-01T01:02:47.285778+0000","last_active":"2023-12-01T01:03:58.005701+0000","last_peered":"2023-12-01T01:03:58.005701+0000","last_clean":"2023-12-01T01:03:58.005701+0000","last_became_active":"2023-12-01T01:02:47.279395+0000","last_became_peered":"2023-12-01T01:02:47.279395+0000","last_unstale":"2023-12-01T01:03:58.005701+0000","last_undegraded":"2023-12-01T01:03:58.005701+0000","last_fullsized":"2023-12-01T01:03:58.005701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:04:20.570660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996769+0000","last_change":"2023-12-01T01:02:47.269316+0000","last_active":"2023-12-01T01:03:57.996769+0000","last_peered":"2023-12-01T01:03:57.996769+0000","last_clean":"2023-12-01T01:03:57.996769+0000","last_became_active":"2023-12-01T01:02:47.269041+0000","last_became_peered":"2023-12-01T01:02:47.269041+0000","last_unstale":"2023-12-01T01:03:57.996769+0000","last_undegraded":"2023-12-01T01:03:57.996769+0000","last_fullsized":"2023-12-01T01:03:57.996769+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:24:27.951422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.991431+0000","last_change":"2023-12-01T01:02:47.273802+0000","last_active":"2023-12-01T01:03:57.991431+0000","last_peered":"2023-12-01T01:03:57.991431+0000","last_clean":"2023-12-01T01:03:57.991431+0000","last_became_active":"2023-12-01T01:02:47.273450+0000","last_became_peered":"2023-12-01T01:02:47.273450+0000","last_unstale":"2023-12-01T01:03:57.991431+0000","last_undegraded":"2023-12-01T01:03:57.991431+0000","last_fullsized":"2023-12-01T01:03:57.991431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:19:39.061786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.003491+0000","last_change":"2023-12-01T01:02:47.274505+0000","last_active":"2023-12-01T01:03:58.003491+0000","last_peered":"2023-12-01T01:03:58.003491+0000","last_clean":"2023-12-01T01:03:58.003491+0000","last_became_active":"2023-12-01T01:02:47.274141+0000","last_became_peered":"2023-12-01T01:02:47.274141+0000","last_unstale":"2023-12-01T01:03:58.003491+0000","last_undegraded":"2023-12-01T01:03:58.003491+0000","last_fullsized":"2023-12-01T01:03:58.003491+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:27:16.589927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999308+0000","last_change":"2023-12-01T01:02:47.279480+0000","last_active":"2023-12-01T01:03:57.999308+0000","last_peered":"2023-12-01T01:03:57.999308+0000","last_clean":"2023-12-01T01:03:57.999308+0000","last_became_active":"2023-12-01T01:02:47.279147+0000","last_became_peered":"2023-12-01T01:02:47.279147+0000","last_unstale":"2023-12-01T01:03:57.999308+0000","last_undegraded":"2023-12-01T01:03:57.999308+0000","last_fullsized":"2023-12-01T01:03:57.999308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:28:37.815087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997337+0000","last_change":"2023-12-01T01:02:47.283997+0000","last_active":"2023-12-01T01:03:57.997337+0000","last_peered":"2023-12-01T01:03:57.997337+0000","last_clean":"2023-12-01T01:03:57.997337+0000","last_became_active":"2023-12-01T01:02:47.283694+0000","last_became_peered":"2023-12-01T01:02:47.283694+0000","last_unstale":"2023-12-01T01:03:57.997337+0000","last_undegraded":"2023-12-01T01:03:57.997337+0000","last_fullsized":"2023-12-01T01:03:57.997337+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:49:30.154079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"83'11","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.001593+0000","last_change":"2023-12-01T01:02:47.280113+0000","last_active":"2023-12-01T01:03:58.001593+0000","last_peered":"2023-12-01T01:03:58.001593+0000","last_clean":"2023-12-01T01:03:58.001593+0000","last_became_active":"2023-12-01T01:02:47.279844+0000","last_became_peered":"2023-12-01T01:02:47.279844+0000","last_unstale":"2023-12-01T01:03:58.001593+0000","last_undegraded":"2023-12-01T01:03:58.001593+0000","last_fullsized":"2023-12-01T01:03:58.001593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:50:19.955146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"83'16","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.003221+0000","last_change":"2023-12-01T01:02:47.275575+0000","last_active":"2023-12-01T01:03:58.003221+0000","last_peered":"2023-12-01T01:03:58.003221+0000","last_clean":"2023-12-01T01:03:58.003221+0000","last_became_active":"2023-12-01T01:02:47.275283+0000","last_became_peered":"2023-12-01T01:02:47.275283+0000","last_unstale":"2023-12-01T01:03:58.003221+0000","last_undegraded":"2023-12-01T01:03:58.003221+0000","last_fullsized":"2023-12-01T01:03:58.003221+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:08:41.842374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.007450+0000","last_change":"2023-12-01T01:02:47.275992+0000","last_active":"2023-12-01T01:03:58.007450+0000","last_peered":"2023-12-01T01:03:58.007450+0000","last_clean":"2023-12-01T01:03:58.007450+0000","last_became_active":"2023-12-01T01:02:47.275406+0000","last_became_peered":"2023-12-01T01:02:47.275406+0000","last_unstale":"2023-12-01T01:03:58.007450+0000","last_undegraded":"2023-12-01T01:03:58.007450+0000","last_fullsized":"2023-12-01T01:03:58.007450+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:58:39.978873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.000303+0000","last_change":"2023-12-01T01:02:47.282829+0000","last_active":"2023-12-01T01:03:58.000303+0000","last_peered":"2023-12-01T01:03:58.000303+0000","last_clean":"2023-12-01T01:03:58.000303+0000","last_became_active":"2023-12-01T01:02:47.282007+0000","last_became_peered":"2023-12-01T01:02:47.282007+0000","last_unstale":"2023-12-01T01:03:58.000303+0000","last_undegraded":"2023-12-01T01:03:58.000303+0000","last_fullsized":"2023-12-01T01:03:58.000303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:55:57.394004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"83'10","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999813+0000","last_change":"2023-12-01T01:02:47.276769+0000","last_active":"2023-12-01T01:03:57.999813+0000","last_peered":"2023-12-01T01:03:57.999813+0000","last_clean":"2023-12-01T01:03:57.999813+0000","last_became_active":"2023-12-01T01:02:47.276355+0000","last_became_peered":"2023-12-01T01:02:47.276355+0000","last_unstale":"2023-12-01T01:03:57.999813+0000","last_undegraded":"2023-12-01T01:03:57.999813+0000","last_fullsized":"2023-12-01T01:03:57.999813+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:15:23.314516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996245+0000","last_change":"2023-12-01T01:02:47.286107+0000","last_active":"2023-12-01T01:03:57.996245+0000","last_peered":"2023-12-01T01:03:57.996245+0000","last_clean":"2023-12-01T01:03:57.996245+0000","last_became_active":"2023-12-01T01:02:47.285772+0000","last_became_peered":"2023-12-01T01:02:47.285772+0000","last_unstale":"2023-12-01T01:03:57.996245+0000","last_undegraded":"2023-12-01T01:03:57.996245+0000","last_fullsized":"2023-12-01T01:03:57.996245+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:30:29.730055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.992497+0000","last_change":"2023-12-01T01:02:47.281813+0000","last_active":"2023-12-01T01:03:57.992497+0000","last_peered":"2023-12-01T01:03:57.992497+0000","last_clean":"2023-12-01T01:03:57.992497+0000","last_became_active":"2023-12-01T01:02:47.279117+0000","last_became_peered":"2023-12-01T01:02:47.279117+0000","last_unstale":"2023-12-01T01:03:57.992497+0000","last_undegraded":"2023-12-01T01:03:57.992497+0000","last_fullsized":"2023-12-01T01:03:57.992497+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:11:34.646161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.002762+0000","last_change":"2023-12-01T01:02:47.289596+0000","last_active":"2023-12-01T01:03:58.002762+0000","last_peered":"2023-12-01T01:03:58.002762+0000","last_clean":"2023-12-01T01:03:58.002762+0000","last_became_active":"2023-12-01T01:02:47.289273+0000","last_became_peered":"2023-12-01T01:02:47.289273+0000","last_unstale":"2023-12-01T01:03:58.002762+0000","last_undegraded":"2023-12-01T01:03:58.002762+0000","last_fullsized":"2023-12-01T01:03:58.002762+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:10:33.606237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006622+0000","last_change":"2023-12-01T01:02:47.281198+0000","last_active":"2023-12-01T01:03:58.006622+0000","last_peered":"2023-12-01T01:03:58.006622+0000","last_clean":"2023-12-01T01:03:58.006622+0000","last_became_active":"2023-12-01T01:02:47.280903+0000","last_became_peered":"2023-12-01T01:02:47.280903+0000","last_unstale":"2023-12-01T01:03:58.006622+0000","last_undegraded":"2023-12-01T01:03:58.006622+0000","last_fullsized":"2023-12-01T01:03:58.006622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:14:56.199140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"83'10","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.000335+0000","last_change":"2023-12-01T01:02:47.281015+0000","last_active":"2023-12-01T01:03:58.000335+0000","last_peered":"2023-12-01T01:03:58.000335+0000","last_clean":"2023-12-01T01:03:58.000335+0000","last_became_active":"2023-12-01T01:02:47.280670+0000","last_became_peered":"2023-12-01T01:02:47.280670+0000","last_unstale":"2023-12-01T01:03:58.000335+0000","last_undegraded":"2023-12-01T01:03:58.000335+0000","last_fullsized":"2023-12-01T01:03:58.000335+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:13:12.686506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997595+0000","last_change":"2023-12-01T01:02:47.283444+0000","last_active":"2023-12-01T01:03:57.997595+0000","last_peered":"2023-12-01T01:03:57.997595+0000","last_clean":"2023-12-01T01:03:57.997595+0000","last_became_active":"2023-12-01T01:02:47.283131+0000","last_became_peered":"2023-12-01T01:02:47.283131+0000","last_unstale":"2023-12-01T01:03:57.997595+0000","last_undegraded":"2023-12-01T01:03:57.997595+0000","last_fullsized":"2023-12-01T01:03:57.997595+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:36:50.069639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635021+0000","last_change":"2023-12-01T01:02:46.825507+0000","last_active":"2023-12-01T01:02:58.635021+0000","last_peered":"2023-12-01T01:02:58.635021+0000","last_clean":"2023-12-01T01:02:58.635021+0000","last_became_active":"2023-12-01T01:02:46.825170+0000","last_became_peered":"2023-12-01T01:02:46.825170+0000","last_unstale":"2023-12-01T01:02:58.635021+0000","last_undegraded":"2023-12-01T01:02:58.635021+0000","last_fullsized":"2023-12-01T01:02:58.635021+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:10:10.518664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"83'5","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.987626+0000","last_change":"2023-12-01T01:03:00.001168+0000","last_active":"2023-12-01T01:03:57.987626+0000","last_peered":"2023-12-01T01:03:57.987626+0000","last_clean":"2023-12-01T01:03:57.987626+0000","last_became_active":"2023-12-01T01:03:00.000826+0000","last_became_peered":"2023-12-01T01:03:00.000826+0000","last_unstale":"2023-12-01T01:03:57.987626+0000","last_undegraded":"2023-12-01T01:03:57.987626+0000","last_fullsized":"2023-12-01T01:03:57.987626+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:03:25.647589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638080+0000","last_change":"2023-12-01T01:02:46.835504+0000","last_active":"2023-12-01T01:02:58.638080+0000","last_peered":"2023-12-01T01:02:58.638080+0000","last_clean":"2023-12-01T01:02:58.638080+0000","last_became_active":"2023-12-01T01:02:46.835206+0000","last_became_peered":"2023-12-01T01:02:46.835206+0000","last_unstale":"2023-12-01T01:02:58.638080+0000","last_undegraded":"2023-12-01T01:02:58.638080+0000","last_fullsized":"2023-12-01T01:02:58.638080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:42:18.756880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006507+0000","last_change":"2023-12-01T01:02:47.286713+0000","last_active":"2023-12-01T01:03:58.006507+0000","last_peered":"2023-12-01T01:03:58.006507+0000","last_clean":"2023-12-01T01:03:58.006507+0000","last_became_active":"2023-12-01T01:02:47.285868+0000","last_became_peered":"2023-12-01T01:02:47.285868+0000","last_unstale":"2023-12-01T01:03:58.006507+0000","last_undegraded":"2023-12-01T01:03:58.006507+0000","last_fullsized":"2023-12-01T01:03:58.006507+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:16:31.496085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.648184+0000","last_change":"2023-12-01T01:02:59.647766+0000","last_active":"2023-12-01T01:02:59.648184+0000","last_peered":"2023-12-01T01:02:59.648184+0000","last_clean":"2023-12-01T01:02:59.648184+0000","last_became_active":"2023-12-01T01:02:59.641808+0000","last_became_peered":"2023-12-01T01:02:59.641808+0000","last_unstale":"2023-12-01T01:02:59.648184+0000","last_undegraded":"2023-12-01T01:02:59.648184+0000","last_fullsized":"2023-12-01T01:02:59.648184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:57:44.213111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.005710+0000","last_change":"2023-12-01T01:02:47.284868+0000","last_active":"2023-12-01T01:03:58.005710+0000","last_peered":"2023-12-01T01:03:58.005710+0000","last_clean":"2023-12-01T01:03:58.005710+0000","last_became_active":"2023-12-01T01:02:47.284602+0000","last_became_peered":"2023-12-01T01:02:47.284602+0000","last_unstale":"2023-12-01T01:03:58.005710+0000","last_undegraded":"2023-12-01T01:03:58.005710+0000","last_fullsized":"2023-12-01T01:03:58.005710+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:12:36.510333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634994+0000","last_change":"2023-12-01T01:02:46.832234+0000","last_active":"2023-12-01T01:02:58.634994+0000","last_peered":"2023-12-01T01:02:58.634994+0000","last_clean":"2023-12-01T01:02:58.634994+0000","last_became_active":"2023-12-01T01:02:46.831986+0000","last_became_peered":"2023-12-01T01:02:46.831986+0000","last_unstale":"2023-12-01T01:02:58.634994+0000","last_undegraded":"2023-12-01T01:02:58.634994+0000","last_fullsized":"2023-12-01T01:02:58.634994+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:49:35.773243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"83'15","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.004824+0000","last_change":"2023-12-01T01:02:47.275033+0000","last_active":"2023-12-01T01:03:58.004824+0000","last_peered":"2023-12-01T01:03:58.004824+0000","last_clean":"2023-12-01T01:03:58.004824+0000","last_became_active":"2023-12-01T01:02:47.274730+0000","last_became_peered":"2023-12-01T01:02:47.274730+0000","last_unstale":"2023-12-01T01:03:58.004824+0000","last_undegraded":"2023-12-01T01:03:58.004824+0000","last_fullsized":"2023-12-01T01:03:58.004824+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:48:44.959720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'7","reported_seq":103,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:08.450577+0000","last_change":"2023-12-01T01:02:46.827046+0000","last_active":"2023-12-01T01:04:08.450577+0000","last_peered":"2023-12-01T01:04:08.450577+0000","last_clean":"2023-12-01T01:04:08.450577+0000","last_became_active":"2023-12-01T01:02:46.826716+0000","last_became_peered":"2023-12-01T01:02:46.826716+0000","last_unstale":"2023-12-01T01:04:08.450577+0000","last_undegraded":"2023-12-01T01:04:08.450577+0000","last_fullsized":"2023-12-01T01:04:08.450577+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:06:46.195630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1108,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.987198+0000","last_change":"2023-12-01T01:02:47.270299+0000","last_active":"2023-12-01T01:03:57.987198+0000","last_peered":"2023-12-01T01:03:57.987198+0000","last_clean":"2023-12-01T01:03:57.987198+0000","last_became_active":"2023-12-01T01:02:47.270016+0000","last_became_peered":"2023-12-01T01:02:47.270016+0000","last_unstale":"2023-12-01T01:03:57.987198+0000","last_undegraded":"2023-12-01T01:03:57.987198+0000","last_fullsized":"2023-12-01T01:03:57.987198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:16:30.207449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":30,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.643802+0000","last_change":"2023-12-01T01:02:59.643802+0000","last_active":"2023-12-01T01:02:59.643802+0000","last_peered":"2023-12-01T01:02:59.643802+0000","last_clean":"2023-12-01T01:02:59.643802+0000","last_became_active":"2023-12-01T01:02:59.640951+0000","last_became_peered":"2023-12-01T01:02:59.640951+0000","last_unstale":"2023-12-01T01:02:59.643802+0000","last_undegraded":"2023-12-01T01:02:59.643802+0000","last_fullsized":"2023-12-01T01:02:59.643802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:52:32.599515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999994+0000","last_change":"2023-12-01T01:02:47.274600+0000","last_active":"2023-12-01T01:03:57.999994+0000","last_peered":"2023-12-01T01:03:57.999994+0000","last_clean":"2023-12-01T01:03:57.999994+0000","last_became_active":"2023-12-01T01:02:47.273979+0000","last_became_peered":"2023-12-01T01:02:47.273979+0000","last_unstale":"2023-12-01T01:03:57.999994+0000","last_undegraded":"2023-12-01T01:03:57.999994+0000","last_fullsized":"2023-12-01T01:03:57.999994+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:20:55.693393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629126+0000","last_change":"2023-12-01T01:02:46.821479+0000","last_active":"2023-12-01T01:02:58.629126+0000","last_peered":"2023-12-01T01:02:58.629126+0000","last_clean":"2023-12-01T01:02:58.629126+0000","last_became_active":"2023-12-01T01:02:46.821090+0000","last_became_peered":"2023-12-01T01:02:46.821090+0000","last_unstale":"2023-12-01T01:02:58.629126+0000","last_undegraded":"2023-12-01T01:02:58.629126+0000","last_fullsized":"2023-12-01T01:02:58.629126+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:17:48.216217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.994530+0000","last_change":"2023-12-01T01:02:47.274298+0000","last_active":"2023-12-01T01:03:57.994530+0000","last_peered":"2023-12-01T01:03:57.994530+0000","last_clean":"2023-12-01T01:03:57.994530+0000","last_became_active":"2023-12-01T01:02:47.274006+0000","last_became_peered":"2023-12-01T01:02:47.274006+0000","last_unstale":"2023-12-01T01:03:57.994530+0000","last_undegraded":"2023-12-01T01:03:57.994530+0000","last_fullsized":"2023-12-01T01:03:57.994530+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:40:38.354879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637568+0000","last_change":"2023-12-01T01:02:46.826341+0000","last_active":"2023-12-01T01:02:58.637568+0000","last_peered":"2023-12-01T01:02:58.637568+0000","last_clean":"2023-12-01T01:02:58.637568+0000","last_became_active":"2023-12-01T01:02:46.825979+0000","last_became_peered":"2023-12-01T01:02:46.825979+0000","last_unstale":"2023-12-01T01:02:58.637568+0000","last_undegraded":"2023-12-01T01:02:58.637568+0000","last_fullsized":"2023-12-01T01:02:58.637568+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:29:48.681232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"83'11","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.992738+0000","last_change":"2023-12-01T01:02:47.280989+0000","last_active":"2023-12-01T01:03:57.992738+0000","last_peered":"2023-12-01T01:03:57.992738+0000","last_clean":"2023-12-01T01:03:57.992738+0000","last_became_active":"2023-12-01T01:02:47.280649+0000","last_became_peered":"2023-12-01T01:02:47.280649+0000","last_unstale":"2023-12-01T01:03:57.992738+0000","last_undegraded":"2023-12-01T01:03:57.992738+0000","last_fullsized":"2023-12-01T01:03:57.992738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:16:30.307427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":98,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:10.452968+0000","last_change":"2023-12-01T01:02:46.832304+0000","last_active":"2023-12-01T01:04:10.452968+0000","last_peered":"2023-12-01T01:04:10.452968+0000","last_clean":"2023-12-01T01:04:10.452968+0000","last_became_active":"2023-12-01T01:02:46.832014+0000","last_became_peered":"2023-12-01T01:02:46.832014+0000","last_unstale":"2023-12-01T01:04:10.452968+0000","last_undegraded":"2023-12-01T01:04:10.452968+0000","last_fullsized":"2023-12-01T01:04:10.452968+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:41:46.003527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"83'10","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.005234+0000","last_change":"2023-12-01T01:02:47.277819+0000","last_active":"2023-12-01T01:03:58.005234+0000","last_peered":"2023-12-01T01:03:58.005234+0000","last_clean":"2023-12-01T01:03:58.005234+0000","last_became_active":"2023-12-01T01:02:47.277534+0000","last_became_peered":"2023-12-01T01:02:47.277534+0000","last_unstale":"2023-12-01T01:03:58.005234+0000","last_undegraded":"2023-12-01T01:03:58.005234+0000","last_fullsized":"2023-12-01T01:03:58.005234+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:56:15.627538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638700+0000","last_change":"2023-12-01T01:02:46.826783+0000","last_active":"2023-12-01T01:02:58.638700+0000","last_peered":"2023-12-01T01:02:58.638700+0000","last_clean":"2023-12-01T01:02:58.638700+0000","last_became_active":"2023-12-01T01:02:46.826479+0000","last_became_peered":"2023-12-01T01:02:46.826479+0000","last_unstale":"2023-12-01T01:02:58.638700+0000","last_undegraded":"2023-12-01T01:02:58.638700+0000","last_fullsized":"2023-12-01T01:02:58.638700+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:30:09.681494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"83'9","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997740+0000","last_change":"2023-12-01T01:03:00.001466+0000","last_active":"2023-12-01T01:03:57.997740+0000","last_peered":"2023-12-01T01:03:57.997740+0000","last_clean":"2023-12-01T01:03:57.997740+0000","last_became_active":"2023-12-01T01:03:00.001077+0000","last_became_peered":"2023-12-01T01:03:00.001077+0000","last_unstale":"2023-12-01T01:03:57.997740+0000","last_undegraded":"2023-12-01T01:03:57.997740+0000","last_fullsized":"2023-12-01T01:03:57.997740+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:46:26.987257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.639542+0000","last_change":"2023-12-01T01:02:46.829332+0000","last_active":"2023-12-01T01:02:58.639542+0000","last_peered":"2023-12-01T01:02:58.639542+0000","last_clean":"2023-12-01T01:02:58.639542+0000","last_became_active":"2023-12-01T01:02:46.828828+0000","last_became_peered":"2023-12-01T01:02:46.828828+0000","last_unstale":"2023-12-01T01:02:58.639542+0000","last_undegraded":"2023-12-01T01:02:58.639542+0000","last_fullsized":"2023-12-01T01:02:58.639542+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:15:15.648138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"83'11","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006501+0000","last_change":"2023-12-01T01:02:47.277938+0000","last_active":"2023-12-01T01:03:58.006501+0000","last_peered":"2023-12-01T01:03:58.006501+0000","last_clean":"2023-12-01T01:03:58.006501+0000","last_became_active":"2023-12-01T01:02:47.277650+0000","last_became_peered":"2023-12-01T01:02:47.277650+0000","last_unstale":"2023-12-01T01:03:58.006501+0000","last_undegraded":"2023-12-01T01:03:58.006501+0000","last_fullsized":"2023-12-01T01:03:58.006501+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:03:46.667892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'32","reported_seq":236,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:11.111956+0000","last_change":"2023-12-01T01:03:00.008983+0000","last_active":"2023-12-01T01:04:11.111956+0000","last_peered":"2023-12-01T01:04:11.111956+0000","last_clean":"2023-12-01T01:04:11.111956+0000","last_became_active":"2023-12-01T01:03:00.001444+0000","last_became_peered":"2023-12-01T01:03:00.001444+0000","last_unstale":"2023-12-01T01:04:11.111956+0000","last_undegraded":"2023-12-01T01:04:11.111956+0000","last_fullsized":"2023-12-01T01:04:11.111956+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:29:25.347028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64476,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":162,"num_read_kb":139,"num_write":33,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":40837,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.995106+0000","last_change":"2023-12-01T01:02:47.272049+0000","last_active":"2023-12-01T01:03:57.995106+0000","last_peered":"2023-12-01T01:03:57.995106+0000","last_clean":"2023-12-01T01:03:57.995106+0000","last_became_active":"2023-12-01T01:02:47.271726+0000","last_became_peered":"2023-12-01T01:02:47.271726+0000","last_unstale":"2023-12-01T01:03:57.995106+0000","last_undegraded":"2023-12-01T01:03:57.995106+0000","last_fullsized":"2023-12-01T01:03:57.995106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:08:45.038989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634393+0000","last_change":"2023-12-01T01:02:46.831362+0000","last_active":"2023-12-01T01:02:58.634393+0000","last_peered":"2023-12-01T01:02:58.634393+0000","last_clean":"2023-12-01T01:02:58.634393+0000","last_became_active":"2023-12-01T01:02:46.830929+0000","last_became_peered":"2023-12-01T01:02:46.830929+0000","last_unstale":"2023-12-01T01:02:58.634393+0000","last_undegraded":"2023-12-01T01:02:58.634393+0000","last_fullsized":"2023-12-01T01:02:58.634393+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:39:54.855526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997351+0000","last_change":"2023-12-01T01:02:47.275343+0000","last_active":"2023-12-01T01:03:57.997351+0000","last_peered":"2023-12-01T01:03:57.997351+0000","last_clean":"2023-12-01T01:03:57.997351+0000","last_became_active":"2023-12-01T01:02:47.275042+0000","last_became_peered":"2023-12-01T01:02:47.275042+0000","last_unstale":"2023-12-01T01:03:57.997351+0000","last_undegraded":"2023-12-01T01:03:57.997351+0000","last_fullsized":"2023-12-01T01:03:57.997351+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:18:27.862601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638406+0000","last_change":"2023-12-01T01:02:46.831996+0000","last_active":"2023-12-01T01:02:58.638406+0000","last_peered":"2023-12-01T01:02:58.638406+0000","last_clean":"2023-12-01T01:02:58.638406+0000","last_became_active":"2023-12-01T01:02:46.831710+0000","last_became_peered":"2023-12-01T01:02:46.831710+0000","last_unstale":"2023-12-01T01:02:58.638406+0000","last_undegraded":"2023-12-01T01:02:58.638406+0000","last_fullsized":"2023-12-01T01:02:58.638406+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:50:42.698415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"83'15","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006191+0000","last_change":"2023-12-01T01:02:47.283771+0000","last_active":"2023-12-01T01:03:58.006191+0000","last_peered":"2023-12-01T01:03:58.006191+0000","last_clean":"2023-12-01T01:03:58.006191+0000","last_became_active":"2023-12-01T01:02:47.283363+0000","last_became_peered":"2023-12-01T01:02:47.283363+0000","last_unstale":"2023-12-01T01:03:58.006191+0000","last_undegraded":"2023-12-01T01:03:58.006191+0000","last_fullsized":"2023-12-01T01:03:58.006191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:44:40.918161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":101,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:08.450146+0000","last_change":"2023-12-01T01:02:46.825170+0000","last_active":"2023-12-01T01:04:08.450146+0000","last_peered":"2023-12-01T01:04:08.450146+0000","last_clean":"2023-12-01T01:04:08.450146+0000","last_became_active":"2023-12-01T01:02:46.824857+0000","last_became_peered":"2023-12-01T01:02:46.824857+0000","last_unstale":"2023-12-01T01:04:08.450146+0000","last_undegraded":"2023-12-01T01:04:08.450146+0000","last_fullsized":"2023-12-01T01:04:08.450146+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:05:54.095408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1074,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":83,"num_read_kb":5,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997749+0000","last_change":"2023-12-01T01:02:47.279495+0000","last_active":"2023-12-01T01:03:57.997749+0000","last_peered":"2023-12-01T01:03:57.997749+0000","last_clean":"2023-12-01T01:03:57.997749+0000","last_became_active":"2023-12-01T01:02:47.279171+0000","last_became_peered":"2023-12-01T01:02:47.279171+0000","last_unstale":"2023-12-01T01:03:57.997749+0000","last_undegraded":"2023-12-01T01:03:57.997749+0000","last_fullsized":"2023-12-01T01:03:57.997749+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:29:33.298818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634745+0000","last_change":"2023-12-01T01:02:46.833837+0000","last_active":"2023-12-01T01:02:58.634745+0000","last_peered":"2023-12-01T01:02:58.634745+0000","last_clean":"2023-12-01T01:02:58.634745+0000","last_became_active":"2023-12-01T01:02:46.833549+0000","last_became_peered":"2023-12-01T01:02:46.833549+0000","last_unstale":"2023-12-01T01:02:58.634745+0000","last_undegraded":"2023-12-01T01:02:58.634745+0000","last_fullsized":"2023-12-01T01:02:58.634745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:35:02.581360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.000743+0000","last_change":"2023-12-01T01:02:47.273884+0000","last_active":"2023-12-01T01:03:58.000743+0000","last_peered":"2023-12-01T01:03:58.000743+0000","last_clean":"2023-12-01T01:03:58.000743+0000","last_became_active":"2023-12-01T01:02:47.273575+0000","last_became_peered":"2023-12-01T01:02:47.273575+0000","last_unstale":"2023-12-01T01:03:58.000743+0000","last_undegraded":"2023-12-01T01:03:58.000743+0000","last_fullsized":"2023-12-01T01:03:58.000743+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:49:54.924619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635351+0000","last_change":"2023-12-01T01:02:46.832265+0000","last_active":"2023-12-01T01:02:58.635351+0000","last_peered":"2023-12-01T01:02:58.635351+0000","last_clean":"2023-12-01T01:02:58.635351+0000","last_became_active":"2023-12-01T01:02:46.831944+0000","last_became_peered":"2023-12-01T01:02:46.831944+0000","last_unstale":"2023-12-01T01:02:58.635351+0000","last_undegraded":"2023-12-01T01:02:58.635351+0000","last_fullsized":"2023-12-01T01:02:58.635351+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:54:54.814744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996133+0000","last_change":"2023-12-01T01:02:47.276967+0000","last_active":"2023-12-01T01:03:57.996133+0000","last_peered":"2023-12-01T01:03:57.996133+0000","last_clean":"2023-12-01T01:03:57.996133+0000","last_became_active":"2023-12-01T01:02:47.276660+0000","last_became_peered":"2023-12-01T01:02:47.276660+0000","last_unstale":"2023-12-01T01:03:57.996133+0000","last_undegraded":"2023-12-01T01:03:57.996133+0000","last_fullsized":"2023-12-01T01:03:57.996133+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:19:16.029376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634786+0000","last_change":"2023-12-01T01:02:46.834425+0000","last_active":"2023-12-01T01:02:58.634786+0000","last_peered":"2023-12-01T01:02:58.634786+0000","last_clean":"2023-12-01T01:02:58.634786+0000","last_became_active":"2023-12-01T01:02:46.834150+0000","last_became_peered":"2023-12-01T01:02:46.834150+0000","last_unstale":"2023-12-01T01:02:58.634786+0000","last_undegraded":"2023-12-01T01:02:58.634786+0000","last_fullsized":"2023-12-01T01:02:58.634786+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:52:39.619014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996630+0000","last_change":"2023-12-01T01:02:47.276386+0000","last_active":"2023-12-01T01:03:57.996630+0000","last_peered":"2023-12-01T01:03:57.996630+0000","last_clean":"2023-12-01T01:03:57.996630+0000","last_became_active":"2023-12-01T01:02:47.276092+0000","last_became_peered":"2023-12-01T01:02:47.276092+0000","last_unstale":"2023-12-01T01:03:57.996630+0000","last_undegraded":"2023-12-01T01:03:57.996630+0000","last_fullsized":"2023-12-01T01:03:57.996630+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:33:39.707619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":15,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638513+0000","last_change":"2023-12-01T01:02:46.832778+0000","last_active":"2023-12-01T01:02:58.638513+0000","last_peered":"2023-12-01T01:02:58.638513+0000","last_clean":"2023-12-01T01:02:58.638513+0000","last_became_active":"2023-12-01T01:02:46.832406+0000","last_became_peered":"2023-12-01T01:02:46.832406+0000","last_unstale":"2023-12-01T01:02:58.638513+0000","last_undegraded":"2023-12-01T01:02:58.638513+0000","last_fullsized":"2023-12-01T01:02:58.638513+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:06:08.569651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996321+0000","last_change":"2023-12-01T01:02:59.639129+0000","last_active":"2023-12-01T01:03:57.996321+0000","last_peered":"2023-12-01T01:03:57.996321+0000","last_clean":"2023-12-01T01:03:57.996321+0000","last_became_active":"2023-12-01T01:02:59.638745+0000","last_became_peered":"2023-12-01T01:02:59.638745+0000","last_unstale":"2023-12-01T01:03:57.996321+0000","last_undegraded":"2023-12-01T01:03:57.996321+0000","last_fullsized":"2023-12-01T01:03:57.996321+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:26:26.032297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.003323+0000","last_change":"2023-12-01T01:02:47.269953+0000","last_active":"2023-12-01T01:03:58.003323+0000","last_peered":"2023-12-01T01:03:58.003323+0000","last_clean":"2023-12-01T01:03:58.003323+0000","last_became_active":"2023-12-01T01:02:47.265723+0000","last_became_peered":"2023-12-01T01:02:47.265723+0000","last_unstale":"2023-12-01T01:03:58.003323+0000","last_undegraded":"2023-12-01T01:03:58.003323+0000","last_fullsized":"2023-12-01T01:03:58.003323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:28:44.370883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":97,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:08.449625+0000","last_change":"2023-12-01T01:02:46.827001+0000","last_active":"2023-12-01T01:04:08.449625+0000","last_peered":"2023-12-01T01:04:08.449625+0000","last_clean":"2023-12-01T01:04:08.449625+0000","last_became_active":"2023-12-01T01:02:46.826690+0000","last_became_peered":"2023-12-01T01:02:46.826690+0000","last_unstale":"2023-12-01T01:04:08.449625+0000","last_undegraded":"2023-12-01T01:04:08.449625+0000","last_fullsized":"2023-12-01T01:04:08.449625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:37:38.015190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006285+0000","last_change":"2023-12-01T01:02:47.283372+0000","last_active":"2023-12-01T01:03:58.006285+0000","last_peered":"2023-12-01T01:03:58.006285+0000","last_clean":"2023-12-01T01:03:58.006285+0000","last_became_active":"2023-12-01T01:02:47.283075+0000","last_became_peered":"2023-12-01T01:02:47.283075+0000","last_unstale":"2023-12-01T01:03:58.006285+0000","last_undegraded":"2023-12-01T01:03:58.006285+0000","last_fullsized":"2023-12-01T01:03:58.006285+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:37:07.707284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.631280+0000","last_change":"2023-12-01T01:02:46.828490+0000","last_active":"2023-12-01T01:02:58.631280+0000","last_peered":"2023-12-01T01:02:58.631280+0000","last_clean":"2023-12-01T01:02:58.631280+0000","last_became_active":"2023-12-01T01:02:46.828129+0000","last_became_peered":"2023-12-01T01:02:46.828129+0000","last_unstale":"2023-12-01T01:02:58.631280+0000","last_undegraded":"2023-12-01T01:02:58.631280+0000","last_fullsized":"2023-12-01T01:02:58.631280+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T11:52:17.060443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":322,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638309+0000","last_change":"2023-12-01T01:01:49.966660+0000","last_active":"2023-12-01T01:02:58.638309+0000","last_peered":"2023-12-01T01:02:58.638309+0000","last_clean":"2023-12-01T01:02:58.638309+0000","last_became_active":"2023-12-01T01:01:49.966125+0000","last_became_peered":"2023-12-01T01:01:49.966125+0000","last_unstale":"2023-12-01T01:02:58.638309+0000","last_undegraded":"2023-12-01T01:02:58.638309+0000","last_fullsized":"2023-12-01T01:02:58.638309+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T00:59:06.461487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T00:59:06.461487+0000","last_clean_scrub_stamp":"2023-12-01T00:59:06.461487+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:34:52.236994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.994773+0000","last_change":"2023-12-01T01:02:47.282702+0000","last_active":"2023-12-01T01:03:57.994773+0000","last_peered":"2023-12-01T01:03:57.994773+0000","last_clean":"2023-12-01T01:03:57.994773+0000","last_became_active":"2023-12-01T01:02:47.282368+0000","last_became_peered":"2023-12-01T01:02:47.282368+0000","last_unstale":"2023-12-01T01:03:57.994773+0000","last_undegraded":"2023-12-01T01:03:57.994773+0000","last_fullsized":"2023-12-01T01:03:57.994773+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:24:40.985055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638420+0000","last_change":"2023-12-01T01:02:46.827882+0000","last_active":"2023-12-01T01:02:58.638420+0000","last_peered":"2023-12-01T01:02:58.638420+0000","last_clean":"2023-12-01T01:02:58.638420+0000","last_became_active":"2023-12-01T01:02:46.827354+0000","last_became_peered":"2023-12-01T01:02:46.827354+0000","last_unstale":"2023-12-01T01:02:58.638420+0000","last_undegraded":"2023-12-01T01:02:58.638420+0000","last_fullsized":"2023-12-01T01:02:58.638420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:48:42.894733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635396+0000","last_change":"2023-12-01T01:02:46.833439+0000","last_active":"2023-12-01T01:02:58.635396+0000","last_peered":"2023-12-01T01:02:58.635396+0000","last_clean":"2023-12-01T01:02:58.635396+0000","last_became_active":"2023-12-01T01:02:46.833199+0000","last_became_peered":"2023-12-01T01:02:46.833199+0000","last_unstale":"2023-12-01T01:02:58.635396+0000","last_undegraded":"2023-12-01T01:02:58.635396+0000","last_fullsized":"2023-12-01T01:02:58.635396+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:44:49.559138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999313+0000","last_change":"2023-12-01T01:02:47.283580+0000","last_active":"2023-12-01T01:03:57.999313+0000","last_peered":"2023-12-01T01:03:57.999313+0000","last_clean":"2023-12-01T01:03:57.999313+0000","last_became_active":"2023-12-01T01:02:47.283095+0000","last_became_peered":"2023-12-01T01:02:47.283095+0000","last_unstale":"2023-12-01T01:03:57.999313+0000","last_undegraded":"2023-12-01T01:03:57.999313+0000","last_fullsized":"2023-12-01T01:03:57.999313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:33:12.541487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:04:01.002114+0000","last_change":"2023-12-01T01:02:46.831348+0000","last_active":"2023-12-01T01:04:01.002114+0000","last_peered":"2023-12-01T01:04:01.002114+0000","last_clean":"2023-12-01T01:04:01.002114+0000","last_became_active":"2023-12-01T01:02:46.831031+0000","last_became_peered":"2023-12-01T01:02:46.831031+0000","last_unstale":"2023-12-01T01:04:01.002114+0000","last_undegraded":"2023-12-01T01:04:01.002114+0000","last_fullsized":"2023-12-01T01:04:01.002114+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:15:53.172465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996739+0000","last_change":"2023-12-01T01:02:47.276281+0000","last_active":"2023-12-01T01:03:57.996739+0000","last_peered":"2023-12-01T01:03:57.996739+0000","last_clean":"2023-12-01T01:03:57.996739+0000","last_became_active":"2023-12-01T01:02:47.275573+0000","last_became_peered":"2023-12-01T01:02:47.275573+0000","last_unstale":"2023-12-01T01:03:57.996739+0000","last_undegraded":"2023-12-01T01:03:57.996739+0000","last_fullsized":"2023-12-01T01:03:57.996739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:50:07.601674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.631688+0000","last_change":"2023-12-01T01:02:46.823053+0000","last_active":"2023-12-01T01:02:58.631688+0000","last_peered":"2023-12-01T01:02:58.631688+0000","last_clean":"2023-12-01T01:02:58.631688+0000","last_became_active":"2023-12-01T01:02:46.822772+0000","last_became_peered":"2023-12-01T01:02:46.822772+0000","last_unstale":"2023-12-01T01:02:58.631688+0000","last_undegraded":"2023-12-01T01:02:58.631688+0000","last_fullsized":"2023-12-01T01:02:58.631688+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:43:22.496286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996524+0000","last_change":"2023-12-01T01:02:47.289484+0000","last_active":"2023-12-01T01:03:57.996524+0000","last_peered":"2023-12-01T01:03:57.996524+0000","last_clean":"2023-12-01T01:03:57.996524+0000","last_became_active":"2023-12-01T01:02:47.289176+0000","last_became_peered":"2023-12-01T01:02:47.289176+0000","last_unstale":"2023-12-01T01:03:57.996524+0000","last_undegraded":"2023-12-01T01:03:57.996524+0000","last_fullsized":"2023-12-01T01:03:57.996524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:21:52.905017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634804+0000","last_change":"2023-12-01T01:02:46.830635+0000","last_active":"2023-12-01T01:02:58.634804+0000","last_peered":"2023-12-01T01:02:58.634804+0000","last_clean":"2023-12-01T01:02:58.634804+0000","last_became_active":"2023-12-01T01:02:46.830337+0000","last_became_peered":"2023-12-01T01:02:46.830337+0000","last_unstale":"2023-12-01T01:02:58.634804+0000","last_undegraded":"2023-12-01T01:02:58.634804+0000","last_fullsized":"2023-12-01T01:02:58.634804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:02:10.017744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.964199+0000","last_change":"2023-12-01T01:02:47.281923+0000","last_active":"2023-12-01T01:03:57.964199+0000","last_peered":"2023-12-01T01:03:57.964199+0000","last_clean":"2023-12-01T01:03:57.964199+0000","last_became_active":"2023-12-01T01:02:47.281598+0000","last_became_peered":"2023-12-01T01:02:47.281598+0000","last_unstale":"2023-12-01T01:03:57.964199+0000","last_undegraded":"2023-12-01T01:03:57.964199+0000","last_fullsized":"2023-12-01T01:03:57.964199+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:07:54.327023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.637701+0000","last_change":"2023-12-01T01:02:46.830248+0000","last_active":"2023-12-01T01:02:58.637701+0000","last_peered":"2023-12-01T01:02:58.637701+0000","last_clean":"2023-12-01T01:02:58.637701+0000","last_became_active":"2023-12-01T01:02:46.829951+0000","last_became_peered":"2023-12-01T01:02:46.829951+0000","last_unstale":"2023-12-01T01:02:58.637701+0000","last_undegraded":"2023-12-01T01:02:58.637701+0000","last_fullsized":"2023-12-01T01:02:58.637701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:04:23.978035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.992005+0000","last_change":"2023-12-01T01:02:47.280871+0000","last_active":"2023-12-01T01:03:57.992005+0000","last_peered":"2023-12-01T01:03:57.992005+0000","last_clean":"2023-12-01T01:03:57.992005+0000","last_became_active":"2023-12-01T01:02:47.280527+0000","last_became_peered":"2023-12-01T01:02:47.280527+0000","last_unstale":"2023-12-01T01:03:57.992005+0000","last_undegraded":"2023-12-01T01:03:57.992005+0000","last_fullsized":"2023-12-01T01:03:57.992005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:16:47.700500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:02:59.644414+0000","last_change":"2023-12-01T01:02:59.643980+0000","last_active":"2023-12-01T01:02:59.644414+0000","last_peered":"2023-12-01T01:02:59.644414+0000","last_clean":"2023-12-01T01:02:59.644414+0000","last_became_active":"2023-12-01T01:02:59.641039+0000","last_became_peered":"2023-12-01T01:02:59.641039+0000","last_unstale":"2023-12-01T01:02:59.644414+0000","last_undegraded":"2023-12-01T01:02:59.644414+0000","last_fullsized":"2023-12-01T01:02:59.644414+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:06:23.044556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.996416+0000","last_change":"2023-12-01T01:02:47.284981+0000","last_active":"2023-12-01T01:03:57.996416+0000","last_peered":"2023-12-01T01:03:57.996416+0000","last_clean":"2023-12-01T01:03:57.996416+0000","last_became_active":"2023-12-01T01:02:47.284576+0000","last_became_peered":"2023-12-01T01:02:47.284576+0000","last_unstale":"2023-12-01T01:03:57.996416+0000","last_undegraded":"2023-12-01T01:03:57.996416+0000","last_fullsized":"2023-12-01T01:03:57.996416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:58:21.152156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.634597+0000","last_change":"2023-12-01T01:02:46.828769+0000","last_active":"2023-12-01T01:02:58.634597+0000","last_peered":"2023-12-01T01:02:58.634597+0000","last_clean":"2023-12-01T01:02:58.634597+0000","last_became_active":"2023-12-01T01:02:46.828498+0000","last_became_peered":"2023-12-01T01:02:46.828498+0000","last_unstale":"2023-12-01T01:02:58.634597+0000","last_undegraded":"2023-12-01T01:02:58.634597+0000","last_fullsized":"2023-12-01T01:02:58.634597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:12:26.618082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006850+0000","last_change":"2023-12-01T01:02:47.283179+0000","last_active":"2023-12-01T01:03:58.006850+0000","last_peered":"2023-12-01T01:03:58.006850+0000","last_clean":"2023-12-01T01:03:58.006850+0000","last_became_active":"2023-12-01T01:02:47.282883+0000","last_became_peered":"2023-12-01T01:02:47.282883+0000","last_unstale":"2023-12-01T01:03:58.006850+0000","last_undegraded":"2023-12-01T01:03:58.006850+0000","last_fullsized":"2023-12-01T01:03:58.006850+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:19:47.406888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.635111+0000","last_change":"2023-12-01T01:02:46.833482+0000","last_active":"2023-12-01T01:02:58.635111+0000","last_peered":"2023-12-01T01:02:58.635111+0000","last_clean":"2023-12-01T01:02:58.635111+0000","last_became_active":"2023-12-01T01:02:46.833200+0000","last_became_peered":"2023-12-01T01:02:46.833200+0000","last_unstale":"2023-12-01T01:02:58.635111+0000","last_undegraded":"2023-12-01T01:02:58.635111+0000","last_fullsized":"2023-12-01T01:02:58.635111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T04:52:41.480509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.007582+0000","last_change":"2023-12-01T01:02:47.275802+0000","last_active":"2023-12-01T01:03:58.007582+0000","last_peered":"2023-12-01T01:03:58.007582+0000","last_clean":"2023-12-01T01:03:58.007582+0000","last_became_active":"2023-12-01T01:02:47.274837+0000","last_became_peered":"2023-12-01T01:02:47.274837+0000","last_unstale":"2023-12-01T01:03:58.007582+0000","last_undegraded":"2023-12-01T01:03:58.007582+0000","last_fullsized":"2023-12-01T01:03:58.007582+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:43:30.799999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'1","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.638603+0000","last_change":"2023-12-01T01:02:46.829445+0000","last_active":"2023-12-01T01:02:58.638603+0000","last_peered":"2023-12-01T01:02:58.638603+0000","last_clean":"2023-12-01T01:02:58.638603+0000","last_became_active":"2023-12-01T01:02:46.829120+0000","last_became_peered":"2023-12-01T01:02:46.829120+0000","last_unstale":"2023-12-01T01:02:58.638603+0000","last_undegraded":"2023-12-01T01:02:58.638603+0000","last_fullsized":"2023-12-01T01:02:58.638603+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:57:44.467570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997242+0000","last_change":"2023-12-01T01:02:47.282683+0000","last_active":"2023-12-01T01:03:57.997242+0000","last_peered":"2023-12-01T01:03:57.997242+0000","last_clean":"2023-12-01T01:03:57.997242+0000","last_became_active":"2023-12-01T01:02:47.282346+0000","last_became_peered":"2023-12-01T01:02:47.282346+0000","last_unstale":"2023-12-01T01:03:57.997242+0000","last_undegraded":"2023-12-01T01:03:57.997242+0000","last_fullsized":"2023-12-01T01:03:57.997242+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:20:25.085982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'2","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-01T01:02:58.629529+0000","last_change":"2023-12-01T01:02:46.828060+0000","last_active":"2023-12-01T01:02:58.629529+0000","last_peered":"2023-12-01T01:02:58.629529+0000","last_clean":"2023-12-01T01:02:58.629529+0000","last_became_active":"2023-12-01T01:02:46.827754+0000","last_became_peered":"2023-12-01T01:02:46.827754+0000","last_unstale":"2023-12-01T01:02:58.629529+0000","last_undegraded":"2023-12-01T01:02:58.629529+0000","last_fullsized":"2023-12-01T01:02:58.629529+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:45.803913+0000","last_clean_scrub_stamp":"2023-12-01T01:02:45.803913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:22.794619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999191+0000","last_change":"2023-12-01T01:02:47.269538+0000","last_active":"2023-12-01T01:03:57.999191+0000","last_peered":"2023-12-01T01:03:57.999191+0000","last_clean":"2023-12-01T01:03:57.999191+0000","last_became_active":"2023-12-01T01:02:47.269245+0000","last_became_peered":"2023-12-01T01:02:47.269245+0000","last_unstale":"2023-12-01T01:03:57.999191+0000","last_undegraded":"2023-12-01T01:03:57.999191+0000","last_fullsized":"2023-12-01T01:03:57.999191+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:48:49.163896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"83'9","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.997229+0000","last_change":"2023-12-01T01:02:47.277545+0000","last_active":"2023-12-01T01:03:57.997229+0000","last_peered":"2023-12-01T01:03:57.997229+0000","last_clean":"2023-12-01T01:03:57.997229+0000","last_became_active":"2023-12-01T01:02:47.277307+0000","last_became_peered":"2023-12-01T01:02:47.277307+0000","last_unstale":"2023-12-01T01:03:57.997229+0000","last_undegraded":"2023-12-01T01:03:57.997229+0000","last_fullsized":"2023-12-01T01:03:57.997229+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T09:26:08.655231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"83'12","reported_seq":34,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.003980+0000","last_change":"2023-12-01T01:03:00.001120+0000","last_active":"2023-12-01T01:03:58.003980+0000","last_peered":"2023-12-01T01:03:58.003980+0000","last_clean":"2023-12-01T01:03:58.003980+0000","last_became_active":"2023-12-01T01:03:00.000707+0000","last_became_peered":"2023-12-01T01:03:00.000707+0000","last_unstale":"2023-12-01T01:03:58.003980+0000","last_undegraded":"2023-12-01T01:03:58.003980+0000","last_fullsized":"2023-12-01T01:03:58.003980+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T05:12:25.500981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,4],"acting":[2,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.994726+0000","last_change":"2023-12-01T01:02:47.274775+0000","last_active":"2023-12-01T01:03:57.994726+0000","last_peered":"2023-12-01T01:03:57.994726+0000","last_clean":"2023-12-01T01:03:57.994726+0000","last_became_active":"2023-12-01T01:02:47.274459+0000","last_became_peered":"2023-12-01T01:02:47.274459+0000","last_unstale":"2023-12-01T01:03:57.994726+0000","last_undegraded":"2023-12-01T01:03:57.994726+0000","last_fullsized":"2023-12-01T01:03:57.994726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T07:06:01.273551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.993086+0000","last_change":"2023-12-01T01:02:47.277487+0000","last_active":"2023-12-01T01:03:57.993086+0000","last_peered":"2023-12-01T01:03:57.993086+0000","last_clean":"2023-12-01T01:03:57.993086+0000","last_became_active":"2023-12-01T01:02:47.277092+0000","last_became_peered":"2023-12-01T01:02:47.277092+0000","last_unstale":"2023-12-01T01:03:57.993086+0000","last_undegraded":"2023-12-01T01:03:57.993086+0000","last_fullsized":"2023-12-01T01:03:57.993086+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:02:51.967302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"83'4","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.004024+0000","last_change":"2023-12-01T01:02:47.283814+0000","last_active":"2023-12-01T01:03:58.004024+0000","last_peered":"2023-12-01T01:03:58.004024+0000","last_clean":"2023-12-01T01:03:58.004024+0000","last_became_active":"2023-12-01T01:02:47.283289+0000","last_became_peered":"2023-12-01T01:02:47.283289+0000","last_unstale":"2023-12-01T01:03:58.004024+0000","last_undegraded":"2023-12-01T01:03:58.004024+0000","last_fullsized":"2023-12-01T01:03:58.004024+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T10:42:59.523846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.989722+0000","last_change":"2023-12-01T01:02:47.281748+0000","last_active":"2023-12-01T01:03:57.989722+0000","last_peered":"2023-12-01T01:03:57.989722+0000","last_clean":"2023-12-01T01:03:57.989722+0000","last_became_active":"2023-12-01T01:02:47.281445+0000","last_became_peered":"2023-12-01T01:02:47.281445+0000","last_unstale":"2023-12-01T01:03:57.989722+0000","last_undegraded":"2023-12-01T01:03:57.989722+0000","last_fullsized":"2023-12-01T01:03:57.989722+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T12:33:18.146911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"83'15","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.999814+0000","last_change":"2023-12-01T01:02:47.276827+0000","last_active":"2023-12-01T01:03:57.999814+0000","last_peered":"2023-12-01T01:03:57.999814+0000","last_clean":"2023-12-01T01:03:57.999814+0000","last_became_active":"2023-12-01T01:02:47.276346+0000","last_became_peered":"2023-12-01T01:02:47.276346+0000","last_unstale":"2023-12-01T01:03:57.999814+0000","last_undegraded":"2023-12-01T01:03:57.999814+0000","last_fullsized":"2023-12-01T01:03:57.999814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:49:23.203883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.991150+0000","last_change":"2023-12-01T01:02:47.276461+0000","last_active":"2023-12-01T01:03:57.991150+0000","last_peered":"2023-12-01T01:03:57.991150+0000","last_clean":"2023-12-01T01:03:57.991150+0000","last_became_active":"2023-12-01T01:02:47.275992+0000","last_became_peered":"2023-12-01T01:02:47.275992+0000","last_unstale":"2023-12-01T01:03:57.991150+0000","last_undegraded":"2023-12-01T01:03:57.991150+0000","last_fullsized":"2023-12-01T01:03:57.991150+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T03:14:04.629355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"83'6","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.995810+0000","last_change":"2023-12-01T01:02:47.274018+0000","last_active":"2023-12-01T01:03:57.995810+0000","last_peered":"2023-12-01T01:03:57.995810+0000","last_clean":"2023-12-01T01:03:57.995810+0000","last_became_active":"2023-12-01T01:02:47.273714+0000","last_became_peered":"2023-12-01T01:02:47.273714+0000","last_unstale":"2023-12-01T01:03:57.995810+0000","last_undegraded":"2023-12-01T01:03:57.995810+0000","last_fullsized":"2023-12-01T01:03:57.995810+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:26:14.154249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.993679+0000","last_change":"2023-12-01T01:02:47.276438+0000","last_active":"2023-12-01T01:03:57.993679+0000","last_peered":"2023-12-01T01:03:57.993679+0000","last_clean":"2023-12-01T01:03:57.993679+0000","last_became_active":"2023-12-01T01:02:47.276121+0000","last_became_peered":"2023-12-01T01:02:47.276121+0000","last_unstale":"2023-12-01T01:03:57.993679+0000","last_undegraded":"2023-12-01T01:03:57.993679+0000","last_fullsized":"2023-12-01T01:03:57.993679+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T01:09:25.689189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"83'10","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.004961+0000","last_change":"2023-12-01T01:02:47.275763+0000","last_active":"2023-12-01T01:03:58.004961+0000","last_peered":"2023-12-01T01:03:58.004961+0000","last_clean":"2023-12-01T01:03:58.004961+0000","last_became_active":"2023-12-01T01:02:47.275484+0000","last_became_peered":"2023-12-01T01:02:47.275484+0000","last_unstale":"2023-12-01T01:03:58.004961+0000","last_undegraded":"2023-12-01T01:03:58.004961+0000","last_fullsized":"2023-12-01T01:03:58.004961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T02:38:02.612857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"83'11","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:58.006906+0000","last_change":"2023-12-01T01:02:47.274122+0000","last_active":"2023-12-01T01:03:58.006906+0000","last_peered":"2023-12-01T01:03:58.006906+0000","last_clean":"2023-12-01T01:03:58.006906+0000","last_became_active":"2023-12-01T01:02:47.273005+0000","last_became_peered":"2023-12-01T01:02:47.273005+0000","last_unstale":"2023-12-01T01:03:58.006906+0000","last_undegraded":"2023-12-01T01:03:58.006906+0000","last_fullsized":"2023-12-01T01:03:58.006906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T08:42:59.273076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"83'8","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-01T01:03:57.992330+0000","last_change":"2023-12-01T01:02:47.270221+0000","last_active":"2023-12-01T01:03:57.992330+0000","last_peered":"2023-12-01T01:03:57.992330+0000","last_clean":"2023-12-01T01:03:57.992330+0000","last_became_active":"2023-12-01T01:02:47.269946+0000","last_became_peered":"2023-12-01T01:02:47.269946+0000","last_unstale":"2023-12-01T01:03:57.992330+0000","last_undegraded":"2023-12-01T01:03:57.992330+0000","last_fullsized":"2023-12-01T01:03:57.992330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-01T01:02:46.809357+0000","last_clean_scrub_stamp":"2023-12-01T01:02:46.809357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-02T06:00:01.640510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":283824,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":69058,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":498,"num_read_kb":319,"num_write":163,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":40837,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":196416,"data_compressed":6441,"data_compressed_allocated":8192,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":0},"log_size":143,"ondisk_log_size":143,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":76,"seq":326417514525,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27828,"kb_used_data":876,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717324,"statfs":{"total":95995035648,"available":95966539776,"internally_reserved":0,"allocated":897024,"data_stored":433440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.502,"15min":0.504},"min":{"1min":0.38300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.54400000000000004,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.36799999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.60099999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.61499999999999999,"15min":0.60899999999999999},"min":{"1min":0.5,"5min":0.371,"15min":0.371},"max":{"1min":0.83599999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.60499999999999998,"15min":0.60199999999999998},"min":{"1min":0.45900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81499999999999995,"5min":1.167,"15min":1.167},"last":0.498}]},{"osd":2,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53000000000000003,"15min":0.53200000000000003},"min":{"1min":0.379,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76900000000000002,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.52000000000000002,"15min":0.51300000000000001},"min":{"1min":0.39200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.434}]},{"osd":3,"last update":"Fri Dec 1 01:04:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.54200000000000004}]},{"osd":4,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.67700000000000005,"15min":0.67300000000000004},"min":{"1min":0.56899999999999995,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.875,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.752},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.627,"15min":0.625},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.79200000000000004,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.56399999999999995}]},{"osd":5,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.64300000000000002,"15min":0.63500000000000001},"min":{"1min":0.501,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.89100000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.877,"5min":1.103,"15min":1.103},"last":0.66500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":7,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76500000000000001,"15min":0.76300000000000001},"min":{"1min":0.59099999999999997,"5min":0.502,"15min":0.502},"max":{"1min":0.97699999999999998,"5min":1.153,"15min":1.153},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.89400000000000002,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.64300000000000002}]},{"osd":8,"last update":"Fri Dec 1 01:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.79100000000000004}]},{"osd":9,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78200000000000003,"15min":0.78000000000000003},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":0.98099999999999998,"5min":1.4259999999999999,"15min":1.4259999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.77400000000000002,"15min":0.76800000000000002},"min":{"1min":0.66400000000000003,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.94499999999999995,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.85399999999999998}]},{"osd":10,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.73999999999999999,"15min":0.73399999999999999},"min":{"1min":0.63500000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.86099999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.80600000000000005,"15min":0.80300000000000005},"min":{"1min":0.66100000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0109999999999999,"5min":1.482,"15min":1.482},"last":0.73899999999999999}]}]},{"osd":10,"up_from":69,"seq":296352743457,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":1028,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":1052672,"data_stored":1089889,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52000000000000002}]},{"osd":1,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.443,"15min":0.443},"min":{"1min":0.29699999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.63,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.503},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.30099999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.69699999999999995,"5min":1.829,"15min":1.829},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.59399999999999997,"15min":0.58799999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.77900000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.68899999999999995}]},{"osd":3,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.60699999999999998,"15min":0.61899999999999999},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84399999999999997,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.64900000000000002,"15min":0.66100000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.91600000000000004,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.47699999999999998}]},{"osd":4,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54600000000000004,"15min":0.54700000000000004},"min":{"1min":0.32600000000000001,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.80700000000000005,"5min":1.234,"15min":1.234},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.82699999999999996,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.63100000000000001,"15min":0.623},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.90700000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.45500000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.98099999999999998,"5min":1.173,"15min":1.173},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.69099999999999995,"15min":0.70499999999999996},"min":{"1min":0.40699999999999997,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.88900000000000001,"5min":1.302,"15min":1.302},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96399999999999997,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0569999999999999,"5min":1.198,"15min":1.198},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72899999999999998,"15min":0.72799999999999998},"min":{"1min":0.53400000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.95199999999999996,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.72799999999999998}]},{"osd":9,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81899999999999995,"15min":0.82399999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.753,"15min":0.75900000000000001},"min":{"1min":0.48599999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.92700000000000005,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.64500000000000002}]},{"osd":11,"last update":"Fri Dec 1 01:04:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.68200000000000005,"15min":0.67600000000000005},"min":{"1min":0.54200000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71099999999999997,"15min":0.70099999999999996},"min":{"1min":0.53200000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.66700000000000004}]}]},{"osd":9,"up_from":64,"seq":274877906980,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":913408,"data_stored":433676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.45200000000000001,"15min":0.46300000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58499999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.318},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.46800000000000003,"15min":0.47699999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64600000000000002,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.372}]},{"osd":1,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.60299999999999998,"15min":0.61299999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.73799999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.65000000000000002,"15min":0.63100000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":4.5899999999999999,"5min":4.5899999999999999,"15min":4.5899999999999999},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63,"15min":0.63900000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.91900000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.63600000000000001,"15min":0.64200000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.46800000000000003}]},{"osd":3,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.59199999999999997,"15min":0.60799999999999998},"min":{"1min":0.317,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.748,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.53500000000000003,"15min":0.54300000000000004},"min":{"1min":0.32300000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.69799999999999995,"15min":0.71199999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.83199999999999996,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.71599999999999997,"15min":0.72999999999999998},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.83999999999999997,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.90600000000000003,"15min":0.94999999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89200000000000002,"5min":4.2309999999999999,"15min":4.2309999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":4.6200000000000001,"5min":4.6200000000000001,"15min":4.6200000000000001},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.64000000000000001,"15min":0.65300000000000002},"min":{"1min":0.39300000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81699999999999995,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.70299999999999996,"15min":0.71899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.95699999999999996,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.83799999999999997,"15min":0.82899999999999996},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":4.6040000000000001,"5min":4.6040000000000001,"15min":4.6040000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.76700000000000002,"15min":0.78100000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.98999999999999999,"5min":1.111,"15min":1.111},"last":0.61799999999999999}]},{"osd":8,"last update":"Fri Dec 1 01:03:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76300000000000001,"15min":0.77200000000000002},"min":{"1min":0.54600000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":1.071,"15min":1.1259999999999999},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.004,"5min":4.2729999999999997,"15min":4.2729999999999997},"last":0.502}]},{"osd":10,"last update":"Fri Dec 1 01:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.91300000000000003,"15min":0.95199999999999996},"min":{"1min":0.55500000000000005,"5min":0.496,"15min":0.496},"max":{"1min":0.88600000000000001,"5min":4.6369999999999996,"15min":4.6369999999999996},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.92700000000000005,"15min":0.96499999999999997},"min":{"1min":0.57899999999999996,"5min":0.504,"15min":0.504},"max":{"1min":0.84799999999999998,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.67800000000000005}]}]},{"osd":8,"up_from":57,"seq":244813135912,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":913408,"data_stored":433596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60799999999999998,"15min":0.63400000000000001},"min":{"1min":0.41299999999999998,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.745,"5min":2.25,"15min":2.25},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59999999999999998,"15min":0.60999999999999999},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77500000000000002,"5min":2.234,"15min":2.234},"last":0.56899999999999995}]},{"osd":1,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.68100000000000005,"15min":0.68200000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96999999999999997,"5min":2.234,"15min":2.234},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.58599999999999997}]},{"osd":2,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72899999999999998,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52700000000000002,"15min":0.54300000000000004},"min":{"1min":0.29299999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.80700000000000005,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":0.54200000000000004}]},{"osd":3,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67200000000000004,"15min":0.69199999999999995},"min":{"1min":0.42199999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86299999999999999,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55600000000000005,"15min":0.54900000000000004},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.81999999999999995,"5min":2.1760000000000002,"15min":2.1760000000000002},"last":0.748}]},{"osd":4,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.60999999999999999,"15min":0.60399999999999998},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.79600000000000004,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68999999999999995,"15min":0.69799999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82699999999999996,"5min":2.222,"15min":2.222},"last":0.78000000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.65800000000000003,"15min":0.68000000000000005},"min":{"1min":0.38100000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.84499999999999997,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.41399999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.78000000000000003,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.75800000000000001,"15min":0.78400000000000003},"min":{"1min":0.439,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.89100000000000001,"5min":2.7429999999999999,"15min":2.7429999999999999},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.80100000000000005,"15min":0.81100000000000005},"min":{"1min":0.54600000000000004,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4299999999999999,"5min":2.5590000000000002,"15min":2.5590000000000002},"last":0.84499999999999997}]},{"osd":7,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77700000000000002,"15min":0.79100000000000004},"min":{"1min":0.46500000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.98399999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81200000000000006,"15min":0.81899999999999995},"min":{"1min":0.51900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0029999999999999,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.96599999999999997}]},{"osd":9,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.82099999999999995,"15min":0.80300000000000005},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.3259999999999996,"5min":5.3259999999999996,"15min":5.3259999999999996},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.85099999999999998,"15min":0.85299999999999998},"min":{"1min":0.626,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":2.0550000000000002,"5min":2.5910000000000002,"15min":2.5910000000000002},"last":0.92800000000000005}]},{"osd":10,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.78400000000000003,"15min":0.78200000000000003},"min":{"1min":0.5,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.101,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82099999999999995,"15min":0.81899999999999995},"min":{"1min":0.59899999999999998,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0629999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":0.876}]},{"osd":11,"last update":"Fri Dec 1 01:03:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.94199999999999995}]}]},{"osd":7,"up_from":50,"seq":214748364844,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":1026113,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.54500000000000004,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.39600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.40999999999999998,"15min":0.40300000000000002},"min":{"1min":0.36199999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.58599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.434,"15min":0.42199999999999999},"min":{"1min":0.34200000000000003,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.75700000000000001}]},{"osd":2,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58199999999999996,"15min":0.57199999999999995},"min":{"1min":0.44500000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.82099999999999995,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60299999999999998,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.85199999999999998,"5min":1.383,"15min":1.383},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56299999999999994,"15min":0.55700000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.627},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60599999999999998,"15min":0.60399999999999998},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80000000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.67000000000000004}]},{"osd":4,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.39100000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73999999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.495,"15min":0.48499999999999999},"min":{"1min":0.379,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.73599999999999999}]},{"osd":5,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.64600000000000002,"15min":0.63300000000000001},"min":{"1min":0.49299999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.86599999999999999,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.66700000000000004,"15min":0.65300000000000002},"min":{"1min":0.59999999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Dec 1 01:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.502,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84799999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.66200000000000003,"15min":0.65900000000000003},"min":{"1min":0.46500000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.90500000000000003,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.77600000000000002}]},{"osd":8,"last update":"Fri Dec 1 01:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.69899999999999995,"15min":0.69699999999999995},"min":{"1min":0.54300000000000004,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71499999999999997,"15min":0.71199999999999997},"min":{"1min":0.53100000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.88700000000000001,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.82699999999999996}]},{"osd":9,"last update":"Fri Dec 1 01:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.54200000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.98199999999999998,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.52800000000000002,"5min":0.498,"15min":0.498},"max":{"1min":0.88800000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.83699999999999997}]},{"osd":10,"last update":"Fri Dec 1 01:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.52500000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.012,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.68500000000000005,"15min":0.67700000000000005},"min":{"1min":0.497,"5min":0.433,"15min":0.433},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.873}]},{"osd":11,"last update":"Fri Dec 1 01:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.90900000000000003}]}]},{"osd":6,"up_from":45,"seq":193273528368,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27832,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717320,"statfs":{"total":95995035648,"available":95966535680,"internally_reserved":0,"allocated":901120,"data_stored":433071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.41999999999999998,"15min":0.41899999999999998},"min":{"1min":0.27500000000000002,"5min":0.254,"15min":0.254},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.505,"5min":0.45300000000000001,"15min":0.436},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":3.036,"5min":3.036,"15min":3.036},"last":0.317}]},{"osd":1,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.57599999999999996},"min":{"1min":0.45400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.76700000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.59699999999999998,"15min":0.57899999999999996},"min":{"1min":0.46600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":2.96,"5min":2.96,"15min":2.96},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.626,"15min":0.622},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.439}]},{"osd":3,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33900000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.86299999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53600000000000003,"15min":0.52500000000000002},"min":{"1min":0.34300000000000003,"5min":0.314,"15min":0.314},"max":{"1min":3.052,"5min":3.052,"15min":3.052},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60099999999999998,"15min":0.59899999999999998},"min":{"1min":0.42799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.96299999999999997,"5min":1.248,"15min":1.248},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.62,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.46100000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.78800000000000003,"5min":1.204,"15min":1.204},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.65600000000000003,"15min":0.65400000000000003},"min":{"1min":0.41999999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.9950000000000001,"5min":2.9950000000000001,"15min":2.9950000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.64300000000000002,"15min":0.65500000000000003},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.04,"5min":1.319,"15min":1.319},"last":0.48699999999999999}]},{"osd":7,"last update":"Fri Dec 1 01:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.53600000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.93300000000000005,"5min":1.149,"15min":1.149},"last":0.55300000000000005}]},{"osd":8,"last update":"Fri Dec 1 01:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.52000000000000002,"5min":0.502,"15min":0.502},"max":{"1min":0.95299999999999996,"5min":1.276,"15min":1.276},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.71099999999999997,"15min":0.71999999999999997},"min":{"1min":0.51400000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.84699999999999998,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.499}]},{"osd":9,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.64900000000000002,"15min":0.66800000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.0629999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77700000000000002,"15min":0.78500000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":3.6259999999999999,"5min":3.6259999999999999,"15min":3.6259999999999999},"last":0.57399999999999995}]},{"osd":10,"last update":"Fri Dec 1 01:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.72699999999999998,"15min":0.73699999999999999},"min":{"1min":0.51100000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.98299999999999998,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.86199999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.61399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":491637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51500000000000001,"15min":0.50600000000000001},"min":{"1min":0.40999999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.53400000000000003,"15min":0.51400000000000001},"min":{"1min":0.36299999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.54200000000000004,"15min":0.499},"min":{"1min":0.52600000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.55000000000000004,"15min":0.505},"min":{"1min":0.46700000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.90100000000000002,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.77800000000000002}]},{"osd":3,"last update":"Fri Dec 1 01:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52900000000000003,"15min":0.51600000000000001},"min":{"1min":0.378,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67300000000000004,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57499999999999996,"15min":0.54800000000000004},"min":{"1min":0.41199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Dec 1 01:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.434,"15min":0.38200000000000001},"min":{"1min":0.35999999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.46000000000000002,"15min":0.40200000000000002},"min":{"1min":0.39900000000000002,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.40400000000000003}]},{"osd":5,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.58599999999999997,"15min":0.55600000000000005},"min":{"1min":0.51600000000000001,"5min":0.37,"15min":0.37},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.60099999999999998,"15min":0.56599999999999995},"min":{"1min":0.53600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.59899999999999998,"15min":0.55900000000000005},"min":{"1min":0.495,"5min":0.377,"15min":0.377},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.47499999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.58899999999999997,"15min":0.53600000000000003},"min":{"1min":0.50600000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.58399999999999996,"15min":0.55400000000000005},"min":{"1min":0.44900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.63}]},{"osd":8,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.63300000000000001,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.68799999999999994,"15min":0.67400000000000004},"min":{"1min":0.56000000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.66300000000000003}]},{"osd":9,"last update":"Fri Dec 1 01:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.746,"15min":0.73199999999999998},"min":{"1min":0.51300000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.53900000000000003,"5min":0.439,"15min":0.439},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.745}]},{"osd":10,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.53000000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.875,"5min":0.77400000000000002,"15min":0.75700000000000001},"min":{"1min":0.67500000000000004,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.80700000000000005}]},{"osd":11,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.83299999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":921600,"data_stored":434336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Dec 1 01:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.53600000000000003,"15min":0.52100000000000002},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.65000000000000002,"5min":1.131,"15min":1.131},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.70699999999999996,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.42899999999999999}]},{"osd":2,"last update":"Fri Dec 1 01:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.38,"5min":0.37,"15min":0.37},"max":{"1min":0.86499999999999999,"5min":0.875,"15min":0.875},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.33500000000000002}]},{"osd":4,"last update":"Fri Dec 1 01:03:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55500000000000005,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68400000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55900000000000005,"15min":0.53100000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66300000000000003,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.41499999999999998}]},{"osd":5,"last update":"Fri Dec 1 01:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.59299999999999997,"15min":0.58499999999999996},"min":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Dec 1 01:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.526,"5min":1.526,"15min":1.526},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60199999999999998,"15min":0.59499999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.45700000000000002}]},{"osd":7,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.628}]},{"osd":8,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.70599999999999996,"15min":0.69499999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.5299999999999998,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":0.63800000000000001}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.67500000000000004,"15min":0.69699999999999995},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.93100000000000005,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.71199999999999997,"15min":0.73399999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94799999999999995,"5min":1.024,"15min":1.024},"last":0.495}]},{"osd":10,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.75800000000000001,"15min":0.77600000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.878,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.73999999999999999,"15min":0.76000000000000001},"min":{"1min":0.42999999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89600000000000002,"5min":1.175,"15min":1.175},"last":0.503}]},{"osd":11,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.628},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.56399999999999995}]}]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":917504,"data_stored":434694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.5,"15min":0.48399999999999999},"min":{"1min":0.35999999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.874,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48399999999999999,"15min":0.47799999999999998},"min":{"1min":0.309,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.70999999999999996,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.53000000000000003,"15min":0.52200000000000002},"min":{"1min":0.47399999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.54600000000000004,"15min":0.52400000000000002},"min":{"1min":0.39800000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.70399999999999996}]},{"osd":3,"last update":"Fri Dec 1 01:03:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.55600000000000005,"15min":0.52100000000000002},"min":{"1min":0.45900000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.85299999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.628},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.52700000000000002},"min":{"1min":0.42999999999999999,"5min":0.38,"15min":0.38},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.60099999999999998}]},{"osd":4,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Dec 1 01:03:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.44600000000000001,"15min":0.41199999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.442},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.45000000000000001,"15min":0.42599999999999999},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.46300000000000002}]},{"osd":6,"last update":"Fri Dec 1 01:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.54800000000000004,"15min":0.53400000000000003},"min":{"1min":0.36799999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83299999999999996,"5min":0.877,"15min":0.877},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.628,"15min":0.59799999999999998},"min":{"1min":0.52000000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Dec 1 01:01:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.59199999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:03:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.58099999999999996,"15min":0.55900000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.54500000000000004,"15min":0.53300000000000003},"min":{"1min":0.39100000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.64000000000000001}]},{"osd":9,"last update":"Fri Dec 1 01:03:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65500000000000003,"15min":0.64900000000000002},"min":{"1min":0.47499999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.52800000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.69299999999999995}]},{"osd":10,"last update":"Fri Dec 1 01:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.68300000000000005,"15min":0.67300000000000004},"min":{"1min":0.55600000000000005,"5min":0.504,"15min":0.504},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.61499999999999999}]},{"osd":11,"last update":"Fri Dec 1 01:03:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.68400000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182460,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":917504,"data_stored":433388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.39000000000000001,"15min":0.35599999999999998},"min":{"1min":0.26600000000000001,"5min":0.245,"15min":0.245},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.41499999999999998,"15min":0.38100000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.32100000000000001}]},{"osd":1,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.51200000000000001},"min":{"1min":0.441,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.622,"5min":0.58899999999999997,"15min":0.52900000000000003},"min":{"1min":0.40500000000000003,"5min":0.371,"15min":0.371},"max":{"1min":2.1080000000000001,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.71199999999999997}]},{"osd":2,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.60599999999999998,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59699999999999998,"15min":0.59299999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.51000000000000001}]},{"osd":4,"last update":"Fri Dec 1 01:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.61099999999999999,"15min":0.58099999999999996},"min":{"1min":0.47499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.70799999999999996,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.60599999999999998,"15min":0.57799999999999996},"min":{"1min":0.39600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77600000000000002,"5min":1.976,"15min":1.976},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Dec 1 01:03:11 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.623,"15min":0.60999999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.621,"15min":0.59699999999999998},"min":{"1min":0.45700000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.57499999999999996,"15min":0.55900000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.41499999999999998}]},{"osd":7,"last update":"Fri Dec 1 01:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.72299999999999998,"15min":0.72899999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.81999999999999995,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.71999999999999997,"15min":0.71599999999999997},"min":{"1min":0.52900000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.872,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.66700000000000004}]},{"osd":8,"last update":"Fri Dec 1 01:02:08 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.65200000000000002}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.751,"15min":0.76900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":2.0880000000000001,"5min":2.0880000000000001,"15min":2.0880000000000001},"last":0.442},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.76500000000000001,"15min":0.78900000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.61199999999999999}]},{"osd":10,"last update":"Fri Dec 1 01:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.86099999999999999,"15min":0.89300000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.81599999999999995,"5min":2.048,"15min":2.048},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.84999999999999998,"15min":0.88},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.90200000000000002,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":0.63}]},{"osd":11,"last update":"Fri Dec 1 01:03:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.68000000000000005}]}]},{"osd":4,"up_from":32,"seq":137438953528,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":946176,"data_stored":492767,"data_compressed":6441,"data_compressed_allocated":8192,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:01:49 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51600000000000001,"15min":0.51100000000000001},"min":{"1min":0.36699999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.85099999999999998,"5min":0.88,"15min":0.88},"last":0.371},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73199999999999998,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.42999999999999999}]},{"osd":1,"last update":"Fri Dec 1 01:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.38800000000000001,"15min":0.36899999999999999},"min":{"1min":0.28100000000000003,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.61199999999999999,"5min":0.627,"15min":0.627},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.41699999999999998,"15min":0.38800000000000001},"min":{"1min":0.32700000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.63200000000000001,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.437}]},{"osd":2,"last update":"Fri Dec 1 01:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.63700000000000001,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":6.0110000000000001,"5min":6.0110000000000001,"15min":6.0110000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57399999999999995,"15min":0.55400000000000005},"min":{"1min":0.38800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Dec 1 01:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57699999999999996,"15min":0.55100000000000005},"min":{"1min":0.379,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75,"5min":1.004,"15min":1.004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55700000000000005,"15min":0.54300000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80600000000000005,"5min":0.879,"15min":0.879},"last":0.55100000000000005}]},{"osd":5,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.59999999999999998,"15min":0.57799999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59999999999999998,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.76600000000000001,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.50600000000000001}]},{"osd":6,"last update":"Fri Dec 1 01:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61799999999999999,"15min":0.59599999999999997},"min":{"1min":0.40799999999999997,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.93300000000000005,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.61699999999999999,"15min":0.59699999999999998},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.442},"max":{"1min":0.82499999999999996,"5min":1.0189999999999999,"15min":1.0189999999999999},"last":0.64200000000000002}]},{"osd":7,"last update":"Fri Dec 1 01:03:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.55700000000000005,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.872,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.57399999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80200000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.72999999999999998}]},{"osd":8,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.93400000000000005,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.006,"5min":0.77800000000000002,"15min":0.73799999999999999},"min":{"1min":0.51100000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":6.0419999999999998,"5min":6.0419999999999998,"15min":6.0419999999999998},"last":0.66500000000000004}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.75800000000000001,"15min":0.76300000000000001},"min":{"1min":0.54600000000000004,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96999999999999997,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.53700000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.74199999999999999}]},{"osd":10,"last update":"Fri Dec 1 01:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.745,"15min":0.74099999999999999},"min":{"1min":0.55000000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.72199999999999998,"15min":0.71699999999999997},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.80200000000000005}]},{"osd":11,"last update":"Fri Dec 1 01:03:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.76200000000000001}]}]},{"osd":5,"up_from":37,"seq":158913790005,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":974848,"data_stored":1025311,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.49199999999999999},"min":{"1min":0.374,"5min":0.249,"15min":0.249},"max":{"1min":0.73199999999999998,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.495,"15min":0.48899999999999999},"min":{"1min":0.35299999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.69799999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.443}]},{"osd":1,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53000000000000003},"min":{"1min":0.45700000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.56899999999999995,"15min":0.54100000000000004},"min":{"1min":0.47299999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.79100000000000004,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55800000000000005}]},{"osd":2,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39700000000000002,"15min":0.38400000000000001},"min":{"1min":0.30399999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.68600000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.436,"15min":0.42899999999999999},"min":{"1min":0.28799999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.315,"5min":0.309,"15min":0.309},"max":{"1min":0.626,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.626},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53500000000000003,"15min":0.53800000000000003},"min":{"1min":0.378,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60699999999999998,"15min":0.58699999999999997},"min":{"1min":0.46899999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.81799999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.59299999999999997,"15min":0.57699999999999996},"min":{"1min":0.54200000000000004,"5min":0.318,"15min":0.318},"max":{"1min":0.77700000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Dec 1 01:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.622},"min":{"1min":0.40500000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.42899999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.97199999999999998,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.64300000000000002}]},{"osd":7,"last update":"Fri Dec 1 01:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63700000000000001,"15min":0.623},"min":{"1min":0.5,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.86099999999999999,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.81399999999999995,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71599999999999997}]},{"osd":8,"last update":"Fri Dec 1 01:04:08 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.59899999999999998,"15min":0.59099999999999997},"min":{"1min":0.41799999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.57499999999999996,"15min":0.56699999999999995},"min":{"1min":0.44500000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.66800000000000004}]},{"osd":9,"last update":"Fri Dec 1 01:03:29 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.72199999999999998,"15min":0.68200000000000005},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.673,"5min":5.673,"15min":5.673},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.01,"5min":0.77800000000000002,"15min":0.73999999999999999},"min":{"1min":0.48999999999999999,"5min":0.439,"15min":0.439},"max":{"1min":5.6390000000000002,"5min":5.6390000000000002,"15min":5.6390000000000002},"last":0.79400000000000004}]},{"osd":10,"last update":"Fri Dec 1 01:03:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67100000000000004,"15min":0.66300000000000003},"min":{"1min":0.59499999999999997,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83399999999999996,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.68799999999999994,"15min":0.68200000000000005},"min":{"1min":0.57499999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84699999999999998,"5min":1.004,"15min":1.004},"last":0.754}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34453,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36093,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":58779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":60227,"data_compressed":6441,"data_compressed_allocated":8192,"data_compressed_original":36864,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":66540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-01T01:04:14.955 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:04:15.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.114+0000 7f9294615700 1 -- 172.21.15.26:0/1305418073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f928c100e60 msgr2=0x7f928c1012c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:15.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.114+0000 7f9294615700 1 --2- 172.21.15.26:0/1305418073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f928c100e60 0x7f928c1012c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f92800099c0 tx=0x7f9280009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.117 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.114+0000 7f9294615700 1 -- 172.21.15.26:0/1305418073 shutdown_connections 2023-12-01T01:04:15.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.114+0000 7f9294615700 1 --2- 172.21.15.26:0/1305418073 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f928c101800 0x7f928c1080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.114+0000 7f9294615700 1 --2- 172.21.15.26:0/1305418073 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f928c0ffc70 0x7f928c100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.114+0000 7f9294615700 1 --2- 172.21.15.26:0/1305418073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f928c100e60 0x7f928c1012c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.114+0000 7f9294615700 1 -- 172.21.15.26:0/1305418073 >> 172.21.15.26:0/1305418073 conn(0x7f928c0fb1c0 msgr2=0x7f928c0fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:15.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.114+0000 7f9294615700 1 -- 172.21.15.26:0/1305418073 shutdown_connections 2023-12-01T01:04:15.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.114+0000 7f9294615700 1 -- 172.21.15.26:0/1305418073 wait complete. 2023-12-01T01:04:15.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9294615700 1 Processor -- start 2023-12-01T01:04:15.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9294615700 1 -- start start 2023-12-01T01:04:15.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9294615700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f928c0ffc70 0x7f928c068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:15.118 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9294615700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f928c100e60 0x7f928c19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:15.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9294615700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f928c101800 0x7f928c19de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:15.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9294615700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c19e5e0 con 0x7f928c101800 2023-12-01T01:04:15.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9294615700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c19e750 con 0x7f928c0ffc70 2023-12-01T01:04:15.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9294615700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f928c19e910 con 0x7f928c100e60 2023-12-01T01:04:15.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9292bb2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f928c101800 0x7f928c19de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:15.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9292bb2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f928c101800 0x7f928c19de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55040/0 (socket says 172.21.15.26:55040) 2023-12-01T01:04:15.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9292bb2700 1 -- 172.21.15.26:0/1772780431 learned_addr learned my addr 172.21.15.26:0/1772780431 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:15.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f92923b1700 1 --2- 172.21.15.26:0/1772780431 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f928c0ffc70 0x7f928c068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:15.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9291bb0700 1 --2- 172.21.15.26:0/1772780431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f928c100e60 0x7f928c19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:15.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9292bb2700 1 -- 172.21.15.26:0/1772780431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f928c100e60 msgr2=0x7f928c19b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:15.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9292bb2700 1 --2- 172.21.15.26:0/1772780431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f928c100e60 0x7f928c19b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9292bb2700 1 -- 172.21.15.26:0/1772780431 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f928c0ffc70 msgr2=0x7f928c068a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9292bb2700 1 --2- 172.21.15.26:0/1772780431 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f928c0ffc70 0x7f928c068a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9292bb2700 1 -- 172.21.15.26:0/1772780431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92800095f0 con 0x7f928c101800 2023-12-01T01:04:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f9292bb2700 1 --2- 172.21.15.26:0/1772780431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f928c101800 0x7f928c19de40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9284007ee0 tx=0x7f928400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f927f7fe700 1 -- 172.21.15.26:0/1772780431 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284017070 con 0x7f928c101800 2023-12-01T01:04:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.115+0000 7f927f7fe700 1 -- 172.21.15.26:0/1772780431 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f928400f040 con 0x7f928c101800 2023-12-01T01:04:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.116+0000 7f927f7fe700 1 -- 172.21.15.26:0/1772780431 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284005610 con 0x7f928c101800 2023-12-01T01:04:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.116+0000 7f9294615700 1 -- 172.21.15.26:0/1772780431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f928c1956f0 con 0x7f928c101800 2023-12-01T01:04:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.116+0000 7f9294615700 1 -- 172.21.15.26:0/1772780431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f928c195bb0 con 0x7f928c101800 2023-12-01T01:04:15.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.116+0000 7f9294615700 1 -- 172.21.15.26:0/1772780431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f928c107190 con 0x7f928c101800 2023-12-01T01:04:15.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.118+0000 7f927f7fe700 1 -- 172.21.15.26:0/1772780431 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f9284005770 con 0x7f928c101800 2023-12-01T01:04:15.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.118+0000 7f927f7fe700 1 --2- 172.21.15.26:0/1772780431 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f92780a0570 0x7f92780a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:15.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.118+0000 7f927f7fe700 1 -- 172.21.15.26:0/1772780431 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f92840cb6c0 con 0x7f928c101800 2023-12-01T01:04:15.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.118+0000 7f92923b1700 1 --2- 172.21.15.26:0/1772780431 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f92780a0570 0x7f92780a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:15.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.119+0000 7f92923b1700 1 --2- 172.21.15.26:0/1772780431 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f92780a0570 0x7f92780a2a30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f928c100cc0 tx=0x7f9288007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:15.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.122+0000 7f927f7fe700 1 -- 172.21.15.26:0/1772780431 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9284095270 con 0x7f928c101800 2023-12-01T01:04:15.327 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.326+0000 7f9294615700 1 -- 172.21.15.26:0/1772780431 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f928c02ce80 con 0x7f928c101800 2023-12-01T01:04:15.328 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.327+0000 7f927f7fe700 1 -- 172.21.15.26:0/1772780431 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22481 (secure 0 0 0) 0x7f9284009390 con 0x7f928c101800 2023-12-01T01:04:15.329 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:04:15.329 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":83,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:59.627676+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:04:15.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.330+0000 7f9294615700 1 -- 172.21.15.26:0/1772780431 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f92780a0570 msgr2=0x7f92780a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:15.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.330+0000 7f9294615700 1 --2- 172.21.15.26:0/1772780431 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f92780a0570 0x7f92780a2a30 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f928c100cc0 tx=0x7f9288007400 comp rx=0 tx=0).stop 2023-12-01T01:04:15.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.330+0000 7f9294615700 1 -- 172.21.15.26:0/1772780431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f928c101800 msgr2=0x7f928c19de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:15.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.330+0000 7f9294615700 1 --2- 172.21.15.26:0/1772780431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f928c101800 0x7f928c19de40 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9284007ee0 tx=0x7f928400d3b0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.330+0000 7f9294615700 1 -- 172.21.15.26:0/1772780431 shutdown_connections 2023-12-01T01:04:15.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.330+0000 7f9294615700 1 --2- 172.21.15.26:0/1772780431 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f92780a0570 0x7f92780a2a30 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.330+0000 7f9294615700 1 --2- 172.21.15.26:0/1772780431 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f928c101800 0x7f928c19de40 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.331 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.330+0000 7f9294615700 1 --2- 172.21.15.26:0/1772780431 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f928c0ffc70 0x7f928c068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.330+0000 7f9294615700 1 --2- 172.21.15.26:0/1772780431 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f928c100e60 0x7f928c19b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.330+0000 7f9294615700 1 -- 172.21.15.26:0/1772780431 >> 172.21.15.26:0/1772780431 conn(0x7f928c0fb1c0 msgr2=0x7f928c1042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:15.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.330+0000 7f9294615700 1 -- 172.21.15.26:0/1772780431 shutdown_connections 2023-12-01T01:04:15.332 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.330+0000 7f9294615700 1 -- 172.21.15.26:0/1772780431 wait complete. 2023-12-01T01:04:15.344 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T00:59:06.411348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T01:02:45.762784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T01:02:46.638998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T01:04:15.344 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T01:04:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.472+0000 7f5682131700 1 -- 172.21.15.26:0/3086053745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f567c100da0 msgr2=0x7f567c1011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.472+0000 7f5682131700 1 --2- 172.21.15.26:0/3086053745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f567c100da0 0x7f567c1011c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f566c0099c0 tx=0x7f566c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.472+0000 7f5682131700 1 -- 172.21.15.26:0/3086053745 shutdown_connections 2023-12-01T01:04:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.472+0000 7f5682131700 1 --2- 172.21.15.26:0/3086053745 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f567c102930 0x7f567c1091e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.472+0000 7f5682131700 1 --2- 172.21.15.26:0/3086053745 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f567c100da0 0x7f567c1011c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.472+0000 7f5682131700 1 --2- 172.21.15.26:0/3086053745 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f567c101f90 0x7f567c1023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.472+0000 7f5682131700 1 -- 172.21.15.26:0/3086053745 >> 172.21.15.26:0/3086053745 conn(0x7f567c0fc310 msgr2=0x7f567c0fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.472+0000 7f5682131700 1 -- 172.21.15.26:0/3086053745 shutdown_connections 2023-12-01T01:04:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.472+0000 7f5682131700 1 -- 172.21.15.26:0/3086053745 wait complete. 2023-12-01T01:04:15.474 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.473+0000 7f5682131700 1 Processor -- start 2023-12-01T01:04:15.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.473+0000 7f5682131700 1 -- start start 2023-12-01T01:04:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.473+0000 7f5682131700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f567c100da0 0x7f567c196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.473+0000 7f5682131700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f567c101f90 0x7f567c1970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.473+0000 7f5682131700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f567c102930 0x7f567c19e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.473+0000 7f5682131700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c19e700 con 0x7f567c100da0 2023-12-01T01:04:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.473+0000 7f5682131700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c19e840 con 0x7f567c102930 2023-12-01T01:04:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.473+0000 7f5682131700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c19e9d0 con 0x7f567c101f90 2023-12-01T01:04:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f567b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f567c100da0 0x7f567c196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f567b7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f567c100da0 0x7f567c196b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55050/0 (socket says 172.21.15.26:55050) 2023-12-01T01:04:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f567b7fe700 1 -- 172.21.15.26:0/27222912 learned_addr learned my addr 172.21.15.26:0/27222912 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f567affd700 1 --2- 172.21.15.26:0/27222912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f567c101f90 0x7f567c1970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f567bfff700 1 --2- 172.21.15.26:0/27222912 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f567c102930 0x7f567c19e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f567b7fe700 1 -- 172.21.15.26:0/27222912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f567c101f90 msgr2=0x7f567c1970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f567b7fe700 1 --2- 172.21.15.26:0/27222912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f567c101f90 0x7f567c1970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f567b7fe700 1 -- 172.21.15.26:0/27222912 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f567c102930 msgr2=0x7f567c19e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f567b7fe700 1 --2- 172.21.15.26:0/27222912 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f567c102930 0x7f567c19e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f567b7fe700 1 -- 172.21.15.26:0/27222912 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566c0095f0 con 0x7f567c100da0 2023-12-01T01:04:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f567affd700 1 --2- 172.21.15.26:0/27222912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f567c101f90 0x7f567c1970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f567bfff700 1 --2- 172.21.15.26:0/27222912 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f567c102930 0x7f567c19e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f567b7fe700 1 --2- 172.21.15.26:0/27222912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f567c100da0 0x7f567c196b80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f566c003800 tx=0x7f566c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f5678ff9700 1 -- 172.21.15.26:0/27222912 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c01d070 con 0x7f567c100da0 2023-12-01T01:04:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f5678ff9700 1 -- 172.21.15.26:0/27222912 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f566c0041a0 con 0x7f567c100da0 2023-12-01T01:04:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f5682131700 1 -- 172.21.15.26:0/27222912 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f567c19ec50 con 0x7f567c100da0 2023-12-01T01:04:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f5678ff9700 1 -- 172.21.15.26:0/27222912 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c022e90 con 0x7f567c100da0 2023-12-01T01:04:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.474+0000 7f5682131700 1 -- 172.21.15.26:0/27222912 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567c19f150 con 0x7f567c100da0 2023-12-01T01:04:15.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.475+0000 7f5682131700 1 -- 172.21.15.26:0/27222912 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f567c108330 con 0x7f567c100da0 2023-12-01T01:04:15.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.476+0000 7f5678ff9700 1 -- 172.21.15.26:0/27222912 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f566c022570 con 0x7f567c100da0 2023-12-01T01:04:15.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.477+0000 7f5678ff9700 1 --2- 172.21.15.26:0/27222912 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f56640a05a0 0x7f56640a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:15.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.477+0000 7f567affd700 1 --2- 172.21.15.26:0/27222912 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f56640a05a0 0x7f56640a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:15.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.477+0000 7f5678ff9700 1 -- 172.21.15.26:0/27222912 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f566c0cd4c0 con 0x7f567c100da0 2023-12-01T01:04:15.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.478+0000 7f567affd700 1 --2- 172.21.15.26:0/27222912 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f56640a05a0 0x7f56640a2a60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5670005950 tx=0x7f56700058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:15.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.481+0000 7f5678ff9700 1 -- 172.21.15.26:0/27222912 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f566c0970a0 con 0x7f567c100da0 2023-12-01T01:04:15.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.681+0000 7f5682131700 1 -- 172.21.15.26:0/27222912 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f567c02ce00 con 0x7f567c100da0 2023-12-01T01:04:15.682 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.681+0000 7f5678ff9700 1 -- 172.21.15.26:0/27222912 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f566c09a6c0 con 0x7f567c100da0 2023-12-01T01:04:15.682 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-12-01T01:04:15.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.683+0000 7f5682131700 1 -- 172.21.15.26:0/27222912 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f56640a05a0 msgr2=0x7f56640a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:15.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.683+0000 7f5682131700 1 --2- 172.21.15.26:0/27222912 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f56640a05a0 0x7f56640a2a60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5670005950 tx=0x7f56700058e0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.683+0000 7f5682131700 1 -- 172.21.15.26:0/27222912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f567c100da0 msgr2=0x7f567c196b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:15.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.683+0000 7f5682131700 1 --2- 172.21.15.26:0/27222912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f567c100da0 0x7f567c196b80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f566c003800 tx=0x7f566c005e80 comp rx=0 tx=0).stop 2023-12-01T01:04:15.684 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.683+0000 7f5682131700 1 -- 172.21.15.26:0/27222912 shutdown_connections 2023-12-01T01:04:15.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.683+0000 7f5682131700 1 --2- 172.21.15.26:0/27222912 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f56640a05a0 0x7f56640a2a60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.683+0000 7f5682131700 1 --2- 172.21.15.26:0/27222912 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f567c102930 0x7f567c19e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.683+0000 7f5682131700 1 --2- 172.21.15.26:0/27222912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f567c100da0 0x7f567c196b80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.683+0000 7f5682131700 1 --2- 172.21.15.26:0/27222912 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f567c101f90 0x7f567c1970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.683+0000 7f5682131700 1 -- 172.21.15.26:0/27222912 >> 172.21.15.26:0/27222912 conn(0x7f567c0fc310 msgr2=0x7f567c105470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:15.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.683+0000 7f5682131700 1 -- 172.21.15.26:0/27222912 shutdown_connections 2023-12-01T01:04:15.685 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.683+0000 7f5682131700 1 -- 172.21.15.26:0/27222912 wait complete. 2023-12-01T01:04:15.697 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T01:04:15.826 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.825+0000 7f2be4e88700 1 -- 172.21.15.26:0/547203001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be0100d80 msgr2=0x7f2be01011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:15.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.825+0000 7f2be4e88700 1 --2- 172.21.15.26:0/547203001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be0100d80 0x7f2be01011a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40099c0 tx=0x7f2bd4009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.825+0000 7f2be4e88700 1 -- 172.21.15.26:0/547203001 shutdown_connections 2023-12-01T01:04:15.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.825+0000 7f2be4e88700 1 --2- 172.21.15.26:0/547203001 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2be0102910 0x7f2be01091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.825+0000 7f2be4e88700 1 --2- 172.21.15.26:0/547203001 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be0100d80 0x7f2be01011a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.825+0000 7f2be4e88700 1 --2- 172.21.15.26:0/547203001 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2be0101f70 0x7f2be01023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.825+0000 7f2be4e88700 1 -- 172.21.15.26:0/547203001 >> 172.21.15.26:0/547203001 conn(0x7f2be00fc310 msgr2=0x7f2be00fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:15.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.825+0000 7f2be4e88700 1 -- 172.21.15.26:0/547203001 shutdown_connections 2023-12-01T01:04:15.827 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.825+0000 7f2be4e88700 1 -- 172.21.15.26:0/547203001 wait complete. 2023-12-01T01:04:15.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.826+0000 7f2be4e88700 1 Processor -- start 2023-12-01T01:04:15.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.826+0000 7f2be4e88700 1 -- start start 2023-12-01T01:04:15.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.826+0000 7f2be4e88700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be0100d80 0x7f2be0196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:15.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.826+0000 7f2be4e88700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2be0101f70 0x7f2be0197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:15.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.826+0000 7f2be4e88700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2be0102910 0x7f2be019e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:15.829 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.826+0000 7f2be4e88700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be019e660 con 0x7f2be0100d80 2023-12-01T01:04:15.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.826+0000 7f2be4e88700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be019e7a0 con 0x7f2be0101f70 2023-12-01T01:04:15.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.826+0000 7f2be4e88700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be019e930 con 0x7f2be0102910 2023-12-01T01:04:15.830 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.826+0000 7f2bde59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be0100d80 0x7f2be0196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:15.831 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.827+0000 7f2bde59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be0100d80 0x7f2be0196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55064/0 (socket says 172.21.15.26:55064) 2023-12-01T01:04:15.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.827+0000 7f2bde59c700 1 -- 172.21.15.26:0/784869722 learned_addr learned my addr 172.21.15.26:0/784869722 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:15.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.827+0000 7f2bddd9b700 1 --2- 172.21.15.26:0/784869722 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2be0101f70 0x7f2be0197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:15.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.827+0000 7f2bded9d700 1 --2- 172.21.15.26:0/784869722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2be0102910 0x7f2be019e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:15.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.827+0000 7f2bde59c700 1 -- 172.21.15.26:0/784869722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2be0102910 msgr2=0x7f2be019e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:15.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.827+0000 7f2bde59c700 1 --2- 172.21.15.26:0/784869722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2be0102910 0x7f2be019e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.827+0000 7f2bde59c700 1 -- 172.21.15.26:0/784869722 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2be0101f70 msgr2=0x7f2be0197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:15.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.827+0000 7f2bde59c700 1 --2- 172.21.15.26:0/784869722 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2be0101f70 0x7f2be0197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:15.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.827+0000 7f2bde59c700 1 -- 172.21.15.26:0/784869722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd40095f0 con 0x7f2be0100d80 2023-12-01T01:04:15.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.827+0000 7f2bde59c700 1 --2- 172.21.15.26:0/784869722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be0100d80 0x7f2be0196ae0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40098e0 tx=0x7f2bd4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:15.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.828+0000 7f2bcf7fe700 1 -- 172.21.15.26:0/784869722 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd401d070 con 0x7f2be0100d80 2023-12-01T01:04:15.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.828+0000 7f2bcf7fe700 1 -- 172.21.15.26:0/784869722 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f2bd4022470 con 0x7f2be0100d80 2023-12-01T01:04:15.832 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.828+0000 7f2be4e88700 1 -- 172.21.15.26:0/784869722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be019ebb0 con 0x7f2be0100d80 2023-12-01T01:04:15.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.828+0000 7f2bcf7fe700 1 -- 172.21.15.26:0/784869722 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4017650 con 0x7f2be0100d80 2023-12-01T01:04:15.833 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.828+0000 7f2be4e88700 1 -- 172.21.15.26:0/784869722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be019f030 con 0x7f2be0100d80 2023-12-01T01:04:15.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.829+0000 7f2be4e88700 1 -- 172.21.15.26:0/784869722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be0107c60 con 0x7f2be0100d80 2023-12-01T01:04:15.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.830+0000 7f2bcf7fe700 1 -- 172.21.15.26:0/784869722 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f2bd40225e0 con 0x7f2be0100d80 2023-12-01T01:04:15.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.831+0000 7f2bcf7fe700 1 --2- 172.21.15.26:0/784869722 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2bc80a05a0 0x7f2bc80a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:15.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.831+0000 7f2bcf7fe700 1 -- 172.21.15.26:0/784869722 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f2bd40cca70 con 0x7f2be0100d80 2023-12-01T01:04:15.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.831+0000 7f2bddd9b700 1 --2- 172.21.15.26:0/784869722 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2bc80a05a0 0x7f2bc80a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:15.834 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.831+0000 7f2bddd9b700 1 --2- 172.21.15.26:0/784869722 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2bc80a05a0 0x7f2bc80a2a60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009c60 tx=0x7f2bd0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:15.836 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:15.835+0000 7f2bcf7fe700 1 -- 172.21.15.26:0/784869722 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2bd405d0e0 con 0x7f2be0100d80 2023-12-01T01:04:16.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.042+0000 7f2be4e88700 1 -- 172.21.15.26:0/784869722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2be0061a40 con 0x7f2be0100d80 2023-12-01T01:04:16.043 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.042+0000 7f2bcf7fe700 1 -- 172.21.15.26:0/784869722 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v83) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2bd4096650 con 0x7f2be0100d80 2023-12-01T01:04:16.043 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-12-01T01:04:16.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.044+0000 7f2be4e88700 1 -- 172.21.15.26:0/784869722 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2bc80a05a0 msgr2=0x7f2bc80a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:16.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.044+0000 7f2be4e88700 1 --2- 172.21.15.26:0/784869722 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2bc80a05a0 0x7f2bc80a2a60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009c60 tx=0x7f2bd0009260 comp rx=0 tx=0).stop 2023-12-01T01:04:16.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.044+0000 7f2be4e88700 1 -- 172.21.15.26:0/784869722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be0100d80 msgr2=0x7f2be0196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:16.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.044+0000 7f2be4e88700 1 --2- 172.21.15.26:0/784869722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be0100d80 0x7f2be0196ae0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40098e0 tx=0x7f2bd4009580 comp rx=0 tx=0).stop 2023-12-01T01:04:16.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.045+0000 7f2be4e88700 1 -- 172.21.15.26:0/784869722 shutdown_connections 2023-12-01T01:04:16.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.045+0000 7f2be4e88700 1 --2- 172.21.15.26:0/784869722 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f2bc80a05a0 0x7f2bc80a2a60 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.045+0000 7f2be4e88700 1 --2- 172.21.15.26:0/784869722 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f2be0102910 0x7f2be019e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.045+0000 7f2be4e88700 1 --2- 172.21.15.26:0/784869722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2be0100d80 0x7f2be0196ae0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.045+0000 7f2be4e88700 1 --2- 172.21.15.26:0/784869722 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2be0101f70 0x7f2be0197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.045+0000 7f2be4e88700 1 -- 172.21.15.26:0/784869722 >> 172.21.15.26:0/784869722 conn(0x7f2be00fc310 msgr2=0x7f2be00fe4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:16.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.045+0000 7f2be4e88700 1 -- 172.21.15.26:0/784869722 shutdown_connections 2023-12-01T01:04:16.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:15 smithi026 ceph-mon[98801]: pgmap v291: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1023 B/s wr, 7 op/s 2023-12-01T01:04:16.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:15 smithi026 ceph-mon[98801]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:04:16.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:15 smithi026 ceph-mon[98801]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:04:16.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:15 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1772780431' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:16.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:15 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/27222912' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:04:16.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.045+0000 7f2be4e88700 1 -- 172.21.15.26:0/784869722 wait complete. 2023-12-01T01:04:16.058 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T01:04:16.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:15 smithi116 ceph-mon[103554]: pgmap v291: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1023 B/s wr, 7 op/s 2023-12-01T01:04:16.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:15 smithi116 ceph-mon[103554]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:04:16.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:15 smithi116 ceph-mon[103554]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:04:16.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:15 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1772780431' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:16.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:15 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/27222912' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:04:16.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.187+0000 7f25f4b96700 1 -- 172.21.15.26:0/2978834352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f00ffc80 msgr2=0x7f25f01000a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:16.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.187+0000 7f25f4b96700 1 --2- 172.21.15.26:0/2978834352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f00ffc80 0x7f25f01000a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f25d80099c0 tx=0x7f25d8009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.187+0000 7f25f4b96700 1 -- 172.21.15.26:0/2978834352 shutdown_connections 2023-12-01T01:04:16.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.187+0000 7f25f4b96700 1 --2- 172.21.15.26:0/2978834352 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f0101810 0x7f25f01080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.187+0000 7f25f4b96700 1 --2- 172.21.15.26:0/2978834352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f00ffc80 0x7f25f01000a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.187+0000 7f25f4b96700 1 --2- 172.21.15.26:0/2978834352 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25f0100e70 0x7f25f01012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.187+0000 7f25f4b96700 1 -- 172.21.15.26:0/2978834352 >> 172.21.15.26:0/2978834352 conn(0x7f25f00fb1f0 msgr2=0x7f25f00fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:16.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.187+0000 7f25f4b96700 1 -- 172.21.15.26:0/2978834352 shutdown_connections 2023-12-01T01:04:16.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.187+0000 7f25f4b96700 1 -- 172.21.15.26:0/2978834352 wait complete. 2023-12-01T01:04:16.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25f4b96700 1 Processor -- start 2023-12-01T01:04:16.190 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25f4b96700 1 -- start start 2023-12-01T01:04:16.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25f4b96700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f00ffc80 0x7f25f0196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:16.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25f4b96700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f0100e70 0x7f25f01970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:16.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25f4b96700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25f0101810 0x7f25f019e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:16.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25f4b96700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f019e720 con 0x7f25f0100e70 2023-12-01T01:04:16.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25f4b96700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f019e860 con 0x7f25f0101810 2023-12-01T01:04:16.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25f4b96700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f019e9f0 con 0x7f25f00ffc80 2023-12-01T01:04:16.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25edd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f0100e70 0x7f25f01970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:16.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25edd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f0100e70 0x7f25f01970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55080/0 (socket says 172.21.15.26:55080) 2023-12-01T01:04:16.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25edd9b700 1 -- 172.21.15.26:0/3715401216 learned_addr learned my addr 172.21.15.26:0/3715401216 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:16.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25ee59c700 1 --2- 172.21.15.26:0/3715401216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f00ffc80 0x7f25f0196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:16.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25eed9d700 1 --2- 172.21.15.26:0/3715401216 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25f0101810 0x7f25f019e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:16.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25edd9b700 1 -- 172.21.15.26:0/3715401216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f00ffc80 msgr2=0x7f25f0196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:16.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25edd9b700 1 --2- 172.21.15.26:0/3715401216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f00ffc80 0x7f25f0196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25edd9b700 1 -- 172.21.15.26:0/3715401216 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25f0101810 msgr2=0x7f25f019e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:16.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25edd9b700 1 --2- 172.21.15.26:0/3715401216 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25f0101810 0x7f25f019e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25edd9b700 1 -- 172.21.15.26:0/3715401216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d80095f0 con 0x7f25f0100e70 2023-12-01T01:04:16.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25eed9d700 1 --2- 172.21.15.26:0/3715401216 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25f0101810 0x7f25f019e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:16.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25ee59c700 1 --2- 172.21.15.26:0/3715401216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f00ffc80 0x7f25f0196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:16.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.188+0000 7f25edd9b700 1 --2- 172.21.15.26:0/3715401216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f0100e70 0x7f25f01970e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f25e000d950 tx=0x7f25e000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:16.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.189+0000 7f25e77fe700 1 -- 172.21.15.26:0/3715401216 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e0009b40 con 0x7f25f0100e70 2023-12-01T01:04:16.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.189+0000 7f25e77fe700 1 -- 172.21.15.26:0/3715401216 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f25e0009ca0 con 0x7f25f0100e70 2023-12-01T01:04:16.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.189+0000 7f25e77fe700 1 -- 172.21.15.26:0/3715401216 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e000f6b0 con 0x7f25f0100e70 2023-12-01T01:04:16.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.189+0000 7f25f4b96700 1 -- 172.21.15.26:0/3715401216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f019ecd0 con 0x7f25f0100e70 2023-12-01T01:04:16.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.189+0000 7f25f4b96700 1 -- 172.21.15.26:0/3715401216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f019f190 con 0x7f25f0100e70 2023-12-01T01:04:16.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.190+0000 7f25f4b96700 1 -- 172.21.15.26:0/3715401216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f010b620 con 0x7f25f0100e70 2023-12-01T01:04:16.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.191+0000 7f25e77fe700 1 -- 172.21.15.26:0/3715401216 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f25e0010460 con 0x7f25f0100e70 2023-12-01T01:04:16.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.191+0000 7f25e77fe700 1 --2- 172.21.15.26:0/3715401216 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f25dc0a05a0 0x7f25dc0a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:16.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.191+0000 7f25e77fe700 1 -- 172.21.15.26:0/3715401216 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f25e00cbc80 con 0x7f25f0100e70 2023-12-01T01:04:16.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.191+0000 7f25ee59c700 1 --2- 172.21.15.26:0/3715401216 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f25dc0a05a0 0x7f25dc0a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:16.193 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.192+0000 7f25ee59c700 1 --2- 172.21.15.26:0/3715401216 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f25dc0a05a0 0x7f25dc0a2a60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f25d800b580 tx=0x7f25d8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:16.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.196+0000 7f25e77fe700 1 -- 172.21.15.26:0/3715401216 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f25e0095830 con 0x7f25f0100e70 2023-12-01T01:04:16.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:15 smithi093 ceph-mon[103327]: pgmap v291: 97 pgs: 97 active+clean; 644 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1023 B/s wr, 7 op/s 2023-12-01T01:04:16.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:15 smithi093 ceph-mon[103327]: from='client.15306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:04:16.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:15 smithi093 ceph-mon[103327]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:04:16.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:15 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1772780431' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:16.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:15 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/27222912' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:04:16.397 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.396+0000 7f25f4b96700 1 -- 172.21.15.26:0/3715401216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f25f019f7a0 con 0x7f25f0100e70 2023-12-01T01:04:16.398 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.397+0000 7f25e77fe700 1 -- 172.21.15.26:0/3715401216 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v83) v1 ==== 100+0+11 (secure 0 0 0) 0x7f25e0098e50 con 0x7f25f0100e70 2023-12-01T01:04:16.398 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-12-01T01:04:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.399+0000 7f25f4b96700 1 -- 172.21.15.26:0/3715401216 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f25dc0a05a0 msgr2=0x7f25dc0a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.399+0000 7f25f4b96700 1 --2- 172.21.15.26:0/3715401216 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f25dc0a05a0 0x7f25dc0a2a60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f25d800b580 tx=0x7f25d8005fb0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.399+0000 7f25f4b96700 1 -- 172.21.15.26:0/3715401216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f0100e70 msgr2=0x7f25f01970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.399+0000 7f25f4b96700 1 --2- 172.21.15.26:0/3715401216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f0100e70 0x7f25f01970e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f25e000d950 tx=0x7f25e000dd10 comp rx=0 tx=0).stop 2023-12-01T01:04:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.399+0000 7f25f4b96700 1 -- 172.21.15.26:0/3715401216 shutdown_connections 2023-12-01T01:04:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.399+0000 7f25f4b96700 1 --2- 172.21.15.26:0/3715401216 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f25dc0a05a0 0x7f25dc0a2a60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.400 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.399+0000 7f25f4b96700 1 --2- 172.21.15.26:0/3715401216 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25f0101810 0x7f25f019e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.399+0000 7f25f4b96700 1 --2- 172.21.15.26:0/3715401216 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25f00ffc80 0x7f25f0196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.399+0000 7f25f4b96700 1 --2- 172.21.15.26:0/3715401216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25f0100e70 0x7f25f01970e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.399+0000 7f25f4b96700 1 -- 172.21.15.26:0/3715401216 >> 172.21.15.26:0/3715401216 conn(0x7f25f00fb1f0 msgr2=0x7f25f0067ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:16.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.399+0000 7f25f4b96700 1 -- 172.21.15.26:0/3715401216 shutdown_connections 2023-12-01T01:04:16.401 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.399+0000 7f25f4b96700 1 -- 172.21.15.26:0/3715401216 wait complete. 2023-12-01T01:04:16.413 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:04:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.537+0000 7f40bb3f0700 1 -- 172.21.15.26:0/3662803605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b41017a0 msgr2=0x7f40b4108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.537+0000 7f40bb3f0700 1 --2- 172.21.15.26:0/3662803605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b41017a0 0x7f40b4108050 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00b0d0 tx=0x7f40ac00b3e0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.537+0000 7f40bb3f0700 1 -- 172.21.15.26:0/3662803605 shutdown_connections 2023-12-01T01:04:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.537+0000 7f40bb3f0700 1 --2- 172.21.15.26:0/3662803605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b41017a0 0x7f40b4108050 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.537+0000 7f40bb3f0700 1 --2- 172.21.15.26:0/3662803605 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40b40ffc10 0x7f40b4100030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.537+0000 7f40bb3f0700 1 --2- 172.21.15.26:0/3662803605 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40b4100e00 0x7f40b4101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.537+0000 7f40bb3f0700 1 -- 172.21.15.26:0/3662803605 >> 172.21.15.26:0/3662803605 conn(0x7f40b40fb140 msgr2=0x7f40b40fd5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.537+0000 7f40bb3f0700 1 -- 172.21.15.26:0/3662803605 shutdown_connections 2023-12-01T01:04:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.537+0000 7f40bb3f0700 1 -- 172.21.15.26:0/3662803605 wait complete. 2023-12-01T01:04:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40bb3f0700 1 Processor -- start 2023-12-01T01:04:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40bb3f0700 1 -- start start 2023-12-01T01:04:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40bb3f0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b40ffc10 0x7f40b4196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40bb3f0700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40b4100e00 0x7f40b41970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40bb3f0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40b41017a0 0x7f40b419e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40bb3f0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b419e6f0 con 0x7f40b40ffc10 2023-12-01T01:04:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40bb3f0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b419e830 con 0x7f40b41017a0 2023-12-01T01:04:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40bb3f0700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b419e9c0 con 0x7f40b4100e00 2023-12-01T01:04:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40b918c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b40ffc10 0x7f40b4196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40b918c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b40ffc10 0x7f40b4196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55092/0 (socket says 172.21.15.26:55092) 2023-12-01T01:04:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40b918c700 1 -- 172.21.15.26:0/3873882193 learned_addr learned my addr 172.21.15.26:0/3873882193 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40b998d700 1 --2- 172.21.15.26:0/3873882193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40b41017a0 0x7f40b419e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:16.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40b898b700 1 --2- 172.21.15.26:0/3873882193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40b4100e00 0x7f40b41970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:16.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40b918c700 1 -- 172.21.15.26:0/3873882193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40b4100e00 msgr2=0x7f40b41970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:16.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40b918c700 1 --2- 172.21.15.26:0/3873882193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40b4100e00 0x7f40b41970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40b918c700 1 -- 172.21.15.26:0/3873882193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40b41017a0 msgr2=0x7f40b419e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:16.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40b918c700 1 --2- 172.21.15.26:0/3873882193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40b41017a0 0x7f40b419e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.538+0000 7f40b918c700 1 -- 172.21.15.26:0/3873882193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac009d00 con 0x7f40b40ffc10 2023-12-01T01:04:16.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.539+0000 7f40b918c700 1 --2- 172.21.15.26:0/3873882193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b40ffc10 0x7f40b4196b70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f40b000d980 tx=0x7f40b000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:16.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.539+0000 7f40aa7fc700 1 -- 172.21.15.26:0/3873882193 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b000f890 con 0x7f40b40ffc10 2023-12-01T01:04:16.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.539+0000 7f40bb3f0700 1 -- 172.21.15.26:0/3873882193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b419eca0 con 0x7f40b40ffc10 2023-12-01T01:04:16.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.539+0000 7f40aa7fc700 1 -- 172.21.15.26:0/3873882193 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f40b0010460 con 0x7f40b40ffc10 2023-12-01T01:04:16.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.539+0000 7f40aa7fc700 1 -- 172.21.15.26:0/3873882193 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b00195c0 con 0x7f40b40ffc10 2023-12-01T01:04:16.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.539+0000 7f40bb3f0700 1 -- 172.21.15.26:0/3873882193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b419f1b0 con 0x7f40b40ffc10 2023-12-01T01:04:16.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.540+0000 7f40bb3f0700 1 -- 172.21.15.26:0/3873882193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b41070b0 con 0x7f40b40ffc10 2023-12-01T01:04:16.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.541+0000 7f40aa7fc700 1 -- 172.21.15.26:0/3873882193 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f40b0010940 con 0x7f40b40ffc10 2023-12-01T01:04:16.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.541+0000 7f40aa7fc700 1 --2- 172.21.15.26:0/3873882193 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f40a00a0570 0x7f40a00a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:16.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.542+0000 7f40b898b700 1 --2- 172.21.15.26:0/3873882193 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f40a00a0570 0x7f40a00a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:16.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.542+0000 7f40aa7fc700 1 -- 172.21.15.26:0/3873882193 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f40b00cbc30 con 0x7f40b40ffc10 2023-12-01T01:04:16.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.542+0000 7f40b898b700 1 --2- 172.21.15.26:0/3873882193 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f40a00a0570 0x7f40a00a2a30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f40a4005950 tx=0x7f40a400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:16.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.545+0000 7f40aa7fc700 1 -- 172.21.15.26:0/3873882193 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f40b00957e0 con 0x7f40b40ffc10 2023-12-01T01:04:16.799 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.798+0000 7f40bb3f0700 1 -- 172.21.15.26:0/3873882193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40b402cc70 con 0x7f40b40ffc10 2023-12-01T01:04:16.800 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.799+0000 7f40aa7fc700 1 -- 172.21.15.26:0/3873882193 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10777 (secure 0 0 0) 0x7f40b00105d0 con 0x7f40b40ffc10 2023-12-01T01:04:16.800 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:04:16.800 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6841/3515135915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6840","nonce":3515135915},{"type":"v1","addr":"172.21.15.26:6841","nonce":3515135915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-01T01:02:47.252972+0000","modified":"2023-12-01T01:02:52.326753+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24493,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.93:6837/3333520218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3333520218},{"type":"v1","addr":"172.21.15.93:6837","nonce":3333520218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6839/3364532241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":3364532241},{"type":"v1","addr":"172.21.15.93:6839","nonce":3364532241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T01:04:16.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.801+0000 7f40bb3f0700 1 -- 172.21.15.26:0/3873882193 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f40a00a0570 msgr2=0x7f40a00a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:16.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.801+0000 7f40bb3f0700 1 --2- 172.21.15.26:0/3873882193 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f40a00a0570 0x7f40a00a2a30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f40a4005950 tx=0x7f40a400b410 comp rx=0 tx=0).stop 2023-12-01T01:04:16.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.801+0000 7f40bb3f0700 1 -- 172.21.15.26:0/3873882193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b40ffc10 msgr2=0x7f40b4196b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:16.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.801+0000 7f40bb3f0700 1 --2- 172.21.15.26:0/3873882193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b40ffc10 0x7f40b4196b70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f40b000d980 tx=0x7f40b000dc90 comp rx=0 tx=0).stop 2023-12-01T01:04:16.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.801+0000 7f40bb3f0700 1 -- 172.21.15.26:0/3873882193 shutdown_connections 2023-12-01T01:04:16.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.801+0000 7f40bb3f0700 1 --2- 172.21.15.26:0/3873882193 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f40a00a0570 0x7f40a00a2a30 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.801+0000 7f40bb3f0700 1 --2- 172.21.15.26:0/3873882193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f40b41017a0 0x7f40b419e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.801+0000 7f40bb3f0700 1 --2- 172.21.15.26:0/3873882193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f40b40ffc10 0x7f40b4196b70 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.801+0000 7f40bb3f0700 1 --2- 172.21.15.26:0/3873882193 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f40b4100e00 0x7f40b41970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.801+0000 7f40bb3f0700 1 -- 172.21.15.26:0/3873882193 >> 172.21.15.26:0/3873882193 conn(0x7f40b40fb140 msgr2=0x7f40b41041f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:16.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.801+0000 7f40bb3f0700 1 -- 172.21.15.26:0/3873882193 shutdown_connections 2023-12-01T01:04:16.807 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.801+0000 7f40bb3f0700 1 -- 172.21.15.26:0/3873882193 wait complete. 2023-12-01T01:04:16.807 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 23 2023-12-01T01:04:16.815 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:04:16.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.941+0000 7fdaeea20700 1 -- 172.21.15.26:0/1002109834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdae8101840 msgr2=0x7fdae81080f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:16.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.941+0000 7fdaeea20700 1 --2- 172.21.15.26:0/1002109834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdae8101840 0x7fdae81080f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fdae000b0d0 tx=0x7fdae000b3e0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.941+0000 7fdaeea20700 1 -- 172.21.15.26:0/1002109834 shutdown_connections 2023-12-01T01:04:16.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.941+0000 7fdaeea20700 1 --2- 172.21.15.26:0/1002109834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdae8101840 0x7fdae81080f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.941+0000 7fdaeea20700 1 --2- 172.21.15.26:0/1002109834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae80ffcb0 0x7fdae81000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.941+0000 7fdaeea20700 1 --2- 172.21.15.26:0/1002109834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae8100ea0 0x7fdae8101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.941+0000 7fdaeea20700 1 -- 172.21.15.26:0/1002109834 >> 172.21.15.26:0/1002109834 conn(0x7fdae80fb220 msgr2=0x7fdae80fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:16.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.941+0000 7fdaeea20700 1 -- 172.21.15.26:0/1002109834 shutdown_connections 2023-12-01T01:04:16.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.941+0000 7fdaeea20700 1 -- 172.21.15.26:0/1002109834 wait complete. 2023-12-01T01:04:16.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.941+0000 7fdaeea20700 1 Processor -- start 2023-12-01T01:04:16.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.941+0000 7fdaeea20700 1 -- start start 2023-12-01T01:04:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdaeea20700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdae80ffcb0 0x7fdae81949d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdaeea20700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae8100ea0 0x7fdae8194f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdaeea20700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8101840 0x7fdae819bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdaeea20700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae819c550 con 0x7fdae80ffcb0 2023-12-01T01:04:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdaeea20700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae819c690 con 0x7fdae8101840 2023-12-01T01:04:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdaeea20700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae819c820 con 0x7fdae8100ea0 2023-12-01T01:04:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdae7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdae80ffcb0 0x7fdae81949d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdae7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdae80ffcb0 0x7fdae81949d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55104/0 (socket says 172.21.15.26:55104) 2023-12-01T01:04:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdae7fff700 1 -- 172.21.15.26:0/3661768875 learned_addr learned my addr 172.21.15.26:0/3661768875 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:16.945 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdae77fe700 1 --2- 172.21.15.26:0/3661768875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae8100ea0 0x7fdae8194f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdaecfbd700 1 --2- 172.21.15.26:0/3661768875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8101840 0x7fdae819bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdae7fff700 1 -- 172.21.15.26:0/3661768875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae8100ea0 msgr2=0x7fdae8194f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdae7fff700 1 --2- 172.21.15.26:0/3661768875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae8100ea0 0x7fdae8194f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdae7fff700 1 -- 172.21.15.26:0/3661768875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8101840 msgr2=0x7fdae819bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdae7fff700 1 --2- 172.21.15.26:0/3661768875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8101840 0x7fdae819bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdae7fff700 1 -- 172.21.15.26:0/3661768875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae0009d00 con 0x7fdae80ffcb0 2023-12-01T01:04:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdaecfbd700 1 --2- 172.21.15.26:0/3661768875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8101840 0x7fdae819bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdae7fff700 1 --2- 172.21.15.26:0/3661768875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdae80ffcb0 0x7fdae81949d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdad800c970 tx=0x7fdad800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdae57fa700 1 -- 172.21.15.26:0/3661768875 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad8004220 con 0x7fdae80ffcb0 2023-12-01T01:04:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdae57fa700 1 -- 172.21.15.26:0/3661768875 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdad8007d80 con 0x7fdae80ffcb0 2023-12-01T01:04:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.942+0000 7fdaeea20700 1 -- 172.21.15.26:0/3661768875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae819cb00 con 0x7fdae80ffcb0 2023-12-01T01:04:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.943+0000 7fdae57fa700 1 -- 172.21.15.26:0/3661768875 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad8003cd0 con 0x7fdae80ffcb0 2023-12-01T01:04:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.943+0000 7fdaeea20700 1 -- 172.21.15.26:0/3661768875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae819d010 con 0x7fdae80ffcb0 2023-12-01T01:04:16.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.943+0000 7fdaeea20700 1 -- 172.21.15.26:0/3661768875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae8107100 con 0x7fdae80ffcb0 2023-12-01T01:04:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.945+0000 7fdae57fa700 1 -- 172.21.15.26:0/3661768875 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fdad80078a0 con 0x7fdae80ffcb0 2023-12-01T01:04:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.946+0000 7fdae57fa700 1 --2- 172.21.15.26:0/3661768875 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdad40a2780 0x7fdad40a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.946+0000 7fdae57fa700 1 -- 172.21.15.26:0/3661768875 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdad80cba00 con 0x7fdae80ffcb0 2023-12-01T01:04:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.946+0000 7fdae77fe700 1 --2- 172.21.15.26:0/3661768875 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdad40a2780 0x7fdad40a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:16.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.946+0000 7fdae77fe700 1 --2- 172.21.15.26:0/3661768875 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdad40a2780 0x7fdad40a4c40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdad0004630 tx=0x7fdad000b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:16.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:16.949+0000 7fdae57fa700 1 -- 172.21.15.26:0/3661768875 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fdad80955b0 con 0x7fdae80ffcb0 2023-12-01T01:04:17.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.150+0000 7fdaeea20700 1 -- 172.21.15.26:0/3661768875 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdae802cc70 con 0x7fdae80ffcb0 2023-12-01T01:04:17.152 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.151+0000 7fdae57fa700 1 -- 172.21.15.26:0/3661768875 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22481 (secure 0 0 0) 0x7fdad801d090 con 0x7fdae80ffcb0 2023-12-01T01:04:17.152 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:04:17.153 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":83,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:02:59.627676+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:04:17.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.153+0000 7fdaeea20700 1 -- 172.21.15.26:0/3661768875 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdad40a2780 msgr2=0x7fdad40a4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.153+0000 7fdaeea20700 1 --2- 172.21.15.26:0/3661768875 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdad40a2780 0x7fdad40a4c40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdad0004630 tx=0x7fdad000b3c0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.153+0000 7fdaeea20700 1 -- 172.21.15.26:0/3661768875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdae80ffcb0 msgr2=0x7fdae81949d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.153+0000 7fdaeea20700 1 --2- 172.21.15.26:0/3661768875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdae80ffcb0 0x7fdae81949d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fdad800c970 tx=0x7fdad800cc80 comp rx=0 tx=0).stop 2023-12-01T01:04:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.153+0000 7fdaeea20700 1 -- 172.21.15.26:0/3661768875 shutdown_connections 2023-12-01T01:04:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.153+0000 7fdaeea20700 1 --2- 172.21.15.26:0/3661768875 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdad40a2780 0x7fdad40a4c40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.153+0000 7fdaeea20700 1 --2- 172.21.15.26:0/3661768875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdae8101840 0x7fdae819bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.153+0000 7fdaeea20700 1 --2- 172.21.15.26:0/3661768875 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdae80ffcb0 0x7fdae81949d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.153+0000 7fdaeea20700 1 --2- 172.21.15.26:0/3661768875 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdae8100ea0 0x7fdae8194f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.153+0000 7fdaeea20700 1 -- 172.21.15.26:0/3661768875 >> 172.21.15.26:0/3661768875 conn(0x7fdae80fb220 msgr2=0x7fdae8104240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.153+0000 7fdaeea20700 1 -- 172.21.15.26:0/3661768875 shutdown_connections 2023-12-01T01:04:17.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.153+0000 7fdaeea20700 1 -- 172.21.15.26:0/3661768875 wait complete. 2023-12-01T01:04:17.166 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:16 smithi026 ceph-mon[98801]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:04:17.166 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:16 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/784869722' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:04:17.166 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:16 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3715401216' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:04:17.166 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:16 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3873882193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:04:17.167 DEBUG:tasks.fwd_scrub:Yielding 2023-12-01T01:04:17.168 INFO:teuthology.run_tasks:Running task background_exec... 2023-12-01T01:04:17.178 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi026.front.sepia.ceph.com 2023-12-01T01:04:17.178 DEBUG:teuthology.orchestra.run.smithi026:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-12-01T01:04:17.179 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-12-01T01:04:17.179 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-01T01:04:17.180 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-01T01:04:17.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:16 smithi116 ceph-mon[103554]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:04:17.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:16 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/784869722' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:04:17.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:16 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3715401216' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:04:17.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:16 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3873882193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:04:17.184 INFO:teuthology.run_tasks:Running task workunit... 2023-12-01T01:04:17.200 INFO:tasks.workunit:Pulling workunits from ref a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T01:04:17.200 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-01T01:04:17.200 INFO:tasks.workunit:timeout=3h 2023-12-01T01:04:17.200 INFO:tasks.workunit:cleanup=True 2023-12-01T01:04:17.201 DEBUG:teuthology.orchestra.run.smithi026:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-01T01:04:17.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:16 smithi093 ceph-mon[103327]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-01T01:04:17.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:16 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/784869722' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:04:17.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:16 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3715401216' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:04:17.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:16 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3873882193' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:04:17.219 INFO:teuthology.orchestra.run.smithi026.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-12-01T01:04:17.219 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-12-01T01:04:17.219 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 7ch/124d Inode: 1099511628283 Links: 2 2023-12-01T01:04:17.221 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-01T01:04:17.222 INFO:teuthology.orchestra.run.smithi026.stdout:Context: system_u:object_r:cephfs_t:s0 2023-12-01T01:04:17.222 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2023-12-01 01:02:53.562508625 +0000 2023-12-01T01:04:17.222 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2023-12-01 01:02:53.562508625 +0000 2023-12-01T01:04:17.222 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2023-12-01 01:04:10.097623766 +0000 2023-12-01T01:04:17.222 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: 2023-12-01 01:02:53.562508625 +0000 2023-12-01T01:04:17.222 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-12-01T01:04:17.222 DEBUG:teuthology.orchestra.run.smithi026:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-12-01T01:04:17.316 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a6f82997ac57b70a895455dfed6256360a1e4c32 2023-12-01T01:04:17.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.322+0000 7f814f0fe700 1 -- 172.21.15.26:0/1323198075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8148101340 msgr2=0x7f8148101760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.322+0000 7f814f0fe700 1 --2- 172.21.15.26:0/1323198075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8148101340 0x7f8148101760 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f813c009990 tx=0x7f813c009ca0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.322+0000 7f814f0fe700 1 -- 172.21.15.26:0/1323198075 shutdown_connections 2023-12-01T01:04:17.323 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.322+0000 7f814f0fe700 1 --2- 172.21.15.26:0/1323198075 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f81481008c0 0x7f8148108160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.322+0000 7f814f0fe700 1 --2- 172.21.15.26:0/1323198075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8148101340 0x7f8148101760 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.322+0000 7f814f0fe700 1 --2- 172.21.15.26:0/1323198075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81480fff00 0x7f8148100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.322+0000 7f814f0fe700 1 -- 172.21.15.26:0/1323198075 >> 172.21.15.26:0/1323198075 conn(0x7f81480fa9b0 msgr2=0x7f81480fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:17.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.322+0000 7f814f0fe700 1 -- 172.21.15.26:0/1323198075 shutdown_connections 2023-12-01T01:04:17.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.322+0000 7f814f0fe700 1 -- 172.21.15.26:0/1323198075 wait complete. 2023-12-01T01:04:17.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814f0fe700 1 Processor -- start 2023-12-01T01:04:17.324 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814f0fe700 1 -- start start 2023-12-01T01:04:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814f0fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f81480fff00 0x7f81480ff980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814f0fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81481008c0 0x7f814819b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814f0fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8148101340 0x7f814819dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814f0fe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814819e6b0 con 0x7f8148101340 2023-12-01T01:04:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814f0fe700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814819e820 con 0x7f81481008c0 2023-12-01T01:04:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814f0fe700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814819e9e0 con 0x7f81480fff00 2023-12-01T01:04:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814d69b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8148101340 0x7f814819dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814d69b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8148101340 0x7f814819dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55124/0 (socket says 172.21.15.26:55124) 2023-12-01T01:04:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814d69b700 1 -- 172.21.15.26:0/2742362598 learned_addr learned my addr 172.21.15.26:0/2742362598 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814ce9a700 1 --2- 172.21.15.26:0/2742362598 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f81480fff00 0x7f81480ff980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f8147fff700 1 --2- 172.21.15.26:0/2742362598 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81481008c0 0x7f814819b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814d69b700 1 -- 172.21.15.26:0/2742362598 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f81480fff00 msgr2=0x7f81480ff980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814d69b700 1 --2- 172.21.15.26:0/2742362598 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f81480fff00 0x7f81480ff980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814d69b700 1 -- 172.21.15.26:0/2742362598 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81481008c0 msgr2=0x7f814819b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814d69b700 1 --2- 172.21.15.26:0/2742362598 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81481008c0 0x7f814819b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f814d69b700 1 -- 172.21.15.26:0/2742362598 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c0095f0 con 0x7f8148101340 2023-12-01T01:04:17.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.323+0000 7f8147fff700 1 --2- 172.21.15.26:0/2742362598 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81481008c0 0x7f814819b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.324+0000 7f814d69b700 1 --2- 172.21.15.26:0/2742362598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8148101340 0x7f814819dee0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f814000ef30 tx=0x7f814000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.324+0000 7f8145ffb700 1 -- 172.21.15.26:0/2742362598 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8140018070 con 0x7f8148101340 2023-12-01T01:04:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.324+0000 7f8145ffb700 1 -- 172.21.15.26:0/2742362598 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f814000f040 con 0x7f8148101340 2023-12-01T01:04:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.324+0000 7f814f0fe700 1 -- 172.21.15.26:0/2742362598 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814819ec60 con 0x7f8148101340 2023-12-01T01:04:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.324+0000 7f8145ffb700 1 -- 172.21.15.26:0/2742362598 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814000ce00 con 0x7f8148101340 2023-12-01T01:04:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.324+0000 7f814f0fe700 1 -- 172.21.15.26:0/2742362598 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814819f120 con 0x7f8148101340 2023-12-01T01:04:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.327+0000 7f8145ffb700 1 -- 172.21.15.26:0/2742362598 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f8140003a00 con 0x7f8148101340 2023-12-01T01:04:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.328+0000 7f815b28eb80 1 Processor -- start 2023-12-01T01:04:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.328+0000 7f8145ffb700 1 --2- 172.21.15.26:0/2742362598 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81380a0520 0x7f81380a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.328+0000 7f815b28eb80 1 -- start start 2023-12-01T01:04:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.328+0000 7f8147fff700 1 --2- 172.21.15.26:0/2742362598 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81380a0520 0x7f81380a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.328+0000 7f8145ffb700 1 -- 172.21.15.26:0/2742362598 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f81400cb560 con 0x7f8148101340 2023-12-01T01:04:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.328+0000 7f815b28eb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 0x55a828d5b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.328+0000 7f815b28eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5baf0 0x55a828d59ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.328+0000 7f815b28eb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5a470 0x55a828d5a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.328+0000 7f815b28eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a828cb1a90 con 0x55a828d5baf0 2023-12-01T01:04:17.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.328+0000 7f815b28eb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a828caf450 con 0x55a828d5a470 2023-12-01T01:04:17.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.328+0000 7f815b28eb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a828caad40 con 0x55a828d5b170 2023-12-01T01:04:17.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.328+0000 7f814ce9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 0x55a828d5b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.328+0000 7f814ce9a700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 0x55a828d5b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.26:47358/0 (socket says 172.21.15.26:47358) 2023-12-01T01:04:17.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.328+0000 7f8147fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5baf0 0x55a828d59ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.328+0000 7f814ce9a700 1 -- 172.21.15.26:0/2806644097 learned_addr learned my addr 172.21.15.26:0/2806644097 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:17.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.328+0000 7f814d69b700 1 --2- 172.21.15.26:0/2806644097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5a470 0x55a828d5a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.329+0000 7f8147fff700 1 --2- 172.21.15.26:0/2742362598 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81380a0520 0x7f81380a29e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8134005d90 tx=0x7f81340096c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:17.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.329+0000 7f814ce9a700 1 -- 172.21.15.26:0/2806644097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5a470 msgr2=0x55a828d5a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:17.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.329+0000 7f814ce9a700 1 --2- 172.21.15.26:0/2806644097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5a470 0x55a828d5a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.329+0000 7f814ce9a700 1 -- 172.21.15.26:0/2806644097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5baf0 msgr2=0x55a828d59ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:17.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.329+0000 7f814ce9a700 1 --2- 172.21.15.26:0/2806644097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5baf0 0x55a828d59ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.329+0000 7f814ce9a700 1 -- 172.21.15.26:0/2806644097 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a828ad8e60 con 0x55a828d5b170 2023-12-01T01:04:17.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.329+0000 7f814ce9a700 1 --2- 172.21.15.26:0/2806644097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 0x55a828d5b5b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f813c015000 tx=0x7f813c005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c04ca520cebd6b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:17.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.329+0000 7f8132ffd700 1 -- 172.21.15.26:0/2806644097 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c01d070 con 0x55a828d5b170 2023-12-01T01:04:17.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.329+0000 7f8132ffd700 1 -- 172.21.15.26:0/2806644097 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f813c01e040 con 0x55a828d5b170 2023-12-01T01:04:17.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.329+0000 7f8132ffd700 1 -- 172.21.15.26:0/2806644097 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c004a70 con 0x55a828d5b170 2023-12-01T01:04:17.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.330+0000 7f815b28eb80 1 -- 172.21.15.26:0/2806644097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 msgr2=0x55a828d5b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.330+0000 7f815b28eb80 1 --2- 172.21.15.26:0/2806644097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 0x55a828d5b5b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f813c015000 tx=0x7f813c005e80 comp rx=0 tx=0).stop 2023-12-01T01:04:17.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.330+0000 7f815b28eb80 1 -- 172.21.15.26:0/2806644097 shutdown_connections 2023-12-01T01:04:17.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.330+0000 7f815b28eb80 1 --2- 172.21.15.26:0/2806644097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5a470 0x55a828d5a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.330+0000 7f815b28eb80 1 --2- 172.21.15.26:0/2806644097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 0x55a828d5b5b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.330+0000 7f815b28eb80 1 --2- 172.21.15.26:0/2806644097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5baf0 0x55a828d59ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.330+0000 7f815b28eb80 1 -- 172.21.15.26:0/2806644097 >> 172.21.15.26:0/2806644097 conn(0x55a828cb9150 msgr2=0x55a828d549c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:17.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.330+0000 7f815b28eb80 1 -- 172.21.15.26:0/2806644097 shutdown_connections 2023-12-01T01:04:17.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.330+0000 7f815b28eb80 1 -- 172.21.15.26:0/2806644097 wait complete. 2023-12-01T01:04:17.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.330+0000 7f815b28eb80 1 -- start start 2023-12-01T01:04:17.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.330+0000 7f815b28eb80 1 Processor -- start 2023-12-01T01:04:17.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f815b28eb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5a470 0x55a828d67da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f815b28eb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 0x55a828d682e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f815b28eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5baf0 0x55a828d6f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f815b28eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a828c47590 con 0x55a828d5baf0 2023-12-01T01:04:17.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f815b28eb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a828c47230 con 0x55a828d5a470 2023-12-01T01:04:17.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f815b28eb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a828b2e9a0 con 0x55a828d5b170 2023-12-01T01:04:17.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f815b28eb80 10 client.0 _ll_register_callbacks cb 0x55a828b94b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:17.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f814d69b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5baf0 0x55a828d6f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f814d69b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5baf0 0x55a828d6f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55138/0 (socket says 172.21.15.26:55138) 2023-12-01T01:04:17.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f814d69b700 1 -- 172.21.15.26:0/4008049005 learned_addr learned my addr 172.21.15.26:0/4008049005 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:17.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f8147fff700 1 --2- 172.21.15.26:0/4008049005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 0x55a828d682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f814ce9a700 1 --2- 172.21.15.26:0/4008049005 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5a470 0x55a828d67da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f814d69b700 1 -- 172.21.15.26:0/4008049005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 msgr2=0x55a828d682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:17.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f814d69b700 1 --2- 172.21.15.26:0/4008049005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 0x55a828d682e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f814d69b700 1 -- 172.21.15.26:0/4008049005 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5a470 msgr2=0x55a828d67da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:17.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f814d69b700 1 --2- 172.21.15.26:0/4008049005 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5a470 0x55a828d67da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.331+0000 7f814d69b700 1 -- 172.21.15.26:0/4008049005 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8148108b10 con 0x55a828d5baf0 2023-12-01T01:04:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.332+0000 7f814d69b700 1 --2- 172.21.15.26:0/4008049005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5baf0 0x55a828d6f320 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f81400c9010 tx=0x7f81400989c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3280eb16919170d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.332+0000 7f8127fff700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.332+0000 7f8127fff700 1 -- 172.21.15.26:0/4008049005 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8140099500 con 0x55a828d5baf0 2023-12-01T01:04:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.332+0000 7f8127fff700 1 -- 172.21.15.26:0/4008049005 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8140098e00 con 0x55a828d5baf0 2023-12-01T01:04:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.332+0000 7f815b28eb80 1 -- 172.21.15.26:0/4008049005 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a828cd5d90 con 0x55a828d5baf0 2023-12-01T01:04:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.332+0000 7f8127fff700 1 -- 172.21.15.26:0/4008049005 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f814009cc30 con 0x55a828d5baf0 2023-12-01T01:04:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.332+0000 7f815b28eb80 10 client.15366 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.332+0000 7f815b28eb80 1 -- 172.21.15.26:0/4008049005 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55a828ac1ce0 con 0x55a828d5baf0 2023-12-01T01:04:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.332+0000 7f8127fff700 1 -- 172.21.15.26:0/4008049005 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8140063020 con 0x55a828d5baf0 2023-12-01T01:04:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.332+0000 7f8127fff700 1 -- 172.21.15.26:0/4008049005 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f81400cb0d0 con 0x55a828d5baf0 2023-12-01T01:04:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.332+0000 7f815b28eb80 10 client.15366 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.332+0000 7f815b28eb80 10 client.15366 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.332+0000 7f815b28eb80 20 client.15366 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:17.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.333+0000 7f815b28eb80 1 --2- 172.21.15.26:0/4008049005 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a828d73a50 0x55a828d75e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.333+0000 7f815b28eb80 4 client.15366 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:04:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.333+0000 7f815b28eb80 1 -- 172.21.15.26:0/4008049005 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a828d28e90 con 0x55a828d73a50 2023-12-01T01:04:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.333+0000 7f814ce9a700 1 --2- 172.21.15.26:0/4008049005 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a828d73a50 0x55a828d75e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.333+0000 7f8127fff700 10 client.15366 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.333+0000 7f814ce9a700 1 --2- 172.21.15.26:0/4008049005 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a828d73a50 0x55a828d75e70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f93940a256c99c4 server_cookie=666971388f6c5520 in_seq=0 out_seq=0 2023-12-01T01:04:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.334+0000 7f8127fff700 1 -- 172.21.15.26:0/4008049005 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55a828d28e90 con 0x55a828d73a50 2023-12-01T01:04:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.334+0000 7f8127fff700 10 client.15366 handle_command_reply: tid=0 2023-12-01T01:04:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.334+0000 7f815b28eb80 1 client.15366 shutdown 2023-12-01T01:04:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.334+0000 7f815b28eb80 1 -- 172.21.15.26:0/4008049005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5baf0 msgr2=0x55a828d6f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.334+0000 7f815b28eb80 1 --2- 172.21.15.26:0/4008049005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5baf0 0x55a828d6f320 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f81400c9010 tx=0x7f81400989c0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.334+0000 7f815b28eb80 1 -- 172.21.15.26:0/4008049005 shutdown_connections 2023-12-01T01:04:17.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.334+0000 7f815b28eb80 1 --2- 172.21.15.26:0/4008049005 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a828d73a50 0x55a828d75e70 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.334+0000 7f815b28eb80 1 --2- 172.21.15.26:0/4008049005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5baf0 0x55a828d6f320 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.334+0000 7f815b28eb80 1 --2- 172.21.15.26:0/4008049005 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5a470 0x55a828d67da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.334+0000 7f8127fff700 0 client.15366 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:17.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.334+0000 7f815b28eb80 1 --2- 172.21.15.26:0/4008049005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 0x55a828d682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.334+0000 7f815b28eb80 1 -- 172.21.15.26:0/4008049005 >> 172.21.15.26:0/4008049005 conn(0x55a828cb9150 msgr2=0x55a828d54130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:17.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.334+0000 7f815b28eb80 1 -- 172.21.15.26:0/4008049005 shutdown_connections 2023-12-01T01:04:17.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.334+0000 7f815b28eb80 1 -- 172.21.15.26:0/4008049005 wait complete. 2023-12-01T01:04:17.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.334+0000 7f815b28eb80 20 client.15366 trim_cache size 0 max 16384 2023-12-01T01:04:17.345 INFO:tasks.workunit.client.0.smithi026.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-01T01:04:17.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.351+0000 7f815b28eb80 1 Processor -- start 2023-12-01T01:04:17.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.351+0000 7f815b28eb80 1 -- start start 2023-12-01T01:04:17.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.351+0000 7f815b28eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5a470 0x55a828d59ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.351+0000 7f815b28eb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 0x55a828d6f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.351+0000 7f815b28eb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5baf0 0x55a828d67b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.351+0000 7f815b28eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a828d54ee0 con 0x55a828d5a470 2023-12-01T01:04:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.351+0000 7f815b28eb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a828d737e0 con 0x55a828d5baf0 2023-12-01T01:04:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.351+0000 7f815b28eb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a828d5eb40 con 0x55a828d5b170 2023-12-01T01:04:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.352+0000 7f814ce9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5a470 0x55a828d59ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.352+0000 7f814ce9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5a470 0x55a828d59ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55144/0 (socket says 172.21.15.26:55144) 2023-12-01T01:04:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.352+0000 7f814ce9a700 1 -- 172.21.15.26:0/1089354225 learned_addr learned my addr 172.21.15.26:0/1089354225 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.352+0000 7f8147fff700 1 --2- 172.21.15.26:0/1089354225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 0x55a828d6f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.352+0000 7f814d69b700 1 --2- 172.21.15.26:0/1089354225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5baf0 0x55a828d67b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.352+0000 7f814ce9a700 1 -- 172.21.15.26:0/1089354225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 msgr2=0x55a828d6f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.352+0000 7f814ce9a700 1 --2- 172.21.15.26:0/1089354225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 0x55a828d6f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.352+0000 7f814ce9a700 1 -- 172.21.15.26:0/1089354225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5baf0 msgr2=0x55a828d67b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.352+0000 7f814ce9a700 1 --2- 172.21.15.26:0/1089354225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5baf0 0x55a828d67b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.352+0000 7f814ce9a700 1 -- 172.21.15.26:0/1089354225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a828d5ab20 con 0x55a828d5a470 2023-12-01T01:04:17.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.352+0000 7f8147fff700 1 --2- 172.21.15.26:0/1089354225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 0x55a828d6f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.352+0000 7f814ce9a700 1 --2- 172.21.15.26:0/1089354225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5a470 0x55a828d59ee0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f813c000c00 tx=0x7f813c01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa46af716476547 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.352+0000 7f81337fe700 1 -- 172.21.15.26:0/1089354225 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c01d040 con 0x55a828d5a470 2023-12-01T01:04:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.352+0000 7f81337fe700 1 -- 172.21.15.26:0/1089354225 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f813c00beb0 con 0x55a828d5a470 2023-12-01T01:04:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.352+0000 7f81337fe700 1 -- 172.21.15.26:0/1089354225 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c004bd0 con 0x55a828d5a470 2023-12-01T01:04:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.353+0000 7f815b28eb80 1 -- 172.21.15.26:0/1089354225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5a470 msgr2=0x55a828d59ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.353+0000 7f815b28eb80 1 --2- 172.21.15.26:0/1089354225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5a470 0x55a828d59ee0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f813c000c00 tx=0x7f813c01a040 comp rx=0 tx=0).stop 2023-12-01T01:04:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.353+0000 7f815b28eb80 1 -- 172.21.15.26:0/1089354225 shutdown_connections 2023-12-01T01:04:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.353+0000 7f815b28eb80 1 --2- 172.21.15.26:0/1089354225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5baf0 0x55a828d67b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.353+0000 7f815b28eb80 1 --2- 172.21.15.26:0/1089354225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5a470 0x55a828d59ee0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.353+0000 7f815b28eb80 1 --2- 172.21.15.26:0/1089354225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5b170 0x55a828d6f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.353+0000 7f815b28eb80 1 -- 172.21.15.26:0/1089354225 >> 172.21.15.26:0/1089354225 conn(0x55a828cb9150 msgr2=0x55a828d61770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.353+0000 7f815b28eb80 1 -- 172.21.15.26:0/1089354225 shutdown_connections 2023-12-01T01:04:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.353+0000 7f815b28eb80 1 -- 172.21.15.26:0/1089354225 wait complete. 2023-12-01T01:04:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.353+0000 7f815b28eb80 1 -- start start 2023-12-01T01:04:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.353+0000 7f815b28eb80 1 Processor -- start 2023-12-01T01:04:17.359 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f815b28eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5a470 0x55a828d6c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f815b28eb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5b170 0x55a828d6c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f815b28eb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5baf0 0x55a828d6d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f815b28eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a828d6ddd0 con 0x55a828d5a470 2023-12-01T01:04:17.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f815b28eb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a828d6df40 con 0x55a828d5b170 2023-12-01T01:04:17.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f815b28eb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a828d6e100 con 0x55a828d5baf0 2023-12-01T01:04:17.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f815b28eb80 10 client.0 _ll_register_callbacks cb 0x7f8140095230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:17.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f814ce9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5a470 0x55a828d6c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f814ce9a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5a470 0x55a828d6c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55150/0 (socket says 172.21.15.26:55150) 2023-12-01T01:04:17.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f814ce9a700 1 -- 172.21.15.26:0/784256353 learned_addr learned my addr 172.21.15.26:0/784256353 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:17.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f8147fff700 1 --2- 172.21.15.26:0/784256353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5b170 0x55a828d6c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f814d69b700 1 --2- 172.21.15.26:0/784256353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5baf0 0x55a828d6d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f814ce9a700 1 -- 172.21.15.26:0/784256353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5baf0 msgr2=0x55a828d6d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:17.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f814ce9a700 1 --2- 172.21.15.26:0/784256353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5baf0 0x55a828d6d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f814ce9a700 1 -- 172.21.15.26:0/784256353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5b170 msgr2=0x55a828d6c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:17.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f814ce9a700 1 --2- 172.21.15.26:0/784256353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5b170 0x55a828d6c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f814ce9a700 1 -- 172.21.15.26:0/784256353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a828ad8e60 con 0x55a828d5a470 2023-12-01T01:04:17.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.354+0000 7f8147fff700 1 --2- 172.21.15.26:0/784256353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5b170 0x55a828d6c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:17.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.355+0000 7f814ce9a700 1 --2- 172.21.15.26:0/784256353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5a470 0x55a828d6c340 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f813c009350 tx=0x7f813c004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385e6b2b1c22b88c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:17.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.355+0000 7f8127fff700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:17.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.355+0000 7f8127fff700 1 -- 172.21.15.26:0/784256353 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c01d050 con 0x55a828d5a470 2023-12-01T01:04:17.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.355+0000 7f815b28eb80 1 -- 172.21.15.26:0/784256353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f813c01e040 con 0x55a828d5a470 2023-12-01T01:04:17.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.355+0000 7f8127fff700 1 -- 172.21.15.26:0/784256353 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f813c0050c0 con 0x55a828d5a470 2023-12-01T01:04:17.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.355+0000 7f8127fff700 1 -- 172.21.15.26:0/784256353 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f813c0052c0 con 0x55a828d5a470 2023-12-01T01:04:17.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.355+0000 7f815b28eb80 10 client.15372 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:17.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.355+0000 7f815b28eb80 1 -- 172.21.15.26:0/784256353 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55a828d66e40 con 0x55a828d5a470 2023-12-01T01:04:17.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.355+0000 7f8127fff700 1 -- 172.21.15.26:0/784256353 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f813c01e040 con 0x55a828d5a470 2023-12-01T01:04:17.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.355+0000 7f8127fff700 1 -- 172.21.15.26:0/784256353 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f813c00fd00 con 0x55a828d5a470 2023-12-01T01:04:17.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.355+0000 7f815b28eb80 10 client.15372 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:17.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.355+0000 7f815b28eb80 10 client.15372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:17.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.355+0000 7f815b28eb80 20 client.15372 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:17.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.355+0000 7f815b28eb80 1 --2- 172.21.15.26:0/784256353 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a828dc7570 0x55a828dc9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.355+0000 7f815b28eb80 4 client.15372 mds_command: new command op to 24509 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-01T01:04:17.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.355+0000 7f815b28eb80 1 -- 172.21.15.26:0/784256353 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a828ca3dc0 con 0x55a828dc7570 2023-12-01T01:04:17.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.356+0000 7f8147fff700 1 --2- 172.21.15.26:0/784256353 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a828dc7570 0x55a828dc9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.356+0000 7f8127fff700 10 client.15372 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:17.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.356+0000 7f8147fff700 1 --2- 172.21.15.26:0/784256353 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a828dc7570 0x55a828dc9960 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c6449316672d1c4 server_cookie=c603a8f49c874fc7 in_seq=0 out_seq=0 2023-12-01T01:04:17.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.357+0000 7f8127fff700 1 -- 172.21.15.26:0/784256353 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a828ca3dc0 con 0x55a828dc7570 2023-12-01T01:04:17.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.357+0000 7f8127fff700 10 client.15372 handle_command_reply: tid=0 2023-12-01T01:04:17.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.357+0000 7f815b28eb80 1 client.15372 shutdown 2023-12-01T01:04:17.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.357+0000 7f815b28eb80 1 -- 172.21.15.26:0/784256353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5a470 msgr2=0x55a828d6c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.357+0000 7f815b28eb80 1 --2- 172.21.15.26:0/784256353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5a470 0x55a828d6c340 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f813c009350 tx=0x7f813c004950 comp rx=0 tx=0).stop 2023-12-01T01:04:17.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f815b28eb80 1 -- 172.21.15.26:0/784256353 shutdown_connections 2023-12-01T01:04:17.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f815b28eb80 1 --2- 172.21.15.26:0/784256353 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a828dc7570 0x55a828dc9960 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f815b28eb80 1 --2- 172.21.15.26:0/784256353 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a828d5baf0 0x55a828d6d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f815b28eb80 1 --2- 172.21.15.26:0/784256353 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a828d5a470 0x55a828d6c340 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f8127fff700 0 client.15372 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:17.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f815b28eb80 1 --2- 172.21.15.26:0/784256353 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a828d5b170 0x55a828d6c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f815b28eb80 1 -- 172.21.15.26:0/784256353 >> 172.21.15.26:0/784256353 conn(0x55a828cb9150 msgr2=0x55a828d67b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:17.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f815b28eb80 1 -- 172.21.15.26:0/784256353 shutdown_connections 2023-12-01T01:04:17.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f815b28eb80 1 -- 172.21.15.26:0/784256353 wait complete. 2023-12-01T01:04:17.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f815b28eb80 20 client.15372 trim_cache size 0 max 16384 2023-12-01T01:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout: "return_code": 0, 2023-12-01T01:04:17.365 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_tag": "80fdf2b5-f29f-47a4-b916-55311d44569b", 2023-12-01T01:04:17.366 INFO:teuthology.orchestra.run.smithi026.stdout: "mode": "asynchronous" 2023-12-01T01:04:17.366 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:04:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f814f0fe700 1 -- 172.21.15.26:0/2742362598 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81380a0520 msgr2=0x7f81380a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f814f0fe700 1 --2- 172.21.15.26:0/2742362598 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81380a0520 0x7f81380a29e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8134005d90 tx=0x7f81340096c0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f814f0fe700 1 -- 172.21.15.26:0/2742362598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8148101340 msgr2=0x7f814819dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f814f0fe700 1 --2- 172.21.15.26:0/2742362598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8148101340 0x7f814819dee0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f814000ef30 tx=0x7f814000c3a0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f814f0fe700 1 -- 172.21.15.26:0/2742362598 shutdown_connections 2023-12-01T01:04:17.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f814f0fe700 1 --2- 172.21.15.26:0/2742362598 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f81380a0520 0x7f81380a29e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f814f0fe700 1 --2- 172.21.15.26:0/2742362598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8148101340 0x7f814819dee0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f814f0fe700 1 --2- 172.21.15.26:0/2742362598 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f81480fff00 0x7f81480ff980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f814f0fe700 1 --2- 172.21.15.26:0/2742362598 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f81481008c0 0x7f814819b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.358+0000 7f814f0fe700 1 -- 172.21.15.26:0/2742362598 >> 172.21.15.26:0/2742362598 conn(0x7f81480fa9b0 msgr2=0x7f81480fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:17.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.359+0000 7f814f0fe700 1 -- 172.21.15.26:0/2742362598 shutdown_connections 2023-12-01T01:04:17.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.359+0000 7f814f0fe700 1 -- 172.21.15.26:0/2742362598 wait complete. 2023-12-01T01:04:17.373 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-01T01:04:17.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.540+0000 7faf02253700 1 -- 172.21.15.26:0/2536933034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faefc106a60 msgr2=0x7faefc108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.540+0000 7faf02253700 1 --2- 172.21.15.26:0/2536933034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faefc106a60 0x7faefc108ed0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7faef400b0a0 tx=0x7faef400b3b0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.540+0000 7faf02253700 1 -- 172.21.15.26:0/2536933034 shutdown_connections 2023-12-01T01:04:17.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.540+0000 7faf02253700 1 --2- 172.21.15.26:0/2536933034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faefc106a60 0x7faefc108ed0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.540+0000 7faf02253700 1 --2- 172.21.15.26:0/2536933034 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faefc101800 0x7faefc103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.540+0000 7faf02253700 1 --2- 172.21.15.26:0/2536933034 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faefc104130 0x7faefc106520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.540+0000 7faf02253700 1 -- 172.21.15.26:0/2536933034 >> 172.21.15.26:0/2536933034 conn(0x7faefc0fb1f0 msgr2=0x7faefc0fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.540+0000 7faf02253700 1 -- 172.21.15.26:0/2536933034 shutdown_connections 2023-12-01T01:04:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.540+0000 7faf02253700 1 -- 172.21.15.26:0/2536933034 wait complete. 2023-12-01T01:04:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faf02253700 1 Processor -- start 2023-12-01T01:04:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faf02253700 1 -- start start 2023-12-01T01:04:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faf02253700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faefc101800 0x7faefc198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faf02253700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faefc104130 0x7faefc1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faf02253700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faefc106a60 0x7faefc1a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faf02253700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc1a0a00 con 0x7faefc101800 2023-12-01T01:04:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faf02253700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc1a0b40 con 0x7faefc104130 2023-12-01T01:04:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faf02253700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faefc1a0cd0 con 0x7faefc106a60 2023-12-01T01:04:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faefb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faefc101800 0x7faefc198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.544 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faefb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faefc101800 0x7faefc198e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55164/0 (socket says 172.21.15.26:55164) 2023-12-01T01:04:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faefb7fe700 1 -- 172.21.15.26:0/2740140221 learned_addr learned my addr 172.21.15.26:0/2740140221 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faefbfff700 1 --2- 172.21.15.26:0/2740140221 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faefc106a60 0x7faefc1a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faefaffd700 1 --2- 172.21.15.26:0/2740140221 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faefc104130 0x7faefc1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faefb7fe700 1 -- 172.21.15.26:0/2740140221 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faefc106a60 msgr2=0x7faefc1a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faefb7fe700 1 --2- 172.21.15.26:0/2740140221 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faefc106a60 0x7faefc1a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faefb7fe700 1 -- 172.21.15.26:0/2740140221 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faefc104130 msgr2=0x7faefc1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faefb7fe700 1 --2- 172.21.15.26:0/2740140221 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faefc104130 0x7faefc1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faefb7fe700 1 -- 172.21.15.26:0/2740140221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef4009d00 con 0x7faefc101800 2023-12-01T01:04:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faefbfff700 1 --2- 172.21.15.26:0/2740140221 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faefc106a60 0x7faefc1a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.541+0000 7faefaffd700 1 --2- 172.21.15.26:0/2740140221 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faefc104130 0x7faefc1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.542+0000 7faefb7fe700 1 --2- 172.21.15.26:0/2740140221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faefc101800 0x7faefc198e80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7faee400d980 tx=0x7faee400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.542+0000 7faef8ff9700 1 -- 172.21.15.26:0/2740140221 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee400bb60 con 0x7faefc101800 2023-12-01T01:04:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.542+0000 7faef8ff9700 1 -- 172.21.15.26:0/2740140221 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faee4007640 con 0x7faefc101800 2023-12-01T01:04:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.542+0000 7faf02253700 1 -- 172.21.15.26:0/2740140221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faefc1a0fb0 con 0x7faefc101800 2023-12-01T01:04:17.545 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.542+0000 7faef8ff9700 1 -- 172.21.15.26:0/2740140221 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4005020 con 0x7faefc101800 2023-12-01T01:04:17.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.542+0000 7faf02253700 1 -- 172.21.15.26:0/2740140221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc1a13e0 con 0x7faefc101800 2023-12-01T01:04:17.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.544+0000 7faef8ff9700 1 -- 172.21.15.26:0/2740140221 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7faee4004020 con 0x7faefc101800 2023-12-01T01:04:17.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.544+0000 7faef8ff9700 1 --2- 172.21.15.26:0/2740140221 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7faee80a05a0 0x7faee80a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.545+0000 7faef8ff9700 1 -- 172.21.15.26:0/2740140221 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7faee40cb860 con 0x7faefc101800 2023-12-01T01:04:17.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.545+0000 7faefaffd700 1 --2- 172.21.15.26:0/2740140221 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7faee80a05a0 0x7faee80a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.545+0000 7faefaffd700 1 --2- 172.21.15.26:0/2740140221 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7faee80a05a0 0x7faee80a2a60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faeec009b50 tx=0x7faeec009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:17.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.545+0000 7faf0e3e3b80 1 Processor -- start 2023-12-01T01:04:17.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.545+0000 7faf0e3e3b80 1 -- start start 2023-12-01T01:04:17.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.545+0000 7faf0e3e3b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a540f0 0x55f590a54530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faf0e3e3b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a54a70 0x55f590a52e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faf0e3e3b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a533f0 0x55f590a53870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faf0e3e3b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5909aaa10 con 0x55f590a540f0 2023-12-01T01:04:17.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faf0e3e3b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5909a83d0 con 0x55f590a54a70 2023-12-01T01:04:17.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faf0e3e3b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5909a3cc0 con 0x55f590a533f0 2023-12-01T01:04:17.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faefb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a540f0 0x55f590a54530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faefb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a540f0 0x55f590a54530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55172/0 (socket says 172.21.15.26:55172) 2023-12-01T01:04:17.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faefb7fe700 1 -- 172.21.15.26:0/191037225 learned_addr learned my addr 172.21.15.26:0/191037225 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:17.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faefbfff700 1 --2- 172.21.15.26:0/191037225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a533f0 0x55f590a53870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faefaffd700 1 --2- 172.21.15.26:0/191037225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a54a70 0x55f590a52e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faefb7fe700 1 -- 172.21.15.26:0/191037225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a533f0 msgr2=0x55f590a53870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:17.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faefb7fe700 1 --2- 172.21.15.26:0/191037225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a533f0 0x55f590a53870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faefb7fe700 1 -- 172.21.15.26:0/191037225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a54a70 msgr2=0x55f590a52e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:17.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faefb7fe700 1 --2- 172.21.15.26:0/191037225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a54a70 0x55f590a52e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faefb7fe700 1 -- 172.21.15.26:0/191037225 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5907d1de0 con 0x55f590a540f0 2023-12-01T01:04:17.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faefb7fe700 1 --2- 172.21.15.26:0/191037225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a540f0 0x55f590a54530 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7faee40a0bb0 tx=0x7faee400de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76b2bfffc82150b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:17.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faef1ffb700 1 -- 172.21.15.26:0/191037225 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4099770 con 0x55f590a540f0 2023-12-01T01:04:17.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faef1ffb700 1 -- 172.21.15.26:0/191037225 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faee4099070 con 0x55f590a540f0 2023-12-01T01:04:17.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.546+0000 7faef1ffb700 1 -- 172.21.15.26:0/191037225 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee4099530 con 0x55f590a540f0 2023-12-01T01:04:17.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.547+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/191037225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a540f0 msgr2=0x55f590a54530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.547+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/191037225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a540f0 0x55f590a54530 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7faee40a0bb0 tx=0x7faee400de60 comp rx=0 tx=0).stop 2023-12-01T01:04:17.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.547+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/191037225 shutdown_connections 2023-12-01T01:04:17.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.547+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/191037225 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a533f0 0x55f590a53870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.547+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/191037225 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a540f0 0x55f590a54530 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.547+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/191037225 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a54a70 0x55f590a52e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.547+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/191037225 >> 172.21.15.26:0/191037225 conn(0x55f5909b20d0 msgr2=0x55f590a4d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:17.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.547+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/191037225 shutdown_connections 2023-12-01T01:04:17.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.547+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/191037225 wait complete. 2023-12-01T01:04:17.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.547+0000 7faf0e3e3b80 1 -- start start 2023-12-01T01:04:17.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faf0e3e3b80 1 Processor -- start 2023-12-01T01:04:17.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faf0e3e3b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a533f0 0x55f590a5ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faf0e3e3b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a540f0 0x55f590a5cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faf0e3e3b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a54a70 0x55f590a63fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faf0e3e3b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f590940510 con 0x55f590a540f0 2023-12-01T01:04:17.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faf0e3e3b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5909401b0 con 0x55f590a54a70 2023-12-01T01:04:17.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faf0e3e3b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f590827920 con 0x55f590a533f0 2023-12-01T01:04:17.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faf0e3e3b80 10 client.0 _ll_register_callbacks cb 0x55f59088da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:17.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faefaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a540f0 0x55f590a5cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faefaffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a540f0 0x55f590a5cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55180/0 (socket says 172.21.15.26:55180) 2023-12-01T01:04:17.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faefaffd700 1 -- 172.21.15.26:0/411811644 learned_addr learned my addr 172.21.15.26:0/411811644 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:17.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faefb7fe700 1 --2- 172.21.15.26:0/411811644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a533f0 0x55f590a5ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faefbfff700 1 --2- 172.21.15.26:0/411811644 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a54a70 0x55f590a63fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faefaffd700 1 -- 172.21.15.26:0/411811644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a533f0 msgr2=0x55f590a5ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:17.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faefaffd700 1 --2- 172.21.15.26:0/411811644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a533f0 0x55f590a5ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faefaffd700 1 -- 172.21.15.26:0/411811644 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a54a70 msgr2=0x55f590a63fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:17.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faefaffd700 1 --2- 172.21.15.26:0/411811644 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a54a70 0x55f590a63fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.548+0000 7faefaffd700 1 -- 172.21.15.26:0/411811644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faefc1a13e0 con 0x55f590a540f0 2023-12-01T01:04:17.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.549+0000 7faefaffd700 1 --2- 172.21.15.26:0/411811644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a540f0 0x55f590a5cf90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7faeec009930 tx=0x7faeec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe6f4bf60037b60 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:17.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.549+0000 7faedaffd700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:17.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.549+0000 7faedaffd700 1 -- 172.21.15.26:0/411811644 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec004a30 con 0x55f590a540f0 2023-12-01T01:04:17.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.549+0000 7faedaffd700 1 -- 172.21.15.26:0/411811644 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7faeec004b90 con 0x55f590a540f0 2023-12-01T01:04:17.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.549+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/411811644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f5909ced10 con 0x55f590a540f0 2023-12-01T01:04:17.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.549+0000 7faedaffd700 1 -- 172.21.15.26:0/411811644 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7faeec004d50 con 0x55f590a540f0 2023-12-01T01:04:17.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.549+0000 7faf0e3e3b80 10 client.15384 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:17.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.549+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/411811644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55f5907bac60 con 0x55f590a540f0 2023-12-01T01:04:17.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.549+0000 7faedaffd700 1 -- 172.21.15.26:0/411811644 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55f5909ced10 con 0x55f590a540f0 2023-12-01T01:04:17.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.549+0000 7faedaffd700 1 -- 172.21.15.26:0/411811644 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7faeec01fa40 con 0x55f590a540f0 2023-12-01T01:04:17.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.549+0000 7faf0e3e3b80 10 client.15384 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:17.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.549+0000 7faf0e3e3b80 10 client.15384 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:17.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.549+0000 7faf0e3e3b80 20 client.15384 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:17.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.549+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/411811644 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f590a687d0 0x55f590a6abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.549+0000 7faf0e3e3b80 4 client.15384 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:04:17.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.549+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/411811644 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f590a21e10 con 0x55f590a687d0 2023-12-01T01:04:17.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.550+0000 7faefb7fe700 1 --2- 172.21.15.26:0/411811644 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f590a687d0 0x55f590a6abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.550+0000 7faedaffd700 10 client.15384 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:17.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.550+0000 7faefb7fe700 1 --2- 172.21.15.26:0/411811644 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f590a687d0 0x55f590a6abf0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8857c6d8544ba34 server_cookie=fe9b40d20b104ba6 in_seq=0 out_seq=0 2023-12-01T01:04:17.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.551+0000 7faedaffd700 1 -- 172.21.15.26:0/411811644 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55f590a21e10 con 0x55f590a687d0 2023-12-01T01:04:17.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.551+0000 7faedaffd700 10 client.15384 handle_command_reply: tid=0 2023-12-01T01:04:17.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.551+0000 7faf0e3e3b80 1 client.15384 shutdown 2023-12-01T01:04:17.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.551+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/411811644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a540f0 msgr2=0x55f590a5cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.551+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/411811644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a540f0 0x55f590a5cf90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7faeec009930 tx=0x7faeec004750 comp rx=0 tx=0).stop 2023-12-01T01:04:17.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.551+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/411811644 shutdown_connections 2023-12-01T01:04:17.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.551+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/411811644 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f590a687d0 0x55f590a6abf0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.551+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/411811644 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a54a70 0x55f590a63fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.551+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/411811644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a533f0 0x55f590a5ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.551+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/411811644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a540f0 0x55f590a5cf90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.551+0000 7faedaffd700 0 client.15384 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:17.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.551+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/411811644 >> 172.21.15.26:0/411811644 conn(0x55f5909b20d0 msgr2=0x55f590a4d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:17.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.551+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/411811644 shutdown_connections 2023-12-01T01:04:17.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.551+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/411811644 wait complete. 2023-12-01T01:04:17.558 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.551+0000 7faf0e3e3b80 20 client.15384 trim_cache size 0 max 16384 2023-12-01T01:04:17.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.568+0000 7faf0e3e3b80 1 Processor -- start 2023-12-01T01:04:17.575 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faf0e3e3b80 1 -- start start 2023-12-01T01:04:17.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faf0e3e3b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a533f0 0x55f590a52e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faf0e3e3b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a540f0 0x55f590a61f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faf0e3e3b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a54a70 0x55f590a648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faf0e3e3b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5909ced10 con 0x55f590a533f0 2023-12-01T01:04:17.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faf0e3e3b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f590a5bf00 con 0x55f590a540f0 2023-12-01T01:04:17.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faf0e3e3b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f590a5c5c0 con 0x55f590a54a70 2023-12-01T01:04:17.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faefb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a533f0 0x55f590a52e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faefb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a533f0 0x55f590a52e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55186/0 (socket says 172.21.15.26:55186) 2023-12-01T01:04:17.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faefb7fe700 1 -- 172.21.15.26:0/269331252 learned_addr learned my addr 172.21.15.26:0/269331252 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:17.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faefbfff700 1 --2- 172.21.15.26:0/269331252 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a54a70 0x55f590a648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faefaffd700 1 --2- 172.21.15.26:0/269331252 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a540f0 0x55f590a61f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faefb7fe700 1 -- 172.21.15.26:0/269331252 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a54a70 msgr2=0x55f590a648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:17.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faefb7fe700 1 --2- 172.21.15.26:0/269331252 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a54a70 0x55f590a648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.576 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faefb7fe700 1 -- 172.21.15.26:0/269331252 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a540f0 msgr2=0x55f590a61f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:17.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faefb7fe700 1 --2- 172.21.15.26:0/269331252 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a540f0 0x55f590a61f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faefb7fe700 1 -- 172.21.15.26:0/269331252 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5907f8250 con 0x55f590a533f0 2023-12-01T01:04:17.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faefaffd700 1 --2- 172.21.15.26:0/269331252 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a540f0 0x55f590a61f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:17.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faefb7fe700 1 --2- 172.21.15.26:0/269331252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a533f0 0x55f590a52e60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7faee4095ae0 tx=0x7faee40ae040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dd1192efe55ab01 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:17.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.569+0000 7faef27fc700 1 -- 172.21.15.26:0/269331252 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee40b7040 con 0x55f590a533f0 2023-12-01T01:04:17.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.570+0000 7faef27fc700 1 -- 172.21.15.26:0/269331252 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faee409cea0 con 0x55f590a533f0 2023-12-01T01:04:17.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.570+0000 7faef27fc700 1 -- 172.21.15.26:0/269331252 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee40992d0 con 0x55f590a533f0 2023-12-01T01:04:17.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.570+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/269331252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a533f0 msgr2=0x55f590a52e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.570+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/269331252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a533f0 0x55f590a52e60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7faee4095ae0 tx=0x7faee40ae040 comp rx=0 tx=0).stop 2023-12-01T01:04:17.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.570+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/269331252 shutdown_connections 2023-12-01T01:04:17.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.570+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/269331252 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a54a70 0x55f590a648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.570+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/269331252 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a533f0 0x55f590a52e60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.570+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/269331252 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a540f0 0x55f590a61f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.570+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/269331252 >> 172.21.15.26:0/269331252 conn(0x55f5909b20d0 msgr2=0x55f590a5b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:17.577 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.570+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/269331252 shutdown_connections 2023-12-01T01:04:17.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.570+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/269331252 wait complete. 2023-12-01T01:04:17.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.570+0000 7faf0e3e3b80 1 -- start start 2023-12-01T01:04:17.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faf0e3e3b80 1 Processor -- start 2023-12-01T01:04:17.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faf0e3e3b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a533f0 0x55f590ab24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faf0e3e3b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a540f0 0x55f590ab2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faf0e3e3b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a54a70 0x55f590ab9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faf0e3e3b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f590ab9a90 con 0x55f590a533f0 2023-12-01T01:04:17.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faf0e3e3b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f590ab9bd0 con 0x55f590a540f0 2023-12-01T01:04:17.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faf0e3e3b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f590ab9d60 con 0x55f590a54a70 2023-12-01T01:04:17.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faf0e3e3b80 10 client.0 _ll_register_callbacks cb 0x7faeec00ee80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:17.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faefb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a533f0 0x55f590ab24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faefb7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a533f0 0x55f590ab24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55192/0 (socket says 172.21.15.26:55192) 2023-12-01T01:04:17.578 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faefb7fe700 1 -- 172.21.15.26:0/1383417110 learned_addr learned my addr 172.21.15.26:0/1383417110 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:17.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faefbfff700 1 --2- 172.21.15.26:0/1383417110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a54a70 0x55f590ab9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faefb7fe700 1 -- 172.21.15.26:0/1383417110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a54a70 msgr2=0x55f590ab9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:17.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faefb7fe700 1 --2- 172.21.15.26:0/1383417110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a54a70 0x55f590ab9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faefb7fe700 1 -- 172.21.15.26:0/1383417110 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a540f0 msgr2=0x55f590ab2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:17.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faefb7fe700 1 --2- 172.21.15.26:0/1383417110 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a540f0 0x55f590ab2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faefb7fe700 1 -- 172.21.15.26:0/1383417110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f5907d1de0 con 0x55f590a533f0 2023-12-01T01:04:17.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.571+0000 7faefb7fe700 1 --2- 172.21.15.26:0/1383417110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a533f0 0x55f590ab24f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7faee400b540 tx=0x7faee40a1240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30272b51f680c0f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:17.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.572+0000 7faedaffd700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:17.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.572+0000 7faedaffd700 1 -- 172.21.15.26:0/1383417110 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee40b7040 con 0x55f590a533f0 2023-12-01T01:04:17.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.572+0000 7faedaffd700 1 -- 172.21.15.26:0/1383417110 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7faee40b5040 con 0x55f590a533f0 2023-12-01T01:04:17.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.572+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/1383417110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faee4099070 con 0x55f590a533f0 2023-12-01T01:04:17.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.572+0000 7faedaffd700 1 -- 172.21.15.26:0/1383417110 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7faee4097410 con 0x55f590a533f0 2023-12-01T01:04:17.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.572+0000 7faf0e3e3b80 10 client.15390 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:17.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.572+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/1383417110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55f5907d02b0 con 0x55f590a533f0 2023-12-01T01:04:17.579 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.572+0000 7faedaffd700 1 -- 172.21.15.26:0/1383417110 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7faee4099070 con 0x55f590a533f0 2023-12-01T01:04:17.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.572+0000 7faedaffd700 1 -- 172.21.15.26:0/1383417110 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7faee40a0c50 con 0x55f590a533f0 2023-12-01T01:04:17.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.572+0000 7faf0e3e3b80 10 client.15390 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:17.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.572+0000 7faf0e3e3b80 10 client.15390 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:17.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.572+0000 7faf0e3e3b80 20 client.15390 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:17.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.572+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/1383417110 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f590abb270 0x55f590abd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:17.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.572+0000 7faf0e3e3b80 4 client.15390 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-01T01:04:17.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.572+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/1383417110 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f59099cd40 con 0x55f590abb270 2023-12-01T01:04:17.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.572+0000 7faefaffd700 1 --2- 172.21.15.26:0/1383417110 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f590abb270 0x55f590abd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:17.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faedaffd700 10 client.15390 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:17.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faefaffd700 1 --2- 172.21.15.26:0/1383417110 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f590abb270 0x55f590abd690 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cdd379bab685d5c server_cookie=fbf4e17aa42ef323 in_seq=0 out_seq=0 2023-12-01T01:04:17.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faedaffd700 1 -- 172.21.15.26:0/1383417110 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f59099cd40 con 0x55f590abb270 2023-12-01T01:04:17.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faedaffd700 10 client.15390 handle_command_reply: tid=0 2023-12-01T01:04:17.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faf0e3e3b80 1 client.15390 shutdown 2023-12-01T01:04:17.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/1383417110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a533f0 msgr2=0x55f590ab24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.580 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/1383417110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a533f0 0x55f590ab24f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7faee400b540 tx=0x7faee40a1240 comp rx=0 tx=0).stop 2023-12-01T01:04:17.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/1383417110 shutdown_connections 2023-12-01T01:04:17.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/1383417110 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f590abb270 0x55f590abd690 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/1383417110 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f590a54a70 0x55f590ab9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faedaffd700 0 client.15390 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:17.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/1383417110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f590a533f0 0x55f590ab24f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faf0e3e3b80 1 --2- 172.21.15.26:0/1383417110 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f590a540f0 0x55f590ab2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/1383417110 >> 172.21.15.26:0/1383417110 conn(0x55f5909b20d0 msgr2=0x55f590a648c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:17.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/1383417110 shutdown_connections 2023-12-01T01:04:17.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faf0e3e3b80 1 -- 172.21.15.26:0/1383417110 wait complete. 2023-12-01T01:04:17.581 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.573+0000 7faf0e3e3b80 20 client.15390 trim_cache size 0 max 16384 2023-12-01T01:04:17.581 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:04:17.582 INFO:teuthology.orchestra.run.smithi026.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-01T01:04:17.582 INFO:teuthology.orchestra.run.smithi026.stdout: "scrubs": { 2023-12-01T01:04:17.582 INFO:teuthology.orchestra.run.smithi026.stdout: "80fdf2b5-f29f-47a4-b916-55311d44569b": { 2023-12-01T01:04:17.582 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/", 2023-12-01T01:04:17.582 INFO:teuthology.orchestra.run.smithi026.stdout: "tag": "80fdf2b5-f29f-47a4-b916-55311d44569b", 2023-12-01T01:04:17.582 INFO:teuthology.orchestra.run.smithi026.stdout: "options": "recursive,force" 2023-12-01T01:04:17.582 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:04:17.582 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:04:17.582 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:04:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.574+0000 7faf02253700 1 -- 172.21.15.26:0/2740140221 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7faee80a05a0 msgr2=0x7faee80a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.574+0000 7faf02253700 1 --2- 172.21.15.26:0/2740140221 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7faee80a05a0 0x7faee80a2a60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7faeec009b50 tx=0x7faeec009550 comp rx=0 tx=0).stop 2023-12-01T01:04:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.574+0000 7faf02253700 1 -- 172.21.15.26:0/2740140221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faefc101800 msgr2=0x7faefc198e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.574+0000 7faf02253700 1 --2- 172.21.15.26:0/2740140221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faefc101800 0x7faefc198e80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7faee400d980 tx=0x7faee400dd40 comp rx=0 tx=0).stop 2023-12-01T01:04:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.574+0000 7faf02253700 1 -- 172.21.15.26:0/2740140221 shutdown_connections 2023-12-01T01:04:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.574+0000 7faf02253700 1 --2- 172.21.15.26:0/2740140221 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7faee80a05a0 0x7faee80a2a60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.574+0000 7faf02253700 1 --2- 172.21.15.26:0/2740140221 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7faefc106a60 0x7faefc1a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.574+0000 7faf02253700 1 --2- 172.21.15.26:0/2740140221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faefc101800 0x7faefc198e80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.574+0000 7faf02253700 1 --2- 172.21.15.26:0/2740140221 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faefc104130 0x7faefc1993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.574+0000 7faf02253700 1 -- 172.21.15.26:0/2740140221 >> 172.21.15.26:0/2740140221 conn(0x7faefc0fb1f0 msgr2=0x7faefc0ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:17.583 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.574+0000 7faf02253700 1 -- 172.21.15.26:0/2740140221 shutdown_connections 2023-12-01T01:04:17.584 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:17.574+0000 7faf02253700 1 -- 172.21.15.26:0/2740140221 wait complete. 2023-12-01T01:04:17.587 INFO:tasks.cephfs.filesystem:scrub status for tag:80fdf2b5-f29f-47a4-b916-55311d44569b - {'path': '/', 'tag': '80fdf2b5-f29f-47a4-b916-55311d44569b', 'options': 'recursive,force'} 2023-12-01T01:04:18.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:17 smithi116 ceph-mon[103554]: pgmap v292: 97 pgs: 97 active+clean; 645 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 6 op/s 2023-12-01T01:04:18.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:17 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3661768875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:18.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:17 smithi093 ceph-mon[103327]: pgmap v292: 97 pgs: 97 active+clean; 645 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 6 op/s 2023-12-01T01:04:18.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:17 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3661768875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:18.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:17 smithi026 ceph-mon[98801]: pgmap v292: 97 pgs: 97 active+clean; 645 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 6 op/s 2023-12-01T01:04:18.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:17 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3661768875' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:04:19.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:18 smithi116 ceph-mon[103554]: scrub queued for path: / 2023-12-01T01:04:19.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:18 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:04:19.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:18 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:04:19.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:18 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:04:19.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:18 smithi093 ceph-mon[103327]: scrub queued for path: / 2023-12-01T01:04:19.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:18 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:04:19.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:18 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:04:19.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:18 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:04:19.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:18 smithi026 ceph-mon[98801]: scrub queued for path: / 2023-12-01T01:04:19.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:18 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:04:19.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:18 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:04:19.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:18 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:04:20.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:19 smithi116 ceph-mon[103554]: pgmap v293: 97 pgs: 97 active+clean; 645 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-12-01T01:04:20.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:19 smithi093 ceph-mon[103327]: pgmap v293: 97 pgs: 97 active+clean; 645 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-12-01T01:04:20.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:19 smithi026 ceph-mon[98801]: pgmap v293: 97 pgs: 97 active+clean; 645 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 6 op/s 2023-12-01T01:04:22.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:21 smithi116 ceph-mon[103554]: pgmap v294: 97 pgs: 97 active+clean; 645 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2023-12-01T01:04:22.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:21 smithi116 ceph-mon[103554]: scrub summary: idle 2023-12-01T01:04:22.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:21 smithi093 ceph-mon[103327]: pgmap v294: 97 pgs: 97 active+clean; 645 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2023-12-01T01:04:22.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:21 smithi093 ceph-mon[103327]: scrub summary: idle 2023-12-01T01:04:22.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:21 smithi026 ceph-mon[98801]: pgmap v294: 97 pgs: 97 active+clean; 645 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 853 B/s wr, 6 op/s 2023-12-01T01:04:22.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:21 smithi026 ceph-mon[98801]: scrub summary: idle 2023-12-01T01:04:24.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:23 smithi116 ceph-mon[103554]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-12-01T01:04:24.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:23 smithi093 ceph-mon[103327]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-12-01T01:04:24.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:23 smithi026 ceph-mon[98801]: pgmap v295: 97 pgs: 97 active+clean; 645 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-12-01T01:04:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:25 smithi116 ceph-mon[103554]: pgmap v296: 97 pgs: 97 active+clean; 650 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2023-12-01T01:04:26.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:25 smithi093 ceph-mon[103327]: pgmap v296: 97 pgs: 97 active+clean; 650 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2023-12-01T01:04:26.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:25 smithi026 ceph-mon[98801]: pgmap v296: 97 pgs: 97 active+clean; 650 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2023-12-01T01:04:28.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:27 smithi116 ceph-mon[103554]: pgmap v297: 97 pgs: 97 active+clean; 650 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 7 op/s 2023-12-01T01:04:28.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:27 smithi093 ceph-mon[103327]: pgmap v297: 97 pgs: 97 active+clean; 650 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 7 op/s 2023-12-01T01:04:28.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:27 smithi026 ceph-mon[98801]: pgmap v297: 97 pgs: 97 active+clean; 650 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1023 B/s wr, 7 op/s 2023-12-01T01:04:30.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:29 smithi116 ceph-mon[103554]: pgmap v298: 97 pgs: 97 active+clean; 650 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 7 op/s 2023-12-01T01:04:30.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:29 smithi093 ceph-mon[103327]: pgmap v298: 97 pgs: 97 active+clean; 650 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 7 op/s 2023-12-01T01:04:30.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:29 smithi026 ceph-mon[98801]: pgmap v298: 97 pgs: 97 active+clean; 650 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 7 op/s 2023-12-01T01:04:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.341+0000 7fba2e0e4700 1 -- 172.21.15.26:0/908751345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba281041a0 msgr2=0x7fba28106590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.341+0000 7fba2e0e4700 1 --2- 172.21.15.26:0/908751345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba281041a0 0x7fba28106590 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fba14009990 tx=0x7fba14009ca0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.341+0000 7fba2e0e4700 1 -- 172.21.15.26:0/908751345 shutdown_connections 2023-12-01T01:04:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.341+0000 7fba2e0e4700 1 --2- 172.21.15.26:0/908751345 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba28106ad0 0x7fba28108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.344 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.341+0000 7fba2e0e4700 1 --2- 172.21.15.26:0/908751345 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba28101870 0x7fba28103c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.341+0000 7fba2e0e4700 1 --2- 172.21.15.26:0/908751345 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba281041a0 0x7fba28106590 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.341+0000 7fba2e0e4700 1 -- 172.21.15.26:0/908751345 >> 172.21.15.26:0/908751345 conn(0x7fba280fb1e0 msgr2=0x7fba280fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.341+0000 7fba2e0e4700 1 -- 172.21.15.26:0/908751345 shutdown_connections 2023-12-01T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.341+0000 7fba2e0e4700 1 -- 172.21.15.26:0/908751345 wait complete. 2023-12-01T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.341+0000 7fba2e0e4700 1 Processor -- start 2023-12-01T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba2e0e4700 1 -- start start 2023-12-01T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba2e0e4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba28101870 0x7fba28196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba2e0e4700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba281041a0 0x7fba281970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba2e0e4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba28106ad0 0x7fba28197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba2e0e4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba281985a0 con 0x7fba28101870 2023-12-01T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba2e0e4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba28198710 con 0x7fba28106ad0 2023-12-01T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba2e0e4700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba281988d0 con 0x7fba281041a0 2023-12-01T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba28101870 0x7fba28196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba28101870 0x7fba28196b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55204/0 (socket says 172.21.15.26:55204) 2023-12-01T01:04:30.345 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba277fe700 1 -- 172.21.15.26:0/2695994543 learned_addr learned my addr 172.21.15.26:0/2695994543 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba26ffd700 1 --2- 172.21.15.26:0/2695994543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba281041a0 0x7fba281970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba27fff700 1 --2- 172.21.15.26:0/2695994543 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba28106ad0 0x7fba28197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba277fe700 1 -- 172.21.15.26:0/2695994543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba281041a0 msgr2=0x7fba281970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba277fe700 1 --2- 172.21.15.26:0/2695994543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba281041a0 0x7fba281970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba277fe700 1 -- 172.21.15.26:0/2695994543 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba28106ad0 msgr2=0x7fba28197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba277fe700 1 --2- 172.21.15.26:0/2695994543 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba28106ad0 0x7fba28197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba277fe700 1 -- 172.21.15.26:0/2695994543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140095f0 con 0x7fba28101870 2023-12-01T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba26ffd700 1 --2- 172.21.15.26:0/2695994543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba281041a0 0x7fba281970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.342+0000 7fba27fff700 1 --2- 172.21.15.26:0/2695994543 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba28106ad0 0x7fba28197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.343+0000 7fba277fe700 1 --2- 172.21.15.26:0/2695994543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba28101870 0x7fba28196b80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fba1800c9b0 tx=0x7fba1800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.343+0000 7fba24ff9700 1 -- 172.21.15.26:0/2695994543 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18007b00 con 0x7fba28101870 2023-12-01T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.343+0000 7fba24ff9700 1 -- 172.21.15.26:0/2695994543 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fba18007c60 con 0x7fba28101870 2023-12-01T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.343+0000 7fba2e0e4700 1 -- 172.21.15.26:0/2695994543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba28198bb0 con 0x7fba28101870 2023-12-01T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.343+0000 7fba24ff9700 1 -- 172.21.15.26:0/2695994543 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18018730 con 0x7fba28101870 2023-12-01T01:04:30.346 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.343+0000 7fba2e0e4700 1 -- 172.21.15.26:0/2695994543 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2819f370 con 0x7fba28101870 2023-12-01T01:04:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.345+0000 7fba24ff9700 1 -- 172.21.15.26:0/2695994543 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fba18018890 con 0x7fba28101870 2023-12-01T01:04:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.346+0000 7fba24ff9700 1 --2- 172.21.15.26:0/2695994543 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fba0c0a0520 0x7fba0c0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.349 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.346+0000 7fba26ffd700 1 --2- 172.21.15.26:0/2695994543 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fba0c0a0520 0x7fba0c0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.346+0000 7fba24ff9700 1 -- 172.21.15.26:0/2695994543 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fba180cbaf0 con 0x7fba28101870 2023-12-01T01:04:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.346+0000 7fba26ffd700 1 --2- 172.21.15.26:0/2695994543 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fba0c0a0520 0x7fba0c0a29e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fba140036f0 tx=0x7fba14003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.346+0000 7fba3a274b80 1 Processor -- start 2023-12-01T01:04:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba3a274b80 1 -- start start 2023-12-01T01:04:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba3a274b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30680 0x561fcae30aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba3a274b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30fe0 0x561fcae318f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba3a274b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae31ed0 0x561fcae32350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba3a274b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcad889b0 con 0x561fcae30680 2023-12-01T01:04:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba3a274b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcad86370 con 0x561fcae31ed0 2023-12-01T01:04:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba3a274b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcad81c60 con 0x561fcae30fe0 2023-12-01T01:04:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30680 0x561fcae30aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba277fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30680 0x561fcae30aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55212/0 (socket says 172.21.15.26:55212) 2023-12-01T01:04:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba277fe700 1 -- 172.21.15.26:0/682866418 learned_addr learned my addr 172.21.15.26:0/682866418 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:30.350 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba26ffd700 1 --2- 172.21.15.26:0/682866418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30fe0 0x561fcae318f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba27fff700 1 --2- 172.21.15.26:0/682866418 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae31ed0 0x561fcae32350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba277fe700 1 -- 172.21.15.26:0/682866418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30fe0 msgr2=0x561fcae318f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba277fe700 1 --2- 172.21.15.26:0/682866418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30fe0 0x561fcae318f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba277fe700 1 -- 172.21.15.26:0/682866418 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae31ed0 msgr2=0x561fcae32350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba277fe700 1 --2- 172.21.15.26:0/682866418 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae31ed0 0x561fcae32350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba277fe700 1 -- 172.21.15.26:0/682866418 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fcabafd80 con 0x561fcae30680 2023-12-01T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.347+0000 7fba277fe700 1 --2- 172.21.15.26:0/682866418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30680 0x561fcae30aa0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fba180a0e40 tx=0x7fba18099a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c96838900d1568b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.348+0000 7fba1dffb700 1 -- 172.21.15.26:0/682866418 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba180b0070 con 0x561fcae30680 2023-12-01T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.348+0000 7fba1dffb700 1 -- 172.21.15.26:0/682866418 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fba180a1370 con 0x561fcae30680 2023-12-01T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.348+0000 7fba1dffb700 1 -- 172.21.15.26:0/682866418 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba180997c0 con 0x561fcae30680 2023-12-01T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.348+0000 7fba3a274b80 1 -- 172.21.15.26:0/682866418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30680 msgr2=0x561fcae30aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.348+0000 7fba3a274b80 1 --2- 172.21.15.26:0/682866418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30680 0x561fcae30aa0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fba180a0e40 tx=0x7fba18099a00 comp rx=0 tx=0).stop 2023-12-01T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.348+0000 7fba3a274b80 1 -- 172.21.15.26:0/682866418 shutdown_connections 2023-12-01T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.348+0000 7fba3a274b80 1 --2- 172.21.15.26:0/682866418 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae31ed0 0x561fcae32350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.351 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.348+0000 7fba3a274b80 1 --2- 172.21.15.26:0/682866418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30680 0x561fcae30aa0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.348+0000 7fba3a274b80 1 --2- 172.21.15.26:0/682866418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30fe0 0x561fcae318f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.348+0000 7fba3a274b80 1 -- 172.21.15.26:0/682866418 >> 172.21.15.26:0/682866418 conn(0x561fcad90070 msgr2=0x561fcae2d040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.348+0000 7fba3a274b80 1 -- 172.21.15.26:0/682866418 shutdown_connections 2023-12-01T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.348+0000 7fba3a274b80 1 -- 172.21.15.26:0/682866418 wait complete. 2023-12-01T01:04:30.352 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.349+0000 7fba3a274b80 1 -- start start 2023-12-01T01:04:30.356 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.349+0000 7fba3a274b80 1 Processor -- start 2023-12-01T01:04:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.349+0000 7fba3a274b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30680 0x561fcae3a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.349+0000 7fba3a274b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30fe0 0x561fcae3aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.349+0000 7fba3a274b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae31ed0 0x561fcae41a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.349+0000 7fba3a274b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcad1e4b0 con 0x561fcae30fe0 2023-12-01T01:04:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.349+0000 7fba3a274b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcad1e150 con 0x561fcae31ed0 2023-12-01T01:04:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.349+0000 7fba3a274b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcac058c0 con 0x561fcae30680 2023-12-01T01:04:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.349+0000 7fba3a274b80 10 client.0 _ll_register_callbacks cb 0x561fcac6ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba26ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30fe0 0x561fcae3aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba26ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30fe0 0x561fcae3aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55220/0 (socket says 172.21.15.26:55220) 2023-12-01T01:04:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba26ffd700 1 -- 172.21.15.26:0/243587999 learned_addr learned my addr 172.21.15.26:0/243587999 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba27fff700 1 --2- 172.21.15.26:0/243587999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae31ed0 0x561fcae41a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba277fe700 1 --2- 172.21.15.26:0/243587999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30680 0x561fcae3a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.357 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba26ffd700 1 -- 172.21.15.26:0/243587999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30680 msgr2=0x561fcae3a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba26ffd700 1 --2- 172.21.15.26:0/243587999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30680 0x561fcae3a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba26ffd700 1 -- 172.21.15.26:0/243587999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae31ed0 msgr2=0x561fcae41a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba26ffd700 1 --2- 172.21.15.26:0/243587999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae31ed0 0x561fcae41a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba26ffd700 1 -- 172.21.15.26:0/243587999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2819f370 con 0x561fcae30fe0 2023-12-01T01:04:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba27fff700 1 --2- 172.21.15.26:0/243587999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae31ed0 0x561fcae41a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba26ffd700 1 --2- 172.21.15.26:0/243587999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30fe0 0x561fcae3aa50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fba14009990 tx=0x7fba14009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9650fe06e56968c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba0affd700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba0affd700 1 -- 172.21.15.26:0/243587999 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1400b900 con 0x561fcae30fe0 2023-12-01T01:04:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba0affd700 1 -- 172.21.15.26:0/243587999 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fba14024820 con 0x561fcae30fe0 2023-12-01T01:04:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba3a274b80 1 -- 172.21.15.26:0/243587999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fcadaccb0 con 0x561fcae30fe0 2023-12-01T01:04:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba0affd700 1 -- 172.21.15.26:0/243587999 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba140249e0 con 0x561fcae30fe0 2023-12-01T01:04:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba3a274b80 10 client.15402 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba3a274b80 1 -- 172.21.15.26:0/243587999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x561fcab98c00 con 0x561fcae30fe0 2023-12-01T01:04:30.358 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.350+0000 7fba0affd700 1 -- 172.21.15.26:0/243587999 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x561fcadaccb0 con 0x561fcae30fe0 2023-12-01T01:04:30.361 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.351+0000 7fba0affd700 1 -- 172.21.15.26:0/243587999 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fba140173f0 con 0x561fcae30fe0 2023-12-01T01:04:30.361 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.351+0000 7fba3a274b80 10 client.15402 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:30.361 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.351+0000 7fba3a274b80 10 client.15402 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:30.361 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.351+0000 7fba3a274b80 20 client.15402 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.351+0000 7fba3a274b80 1 --2- 172.21.15.26:0/243587999 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x561fcae462e0 0x561fcae48700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.351+0000 7fba3a274b80 4 client.15402 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:04:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.351+0000 7fba3a274b80 1 -- 172.21.15.26:0/243587999 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fcadffdb0 con 0x561fcae462e0 2023-12-01T01:04:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.351+0000 7fba277fe700 1 --2- 172.21.15.26:0/243587999 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x561fcae462e0 0x561fcae48700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.351+0000 7fba0affd700 10 client.15402 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.351+0000 7fba277fe700 1 --2- 172.21.15.26:0/243587999 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x561fcae462e0 0x561fcae48700 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea0e3fb0f2b9be62 server_cookie=7b5231613508f16d in_seq=0 out_seq=0 2023-12-01T01:04:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.352+0000 7fba0affd700 1 -- 172.21.15.26:0/243587999 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x561fcadffdb0 con 0x561fcae462e0 2023-12-01T01:04:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.352+0000 7fba0affd700 10 client.15402 handle_command_reply: tid=0 2023-12-01T01:04:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.352+0000 7fba3a274b80 1 client.15402 shutdown 2023-12-01T01:04:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.352+0000 7fba3a274b80 1 -- 172.21.15.26:0/243587999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30fe0 msgr2=0x561fcae3aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.352+0000 7fba3a274b80 1 --2- 172.21.15.26:0/243587999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30fe0 0x561fcae3aa50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fba14009990 tx=0x7fba14009ca0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.352+0000 7fba3a274b80 1 -- 172.21.15.26:0/243587999 shutdown_connections 2023-12-01T01:04:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.352+0000 7fba3a274b80 1 --2- 172.21.15.26:0/243587999 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x561fcae462e0 0x561fcae48700 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.362 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.352+0000 7fba3a274b80 1 --2- 172.21.15.26:0/243587999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae31ed0 0x561fcae41a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.352+0000 7fba0affd700 0 client.15402 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.352+0000 7fba3a274b80 1 --2- 172.21.15.26:0/243587999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30680 0x561fcae3a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.352+0000 7fba3a274b80 1 --2- 172.21.15.26:0/243587999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30fe0 0x561fcae3aa50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.352+0000 7fba3a274b80 1 -- 172.21.15.26:0/243587999 >> 172.21.15.26:0/243587999 conn(0x561fcad90070 msgr2=0x561fcae2b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.352+0000 7fba3a274b80 1 -- 172.21.15.26:0/243587999 shutdown_connections 2023-12-01T01:04:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.352+0000 7fba3a274b80 1 -- 172.21.15.26:0/243587999 wait complete. 2023-12-01T01:04:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.352+0000 7fba3a274b80 20 client.15402 trim_cache size 0 max 16384 2023-12-01T01:04:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.367+0000 7fba3a274b80 1 Processor -- start 2023-12-01T01:04:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.367+0000 7fba3a274b80 1 -- start start 2023-12-01T01:04:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.367+0000 7fba3a274b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae30680 0x561fcae3fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.367+0000 7fba3a274b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30fe0 0x561fcae382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.367+0000 7fba3a274b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae31ed0 0x561fcae3a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.367+0000 7fba3a274b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcae399c0 con 0x561fcae31ed0 2023-12-01T01:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.367+0000 7fba3a274b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcae26500 con 0x561fcae30680 2023-12-01T01:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.367+0000 7fba3a274b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcae3a080 con 0x561fcae30fe0 2023-12-01T01:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.367+0000 7fba27fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae31ed0 0x561fcae3a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.367+0000 7fba27fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae31ed0 0x561fcae3a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55230/0 (socket says 172.21.15.26:55230) 2023-12-01T01:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.367+0000 7fba27fff700 1 -- 172.21.15.26:0/1480071120 learned_addr learned my addr 172.21.15.26:0/1480071120 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.367+0000 7fba277fe700 1 --2- 172.21.15.26:0/1480071120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae30680 0x561fcae3fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.368+0000 7fba26ffd700 1 --2- 172.21.15.26:0/1480071120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30fe0 0x561fcae382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.368+0000 7fba27fff700 1 -- 172.21.15.26:0/1480071120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30fe0 msgr2=0x561fcae382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.368+0000 7fba27fff700 1 --2- 172.21.15.26:0/1480071120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30fe0 0x561fcae382f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.368+0000 7fba27fff700 1 -- 172.21.15.26:0/1480071120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae30680 msgr2=0x561fcae3fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.368+0000 7fba27fff700 1 --2- 172.21.15.26:0/1480071120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae30680 0x561fcae3fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.368+0000 7fba27fff700 1 -- 172.21.15.26:0/1480071120 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fcabd61f0 con 0x561fcae31ed0 2023-12-01T01:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.368+0000 7fba27fff700 1 --2- 172.21.15.26:0/1480071120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae31ed0 0x561fcae3a510 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fba20009c90 tx=0x7fba20009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a200df8a46a6ef41 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.368+0000 7fba1e7fc700 1 -- 172.21.15.26:0/1480071120 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20007b80 con 0x561fcae31ed0 2023-12-01T01:04:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.368+0000 7fba1e7fc700 1 -- 172.21.15.26:0/1480071120 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fba2000f030 con 0x561fcae31ed0 2023-12-01T01:04:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.368+0000 7fba1e7fc700 1 -- 172.21.15.26:0/1480071120 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba200145b0 con 0x561fcae31ed0 2023-12-01T01:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.369+0000 7fba3a274b80 1 -- 172.21.15.26:0/1480071120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae31ed0 msgr2=0x561fcae3a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.369+0000 7fba3a274b80 1 --2- 172.21.15.26:0/1480071120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae31ed0 0x561fcae3a510 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fba20009c90 tx=0x7fba20009040 comp rx=0 tx=0).stop 2023-12-01T01:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.369+0000 7fba3a274b80 1 -- 172.21.15.26:0/1480071120 shutdown_connections 2023-12-01T01:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.369+0000 7fba3a274b80 1 --2- 172.21.15.26:0/1480071120 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae31ed0 0x561fcae3a510 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.369+0000 7fba3a274b80 1 --2- 172.21.15.26:0/1480071120 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae30680 0x561fcae3fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.369+0000 7fba3a274b80 1 --2- 172.21.15.26:0/1480071120 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30fe0 0x561fcae382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.369+0000 7fba3a274b80 1 -- 172.21.15.26:0/1480071120 >> 172.21.15.26:0/1480071120 conn(0x561fcad90070 msgr2=0x561fcae39130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.369+0000 7fba3a274b80 1 -- 172.21.15.26:0/1480071120 shutdown_connections 2023-12-01T01:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.369+0000 7fba3a274b80 1 -- 172.21.15.26:0/1480071120 wait complete. 2023-12-01T01:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.369+0000 7fba3a274b80 1 -- start start 2023-12-01T01:04:30.375 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.369+0000 7fba3a274b80 1 Processor -- start 2023-12-01T01:04:30.375 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba3a274b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30680 0x561fcae90000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.375 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba3a274b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30fe0 0x561fcae90540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.375 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba3a274b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae31ed0 0x561fcae96f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.375 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba3a274b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcae974d0 con 0x561fcae30fe0 2023-12-01T01:04:30.375 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba3a274b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcae97640 con 0x561fcae31ed0 2023-12-01T01:04:30.375 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba3a274b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fcae97800 con 0x561fcae30680 2023-12-01T01:04:30.375 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba3a274b80 10 client.0 _ll_register_callbacks cb 0x7fba1400f770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:30.375 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba26ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30fe0 0x561fcae90540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.375 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba26ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30fe0 0x561fcae90540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55234/0 (socket says 172.21.15.26:55234) 2023-12-01T01:04:30.375 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba26ffd700 1 -- 172.21.15.26:0/2073463663 learned_addr learned my addr 172.21.15.26:0/2073463663 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:30.375 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba277fe700 1 --2- 172.21.15.26:0/2073463663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30680 0x561fcae90000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.375 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba27fff700 1 --2- 172.21.15.26:0/2073463663 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae31ed0 0x561fcae96f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.375 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba26ffd700 1 -- 172.21.15.26:0/2073463663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30680 msgr2=0x561fcae90000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:30.376 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba26ffd700 1 --2- 172.21.15.26:0/2073463663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30680 0x561fcae90000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.376 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba26ffd700 1 -- 172.21.15.26:0/2073463663 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae31ed0 msgr2=0x561fcae96f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:30.376 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba26ffd700 1 --2- 172.21.15.26:0/2073463663 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae31ed0 0x561fcae96f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.376 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba26ffd700 1 -- 172.21.15.26:0/2073463663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba200098c0 con 0x561fcae30fe0 2023-12-01T01:04:30.376 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba26ffd700 1 --2- 172.21.15.26:0/2073463663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30fe0 0x561fcae90540 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fba140098e0 tx=0x7fba140059c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270e7c28b3b94891 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:30.376 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba0affd700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:30.376 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba0affd700 1 -- 172.21.15.26:0/2073463663 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140174f0 con 0x561fcae30fe0 2023-12-01T01:04:30.376 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba0affd700 1 -- 172.21.15.26:0/2073463663 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fba14024620 con 0x561fcae30fe0 2023-12-01T01:04:30.376 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.370+0000 7fba3a274b80 1 -- 172.21.15.26:0/2073463663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fba180a1370 con 0x561fcae30fe0 2023-12-01T01:04:30.376 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.371+0000 7fba0affd700 1 -- 172.21.15.26:0/2073463663 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba14017b40 con 0x561fcae30fe0 2023-12-01T01:04:30.376 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.371+0000 7fba3a274b80 10 client.15408 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:30.376 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.371+0000 7fba3a274b80 1 -- 172.21.15.26:0/2073463663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x561fcabae250 con 0x561fcae30fe0 2023-12-01T01:04:30.376 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.371+0000 7fba0affd700 1 -- 172.21.15.26:0/2073463663 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fba180a1370 con 0x561fcae30fe0 2023-12-01T01:04:30.376 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.371+0000 7fba0affd700 1 -- 172.21.15.26:0/2073463663 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fba14042030 con 0x561fcae30fe0 2023-12-01T01:04:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.371+0000 7fba3a274b80 10 client.15408 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.371+0000 7fba3a274b80 10 client.15408 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.371+0000 7fba3a274b80 20 client.15408 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.371+0000 7fba3a274b80 1 --2- 172.21.15.26:0/2073463663 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x561fcae98d40 0x561fcae9b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.371+0000 7fba3a274b80 4 client.15408 mds_command: new command op to 24509 tid=0[{"prefix": "flush journal"}] 2023-12-01T01:04:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.371+0000 7fba3a274b80 1 -- 172.21.15.26:0/2073463663 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561fcad7ace0 con 0x561fcae98d40 2023-12-01T01:04:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.371+0000 7fba277fe700 1 --2- 172.21.15.26:0/2073463663 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x561fcae98d40 0x561fcae9b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.372+0000 7fba0affd700 10 client.15408 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.372+0000 7fba277fe700 1 --2- 172.21.15.26:0/2073463663 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x561fcae98d40 0x561fcae9b160 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f91029cf44151618 server_cookie=6d85a8d68e0a4a17 in_seq=0 out_seq=0 2023-12-01T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.383+0000 7fba0affd700 1 -- 172.21.15.26:0/2073463663 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561fcad7ace0 con 0x561fcae98d40 2023-12-01T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.383+0000 7fba0affd700 10 client.15408 handle_command_reply: tid=0 2023-12-01T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.383+0000 7fba3a274b80 1 client.15408 shutdown 2023-12-01T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.383+0000 7fba3a274b80 1 -- 172.21.15.26:0/2073463663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30fe0 msgr2=0x561fcae90540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.383+0000 7fba3a274b80 1 --2- 172.21.15.26:0/2073463663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30fe0 0x561fcae90540 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fba140098e0 tx=0x7fba140059c0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.383+0000 7fba3a274b80 1 -- 172.21.15.26:0/2073463663 shutdown_connections 2023-12-01T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.383+0000 7fba3a274b80 1 --2- 172.21.15.26:0/2073463663 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x561fcae98d40 0x561fcae9b160 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.383+0000 7fba3a274b80 1 --2- 172.21.15.26:0/2073463663 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561fcae31ed0 0x561fcae96f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.383+0000 7fba3a274b80 1 --2- 172.21.15.26:0/2073463663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561fcae30680 0x561fcae90000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.383+0000 7fba3a274b80 1 --2- 172.21.15.26:0/2073463663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561fcae30fe0 0x561fcae90540 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.383+0000 7fba3a274b80 1 -- 172.21.15.26:0/2073463663 >> 172.21.15.26:0/2073463663 conn(0x561fcad90070 msgr2=0x561fcae42320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.384+0000 7fba0affd700 0 client.15408 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.384+0000 7fba3a274b80 1 -- 172.21.15.26:0/2073463663 shutdown_connections 2023-12-01T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.384+0000 7fba3a274b80 1 -- 172.21.15.26:0/2073463663 wait complete. 2023-12-01T01:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.384+0000 7fba3a274b80 20 client.15408 trim_cache size 0 max 16384 2023-12-01T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:{ 2023-12-01T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "message": "", 2023-12-01T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "return_code": 0 2023-12-01T01:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:} 2023-12-01T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.384+0000 7fba2e0e4700 1 -- 172.21.15.26:0/2695994543 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fba0c0a0520 msgr2=0x7fba0c0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.384+0000 7fba2e0e4700 1 --2- 172.21.15.26:0/2695994543 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fba0c0a0520 0x7fba0c0a29e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fba140036f0 tx=0x7fba14003680 comp rx=0 tx=0).stop 2023-12-01T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.384+0000 7fba2e0e4700 1 -- 172.21.15.26:0/2695994543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba28101870 msgr2=0x7fba28196b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.384+0000 7fba2e0e4700 1 --2- 172.21.15.26:0/2695994543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba28101870 0x7fba28196b80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fba1800c9b0 tx=0x7fba1800cd70 comp rx=0 tx=0).stop 2023-12-01T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.384+0000 7fba2e0e4700 1 -- 172.21.15.26:0/2695994543 shutdown_connections 2023-12-01T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.384+0000 7fba2e0e4700 1 --2- 172.21.15.26:0/2695994543 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fba0c0a0520 0x7fba0c0a29e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.384+0000 7fba2e0e4700 1 --2- 172.21.15.26:0/2695994543 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fba28106ad0 0x7fba28197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.384+0000 7fba2e0e4700 1 --2- 172.21.15.26:0/2695994543 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fba28101870 0x7fba28196b80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.384+0000 7fba2e0e4700 1 --2- 172.21.15.26:0/2695994543 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fba281041a0 0x7fba281970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.384+0000 7fba2e0e4700 1 -- 172.21.15.26:0/2695994543 >> 172.21.15.26:0/2695994543 conn(0x7fba280fb1e0 msgr2=0x7fba281024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.384+0000 7fba2e0e4700 1 -- 172.21.15.26:0/2695994543 shutdown_connections 2023-12-01T01:04:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:30.384+0000 7fba2e0e4700 1 -- 172.21.15.26:0/2695994543 wait complete. 2023-12-01T01:04:32.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:31 smithi116 ceph-mon[103554]: pgmap v299: 97 pgs: 97 active+clean; 650 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2023-12-01T01:04:32.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:31 smithi093 ceph-mon[103327]: pgmap v299: 97 pgs: 97 active+clean; 650 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2023-12-01T01:04:32.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:31 smithi026 ceph-mon[98801]: pgmap v299: 97 pgs: 97 active+clean; 650 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2023-12-01T01:04:33.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:32 smithi116 ceph-mon[103554]: pgmap v300: 97 pgs: 97 active+clean; 650 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-12-01T01:04:33.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:32 smithi093 ceph-mon[103327]: pgmap v300: 97 pgs: 97 active+clean; 650 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-12-01T01:04:33.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:32 smithi026 ceph-mon[98801]: pgmap v300: 97 pgs: 97 active+clean; 650 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2023-12-01T01:04:35.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:35 smithi116 ceph-mon[103554]: pgmap v301: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-12-01T01:04:35.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:35 smithi093 ceph-mon[103327]: pgmap v301: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-12-01T01:04:35.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:35 smithi026 ceph-mon[98801]: pgmap v301: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-12-01T01:04:37.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:37 smithi116 ceph-mon[103554]: pgmap v302: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-12-01T01:04:37.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:37 smithi093 ceph-mon[103327]: pgmap v302: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-12-01T01:04:37.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:37 smithi026 ceph-mon[98801]: pgmap v302: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-12-01T01:04:39.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:39 smithi116 ceph-mon[103554]: pgmap v303: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-12-01T01:04:39.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:39 smithi093 ceph-mon[103327]: pgmap v303: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-12-01T01:04:39.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:39 smithi026 ceph-mon[98801]: pgmap v303: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-12-01T01:04:41.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:41 smithi116 ceph-mon[103554]: pgmap v304: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2023-12-01T01:04:41.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:41 smithi093 ceph-mon[103327]: pgmap v304: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2023-12-01T01:04:41.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:41 smithi026 ceph-mon[98801]: pgmap v304: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2023-12-01T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.506+0000 7f4d59333700 1 -- 172.21.15.26:0/3399267520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54101870 msgr2=0x7f4d54108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.506+0000 7f4d59333700 1 --2- 172.21.15.26:0/3399267520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54101870 0x7f4d54108120 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00b0d0 tx=0x7f4d4c00b3e0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.506+0000 7f4d59333700 1 -- 172.21.15.26:0/3399267520 shutdown_connections 2023-12-01T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.506+0000 7f4d59333700 1 --2- 172.21.15.26:0/3399267520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54101870 0x7f4d54108120 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.506+0000 7f4d59333700 1 --2- 172.21.15.26:0/3399267520 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d540ffce0 0x7f4d54100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.506+0000 7f4d59333700 1 --2- 172.21.15.26:0/3399267520 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d54100ed0 0x7f4d54101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.506+0000 7f4d59333700 1 -- 172.21.15.26:0/3399267520 >> 172.21.15.26:0/3399267520 conn(0x7f4d540fb250 msgr2=0x7f4d540fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.506+0000 7f4d59333700 1 -- 172.21.15.26:0/3399267520 shutdown_connections 2023-12-01T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.506+0000 7f4d59333700 1 -- 172.21.15.26:0/3399267520 wait complete. 2023-12-01T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.507+0000 7f4d59333700 1 Processor -- start 2023-12-01T01:04:43.508 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.507+0000 7f4d59333700 1 -- start start 2023-12-01T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.507+0000 7f4d59333700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d540ffce0 0x7f4d54199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.507+0000 7f4d59333700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d54100ed0 0x7f4d5419beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.507+0000 7f4d59333700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54101870 0x7f4d5419e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.507+0000 7f4d59333700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5419e9d0 con 0x7f4d54101870 2023-12-01T01:04:43.510 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.507+0000 7f4d59333700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5419eb10 con 0x7f4d54100ed0 2023-12-01T01:04:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.507+0000 7f4d59333700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5419ecd0 con 0x7f4d540ffce0 2023-12-01T01:04:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.507+0000 7f4d537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54101870 0x7f4d5419e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.507+0000 7f4d537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54101870 0x7f4d5419e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55250/0 (socket says 172.21.15.26:55250) 2023-12-01T01:04:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.507+0000 7f4d537fe700 1 -- 172.21.15.26:0/3552561301 learned_addr learned my addr 172.21.15.26:0/3552561301 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.507+0000 7f4d527fc700 1 --2- 172.21.15.26:0/3552561301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d54100ed0 0x7f4d5419beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.507+0000 7f4d52ffd700 1 --2- 172.21.15.26:0/3552561301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d540ffce0 0x7f4d54199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.508+0000 7f4d537fe700 1 -- 172.21.15.26:0/3552561301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d540ffce0 msgr2=0x7f4d54199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.508+0000 7f4d537fe700 1 --2- 172.21.15.26:0/3552561301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d540ffce0 0x7f4d54199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.508+0000 7f4d537fe700 1 -- 172.21.15.26:0/3552561301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d54100ed0 msgr2=0x7f4d5419beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.508+0000 7f4d537fe700 1 --2- 172.21.15.26:0/3552561301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d54100ed0 0x7f4d5419beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.508+0000 7f4d537fe700 1 -- 172.21.15.26:0/3552561301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c009d00 con 0x7f4d54101870 2023-12-01T01:04:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.508+0000 7f4d537fe700 1 --2- 172.21.15.26:0/3552561301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54101870 0x7f4d5419e400 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00d010 tx=0x7f4d4c00bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:43.511 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.508+0000 7f4d4bfff700 1 -- 172.21.15.26:0/3552561301 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c00e040 con 0x7f4d54101870 2023-12-01T01:04:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.508+0000 7f4d4bfff700 1 -- 172.21.15.26:0/3552561301 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4d4c012de0 con 0x7f4d54101870 2023-12-01T01:04:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.508+0000 7f4d59333700 1 -- 172.21.15.26:0/3552561301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5419ef50 con 0x7f4d54101870 2023-12-01T01:04:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.508+0000 7f4d4bfff700 1 -- 172.21.15.26:0/3552561301 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c01b450 con 0x7f4d54101870 2023-12-01T01:04:43.512 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.508+0000 7f4d59333700 1 -- 172.21.15.26:0/3552561301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5419f370 con 0x7f4d54101870 2023-12-01T01:04:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.510+0000 7f4d4bfff700 1 -- 172.21.15.26:0/3552561301 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f4d4c01d480 con 0x7f4d54101870 2023-12-01T01:04:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.511+0000 7f4d4bfff700 1 --2- 172.21.15.26:0/3552561301 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4d400a0520 0x7f4d400a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.511+0000 7f4d4bfff700 1 -- 172.21.15.26:0/3552561301 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4d4c0cd5b0 con 0x7f4d54101870 2023-12-01T01:04:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.511+0000 7f4d52ffd700 1 --2- 172.21.15.26:0/3552561301 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4d400a0520 0x7f4d400a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.512+0000 7f4d654c3b80 1 Processor -- start 2023-12-01T01:04:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.512+0000 7f4d654c3b80 1 -- start start 2023-12-01T01:04:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.512+0000 7f4d52ffd700 1 --2- 172.21.15.26:0/3552561301 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4d400a0520 0x7f4d400a29e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4d54069740 tx=0x7f4d3c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:43.515 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.512+0000 7f4d654c3b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e200680 0x55bc1e200aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.512+0000 7f4d654c3b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e200fe0 0x55bc1e2018f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.512+0000 7f4d654c3b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e201ed0 0x55bc1e202350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.512+0000 7f4d654c3b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1e1589b0 con 0x55bc1e201ed0 2023-12-01T01:04:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.512+0000 7f4d654c3b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1e156370 con 0x55bc1e200fe0 2023-12-01T01:04:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.512+0000 7f4d654c3b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1e151c60 con 0x55bc1e200680 2023-12-01T01:04:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.512+0000 7f4d537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e201ed0 0x55bc1e202350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.512+0000 7f4d537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e201ed0 0x55bc1e202350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55258/0 (socket says 172.21.15.26:55258) 2023-12-01T01:04:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.512+0000 7f4d537fe700 1 -- 172.21.15.26:0/2522419725 learned_addr learned my addr 172.21.15.26:0/2522419725 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.512+0000 7f4d52ffd700 1 --2- 172.21.15.26:0/2522419725 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e200680 0x55bc1e200aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.512+0000 7f4d527fc700 1 --2- 172.21.15.26:0/2522419725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e200fe0 0x55bc1e2018f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.513+0000 7f4d537fe700 1 -- 172.21.15.26:0/2522419725 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e200680 msgr2=0x55bc1e200aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.513+0000 7f4d537fe700 1 --2- 172.21.15.26:0/2522419725 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e200680 0x55bc1e200aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.513+0000 7f4d537fe700 1 -- 172.21.15.26:0/2522419725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e200fe0 msgr2=0x55bc1e2018f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:43.516 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.513+0000 7f4d537fe700 1 --2- 172.21.15.26:0/2522419725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e200fe0 0x55bc1e2018f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.513+0000 7f4d537fe700 1 -- 172.21.15.26:0/2522419725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc1df7fd80 con 0x55bc1e201ed0 2023-12-01T01:04:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.513+0000 7f4d527fc700 1 --2- 172.21.15.26:0/2522419725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e200fe0 0x55bc1e2018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.513+0000 7f4d537fe700 1 --2- 172.21.15.26:0/2522419725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e201ed0 0x55bc1e202350 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0a2960 tx=0x7f4d4c00b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f2ab8a27f09cd server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.513+0000 7f4d497fa700 1 -- 172.21.15.26:0/2522419725 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c09a9f0 con 0x55bc1e201ed0 2023-12-01T01:04:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.513+0000 7f4d497fa700 1 -- 172.21.15.26:0/2522419725 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4d4c09a810 con 0x55bc1e201ed0 2023-12-01T01:04:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.513+0000 7f4d497fa700 1 -- 172.21.15.26:0/2522419725 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c09b110 con 0x55bc1e201ed0 2023-12-01T01:04:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.514+0000 7f4d654c3b80 1 -- 172.21.15.26:0/2522419725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e201ed0 msgr2=0x55bc1e202350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.514+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/2522419725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e201ed0 0x55bc1e202350 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0a2960 tx=0x7f4d4c00b3e0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.514+0000 7f4d654c3b80 1 -- 172.21.15.26:0/2522419725 shutdown_connections 2023-12-01T01:04:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.514+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/2522419725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e201ed0 0x55bc1e202350 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.514+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/2522419725 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e200680 0x55bc1e200aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.514+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/2522419725 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e200fe0 0x55bc1e2018f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.514+0000 7f4d654c3b80 1 -- 172.21.15.26:0/2522419725 >> 172.21.15.26:0/2522419725 conn(0x55bc1e160070 msgr2=0x55bc1e1fd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.514+0000 7f4d654c3b80 1 -- 172.21.15.26:0/2522419725 shutdown_connections 2023-12-01T01:04:43.517 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.514+0000 7f4d654c3b80 1 -- 172.21.15.26:0/2522419725 wait complete. 2023-12-01T01:04:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.514+0000 7f4d654c3b80 1 -- start start 2023-12-01T01:04:43.518 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.514+0000 7f4d654c3b80 1 Processor -- start 2023-12-01T01:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d654c3b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e200680 0x55bc1e20a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d654c3b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e200fe0 0x55bc1e20a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d654c3b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e201ed0 0x55bc1e2117d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.521 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d654c3b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1e0ee4b0 con 0x55bc1e200fe0 2023-12-01T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d654c3b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1e0ee150 con 0x55bc1e201ed0 2023-12-01T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d654c3b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1dfd58c0 con 0x55bc1e200680 2023-12-01T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d654c3b80 10 client.0 _ll_register_callbacks cb 0x55bc1e03ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d527fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e200fe0 0x55bc1e20a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d527fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e200fe0 0x55bc1e20a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55262/0 (socket says 172.21.15.26:55262) 2023-12-01T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d527fc700 1 -- 172.21.15.26:0/1043892192 learned_addr learned my addr 172.21.15.26:0/1043892192 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d52ffd700 1 --2- 172.21.15.26:0/1043892192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e200680 0x55bc1e20a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d537fe700 1 --2- 172.21.15.26:0/1043892192 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e201ed0 0x55bc1e2117d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d527fc700 1 -- 172.21.15.26:0/1043892192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e200680 msgr2=0x55bc1e20a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d527fc700 1 --2- 172.21.15.26:0/1043892192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e200680 0x55bc1e20a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d527fc700 1 -- 172.21.15.26:0/1043892192 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e201ed0 msgr2=0x55bc1e2117d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d527fc700 1 --2- 172.21.15.26:0/1043892192 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e201ed0 0x55bc1e2117d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d527fc700 1 -- 172.21.15.26:0/1043892192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5419f370 con 0x55bc1e200fe0 2023-12-01T01:04:43.522 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d537fe700 1 --2- 172.21.15.26:0/1043892192 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e201ed0 0x55bc1e2117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d52ffd700 1 --2- 172.21.15.26:0/1043892192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e200680 0x55bc1e20a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d527fc700 1 --2- 172.21.15.26:0/1043892192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e200fe0 0x55bc1e20a790 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4d44007fa0 tx=0x7f4d440127e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11d3d4228d04489 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.515+0000 7f4d3a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.516+0000 7f4d3a7fc700 1 -- 172.21.15.26:0/1043892192 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44004520 con 0x55bc1e200fe0 2023-12-01T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.516+0000 7f4d3a7fc700 1 -- 172.21.15.26:0/1043892192 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4d44003680 con 0x55bc1e200fe0 2023-12-01T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.516+0000 7f4d654c3b80 1 -- 172.21.15.26:0/1043892192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc1e17ccb0 con 0x55bc1e200fe0 2023-12-01T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.516+0000 7f4d3a7fc700 1 -- 172.21.15.26:0/1043892192 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d44003840 con 0x55bc1e200fe0 2023-12-01T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.516+0000 7f4d654c3b80 10 client.15420 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.516+0000 7f4d654c3b80 1 -- 172.21.15.26:0/1043892192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55bc1df68c00 con 0x55bc1e200fe0 2023-12-01T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.516+0000 7f4d3a7fc700 1 -- 172.21.15.26:0/1043892192 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55bc1e17ccb0 con 0x55bc1e200fe0 2023-12-01T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.516+0000 7f4d3a7fc700 1 -- 172.21.15.26:0/1043892192 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f4d44024070 con 0x55bc1e200fe0 2023-12-01T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.516+0000 7f4d654c3b80 10 client.15420 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.516+0000 7f4d654c3b80 10 client.15420 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.516+0000 7f4d654c3b80 20 client.15420 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:43.523 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.516+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/1043892192 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55bc1e2160e0 0x55bc1e218500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.516+0000 7f4d654c3b80 4 client.15420 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.516+0000 7f4d654c3b80 1 -- 172.21.15.26:0/1043892192 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc1e1cfdb0 con 0x55bc1e2160e0 2023-12-01T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.517+0000 7f4d52ffd700 1 --2- 172.21.15.26:0/1043892192 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55bc1e2160e0 0x55bc1e218500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.517+0000 7f4d3a7fc700 10 client.15420 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.517+0000 7f4d52ffd700 1 --2- 172.21.15.26:0/1043892192 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55bc1e2160e0 0x55bc1e218500 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8c494b560ef9ddd server_cookie=c99e538acc8764d5 in_seq=0 out_seq=0 2023-12-01T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.518+0000 7f4d3a7fc700 1 -- 172.21.15.26:0/1043892192 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55bc1e1cfdb0 con 0x55bc1e2160e0 2023-12-01T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.518+0000 7f4d3a7fc700 10 client.15420 handle_command_reply: tid=0 2023-12-01T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.518+0000 7f4d654c3b80 1 client.15420 shutdown 2023-12-01T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.518+0000 7f4d654c3b80 1 -- 172.21.15.26:0/1043892192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e200fe0 msgr2=0x55bc1e20a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.518+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/1043892192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e200fe0 0x55bc1e20a790 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4d44007fa0 tx=0x7f4d440127e0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.518+0000 7f4d654c3b80 1 -- 172.21.15.26:0/1043892192 shutdown_connections 2023-12-01T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.518+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/1043892192 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55bc1e2160e0 0x55bc1e218500 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.518+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/1043892192 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e201ed0 0x55bc1e2117d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.518+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/1043892192 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e200680 0x55bc1e20a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.518+0000 7f4d3a7fc700 0 client.15420 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.518+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/1043892192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e200fe0 0x55bc1e20a790 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.518+0000 7f4d654c3b80 1 -- 172.21.15.26:0/1043892192 >> 172.21.15.26:0/1043892192 conn(0x55bc1e160070 msgr2=0x55bc1e1fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.518+0000 7f4d654c3b80 1 -- 172.21.15.26:0/1043892192 shutdown_connections 2023-12-01T01:04:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.518+0000 7f4d654c3b80 1 -- 172.21.15.26:0/1043892192 wait complete. 2023-12-01T01:04:43.525 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.518+0000 7f4d654c3b80 20 client.15420 trim_cache size 0 max 16384 2023-12-01T01:04:43.538 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d654c3b80 1 Processor -- start 2023-12-01T01:04:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d654c3b80 1 -- start start 2023-12-01T01:04:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d654c3b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e200680 0x55bc1e20f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d654c3b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e200fe0 0x55bc1e202310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d654c3b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e201ed0 0x55bc1e208f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d654c3b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1e1f37a0 con 0x55bc1e200fe0 2023-12-01T01:04:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d654c3b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1e1f6500 con 0x55bc1e200680 2023-12-01T01:04:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d654c3b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1e209dc0 con 0x55bc1e201ed0 2023-12-01T01:04:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d527fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e200fe0 0x55bc1e202310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d527fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e200fe0 0x55bc1e202310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55270/0 (socket says 172.21.15.26:55270) 2023-12-01T01:04:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d527fc700 1 -- 172.21.15.26:0/2684720275 learned_addr learned my addr 172.21.15.26:0/2684720275 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d537fe700 1 --2- 172.21.15.26:0/2684720275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e201ed0 0x55bc1e208f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d52ffd700 1 --2- 172.21.15.26:0/2684720275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e200680 0x55bc1e20f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d527fc700 1 -- 172.21.15.26:0/2684720275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e201ed0 msgr2=0x55bc1e208f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:43.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d527fc700 1 --2- 172.21.15.26:0/2684720275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e201ed0 0x55bc1e208f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d527fc700 1 -- 172.21.15.26:0/2684720275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e200680 msgr2=0x55bc1e20f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.533+0000 7f4d527fc700 1 --2- 172.21.15.26:0/2684720275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e200680 0x55bc1e20f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.534+0000 7f4d527fc700 1 -- 172.21.15.26:0/2684720275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc1dfa61f0 con 0x55bc1e200fe0 2023-12-01T01:04:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.534+0000 7f4d527fc700 1 --2- 172.21.15.26:0/2684720275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e200fe0 0x55bc1e202310 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4d4401bb50 tx=0x7f4d44005a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7f11bdb8d121d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.534+0000 7f4d49ffb700 1 -- 172.21.15.26:0/2684720275 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d440055a0 con 0x55bc1e200fe0 2023-12-01T01:04:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.534+0000 7f4d49ffb700 1 -- 172.21.15.26:0/2684720275 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4d44021070 con 0x55bc1e200fe0 2023-12-01T01:04:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.534+0000 7f4d49ffb700 1 -- 172.21.15.26:0/2684720275 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d44003cd0 con 0x55bc1e200fe0 2023-12-01T01:04:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 -- 172.21.15.26:0/2684720275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e200fe0 msgr2=0x55bc1e202310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/2684720275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e200fe0 0x55bc1e202310 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4d4401bb50 tx=0x7f4d44005a00 comp rx=0 tx=0).stop 2023-12-01T01:04:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 -- 172.21.15.26:0/2684720275 shutdown_connections 2023-12-01T01:04:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/2684720275 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e201ed0 0x55bc1e208f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/2684720275 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e200680 0x55bc1e20f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/2684720275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e200fe0 0x55bc1e202310 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 -- 172.21.15.26:0/2684720275 >> 172.21.15.26:0/2684720275 conn(0x55bc1e160070 msgr2=0x55bc1e2050a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 -- 172.21.15.26:0/2684720275 shutdown_connections 2023-12-01T01:04:43.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 -- 172.21.15.26:0/2684720275 wait complete. 2023-12-01T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 -- start start 2023-12-01T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 Processor -- start 2023-12-01T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e200680 0x55bc1e25fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e200fe0 0x55bc1e260340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e201ed0 0x55bc1e266e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1e2673a0 con 0x55bc1e201ed0 2023-12-01T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1e267510 con 0x55bc1e200fe0 2023-12-01T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc1e2676d0 con 0x55bc1e200680 2023-12-01T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d654c3b80 10 client.0 _ll_register_callbacks cb 0x7f4d44007a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e201ed0 0x55bc1e266e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.535+0000 7f4d537fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e201ed0 0x55bc1e266e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55278/0 (socket says 172.21.15.26:55278) 2023-12-01T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d52ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e200680 0x55bc1e25fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d537fe700 1 -- 172.21.15.26:0/1155104680 learned_addr learned my addr 172.21.15.26:0/1155104680 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:43.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d527fc700 1 --2- 172.21.15.26:0/1155104680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e200fe0 0x55bc1e260340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d537fe700 1 -- 172.21.15.26:0/1155104680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e200680 msgr2=0x55bc1e25fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d537fe700 1 --2- 172.21.15.26:0/1155104680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e200680 0x55bc1e25fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d537fe700 1 -- 172.21.15.26:0/1155104680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e200fe0 msgr2=0x55bc1e260340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d537fe700 1 --2- 172.21.15.26:0/1155104680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e200fe0 0x55bc1e260340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d537fe700 1 -- 172.21.15.26:0/1155104680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc1df68c00 con 0x55bc1e201ed0 2023-12-01T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d537fe700 1 --2- 172.21.15.26:0/1155104680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e201ed0 0x55bc1e266e60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0cb110 tx=0x7f4d4c0971f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb50af8cef2bb9ae server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d3a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d3a7fc700 1 -- 172.21.15.26:0/1155104680 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c09b310 con 0x55bc1e201ed0 2023-12-01T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d3a7fc700 1 -- 172.21.15.26:0/1155104680 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4d4c09ece0 con 0x55bc1e201ed0 2023-12-01T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d654c3b80 1 -- 172.21.15.26:0/1155104680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d4c09a810 con 0x55bc1e201ed0 2023-12-01T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d3a7fc700 1 -- 172.21.15.26:0/1155104680 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d4c09a9f0 con 0x55bc1e201ed0 2023-12-01T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d654c3b80 10 client.15426 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:43.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d654c3b80 1 -- 172.21.15.26:0/1155104680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55bc1df7e250 con 0x55bc1e201ed0 2023-12-01T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.536+0000 7f4d3a7fc700 1 -- 172.21.15.26:0/1155104680 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4d4c09a810 con 0x55bc1e201ed0 2023-12-01T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.537+0000 7f4d3a7fc700 1 -- 172.21.15.26:0/1155104680 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f4d4c0b30d0 con 0x55bc1e201ed0 2023-12-01T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.537+0000 7f4d654c3b80 10 client.15426 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.537+0000 7f4d654c3b80 10 client.15426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.537+0000 7f4d654c3b80 20 client.15426 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.537+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/1155104680 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55bc1e268c50 0x55bc1e26b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.537+0000 7f4d654c3b80 4 client.15426 mds_command: new command op to 24509 tid=0[{"prefix": "flush journal"}] 2023-12-01T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.537+0000 7f4d654c3b80 1 -- 172.21.15.26:0/1155104680 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bc1e14ace0 con 0x55bc1e268c50 2023-12-01T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.537+0000 7f4d52ffd700 1 --2- 172.21.15.26:0/1155104680 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55bc1e268c50 0x55bc1e26b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.537+0000 7f4d3a7fc700 10 client.15426 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:43.543 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.537+0000 7f4d52ffd700 1 --2- 172.21.15.26:0/1155104680 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55bc1e268c50 0x55bc1e26b040 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a394e7ad7b9b75a3 server_cookie=6b45cdeb3a8e7d35 in_seq=0 out_seq=0 2023-12-01T01:04:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.541+0000 7f4d3a7fc700 1 -- 172.21.15.26:0/1155104680 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bc1e14ace0 con 0x55bc1e268c50 2023-12-01T01:04:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.541+0000 7f4d3a7fc700 10 client.15426 handle_command_reply: tid=0 2023-12-01T01:04:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.541+0000 7f4d654c3b80 1 client.15426 shutdown 2023-12-01T01:04:43.544 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.541+0000 7f4d654c3b80 1 -- 172.21.15.26:0/1155104680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e201ed0 msgr2=0x55bc1e266e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.541+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/1155104680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e201ed0 0x55bc1e266e60 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0cb110 tx=0x7f4d4c0971f0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.541+0000 7f4d654c3b80 1 -- 172.21.15.26:0/1155104680 shutdown_connections 2023-12-01T01:04:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.541+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/1155104680 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55bc1e268c50 0x55bc1e26b040 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.541+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/1155104680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55bc1e201ed0 0x55bc1e266e60 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.541+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/1155104680 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55bc1e200680 0x55bc1e25fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.541+0000 7f4d3a7fc700 0 client.15426 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.541+0000 7f4d654c3b80 1 --2- 172.21.15.26:0/1155104680 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55bc1e200fe0 0x55bc1e260340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.541+0000 7f4d654c3b80 1 -- 172.21.15.26:0/1155104680 >> 172.21.15.26:0/1155104680 conn(0x55bc1e160070 msgr2=0x55bc1e208f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.541+0000 7f4d654c3b80 1 -- 172.21.15.26:0/1155104680 shutdown_connections 2023-12-01T01:04:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.541+0000 7f4d654c3b80 1 -- 172.21.15.26:0/1155104680 wait complete. 2023-12-01T01:04:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.541+0000 7f4d654c3b80 20 client.15426 trim_cache size 0 max 16384 2023-12-01T01:04:43.545 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:{ 2023-12-01T01:04:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "message": "", 2023-12-01T01:04:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "return_code": 0 2023-12-01T01:04:43.546 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:} 2023-12-01T01:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.542+0000 7f4d59333700 1 -- 172.21.15.26:0/3552561301 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4d400a0520 msgr2=0x7f4d400a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.542+0000 7f4d59333700 1 --2- 172.21.15.26:0/3552561301 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4d400a0520 0x7f4d400a29e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4d54069740 tx=0x7f4d3c009260 comp rx=0 tx=0).stop 2023-12-01T01:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.542+0000 7f4d59333700 1 -- 172.21.15.26:0/3552561301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54101870 msgr2=0x7f4d5419e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.542+0000 7f4d59333700 1 --2- 172.21.15.26:0/3552561301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54101870 0x7f4d5419e400 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c00d010 tx=0x7f4d4c00bdc0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.542+0000 7f4d59333700 1 -- 172.21.15.26:0/3552561301 shutdown_connections 2023-12-01T01:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.542+0000 7f4d59333700 1 --2- 172.21.15.26:0/3552561301 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4d400a0520 0x7f4d400a29e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.542+0000 7f4d59333700 1 --2- 172.21.15.26:0/3552561301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54101870 0x7f4d5419e400 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.542+0000 7f4d59333700 1 --2- 172.21.15.26:0/3552561301 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4d540ffce0 0x7f4d54199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.542+0000 7f4d59333700 1 --2- 172.21.15.26:0/3552561301 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4d54100ed0 0x7f4d5419beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.542+0000 7f4d59333700 1 -- 172.21.15.26:0/3552561301 >> 172.21.15.26:0/3552561301 conn(0x7f4d540fb250 msgr2=0x7f4d540fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.542+0000 7f4d59333700 1 -- 172.21.15.26:0/3552561301 shutdown_connections 2023-12-01T01:04:43.547 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:43.542+0000 7f4d59333700 1 -- 172.21.15.26:0/3552561301 wait complete. 2023-12-01T01:04:43.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:43 smithi116 ceph-mon[103554]: pgmap v305: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-12-01T01:04:43.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:43 smithi093 ceph-mon[103327]: pgmap v305: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-12-01T01:04:43.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:43 smithi026 ceph-mon[98801]: pgmap v305: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2023-12-01T01:04:45.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:45 smithi116 ceph-mon[103554]: pgmap v306: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-12-01T01:04:45.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:45 smithi093 ceph-mon[103327]: pgmap v306: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-12-01T01:04:45.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:45 smithi026 ceph-mon[98801]: pgmap v306: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2023-12-01T01:04:47.588 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-01T01:04:47.616 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:47 smithi026 ceph-mon[98801]: pgmap v307: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 8 op/s 2023-12-01T01:04:47.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:47 smithi116 ceph-mon[103554]: pgmap v307: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 8 op/s 2023-12-01T01:04:47.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:47 smithi093 ceph-mon[103327]: pgmap v307: 97 pgs: 97 active+clean; 651 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 767 B/s wr, 8 op/s 2023-12-01T01:04:47.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.722+0000 7f680c8ab700 1 -- 172.21.15.26:0/274111872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6808104190 msgr2=0x7f6808106580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:47.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.722+0000 7f680c8ab700 1 --2- 172.21.15.26:0/274111872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6808104190 0x7f6808106580 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f67fc009990 tx=0x7f67fc009ca0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.722+0000 7f680c8ab700 1 -- 172.21.15.26:0/274111872 shutdown_connections 2023-12-01T01:04:47.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.722+0000 7f680c8ab700 1 --2- 172.21.15.26:0/274111872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6808106ac0 0x7f6808108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.722+0000 7f680c8ab700 1 --2- 172.21.15.26:0/274111872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6808101860 0x7f6808103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.722+0000 7f680c8ab700 1 --2- 172.21.15.26:0/274111872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6808104190 0x7f6808106580 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.722+0000 7f680c8ab700 1 -- 172.21.15.26:0/274111872 >> 172.21.15.26:0/274111872 conn(0x7f68080fb1f0 msgr2=0x7f68080fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:47.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.722+0000 7f680c8ab700 1 -- 172.21.15.26:0/274111872 shutdown_connections 2023-12-01T01:04:47.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.722+0000 7f680c8ab700 1 -- 172.21.15.26:0/274111872 wait complete. 2023-12-01T01:04:47.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f680c8ab700 1 Processor -- start 2023-12-01T01:04:47.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f680c8ab700 1 -- start start 2023-12-01T01:04:47.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f680c8ab700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6808101860 0x7f68081011d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f680c8ab700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6808104190 0x7f68080ff810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f680c8ab700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6808106ac0 0x7f68080ffd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f680c8ab700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68081004f0 con 0x7f6808104190 2023-12-01T01:04:47.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f680c8ab700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6808100660 con 0x7f6808101860 2023-12-01T01:04:47.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f680c8ab700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68081a0bc0 con 0x7f6808106ac0 2023-12-01T01:04:47.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f6805d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6808104190 0x7f68080ff810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f6805d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6808104190 0x7f68080ff810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55288/0 (socket says 172.21.15.26:55288) 2023-12-01T01:04:47.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f6805d9b700 1 -- 172.21.15.26:0/3922189428 learned_addr learned my addr 172.21.15.26:0/3922189428 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:47.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f6806d9d700 1 --2- 172.21.15.26:0/3922189428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6808106ac0 0x7f68080ffd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f680659c700 1 --2- 172.21.15.26:0/3922189428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6808101860 0x7f68081011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f6805d9b700 1 -- 172.21.15.26:0/3922189428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6808106ac0 msgr2=0x7f68080ffd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:47.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f6805d9b700 1 --2- 172.21.15.26:0/3922189428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6808106ac0 0x7f68080ffd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f6805d9b700 1 -- 172.21.15.26:0/3922189428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6808101860 msgr2=0x7f68081011d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:47.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f6805d9b700 1 --2- 172.21.15.26:0/3922189428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6808101860 0x7f68081011d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f6805d9b700 1 -- 172.21.15.26:0/3922189428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc0095f0 con 0x7f6808104190 2023-12-01T01:04:47.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f6805d9b700 1 --2- 172.21.15.26:0/3922189428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6808104190 0x7f68080ff810 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0036f0 tx=0x7f67fc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:47.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.723+0000 7f67f77fe700 1 -- 172.21.15.26:0/3922189428 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc01d070 con 0x7f6808104190 2023-12-01T01:04:47.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.724+0000 7f67f77fe700 1 -- 172.21.15.26:0/3922189428 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f67fc00fb80 con 0x7f6808104190 2023-12-01T01:04:47.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.724+0000 7f680c8ab700 1 -- 172.21.15.26:0/3922189428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68081a0e40 con 0x7f6808104190 2023-12-01T01:04:47.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.724+0000 7f67f77fe700 1 -- 172.21.15.26:0/3922189428 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc017650 con 0x7f6808104190 2023-12-01T01:04:47.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.724+0000 7f680c8ab700 1 -- 172.21.15.26:0/3922189428 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68081a1200 con 0x7f6808104190 2023-12-01T01:04:47.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.726+0000 7f67f77fe700 1 -- 172.21.15.26:0/3922189428 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f67fc022470 con 0x7f6808104190 2023-12-01T01:04:47.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.726+0000 7f67f77fe700 1 --2- 172.21.15.26:0/3922189428 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f67f00a0520 0x7f67f00a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.726+0000 7f67f77fe700 1 -- 172.21.15.26:0/3922189428 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f67fc0ccfa0 con 0x7f6808104190 2023-12-01T01:04:47.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.726+0000 7f680659c700 1 --2- 172.21.15.26:0/3922189428 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f67f00a0520 0x7f67f00a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.727+0000 7f680659c700 1 --2- 172.21.15.26:0/3922189428 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f67f00a0520 0x7f67f00a29e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f67f8005950 tx=0x7f67f80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:47.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.727+0000 7f6818a3bb80 1 Processor -- start 2023-12-01T01:04:47.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f6818a3bb80 1 -- start start 2023-12-01T01:04:47.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f6818a3bb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be030f0 0x55655be03530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f6818a3bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be03a70 0x55655be01e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f6818a3bb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be023f0 0x55655be02870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f6818a3bb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bd59a10 con 0x55655be030f0 2023-12-01T01:04:47.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f6818a3bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bd573d0 con 0x55655be03a70 2023-12-01T01:04:47.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f6818a3bb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bd52cc0 con 0x55655be023f0 2023-12-01T01:04:47.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f680659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be030f0 0x55655be03530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f680659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be030f0 0x55655be03530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55294/0 (socket says 172.21.15.26:55294) 2023-12-01T01:04:47.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f680659c700 1 -- 172.21.15.26:0/2997579138 learned_addr learned my addr 172.21.15.26:0/2997579138 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:47.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f6806d9d700 1 --2- 172.21.15.26:0/2997579138 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be023f0 0x55655be02870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f6805d9b700 1 --2- 172.21.15.26:0/2997579138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be03a70 0x55655be01e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f680659c700 1 -- 172.21.15.26:0/2997579138 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be023f0 msgr2=0x55655be02870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:47.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f680659c700 1 --2- 172.21.15.26:0/2997579138 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be023f0 0x55655be02870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f680659c700 1 -- 172.21.15.26:0/2997579138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be03a70 msgr2=0x55655be01e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:47.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f680659c700 1 --2- 172.21.15.26:0/2997579138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be03a70 0x55655be01e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f680659c700 1 -- 172.21.15.26:0/2997579138 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55655bb80de0 con 0x55655be030f0 2023-12-01T01:04:47.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.728+0000 7f6805d9b700 1 --2- 172.21.15.26:0/2997579138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be03a70 0x55655be01e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:47.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.729+0000 7f680659c700 1 --2- 172.21.15.26:0/2997579138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be030f0 0x55655be03530 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009450 tx=0x7f67f8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2372254da816188f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:47.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.729+0000 7f67f4ff9700 1 -- 172.21.15.26:0/2997579138 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f8011b00 con 0x55655be030f0 2023-12-01T01:04:47.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.729+0000 7f67f4ff9700 1 -- 172.21.15.26:0/2997579138 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f67f8011c60 con 0x55655be030f0 2023-12-01T01:04:47.731 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.729+0000 7f67f4ff9700 1 -- 172.21.15.26:0/2997579138 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f8010630 con 0x55655be030f0 2023-12-01T01:04:47.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.729+0000 7f6818a3bb80 1 -- 172.21.15.26:0/2997579138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be030f0 msgr2=0x55655be03530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:47.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.729+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/2997579138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be030f0 0x55655be03530 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f67f8009450 tx=0x7f67f8011000 comp rx=0 tx=0).stop 2023-12-01T01:04:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.730+0000 7f6818a3bb80 1 -- 172.21.15.26:0/2997579138 shutdown_connections 2023-12-01T01:04:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.730+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/2997579138 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be023f0 0x55655be02870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.730+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/2997579138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be030f0 0x55655be03530 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.730+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/2997579138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be03a70 0x55655be01e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.730+0000 7f6818a3bb80 1 -- 172.21.15.26:0/2997579138 >> 172.21.15.26:0/2997579138 conn(0x55655bd610d0 msgr2=0x55655bdfc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.730+0000 7f6818a3bb80 1 -- 172.21.15.26:0/2997579138 shutdown_connections 2023-12-01T01:04:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.730+0000 7f6818a3bb80 1 -- 172.21.15.26:0/2997579138 wait complete. 2023-12-01T01:04:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.730+0000 7f6818a3bb80 1 -- start start 2023-12-01T01:04:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.730+0000 7f6818a3bb80 1 Processor -- start 2023-12-01T01:04:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.730+0000 7f6818a3bb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be023f0 0x55655be0b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.730+0000 7f6818a3bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be030f0 0x55655be0be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.730+0000 7f6818a3bb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be03a70 0x55655be12eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.730+0000 7f6818a3bb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bcef510 con 0x55655be023f0 2023-12-01T01:04:47.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.730+0000 7f6818a3bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bcef1b0 con 0x55655be030f0 2023-12-01T01:04:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.730+0000 7f6818a3bb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655bbd6920 con 0x55655be03a70 2023-12-01T01:04:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f6818a3bb80 10 client.0 _ll_register_callbacks cb 0x55655bc3ca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f680659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be023f0 0x55655be0b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f680659c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be023f0 0x55655be0b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55300/0 (socket says 172.21.15.26:55300) 2023-12-01T01:04:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f680659c700 1 -- 172.21.15.26:0/3855002578 learned_addr learned my addr 172.21.15.26:0/3855002578 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f6806d9d700 1 --2- 172.21.15.26:0/3855002578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be03a70 0x55655be12eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f6805d9b700 1 --2- 172.21.15.26:0/3855002578 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be030f0 0x55655be0be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f680659c700 1 -- 172.21.15.26:0/3855002578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be03a70 msgr2=0x55655be12eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f680659c700 1 --2- 172.21.15.26:0/3855002578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be03a70 0x55655be12eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f680659c700 1 -- 172.21.15.26:0/3855002578 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be030f0 msgr2=0x55655be0be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f680659c700 1 --2- 172.21.15.26:0/3855002578 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be030f0 0x55655be0be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f680659c700 1 -- 172.21.15.26:0/3855002578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f800e970 con 0x55655be023f0 2023-12-01T01:04:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f680659c700 1 --2- 172.21.15.26:0/3855002578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be023f0 0x55655be0b930 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f67f8011750 tx=0x7f67f8005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28bdc658e39605b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f67edffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:47.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f67edffb700 1 -- 172.21.15.26:0/3855002578 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f801e640 con 0x55655be023f0 2023-12-01T01:04:47.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f6818a3bb80 1 -- 172.21.15.26:0/3855002578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55655bd7dd10 con 0x55655be023f0 2023-12-01T01:04:47.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f67edffb700 1 -- 172.21.15.26:0/3855002578 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f67f802e070 con 0x55655be023f0 2023-12-01T01:04:47.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f67edffb700 1 -- 172.21.15.26:0/3855002578 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67f801e7a0 con 0x55655be023f0 2023-12-01T01:04:47.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f6818a3bb80 10 client.15438 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:47.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.731+0000 7f6818a3bb80 1 -- 172.21.15.26:0/3855002578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55655bb69c60 con 0x55655be023f0 2023-12-01T01:04:47.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.732+0000 7f67edffb700 1 -- 172.21.15.26:0/3855002578 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55655bd7dd10 con 0x55655be023f0 2023-12-01T01:04:47.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.732+0000 7f67edffb700 1 -- 172.21.15.26:0/3855002578 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f67f8027630 con 0x55655be023f0 2023-12-01T01:04:47.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.732+0000 7f6818a3bb80 10 client.15438 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:47.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.732+0000 7f6818a3bb80 10 client.15438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:47.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.732+0000 7f6818a3bb80 20 client.15438 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:47.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.732+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/3855002578 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55655be17630 0x55655be19a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.732+0000 7f6818a3bb80 4 client.15438 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:04:47.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.732+0000 7f6818a3bb80 1 -- 172.21.15.26:0/3855002578 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55655bdd0e10 con 0x55655be17630 2023-12-01T01:04:47.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.732+0000 7f6805d9b700 1 --2- 172.21.15.26:0/3855002578 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55655be17630 0x55655be19a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.732+0000 7f6805d9b700 1 --2- 172.21.15.26:0/3855002578 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55655be17630 0x55655be19a50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=483cc173f8909ee server_cookie=6a5be9694703e8b1 in_seq=0 out_seq=0 2023-12-01T01:04:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.732+0000 7f67edffb700 10 client.15438 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.733+0000 7f67edffb700 1 -- 172.21.15.26:0/3855002578 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55655bdd0e10 con 0x55655be17630 2023-12-01T01:04:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.733+0000 7f67edffb700 10 client.15438 handle_command_reply: tid=0 2023-12-01T01:04:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.733+0000 7f6818a3bb80 1 client.15438 shutdown 2023-12-01T01:04:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.733+0000 7f6818a3bb80 1 -- 172.21.15.26:0/3855002578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be023f0 msgr2=0x55655be0b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.733+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/3855002578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be023f0 0x55655be0b930 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f67f8011750 tx=0x7f67f8005ee0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.733+0000 7f6818a3bb80 1 -- 172.21.15.26:0/3855002578 shutdown_connections 2023-12-01T01:04:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.733+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/3855002578 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55655be17630 0x55655be19a50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.733+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/3855002578 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be03a70 0x55655be12eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.733+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/3855002578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be023f0 0x55655be0b930 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.733+0000 7f67edffb700 0 client.15438 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.733+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/3855002578 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be030f0 0x55655be0be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.733+0000 7f6818a3bb80 1 -- 172.21.15.26:0/3855002578 >> 172.21.15.26:0/3855002578 conn(0x55655bd610d0 msgr2=0x55655bdfc0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.733+0000 7f6818a3bb80 1 -- 172.21.15.26:0/3855002578 shutdown_connections 2023-12-01T01:04:47.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.733+0000 7f6818a3bb80 1 -- 172.21.15.26:0/3855002578 wait complete. 2023-12-01T01:04:47.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.734+0000 7f6818a3bb80 20 client.15438 trim_cache size 0 max 16384 2023-12-01T01:04:47.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.750+0000 7f6818a3bb80 1 Processor -- start 2023-12-01T01:04:47.756 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.750+0000 7f6818a3bb80 1 -- start start 2023-12-01T01:04:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.750+0000 7f6818a3bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be023f0 0x55655be10e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.750+0000 7f6818a3bb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be030f0 0x55655be137a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.750+0000 7f6818a3bb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be03a70 0x55655be06330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.750+0000 7f6818a3bb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655be171b0 con 0x55655be03a70 2023-12-01T01:04:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.750+0000 7f6818a3bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655be0a0b0 con 0x55655be023f0 2023-12-01T01:04:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.750+0000 7f6818a3bb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655be095d0 con 0x55655be030f0 2023-12-01T01:04:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.750+0000 7f6806d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be03a70 0x55655be06330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.750+0000 7f6806d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be03a70 0x55655be06330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55312/0 (socket says 172.21.15.26:55312) 2023-12-01T01:04:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.751+0000 7f6806d9d700 1 -- 172.21.15.26:0/2029607947 learned_addr learned my addr 172.21.15.26:0/2029607947 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.751+0000 7f6805d9b700 1 --2- 172.21.15.26:0/2029607947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be030f0 0x55655be137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.751+0000 7f680659c700 1 --2- 172.21.15.26:0/2029607947 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be023f0 0x55655be10e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.751+0000 7f6806d9d700 1 -- 172.21.15.26:0/2029607947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be030f0 msgr2=0x55655be137a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.751+0000 7f6806d9d700 1 --2- 172.21.15.26:0/2029607947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be030f0 0x55655be137a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.757 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.751+0000 7f6806d9d700 1 -- 172.21.15.26:0/2029607947 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be023f0 msgr2=0x55655be10e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.751+0000 7f6806d9d700 1 --2- 172.21.15.26:0/2029607947 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be023f0 0x55655be10e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.751+0000 7f6806d9d700 1 -- 172.21.15.26:0/2029607947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55655bba7250 con 0x55655be03a70 2023-12-01T01:04:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.751+0000 7f6805d9b700 1 --2- 172.21.15.26:0/2029607947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be030f0 0x55655be137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.751+0000 7f6806d9d700 1 --2- 172.21.15.26:0/2029607947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be03a70 0x55655be06330 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6800009e90 tx=0x7f6800009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4184c1115f2ccbb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.751+0000 7f67f57fa700 1 -- 172.21.15.26:0/2029607947 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800007ea0 con 0x55655be03a70 2023-12-01T01:04:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.751+0000 7f67f57fa700 1 -- 172.21.15.26:0/2029607947 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f680000f040 con 0x55655be03a70 2023-12-01T01:04:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.751+0000 7f67f57fa700 1 -- 172.21.15.26:0/2029607947 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680001f970 con 0x55655be03a70 2023-12-01T01:04:47.758 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 -- 172.21.15.26:0/2029607947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be03a70 msgr2=0x55655be06330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/2029607947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be03a70 0x55655be06330 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6800009e90 tx=0x7f6800009ec0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 -- 172.21.15.26:0/2029607947 shutdown_connections 2023-12-01T01:04:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/2029607947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be03a70 0x55655be06330 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/2029607947 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be023f0 0x55655be10e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/2029607947 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be030f0 0x55655be137a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 -- 172.21.15.26:0/2029607947 >> 172.21.15.26:0/2029607947 conn(0x55655bd610d0 msgr2=0x55655bdfc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 -- 172.21.15.26:0/2029607947 shutdown_connections 2023-12-01T01:04:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 -- 172.21.15.26:0/2029607947 wait complete. 2023-12-01T01:04:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 -- start start 2023-12-01T01:04:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 Processor -- start 2023-12-01T01:04:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be023f0 0x55655be10a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be030f0 0x55655be0f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be03a70 0x55655be0f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655be0fb00 con 0x55655be030f0 2023-12-01T01:04:47.759 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655be0fc70 con 0x55655be03a70 2023-12-01T01:04:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55655be0fe30 con 0x55655be023f0 2023-12-01T01:04:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.752+0000 7f6818a3bb80 10 client.0 _ll_register_callbacks cb 0x7f67f800eb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f6805d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be030f0 0x55655be0f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f6805d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be030f0 0x55655be0f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55316/0 (socket says 172.21.15.26:55316) 2023-12-01T01:04:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f6805d9b700 1 -- 172.21.15.26:0/309367391 learned_addr learned my addr 172.21.15.26:0/309367391 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f6806d9d700 1 --2- 172.21.15.26:0/309367391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be03a70 0x55655be0f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f680659c700 1 --2- 172.21.15.26:0/309367391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be023f0 0x55655be10a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f6805d9b700 1 -- 172.21.15.26:0/309367391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be023f0 msgr2=0x55655be10a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f6805d9b700 1 --2- 172.21.15.26:0/309367391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be023f0 0x55655be10a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f6805d9b700 1 -- 172.21.15.26:0/309367391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be03a70 msgr2=0x55655be0f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f6805d9b700 1 --2- 172.21.15.26:0/309367391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be03a70 0x55655be0f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f6805d9b700 1 -- 172.21.15.26:0/309367391 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6800009b10 con 0x55655be030f0 2023-12-01T01:04:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f6805d9b700 1 --2- 172.21.15.26:0/309367391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be030f0 0x55655be0f080 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0cae20 tx=0x7f67fc0cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4d87e36ef41997 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f67edffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:47.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f67edffb700 1 -- 172.21.15.26:0/309367391 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc098aa0 con 0x55655be030f0 2023-12-01T01:04:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f67edffb700 1 -- 172.21.15.26:0/309367391 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f67fc099d90 con 0x55655be030f0 2023-12-01T01:04:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f6818a3bb80 1 -- 172.21.15.26:0/309367391 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f67f8011c60 con 0x55655be030f0 2023-12-01T01:04:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f67edffb700 1 -- 172.21.15.26:0/309367391 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67fc099f50 con 0x55655be030f0 2023-12-01T01:04:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f6818a3bb80 10 client.15444 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.753+0000 7f6818a3bb80 1 -- 172.21.15.26:0/309367391 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55655bb7f2b0 con 0x55655be030f0 2023-12-01T01:04:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.754+0000 7f67edffb700 1 -- 172.21.15.26:0/309367391 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f67f8011c60 con 0x55655be030f0 2023-12-01T01:04:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.754+0000 7f67edffb700 1 -- 172.21.15.26:0/309367391 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f67fc096690 con 0x55655be030f0 2023-12-01T01:04:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.754+0000 7f6818a3bb80 10 client.15444 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.754+0000 7f6818a3bb80 10 client.15444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.754+0000 7f6818a3bb80 20 client.15444 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.754+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/309367391 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55655be6a3e0 0x55655be6c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.754+0000 7f6818a3bb80 4 client.15444 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-01T01:04:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.754+0000 7f6818a3bb80 1 -- 172.21.15.26:0/309367391 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55655bd4bd40 con 0x55655be6a3e0 2023-12-01T01:04:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.754+0000 7f680659c700 1 --2- 172.21.15.26:0/309367391 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55655be6a3e0 0x55655be6c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.754+0000 7f680659c700 1 --2- 172.21.15.26:0/309367391 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55655be6a3e0 0x55655be6c800 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c50b5e4fc6921e4 server_cookie=64f3243519d1461d in_seq=0 out_seq=0 2023-12-01T01:04:47.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.754+0000 7f67edffb700 10 client.15444 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:47.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f67edffb700 1 -- 172.21.15.26:0/309367391 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55655bd4bd40 con 0x55655be6a3e0 2023-12-01T01:04:47.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f67edffb700 10 client.15444 handle_command_reply: tid=0 2023-12-01T01:04:47.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f6818a3bb80 1 client.15444 shutdown 2023-12-01T01:04:47.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f6818a3bb80 1 -- 172.21.15.26:0/309367391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be030f0 msgr2=0x55655be0f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:47.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/309367391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be030f0 0x55655be0f080 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0cae20 tx=0x7f67fc0cc040 comp rx=0 tx=0).stop 2023-12-01T01:04:47.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f6818a3bb80 1 -- 172.21.15.26:0/309367391 shutdown_connections 2023-12-01T01:04:47.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/309367391 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55655be6a3e0 0x55655be6c800 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/309367391 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55655be03a70 0x55655be0f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/309367391 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55655be023f0 0x55655be10a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f67edffb700 0 client.15444 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:47.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f6818a3bb80 1 --2- 172.21.15.26:0/309367391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55655be030f0 0x55655be0f080 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f6818a3bb80 1 -- 172.21.15.26:0/309367391 >> 172.21.15.26:0/309367391 conn(0x55655bd610d0 msgr2=0x55655be06330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:47.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f6818a3bb80 1 -- 172.21.15.26:0/309367391 shutdown_connections 2023-12-01T01:04:47.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f6818a3bb80 1 -- 172.21.15.26:0/309367391 wait complete. 2023-12-01T01:04:47.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f6818a3bb80 20 client.15444 trim_cache size 0 max 16384 2023-12-01T01:04:47.763 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:04:47.763 INFO:teuthology.orchestra.run.smithi026.stdout: "status": "no active scrubs running", 2023-12-01T01:04:47.763 INFO:teuthology.orchestra.run.smithi026.stdout: "scrubs": {} 2023-12-01T01:04:47.763 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:04:47.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f680c8ab700 1 -- 172.21.15.26:0/3922189428 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f67f00a0520 msgr2=0x7f67f00a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:47.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f680c8ab700 1 --2- 172.21.15.26:0/3922189428 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f67f00a0520 0x7f67f00a29e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f67f8005950 tx=0x7f67f80058e0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f680c8ab700 1 -- 172.21.15.26:0/3922189428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6808104190 msgr2=0x7f68080ff810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:47.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f680c8ab700 1 --2- 172.21.15.26:0/3922189428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6808104190 0x7f68080ff810 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0036f0 tx=0x7f67fc00f690 comp rx=0 tx=0).stop 2023-12-01T01:04:47.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f680c8ab700 1 -- 172.21.15.26:0/3922189428 shutdown_connections 2023-12-01T01:04:47.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f680c8ab700 1 --2- 172.21.15.26:0/3922189428 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f67f00a0520 0x7f67f00a29e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f680c8ab700 1 --2- 172.21.15.26:0/3922189428 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6808106ac0 0x7f68080ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f680c8ab700 1 --2- 172.21.15.26:0/3922189428 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6808101860 0x7f68081011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f680c8ab700 1 --2- 172.21.15.26:0/3922189428 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6808104190 0x7f68080ff810 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.755+0000 7f680c8ab700 1 -- 172.21.15.26:0/3922189428 >> 172.21.15.26:0/3922189428 conn(0x7f68080fb1f0 msgr2=0x7f68081024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:47.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.756+0000 7f680c8ab700 1 -- 172.21.15.26:0/3922189428 shutdown_connections 2023-12-01T01:04:47.765 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.756+0000 7f680c8ab700 1 -- 172.21.15.26:0/3922189428 wait complete. 2023-12-01T01:04:47.768 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-01T01:04:47.769 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:04:47.937 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.934+0000 7fadb053b700 1 -- 172.21.15.26:0/3834253343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fada80ffc70 msgr2=0x7fada8100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:47.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.934+0000 7fadb053b700 1 --2- 172.21.15.26:0/3834253343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fada80ffc70 0x7fada8100090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fada40098f0 tx=0x7fada4009c00 comp rx=0 tx=0).stop 2023-12-01T01:04:47.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.934+0000 7fadb053b700 1 -- 172.21.15.26:0/3834253343 shutdown_connections 2023-12-01T01:04:47.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.934+0000 7fadb053b700 1 --2- 172.21.15.26:0/3834253343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fada8101800 0x7fada81080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.934+0000 7fadb053b700 1 --2- 172.21.15.26:0/3834253343 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fada80ffc70 0x7fada8100090 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.934+0000 7fadb053b700 1 --2- 172.21.15.26:0/3834253343 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fada8100e60 0x7fada81012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.934+0000 7fadb053b700 1 -- 172.21.15.26:0/3834253343 >> 172.21.15.26:0/3834253343 conn(0x7fada80fb1c0 msgr2=0x7fada80fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:47.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.934+0000 7fadb053b700 1 -- 172.21.15.26:0/3834253343 shutdown_connections 2023-12-01T01:04:47.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.934+0000 7fadb053b700 1 -- 172.21.15.26:0/3834253343 wait complete. 2023-12-01T01:04:47.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.935+0000 7fadb053b700 1 Processor -- start 2023-12-01T01:04:47.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.935+0000 7fadb053b700 1 -- start start 2023-12-01T01:04:47.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.935+0000 7fadb053b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fada80ffc70 0x7fada8068a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.938 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.935+0000 7fadb053b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fada8100e60 0x7fada819b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.935+0000 7fadb053b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fada8101800 0x7fada819df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.935+0000 7fadb053b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada819e6d0 con 0x7fada8100e60 2023-12-01T01:04:47.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.935+0000 7fadb053b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada819e840 con 0x7fada80ffc70 2023-12-01T01:04:47.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.935+0000 7fadb053b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada819ea00 con 0x7fada8101800 2023-12-01T01:04:47.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.935+0000 7fadadad6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fada8100e60 0x7fada819b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.935+0000 7fadadad6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fada8100e60 0x7fada819b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55330/0 (socket says 172.21.15.26:55330) 2023-12-01T01:04:47.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.935+0000 7fadadad6700 1 -- 172.21.15.26:0/2750536606 learned_addr learned my addr 172.21.15.26:0/2750536606 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:47.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.935+0000 7fadae2d7700 1 --2- 172.21.15.26:0/2750536606 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fada80ffc70 0x7fada8068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.935+0000 7fadaead8700 1 --2- 172.21.15.26:0/2750536606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fada8101800 0x7fada819df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.936+0000 7fadadad6700 1 -- 172.21.15.26:0/2750536606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fada8101800 msgr2=0x7fada819df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:47.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.936+0000 7fadadad6700 1 --2- 172.21.15.26:0/2750536606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fada8101800 0x7fada819df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.939 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.936+0000 7fadadad6700 1 -- 172.21.15.26:0/2750536606 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fada80ffc70 msgr2=0x7fada8068a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.936+0000 7fadadad6700 1 --2- 172.21.15.26:0/2750536606 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fada80ffc70 0x7fada8068a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.936+0000 7fadadad6700 1 -- 172.21.15.26:0/2750536606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada4009520 con 0x7fada8100e60 2023-12-01T01:04:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.936+0000 7fadaead8700 1 --2- 172.21.15.26:0/2750536606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fada8101800 0x7fada819df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.936+0000 7fadadad6700 1 --2- 172.21.15.26:0/2750536606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fada8100e60 0x7fada819b8b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fad9800d950 tx=0x7fad9800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.936+0000 7fad9f7fe700 1 -- 172.21.15.26:0/2750536606 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98009940 con 0x7fada8100e60 2023-12-01T01:04:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.936+0000 7fadb053b700 1 -- 172.21.15.26:0/2750536606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada819ece0 con 0x7fada8100e60 2023-12-01T01:04:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.936+0000 7fad9f7fe700 1 -- 172.21.15.26:0/2750536606 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fad98010460 con 0x7fada8100e60 2023-12-01T01:04:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.936+0000 7fad9f7fe700 1 -- 172.21.15.26:0/2750536606 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9800f620 con 0x7fada8100e60 2023-12-01T01:04:47.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.936+0000 7fadb053b700 1 -- 172.21.15.26:0/2750536606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada819f1a0 con 0x7fada8100e60 2023-12-01T01:04:47.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.937+0000 7fadb053b700 1 -- 172.21.15.26:0/2750536606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada8106bf0 con 0x7fada8100e60 2023-12-01T01:04:47.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.938+0000 7fad9f7fe700 1 -- 172.21.15.26:0/2750536606 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fad98010960 con 0x7fada8100e60 2023-12-01T01:04:47.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.939+0000 7fad9f7fe700 1 --2- 172.21.15.26:0/2750536606 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fad940a0570 0x7fad940a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:47.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.939+0000 7fadae2d7700 1 --2- 172.21.15.26:0/2750536606 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fad940a0570 0x7fad940a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:47.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.939+0000 7fad9f7fe700 1 -- 172.21.15.26:0/2750536606 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fad980cb840 con 0x7fada8100e60 2023-12-01T01:04:47.942 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.939+0000 7fadae2d7700 1 --2- 172.21.15.26:0/2750536606 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fad940a0570 0x7fad940a2a30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fada4009fd0 tx=0x7fada401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:47.943 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:47.942+0000 7fad9f7fe700 1 -- 172.21.15.26:0/2750536606 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fad980953f0 con 0x7fada8100e60 2023-12-01T01:04:48.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.202+0000 7fadb053b700 1 -- 172.21.15.26:0/2750536606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fada802cc70 con 0x7fada8100e60 2023-12-01T01:04:48.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.203+0000 7fad9f7fe700 1 -- 172.21.15.26:0/2750536606 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10777 (secure 0 0 0) 0x7fad98020090 con 0x7fada8100e60 2023-12-01T01:04:48.204 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:04:48.204 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6841/3515135915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6840","nonce":3515135915},{"type":"v1","addr":"172.21.15.26:6841","nonce":3515135915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-01T01:02:47.252972+0000","modified":"2023-12-01T01:02:52.326753+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24493,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.93:6837/3333520218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3333520218},{"type":"v1","addr":"172.21.15.93:6837","nonce":3333520218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6839/3364532241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":3364532241},{"type":"v1","addr":"172.21.15.93:6839","nonce":3364532241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T01:04:48.206 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.205+0000 7fadb053b700 1 -- 172.21.15.26:0/2750536606 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fad940a0570 msgr2=0x7fad940a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.205+0000 7fadb053b700 1 --2- 172.21.15.26:0/2750536606 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fad940a0570 0x7fad940a2a30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fada4009fd0 tx=0x7fada401a040 comp rx=0 tx=0).stop 2023-12-01T01:04:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.205+0000 7fadb053b700 1 -- 172.21.15.26:0/2750536606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fada8100e60 msgr2=0x7fada819b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.205+0000 7fadb053b700 1 --2- 172.21.15.26:0/2750536606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fada8100e60 0x7fada819b8b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fad9800d950 tx=0x7fad9800dc60 comp rx=0 tx=0).stop 2023-12-01T01:04:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.205+0000 7fadb053b700 1 -- 172.21.15.26:0/2750536606 shutdown_connections 2023-12-01T01:04:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.205+0000 7fadb053b700 1 --2- 172.21.15.26:0/2750536606 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fad940a0570 0x7fad940a2a30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.205+0000 7fadb053b700 1 --2- 172.21.15.26:0/2750536606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fada8101800 0x7fada819df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.205+0000 7fadb053b700 1 --2- 172.21.15.26:0/2750536606 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fada80ffc70 0x7fada8068a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.205+0000 7fadb053b700 1 --2- 172.21.15.26:0/2750536606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fada8100e60 0x7fada819b8b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.205+0000 7fadb053b700 1 -- 172.21.15.26:0/2750536606 >> 172.21.15.26:0/2750536606 conn(0x7fada80fb1c0 msgr2=0x7fada80fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.205+0000 7fadb053b700 1 -- 172.21.15.26:0/2750536606 shutdown_connections 2023-12-01T01:04:48.207 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.205+0000 7fadb053b700 1 -- 172.21.15.26:0/2750536606 wait complete. 2023-12-01T01:04:48.208 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 23 2023-12-01T01:04:48.219 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-01T01:04:48.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.346+0000 7f05340d4700 1 -- 172.21.15.26:0/4230591733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f052c100da0 msgr2=0x7f052c1011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.346+0000 7f05340d4700 1 --2- 172.21.15.26:0/4230591733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f052c100da0 0x7f052c1011c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f05280099c0 tx=0x7f0528009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.346+0000 7f05340d4700 1 -- 172.21.15.26:0/4230591733 shutdown_connections 2023-12-01T01:04:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.346+0000 7f05340d4700 1 --2- 172.21.15.26:0/4230591733 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f052c102930 0x7f052c1091e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.346+0000 7f05340d4700 1 --2- 172.21.15.26:0/4230591733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f052c100da0 0x7f052c1011c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.346+0000 7f05340d4700 1 --2- 172.21.15.26:0/4230591733 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f052c101f90 0x7f052c1023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.346+0000 7f05340d4700 1 -- 172.21.15.26:0/4230591733 >> 172.21.15.26:0/4230591733 conn(0x7f052c0fc310 msgr2=0x7f052c0fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.346+0000 7f05340d4700 1 -- 172.21.15.26:0/4230591733 shutdown_connections 2023-12-01T01:04:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.346+0000 7f05340d4700 1 -- 172.21.15.26:0/4230591733 wait complete. 2023-12-01T01:04:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f05340d4700 1 Processor -- start 2023-12-01T01:04:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f05340d4700 1 -- start start 2023-12-01T01:04:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f05340d4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f052c100da0 0x7f052c196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f05340d4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f052c101f90 0x7f052c197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f05340d4700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f052c102930 0x7f052c19e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f05340d4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c19e6b0 con 0x7f052c101f90 2023-12-01T01:04:48.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f05340d4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c19e7f0 con 0x7f052c100da0 2023-12-01T01:04:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f05340d4700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c19e980 con 0x7f052c102930 2023-12-01T01:04:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f053166f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f052c101f90 0x7f052c197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f053166f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f052c101f90 0x7f052c197070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55344/0 (socket says 172.21.15.26:55344) 2023-12-01T01:04:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f053166f700 1 -- 172.21.15.26:0/2614911079 learned_addr learned my addr 172.21.15.26:0/2614911079 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f0532671700 1 --2- 172.21.15.26:0/2614911079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f052c102930 0x7f052c19e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f0531e70700 1 --2- 172.21.15.26:0/2614911079 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f052c100da0 0x7f052c196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f053166f700 1 -- 172.21.15.26:0/2614911079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f052c102930 msgr2=0x7f052c19e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f053166f700 1 --2- 172.21.15.26:0/2614911079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f052c102930 0x7f052c19e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f053166f700 1 -- 172.21.15.26:0/2614911079 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f052c100da0 msgr2=0x7f052c196b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f053166f700 1 --2- 172.21.15.26:0/2614911079 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f052c100da0 0x7f052c196b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f053166f700 1 -- 172.21.15.26:0/2614911079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05280095f0 con 0x7f052c101f90 2023-12-01T01:04:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.347+0000 7f053166f700 1 --2- 172.21.15.26:0/2614911079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f052c101f90 0x7f052c197070 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f051c00c920 tx=0x7f051c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.348+0000 7f0522ffd700 1 -- 172.21.15.26:0/2614911079 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c004a30 con 0x7f052c101f90 2023-12-01T01:04:48.351 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.348+0000 7f05340d4700 1 -- 172.21.15.26:0/2614911079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052c19ec60 con 0x7f052c101f90 2023-12-01T01:04:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.348+0000 7f0522ffd700 1 -- 172.21.15.26:0/2614911079 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f051c005500 con 0x7f052c101f90 2023-12-01T01:04:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.348+0000 7f0522ffd700 1 -- 172.21.15.26:0/2614911079 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c007c40 con 0x7f052c101f90 2023-12-01T01:04:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.348+0000 7f05340d4700 1 -- 172.21.15.26:0/2614911079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052c19f170 con 0x7f052c101f90 2023-12-01T01:04:48.352 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.351+0000 7f0522ffd700 1 -- 172.21.15.26:0/2614911079 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f051c005000 con 0x7f052c101f90 2023-12-01T01:04:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.351+0000 7f0522ffd700 1 --2- 172.21.15.26:0/2614911079 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f05180a0520 0x7f05180a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.351+0000 7f0522ffd700 1 -- 172.21.15.26:0/2614911079 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f051c0cb520 con 0x7f052c101f90 2023-12-01T01:04:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.351+0000 7f0531e70700 1 --2- 172.21.15.26:0/2614911079 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f05180a0520 0x7f05180a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.352+0000 7f0540264b80 1 Processor -- start 2023-12-01T01:04:48.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.352+0000 7f0540264b80 1 -- start start 2023-12-01T01:04:48.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.352+0000 7f0531e70700 1 --2- 172.21.15.26:0/2614911079 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f05180a0520 0x7f05180a29e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0528006010 tx=0x7f0528003700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.352+0000 7f0540264b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ad0f0 0x56205e9ad530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.352+0000 7f0540264b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ada70 0x56205e9abe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.352+0000 7f0540264b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.352+0000 7f0540264b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56205e903a10 con 0x56205e9ac3f0 2023-12-01T01:04:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.352+0000 7f0540264b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56205e9013d0 con 0x56205e9ad0f0 2023-12-01T01:04:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.352+0000 7f0540264b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56205e8fccc0 con 0x56205e9ada70 2023-12-01T01:04:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.353+0000 7f0532671700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.353+0000 7f053166f700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ada70 0x56205e9abe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.353+0000 7f0532671700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55354/0 (socket says 172.21.15.26:55354) 2023-12-01T01:04:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.353+0000 7f0532671700 1 -- 172.21.15.26:0/349840675 learned_addr learned my addr 172.21.15.26:0/349840675 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.353+0000 7f0531e70700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ad0f0 0x56205e9ad530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.353+0000 7f0532671700 1 -- 172.21.15.26:0/349840675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ada70 msgr2=0x56205e9abe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.353+0000 7f0532671700 1 --2- 172.21.15.26:0/349840675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ada70 0x56205e9abe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.353+0000 7f0532671700 1 -- 172.21.15.26:0/349840675 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ad0f0 msgr2=0x56205e9ad530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.353+0000 7f0532671700 1 --2- 172.21.15.26:0/349840675 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ad0f0 0x56205e9ad530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.353+0000 7f0532671700 1 -- 172.21.15.26:0/349840675 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56205e72ade0 con 0x56205e9ac3f0 2023-12-01T01:04:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.353+0000 7f0532671700 1 --2- 172.21.15.26:0/349840675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9ac870 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f052400f5a0 tx=0x7f052400f8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3993cbe5c61060d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.353+0000 7f0517fff700 1 -- 172.21.15.26:0/349840675 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524004bb0 con 0x56205e9ac3f0 2023-12-01T01:04:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.353+0000 7f0517fff700 1 -- 172.21.15.26:0/349840675 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0524004d10 con 0x56205e9ac3f0 2023-12-01T01:04:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.353+0000 7f0517fff700 1 -- 172.21.15.26:0/349840675 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524005180 con 0x56205e9ac3f0 2023-12-01T01:04:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.354+0000 7f0540264b80 1 -- 172.21.15.26:0/349840675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 msgr2=0x56205e9ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.354+0000 7f0540264b80 1 --2- 172.21.15.26:0/349840675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9ac870 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f052400f5a0 tx=0x7f052400f8b0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.354+0000 7f0540264b80 1 -- 172.21.15.26:0/349840675 shutdown_connections 2023-12-01T01:04:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.354+0000 7f0540264b80 1 --2- 172.21.15.26:0/349840675 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9ac870 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.354+0000 7f0540264b80 1 --2- 172.21.15.26:0/349840675 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ad0f0 0x56205e9ad530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.354+0000 7f0540264b80 1 --2- 172.21.15.26:0/349840675 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ada70 0x56205e9abe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.354+0000 7f0540264b80 1 -- 172.21.15.26:0/349840675 >> 172.21.15.26:0/349840675 conn(0x56205e90b0d0 msgr2=0x56205e9a6940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.354+0000 7f0540264b80 1 -- 172.21.15.26:0/349840675 shutdown_connections 2023-12-01T01:04:48.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.354+0000 7f0540264b80 1 -- 172.21.15.26:0/349840675 wait complete. 2023-12-01T01:04:48.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.355+0000 7f0540264b80 1 -- start start 2023-12-01T01:04:48.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.355+0000 7f0540264b80 1 Processor -- start 2023-12-01T01:04:48.361 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.355+0000 7f0540264b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9b5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.355+0000 7f0540264b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ad0f0 0x56205e9b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.355+0000 7f0540264b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ada70 0x56205e9bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.355+0000 7f0540264b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56205e899510 con 0x56205e9ac3f0 2023-12-01T01:04:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.355+0000 7f0540264b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56205e8991b0 con 0x56205e9ada70 2023-12-01T01:04:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.355+0000 7f0540264b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56205e780920 con 0x56205e9ad0f0 2023-12-01T01:04:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.355+0000 7f0540264b80 10 client.0 _ll_register_callbacks cb 0x56205e7e6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.355+0000 7f0531e70700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.355+0000 7f0531e70700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9b5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55356/0 (socket says 172.21.15.26:55356) 2023-12-01T01:04:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.355+0000 7f0531e70700 1 -- 172.21.15.26:0/2517444175 learned_addr learned my addr 172.21.15.26:0/2517444175 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.355+0000 7f0532671700 1 --2- 172.21.15.26:0/2517444175 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ada70 0x56205e9bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.356+0000 7f053166f700 1 --2- 172.21.15.26:0/2517444175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ad0f0 0x56205e9b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.356+0000 7f0531e70700 1 -- 172.21.15.26:0/2517444175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ad0f0 msgr2=0x56205e9b5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.362 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.356+0000 7f0531e70700 1 --2- 172.21.15.26:0/2517444175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ad0f0 0x56205e9b5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.356+0000 7f0531e70700 1 -- 172.21.15.26:0/2517444175 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ada70 msgr2=0x56205e9bcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.356+0000 7f0531e70700 1 --2- 172.21.15.26:0/2517444175 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ada70 0x56205e9bcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.356+0000 7f0531e70700 1 -- 172.21.15.26:0/2517444175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052400f1d0 con 0x56205e9ac3f0 2023-12-01T01:04:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.356+0000 7f053166f700 1 --2- 172.21.15.26:0/2517444175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ad0f0 0x56205e9b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.356+0000 7f0531e70700 1 --2- 172.21.15.26:0/2517444175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9b5970 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f052800b580 tx=0x7f0528009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258ef17300e04e11 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.356+0000 7f05157fa700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.357+0000 7f05157fa700 1 -- 172.21.15.26:0/2517444175 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05280041a0 con 0x56205e9ac3f0 2023-12-01T01:04:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.357+0000 7f05157fa700 1 -- 172.21.15.26:0/2517444175 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0528004500 con 0x56205e9ac3f0 2023-12-01T01:04:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.357+0000 7f0540264b80 1 -- 172.21.15.26:0/2517444175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56205e927d10 con 0x56205e9ac3f0 2023-12-01T01:04:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.357+0000 7f05157fa700 1 -- 172.21.15.26:0/2517444175 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05280046c0 con 0x56205e9ac3f0 2023-12-01T01:04:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.357+0000 7f0540264b80 10 client.15462 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.357+0000 7f0540264b80 1 -- 172.21.15.26:0/2517444175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56205e713c60 con 0x56205e9ac3f0 2023-12-01T01:04:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.357+0000 7f05157fa700 1 -- 172.21.15.26:0/2517444175 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0528040020 con 0x56205e9ac3f0 2023-12-01T01:04:48.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.357+0000 7f05157fa700 1 -- 172.21.15.26:0/2517444175 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f052802f070 con 0x56205e9ac3f0 2023-12-01T01:04:48.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.357+0000 7f0540264b80 10 client.15462 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:48.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.357+0000 7f0540264b80 10 client.15462 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-12-01T01:04:48.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.357+0000 7f0540264b80 20 client.15462 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:48.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.357+0000 7f0540264b80 1 --2- 172.21.15.26:0/2517444175 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x56205e9c1740 0x56205e9c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.357+0000 7f0540264b80 4 client.15462 mds_command: new command op to 24481 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:04:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.357+0000 7f0540264b80 1 -- 172.21.15.26:0/2517444175 --> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56205e97ae10 con 0x56205e9c1740 2023-12-01T01:04:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.358+0000 7f053166f700 1 --2- 172.21.15.26:0/2517444175 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x56205e9c1740 0x56205e9c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.358+0000 7f053166f700 1 --2- 172.21.15.26:0/2517444175 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x56205e9c1740 0x56205e9c3b60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4064027e4a307b11 server_cookie=4c3924adc64ab76f in_seq=0 out_seq=0 2023-12-01T01:04:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.358+0000 7f05157fa700 10 client.15462 ms_handle_connect on v2:172.21.15.116:6838/261568108 2023-12-01T01:04:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.359+0000 7f05157fa700 1 -- 172.21.15.26:0/2517444175 <== mds.2 v2:172.21.15.116:6838/261568108 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x56205e97ae10 con 0x56205e9c1740 2023-12-01T01:04:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.359+0000 7f05157fa700 10 client.15462 handle_command_reply: tid=0 2023-12-01T01:04:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.359+0000 7f0540264b80 1 client.15462 shutdown 2023-12-01T01:04:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.359+0000 7f0540264b80 1 -- 172.21.15.26:0/2517444175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 msgr2=0x56205e9b5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.359+0000 7f0540264b80 1 --2- 172.21.15.26:0/2517444175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9b5970 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f052800b580 tx=0x7f0528009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.359+0000 7f0540264b80 1 -- 172.21.15.26:0/2517444175 shutdown_connections 2023-12-01T01:04:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.359+0000 7f0540264b80 1 --2- 172.21.15.26:0/2517444175 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x56205e9c1740 0x56205e9c3b60 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.359+0000 7f0540264b80 1 --2- 172.21.15.26:0/2517444175 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ada70 0x56205e9bcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.359+0000 7f05157fa700 0 client.15462 ms_handle_reset on v2:172.21.15.116:6838/261568108 2023-12-01T01:04:48.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.359+0000 7f0540264b80 1 --2- 172.21.15.26:0/2517444175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9b5970 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.359+0000 7f0540264b80 1 --2- 172.21.15.26:0/2517444175 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ad0f0 0x56205e9b5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.359+0000 7f0540264b80 1 -- 172.21.15.26:0/2517444175 >> 172.21.15.26:0/2517444175 conn(0x56205e90b0d0 msgr2=0x56205e9a60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.359+0000 7f0540264b80 1 -- 172.21.15.26:0/2517444175 shutdown_connections 2023-12-01T01:04:48.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.359+0000 7f0540264b80 1 -- 172.21.15.26:0/2517444175 wait complete. 2023-12-01T01:04:48.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.359+0000 7f0540264b80 20 client.15462 trim_cache size 0 max 16384 2023-12-01T01:04:48.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0540264b80 1 Processor -- start 2023-12-01T01:04:48.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0540264b80 1 -- start start 2023-12-01T01:04:48.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0540264b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9a6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0540264b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ad0f0 0x56205e9bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0540264b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ada70 0x56205e9b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0540264b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56205e9b5540 con 0x56205e9ac3f0 2023-12-01T01:04:48.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0540264b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56205e9b4e50 con 0x56205e9ad0f0 2023-12-01T01:04:48.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0540264b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56205e99ebe0 con 0x56205e9ada70 2023-12-01T01:04:48.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0531e70700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0531e70700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9a6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55364/0 (socket says 172.21.15.26:55364) 2023-12-01T01:04:48.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0531e70700 1 -- 172.21.15.26:0/3108856174 learned_addr learned my addr 172.21.15.26:0/3108856174 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:48.375 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0532671700 1 --2- 172.21.15.26:0/3108856174 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ada70 0x56205e9b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0531e70700 1 -- 172.21.15.26:0/3108856174 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ada70 msgr2=0x56205e9b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0531e70700 1 --2- 172.21.15.26:0/3108856174 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ada70 0x56205e9b02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0531e70700 1 -- 172.21.15.26:0/3108856174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ad0f0 msgr2=0x56205e9bceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0531e70700 1 --2- 172.21.15.26:0/3108856174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ad0f0 0x56205e9bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.372+0000 7f0531e70700 1 -- 172.21.15.26:0/3108856174 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56205e751250 con 0x56205e9ac3f0 2023-12-01T01:04:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.373+0000 7f0531e70700 1 --2- 172.21.15.26:0/3108856174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9a6910 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0528009f50 tx=0x7f052803cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23ab2518e3a0411 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.373+0000 7f0520ff9700 1 -- 172.21.15.26:0/3108856174 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528004220 con 0x56205e9ac3f0 2023-12-01T01:04:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.373+0000 7f0520ff9700 1 -- 172.21.15.26:0/3108856174 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0528028070 con 0x56205e9ac3f0 2023-12-01T01:04:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.373+0000 7f0520ff9700 1 -- 172.21.15.26:0/3108856174 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052800f460 con 0x56205e9ac3f0 2023-12-01T01:04:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.373+0000 7f0540264b80 1 -- 172.21.15.26:0/3108856174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 msgr2=0x56205e9a6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.373+0000 7f0540264b80 1 --2- 172.21.15.26:0/3108856174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9a6910 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f0528009f50 tx=0x7f052803cac0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.373+0000 7f0540264b80 1 -- 172.21.15.26:0/3108856174 shutdown_connections 2023-12-01T01:04:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.373+0000 7f0540264b80 1 --2- 172.21.15.26:0/3108856174 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ada70 0x56205e9b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.373+0000 7f0540264b80 1 --2- 172.21.15.26:0/3108856174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ac3f0 0x56205e9a6910 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.376 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.373+0000 7f0540264b80 1 --2- 172.21.15.26:0/3108856174 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ad0f0 0x56205e9bceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.373+0000 7f0540264b80 1 -- 172.21.15.26:0/3108856174 >> 172.21.15.26:0/3108856174 conn(0x56205e90b0d0 msgr2=0x56205e9b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.373+0000 7f0540264b80 1 -- 172.21.15.26:0/3108856174 shutdown_connections 2023-12-01T01:04:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.373+0000 7f0540264b80 1 -- 172.21.15.26:0/3108856174 wait complete. 2023-12-01T01:04:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.374+0000 7f0540264b80 1 -- start start 2023-12-01T01:04:48.377 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.374+0000 7f0540264b80 1 Processor -- start 2023-12-01T01:04:48.380 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.374+0000 7f0540264b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ac3f0 0x56205e9b8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.374+0000 7f0540264b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ad0f0 0x56205e9b9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.374+0000 7f0540264b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ada70 0x56205e9bc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.374+0000 7f0540264b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56205e9bc9b0 con 0x56205e9ada70 2023-12-01T01:04:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.374+0000 7f0540264b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56205e9bcb20 con 0x56205e9ad0f0 2023-12-01T01:04:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.374+0000 7f0540264b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56205e9bcce0 con 0x56205e9ac3f0 2023-12-01T01:04:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.374+0000 7f0540264b80 10 client.0 _ll_register_callbacks cb 0x56205e7e6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.374+0000 7f0532671700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ada70 0x56205e9bc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.374+0000 7f0532671700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ada70 0x56205e9bc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55374/0 (socket says 172.21.15.26:55374) 2023-12-01T01:04:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.374+0000 7f0531e70700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ac3f0 0x56205e9b8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.374+0000 7f0532671700 1 -- 172.21.15.26:0/1603037097 learned_addr learned my addr 172.21.15.26:0/1603037097 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.375+0000 7f053166f700 1 --2- 172.21.15.26:0/1603037097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ad0f0 0x56205e9b9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.375+0000 7f0532671700 1 -- 172.21.15.26:0/1603037097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ac3f0 msgr2=0x56205e9b8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.375+0000 7f0532671700 1 --2- 172.21.15.26:0/1603037097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ac3f0 0x56205e9b8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.381 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.375+0000 7f0532671700 1 -- 172.21.15.26:0/1603037097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ad0f0 msgr2=0x56205e9b9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.375+0000 7f0532671700 1 --2- 172.21.15.26:0/1603037097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ad0f0 0x56205e9b9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.375+0000 7f0532671700 1 -- 172.21.15.26:0/1603037097 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56205e713c60 con 0x56205e9ada70 2023-12-01T01:04:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.375+0000 7f0531e70700 1 --2- 172.21.15.26:0/1603037097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ac3f0 0x56205e9b8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:04:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.375+0000 7f0532671700 1 --2- 172.21.15.26:0/1603037097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ada70 0x56205e9bc470 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0524017040 tx=0x7f05240146a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c0f73f544e014e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.375+0000 7f05157fa700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.375+0000 7f05157fa700 1 -- 172.21.15.26:0/1603037097 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524007690 con 0x56205e9ada70 2023-12-01T01:04:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.375+0000 7f0540264b80 1 -- 172.21.15.26:0/1603037097 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0524004d10 con 0x56205e9ada70 2023-12-01T01:04:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.375+0000 7f05157fa700 1 -- 172.21.15.26:0/1603037097 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0524014a20 con 0x56205e9ada70 2023-12-01T01:04:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.375+0000 7f05157fa700 1 -- 172.21.15.26:0/1603037097 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0524014be0 con 0x56205e9ada70 2023-12-01T01:04:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.375+0000 7f0540264b80 10 client.15468 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.375+0000 7f0540264b80 1 -- 172.21.15.26:0/1603037097 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56205e7292b0 con 0x56205e9ada70 2023-12-01T01:04:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.375+0000 7f05157fa700 1 -- 172.21.15.26:0/1603037097 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0524004d10 con 0x56205e9ada70 2023-12-01T01:04:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.376+0000 7f05157fa700 1 -- 172.21.15.26:0/1603037097 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f0524012070 con 0x56205e9ada70 2023-12-01T01:04:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.376+0000 7f0540264b80 10 client.15468 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:48.382 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.376+0000 7f0540264b80 10 client.15468 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-12-01T01:04:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.376+0000 7f0540264b80 20 client.15468 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.376+0000 7f0540264b80 1 --2- 172.21.15.26:0/1603037097 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x56205ea143a0 0x56205ea167c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.376+0000 7f0540264b80 4 client.15468 mds_command: new command op to 24481 tid=0[{"prefix": "damage ls"}] 2023-12-01T01:04:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.376+0000 7f0540264b80 1 -- 172.21.15.26:0/1603037097 --> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56205e8f5d40 con 0x56205ea143a0 2023-12-01T01:04:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.376+0000 7f0531e70700 1 --2- 172.21.15.26:0/1603037097 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x56205ea143a0 0x56205ea167c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.376+0000 7f05157fa700 10 client.15468 ms_handle_connect on v2:172.21.15.116:6838/261568108 2023-12-01T01:04:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.376+0000 7f0531e70700 1 --2- 172.21.15.26:0/1603037097 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x56205ea143a0 0x56205ea167c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e8bf842ac801b4a9 server_cookie=8422bee379bbeb58 in_seq=0 out_seq=0 2023-12-01T01:04:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f05157fa700 1 -- 172.21.15.26:0/1603037097 <== mds.2 v2:172.21.15.116:6838/261568108 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56205e8f5d40 con 0x56205ea143a0 2023-12-01T01:04:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f05157fa700 10 client.15468 handle_command_reply: tid=0 2023-12-01T01:04:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f0540264b80 1 client.15468 shutdown 2023-12-01T01:04:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f0540264b80 1 -- 172.21.15.26:0/1603037097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ada70 msgr2=0x56205e9bc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f0540264b80 1 --2- 172.21.15.26:0/1603037097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ada70 0x56205e9bc470 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f0524017040 tx=0x7f05240146a0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f0540264b80 1 -- 172.21.15.26:0/1603037097 shutdown_connections 2023-12-01T01:04:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f0540264b80 1 --2- 172.21.15.26:0/1603037097 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56205e9ada70 0x56205e9bc470 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.383 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f0540264b80 1 --2- 172.21.15.26:0/1603037097 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56205e9ac3f0 0x56205e9b8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f0540264b80 1 --2- 172.21.15.26:0/1603037097 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x56205ea143a0 0x56205ea167c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f0540264b80 1 --2- 172.21.15.26:0/1603037097 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56205e9ad0f0 0x56205e9b9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f05157fa700 0 client.15468 ms_handle_reset on v2:172.21.15.116:6838/261568108 2023-12-01T01:04:48.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f0540264b80 1 -- 172.21.15.26:0/1603037097 >> 172.21.15.26:0/1603037097 conn(0x56205e90b0d0 msgr2=0x56205e9b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f0540264b80 1 -- 172.21.15.26:0/1603037097 shutdown_connections 2023-12-01T01:04:48.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f0540264b80 1 -- 172.21.15.26:0/1603037097 wait complete. 2023-12-01T01:04:48.384 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f0540264b80 20 client.15468 trim_cache size 0 max 16384 2023-12-01T01:04:48.384 INFO:teuthology.orchestra.run.smithi026.stdout:[] 2023-12-01T01:04:48.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f05340d4700 1 -- 172.21.15.26:0/2614911079 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f05180a0520 msgr2=0x7f05180a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f05340d4700 1 --2- 172.21.15.26:0/2614911079 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f05180a0520 0x7f05180a29e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0528006010 tx=0x7f0528003700 comp rx=0 tx=0).stop 2023-12-01T01:04:48.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f05340d4700 1 -- 172.21.15.26:0/2614911079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f052c101f90 msgr2=0x7f052c197070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f05340d4700 1 --2- 172.21.15.26:0/2614911079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f052c101f90 0x7f052c197070 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f051c00c920 tx=0x7f051c00cc30 comp rx=0 tx=0).stop 2023-12-01T01:04:48.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f05340d4700 1 -- 172.21.15.26:0/2614911079 shutdown_connections 2023-12-01T01:04:48.385 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f05340d4700 1 --2- 172.21.15.26:0/2614911079 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f05180a0520 0x7f05180a29e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f05340d4700 1 --2- 172.21.15.26:0/2614911079 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f052c102930 0x7f052c19e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f05340d4700 1 --2- 172.21.15.26:0/2614911079 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f052c100da0 0x7f052c196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.377+0000 7f05340d4700 1 --2- 172.21.15.26:0/2614911079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f052c101f90 0x7f052c197070 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.378+0000 7f05340d4700 1 -- 172.21.15.26:0/2614911079 >> 172.21.15.26:0/2614911079 conn(0x7f052c0fc310 msgr2=0x7f052c0fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.378+0000 7f05340d4700 1 -- 172.21.15.26:0/2614911079 shutdown_connections 2023-12-01T01:04:48.386 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.378+0000 7f05340d4700 1 -- 172.21.15.26:0/2614911079 wait complete. 2023-12-01T01:04:48.390 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-01T01:04:48.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.518+0000 7efded782700 1 -- 172.21.15.26:0/1274699038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efde80ff7f0 msgr2=0x7efde81093c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.518+0000 7efded782700 1 --2- 172.21.15.26:0/1274699038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efde80ff7f0 0x7efde81093c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7efde000b0d0 tx=0x7efde000b3e0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.518+0000 7efded782700 1 -- 172.21.15.26:0/1274699038 shutdown_connections 2023-12-01T01:04:48.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.518+0000 7efded782700 1 --2- 172.21.15.26:0/1274699038 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efde80ff7f0 0x7efde81093c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.518+0000 7efded782700 1 --2- 172.21.15.26:0/1274699038 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efde81023e0 0x7efde8102800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.518+0000 7efded782700 1 --2- 172.21.15.26:0/1274699038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efde80fee50 0x7efde80ff2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.518+0000 7efded782700 1 -- 172.21.15.26:0/1274699038 >> 172.21.15.26:0/1274699038 conn(0x7efde80fa9f0 msgr2=0x7efde80fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.518+0000 7efded782700 1 -- 172.21.15.26:0/1274699038 shutdown_connections 2023-12-01T01:04:48.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.518+0000 7efded782700 1 -- 172.21.15.26:0/1274699038 wait complete. 2023-12-01T01:04:48.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.519+0000 7efded782700 1 Processor -- start 2023-12-01T01:04:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.519+0000 7efded782700 1 -- start start 2023-12-01T01:04:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.519+0000 7efded782700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efde80fee50 0x7efde8101ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.519+0000 7efded782700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efde80ff7f0 0x7efde8100120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.519+0000 7efded782700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efde81023e0 0x7efde8100660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.519+0000 7efded782700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde8100e00 con 0x7efde80ff7f0 2023-12-01T01:04:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.519+0000 7efded782700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde8100f70 con 0x7efde80fee50 2023-12-01T01:04:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.519+0000 7efded782700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde81a0c80 con 0x7efde81023e0 2023-12-01T01:04:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.519+0000 7efde67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efde80ff7f0 0x7efde8100120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.519+0000 7efde67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efde80ff7f0 0x7efde8100120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55386/0 (socket says 172.21.15.26:55386) 2023-12-01T01:04:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.519+0000 7efde67fc700 1 -- 172.21.15.26:0/1666569662 learned_addr learned my addr 172.21.15.26:0/1666569662 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.520+0000 7efde6ffd700 1 --2- 172.21.15.26:0/1666569662 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efde80fee50 0x7efde8101ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.520+0000 7efde77fe700 1 --2- 172.21.15.26:0/1666569662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efde81023e0 0x7efde8100660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.520+0000 7efde67fc700 1 -- 172.21.15.26:0/1666569662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efde81023e0 msgr2=0x7efde8100660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.520+0000 7efde67fc700 1 --2- 172.21.15.26:0/1666569662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efde81023e0 0x7efde8100660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.520+0000 7efde67fc700 1 -- 172.21.15.26:0/1666569662 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efde80fee50 msgr2=0x7efde8101ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.520+0000 7efde67fc700 1 --2- 172.21.15.26:0/1666569662 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efde80fee50 0x7efde8101ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.520+0000 7efde67fc700 1 -- 172.21.15.26:0/1666569662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde0009d00 con 0x7efde80ff7f0 2023-12-01T01:04:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.520+0000 7efde67fc700 1 --2- 172.21.15.26:0/1666569662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efde80ff7f0 0x7efde8100120 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c920 tx=0x7efdd000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.520+0000 7efddffff700 1 -- 172.21.15.26:0/1666569662 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0007b00 con 0x7efde80ff7f0 2023-12-01T01:04:48.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.520+0000 7efded782700 1 -- 172.21.15.26:0/1666569662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde81a0f60 con 0x7efde80ff7f0 2023-12-01T01:04:48.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.520+0000 7efddffff700 1 -- 172.21.15.26:0/1666569662 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efdd0004d10 con 0x7efde80ff7f0 2023-12-01T01:04:48.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.520+0000 7efddffff700 1 -- 172.21.15.26:0/1666569662 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0005670 con 0x7efde80ff7f0 2023-12-01T01:04:48.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.520+0000 7efded782700 1 -- 172.21.15.26:0/1666569662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde81a13e0 con 0x7efde80ff7f0 2023-12-01T01:04:48.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.522+0000 7efddffff700 1 -- 172.21.15.26:0/1666569662 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7efdd0004750 con 0x7efde80ff7f0 2023-12-01T01:04:48.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.523+0000 7efddffff700 1 --2- 172.21.15.26:0/1666569662 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efdd40a0520 0x7efdd40a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.523+0000 7efddffff700 1 -- 172.21.15.26:0/1666569662 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efdd00cb9a0 con 0x7efde80ff7f0 2023-12-01T01:04:48.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.523+0000 7efde6ffd700 1 --2- 172.21.15.26:0/1666569662 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efdd40a0520 0x7efdd40a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.523+0000 7efde6ffd700 1 --2- 172.21.15.26:0/1666569662 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efdd40a0520 0x7efdd40a29e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efde8068ea0 tx=0x7efdd8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efdf9912b80 1 Processor -- start 2023-12-01T01:04:48.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efdf9912b80 1 -- start start 2023-12-01T01:04:48.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efdf9912b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d900f0 0x564aa4d90530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efdf9912b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d90a70 0x564aa4d8ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efdf9912b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d8f3f0 0x564aa4d8f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efdf9912b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa4ce6a10 con 0x564aa4d900f0 2023-12-01T01:04:48.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efdf9912b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa4ce43d0 con 0x564aa4d90a70 2023-12-01T01:04:48.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efdf9912b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa4cdfcc0 con 0x564aa4d8f3f0 2023-12-01T01:04:48.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efde6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d900f0 0x564aa4d90530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efde6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d900f0 0x564aa4d90530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55392/0 (socket says 172.21.15.26:55392) 2023-12-01T01:04:48.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efde6ffd700 1 -- 172.21.15.26:0/997857854 learned_addr learned my addr 172.21.15.26:0/997857854 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:48.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efde67fc700 1 --2- 172.21.15.26:0/997857854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d90a70 0x564aa4d8ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efde77fe700 1 --2- 172.21.15.26:0/997857854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d8f3f0 0x564aa4d8f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efde6ffd700 1 -- 172.21.15.26:0/997857854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d8f3f0 msgr2=0x564aa4d8f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efde6ffd700 1 --2- 172.21.15.26:0/997857854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d8f3f0 0x564aa4d8f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efde6ffd700 1 -- 172.21.15.26:0/997857854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d90a70 msgr2=0x564aa4d8ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efde6ffd700 1 --2- 172.21.15.26:0/997857854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d90a70 0x564aa4d8ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efde6ffd700 1 -- 172.21.15.26:0/997857854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564aa4b0dde0 con 0x564aa4d900f0 2023-12-01T01:04:48.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efde77fe700 1 --2- 172.21.15.26:0/997857854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d8f3f0 0x564aa4d8f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:48.535 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.524+0000 7efde67fc700 1 --2- 172.21.15.26:0/997857854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d90a70 0x564aa4d8ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.525+0000 7efde6ffd700 1 --2- 172.21.15.26:0/997857854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d900f0 0x564aa4d90530 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efdd8011e20 tx=0x7efdd8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28da6df295678ccd server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.525+0000 7efddd7fa700 1 -- 172.21.15.26:0/997857854 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd801f620 con 0x564aa4d900f0 2023-12-01T01:04:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.525+0000 7efddd7fa700 1 -- 172.21.15.26:0/997857854 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efdd8016070 con 0x564aa4d900f0 2023-12-01T01:04:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.525+0000 7efddd7fa700 1 -- 172.21.15.26:0/997857854 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd801d9e0 con 0x564aa4d900f0 2023-12-01T01:04:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.525+0000 7efdf9912b80 1 -- 172.21.15.26:0/997857854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d900f0 msgr2=0x564aa4d90530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.525+0000 7efdf9912b80 1 --2- 172.21.15.26:0/997857854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d900f0 0x564aa4d90530 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efdd8011e20 tx=0x7efdd8014000 comp rx=0 tx=0).stop 2023-12-01T01:04:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efdf9912b80 1 -- 172.21.15.26:0/997857854 shutdown_connections 2023-12-01T01:04:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efdf9912b80 1 --2- 172.21.15.26:0/997857854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d8f3f0 0x564aa4d8f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efdf9912b80 1 --2- 172.21.15.26:0/997857854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d900f0 0x564aa4d90530 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efdf9912b80 1 --2- 172.21.15.26:0/997857854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d90a70 0x564aa4d8ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efdf9912b80 1 -- 172.21.15.26:0/997857854 >> 172.21.15.26:0/997857854 conn(0x564aa4cee0d0 msgr2=0x564aa4d89940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efdf9912b80 1 -- 172.21.15.26:0/997857854 shutdown_connections 2023-12-01T01:04:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efdf9912b80 1 -- 172.21.15.26:0/997857854 wait complete. 2023-12-01T01:04:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efdf9912b80 1 -- start start 2023-12-01T01:04:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efdf9912b80 1 Processor -- start 2023-12-01T01:04:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efdf9912b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d8f3f0 0x564aa4d989b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efdf9912b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d900f0 0x564aa4d98ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efdf9912b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d90a70 0x564aa4d9ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efdf9912b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa4c7c510 con 0x564aa4d8f3f0 2023-12-01T01:04:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efdf9912b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa4c7c1b0 con 0x564aa4d900f0 2023-12-01T01:04:48.538 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efdf9912b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa4b63920 con 0x564aa4d90a70 2023-12-01T01:04:48.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efdf9912b80 10 client.0 _ll_register_callbacks cb 0x564aa4bc9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:48.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efde6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d8f3f0 0x564aa4d989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efde6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d8f3f0 0x564aa4d989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55398/0 (socket says 172.21.15.26:55398) 2023-12-01T01:04:48.539 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efde6ffd700 1 -- 172.21.15.26:0/1595328006 learned_addr learned my addr 172.21.15.26:0/1595328006 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.526+0000 7efde67fc700 1 --2- 172.21.15.26:0/1595328006 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d900f0 0x564aa4d98ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.527+0000 7efde77fe700 1 --2- 172.21.15.26:0/1595328006 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d90a70 0x564aa4d9ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.527+0000 7efde6ffd700 1 -- 172.21.15.26:0/1595328006 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d90a70 msgr2=0x564aa4d9ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.527+0000 7efde6ffd700 1 --2- 172.21.15.26:0/1595328006 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d90a70 0x564aa4d9ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.527+0000 7efde6ffd700 1 -- 172.21.15.26:0/1595328006 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d900f0 msgr2=0x564aa4d98ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.527+0000 7efde6ffd700 1 --2- 172.21.15.26:0/1595328006 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d900f0 0x564aa4d98ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.527+0000 7efde6ffd700 1 -- 172.21.15.26:0/1595328006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd8011ad0 con 0x564aa4d8f3f0 2023-12-01T01:04:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.527+0000 7efde6ffd700 1 --2- 172.21.15.26:0/1595328006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d8f3f0 0x564aa4d989b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efdd8011df0 tx=0x7efdd801de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaee39535035ce1b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.527+0000 7efdce7fc700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.527+0000 7efdce7fc700 1 -- 172.21.15.26:0/1595328006 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd802d070 con 0x564aa4d8f3f0 2023-12-01T01:04:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.527+0000 7efdf9912b80 1 -- 172.21.15.26:0/1595328006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564aa4d0ad10 con 0x564aa4d8f3f0 2023-12-01T01:04:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.527+0000 7efdce7fc700 1 -- 172.21.15.26:0/1595328006 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efdd8018070 con 0x564aa4d8f3f0 2023-12-01T01:04:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.527+0000 7efdce7fc700 1 -- 172.21.15.26:0/1595328006 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7efdd8005ce0 con 0x564aa4d8f3f0 2023-12-01T01:04:48.540 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.527+0000 7efdf9912b80 10 client.15480 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.527+0000 7efdf9912b80 1 -- 172.21.15.26:0/1595328006 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x564aa4af6c60 con 0x564aa4d8f3f0 2023-12-01T01:04:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.527+0000 7efdce7fc700 1 -- 172.21.15.26:0/1595328006 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x564aa4d0ad10 con 0x564aa4d8f3f0 2023-12-01T01:04:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.528+0000 7efdce7fc700 1 -- 172.21.15.26:0/1595328006 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7efdd80327a0 con 0x564aa4d8f3f0 2023-12-01T01:04:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.528+0000 7efdf9912b80 10 client.15480 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.528+0000 7efdf9912b80 10 client.15480 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2023-12-01T01:04:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.528+0000 7efdf9912b80 20 client.15480 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.528+0000 7efdf9912b80 1 --2- 172.21.15.26:0/1595328006 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x564aa4da4570 0x564aa4da6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.528+0000 7efdf9912b80 4 client.15480 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:04:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.528+0000 7efdf9912b80 1 -- 172.21.15.26:0/1595328006 --> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564aa4d5de10 con 0x564aa4da4570 2023-12-01T01:04:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.528+0000 7efde67fc700 1 --2- 172.21.15.26:0/1595328006 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x564aa4da4570 0x564aa4da6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.528+0000 7efdce7fc700 10 client.15480 ms_handle_connect on v2:172.21.15.26:6838/1277894156 2023-12-01T01:04:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.528+0000 7efde67fc700 1 --2- 172.21.15.26:0/1595328006 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x564aa4da4570 0x564aa4da6990 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cdff7ac447af2c72 server_cookie=b7b4e8d0ad71090b in_seq=0 out_seq=0 2023-12-01T01:04:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.529+0000 7efdce7fc700 1 -- 172.21.15.26:0/1595328006 <== mds.1 v2:172.21.15.26:6838/1277894156 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x564aa4d5de10 con 0x564aa4da4570 2023-12-01T01:04:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.529+0000 7efdce7fc700 10 client.15480 handle_command_reply: tid=0 2023-12-01T01:04:48.541 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.529+0000 7efdf9912b80 1 client.15480 shutdown 2023-12-01T01:04:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.529+0000 7efdf9912b80 1 -- 172.21.15.26:0/1595328006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d8f3f0 msgr2=0x564aa4d989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.529+0000 7efdf9912b80 1 --2- 172.21.15.26:0/1595328006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d8f3f0 0x564aa4d989b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efdd8011df0 tx=0x7efdd801de40 comp rx=0 tx=0).stop 2023-12-01T01:04:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.529+0000 7efdf9912b80 1 -- 172.21.15.26:0/1595328006 shutdown_connections 2023-12-01T01:04:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.529+0000 7efdf9912b80 1 --2- 172.21.15.26:0/1595328006 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d90a70 0x564aa4d9ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.529+0000 7efdf9912b80 1 --2- 172.21.15.26:0/1595328006 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x564aa4da4570 0x564aa4da6990 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.529+0000 7efdf9912b80 1 --2- 172.21.15.26:0/1595328006 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d8f3f0 0x564aa4d989b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.529+0000 7efdce7fc700 0 client.15480 ms_handle_reset on v2:172.21.15.26:6838/1277894156 2023-12-01T01:04:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.529+0000 7efdf9912b80 1 --2- 172.21.15.26:0/1595328006 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d900f0 0x564aa4d98ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.529+0000 7efdf9912b80 1 -- 172.21.15.26:0/1595328006 >> 172.21.15.26:0/1595328006 conn(0x564aa4cee0d0 msgr2=0x564aa4d890b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.529+0000 7efdf9912b80 1 -- 172.21.15.26:0/1595328006 shutdown_connections 2023-12-01T01:04:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.529+0000 7efdf9912b80 1 -- 172.21.15.26:0/1595328006 wait complete. 2023-12-01T01:04:48.543 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.529+0000 7efdf9912b80 20 client.15480 trim_cache size 0 max 16384 2023-12-01T01:04:48.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.542+0000 7efdf9912b80 1 Processor -- start 2023-12-01T01:04:48.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.542+0000 7efdf9912b80 1 -- start start 2023-12-01T01:04:48.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.542+0000 7efdf9912b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d8f3f0 0x564aa4d9dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.542+0000 7efdf9912b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d900f0 0x564aa4d976b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.542+0000 7efdf9912b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d90a70 0x564aa4d98760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.542+0000 7efdf9912b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa4d8a700 con 0x564aa4d8f3f0 2023-12-01T01:04:48.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.542+0000 7efdf9912b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa4d8add0 con 0x564aa4d900f0 2023-12-01T01:04:48.546 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.542+0000 7efdf9912b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa4da40e0 con 0x564aa4d90a70 2023-12-01T01:04:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.542+0000 7efde6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d8f3f0 0x564aa4d9dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.542+0000 7efde6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d8f3f0 0x564aa4d9dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55406/0 (socket says 172.21.15.26:55406) 2023-12-01T01:04:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.542+0000 7efde6ffd700 1 -- 172.21.15.26:0/3155038436 learned_addr learned my addr 172.21.15.26:0/3155038436 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.543+0000 7efde67fc700 1 --2- 172.21.15.26:0/3155038436 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d900f0 0x564aa4d976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.543+0000 7efde77fe700 1 --2- 172.21.15.26:0/3155038436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d90a70 0x564aa4d98760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.543+0000 7efde6ffd700 1 -- 172.21.15.26:0/3155038436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d90a70 msgr2=0x564aa4d98760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.543+0000 7efde6ffd700 1 --2- 172.21.15.26:0/3155038436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d90a70 0x564aa4d98760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.543+0000 7efde6ffd700 1 -- 172.21.15.26:0/3155038436 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d900f0 msgr2=0x564aa4d976b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.543+0000 7efde6ffd700 1 --2- 172.21.15.26:0/3155038436 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d900f0 0x564aa4d976b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.543+0000 7efde6ffd700 1 -- 172.21.15.26:0/3155038436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564aa4b34250 con 0x564aa4d8f3f0 2023-12-01T01:04:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.543+0000 7efde6ffd700 1 --2- 172.21.15.26:0/3155038436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d8f3f0 0x564aa4d9dee0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7efdd8000c00 tx=0x7efdd8009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e55240dd60ff6d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.543+0000 7efdddffb700 1 -- 172.21.15.26:0/3155038436 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd802d030 con 0x564aa4d8f3f0 2023-12-01T01:04:48.547 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.543+0000 7efdddffb700 1 -- 172.21.15.26:0/3155038436 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efdd8009920 con 0x564aa4d8f3f0 2023-12-01T01:04:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.543+0000 7efdddffb700 1 -- 172.21.15.26:0/3155038436 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd8004560 con 0x564aa4d8f3f0 2023-12-01T01:04:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.544+0000 7efdf9912b80 1 -- 172.21.15.26:0/3155038436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d8f3f0 msgr2=0x564aa4d9dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.544+0000 7efdf9912b80 1 --2- 172.21.15.26:0/3155038436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d8f3f0 0x564aa4d9dee0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7efdd8000c00 tx=0x7efdd8009630 comp rx=0 tx=0).stop 2023-12-01T01:04:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.544+0000 7efdf9912b80 1 -- 172.21.15.26:0/3155038436 shutdown_connections 2023-12-01T01:04:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.544+0000 7efdf9912b80 1 --2- 172.21.15.26:0/3155038436 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d90a70 0x564aa4d98760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.544+0000 7efdf9912b80 1 --2- 172.21.15.26:0/3155038436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d8f3f0 0x564aa4d9dee0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.544+0000 7efdf9912b80 1 --2- 172.21.15.26:0/3155038436 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d900f0 0x564aa4d976b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.544+0000 7efdf9912b80 1 -- 172.21.15.26:0/3155038436 >> 172.21.15.26:0/3155038436 conn(0x564aa4cee0d0 msgr2=0x564aa4da0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.544+0000 7efdf9912b80 1 -- 172.21.15.26:0/3155038436 shutdown_connections 2023-12-01T01:04:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.544+0000 7efdf9912b80 1 -- 172.21.15.26:0/3155038436 wait complete. 2023-12-01T01:04:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.544+0000 7efdf9912b80 1 -- start start 2023-12-01T01:04:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.544+0000 7efdf9912b80 1 Processor -- start 2023-12-01T01:04:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.544+0000 7efdf9912b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d8f3f0 0x564aa4d9bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.544+0000 7efdf9912b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d900f0 0x564aa4d9c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.548 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.545+0000 7efdf9912b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d90a70 0x564aa4d9d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.545+0000 7efdf9912b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa4d9d6f0 con 0x564aa4d900f0 2023-12-01T01:04:48.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.545+0000 7efdf9912b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa4d9d860 con 0x564aa4d8f3f0 2023-12-01T01:04:48.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.545+0000 7efdf9912b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x564aa4d9da20 con 0x564aa4d90a70 2023-12-01T01:04:48.549 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.545+0000 7efdf9912b80 10 client.0 _ll_register_callbacks cb 0x7efdd8011cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:48.549 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:48 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2750536606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:04:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.545+0000 7efde67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d900f0 0x564aa4d9c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.545+0000 7efde67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d900f0 0x564aa4d9c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55414/0 (socket says 172.21.15.26:55414) 2023-12-01T01:04:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.545+0000 7efde67fc700 1 -- 172.21.15.26:0/1465134611 learned_addr learned my addr 172.21.15.26:0/1465134611 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.545+0000 7efde6ffd700 1 --2- 172.21.15.26:0/1465134611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d8f3f0 0x564aa4d9bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.545+0000 7efde6ffd700 1 -- 172.21.15.26:0/1465134611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d90a70 msgr2=0x564aa4d9d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.545+0000 7efde6ffd700 1 --2- 172.21.15.26:0/1465134611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d90a70 0x564aa4d9d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.545+0000 7efde6ffd700 1 -- 172.21.15.26:0/1465134611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d900f0 msgr2=0x564aa4d9c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.545+0000 7efde6ffd700 1 --2- 172.21.15.26:0/1465134611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d900f0 0x564aa4d9c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.545+0000 7efde6ffd700 1 -- 172.21.15.26:0/1465134611 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564aa4af6c60 con 0x564aa4d8f3f0 2023-12-01T01:04:48.552 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.545+0000 7efde6ffd700 1 --2- 172.21.15.26:0/1465134611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d8f3f0 0x564aa4d9bc60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x564aa4d8a590 tx=0x7efdd8032c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6833c40a1c497c05 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.545+0000 7efdce7fc700 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-12-01T01:04:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.546+0000 7efdce7fc700 1 -- 172.21.15.26:0/1465134611 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd802d030 con 0x564aa4d8f3f0 2023-12-01T01:04:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.546+0000 7efdf9912b80 1 -- 172.21.15.26:0/1465134611 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efdd8016070 con 0x564aa4d8f3f0 2023-12-01T01:04:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.546+0000 7efdce7fc700 1 -- 172.21.15.26:0/1465134611 <== mon.2 v2:172.21.15.93:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efdd802e070 con 0x564aa4d8f3f0 2023-12-01T01:04:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.546+0000 7efdce7fc700 1 -- 172.21.15.26:0/1465134611 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7efdd8004460 con 0x564aa4d8f3f0 2023-12-01T01:04:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.546+0000 7efdf9912b80 10 client.25148 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.546+0000 7efdf9912b80 1 -- 172.21.15.26:0/1465134611 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x564aa4b0c2b0 con 0x564aa4d8f3f0 2023-12-01T01:04:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.546+0000 7efdce7fc700 1 -- 172.21.15.26:0/1465134611 <== mon.2 v2:172.21.15.93:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efdd8016070 con 0x564aa4d8f3f0 2023-12-01T01:04:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.546+0000 7efdce7fc700 1 -- 172.21.15.26:0/1465134611 <== mon.2 v2:172.21.15.93:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7efdd8003ba0 con 0x564aa4d8f3f0 2023-12-01T01:04:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.546+0000 7efdf9912b80 10 client.25148 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.546+0000 7efdf9912b80 10 client.25148 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2023-12-01T01:04:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.546+0000 7efdf9912b80 20 client.25148 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:48.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.546+0000 7efdf9912b80 1 --2- 172.21.15.26:0/1465134611 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x564aa4df6aa0 0x564aa4df8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.546+0000 7efdf9912b80 4 client.25148 mds_command: new command op to 24493 tid=0[{"prefix": "damage ls"}] 2023-12-01T01:04:48.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.546+0000 7efdf9912b80 1 -- 172.21.15.26:0/1465134611 --> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564aa4cd8d40 con 0x564aa4df6aa0 2023-12-01T01:04:48.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.546+0000 7efde67fc700 1 --2- 172.21.15.26:0/1465134611 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x564aa4df6aa0 0x564aa4df8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efdce7fc700 10 client.25148 ms_handle_connect on v2:172.21.15.26:6838/1277894156 2023-12-01T01:04:48.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efde67fc700 1 --2- 172.21.15.26:0/1465134611 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x564aa4df6aa0 0x564aa4df8e90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=30220f2c579cdd09 server_cookie=62f2f5796dd98db7 in_seq=0 out_seq=0 2023-12-01T01:04:48.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efdce7fc700 1 -- 172.21.15.26:0/1465134611 <== mds.1 v2:172.21.15.26:6838/1277894156 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564aa4cd8d40 con 0x564aa4df6aa0 2023-12-01T01:04:48.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efdce7fc700 10 client.25148 handle_command_reply: tid=0 2023-12-01T01:04:48.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efdf9912b80 1 client.25148 shutdown 2023-12-01T01:04:48.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efdf9912b80 1 -- 172.21.15.26:0/1465134611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d8f3f0 msgr2=0x564aa4d9bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efdf9912b80 1 --2- 172.21.15.26:0/1465134611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d8f3f0 0x564aa4d9bc60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x564aa4d8a590 tx=0x7efdd8032c10 comp rx=0 tx=0).stop 2023-12-01T01:04:48.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efdf9912b80 1 -- 172.21.15.26:0/1465134611 shutdown_connections 2023-12-01T01:04:48.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efdf9912b80 1 --2- 172.21.15.26:0/1465134611 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564aa4d90a70 0x564aa4d9d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efdf9912b80 1 --2- 172.21.15.26:0/1465134611 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564aa4d8f3f0 0x564aa4d9bc60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.554 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efdf9912b80 1 --2- 172.21.15.26:0/1465134611 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x564aa4df6aa0 0x564aa4df8e90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efdf9912b80 1 --2- 172.21.15.26:0/1465134611 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564aa4d900f0 0x564aa4d9c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efdf9912b80 1 -- 172.21.15.26:0/1465134611 >> 172.21.15.26:0/1465134611 conn(0x564aa4cee0d0 msgr2=0x564aa4d976b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efdce7fc700 0 client.25148 ms_handle_reset on v2:172.21.15.26:6838/1277894156 2023-12-01T01:04:48.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efdf9912b80 1 -- 172.21.15.26:0/1465134611 shutdown_connections 2023-12-01T01:04:48.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efdf9912b80 1 -- 172.21.15.26:0/1465134611 wait complete. 2023-12-01T01:04:48.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.547+0000 7efdf9912b80 20 client.25148 trim_cache size 0 max 16384 2023-12-01T01:04:48.555 INFO:teuthology.orchestra.run.smithi026.stdout:[] 2023-12-01T01:04:48.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.548+0000 7efded782700 1 -- 172.21.15.26:0/1666569662 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efdd40a0520 msgr2=0x7efdd40a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.548+0000 7efded782700 1 --2- 172.21.15.26:0/1666569662 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efdd40a0520 0x7efdd40a29e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efde8068ea0 tx=0x7efdd8009260 comp rx=0 tx=0).stop 2023-12-01T01:04:48.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.548+0000 7efded782700 1 -- 172.21.15.26:0/1666569662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efde80ff7f0 msgr2=0x7efde8100120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.548+0000 7efded782700 1 --2- 172.21.15.26:0/1666569662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efde80ff7f0 0x7efde8100120 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c920 tx=0x7efdd000cce0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.548+0000 7efded782700 1 -- 172.21.15.26:0/1666569662 shutdown_connections 2023-12-01T01:04:48.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.548+0000 7efded782700 1 --2- 172.21.15.26:0/1666569662 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efdd40a0520 0x7efdd40a29e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.548+0000 7efded782700 1 --2- 172.21.15.26:0/1666569662 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efde81023e0 0x7efde8100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.548+0000 7efded782700 1 --2- 172.21.15.26:0/1666569662 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efde80fee50 0x7efde8101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.548+0000 7efded782700 1 --2- 172.21.15.26:0/1666569662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efde80ff7f0 0x7efde8100120 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.548+0000 7efded782700 1 -- 172.21.15.26:0/1666569662 >> 172.21.15.26:0/1666569662 conn(0x7efde80fa9f0 msgr2=0x7efde8105550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.548+0000 7efded782700 1 -- 172.21.15.26:0/1666569662 shutdown_connections 2023-12-01T01:04:48.557 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.548+0000 7efded782700 1 -- 172.21.15.26:0/1666569662 wait complete. 2023-12-01T01:04:48.561 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-01T01:04:48.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:48 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2750536606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:04:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.689+0000 7f51de6e6700 1 -- 172.21.15.26:0/2710928090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51d8100e70 msgr2=0x7f51d81012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.689+0000 7f51de6e6700 1 --2- 172.21.15.26:0/2710928090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51d8100e70 0x7f51d81012d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0099c0 tx=0x7f51cc009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.689+0000 7f51de6e6700 1 -- 172.21.15.26:0/2710928090 shutdown_connections 2023-12-01T01:04:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.689+0000 7f51de6e6700 1 --2- 172.21.15.26:0/2710928090 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f51d8101810 0x7f51d81080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.689+0000 7f51de6e6700 1 --2- 172.21.15.26:0/2710928090 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51d80ffc80 0x7f51d81000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.689+0000 7f51de6e6700 1 --2- 172.21.15.26:0/2710928090 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51d8100e70 0x7f51d81012d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.689+0000 7f51de6e6700 1 -- 172.21.15.26:0/2710928090 >> 172.21.15.26:0/2710928090 conn(0x7f51d80fb1f0 msgr2=0x7f51d80fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.689+0000 7f51de6e6700 1 -- 172.21.15.26:0/2710928090 shutdown_connections 2023-12-01T01:04:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.689+0000 7f51de6e6700 1 -- 172.21.15.26:0/2710928090 wait complete. 2023-12-01T01:04:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.690+0000 7f51de6e6700 1 Processor -- start 2023-12-01T01:04:48.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.690+0000 7f51de6e6700 1 -- start start 2023-12-01T01:04:48.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.690+0000 7f51de6e6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51d80ffc80 0x7f51d8196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.690+0000 7f51de6e6700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f51d8100e70 0x7f51d8197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.690+0000 7f51de6e6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51d8101810 0x7f51d819e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.690+0000 7f51de6e6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d819e780 con 0x7f51d80ffc80 2023-12-01T01:04:48.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.690+0000 7f51de6e6700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d819e8f0 con 0x7f51d8101810 2023-12-01T01:04:48.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.690+0000 7f51de6e6700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d819eab0 con 0x7f51d8100e70 2023-12-01T01:04:48.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.690+0000 7f51d7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51d80ffc80 0x7f51d8196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.690+0000 7f51d7fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51d80ffc80 0x7f51d8196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55426/0 (socket says 172.21.15.26:55426) 2023-12-01T01:04:48.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.690+0000 7f51d7fff700 1 -- 172.21.15.26:0/721474652 learned_addr learned my addr 172.21.15.26:0/721474652 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:48.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.690+0000 7f51dcc83700 1 --2- 172.21.15.26:0/721474652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51d8101810 0x7f51d819e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.691+0000 7f51d77fe700 1 --2- 172.21.15.26:0/721474652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f51d8100e70 0x7f51d8197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.691+0000 7f51d7fff700 1 -- 172.21.15.26:0/721474652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f51d8100e70 msgr2=0x7f51d8197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.691+0000 7f51d7fff700 1 --2- 172.21.15.26:0/721474652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f51d8100e70 0x7f51d8197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.691+0000 7f51d7fff700 1 -- 172.21.15.26:0/721474652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51d8101810 msgr2=0x7f51d819e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.691+0000 7f51d7fff700 1 --2- 172.21.15.26:0/721474652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51d8101810 0x7f51d819e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.691+0000 7f51d7fff700 1 -- 172.21.15.26:0/721474652 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc0095f0 con 0x7f51d80ffc80 2023-12-01T01:04:48.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.691+0000 7f51d7fff700 1 --2- 172.21.15.26:0/721474652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51d80ffc80 0x7f51d8196c40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f51c800e970 tx=0x7f51c800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.691+0000 7f51d57fa700 1 -- 172.21.15.26:0/721474652 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c8009790 con 0x7f51d80ffc80 2023-12-01T01:04:48.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.691+0000 7f51d57fa700 1 -- 172.21.15.26:0/721474652 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f51c800eec0 con 0x7f51d80ffc80 2023-12-01T01:04:48.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.691+0000 7f51de6e6700 1 -- 172.21.15.26:0/721474652 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d819ed90 con 0x7f51d80ffc80 2023-12-01T01:04:48.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.691+0000 7f51d57fa700 1 -- 172.21.15.26:0/721474652 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c8003d90 con 0x7f51d80ffc80 2023-12-01T01:04:48.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.691+0000 7f51de6e6700 1 -- 172.21.15.26:0/721474652 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d819f200 con 0x7f51d80ffc80 2023-12-01T01:04:48.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.694+0000 7f51d57fa700 1 -- 172.21.15.26:0/721474652 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f51c8004000 con 0x7f51d80ffc80 2023-12-01T01:04:48.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.694+0000 7f51d57fa700 1 --2- 172.21.15.26:0/721474652 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f51c00a05a0 0x7f51c00a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.695+0000 7f51d77fe700 1 --2- 172.21.15.26:0/721474652 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f51c00a05a0 0x7f51c00a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.695+0000 7f51d57fa700 1 -- 172.21.15.26:0/721474652 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f51c8014070 con 0x7f51d80ffc80 2023-12-01T01:04:48.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.695+0000 7f51ea876b80 1 Processor -- start 2023-12-01T01:04:48.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.695+0000 7f51ea876b80 1 -- start start 2023-12-01T01:04:48.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.695+0000 7f51d77fe700 1 --2- 172.21.15.26:0/721474652 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f51c00a05a0 0x7f51c00a2a60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0098e0 tx=0x7f51cc00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.695+0000 7f51ea876b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da270f0 0x55e77da27530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.695+0000 7f51ea876b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da27a70 0x55e77da25e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.695+0000 7f51ea876b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da263f0 0x55e77da26870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.695+0000 7f51ea876b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77d97da10 con 0x55e77da263f0 2023-12-01T01:04:48.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.695+0000 7f51ea876b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77d97b3d0 con 0x55e77da27a70 2023-12-01T01:04:48.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.695+0000 7f51ea876b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77d976cc0 con 0x55e77da270f0 2023-12-01T01:04:48.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.695+0000 7f51dcc83700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da263f0 0x55e77da26870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.695+0000 7f51dcc83700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da263f0 0x55e77da26870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55438/0 (socket says 172.21.15.26:55438) 2023-12-01T01:04:48.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.695+0000 7f51dcc83700 1 -- 172.21.15.26:0/2065022623 learned_addr learned my addr 172.21.15.26:0/2065022623 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:48.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.696+0000 7f51d7fff700 1 --2- 172.21.15.26:0/2065022623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da270f0 0x55e77da27530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.696+0000 7f51d77fe700 1 --2- 172.21.15.26:0/2065022623 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da27a70 0x55e77da25e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.696+0000 7f51dcc83700 1 -- 172.21.15.26:0/2065022623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da270f0 msgr2=0x55e77da27530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.696+0000 7f51dcc83700 1 --2- 172.21.15.26:0/2065022623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da270f0 0x55e77da27530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.696+0000 7f51dcc83700 1 -- 172.21.15.26:0/2065022623 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da27a70 msgr2=0x55e77da25e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.696+0000 7f51dcc83700 1 --2- 172.21.15.26:0/2065022623 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da27a70 0x55e77da25e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.696+0000 7f51dcc83700 1 -- 172.21.15.26:0/2065022623 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e77d7a4de0 con 0x55e77da263f0 2023-12-01T01:04:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.696+0000 7f51dcc83700 1 --2- 172.21.15.26:0/2065022623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da263f0 0x55e77da26870 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f51d0011680 tx=0x7f51d0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d517d1dcc95b9d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.696+0000 7f51be7fc700 1 -- 172.21.15.26:0/2065022623 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000e040 con 0x55e77da263f0 2023-12-01T01:04:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.696+0000 7f51be7fc700 1 -- 172.21.15.26:0/2065022623 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f51d000f040 con 0x55e77da263f0 2023-12-01T01:04:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.696+0000 7f51be7fc700 1 -- 172.21.15.26:0/2065022623 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d00048d0 con 0x55e77da263f0 2023-12-01T01:04:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.697+0000 7f51ea876b80 1 -- 172.21.15.26:0/2065022623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da263f0 msgr2=0x55e77da26870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.697+0000 7f51ea876b80 1 --2- 172.21.15.26:0/2065022623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da263f0 0x55e77da26870 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f51d0011680 tx=0x7f51d0009920 comp rx=0 tx=0).stop 2023-12-01T01:04:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.697+0000 7f51ea876b80 1 -- 172.21.15.26:0/2065022623 shutdown_connections 2023-12-01T01:04:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.697+0000 7f51ea876b80 1 --2- 172.21.15.26:0/2065022623 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da263f0 0x55e77da26870 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.697+0000 7f51ea876b80 1 --2- 172.21.15.26:0/2065022623 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da270f0 0x55e77da27530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.697+0000 7f51ea876b80 1 --2- 172.21.15.26:0/2065022623 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da27a70 0x55e77da25e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.697+0000 7f51ea876b80 1 -- 172.21.15.26:0/2065022623 >> 172.21.15.26:0/2065022623 conn(0x55e77d9850d0 msgr2=0x55e77da20940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.697+0000 7f51ea876b80 1 -- 172.21.15.26:0/2065022623 shutdown_connections 2023-12-01T01:04:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.697+0000 7f51ea876b80 1 -- 172.21.15.26:0/2065022623 wait complete. 2023-12-01T01:04:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.697+0000 7f51ea876b80 1 -- start start 2023-12-01T01:04:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.697+0000 7f51ea876b80 1 Processor -- start 2023-12-01T01:04:48.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51ea876b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da263f0 0x55e77da2f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51ea876b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da270f0 0x55e77da2fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51ea876b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da27a70 0x55e77da36ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51ea876b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77d913510 con 0x55e77da270f0 2023-12-01T01:04:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51ea876b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77d9131b0 con 0x55e77da27a70 2023-12-01T01:04:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51ea876b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77d7fa920 con 0x55e77da263f0 2023-12-01T01:04:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51ea876b80 10 client.0 _ll_register_callbacks cb 0x55e77d860a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51d77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da270f0 0x55e77da2fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51d77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da270f0 0x55e77da2fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55442/0 (socket says 172.21.15.26:55442) 2023-12-01T01:04:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51d77fe700 1 -- 172.21.15.26:0/3894403876 learned_addr learned my addr 172.21.15.26:0/3894403876 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51d7fff700 1 --2- 172.21.15.26:0/3894403876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da263f0 0x55e77da2f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51dcc83700 1 --2- 172.21.15.26:0/3894403876 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da27a70 0x55e77da36ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51d77fe700 1 -- 172.21.15.26:0/3894403876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da263f0 msgr2=0x55e77da2f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51d77fe700 1 --2- 172.21.15.26:0/3894403876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da263f0 0x55e77da2f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51d77fe700 1 -- 172.21.15.26:0/3894403876 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da27a70 msgr2=0x55e77da36ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51d77fe700 1 --2- 172.21.15.26:0/3894403876 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da27a70 0x55e77da36ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51d77fe700 1 -- 172.21.15.26:0/3894403876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d0011330 con 0x55e77da270f0 2023-12-01T01:04:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51d77fe700 1 --2- 172.21.15.26:0/3894403876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da270f0 0x55e77da2fe90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f51cc015000 tx=0x7f51cc009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24086154b43b082f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.698+0000 7f51b77fe700 1 -- 172.21.15.26:0/3894403876 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc02b070 con 0x55e77da270f0 2023-12-01T01:04:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.699+0000 7f51b77fe700 1 -- 172.21.15.26:0/3894403876 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f51cc00b9a0 con 0x55e77da270f0 2023-12-01T01:04:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.699+0000 7f51ea876b80 1 -- 172.21.15.26:0/3894403876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e77d9a1d10 con 0x55e77da270f0 2023-12-01T01:04:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.699+0000 7f51b77fe700 1 -- 172.21.15.26:0/3894403876 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51cc01d070 con 0x55e77da270f0 2023-12-01T01:04:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.699+0000 7f51ea876b80 10 client.15498 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.699+0000 7f51ea876b80 1 -- 172.21.15.26:0/3894403876 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55e77d78dc60 con 0x55e77da270f0 2023-12-01T01:04:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.699+0000 7f51b77fe700 1 -- 172.21.15.26:0/3894403876 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55e77d9a1d10 con 0x55e77da270f0 2023-12-01T01:04:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.699+0000 7f51b77fe700 1 -- 172.21.15.26:0/3894403876 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f51cc00fc00 con 0x55e77da270f0 2023-12-01T01:04:48.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.699+0000 7f51ea876b80 10 client.15498 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.699+0000 7f51ea876b80 10 client.15498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.699+0000 7f51ea876b80 20 client.15498 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.699+0000 7f51ea876b80 1 --2- 172.21.15.26:0/3894403876 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55e77da3b7d0 0x55e77da3dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.699+0000 7f51ea876b80 4 client.15498 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:04:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.699+0000 7f51ea876b80 1 -- 172.21.15.26:0/3894403876 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e77d9f4e10 con 0x55e77da3b7d0 2023-12-01T01:04:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.699+0000 7f51d7fff700 1 --2- 172.21.15.26:0/3894403876 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55e77da3b7d0 0x55e77da3dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.700+0000 7f51b77fe700 10 client.15498 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.700+0000 7f51d7fff700 1 --2- 172.21.15.26:0/3894403876 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55e77da3b7d0 0x55e77da3dbf0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6351b31f04485215 server_cookie=ee62b41deab73155 in_seq=0 out_seq=0 2023-12-01T01:04:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.700+0000 7f51b77fe700 1 -- 172.21.15.26:0/3894403876 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55e77d9f4e10 con 0x55e77da3b7d0 2023-12-01T01:04:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.700+0000 7f51b77fe700 10 client.15498 handle_command_reply: tid=0 2023-12-01T01:04:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.700+0000 7f51ea876b80 1 client.15498 shutdown 2023-12-01T01:04:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.701+0000 7f51ea876b80 1 -- 172.21.15.26:0/3894403876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da270f0 msgr2=0x55e77da2fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.701+0000 7f51ea876b80 1 --2- 172.21.15.26:0/3894403876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da270f0 0x55e77da2fe90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f51cc015000 tx=0x7f51cc009310 comp rx=0 tx=0).stop 2023-12-01T01:04:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.701+0000 7f51ea876b80 1 -- 172.21.15.26:0/3894403876 shutdown_connections 2023-12-01T01:04:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.701+0000 7f51ea876b80 1 --2- 172.21.15.26:0/3894403876 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55e77da3b7d0 0x55e77da3dbf0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.701+0000 7f51ea876b80 1 --2- 172.21.15.26:0/3894403876 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da27a70 0x55e77da36ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.701+0000 7f51b77fe700 0 client.15498 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.701+0000 7f51ea876b80 1 --2- 172.21.15.26:0/3894403876 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da263f0 0x55e77da2f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.701+0000 7f51ea876b80 1 --2- 172.21.15.26:0/3894403876 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da270f0 0x55e77da2fe90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.701+0000 7f51ea876b80 1 -- 172.21.15.26:0/3894403876 >> 172.21.15.26:0/3894403876 conn(0x55e77d9850d0 msgr2=0x55e77da200b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.701+0000 7f51ea876b80 1 -- 172.21.15.26:0/3894403876 shutdown_connections 2023-12-01T01:04:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.701+0000 7f51ea876b80 1 -- 172.21.15.26:0/3894403876 wait complete. 2023-12-01T01:04:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.701+0000 7f51ea876b80 20 client.15498 trim_cache size 0 max 16384 2023-12-01T01:04:48.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.713+0000 7f51ea876b80 1 Processor -- start 2023-12-01T01:04:48.721 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.713+0000 7f51ea876b80 1 -- start start 2023-12-01T01:04:48.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.713+0000 7f51ea876b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da263f0 0x55e77da25e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51ea876b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da270f0 0x55e77da34e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51ea876b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da27a70 0x55e77da2f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51ea876b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77da1b6f0 con 0x55e77da27a70 2023-12-01T01:04:48.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51ea876b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77da221a0 con 0x55e77da270f0 2023-12-01T01:04:48.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51ea876b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77da18b50 con 0x55e77da263f0 2023-12-01T01:04:48.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51dcc83700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da27a70 0x55e77da2f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51dcc83700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da27a70 0x55e77da2f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55452/0 (socket says 172.21.15.26:55452) 2023-12-01T01:04:48.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51dcc83700 1 -- 172.21.15.26:0/3834251121 learned_addr learned my addr 172.21.15.26:0/3834251121 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:48.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51d77fe700 1 --2- 172.21.15.26:0/3834251121 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da270f0 0x55e77da34e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.722 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51d7fff700 1 --2- 172.21.15.26:0/3834251121 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da263f0 0x55e77da25e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51dcc83700 1 -- 172.21.15.26:0/3834251121 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da263f0 msgr2=0x55e77da25e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51dcc83700 1 --2- 172.21.15.26:0/3834251121 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da263f0 0x55e77da25e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51dcc83700 1 -- 172.21.15.26:0/3834251121 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da270f0 msgr2=0x55e77da34e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51dcc83700 1 --2- 172.21.15.26:0/3834251121 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da270f0 0x55e77da34e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51dcc83700 1 -- 172.21.15.26:0/3834251121 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e77d7cb250 con 0x55e77da27a70 2023-12-01T01:04:48.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51dcc83700 1 --2- 172.21.15.26:0/3834251121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da27a70 0x55e77da2f950 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f51d0011680 tx=0x7f51d00092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65da51cb28f83666 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51beffd700 1 -- 172.21.15.26:0/3834251121 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000e040 con 0x55e77da27a70 2023-12-01T01:04:48.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51beffd700 1 -- 172.21.15.26:0/3834251121 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f51d0005110 con 0x55e77da27a70 2023-12-01T01:04:48.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.714+0000 7f51beffd700 1 -- 172.21.15.26:0/3834251121 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d0015690 con 0x55e77da27a70 2023-12-01T01:04:48.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.715+0000 7f51ea876b80 1 -- 172.21.15.26:0/3834251121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da27a70 msgr2=0x55e77da2f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.715+0000 7f51ea876b80 1 --2- 172.21.15.26:0/3834251121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da27a70 0x55e77da2f950 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f51d0011680 tx=0x7f51d00092e0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.723 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.715+0000 7f51ea876b80 1 -- 172.21.15.26:0/3834251121 shutdown_connections 2023-12-01T01:04:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.715+0000 7f51ea876b80 1 --2- 172.21.15.26:0/3834251121 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da27a70 0x55e77da2f950 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.715+0000 7f51ea876b80 1 --2- 172.21.15.26:0/3834251121 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da263f0 0x55e77da25e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.715+0000 7f51ea876b80 1 --2- 172.21.15.26:0/3834251121 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da270f0 0x55e77da34e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.715+0000 7f51ea876b80 1 -- 172.21.15.26:0/3834251121 >> 172.21.15.26:0/3834251121 conn(0x55e77d9850d0 msgr2=0x55e77da207e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.715+0000 7f51ea876b80 1 -- 172.21.15.26:0/3834251121 shutdown_connections 2023-12-01T01:04:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.715+0000 7f51ea876b80 1 -- 172.21.15.26:0/3834251121 wait complete. 2023-12-01T01:04:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.715+0000 7f51ea876b80 1 -- start start 2023-12-01T01:04:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.715+0000 7f51ea876b80 1 Processor -- start 2023-12-01T01:04:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51ea876b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da263f0 0x55e77da34b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51ea876b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da270f0 0x55e77da33160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51ea876b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da27a70 0x55e77da336a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51ea876b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77da33be0 con 0x55e77da270f0 2023-12-01T01:04:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51ea876b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77da33d50 con 0x55e77da263f0 2023-12-01T01:04:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51ea876b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e77da33f10 con 0x55e77da27a70 2023-12-01T01:04:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51ea876b80 10 client.0 _ll_register_callbacks cb 0x7f51cc003e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51d77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da270f0 0x55e77da33160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51d77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da270f0 0x55e77da33160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55456/0 (socket says 172.21.15.26:55456) 2023-12-01T01:04:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51d7fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da263f0 0x55e77da34b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51d77fe700 1 -- 172.21.15.26:0/2185161420 learned_addr learned my addr 172.21.15.26:0/2185161420 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51dcc83700 1 --2- 172.21.15.26:0/2185161420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da27a70 0x55e77da336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51d77fe700 1 -- 172.21.15.26:0/2185161420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da27a70 msgr2=0x55e77da336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51d77fe700 1 --2- 172.21.15.26:0/2185161420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da27a70 0x55e77da336a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51d77fe700 1 -- 172.21.15.26:0/2185161420 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da263f0 msgr2=0x55e77da34b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51d77fe700 1 --2- 172.21.15.26:0/2185161420 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da263f0 0x55e77da34b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51d77fe700 1 -- 172.21.15.26:0/2185161420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e77d7a4de0 con 0x55e77da270f0 2023-12-01T01:04:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51d7fff700 1 --2- 172.21.15.26:0/2185161420 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da263f0 0x55e77da34b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:04:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51d77fe700 1 --2- 172.21.15.26:0/2185161420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da270f0 0x55e77da33160 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f51cc030420 tx=0x7f51cc030870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2fe932082e3f448 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.716+0000 7f51b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.717+0000 7f51b77fe700 1 -- 172.21.15.26:0/2185161420 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc02b070 con 0x55e77da270f0 2023-12-01T01:04:48.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.717+0000 7f51b77fe700 1 -- 172.21.15.26:0/2185161420 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f51cc005c00 con 0x55e77da270f0 2023-12-01T01:04:48.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.717+0000 7f51ea876b80 1 -- 172.21.15.26:0/2185161420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f51d000f040 con 0x55e77da270f0 2023-12-01T01:04:48.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.717+0000 7f51b77fe700 1 -- 172.21.15.26:0/2185161420 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51cc030c70 con 0x55e77da270f0 2023-12-01T01:04:48.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.717+0000 7f51ea876b80 10 client.15504 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:48.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.717+0000 7f51ea876b80 1 -- 172.21.15.26:0/2185161420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55e77d7a32b0 con 0x55e77da270f0 2023-12-01T01:04:48.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.717+0000 7f51b77fe700 1 -- 172.21.15.26:0/2185161420 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f51d000f040 con 0x55e77da270f0 2023-12-01T01:04:48.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.717+0000 7f51b77fe700 1 -- 172.21.15.26:0/2185161420 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f51cc03b520 con 0x55e77da270f0 2023-12-01T01:04:48.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.717+0000 7f51ea876b80 10 client.15504 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:48.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.717+0000 7f51ea876b80 10 client.15504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:48.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.717+0000 7f51ea876b80 20 client.15504 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:48.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.717+0000 7f51ea876b80 1 --2- 172.21.15.26:0/2185161420 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55e77da8e530 0x55e77da90950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:48.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.717+0000 7f51ea876b80 4 client.15504 mds_command: new command op to 24509 tid=0[{"prefix": "damage ls"}] 2023-12-01T01:04:48.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.717+0000 7f51ea876b80 1 -- 172.21.15.26:0/2185161420 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e77d96fd40 con 0x55e77da8e530 2023-12-01T01:04:48.726 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.717+0000 7f51d7fff700 1 --2- 172.21.15.26:0/2185161420 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55e77da8e530 0x55e77da90950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51b77fe700 10 client.15504 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51d7fff700 1 --2- 172.21.15.26:0/2185161420 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55e77da8e530 0x55e77da90950 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebc004fbe81228cd server_cookie=44b161c4a04f1d5c in_seq=0 out_seq=0 2023-12-01T01:04:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51b77fe700 1 -- 172.21.15.26:0/2185161420 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e77d96fd40 con 0x55e77da8e530 2023-12-01T01:04:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51b77fe700 10 client.15504 handle_command_reply: tid=0 2023-12-01T01:04:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51ea876b80 1 client.15504 shutdown 2023-12-01T01:04:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51ea876b80 1 -- 172.21.15.26:0/2185161420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da270f0 msgr2=0x55e77da33160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51ea876b80 1 --2- 172.21.15.26:0/2185161420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da270f0 0x55e77da33160 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f51cc030420 tx=0x7f51cc030870 comp rx=0 tx=0).stop 2023-12-01T01:04:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51ea876b80 1 -- 172.21.15.26:0/2185161420 shutdown_connections 2023-12-01T01:04:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51ea876b80 1 --2- 172.21.15.26:0/2185161420 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55e77da8e530 0x55e77da90950 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51ea876b80 1 --2- 172.21.15.26:0/2185161420 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e77da27a70 0x55e77da336a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51ea876b80 1 --2- 172.21.15.26:0/2185161420 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e77da263f0 0x55e77da34b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51b77fe700 0 client.15504 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51ea876b80 1 --2- 172.21.15.26:0/2185161420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e77da270f0 0x55e77da33160 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51ea876b80 1 -- 172.21.15.26:0/2185161420 >> 172.21.15.26:0/2185161420 conn(0x55e77d9850d0 msgr2=0x55e77da2f700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.727 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51ea876b80 1 -- 172.21.15.26:0/2185161420 shutdown_connections 2023-12-01T01:04:48.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51ea876b80 1 -- 172.21.15.26:0/2185161420 wait complete. 2023-12-01T01:04:48.728 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.718+0000 7f51ea876b80 20 client.15504 trim_cache size 0 max 16384 2023-12-01T01:04:48.728 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:48 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2750536606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:04:48.728 INFO:teuthology.orchestra.run.smithi026.stdout:[] 2023-12-01T01:04:48.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.719+0000 7f51de6e6700 1 -- 172.21.15.26:0/721474652 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f51c00a05a0 msgr2=0x7f51c00a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.719+0000 7f51de6e6700 1 --2- 172.21.15.26:0/721474652 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f51c00a05a0 0x7f51c00a2a60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f51cc0098e0 tx=0x7f51cc00b540 comp rx=0 tx=0).stop 2023-12-01T01:04:48.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.719+0000 7f51de6e6700 1 -- 172.21.15.26:0/721474652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51d80ffc80 msgr2=0x7f51d8196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:48.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.719+0000 7f51de6e6700 1 --2- 172.21.15.26:0/721474652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51d80ffc80 0x7f51d8196c40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f51c800e970 tx=0x7f51c800ec80 comp rx=0 tx=0).stop 2023-12-01T01:04:48.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.719+0000 7f51de6e6700 1 -- 172.21.15.26:0/721474652 shutdown_connections 2023-12-01T01:04:48.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.719+0000 7f51de6e6700 1 --2- 172.21.15.26:0/721474652 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f51c00a05a0 0x7f51c00a2a60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.719+0000 7f51de6e6700 1 --2- 172.21.15.26:0/721474652 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f51d8101810 0x7f51d819e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.719+0000 7f51de6e6700 1 --2- 172.21.15.26:0/721474652 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f51d80ffc80 0x7f51d8196c40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.729 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.719+0000 7f51de6e6700 1 --2- 172.21.15.26:0/721474652 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f51d8100e70 0x7f51d8197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:48.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.719+0000 7f51de6e6700 1 -- 172.21.15.26:0/721474652 >> 172.21.15.26:0/721474652 conn(0x7f51d80fb1f0 msgr2=0x7f51d8067ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:48.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.719+0000 7f51de6e6700 1 -- 172.21.15.26:0/721474652 shutdown_connections 2023-12-01T01:04:48.730 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:48.719+0000 7f51de6e6700 1 -- 172.21.15.26:0/721474652 wait complete. 2023-12-01T01:04:49.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:49 smithi116 ceph-mon[103554]: pgmap v308: 97 pgs: 97 active+clean; 652 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:04:49.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:49 smithi093 ceph-mon[103327]: pgmap v308: 97 pgs: 97 active+clean; 652 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:04:49.733 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-01T01:04:49.733 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-01T01:04:49.764 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:49 smithi026 ceph-mon[98801]: pgmap v308: 97 pgs: 97 active+clean; 652 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:04:49.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.877+0000 7fae6abb5700 1 -- 172.21.15.26:0/3873481731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae64101810 msgr2=0x7fae641080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:49.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.877+0000 7fae6abb5700 1 --2- 172.21.15.26:0/3873481731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae64101810 0x7fae641080c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00b0d0 tx=0x7fae5c00b3e0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.878+0000 7fae6abb5700 1 -- 172.21.15.26:0/3873481731 shutdown_connections 2023-12-01T01:04:49.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.878+0000 7fae6abb5700 1 --2- 172.21.15.26:0/3873481731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae64101810 0x7fae641080c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.878+0000 7fae6abb5700 1 --2- 172.21.15.26:0/3873481731 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae640ffc80 0x7fae641000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.878+0000 7fae6abb5700 1 --2- 172.21.15.26:0/3873481731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae64100e70 0x7fae641012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.878+0000 7fae6abb5700 1 -- 172.21.15.26:0/3873481731 >> 172.21.15.26:0/3873481731 conn(0x7fae640fb1f0 msgr2=0x7fae640fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:49.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.878+0000 7fae6abb5700 1 -- 172.21.15.26:0/3873481731 shutdown_connections 2023-12-01T01:04:49.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.878+0000 7fae6abb5700 1 -- 172.21.15.26:0/3873481731 wait complete. 2023-12-01T01:04:49.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.878+0000 7fae6abb5700 1 Processor -- start 2023-12-01T01:04:49.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.878+0000 7fae6abb5700 1 -- start start 2023-12-01T01:04:49.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae6abb5700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae640ffc80 0x7fae64195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae6abb5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae64100e70 0x7fae64196000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae6abb5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae64101810 0x7fae6419d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae6abb5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6419d640 con 0x7fae64100e70 2023-12-01T01:04:49.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae6abb5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6419d780 con 0x7fae64101810 2023-12-01T01:04:49.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae6abb5700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6419d910 con 0x7fae640ffc80 2023-12-01T01:04:49.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae64100e70 0x7fae64196000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae64100e70 0x7fae64196000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55470/0 (socket says 172.21.15.26:55470) 2023-12-01T01:04:49.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae5bfff700 1 -- 172.21.15.26:0/2318407832 learned_addr learned my addr 172.21.15.26:0/2318407832 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:49.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae68951700 1 --2- 172.21.15.26:0/2318407832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae640ffc80 0x7fae64195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae69152700 1 --2- 172.21.15.26:0/2318407832 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae64101810 0x7fae6419d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae5bfff700 1 -- 172.21.15.26:0/2318407832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae640ffc80 msgr2=0x7fae64195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:49.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae5bfff700 1 --2- 172.21.15.26:0/2318407832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae640ffc80 0x7fae64195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae5bfff700 1 -- 172.21.15.26:0/2318407832 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae64101810 msgr2=0x7fae6419d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:49.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae5bfff700 1 --2- 172.21.15.26:0/2318407832 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae64101810 0x7fae6419d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae5bfff700 1 -- 172.21.15.26:0/2318407832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5c009d00 con 0x7fae64100e70 2023-12-01T01:04:49.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae68951700 1 --2- 172.21.15.26:0/2318407832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae640ffc80 0x7fae64195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:49.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.879+0000 7fae5bfff700 1 --2- 172.21.15.26:0/2318407832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae64100e70 0x7fae64196000 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fae54007b50 tx=0x7fae54007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:49.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.880+0000 7fae59ffb700 1 -- 172.21.15.26:0/2318407832 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54011070 con 0x7fae64100e70 2023-12-01T01:04:49.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.880+0000 7fae59ffb700 1 -- 172.21.15.26:0/2318407832 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fae5400c2e0 con 0x7fae64100e70 2023-12-01T01:04:49.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.880+0000 7fae6abb5700 1 -- 172.21.15.26:0/2318407832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae64067f50 con 0x7fae64100e70 2023-12-01T01:04:49.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.880+0000 7fae59ffb700 1 -- 172.21.15.26:0/2318407832 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5400aad0 con 0x7fae64100e70 2023-12-01T01:04:49.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.880+0000 7fae6abb5700 1 -- 172.21.15.26:0/2318407832 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae64068460 con 0x7fae64100e70 2023-12-01T01:04:49.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.882+0000 7fae59ffb700 1 -- 172.21.15.26:0/2318407832 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fae5400ed30 con 0x7fae64100e70 2023-12-01T01:04:49.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.882+0000 7fae59ffb700 1 --2- 172.21.15.26:0/2318407832 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fae4c0a0520 0x7fae4c0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.883+0000 7fae68951700 1 --2- 172.21.15.26:0/2318407832 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fae4c0a0520 0x7fae4c0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.883+0000 7fae59ffb700 1 -- 172.21.15.26:0/2318407832 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fae540cc6d0 con 0x7fae64100e70 2023-12-01T01:04:49.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.883+0000 7fae68951700 1 --2- 172.21.15.26:0/2318407832 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fae4c0a0520 0x7fae4c0a29e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fae64100cd0 tx=0x7fae60005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:49.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.883+0000 7fae76d45b80 1 Processor -- start 2023-12-01T01:04:49.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.883+0000 7fae76d45b80 1 -- start start 2023-12-01T01:04:49.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae76d45b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff1170 0x561794ff15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.903 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae76d45b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x561794fefee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae76d45b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff0470 0x561794ff08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae76d45b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x561794f47a90 con 0x561794ff1af0 2023-12-01T01:04:49.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae76d45b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x561794f45450 con 0x561794ff1170 2023-12-01T01:04:49.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae76d45b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x561794f40d40 con 0x561794ff0470 2023-12-01T01:04:49.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x561794fefee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x561794fefee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55478/0 (socket says 172.21.15.26:55478) 2023-12-01T01:04:49.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae5bfff700 1 -- 172.21.15.26:0/2414665809 learned_addr learned my addr 172.21.15.26:0/2414665809 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:49.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae68951700 1 --2- 172.21.15.26:0/2414665809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff1170 0x561794ff15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae69152700 1 --2- 172.21.15.26:0/2414665809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff0470 0x561794ff08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae5bfff700 1 -- 172.21.15.26:0/2414665809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff0470 msgr2=0x561794ff08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:49.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae5bfff700 1 --2- 172.21.15.26:0/2414665809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff0470 0x561794ff08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae5bfff700 1 -- 172.21.15.26:0/2414665809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff1170 msgr2=0x561794ff15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:49.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae5bfff700 1 --2- 172.21.15.26:0/2414665809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff1170 0x561794ff15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae5bfff700 1 -- 172.21.15.26:0/2414665809 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561794d6ee60 con 0x561794ff1af0 2023-12-01T01:04:49.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae69152700 1 --2- 172.21.15.26:0/2414665809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff0470 0x561794ff08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:49.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.884+0000 7fae5bfff700 1 --2- 172.21.15.26:0/2414665809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x561794fefee0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fae540969b0 tx=0x7fae54000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e5bd58924daa20 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:49.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.885+0000 7fae4affd700 1 -- 172.21.15.26:0/2414665809 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54099f40 con 0x561794ff1af0 2023-12-01T01:04:49.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.885+0000 7fae4affd700 1 -- 172.21.15.26:0/2414665809 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fae5409dd70 con 0x561794ff1af0 2023-12-01T01:04:49.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.885+0000 7fae4affd700 1 -- 172.21.15.26:0/2414665809 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54099690 con 0x561794ff1af0 2023-12-01T01:04:49.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.885+0000 7fae76d45b80 1 -- 172.21.15.26:0/2414665809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 msgr2=0x561794fefee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:49.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.885+0000 7fae76d45b80 1 --2- 172.21.15.26:0/2414665809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x561794fefee0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fae540969b0 tx=0x7fae54000bc0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.885+0000 7fae76d45b80 1 -- 172.21.15.26:0/2414665809 shutdown_connections 2023-12-01T01:04:49.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.885+0000 7fae76d45b80 1 --2- 172.21.15.26:0/2414665809 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff0470 0x561794ff08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.885+0000 7fae76d45b80 1 --2- 172.21.15.26:0/2414665809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff1170 0x561794ff15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.885+0000 7fae76d45b80 1 --2- 172.21.15.26:0/2414665809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x561794fefee0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.885+0000 7fae76d45b80 1 -- 172.21.15.26:0/2414665809 >> 172.21.15.26:0/2414665809 conn(0x561794f4f150 msgr2=0x561794fea9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:49.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.885+0000 7fae76d45b80 1 -- 172.21.15.26:0/2414665809 shutdown_connections 2023-12-01T01:04:49.906 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.885+0000 7fae76d45b80 1 -- 172.21.15.26:0/2414665809 wait complete. 2023-12-01T01:04:49.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.886+0000 7fae76d45b80 1 -- start start 2023-12-01T01:04:49.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.886+0000 7fae76d45b80 1 Processor -- start 2023-12-01T01:04:49.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.886+0000 7fae76d45b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff0470 0x561794ff9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.886+0000 7fae76d45b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1170 0x561794ff9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.886+0000 7fae76d45b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff1af0 0x561795000fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.886+0000 7fae76d45b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x561794edd590 con 0x561794ff1170 2023-12-01T01:04:49.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.886+0000 7fae76d45b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x561794edd230 con 0x561794ff1af0 2023-12-01T01:04:49.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.886+0000 7fae76d45b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x561794dc49a0 con 0x561794ff0470 2023-12-01T01:04:49.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.886+0000 7fae76d45b80 10 client.0 _ll_register_callbacks cb 0x561794e2ab00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:49.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.886+0000 7fae5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1170 0x561794ff9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.886+0000 7fae5bfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1170 0x561794ff9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55484/0 (socket says 172.21.15.26:55484) 2023-12-01T01:04:49.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.886+0000 7fae5bfff700 1 -- 172.21.15.26:0/2772652700 learned_addr learned my addr 172.21.15.26:0/2772652700 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:49.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.887+0000 7fae69152700 1 --2- 172.21.15.26:0/2772652700 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff1af0 0x561795000fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.887+0000 7fae68951700 1 --2- 172.21.15.26:0/2772652700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff0470 0x561794ff9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.887+0000 7fae5bfff700 1 -- 172.21.15.26:0/2772652700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff0470 msgr2=0x561794ff9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:49.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.887+0000 7fae5bfff700 1 --2- 172.21.15.26:0/2772652700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff0470 0x561794ff9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.887+0000 7fae5bfff700 1 -- 172.21.15.26:0/2772652700 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff1af0 msgr2=0x561795000fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:49.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.887+0000 7fae5bfff700 1 --2- 172.21.15.26:0/2772652700 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff1af0 0x561795000fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.887+0000 7fae5bfff700 1 -- 172.21.15.26:0/2772652700 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae64068460 con 0x561794ff1170 2023-12-01T01:04:49.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.887+0000 7fae5bfff700 1 --2- 172.21.15.26:0/2772652700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1170 0x561794ff9f60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fae5400cfd0 tx=0x7fae54099d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180729569c3990cd server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:49.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.887+0000 7fae43fff700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:49.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.887+0000 7fae43fff700 1 -- 172.21.15.26:0/2772652700 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5409a3f0 con 0x561794ff1170 2023-12-01T01:04:49.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.887+0000 7fae43fff700 1 -- 172.21.15.26:0/2772652700 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fae54099f40 con 0x561794ff1170 2023-12-01T01:04:49.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.887+0000 7fae76d45b80 1 -- 172.21.15.26:0/2772652700 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561794f6bd90 con 0x561794ff1170 2023-12-01T01:04:49.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.887+0000 7fae43fff700 1 -- 172.21.15.26:0/2772652700 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae540a1d30 con 0x561794ff1170 2023-12-01T01:04:49.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.887+0000 7fae76d45b80 10 client.15516 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:49.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.887+0000 7fae76d45b80 1 -- 172.21.15.26:0/2772652700 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x561794d57ce0 con 0x561794ff1170 2023-12-01T01:04:49.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.887+0000 7fae43fff700 1 -- 172.21.15.26:0/2772652700 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x561794f6bd90 con 0x561794ff1170 2023-12-01T01:04:49.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.888+0000 7fae43fff700 1 -- 172.21.15.26:0/2772652700 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fae5409eab0 con 0x561794ff1170 2023-12-01T01:04:49.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.888+0000 7fae76d45b80 10 client.15516 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:49.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.888+0000 7fae76d45b80 10 client.15516 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:49.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.888+0000 7fae76d45b80 20 client.15516 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:49.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.888+0000 7fae76d45b80 1 --2- 172.21.15.26:0/2772652700 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x561795005570 0x561795007960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.888+0000 7fae76d45b80 4 client.15516 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:04:49.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.888+0000 7fae76d45b80 1 -- 172.21.15.26:0/2772652700 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561794fbee90 con 0x561795005570 2023-12-01T01:04:49.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.888+0000 7fae68951700 1 --2- 172.21.15.26:0/2772652700 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x561795005570 0x561795007960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.889+0000 7fae43fff700 10 client.15516 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:49.911 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.889+0000 7fae68951700 1 --2- 172.21.15.26:0/2772652700 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x561795005570 0x561795007960 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b15f3bf9014d7e2 server_cookie=30da5af2dba958a7 in_seq=0 out_seq=0 2023-12-01T01:04:49.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.889+0000 7fae43fff700 1 -- 172.21.15.26:0/2772652700 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x561794fbee90 con 0x561795005570 2023-12-01T01:04:49.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.889+0000 7fae43fff700 10 client.15516 handle_command_reply: tid=0 2023-12-01T01:04:49.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.889+0000 7fae76d45b80 1 client.15516 shutdown 2023-12-01T01:04:49.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.889+0000 7fae76d45b80 1 -- 172.21.15.26:0/2772652700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1170 msgr2=0x561794ff9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:49.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.889+0000 7fae76d45b80 1 --2- 172.21.15.26:0/2772652700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1170 0x561794ff9f60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fae5400cfd0 tx=0x7fae54099d10 comp rx=0 tx=0).stop 2023-12-01T01:04:49.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.889+0000 7fae76d45b80 1 -- 172.21.15.26:0/2772652700 shutdown_connections 2023-12-01T01:04:49.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.889+0000 7fae76d45b80 1 --2- 172.21.15.26:0/2772652700 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x561795005570 0x561795007960 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.889+0000 7fae76d45b80 1 --2- 172.21.15.26:0/2772652700 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff1af0 0x561795000fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.889+0000 7fae76d45b80 1 --2- 172.21.15.26:0/2772652700 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff0470 0x561794ff9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.889+0000 7fae43fff700 0 client.15516 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:49.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.889+0000 7fae76d45b80 1 --2- 172.21.15.26:0/2772652700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1170 0x561794ff9f60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.889+0000 7fae76d45b80 1 -- 172.21.15.26:0/2772652700 >> 172.21.15.26:0/2772652700 conn(0x561794f4f150 msgr2=0x561794fea130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:49.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.890+0000 7fae76d45b80 1 -- 172.21.15.26:0/2772652700 shutdown_connections 2023-12-01T01:04:49.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.890+0000 7fae76d45b80 1 -- 172.21.15.26:0/2772652700 wait complete. 2023-12-01T01:04:49.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.890+0000 7fae76d45b80 20 client.15516 trim_cache size 0 max 16384 2023-12-01T01:04:49.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.906+0000 7fae76d45b80 1 Processor -- start 2023-12-01T01:04:49.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.906+0000 7fae76d45b80 1 -- start start 2023-12-01T01:04:49.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae76d45b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff0470 0x561794fefee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae76d45b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff1170 0x561794ffef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae76d45b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x561794ff7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae76d45b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x561794febe80 con 0x561794ff1af0 2023-12-01T01:04:49.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae76d45b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x561794ff95c0 con 0x561794ff0470 2023-12-01T01:04:49.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae76d45b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x561794ff8ef0 con 0x561794ff1170 2023-12-01T01:04:49.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae69152700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x561794ff7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae69152700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x561794ff7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55494/0 (socket says 172.21.15.26:55494) 2023-12-01T01:04:49.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae69152700 1 -- 172.21.15.26:0/825383135 learned_addr learned my addr 172.21.15.26:0/825383135 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:49.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae5bfff700 1 --2- 172.21.15.26:0/825383135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff1170 0x561794ffef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae68951700 1 --2- 172.21.15.26:0/825383135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff0470 0x561794fefee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae69152700 1 -- 172.21.15.26:0/825383135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff1170 msgr2=0x561794ffef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:49.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae69152700 1 --2- 172.21.15.26:0/825383135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff1170 0x561794ffef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae69152700 1 -- 172.21.15.26:0/825383135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff0470 msgr2=0x561794fefee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:49.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae69152700 1 --2- 172.21.15.26:0/825383135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff0470 0x561794fefee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae69152700 1 -- 172.21.15.26:0/825383135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561794fe7070 con 0x561794ff1af0 2023-12-01T01:04:49.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae68951700 1 --2- 172.21.15.26:0/825383135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff0470 0x561794fefee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:04:49.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae69152700 1 --2- 172.21.15.26:0/825383135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x561794ff7d20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fae5c015000 tx=0x7fae5c007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a031fa47e1f49e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:49.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.907+0000 7fae4b7fe700 1 -- 172.21.15.26:0/825383135 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c00e040 con 0x561794ff1af0 2023-12-01T01:04:49.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.908+0000 7fae4b7fe700 1 -- 172.21.15.26:0/825383135 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fae5c021070 con 0x561794ff1af0 2023-12-01T01:04:49.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.908+0000 7fae4b7fe700 1 -- 172.21.15.26:0/825383135 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c026690 con 0x561794ff1af0 2023-12-01T01:04:49.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.908+0000 7fae76d45b80 1 -- 172.21.15.26:0/825383135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 msgr2=0x561794ff7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:49.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.908+0000 7fae76d45b80 1 --2- 172.21.15.26:0/825383135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x561794ff7d20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fae5c015000 tx=0x7fae5c007ec0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.908+0000 7fae76d45b80 1 -- 172.21.15.26:0/825383135 shutdown_connections 2023-12-01T01:04:49.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.908+0000 7fae76d45b80 1 --2- 172.21.15.26:0/825383135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x561794ff7d20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.908+0000 7fae76d45b80 1 --2- 172.21.15.26:0/825383135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff0470 0x561794fefee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.908+0000 7fae76d45b80 1 --2- 172.21.15.26:0/825383135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff1170 0x561794ffef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.908+0000 7fae76d45b80 1 -- 172.21.15.26:0/825383135 >> 172.21.15.26:0/825383135 conn(0x561794f4f150 msgr2=0x561794ff7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.908+0000 7fae76d45b80 1 -- 172.21.15.26:0/825383135 shutdown_connections 2023-12-01T01:04:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.908+0000 7fae76d45b80 1 -- 172.21.15.26:0/825383135 wait complete. 2023-12-01T01:04:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.909+0000 7fae76d45b80 1 -- start start 2023-12-01T01:04:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.909+0000 7fae76d45b80 1 Processor -- start 2023-12-01T01:04:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.909+0000 7fae76d45b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff0470 0x561794ffe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.909+0000 7fae76d45b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff1170 0x561794ffeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.909+0000 7fae76d45b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x5617950575a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.909+0000 7fae76d45b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x561795057b50 con 0x561794ff1af0 2023-12-01T01:04:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.909+0000 7fae76d45b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x561795057cc0 con 0x561794ff1170 2023-12-01T01:04:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.909+0000 7fae76d45b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x561795057e80 con 0x561794ff0470 2023-12-01T01:04:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.909+0000 7fae76d45b80 10 client.0 _ll_register_callbacks cb 0x7fae60014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.909+0000 7fae69152700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x5617950575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.909+0000 7fae69152700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x5617950575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55498/0 (socket says 172.21.15.26:55498) 2023-12-01T01:04:49.927 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.909+0000 7fae69152700 1 -- 172.21.15.26:0/1885479898 learned_addr learned my addr 172.21.15.26:0/1885479898 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:49.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.910+0000 7fae68951700 1 --2- 172.21.15.26:0/1885479898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff0470 0x561794ffe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.910+0000 7fae5bfff700 1 --2- 172.21.15.26:0/1885479898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff1170 0x561794ffeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.910+0000 7fae69152700 1 -- 172.21.15.26:0/1885479898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff0470 msgr2=0x561794ffe5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:49.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.910+0000 7fae69152700 1 --2- 172.21.15.26:0/1885479898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff0470 0x561794ffe5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.910+0000 7fae69152700 1 -- 172.21.15.26:0/1885479898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff1170 msgr2=0x561794ffeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:49.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.910+0000 7fae69152700 1 --2- 172.21.15.26:0/1885479898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff1170 0x561794ffeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.910+0000 7fae69152700 1 -- 172.21.15.26:0/1885479898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae64108a10 con 0x561794ff1af0 2023-12-01T01:04:49.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.910+0000 7fae69152700 1 --2- 172.21.15.26:0/1885479898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x5617950575a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00b820 tx=0x7fae5c0074a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424d30c32a452bf9 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:49.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.910+0000 7fae43fff700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:49.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.910+0000 7fae43fff700 1 -- 172.21.15.26:0/1885479898 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c00e030 con 0x561794ff1af0 2023-12-01T01:04:49.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.910+0000 7fae43fff700 1 -- 172.21.15.26:0/1885479898 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fae5c026470 con 0x561794ff1af0 2023-12-01T01:04:49.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.910+0000 7fae76d45b80 1 -- 172.21.15.26:0/1885479898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae5409dd70 con 0x561794ff1af0 2023-12-01T01:04:49.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.910+0000 7fae43fff700 1 -- 172.21.15.26:0/1885479898 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae5c026630 con 0x561794ff1af0 2023-12-01T01:04:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.910+0000 7fae76d45b80 10 client.15522 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.910+0000 7fae76d45b80 1 -- 172.21.15.26:0/1885479898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x561794ff89a0 con 0x561794ff1af0 2023-12-01T01:04:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.911+0000 7fae43fff700 1 -- 172.21.15.26:0/1885479898 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fae5409dd70 con 0x561794ff1af0 2023-12-01T01:04:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.911+0000 7fae43fff700 1 -- 172.21.15.26:0/1885479898 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fae5c019070 con 0x561794ff1af0 2023-12-01T01:04:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.911+0000 7fae76d45b80 10 client.15522 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.911+0000 7fae76d45b80 10 client.15522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.911+0000 7fae76d45b80 20 client.15522 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.911+0000 7fae76d45b80 1 --2- 172.21.15.26:0/1885479898 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x561795059420 0x56179505b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.911+0000 7fae76d45b80 4 client.15522 mds_command: new command op to 24509 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-01T01:04:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.911+0000 7fae76d45b80 1 -- 172.21.15.26:0/1885479898 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x561794f39dc0 con 0x561795059420 2023-12-01T01:04:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.911+0000 7fae68951700 1 --2- 172.21.15.26:0/1885479898 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x561795059420 0x56179505b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.911+0000 7fae68951700 1 --2- 172.21.15.26:0/1885479898 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x561795059420 0x56179505b810 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf33e42ef2c7679d server_cookie=788e7313be1308b in_seq=0 out_seq=0 2023-12-01T01:04:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.911+0000 7fae43fff700 10 client.15522 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.913+0000 7fae43fff700 1 -- 172.21.15.26:0/1885479898 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561794f39dc0 con 0x561795059420 2023-12-01T01:04:49.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.913+0000 7fae43fff700 10 client.15522 handle_command_reply: tid=0 2023-12-01T01:04:49.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.913+0000 7fae76d45b80 1 client.15522 shutdown 2023-12-01T01:04:49.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.913+0000 7fae76d45b80 1 -- 172.21.15.26:0/1885479898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 msgr2=0x5617950575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:49.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.913+0000 7fae76d45b80 1 --2- 172.21.15.26:0/1885479898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x5617950575a0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00b820 tx=0x7fae5c0074a0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.913+0000 7fae76d45b80 1 -- 172.21.15.26:0/1885479898 shutdown_connections 2023-12-01T01:04:49.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.913+0000 7fae76d45b80 1 --2- 172.21.15.26:0/1885479898 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x561795059420 0x56179505b810 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.913+0000 7fae76d45b80 1 --2- 172.21.15.26:0/1885479898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561794ff1af0 0x5617950575a0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.913+0000 7fae76d45b80 1 --2- 172.21.15.26:0/1885479898 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x561794ff0470 0x561794ffe5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.913+0000 7fae43fff700 0 client.15522 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:49.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.913+0000 7fae76d45b80 1 --2- 172.21.15.26:0/1885479898 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x561794ff1170 0x561794ffeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.913+0000 7fae76d45b80 1 -- 172.21.15.26:0/1885479898 >> 172.21.15.26:0/1885479898 conn(0x561794f4f150 msgr2=0x561794fe98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:49.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.913+0000 7fae76d45b80 1 -- 172.21.15.26:0/1885479898 shutdown_connections 2023-12-01T01:04:49.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.913+0000 7fae76d45b80 1 -- 172.21.15.26:0/1885479898 wait complete. 2023-12-01T01:04:49.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.913+0000 7fae76d45b80 20 client.15522 trim_cache size 0 max 16384 2023-12-01T01:04:49.931 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:04:49.931 INFO:teuthology.orchestra.run.smithi026.stdout: "return_code": 0, 2023-12-01T01:04:49.931 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_tag": "1b8baf69-5c7f-4a00-a602-580fc34b6dca", 2023-12-01T01:04:49.931 INFO:teuthology.orchestra.run.smithi026.stdout: "mode": "asynchronous" 2023-12-01T01:04:49.931 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:04:49.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.914+0000 7fae6abb5700 1 -- 172.21.15.26:0/2318407832 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fae4c0a0520 msgr2=0x7fae4c0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:49.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.914+0000 7fae6abb5700 1 --2- 172.21.15.26:0/2318407832 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fae4c0a0520 0x7fae4c0a29e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fae64100cd0 tx=0x7fae60005f90 comp rx=0 tx=0).stop 2023-12-01T01:04:49.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.914+0000 7fae6abb5700 1 -- 172.21.15.26:0/2318407832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae64100e70 msgr2=0x7fae64196000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:49.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.914+0000 7fae6abb5700 1 --2- 172.21.15.26:0/2318407832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae64100e70 0x7fae64196000 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fae54007b50 tx=0x7fae54007f10 comp rx=0 tx=0).stop 2023-12-01T01:04:49.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.914+0000 7fae6abb5700 1 -- 172.21.15.26:0/2318407832 shutdown_connections 2023-12-01T01:04:49.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.914+0000 7fae6abb5700 1 --2- 172.21.15.26:0/2318407832 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fae4c0a0520 0x7fae4c0a29e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.914+0000 7fae6abb5700 1 --2- 172.21.15.26:0/2318407832 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fae64101810 0x7fae6419d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.914+0000 7fae6abb5700 1 --2- 172.21.15.26:0/2318407832 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fae640ffc80 0x7fae64195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.914+0000 7fae6abb5700 1 --2- 172.21.15.26:0/2318407832 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae64100e70 0x7fae64196000 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:49.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.914+0000 7fae6abb5700 1 -- 172.21.15.26:0/2318407832 >> 172.21.15.26:0/2318407832 conn(0x7fae640fb1f0 msgr2=0x7fae640fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:49.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.914+0000 7fae6abb5700 1 -- 172.21.15.26:0/2318407832 shutdown_connections 2023-12-01T01:04:49.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:49.914+0000 7fae6abb5700 1 -- 172.21.15.26:0/2318407832 wait complete. 2023-12-01T01:04:49.934 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-01T01:04:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.104+0000 7fa97bd8d700 1 -- 172.21.15.26:0/3999735894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9740ffc80 msgr2=0x7fa9741000a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.104+0000 7fa97bd8d700 1 --2- 172.21.15.26:0/3999735894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9740ffc80 0x7fa9741000a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa9700099c0 tx=0x7fa970009cd0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.104+0000 7fa97bd8d700 1 -- 172.21.15.26:0/3999735894 shutdown_connections 2023-12-01T01:04:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.104+0000 7fa97bd8d700 1 --2- 172.21.15.26:0/3999735894 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa974101810 0x7fa9741080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.104+0000 7fa97bd8d700 1 --2- 172.21.15.26:0/3999735894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9740ffc80 0x7fa9741000a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.104+0000 7fa97bd8d700 1 --2- 172.21.15.26:0/3999735894 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa974100e70 0x7fa9741012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.104+0000 7fa97bd8d700 1 -- 172.21.15.26:0/3999735894 >> 172.21.15.26:0/3999735894 conn(0x7fa9740fb1f0 msgr2=0x7fa9740fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.104+0000 7fa97bd8d700 1 -- 172.21.15.26:0/3999735894 shutdown_connections 2023-12-01T01:04:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.104+0000 7fa97bd8d700 1 -- 172.21.15.26:0/3999735894 wait complete. 2023-12-01T01:04:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.105+0000 7fa97bd8d700 1 Processor -- start 2023-12-01T01:04:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.105+0000 7fa97bd8d700 1 -- start start 2023-12-01T01:04:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.105+0000 7fa97bd8d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9740ffc80 0x7fa974068a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.105+0000 7fa97bd8d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa974100e70 0x7fa97419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.105+0000 7fa97bd8d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa974101810 0x7fa97419dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.105+0000 7fa97bd8d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97419e6b0 con 0x7fa9740ffc80 2023-12-01T01:04:50.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.105+0000 7fa97bd8d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97419e820 con 0x7fa974100e70 2023-12-01T01:04:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.105+0000 7fa97bd8d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97419e9e0 con 0x7fa974101810 2023-12-01T01:04:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.105+0000 7fa979b29700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9740ffc80 0x7fa974068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.105+0000 7fa979b29700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9740ffc80 0x7fa974068a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55510/0 (socket says 172.21.15.26:55510) 2023-12-01T01:04:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.105+0000 7fa979b29700 1 -- 172.21.15.26:0/3369940277 learned_addr learned my addr 172.21.15.26:0/3369940277 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.105+0000 7fa979328700 1 --2- 172.21.15.26:0/3369940277 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa974100e70 0x7fa97419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.106+0000 7fa97a32a700 1 --2- 172.21.15.26:0/3369940277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa974101810 0x7fa97419dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.106+0000 7fa979b29700 1 -- 172.21.15.26:0/3369940277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa974101810 msgr2=0x7fa97419dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.106+0000 7fa979b29700 1 --2- 172.21.15.26:0/3369940277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa974101810 0x7fa97419dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.106+0000 7fa979b29700 1 -- 172.21.15.26:0/3369940277 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa974100e70 msgr2=0x7fa97419b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.106+0000 7fa979b29700 1 --2- 172.21.15.26:0/3369940277 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa974100e70 0x7fa97419b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.106+0000 7fa979b29700 1 -- 172.21.15.26:0/3369940277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9700095f0 con 0x7fa9740ffc80 2023-12-01T01:04:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.106+0000 7fa979b29700 1 --2- 172.21.15.26:0/3369940277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9740ffc80 0x7fa974068a80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa9700098e0 tx=0x7fa97000bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.106+0000 7fa96affd700 1 -- 172.21.15.26:0/3369940277 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97001d070 con 0x7fa9740ffc80 2023-12-01T01:04:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.106+0000 7fa96affd700 1 -- 172.21.15.26:0/3369940277 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa97000fb40 con 0x7fa9740ffc80 2023-12-01T01:04:50.109 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.106+0000 7fa97bd8d700 1 -- 172.21.15.26:0/3369940277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97419ec60 con 0x7fa9740ffc80 2023-12-01T01:04:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.106+0000 7fa96affd700 1 -- 172.21.15.26:0/3369940277 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9700173f0 con 0x7fa9740ffc80 2023-12-01T01:04:50.110 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.106+0000 7fa97bd8d700 1 -- 172.21.15.26:0/3369940277 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97419f080 con 0x7fa9740ffc80 2023-12-01T01:04:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.108+0000 7fa96affd700 1 -- 172.21.15.26:0/3369940277 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fa97000fcb0 con 0x7fa9740ffc80 2023-12-01T01:04:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.109+0000 7fa96affd700 1 --2- 172.21.15.26:0/3369940277 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa9600a0520 0x7fa9600a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.109+0000 7fa96affd700 1 -- 172.21.15.26:0/3369940277 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa9700ccb90 con 0x7fa9740ffc80 2023-12-01T01:04:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.109+0000 7fa979328700 1 --2- 172.21.15.26:0/3369940277 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa9600a0520 0x7fa9600a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.109+0000 7fa987f1db80 1 Processor -- start 2023-12-01T01:04:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa987f1db80 1 -- start start 2023-12-01T01:04:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa979328700 1 --2- 172.21.15.26:0/3369940277 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa9600a0520 0x7fa9600a29e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa9740687f0 tx=0x7fa964009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa987f1db80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07d0f0 0x55ea5e07d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa987f1db80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07da70 0x55ea5e07be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa987f1db80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e07c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa987f1db80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5dfd3a10 con 0x55ea5e07c3f0 2023-12-01T01:04:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa987f1db80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5dfd13d0 con 0x55ea5e07da70 2023-12-01T01:04:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa987f1db80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5dfcccc0 con 0x55ea5e07d0f0 2023-12-01T01:04:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa97a32a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e07c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa97a32a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e07c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55522/0 (socket says 172.21.15.26:55522) 2023-12-01T01:04:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa97a32a700 1 -- 172.21.15.26:0/2664729240 learned_addr learned my addr 172.21.15.26:0/2664729240 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa979b29700 1 --2- 172.21.15.26:0/2664729240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07d0f0 0x55ea5e07d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa979328700 1 --2- 172.21.15.26:0/2664729240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07da70 0x55ea5e07be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa97a32a700 1 -- 172.21.15.26:0/2664729240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07d0f0 msgr2=0x55ea5e07d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa97a32a700 1 --2- 172.21.15.26:0/2664729240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07d0f0 0x55ea5e07d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa97a32a700 1 -- 172.21.15.26:0/2664729240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07da70 msgr2=0x55ea5e07be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa97a32a700 1 --2- 172.21.15.26:0/2664729240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07da70 0x55ea5e07be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa97a32a700 1 -- 172.21.15.26:0/2664729240 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea5ddfade0 con 0x55ea5e07c3f0 2023-12-01T01:04:50.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.110+0000 7fa979b29700 1 --2- 172.21.15.26:0/2664729240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07d0f0 0x55ea5e07d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.111+0000 7fa97a32a700 1 --2- 172.21.15.26:0/2664729240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e07c870 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009440 tx=0x7fa96c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f292840118112f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.111+0000 7fa95ffff700 1 -- 172.21.15.26:0/2664729240 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c00e070 con 0x55ea5e07c3f0 2023-12-01T01:04:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.111+0000 7fa95ffff700 1 -- 172.21.15.26:0/2664729240 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa96c00f040 con 0x55ea5e07c3f0 2023-12-01T01:04:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.111+0000 7fa95ffff700 1 -- 172.21.15.26:0/2664729240 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c015c70 con 0x55ea5e07c3f0 2023-12-01T01:04:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.111+0000 7fa987f1db80 1 -- 172.21.15.26:0/2664729240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 msgr2=0x55ea5e07c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.111+0000 7fa987f1db80 1 --2- 172.21.15.26:0/2664729240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e07c870 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009440 tx=0x7fa96c009920 comp rx=0 tx=0).stop 2023-12-01T01:04:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.111+0000 7fa987f1db80 1 -- 172.21.15.26:0/2664729240 shutdown_connections 2023-12-01T01:04:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.111+0000 7fa987f1db80 1 --2- 172.21.15.26:0/2664729240 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e07c870 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.111+0000 7fa987f1db80 1 --2- 172.21.15.26:0/2664729240 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07d0f0 0x55ea5e07d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.111+0000 7fa987f1db80 1 --2- 172.21.15.26:0/2664729240 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07da70 0x55ea5e07be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.111+0000 7fa987f1db80 1 -- 172.21.15.26:0/2664729240 >> 172.21.15.26:0/2664729240 conn(0x55ea5dfdb0d0 msgr2=0x55ea5e076940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.112+0000 7fa987f1db80 1 -- 172.21.15.26:0/2664729240 shutdown_connections 2023-12-01T01:04:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.112+0000 7fa987f1db80 1 -- 172.21.15.26:0/2664729240 wait complete. 2023-12-01T01:04:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.112+0000 7fa987f1db80 1 -- start start 2023-12-01T01:04:50.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.112+0000 7fa987f1db80 1 Processor -- start 2023-12-01T01:04:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.112+0000 7fa987f1db80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e089dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.112+0000 7fa987f1db80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07d0f0 0x55ea5e08a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.112+0000 7fa987f1db80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07da70 0x55ea5e091340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.112+0000 7fa987f1db80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5df69510 con 0x55ea5e07c3f0 2023-12-01T01:04:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.112+0000 7fa987f1db80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5df691b0 con 0x55ea5e07da70 2023-12-01T01:04:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.112+0000 7fa987f1db80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5de50920 con 0x55ea5e07d0f0 2023-12-01T01:04:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.112+0000 7fa987f1db80 10 client.0 _ll_register_callbacks cb 0x55ea5deb6a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.112+0000 7fa979b29700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e089dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa979b29700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e089dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55524/0 (socket says 172.21.15.26:55524) 2023-12-01T01:04:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa979b29700 1 -- 172.21.15.26:0/803699005 learned_addr learned my addr 172.21.15.26:0/803699005 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:50.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa97a32a700 1 --2- 172.21.15.26:0/803699005 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07da70 0x55ea5e091340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa979328700 1 --2- 172.21.15.26:0/803699005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07d0f0 0x55ea5e08a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa979b29700 1 -- 172.21.15.26:0/803699005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07d0f0 msgr2=0x55ea5e08a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa979b29700 1 --2- 172.21.15.26:0/803699005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07d0f0 0x55ea5e08a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa979b29700 1 -- 172.21.15.26:0/803699005 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07da70 msgr2=0x55ea5e091340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa979b29700 1 --2- 172.21.15.26:0/803699005 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07da70 0x55ea5e091340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa979b29700 1 -- 172.21.15.26:0/803699005 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96c0090f0 con 0x55ea5e07c3f0 2023-12-01T01:04:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa979b29700 1 --2- 172.21.15.26:0/803699005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e089dc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa970009fd0 tx=0x7fa970085330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d469265f350d2c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa95d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa95d7fa700 1 -- 172.21.15.26:0/803699005 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970096040 con 0x55ea5e07c3f0 2023-12-01T01:04:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa95d7fa700 1 -- 172.21.15.26:0/803699005 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa97009e350 con 0x55ea5e07c3f0 2023-12-01T01:04:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa987f1db80 1 -- 172.21.15.26:0/803699005 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea5dff7d10 con 0x55ea5e07c3f0 2023-12-01T01:04:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa95d7fa700 1 -- 172.21.15.26:0/803699005 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9700a2500 con 0x55ea5e07c3f0 2023-12-01T01:04:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa987f1db80 10 client.15534 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa987f1db80 1 -- 172.21.15.26:0/803699005 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ea5dde3c60 con 0x55ea5e07c3f0 2023-12-01T01:04:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.113+0000 7fa95d7fa700 1 -- 172.21.15.26:0/803699005 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55ea5dff7d10 con 0x55ea5e07c3f0 2023-12-01T01:04:50.120 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.114+0000 7fa95d7fa700 1 -- 172.21.15.26:0/803699005 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fa9700a2070 con 0x55ea5e07c3f0 2023-12-01T01:04:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.114+0000 7fa987f1db80 10 client.15534 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.114+0000 7fa987f1db80 10 client.15534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.114+0000 7fa987f1db80 20 client.15534 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.114+0000 7fa987f1db80 1 --2- 172.21.15.26:0/803699005 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ea5e0957d0 0x55ea5e097bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.114+0000 7fa987f1db80 4 client.15534 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:04:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.114+0000 7fa987f1db80 1 -- 172.21.15.26:0/803699005 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea5e04ae10 con 0x55ea5e0957d0 2023-12-01T01:04:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.114+0000 7fa979328700 1 --2- 172.21.15.26:0/803699005 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ea5e0957d0 0x55ea5e097bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.114+0000 7fa95d7fa700 10 client.15534 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.114+0000 7fa979328700 1 --2- 172.21.15.26:0/803699005 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ea5e0957d0 0x55ea5e097bc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e715c635f0bcacc8 server_cookie=5b46f1a8302c786f in_seq=0 out_seq=0 2023-12-01T01:04:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.115+0000 7fa95d7fa700 1 -- 172.21.15.26:0/803699005 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55ea5e04ae10 con 0x55ea5e0957d0 2023-12-01T01:04:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.115+0000 7fa95d7fa700 10 client.15534 handle_command_reply: tid=0 2023-12-01T01:04:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.115+0000 7fa987f1db80 1 client.15534 shutdown 2023-12-01T01:04:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.115+0000 7fa987f1db80 1 -- 172.21.15.26:0/803699005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 msgr2=0x55ea5e089dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.115+0000 7fa987f1db80 1 --2- 172.21.15.26:0/803699005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e089dc0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa970009fd0 tx=0x7fa970085330 comp rx=0 tx=0).stop 2023-12-01T01:04:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.115+0000 7fa987f1db80 1 -- 172.21.15.26:0/803699005 shutdown_connections 2023-12-01T01:04:50.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.115+0000 7fa987f1db80 1 --2- 172.21.15.26:0/803699005 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ea5e0957d0 0x55ea5e097bc0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.115+0000 7fa987f1db80 1 --2- 172.21.15.26:0/803699005 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07da70 0x55ea5e091340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.115+0000 7fa987f1db80 1 --2- 172.21.15.26:0/803699005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e089dc0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.115+0000 7fa987f1db80 1 --2- 172.21.15.26:0/803699005 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07d0f0 0x55ea5e08a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.115+0000 7fa95d7fa700 0 client.15534 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.115+0000 7fa987f1db80 1 -- 172.21.15.26:0/803699005 >> 172.21.15.26:0/803699005 conn(0x55ea5dfdb0d0 msgr2=0x55ea5e0760b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.115+0000 7fa987f1db80 1 -- 172.21.15.26:0/803699005 shutdown_connections 2023-12-01T01:04:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.115+0000 7fa987f1db80 1 -- 172.21.15.26:0/803699005 wait complete. 2023-12-01T01:04:50.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.115+0000 7fa987f1db80 20 client.15534 trim_cache size 0 max 16384 2023-12-01T01:04:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa987f1db80 1 Processor -- start 2023-12-01T01:04:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa987f1db80 1 -- start start 2023-12-01T01:04:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa987f1db80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e07be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa987f1db80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07d0f0 0x55ea5e08f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa987f1db80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07da70 0x55ea5e080370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa987f1db80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5e084050 con 0x55ea5e07c3f0 2023-12-01T01:04:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa987f1db80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5e0777f0 con 0x55ea5e07d0f0 2023-12-01T01:04:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa987f1db80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5e06ebe0 con 0x55ea5e07da70 2023-12-01T01:04:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa979b29700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e07be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa979b29700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e07be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55532/0 (socket says 172.21.15.26:55532) 2023-12-01T01:04:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa979b29700 1 -- 172.21.15.26:0/2382938000 learned_addr learned my addr 172.21.15.26:0/2382938000 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa97a32a700 1 --2- 172.21.15.26:0/2382938000 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07da70 0x55ea5e080370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa979328700 1 --2- 172.21.15.26:0/2382938000 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07d0f0 0x55ea5e08f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa979b29700 1 -- 172.21.15.26:0/2382938000 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07da70 msgr2=0x55ea5e080370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa979b29700 1 --2- 172.21.15.26:0/2382938000 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07da70 0x55ea5e080370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa979b29700 1 -- 172.21.15.26:0/2382938000 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07d0f0 msgr2=0x55ea5e08f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa979b29700 1 --2- 172.21.15.26:0/2382938000 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07d0f0 0x55ea5e08f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa979b29700 1 -- 172.21.15.26:0/2382938000 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea5de21250 con 0x55ea5e07c3f0 2023-12-01T01:04:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.132+0000 7fa97a32a700 1 --2- 172.21.15.26:0/2382938000 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07da70 0x55ea5e080370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.133+0000 7fa979b29700 1 --2- 172.21.15.26:0/2382938000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e07be60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa9700ca990 tx=0x7fa970098ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94de87d667d86bc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.133+0000 7fa968ff9700 1 -- 172.21.15.26:0/2382938000 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970096040 con 0x55ea5e07c3f0 2023-12-01T01:04:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.133+0000 7fa968ff9700 1 -- 172.21.15.26:0/2382938000 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa97009e350 con 0x55ea5e07c3f0 2023-12-01T01:04:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.133+0000 7fa968ff9700 1 -- 172.21.15.26:0/2382938000 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970099a10 con 0x55ea5e07c3f0 2023-12-01T01:04:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.133+0000 7fa987f1db80 1 -- 172.21.15.26:0/2382938000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 msgr2=0x55ea5e07be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.133+0000 7fa987f1db80 1 --2- 172.21.15.26:0/2382938000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e07be60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa9700ca990 tx=0x7fa970098ad0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.133+0000 7fa987f1db80 1 -- 172.21.15.26:0/2382938000 shutdown_connections 2023-12-01T01:04:50.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.133+0000 7fa987f1db80 1 --2- 172.21.15.26:0/2382938000 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07da70 0x55ea5e080370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.133+0000 7fa987f1db80 1 --2- 172.21.15.26:0/2382938000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07c3f0 0x55ea5e07be60 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.133+0000 7fa987f1db80 1 --2- 172.21.15.26:0/2382938000 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07d0f0 0x55ea5e08f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.133+0000 7fa987f1db80 1 -- 172.21.15.26:0/2382938000 >> 172.21.15.26:0/2382938000 conn(0x55ea5dfdb0d0 msgr2=0x55ea5e0846b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:50.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.134+0000 7fa987f1db80 1 -- 172.21.15.26:0/2382938000 shutdown_connections 2023-12-01T01:04:50.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.134+0000 7fa987f1db80 1 -- 172.21.15.26:0/2382938000 wait complete. 2023-12-01T01:04:50.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.134+0000 7fa987f1db80 1 -- start start 2023-12-01T01:04:50.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.134+0000 7fa987f1db80 1 Processor -- start 2023-12-01T01:04:50.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa987f1db80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07c3f0 0x55ea5e08ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa987f1db80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07d0f0 0x55ea5e08f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa987f1db80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07da70 0x55ea5e08d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.140 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa987f1db80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5e08d860 con 0x55ea5e07d0f0 2023-12-01T01:04:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa987f1db80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5e08d9d0 con 0x55ea5e07c3f0 2023-12-01T01:04:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa987f1db80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5e08db90 con 0x55ea5e07da70 2023-12-01T01:04:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa987f1db80 10 client.0 _ll_register_callbacks cb 0x7fa97009a3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa979328700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07d0f0 0x55ea5e08f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa979328700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07d0f0 0x55ea5e08f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55540/0 (socket says 172.21.15.26:55540) 2023-12-01T01:04:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa979328700 1 -- 172.21.15.26:0/1609705306 learned_addr learned my addr 172.21.15.26:0/1609705306 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa979b29700 1 --2- 172.21.15.26:0/1609705306 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07c3f0 0x55ea5e08ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa97a32a700 1 --2- 172.21.15.26:0/1609705306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07da70 0x55ea5e08d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa979328700 1 -- 172.21.15.26:0/1609705306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07da70 msgr2=0x55ea5e08d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa979328700 1 --2- 172.21.15.26:0/1609705306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07da70 0x55ea5e08d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa979328700 1 -- 172.21.15.26:0/1609705306 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07c3f0 msgr2=0x55ea5e08ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa979328700 1 --2- 172.21.15.26:0/1609705306 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07c3f0 0x55ea5e08ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa979328700 1 -- 172.21.15.26:0/1609705306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ea5dde3c60 con 0x55ea5e07d0f0 2023-12-01T01:04:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa979328700 1 --2- 172.21.15.26:0/1609705306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07d0f0 0x55ea5e08f170 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa9640097c0 tx=0x7fa9640047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcfacd3837aef1d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa95d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa95d7fa700 1 -- 172.21.15.26:0/1609705306 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964023040 con 0x55ea5e07d0f0 2023-12-01T01:04:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa95d7fa700 1 -- 172.21.15.26:0/1609705306 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fa96401dad0 con 0x55ea5e07d0f0 2023-12-01T01:04:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.135+0000 7fa987f1db80 1 -- 172.21.15.26:0/1609705306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa96c00f040 con 0x55ea5e07d0f0 2023-12-01T01:04:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.136+0000 7fa95d7fa700 1 -- 172.21.15.26:0/1609705306 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa96401dc90 con 0x55ea5e07d0f0 2023-12-01T01:04:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.136+0000 7fa987f1db80 10 client.15540 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.136+0000 7fa987f1db80 1 -- 172.21.15.26:0/1609705306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ea5ddf92b0 con 0x55ea5e07d0f0 2023-12-01T01:04:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.136+0000 7fa95d7fa700 1 -- 172.21.15.26:0/1609705306 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fa96c00f040 con 0x55ea5e07d0f0 2023-12-01T01:04:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.136+0000 7fa95d7fa700 1 -- 172.21.15.26:0/1609705306 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fa964028ca0 con 0x55ea5e07d0f0 2023-12-01T01:04:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.136+0000 7fa987f1db80 10 client.15540 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.136+0000 7fa987f1db80 10 client.15540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.136+0000 7fa987f1db80 20 client.15540 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.136+0000 7fa987f1db80 1 --2- 172.21.15.26:0/1609705306 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ea5e0e86e0 0x55ea5e0eab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.136+0000 7fa987f1db80 4 client.15540 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-01T01:04:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.136+0000 7fa987f1db80 1 -- 172.21.15.26:0/1609705306 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ea5dfc5d40 con 0x55ea5e0e86e0 2023-12-01T01:04:50.142 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.136+0000 7fa979b29700 1 --2- 172.21.15.26:0/1609705306 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ea5e0e86e0 0x55ea5e0eab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa95d7fa700 10 client.15540 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa979b29700 1 --2- 172.21.15.26:0/1609705306 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ea5e0e86e0 0x55ea5e0eab00 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b53e6ce455c72ea7 server_cookie=998844cd1c9b74ef in_seq=0 out_seq=0 2023-12-01T01:04:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa95d7fa700 1 -- 172.21.15.26:0/1609705306 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ea5dfc5d40 con 0x55ea5e0e86e0 2023-12-01T01:04:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa95d7fa700 10 client.15540 handle_command_reply: tid=0 2023-12-01T01:04:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa987f1db80 1 client.15540 shutdown 2023-12-01T01:04:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa987f1db80 1 -- 172.21.15.26:0/1609705306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07d0f0 msgr2=0x55ea5e08f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa987f1db80 1 --2- 172.21.15.26:0/1609705306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07d0f0 0x55ea5e08f170 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa9640097c0 tx=0x7fa9640047c0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa987f1db80 1 -- 172.21.15.26:0/1609705306 shutdown_connections 2023-12-01T01:04:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa987f1db80 1 --2- 172.21.15.26:0/1609705306 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ea5e0e86e0 0x55ea5e0eab00 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa987f1db80 1 --2- 172.21.15.26:0/1609705306 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ea5e07da70 0x55ea5e08d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa95d7fa700 0 client.15540 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa987f1db80 1 --2- 172.21.15.26:0/1609705306 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ea5e07c3f0 0x55ea5e08ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa987f1db80 1 --2- 172.21.15.26:0/1609705306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ea5e07d0f0 0x55ea5e08f170 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa987f1db80 1 -- 172.21.15.26:0/1609705306 >> 172.21.15.26:0/1609705306 conn(0x55ea5dfdb0d0 msgr2=0x55ea5e080370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:50.143 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa987f1db80 1 -- 172.21.15.26:0/1609705306 shutdown_connections 2023-12-01T01:04:50.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa987f1db80 1 -- 172.21.15.26:0/1609705306 wait complete. 2023-12-01T01:04:50.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.137+0000 7fa987f1db80 20 client.15540 trim_cache size 0 max 16384 2023-12-01T01:04:50.144 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:04:50.144 INFO:teuthology.orchestra.run.smithi026.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-01T01:04:50.144 INFO:teuthology.orchestra.run.smithi026.stdout: "scrubs": { 2023-12-01T01:04:50.144 INFO:teuthology.orchestra.run.smithi026.stdout: "1b8baf69-5c7f-4a00-a602-580fc34b6dca": { 2023-12-01T01:04:50.144 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/", 2023-12-01T01:04:50.144 INFO:teuthology.orchestra.run.smithi026.stdout: "tag": "1b8baf69-5c7f-4a00-a602-580fc34b6dca", 2023-12-01T01:04:50.144 INFO:teuthology.orchestra.run.smithi026.stdout: "options": "recursive,force" 2023-12-01T01:04:50.144 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:04:50.144 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:04:50.145 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:04:50.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.138+0000 7fa97bd8d700 1 -- 172.21.15.26:0/3369940277 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa9600a0520 msgr2=0x7fa9600a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:50.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.138+0000 7fa97bd8d700 1 --2- 172.21.15.26:0/3369940277 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa9600a0520 0x7fa9600a29e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa9740687f0 tx=0x7fa964009260 comp rx=0 tx=0).stop 2023-12-01T01:04:50.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.138+0000 7fa97bd8d700 1 -- 172.21.15.26:0/3369940277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9740ffc80 msgr2=0x7fa974068a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:50.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.138+0000 7fa97bd8d700 1 --2- 172.21.15.26:0/3369940277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9740ffc80 0x7fa974068a80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa9700098e0 tx=0x7fa97000bfd0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.138+0000 7fa97bd8d700 1 -- 172.21.15.26:0/3369940277 shutdown_connections 2023-12-01T01:04:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.138+0000 7fa97bd8d700 1 --2- 172.21.15.26:0/3369940277 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fa9600a0520 0x7fa9600a29e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.138+0000 7fa97bd8d700 1 --2- 172.21.15.26:0/3369940277 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fa974101810 0x7fa97419dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.138+0000 7fa97bd8d700 1 --2- 172.21.15.26:0/3369940277 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa9740ffc80 0x7fa974068a80 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.138+0000 7fa97bd8d700 1 --2- 172.21.15.26:0/3369940277 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa974100e70 0x7fa97419b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.138+0000 7fa97bd8d700 1 -- 172.21.15.26:0/3369940277 >> 172.21.15.26:0/3369940277 conn(0x7fa9740fb1f0 msgr2=0x7fa9740fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.138+0000 7fa97bd8d700 1 -- 172.21.15.26:0/3369940277 shutdown_connections 2023-12-01T01:04:50.146 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:04:50.138+0000 7fa97bd8d700 1 -- 172.21.15.26:0/3369940277 wait complete. 2023-12-01T01:04:50.151 INFO:tasks.cephfs.filesystem:scrub status for tag:1b8baf69-5c7f-4a00-a602-580fc34b6dca - {'path': '/', 'tag': '1b8baf69-5c7f-4a00-a602-580fc34b6dca', 'options': 'recursive,force'} 2023-12-01T01:04:50.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:50 smithi026 ceph-mon[98801]: scrub queued for path: / 2023-12-01T01:04:50.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:50 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:04:50.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:50 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:04:50.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:50 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:04:50.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:50 smithi116 ceph-mon[103554]: scrub queued for path: / 2023-12-01T01:04:50.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:50 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:04:50.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:50 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:04:50.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:50 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:04:50.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:50 smithi093 ceph-mon[103327]: scrub queued for path: / 2023-12-01T01:04:50.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:50 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:04:50.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:50 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:04:50.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:50 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:04:51.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:51 smithi116 ceph-mon[103554]: pgmap v309: 97 pgs: 97 active+clean; 652 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:04:51.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:51 smithi116 ceph-mon[103554]: scrub summary: idle 2023-12-01T01:04:51.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:51 smithi093 ceph-mon[103327]: pgmap v309: 97 pgs: 97 active+clean; 652 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:04:51.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:51 smithi093 ceph-mon[103327]: scrub summary: idle 2023-12-01T01:04:51.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:51 smithi026 ceph-mon[98801]: pgmap v309: 97 pgs: 97 active+clean; 652 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:04:51.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:51 smithi026 ceph-mon[98801]: scrub summary: idle 2023-12-01T01:04:53.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:53 smithi116 ceph-mon[103554]: pgmap v310: 97 pgs: 97 active+clean; 652 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:04:53.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:53 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:04:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:53 smithi093 ceph-mon[103327]: pgmap v310: 97 pgs: 97 active+clean; 652 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:04:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:53 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:04:53.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:53 smithi026 ceph-mon[98801]: pgmap v310: 97 pgs: 97 active+clean; 652 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:04:53.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:53 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:04:55.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:55 smithi116 ceph-mon[103554]: pgmap v311: 97 pgs: 97 active+clean; 652 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-01T01:04:55.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:55 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:55 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:55 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:55 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:55 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:55 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:55 smithi093 ceph-mon[103327]: pgmap v311: 97 pgs: 97 active+clean; 652 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-01T01:04:55.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:55 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:55 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:55 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:55 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:55 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:55 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:55 smithi026 ceph-mon[98801]: pgmap v311: 97 pgs: 97 active+clean; 652 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-01T01:04:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:55 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:55 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:55 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:55 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:55 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:55 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.660+0000 7fdfe69b1700 1 -- 172.21.15.26:0/206897649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe0105930 msgr2=0x7fdfe0107df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.660+0000 7fdfe69b1700 1 --2- 172.21.15.26:0/206897649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe0105930 0x7fdfe0107df0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fdfd800b0a0 tx=0x7fdfd800b3b0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.660+0000 7fdfe69b1700 1 -- 172.21.15.26:0/206897649 shutdown_connections 2023-12-01T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.660+0000 7fdfe69b1700 1 --2- 172.21.15.26:0/206897649 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe0105930 0x7fdfe0107df0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.660+0000 7fdfe69b1700 1 --2- 172.21.15.26:0/206897649 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfe01004b0 0x7fdfe01028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.660+0000 7fdfe69b1700 1 --2- 172.21.15.26:0/206897649 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfe0102e70 0x7fdfe01052a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.660+0000 7fdfe69b1700 1 -- 172.21.15.26:0/206897649 >> 172.21.15.26:0/206897649 conn(0x7fdfe00fa540 msgr2=0x7fdfe00fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.660+0000 7fdfe69b1700 1 -- 172.21.15.26:0/206897649 shutdown_connections 2023-12-01T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.661+0000 7fdfe69b1700 1 -- 172.21.15.26:0/206897649 wait complete. 2023-12-01T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.661+0000 7fdfe69b1700 1 Processor -- start 2023-12-01T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.661+0000 7fdfe69b1700 1 -- start start 2023-12-01T01:04:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.661+0000 7fdfe69b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe01004b0 0x7fdfe0196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.661+0000 7fdfe69b1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfe0102e70 0x7fdfe0197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.661+0000 7fdfe69b1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfe0105930 0x7fdfe0198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.661+0000 7fdfe69b1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe01987e0 con 0x7fdfe01004b0 2023-12-01T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.661+0000 7fdfe69b1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe0198950 con 0x7fdfe0102e70 2023-12-01T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.661+0000 7fdfe69b1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe0198b10 con 0x7fdfe0105930 2023-12-01T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.661+0000 7fdfdffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe01004b0 0x7fdfe0196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.662+0000 7fdfdffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe01004b0 0x7fdfe0196df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55552/0 (socket says 172.21.15.26:55552) 2023-12-01T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.662+0000 7fdfdffff700 1 -- 172.21.15.26:0/1956724196 learned_addr learned my addr 172.21.15.26:0/1956724196 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.662+0000 7fdfdf7fe700 1 --2- 172.21.15.26:0/1956724196 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfe0102e70 0x7fdfe0197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.662+0000 7fdfe4f4e700 1 --2- 172.21.15.26:0/1956724196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfe0105930 0x7fdfe0198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.662+0000 7fdfdffff700 1 -- 172.21.15.26:0/1956724196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfe0105930 msgr2=0x7fdfe0198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.662+0000 7fdfdffff700 1 --2- 172.21.15.26:0/1956724196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfe0105930 0x7fdfe0198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.662+0000 7fdfdffff700 1 -- 172.21.15.26:0/1956724196 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfe0102e70 msgr2=0x7fdfe0197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.662+0000 7fdfdffff700 1 --2- 172.21.15.26:0/1956724196 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfe0102e70 0x7fdfe0197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.662+0000 7fdfdffff700 1 -- 172.21.15.26:0/1956724196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd8009d00 con 0x7fdfe01004b0 2023-12-01T01:04:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.662+0000 7fdfe4f4e700 1 --2- 172.21.15.26:0/1956724196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfe0105930 0x7fdfe0198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.662+0000 7fdfdffff700 1 --2- 172.21.15.26:0/1956724196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe01004b0 0x7fdfe0196df0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000d950 tx=0x7fdfd000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.662+0000 7fdfdd7fa700 1 -- 172.21.15.26:0/1956724196 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd0009940 con 0x7fdfe01004b0 2023-12-01T01:04:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.662+0000 7fdfdd7fa700 1 -- 172.21.15.26:0/1956724196 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdfd0010460 con 0x7fdfe01004b0 2023-12-01T01:04:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.662+0000 7fdfe69b1700 1 -- 172.21.15.26:0/1956724196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe0198df0 con 0x7fdfe01004b0 2023-12-01T01:04:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.662+0000 7fdfdd7fa700 1 -- 172.21.15.26:0/1956724196 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd000f620 con 0x7fdfe01004b0 2023-12-01T01:04:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.662+0000 7fdfe69b1700 1 -- 172.21.15.26:0/1956724196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe019f580 con 0x7fdfe01004b0 2023-12-01T01:04:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.665+0000 7fdfdd7fa700 1 -- 172.21.15.26:0/1956724196 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fdfd0010960 con 0x7fdfe01004b0 2023-12-01T01:04:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.666+0000 7fdfdd7fa700 1 --2- 172.21.15.26:0/1956724196 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdfc80a0520 0x7fdfc80a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.666+0000 7fdfdd7fa700 1 -- 172.21.15.26:0/1956724196 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdfd00cb800 con 0x7fdfe01004b0 2023-12-01T01:04:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.666+0000 7fdfdf7fe700 1 --2- 172.21.15.26:0/1956724196 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdfc80a0520 0x7fdfc80a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.666+0000 7fdff2b41b80 1 Processor -- start 2023-12-01T01:04:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdff2b41b80 1 -- start start 2023-12-01T01:04:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdfdf7fe700 1 --2- 172.21.15.26:0/1956724196 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdfc80a0520 0x7fdfc80a29e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0196b60 tx=0x7fdfd400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdff2b41b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9ae680 0x556fef9aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdff2b41b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9aefe0 0x556fef9af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdff2b41b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9afed0 0x556fef9b0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdff2b41b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fef9069b0 con 0x556fef9ae680 2023-12-01T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdff2b41b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fef904370 con 0x556fef9aefe0 2023-12-01T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdff2b41b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fef8ffc60 con 0x556fef9afed0 2023-12-01T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdfdffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9ae680 0x556fef9aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdfdffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9ae680 0x556fef9aeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55560/0 (socket says 172.21.15.26:55560) 2023-12-01T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdfdffff700 1 -- 172.21.15.26:0/2883656889 learned_addr learned my addr 172.21.15.26:0/2883656889 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdfe4f4e700 1 --2- 172.21.15.26:0/2883656889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9afed0 0x556fef9b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdfdf7fe700 1 --2- 172.21.15.26:0/2883656889 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9aefe0 0x556fef9af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdfdffff700 1 -- 172.21.15.26:0/2883656889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9afed0 msgr2=0x556fef9b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdfdffff700 1 --2- 172.21.15.26:0/2883656889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9afed0 0x556fef9b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdfdffff700 1 -- 172.21.15.26:0/2883656889 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9aefe0 msgr2=0x556fef9af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdfdffff700 1 --2- 172.21.15.26:0/2883656889 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9aefe0 0x556fef9af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdfdffff700 1 -- 172.21.15.26:0/2883656889 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fef72dd80 con 0x556fef9ae680 2023-12-01T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdfe4f4e700 1 --2- 172.21.15.26:0/2883656889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9afed0 0x556fef9b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.667+0000 7fdfdf7fe700 1 --2- 172.21.15.26:0/2883656889 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9aefe0 0x556fef9af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.668+0000 7fdfdffff700 1 --2- 172.21.15.26:0/2883656889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9ae680 0x556fef9aeaa0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0095ae0 tx=0x7fdfd0098a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a602c00365c0b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.668+0000 7fdfc67fc700 1 -- 172.21.15.26:0/2883656889 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd009cea0 con 0x556fef9ae680 2023-12-01T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.668+0000 7fdfc67fc700 1 -- 172.21.15.26:0/2883656889 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdfd00a10e0 con 0x556fef9ae680 2023-12-01T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.668+0000 7fdfc67fc700 1 -- 172.21.15.26:0/2883656889 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd00a0eb0 con 0x556fef9ae680 2023-12-01T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.668+0000 7fdff2b41b80 1 -- 172.21.15.26:0/2883656889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9ae680 msgr2=0x556fef9aeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.668+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/2883656889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9ae680 0x556fef9aeaa0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0095ae0 tx=0x7fdfd0098a50 comp rx=0 tx=0).stop 2023-12-01T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.668+0000 7fdff2b41b80 1 -- 172.21.15.26:0/2883656889 shutdown_connections 2023-12-01T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.668+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/2883656889 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9afed0 0x556fef9b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.668+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/2883656889 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9ae680 0x556fef9aeaa0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.668+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/2883656889 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9aefe0 0x556fef9af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.668+0000 7fdff2b41b80 1 -- 172.21.15.26:0/2883656889 >> 172.21.15.26:0/2883656889 conn(0x556fef90e070 msgr2=0x556fef9ab040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.669+0000 7fdff2b41b80 1 -- 172.21.15.26:0/2883656889 shutdown_connections 2023-12-01T01:04:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.669+0000 7fdff2b41b80 1 -- 172.21.15.26:0/2883656889 wait complete. 2023-12-01T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.669+0000 7fdff2b41b80 1 -- start start 2023-12-01T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.669+0000 7fdff2b41b80 1 Processor -- start 2023-12-01T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdff2b41b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9aefe0 0x556fef9b8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.676 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdff2b41b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9afed0 0x556fef9b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdff2b41b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9bdc70 0x556fef9c0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdff2b41b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fef89c4b0 con 0x556fef9bdc70 2023-12-01T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdff2b41b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fef89c150 con 0x556fef9aefe0 2023-12-01T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdff2b41b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fef7838c0 con 0x556fef9afed0 2023-12-01T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdff2b41b80 10 client.0 _ll_register_callbacks cb 0x556fef7e9a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdfe4f4e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9bdc70 0x556fef9c0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdfe4f4e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9bdc70 0x556fef9c0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55570/0 (socket says 172.21.15.26:55570) 2023-12-01T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdfe4f4e700 1 -- 172.21.15.26:0/8361135 learned_addr learned my addr 172.21.15.26:0/8361135 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdfdffff700 1 --2- 172.21.15.26:0/8361135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9aefe0 0x556fef9b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdfdf7fe700 1 --2- 172.21.15.26:0/8361135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9afed0 0x556fef9b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdfe4f4e700 1 -- 172.21.15.26:0/8361135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9afed0 msgr2=0x556fef9b8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdfe4f4e700 1 --2- 172.21.15.26:0/8361135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9afed0 0x556fef9b8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdfe4f4e700 1 -- 172.21.15.26:0/8361135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9aefe0 msgr2=0x556fef9b8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdfe4f4e700 1 --2- 172.21.15.26:0/8361135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9aefe0 0x556fef9b8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdfe4f4e700 1 -- 172.21.15.26:0/8361135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe019f580 con 0x556fef9bdc70 2023-12-01T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdfe4f4e700 1 --2- 172.21.15.26:0/8361135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9bdc70 0x556fef9c0060 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8007b60 tx=0x7fdfd8004d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5610cc1bf94eb2f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdfbf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdfbf7fe700 1 -- 172.21.15.26:0/8361135 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd800e040 con 0x556fef9bdc70 2023-12-01T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdfbf7fe700 1 -- 172.21.15.26:0/8361135 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdfd8005040 con 0x556fef9bdc70 2023-12-01T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.670+0000 7fdff2b41b80 1 -- 172.21.15.26:0/8361135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556fef92acb0 con 0x556fef9bdc70 2023-12-01T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.671+0000 7fdfbf7fe700 1 -- 172.21.15.26:0/8361135 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfd8007970 con 0x556fef9bdc70 2023-12-01T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.671+0000 7fdff2b41b80 10 client.15552 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.671+0000 7fdff2b41b80 1 -- 172.21.15.26:0/8361135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x556fef716c00 con 0x556fef9bdc70 2023-12-01T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.671+0000 7fdfbf7fe700 1 -- 172.21.15.26:0/8361135 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x556fef92acb0 con 0x556fef9bdc70 2023-12-01T01:04:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.671+0000 7fdfbf7fe700 1 -- 172.21.15.26:0/8361135 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fdfd802f070 con 0x556fef9bdc70 2023-12-01T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.671+0000 7fdff2b41b80 10 client.15552 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.671+0000 7fdff2b41b80 10 client.15552 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.671+0000 7fdff2b41b80 20 client.15552 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.671+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/8361135 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x556fef9c48f0 0x556fef9c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.671+0000 7fdff2b41b80 4 client.15552 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.671+0000 7fdff2b41b80 1 -- 172.21.15.26:0/8361135 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556fef97ddb0 con 0x556fef9c48f0 2023-12-01T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.671+0000 7fdfdffff700 1 --2- 172.21.15.26:0/8361135 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x556fef9c48f0 0x556fef9c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.672+0000 7fdfdffff700 1 --2- 172.21.15.26:0/8361135 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x556fef9c48f0 0x556fef9c6d10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17376c509272da3c server_cookie=782844e8d6e8e9d9 in_seq=0 out_seq=0 2023-12-01T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.672+0000 7fdfbf7fe700 10 client.15552 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.672+0000 7fdfbf7fe700 1 -- 172.21.15.26:0/8361135 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x556fef97ddb0 con 0x556fef9c48f0 2023-12-01T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.672+0000 7fdfbf7fe700 10 client.15552 handle_command_reply: tid=0 2023-12-01T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.672+0000 7fdff2b41b80 1 client.15552 shutdown 2023-12-01T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.673+0000 7fdff2b41b80 1 -- 172.21.15.26:0/8361135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9bdc70 msgr2=0x556fef9c0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.673+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/8361135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9bdc70 0x556fef9c0060 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8007b60 tx=0x7fdfd8004d90 comp rx=0 tx=0).stop 2023-12-01T01:04:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.673+0000 7fdff2b41b80 1 -- 172.21.15.26:0/8361135 shutdown_connections 2023-12-01T01:04:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.673+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/8361135 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x556fef9c48f0 0x556fef9c6d10 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.673+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/8361135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9bdc70 0x556fef9c0060 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.673+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/8361135 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9aefe0 0x556fef9b8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.673+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/8361135 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9afed0 0x556fef9b8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.673+0000 7fdff2b41b80 1 -- 172.21.15.26:0/8361135 >> 172.21.15.26:0/8361135 conn(0x556fef90e070 msgr2=0x556fef9a93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.673+0000 7fdfbf7fe700 0 client.15552 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.673+0000 7fdff2b41b80 1 -- 172.21.15.26:0/8361135 shutdown_connections 2023-12-01T01:04:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.673+0000 7fdff2b41b80 1 -- 172.21.15.26:0/8361135 wait complete. 2023-12-01T01:04:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.673+0000 7fdff2b41b80 20 client.15552 trim_cache size 0 max 16384 2023-12-01T01:04:56.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:56 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:04:56.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:56 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:04:56.681 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:56 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.687+0000 7fdff2b41b80 1 Processor -- start 2023-12-01T01:04:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.687+0000 7fdff2b41b80 1 -- start start 2023-12-01T01:04:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdff2b41b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9aefe0 0x556fef9d41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdff2b41b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9afed0 0x556fef9b7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdff2b41b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9bdc70 0x556fef9aac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdff2b41b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fef9aa6d0 con 0x556fef9afed0 2023-12-01T01:04:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdff2b41b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fef9b7bb0 con 0x556fef9bdc70 2023-12-01T01:04:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdff2b41b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fef9b8270 con 0x556fef9aefe0 2023-12-01T01:04:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdfdf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9afed0 0x556fef9b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdfdf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9afed0 0x556fef9b7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55576/0 (socket says 172.21.15.26:55576) 2023-12-01T01:04:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdfdf7fe700 1 -- 172.21.15.26:0/751588884 learned_addr learned my addr 172.21.15.26:0/751588884 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdfdffff700 1 --2- 172.21.15.26:0/751588884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9aefe0 0x556fef9d41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdfe4f4e700 1 --2- 172.21.15.26:0/751588884 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9bdc70 0x556fef9aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdfdf7fe700 1 -- 172.21.15.26:0/751588884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9aefe0 msgr2=0x556fef9d41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdfdf7fe700 1 --2- 172.21.15.26:0/751588884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9aefe0 0x556fef9d41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdfdf7fe700 1 -- 172.21.15.26:0/751588884 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9bdc70 msgr2=0x556fef9aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdfdf7fe700 1 --2- 172.21.15.26:0/751588884 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9bdc70 0x556fef9aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.692 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdfdf7fe700 1 -- 172.21.15.26:0/751588884 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fef7541f0 con 0x556fef9afed0 2023-12-01T01:04:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdfdf7fe700 1 --2- 172.21.15.26:0/751588884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9afed0 0x556fef9b7170 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400fdc0 tx=0x7fdfd4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf88354c90a8a0ea server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.688+0000 7fdfc6ffd700 1 -- 172.21.15.26:0/751588884 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4022050 con 0x556fef9afed0 2023-12-01T01:04:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.689+0000 7fdfc6ffd700 1 -- 172.21.15.26:0/751588884 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdfd4023040 con 0x556fef9afed0 2023-12-01T01:04:56.693 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.689+0000 7fdfc6ffd700 1 -- 172.21.15.26:0/751588884 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd40108d0 con 0x556fef9afed0 2023-12-01T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.689+0000 7fdff2b41b80 1 -- 172.21.15.26:0/751588884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9afed0 msgr2=0x556fef9b7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.689+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/751588884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9afed0 0x556fef9b7170 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400fdc0 tx=0x7fdfd4012000 comp rx=0 tx=0).stop 2023-12-01T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.689+0000 7fdff2b41b80 1 -- 172.21.15.26:0/751588884 shutdown_connections 2023-12-01T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.689+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/751588884 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9bdc70 0x556fef9aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.689+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/751588884 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9aefe0 0x556fef9d41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.689+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/751588884 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9afed0 0x556fef9b7170 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.689+0000 7fdff2b41b80 1 -- 172.21.15.26:0/751588884 >> 172.21.15.26:0/751588884 conn(0x556fef90e070 msgr2=0x556fef9b30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.689+0000 7fdff2b41b80 1 -- 172.21.15.26:0/751588884 shutdown_connections 2023-12-01T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.689+0000 7fdff2b41b80 1 -- 172.21.15.26:0/751588884 wait complete. 2023-12-01T01:04:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.690+0000 7fdff2b41b80 1 -- start start 2023-12-01T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.690+0000 7fdff2b41b80 1 Processor -- start 2023-12-01T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.690+0000 7fdff2b41b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9aefe0 0x556fefa10990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.690+0000 7fdff2b41b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9afed0 0x556fefa12ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.690+0000 7fdff2b41b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9bdc70 0x556fefa15430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.690+0000 7fdff2b41b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fefa15af0 con 0x556fef9afed0 2023-12-01T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.690+0000 7fdff2b41b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fefa15c60 con 0x556fef9aefe0 2023-12-01T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.690+0000 7fdff2b41b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fefa15e20 con 0x556fef9bdc70 2023-12-01T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.690+0000 7fdff2b41b80 10 client.0 _ll_register_callbacks cb 0x7fdfd8009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.690+0000 7fdfdf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9afed0 0x556fefa12ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.690+0000 7fdfdf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9afed0 0x556fefa12ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55582/0 (socket says 172.21.15.26:55582) 2023-12-01T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.690+0000 7fdfdf7fe700 1 -- 172.21.15.26:0/4006362844 learned_addr learned my addr 172.21.15.26:0/4006362844 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.690+0000 7fdfe4f4e700 1 --2- 172.21.15.26:0/4006362844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9bdc70 0x556fefa15430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.690+0000 7fdfdffff700 1 --2- 172.21.15.26:0/4006362844 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9aefe0 0x556fefa10990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdfdf7fe700 1 -- 172.21.15.26:0/4006362844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9bdc70 msgr2=0x556fefa15430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdfdf7fe700 1 --2- 172.21.15.26:0/4006362844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9bdc70 0x556fefa15430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdfdf7fe700 1 -- 172.21.15.26:0/4006362844 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9aefe0 msgr2=0x556fefa10990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdfdf7fe700 1 --2- 172.21.15.26:0/4006362844 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9aefe0 0x556fefa10990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdfdf7fe700 1 -- 172.21.15.26:0/4006362844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd400fa70 con 0x556fef9afed0 2023-12-01T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdfdf7fe700 1 --2- 172.21.15.26:0/4006362844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9afed0 0x556fefa12ee0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400a3e0 tx=0x7fdfd4010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7ffbcefadc8561 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdfbf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdfbf7fe700 1 -- 172.21.15.26:0/4006362844 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd4028660 con 0x556fef9afed0 2023-12-01T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdfbf7fe700 1 -- 172.21.15.26:0/4006362844 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdfd40287c0 con 0x556fef9afed0 2023-12-01T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdff2b41b80 1 -- 172.21.15.26:0/4006362844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdfd00a10e0 con 0x556fef9afed0 2023-12-01T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdfbf7fe700 1 -- 172.21.15.26:0/4006362844 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfd4022020 con 0x556fef9afed0 2023-12-01T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdff2b41b80 10 client.15558 fetch_fsmap learned FSMap version 23 2023-12-01T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdff2b41b80 1 -- 172.21.15.26:0/4006362844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x556fef72c250 con 0x556fef9afed0 2023-12-01T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdfbf7fe700 1 -- 172.21.15.26:0/4006362844 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdfd4042020 con 0x556fef9afed0 2023-12-01T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdfbf7fe700 1 -- 172.21.15.26:0/4006362844 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fdfd4033c40 con 0x556fef9afed0 2023-12-01T01:04:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdff2b41b80 10 client.15558 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:04:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdff2b41b80 10 client.15558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:04:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdff2b41b80 20 client.15558 populate_metadata read hostname 'smithi026' 2023-12-01T01:04:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/4006362844 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x556fefa17810 0x556fefa19c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:04:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdff2b41b80 4 client.15558 mds_command: new command op to 24509 tid=0[{"prefix": "flush journal"}] 2023-12-01T01:04:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.691+0000 7fdff2b41b80 1 -- 172.21.15.26:0/4006362844 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556fef8f8ce0 con 0x556fefa17810 2023-12-01T01:04:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.692+0000 7fdfdffff700 1 --2- 172.21.15.26:0/4006362844 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x556fefa17810 0x556fefa19c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:04:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.692+0000 7fdfbf7fe700 10 client.15558 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.692+0000 7fdfdffff700 1 --2- 172.21.15.26:0/4006362844 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x556fefa17810 0x556fefa19c30 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=660419191608bd1d server_cookie=9793c5206e9903eb in_seq=0 out_seq=0 2023-12-01T01:04:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.699+0000 7fdfbf7fe700 1 -- 172.21.15.26:0/4006362844 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556fef8f8ce0 con 0x556fefa17810 2023-12-01T01:04:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.699+0000 7fdfbf7fe700 10 client.15558 handle_command_reply: tid=0 2023-12-01T01:04:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.699+0000 7fdff2b41b80 1 client.15558 shutdown 2023-12-01T01:04:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.700+0000 7fdff2b41b80 1 -- 172.21.15.26:0/4006362844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9afed0 msgr2=0x556fefa12ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.700+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/4006362844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9afed0 0x556fefa12ee0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdfd400a3e0 tx=0x7fdfd4010d80 comp rx=0 tx=0).stop 2023-12-01T01:04:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.700+0000 7fdff2b41b80 1 -- 172.21.15.26:0/4006362844 shutdown_connections 2023-12-01T01:04:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.700+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/4006362844 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x556fefa17810 0x556fefa19c30 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.700+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/4006362844 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x556fef9bdc70 0x556fefa15430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.700+0000 7fdfbf7fe700 0 client.15558 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:04:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.700+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/4006362844 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x556fef9aefe0 0x556fefa10990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.700+0000 7fdff2b41b80 1 --2- 172.21.15.26:0/4006362844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556fef9afed0 0x556fefa12ee0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.703 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.700+0000 7fdff2b41b80 1 -- 172.21.15.26:0/4006362844 >> 172.21.15.26:0/4006362844 conn(0x556fef90e070 msgr2=0x556fef9b7170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.700+0000 7fdff2b41b80 1 -- 172.21.15.26:0/4006362844 shutdown_connections 2023-12-01T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.700+0000 7fdff2b41b80 1 -- 172.21.15.26:0/4006362844 wait complete. 2023-12-01T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.700+0000 7fdff2b41b80 20 client.15558 trim_cache size 0 max 16384 2023-12-01T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:{ 2023-12-01T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "message": "", 2023-12-01T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "return_code": 0 2023-12-01T01:04:56.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:} 2023-12-01T01:04:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.700+0000 7fdfe69b1700 1 -- 172.21.15.26:0/1956724196 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdfc80a0520 msgr2=0x7fdfc80a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.700+0000 7fdfe69b1700 1 --2- 172.21.15.26:0/1956724196 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdfc80a0520 0x7fdfc80a29e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdfe0196b60 tx=0x7fdfd400a300 comp rx=0 tx=0).stop 2023-12-01T01:04:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.700+0000 7fdfe69b1700 1 -- 172.21.15.26:0/1956724196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe01004b0 msgr2=0x7fdfe0196df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:04:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.700+0000 7fdfe69b1700 1 --2- 172.21.15.26:0/1956724196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe01004b0 0x7fdfe0196df0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fdfd000d950 tx=0x7fdfd000dc60 comp rx=0 tx=0).stop 2023-12-01T01:04:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.701+0000 7fdfe69b1700 1 -- 172.21.15.26:0/1956724196 shutdown_connections 2023-12-01T01:04:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.701+0000 7fdfe69b1700 1 --2- 172.21.15.26:0/1956724196 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdfc80a0520 0x7fdfc80a29e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.701+0000 7fdfe69b1700 1 --2- 172.21.15.26:0/1956724196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdfe0105930 0x7fdfe0198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.701+0000 7fdfe69b1700 1 --2- 172.21.15.26:0/1956724196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfe01004b0 0x7fdfe0196df0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.701+0000 7fdfe69b1700 1 --2- 172.21.15.26:0/1956724196 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdfe0102e70 0x7fdfe0197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:04:56.705 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.701+0000 7fdfe69b1700 1 -- 172.21.15.26:0/1956724196 >> 172.21.15.26:0/1956724196 conn(0x7fdfe00fa540 msgr2=0x7fdfe00ff9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:04:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.701+0000 7fdfe69b1700 1 -- 172.21.15.26:0/1956724196 shutdown_connections 2023-12-01T01:04:56.706 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:04:56.701+0000 7fdfe69b1700 1 -- 172.21.15.26:0/1956724196 wait complete. 2023-12-01T01:04:56.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:56 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:04:56.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:56 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:04:56.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:56 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:56.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:56 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:04:56.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:56 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:04:56.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:56 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:04:58.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:57 smithi026 ceph-mon[98801]: pgmap v312: 97 pgs: 97 active+clean; 652 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-01T01:04:58.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:57 smithi116 ceph-mon[103554]: pgmap v312: 97 pgs: 97 active+clean; 652 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-01T01:04:58.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:57 smithi093 ceph-mon[103327]: pgmap v312: 97 pgs: 97 active+clean; 652 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-01T01:05:00.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:04:59 smithi026 ceph-mon[98801]: pgmap v313: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-01T01:05:00.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:04:59 smithi116 ceph-mon[103554]: pgmap v313: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-01T01:05:00.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:04:59 smithi093 ceph-mon[103327]: pgmap v313: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-01T01:05:02.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:01 smithi026 ceph-mon[98801]: pgmap v314: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-01T01:05:02.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:01 smithi116 ceph-mon[103554]: pgmap v314: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-01T01:05:02.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:01 smithi093 ceph-mon[103327]: pgmap v314: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.5 KiB/s wr, 7 op/s 2023-12-01T01:05:04.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:03 smithi026 ceph-mon[98801]: pgmap v315: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-01T01:05:04.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:03 smithi116 ceph-mon[103554]: pgmap v315: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-01T01:05:04.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:03 smithi093 ceph-mon[103327]: pgmap v315: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-01T01:05:06.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:05 smithi026 ceph-mon[98801]: pgmap v316: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-12-01T01:05:06.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:05 smithi116 ceph-mon[103554]: pgmap v316: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-12-01T01:05:06.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:05 smithi093 ceph-mon[103327]: pgmap v316: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-12-01T01:05:08.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:07 smithi026 ceph-mon[98801]: pgmap v317: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-01T01:05:08.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:07 smithi116 ceph-mon[103554]: pgmap v317: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-01T01:05:08.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:07 smithi093 ceph-mon[103327]: pgmap v317: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-01T01:05:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.868+0000 7ff994521700 1 -- 172.21.15.26:0/1139427402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff98c100e80 msgr2=0x7ff98c1012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.868+0000 7ff994521700 1 --2- 172.21.15.26:0/1139427402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff98c100e80 0x7ff98c1012e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7ff97c0099c0 tx=0x7ff97c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.869+0000 7ff994521700 1 -- 172.21.15.26:0/1139427402 shutdown_connections 2023-12-01T01:05:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.869+0000 7ff994521700 1 --2- 172.21.15.26:0/1139427402 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff98c101820 0x7ff98c1080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.869+0000 7ff994521700 1 --2- 172.21.15.26:0/1139427402 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff98c0ffc90 0x7ff98c1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.869+0000 7ff994521700 1 --2- 172.21.15.26:0/1139427402 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff98c100e80 0x7ff98c1012e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.869+0000 7ff994521700 1 -- 172.21.15.26:0/1139427402 >> 172.21.15.26:0/1139427402 conn(0x7ff98c0fb1e0 msgr2=0x7ff98c0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.869+0000 7ff994521700 1 -- 172.21.15.26:0/1139427402 shutdown_connections 2023-12-01T01:05:09.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.869+0000 7ff994521700 1 -- 172.21.15.26:0/1139427402 wait complete. 2023-12-01T01:05:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.869+0000 7ff994521700 1 Processor -- start 2023-12-01T01:05:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.869+0000 7ff994521700 1 -- start start 2023-12-01T01:05:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff994521700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff98c0ffc90 0x7ff98c196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff994521700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff98c100e80 0x7ff98c197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff994521700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff98c101820 0x7ff98c197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff994521700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c1986c0 con 0x7ff98c100e80 2023-12-01T01:05:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff994521700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c198830 con 0x7ff98c101820 2023-12-01T01:05:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff994521700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c1989f0 con 0x7ff98c0ffc90 2023-12-01T01:05:09.873 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff991abc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff98c100e80 0x7ff98c197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff991abc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff98c100e80 0x7ff98c197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55596/0 (socket says 172.21.15.26:55596) 2023-12-01T01:05:09.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff991abc700 1 -- 172.21.15.26:0/1968861096 learned_addr learned my addr 172.21.15.26:0/1968861096 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:09.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff9922bd700 1 --2- 172.21.15.26:0/1968861096 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff98c0ffc90 0x7ff98c196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff992abe700 1 --2- 172.21.15.26:0/1968861096 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff98c101820 0x7ff98c197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff991abc700 1 -- 172.21.15.26:0/1968861096 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff98c0ffc90 msgr2=0x7ff98c196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:09.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff991abc700 1 --2- 172.21.15.26:0/1968861096 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff98c0ffc90 0x7ff98c196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff991abc700 1 -- 172.21.15.26:0/1968861096 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff98c101820 msgr2=0x7ff98c197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:09.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff991abc700 1 --2- 172.21.15.26:0/1968861096 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff98c101820 0x7ff98c197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff991abc700 1 -- 172.21.15.26:0/1968861096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c0095f0 con 0x7ff98c100e80 2023-12-01T01:05:09.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.870+0000 7ff992abe700 1 --2- 172.21.15.26:0/1968861096 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff98c101820 0x7ff98c197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:05:09.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.871+0000 7ff991abc700 1 --2- 172.21.15.26:0/1968861096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff98c100e80 0x7ff98c197280 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff97c000c00 tx=0x7ff97c005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:09.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.871+0000 7ff9837fe700 1 -- 172.21.15.26:0/1968861096 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c01d070 con 0x7ff98c100e80 2023-12-01T01:05:09.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.871+0000 7ff9837fe700 1 -- 172.21.15.26:0/1968861096 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff97c0040c0 con 0x7ff98c100e80 2023-12-01T01:05:09.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.871+0000 7ff9837fe700 1 -- 172.21.15.26:0/1968861096 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c00f460 con 0x7ff98c100e80 2023-12-01T01:05:09.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.871+0000 7ff994521700 1 -- 172.21.15.26:0/1968861096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98c198c70 con 0x7ff98c100e80 2023-12-01T01:05:09.875 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.871+0000 7ff994521700 1 -- 172.21.15.26:0/1968861096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98c10af90 con 0x7ff98c100e80 2023-12-01T01:05:09.876 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.874+0000 7ff9837fe700 1 -- 172.21.15.26:0/1968861096 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7ff97c022600 con 0x7ff98c100e80 2023-12-01T01:05:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.875+0000 7ff9837fe700 1 --2- 172.21.15.26:0/1968861096 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff9780a0520 0x7ff9780a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.875+0000 7ff9837fe700 1 -- 172.21.15.26:0/1968861096 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff97c0cce00 con 0x7ff98c100e80 2023-12-01T01:05:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.875+0000 7ff9922bd700 1 --2- 172.21.15.26:0/1968861096 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff9780a0520 0x7ff9780a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.877 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.876+0000 7ff9a06b1b80 1 Processor -- start 2023-12-01T01:05:09.879 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.876+0000 7ff9a06b1b80 1 -- start start 2023-12-01T01:05:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.876+0000 7ff9a06b1b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2680 0x5557063f2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.876+0000 7ff9a06b1b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2fe0 0x5557063f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.876+0000 7ff9a06b1b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 0x5557063f4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.876+0000 7ff9a06b1b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55570634a9b0 con 0x5557063f3ed0 2023-12-01T01:05:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.876+0000 7ff9a06b1b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x555706348370 con 0x5557063f2680 2023-12-01T01:05:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.876+0000 7ff9a06b1b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x555706343c60 con 0x5557063f2fe0 2023-12-01T01:05:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.877+0000 7ff9922bd700 1 --2- 172.21.15.26:0/1968861096 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff9780a0520 0x7ff9780a29e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff98c100ce0 tx=0x7ff988007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.877+0000 7ff992abe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 0x5557063f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.877+0000 7ff992abe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 0x5557063f4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55604/0 (socket says 172.21.15.26:55604) 2023-12-01T01:05:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.877+0000 7ff992abe700 1 -- 172.21.15.26:0/571619364 learned_addr learned my addr 172.21.15.26:0/571619364 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.877+0000 7ff991abc700 1 --2- 172.21.15.26:0/571619364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2fe0 0x5557063f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.877+0000 7ff9922bd700 1 --2- 172.21.15.26:0/571619364 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2680 0x5557063f2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.877+0000 7ff992abe700 1 -- 172.21.15.26:0/571619364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2fe0 msgr2=0x5557063f38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.877+0000 7ff992abe700 1 --2- 172.21.15.26:0/571619364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2fe0 0x5557063f38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.880 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.877+0000 7ff992abe700 1 -- 172.21.15.26:0/571619364 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2680 msgr2=0x5557063f2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.877+0000 7ff992abe700 1 --2- 172.21.15.26:0/571619364 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2680 0x5557063f2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.877+0000 7ff992abe700 1 -- 172.21.15.26:0/571619364 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555706171d80 con 0x5557063f3ed0 2023-12-01T01:05:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.877+0000 7ff9922bd700 1 --2- 172.21.15.26:0/571619364 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2680 0x5557063f2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:05:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.877+0000 7ff992abe700 1 --2- 172.21.15.26:0/571619364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 0x5557063f4350 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff984007e80 tx=0x7ff98400c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18b8e631433e39d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.877+0000 7ff980ff9700 1 -- 172.21.15.26:0/571619364 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98400cdf0 con 0x5557063f3ed0 2023-12-01T01:05:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.877+0000 7ff980ff9700 1 -- 172.21.15.26:0/571619364 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff98400f920 con 0x5557063f3ed0 2023-12-01T01:05:09.881 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.877+0000 7ff980ff9700 1 -- 172.21.15.26:0/571619364 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98400e8e0 con 0x5557063f3ed0 2023-12-01T01:05:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.878+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/571619364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 msgr2=0x5557063f4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.878+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/571619364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 0x5557063f4350 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7ff984007e80 tx=0x7ff98400c5a0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.878+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/571619364 shutdown_connections 2023-12-01T01:05:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.878+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/571619364 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 0x5557063f4350 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.878+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/571619364 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2680 0x5557063f2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.878+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/571619364 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2fe0 0x5557063f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.879+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/571619364 >> 172.21.15.26:0/571619364 conn(0x555706352070 msgr2=0x5557063ef040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:09.884 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.879+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/571619364 shutdown_connections 2023-12-01T01:05:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.879+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/571619364 wait complete. 2023-12-01T01:05:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.879+0000 7ff9a06b1b80 1 -- start start 2023-12-01T01:05:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.879+0000 7ff9a06b1b80 1 Processor -- start 2023-12-01T01:05:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.879+0000 7ff9a06b1b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2680 0x5557063fc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff9a06b1b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f2fe0 0x5557063fca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff9a06b1b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f3ed0 0x555706403a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff9a06b1b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557062e04b0 con 0x5557063f2fe0 2023-12-01T01:05:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff9a06b1b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557062e0150 con 0x5557063f3ed0 2023-12-01T01:05:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff9a06b1b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557061c78c0 con 0x5557063f2680 2023-12-01T01:05:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff9a06b1b80 10 client.0 _ll_register_callbacks cb 0x55570622da20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff9922bd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2680 0x5557063fc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff9922bd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2680 0x5557063fc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.26:47838/0 (socket says 172.21.15.26:47838) 2023-12-01T01:05:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff9922bd700 1 -- 172.21.15.26:0/2527045167 learned_addr learned my addr 172.21.15.26:0/2527045167 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff992abe700 1 --2- 172.21.15.26:0/2527045167 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f3ed0 0x555706403a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.885 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff9922bd700 1 -- 172.21.15.26:0/2527045167 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f3ed0 msgr2=0x555706403a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff9922bd700 1 --2- 172.21.15.26:0/2527045167 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f3ed0 0x555706403a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff9922bd700 1 -- 172.21.15.26:0/2527045167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f2fe0 msgr2=0x5557063fca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff9922bd700 1 --2- 172.21.15.26:0/2527045167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f2fe0 0x5557063fca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff9922bd700 1 -- 172.21.15.26:0/2527045167 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff984007ab0 con 0x5557063f2680 2023-12-01T01:05:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff992abe700 1 --2- 172.21.15.26:0/2527045167 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f3ed0 0x555706403a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:05:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff9922bd700 1 --2- 172.21.15.26:0/2527045167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2680 0x5557063fc4d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff9880116f0 tx=0x7ff9880047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd42336615731e74 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.880+0000 7ff975ffb700 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2023-12-01T01:05:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.881+0000 7ff975ffb700 1 -- 172.21.15.26:0/2527045167 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98801e630 con 0x5557063f2680 2023-12-01T01:05:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.881+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/2527045167 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55570636ecb0 con 0x5557063f2680 2023-12-01T01:05:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.881+0000 7ff975ffb700 1 -- 172.21.15.26:0/2527045167 <== mon.1 v2:172.21.15.116:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff988017070 con 0x5557063f2680 2023-12-01T01:05:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.881+0000 7ff975ffb700 1 -- 172.21.15.26:0/2527045167 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff98801e790 con 0x5557063f2680 2023-12-01T01:05:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.881+0000 7ff9a06b1b80 10 client.25246 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.881+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/2527045167 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55570615ac00 con 0x5557063f2680 2023-12-01T01:05:09.886 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.881+0000 7ff975ffb700 1 -- 172.21.15.26:0/2527045167 <== mon.1 v2:172.21.15.116:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55570636ecb0 con 0x5557063f2680 2023-12-01T01:05:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.882+0000 7ff975ffb700 1 -- 172.21.15.26:0/2527045167 <== mon.1 v2:172.21.15.116:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7ff988030070 con 0x5557063f2680 2023-12-01T01:05:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.882+0000 7ff9a06b1b80 10 client.25246 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.882+0000 7ff9a06b1b80 10 client.25246 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.882+0000 7ff9a06b1b80 20 client.25246 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.882+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/2527045167 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5557064082f0 0x55570640a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.882+0000 7ff9a06b1b80 4 client.25246 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:05:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.882+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/2527045167 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557063c1db0 con 0x5557064082f0 2023-12-01T01:05:09.887 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.882+0000 7ff991abc700 1 --2- 172.21.15.26:0/2527045167 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5557064082f0 0x55570640a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.883+0000 7ff975ffb700 10 client.25246 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.883+0000 7ff991abc700 1 --2- 172.21.15.26:0/2527045167 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5557064082f0 0x55570640a710 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c64fdb343068c0 server_cookie=63faa15027003fec in_seq=0 out_seq=0 2023-12-01T01:05:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.883+0000 7ff975ffb700 1 -- 172.21.15.26:0/2527045167 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5557063c1db0 con 0x5557064082f0 2023-12-01T01:05:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.883+0000 7ff975ffb700 10 client.25246 handle_command_reply: tid=0 2023-12-01T01:05:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.883+0000 7ff9a06b1b80 1 client.25246 shutdown 2023-12-01T01:05:09.888 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.883+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/2527045167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2680 msgr2=0x5557063fc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.883+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/2527045167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2680 0x5557063fc4d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff9880116f0 tx=0x7ff9880047c0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.883+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/2527045167 shutdown_connections 2023-12-01T01:05:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.883+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/2527045167 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5557064082f0 0x55570640a710 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.883+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/2527045167 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f3ed0 0x555706403a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.883+0000 7ff975ffb700 0 client.25246 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.883+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/2527045167 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2680 0x5557063fc4d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.883+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/2527045167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f2fe0 0x5557063fca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.883+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/2527045167 >> 172.21.15.26:0/2527045167 conn(0x555706352070 msgr2=0x5557063ed3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.883+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/2527045167 shutdown_connections 2023-12-01T01:05:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.884+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/2527045167 wait complete. 2023-12-01T01:05:09.889 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.884+0000 7ff9a06b1b80 20 client.25246 trim_cache size 0 max 16384 2023-12-01T01:05:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.911+0000 7ff9a06b1b80 1 Processor -- start 2023-12-01T01:05:09.915 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.911+0000 7ff9a06b1b80 1 -- start start 2023-12-01T01:05:09.915 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.911+0000 7ff9a06b1b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2680 0x5557063f42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.915 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.911+0000 7ff9a06b1b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2fe0 0x555706403a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.915 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.911+0000 7ff9a06b1b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 0x5557063fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.915 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.911+0000 7ff9a06b1b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557063faf90 con 0x5557063f3ed0 2023-12-01T01:05:09.915 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.911+0000 7ff9a06b1b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557063fab10 con 0x5557063f2fe0 2023-12-01T01:05:09.915 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.911+0000 7ff9a06b1b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557063e57a0 con 0x5557063f2680 2023-12-01T01:05:09.915 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.912+0000 7ff991abc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2fe0 0x555706403a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.915 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.912+0000 7ff991abc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2fe0 0x555706403a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:46358/0 (socket says 172.21.15.26:46358) 2023-12-01T01:05:09.915 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.912+0000 7ff991abc700 1 -- 172.21.15.26:0/645915854 learned_addr learned my addr 172.21.15.26:0/645915854 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:09.915 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.912+0000 7ff9922bd700 1 --2- 172.21.15.26:0/645915854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2680 0x5557063f42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.915 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.912+0000 7ff992abe700 1 --2- 172.21.15.26:0/645915854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 0x5557063fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.915 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.912+0000 7ff991abc700 1 -- 172.21.15.26:0/645915854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2680 msgr2=0x5557063f42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.912+0000 7ff991abc700 1 --2- 172.21.15.26:0/645915854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2680 0x5557063f42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.912+0000 7ff991abc700 1 -- 172.21.15.26:0/645915854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 msgr2=0x5557063fbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.912+0000 7ff991abc700 1 --2- 172.21.15.26:0/645915854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 0x5557063fbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.912+0000 7ff991abc700 1 -- 172.21.15.26:0/645915854 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557061981f0 con 0x5557063f2fe0 2023-12-01T01:05:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.912+0000 7ff9922bd700 1 --2- 172.21.15.26:0/645915854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2680 0x5557063f42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.912+0000 7ff991abc700 1 --2- 172.21.15.26:0/645915854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2fe0 0x555706403a10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff97c097170 tx=0x7ff97c01a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa7213c5a51a839d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.913+0000 7ff9817fa700 1 -- 172.21.15.26:0/645915854 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c0af070 con 0x5557063f2fe0 2023-12-01T01:05:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.913+0000 7ff9817fa700 1 -- 172.21.15.26:0/645915854 <== mon.2 v2:172.21.15.93:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff97c09ae00 con 0x5557063f2fe0 2023-12-01T01:05:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.913+0000 7ff9817fa700 1 -- 172.21.15.26:0/645915854 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff97c098aa0 con 0x5557063f2fe0 2023-12-01T01:05:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.914+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/645915854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2fe0 msgr2=0x555706403a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.914+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/645915854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2fe0 0x555706403a10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff97c097170 tx=0x7ff97c01a040 comp rx=0 tx=0).stop 2023-12-01T01:05:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.914+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/645915854 shutdown_connections 2023-12-01T01:05:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.914+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/645915854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 0x5557063fbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.914+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/645915854 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2680 0x5557063f42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.914+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/645915854 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2fe0 0x555706403a10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.914+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/645915854 >> 172.21.15.26:0/645915854 conn(0x555706352070 msgr2=0x5557063fb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.914+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/645915854 shutdown_connections 2023-12-01T01:05:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.914+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/645915854 wait complete. 2023-12-01T01:05:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.914+0000 7ff9a06b1b80 1 -- start start 2023-12-01T01:05:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.914+0000 7ff9a06b1b80 1 Processor -- start 2023-12-01T01:05:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff9a06b1b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2680 0x555706401240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff9a06b1b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2fe0 0x555706401780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff9a06b1b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 0x555706402790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff9a06b1b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x555706402cd0 con 0x5557063f3ed0 2023-12-01T01:05:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff9a06b1b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x555706402e40 con 0x5557063f2680 2023-12-01T01:05:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff9a06b1b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x555706403000 con 0x5557063f2fe0 2023-12-01T01:05:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff9a06b1b80 10 client.0 _ll_register_callbacks cb 0x7ff988010ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff9922bd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2680 0x555706401240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff9922bd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2680 0x555706401240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:46360/0 (socket says 172.21.15.26:46360) 2023-12-01T01:05:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff9922bd700 1 -- 172.21.15.26:0/369586537 learned_addr learned my addr 172.21.15.26:0/369586537 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff991abc700 1 --2- 172.21.15.26:0/369586537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2fe0 0x555706401780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff992abe700 1 --2- 172.21.15.26:0/369586537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 0x555706402790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff9922bd700 1 -- 172.21.15.26:0/369586537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2fe0 msgr2=0x555706401780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff9922bd700 1 --2- 172.21.15.26:0/369586537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2fe0 0x555706401780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff9922bd700 1 -- 172.21.15.26:0/369586537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 msgr2=0x555706402790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff9922bd700 1 --2- 172.21.15.26:0/369586537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 0x555706402790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.915+0000 7ff9922bd700 1 -- 172.21.15.26:0/369586537 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55570615ac00 con 0x5557063f2680 2023-12-01T01:05:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.916+0000 7ff9922bd700 1 --2- 172.21.15.26:0/369586537 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2680 0x555706401240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff988027c70 tx=0x7ff9880279b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=441183e92391a8c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.916+0000 7ff975ffb700 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-12-01T01:05:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.916+0000 7ff975ffb700 1 -- 172.21.15.26:0/369586537 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988037070 con 0x5557063f2680 2023-12-01T01:05:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.916+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/369586537 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff98400f920 con 0x5557063f2680 2023-12-01T01:05:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.916+0000 7ff975ffb700 1 -- 172.21.15.26:0/369586537 <== mon.2 v2:172.21.15.93:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff988011e40 con 0x5557063f2680 2023-12-01T01:05:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.916+0000 7ff975ffb700 1 -- 172.21.15.26:0/369586537 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9880079b0 con 0x5557063f2680 2023-12-01T01:05:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.916+0000 7ff9a06b1b80 10 client.25220 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.916+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/369586537 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7ff98c10af90 con 0x5557063f2680 2023-12-01T01:05:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.916+0000 7ff975ffb700 1 -- 172.21.15.26:0/369586537 <== mon.2 v2:172.21.15.93:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff988042020 con 0x5557063f2680 2023-12-01T01:05:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.916+0000 7ff975ffb700 1 -- 172.21.15.26:0/369586537 <== mon.2 v2:172.21.15.93:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7ff9880117d0 con 0x5557063f2680 2023-12-01T01:05:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.916+0000 7ff9a06b1b80 10 client.25220 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.916+0000 7ff9a06b1b80 10 client.25220 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.916+0000 7ff9a06b1b80 20 client.25220 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:09.923 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.916+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/369586537 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55570645a8e0 0x55570645cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:09.923 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.916+0000 7ff9a06b1b80 4 client.25220 mds_command: new command op to 24509 tid=0[{"prefix": "flush journal"}] 2023-12-01T01:05:09.923 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.916+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/369586537 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55570633cce0 con 0x55570645a8e0 2023-12-01T01:05:09.923 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.917+0000 7ff991abc700 1 --2- 172.21.15.26:0/369586537 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55570645a8e0 0x55570645cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:09.923 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.917+0000 7ff975ffb700 10 client.25220 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:09.923 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.917+0000 7ff991abc700 1 --2- 172.21.15.26:0/369586537 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55570645a8e0 0x55570645cd00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3404216ca64ce784 server_cookie=6ea6605d9f696d45 in_seq=0 out_seq=0 2023-12-01T01:05:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.921+0000 7ff975ffb700 1 -- 172.21.15.26:0/369586537 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55570633cce0 con 0x55570645a8e0 2023-12-01T01:05:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.921+0000 7ff975ffb700 10 client.25220 handle_command_reply: tid=0 2023-12-01T01:05:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.921+0000 7ff9a06b1b80 1 client.25220 shutdown 2023-12-01T01:05:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.921+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/369586537 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2680 msgr2=0x555706401240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.921+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/369586537 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2680 0x555706401240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff988027c70 tx=0x7ff9880279b0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.922+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/369586537 shutdown_connections 2023-12-01T01:05:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.922+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/369586537 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55570645a8e0 0x55570645cd00 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.922+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/369586537 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5557063f3ed0 0x555706402790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.922+0000 7ff975ffb700 0 client.25220 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.922+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/369586537 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5557063f2680 0x555706401240 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.922+0000 7ff9a06b1b80 1 --2- 172.21.15.26:0/369586537 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5557063f2fe0 0x555706401780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.922+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/369586537 >> 172.21.15.26:0/369586537 conn(0x555706352070 msgr2=0x5557063fb1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.922+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/369586537 shutdown_connections 2023-12-01T01:05:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.922+0000 7ff9a06b1b80 1 -- 172.21.15.26:0/369586537 wait complete. 2023-12-01T01:05:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.922+0000 7ff9a06b1b80 20 client.25220 trim_cache size 0 max 16384 2023-12-01T01:05:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:{ 2023-12-01T01:05:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "message": "", 2023-12-01T01:05:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "return_code": 0 2023-12-01T01:05:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:} 2023-12-01T01:05:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.923+0000 7ff994521700 1 -- 172.21.15.26:0/1968861096 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff9780a0520 msgr2=0x7ff9780a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.923+0000 7ff994521700 1 --2- 172.21.15.26:0/1968861096 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff9780a0520 0x7ff9780a29e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff98c100ce0 tx=0x7ff988007400 comp rx=0 tx=0).stop 2023-12-01T01:05:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.923+0000 7ff994521700 1 -- 172.21.15.26:0/1968861096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff98c100e80 msgr2=0x7ff98c197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.923+0000 7ff994521700 1 --2- 172.21.15.26:0/1968861096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff98c100e80 0x7ff98c197280 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7ff97c000c00 tx=0x7ff97c005720 comp rx=0 tx=0).stop 2023-12-01T01:05:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.923+0000 7ff994521700 1 -- 172.21.15.26:0/1968861096 shutdown_connections 2023-12-01T01:05:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.923+0000 7ff994521700 1 --2- 172.21.15.26:0/1968861096 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff9780a0520 0x7ff9780a29e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.923+0000 7ff994521700 1 --2- 172.21.15.26:0/1968861096 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff98c101820 0x7ff98c197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.923+0000 7ff994521700 1 --2- 172.21.15.26:0/1968861096 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff98c0ffc90 0x7ff98c196d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.923+0000 7ff994521700 1 --2- 172.21.15.26:0/1968861096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff98c100e80 0x7ff98c197280 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.923+0000 7ff994521700 1 -- 172.21.15.26:0/1968861096 >> 172.21.15.26:0/1968861096 conn(0x7ff98c0fb1e0 msgr2=0x7ff98c104340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.923+0000 7ff994521700 1 -- 172.21.15.26:0/1968861096 shutdown_connections 2023-12-01T01:05:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:09.923+0000 7ff994521700 1 -- 172.21.15.26:0/1968861096 wait complete. 2023-12-01T01:05:10.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:09 smithi026 ceph-mon[98801]: pgmap v318: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-01T01:05:10.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:09 smithi116 ceph-mon[103554]: pgmap v318: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-01T01:05:10.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:09 smithi093 ceph-mon[103327]: pgmap v318: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-12-01T01:05:12.047 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:11 smithi026 ceph-mon[98801]: pgmap v319: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:12.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:11 smithi116 ceph-mon[103554]: pgmap v319: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:12.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:11 smithi093 ceph-mon[103327]: pgmap v319: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:13 smithi026 ceph-mon[98801]: pgmap v320: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-01T01:05:14.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:13 smithi116 ceph-mon[103554]: pgmap v320: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-01T01:05:14.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:13 smithi093 ceph-mon[103327]: pgmap v320: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 6 op/s 2023-12-01T01:05:16.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:15 smithi026 ceph-mon[98801]: pgmap v321: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:16.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:15 smithi116 ceph-mon[103554]: pgmap v321: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:16.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:15 smithi093 ceph-mon[103327]: pgmap v321: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:18.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:17 smithi026 ceph-mon[98801]: pgmap v322: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:18.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:17 smithi116 ceph-mon[103554]: pgmap v322: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:18.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:17 smithi093 ceph-mon[103327]: pgmap v322: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:20.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:19 smithi026 ceph-mon[98801]: pgmap v323: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:20.151 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-01T01:05:20.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:19 smithi116 ceph-mon[103554]: pgmap v323: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:20.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:19 smithi093 ceph-mon[103327]: pgmap v323: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:20.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.294+0000 7fc530fe1700 1 -- 172.21.15.26:0/2867413501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52c104160 msgr2=0x7fc52c106550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.294+0000 7fc530fe1700 1 --2- 172.21.15.26:0/2867413501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52c104160 0x7fc52c106550 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc520009990 tx=0x7fc520009ca0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.294+0000 7fc530fe1700 1 -- 172.21.15.26:0/2867413501 shutdown_connections 2023-12-01T01:05:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.294+0000 7fc530fe1700 1 --2- 172.21.15.26:0/2867413501 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc52c106a90 0x7fc52c108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.294+0000 7fc530fe1700 1 --2- 172.21.15.26:0/2867413501 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc52c101830 0x7fc52c103c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.294+0000 7fc530fe1700 1 --2- 172.21.15.26:0/2867413501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52c104160 0x7fc52c106550 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.294+0000 7fc530fe1700 1 -- 172.21.15.26:0/2867413501 >> 172.21.15.26:0/2867413501 conn(0x7fc52c0fb220 msgr2=0x7fc52c0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:20.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.295+0000 7fc530fe1700 1 -- 172.21.15.26:0/2867413501 shutdown_connections 2023-12-01T01:05:20.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.295+0000 7fc530fe1700 1 -- 172.21.15.26:0/2867413501 wait complete. 2023-12-01T01:05:20.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.295+0000 7fc530fe1700 1 Processor -- start 2023-12-01T01:05:20.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.296+0000 7fc530fe1700 1 -- start start 2023-12-01T01:05:20.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.296+0000 7fc530fe1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc52c101830 0x7fc52c196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.296+0000 7fc530fe1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52c104160 0x7fc52c197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.296+0000 7fc530fe1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc52c106a90 0x7fc52c19e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.296+0000 7fc530fe1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c19e670 con 0x7fc52c104160 2023-12-01T01:05:20.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.296+0000 7fc530fe1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c19e7b0 con 0x7fc52c101830 2023-12-01T01:05:20.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.296+0000 7fc530fe1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52c19e940 con 0x7fc52c106a90 2023-12-01T01:05:20.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.296+0000 7fc529d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52c104160 0x7fc52c197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.296+0000 7fc529d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52c104160 0x7fc52c197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55636/0 (socket says 172.21.15.26:55636) 2023-12-01T01:05:20.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.296+0000 7fc529d9b700 1 -- 172.21.15.26:0/4247367657 learned_addr learned my addr 172.21.15.26:0/4247367657 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:20.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.296+0000 7fc52a59c700 1 --2- 172.21.15.26:0/4247367657 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc52c101830 0x7fc52c196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.296+0000 7fc52ad9d700 1 --2- 172.21.15.26:0/4247367657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc52c106a90 0x7fc52c19e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.296+0000 7fc529d9b700 1 -- 172.21.15.26:0/4247367657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc52c106a90 msgr2=0x7fc52c19e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.297+0000 7fc529d9b700 1 --2- 172.21.15.26:0/4247367657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc52c106a90 0x7fc52c19e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.297+0000 7fc529d9b700 1 -- 172.21.15.26:0/4247367657 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc52c101830 msgr2=0x7fc52c196af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.297+0000 7fc529d9b700 1 --2- 172.21.15.26:0/4247367657 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc52c101830 0x7fc52c196af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.297+0000 7fc529d9b700 1 -- 172.21.15.26:0/4247367657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5200095f0 con 0x7fc52c104160 2023-12-01T01:05:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.297+0000 7fc52a59c700 1 --2- 172.21.15.26:0/4247367657 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc52c101830 0x7fc52c196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.297+0000 7fc52ad9d700 1 --2- 172.21.15.26:0/4247367657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc52c106a90 0x7fc52c19e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:05:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.297+0000 7fc529d9b700 1 --2- 172.21.15.26:0/4247367657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52c104160 0x7fc52c197030 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc5200059d0 tx=0x7fc52000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.297+0000 7fc51b7fe700 1 -- 172.21.15.26:0/4247367657 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52001d070 con 0x7fc52c104160 2023-12-01T01:05:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.297+0000 7fc530fe1700 1 -- 172.21.15.26:0/4247367657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52c19ebc0 con 0x7fc52c104160 2023-12-01T01:05:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.297+0000 7fc530fe1700 1 -- 172.21.15.26:0/4247367657 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52c19f040 con 0x7fc52c104160 2023-12-01T01:05:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.297+0000 7fc51b7fe700 1 -- 172.21.15.26:0/4247367657 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc52000fe20 con 0x7fc52c104160 2023-12-01T01:05:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.297+0000 7fc51b7fe700 1 -- 172.21.15.26:0/4247367657 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520017650 con 0x7fc52c104160 2023-12-01T01:05:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.299+0000 7fc51b7fe700 1 -- 172.21.15.26:0/4247367657 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fc5200177b0 con 0x7fc52c104160 2023-12-01T01:05:20.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.300+0000 7fc51b7fe700 1 --2- 172.21.15.26:0/4247367657 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc5140a05a0 0x7fc5140a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.300+0000 7fc52a59c700 1 --2- 172.21.15.26:0/4247367657 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc5140a05a0 0x7fc5140a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.300+0000 7fc51b7fe700 1 -- 172.21.15.26:0/4247367657 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc5200ccd50 con 0x7fc52c104160 2023-12-01T01:05:20.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.301+0000 7fc52a59c700 1 --2- 172.21.15.26:0/4247367657 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc5140a05a0 0x7fc5140a2a60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc51c011490 tx=0x7fc51c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:20.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.302+0000 7fc53d171b80 1 Processor -- start 2023-12-01T01:05:20.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.302+0000 7fc53d171b80 1 -- start start 2023-12-01T01:05:20.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.303+0000 7fc53d171b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a51c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.303+0000 7fc53d171b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51ca70 0x55ca9a51ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.303+0000 7fc53d171b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51b3f0 0x55ca9a51b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.303+0000 7fc53d171b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9a472a10 con 0x55ca9a51c0f0 2023-12-01T01:05:20.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.303+0000 7fc53d171b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9a4703d0 con 0x55ca9a51ca70 2023-12-01T01:05:20.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.303+0000 7fc53d171b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9a46bcc0 con 0x55ca9a51b3f0 2023-12-01T01:05:20.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.303+0000 7fc529d9b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51ca70 0x55ca9a51ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.303+0000 7fc52a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a51c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.303+0000 7fc529d9b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51ca70 0x55ca9a51ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:46382/0 (socket says 172.21.15.26:46382) 2023-12-01T01:05:20.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.303+0000 7fc52a59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a51c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55642/0 (socket says 172.21.15.26:55642) 2023-12-01T01:05:20.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.303+0000 7fc529d9b700 1 -- 172.21.15.26:0/115136106 learned_addr learned my addr 172.21.15.26:0/115136106 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:20.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.303+0000 7fc52ad9d700 1 --2- 172.21.15.26:0/115136106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51b3f0 0x55ca9a51b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.303+0000 7fc52a59c700 1 -- 172.21.15.26:0/115136106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51b3f0 msgr2=0x55ca9a51b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:20.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.303+0000 7fc52a59c700 1 --2- 172.21.15.26:0/115136106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51b3f0 0x55ca9a51b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.303+0000 7fc52a59c700 1 -- 172.21.15.26:0/115136106 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51ca70 msgr2=0x55ca9a51ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:20.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.303+0000 7fc52a59c700 1 --2- 172.21.15.26:0/115136106 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51ca70 0x55ca9a51ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.304+0000 7fc52a59c700 1 -- 172.21.15.26:0/115136106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca9a299de0 con 0x55ca9a51c0f0 2023-12-01T01:05:20.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.304+0000 7fc52a59c700 1 --2- 172.21.15.26:0/115136106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a51c530 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0042f0 tx=0x7fc51c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49f36c94f120b46 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:20.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.304+0000 7fc518ff9700 1 -- 172.21.15.26:0/115136106 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c023070 con 0x55ca9a51c0f0 2023-12-01T01:05:20.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.304+0000 7fc518ff9700 1 -- 172.21.15.26:0/115136106 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc51c01e0d0 con 0x55ca9a51c0f0 2023-12-01T01:05:20.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.304+0000 7fc518ff9700 1 -- 172.21.15.26:0/115136106 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c01cdd0 con 0x55ca9a51c0f0 2023-12-01T01:05:20.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.305+0000 7fc53d171b80 1 -- 172.21.15.26:0/115136106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 msgr2=0x55ca9a51c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:20.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.305+0000 7fc53d171b80 1 --2- 172.21.15.26:0/115136106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a51c530 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0042f0 tx=0x7fc51c014000 comp rx=0 tx=0).stop 2023-12-01T01:05:20.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.305+0000 7fc53d171b80 1 -- 172.21.15.26:0/115136106 shutdown_connections 2023-12-01T01:05:20.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.305+0000 7fc53d171b80 1 --2- 172.21.15.26:0/115136106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51b3f0 0x55ca9a51b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.317 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.305+0000 7fc53d171b80 1 --2- 172.21.15.26:0/115136106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a51c530 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.305+0000 7fc53d171b80 1 --2- 172.21.15.26:0/115136106 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51ca70 0x55ca9a51ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.305+0000 7fc53d171b80 1 -- 172.21.15.26:0/115136106 >> 172.21.15.26:0/115136106 conn(0x55ca9a47a0d0 msgr2=0x55ca9a515940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:20.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.305+0000 7fc53d171b80 1 -- 172.21.15.26:0/115136106 shutdown_connections 2023-12-01T01:05:20.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.305+0000 7fc53d171b80 1 -- 172.21.15.26:0/115136106 wait complete. 2023-12-01T01:05:20.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.306+0000 7fc53d171b80 1 -- start start 2023-12-01T01:05:20.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.306+0000 7fc53d171b80 1 Processor -- start 2023-12-01T01:05:20.318 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.306+0000 7fc53d171b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51b3f0 0x55ca9a535a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.306+0000 7fc53d171b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a535f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.306+0000 7fc53d171b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51ca70 0x55ca9a53cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.306+0000 7fc53d171b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9a408510 con 0x55ca9a51c0f0 2023-12-01T01:05:20.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.306+0000 7fc53d171b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9a4081b0 con 0x55ca9a51ca70 2023-12-01T01:05:20.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.306+0000 7fc53d171b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9a2ef920 con 0x55ca9a51b3f0 2023-12-01T01:05:20.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.306+0000 7fc53d171b80 10 client.0 _ll_register_callbacks cb 0x55ca9a355a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:20.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.306+0000 7fc529d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a535f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.306+0000 7fc529d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a535f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55650/0 (socket says 172.21.15.26:55650) 2023-12-01T01:05:20.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.306+0000 7fc529d9b700 1 -- 172.21.15.26:0/1915420106 learned_addr learned my addr 172.21.15.26:0/1915420106 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:20.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.306+0000 7fc52ad9d700 1 --2- 172.21.15.26:0/1915420106 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51ca70 0x55ca9a53cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.319 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.306+0000 7fc52a59c700 1 --2- 172.21.15.26:0/1915420106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51b3f0 0x55ca9a535a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.307+0000 7fc529d9b700 1 -- 172.21.15.26:0/1915420106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51b3f0 msgr2=0x55ca9a535a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:20.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.307+0000 7fc529d9b700 1 --2- 172.21.15.26:0/1915420106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51b3f0 0x55ca9a535a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.307+0000 7fc529d9b700 1 -- 172.21.15.26:0/1915420106 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51ca70 msgr2=0x55ca9a53cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:20.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.307+0000 7fc529d9b700 1 --2- 172.21.15.26:0/1915420106 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51ca70 0x55ca9a53cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.307+0000 7fc529d9b700 1 -- 172.21.15.26:0/1915420106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51c017070 con 0x55ca9a51c0f0 2023-12-01T01:05:20.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.307+0000 7fc52ad9d700 1 --2- 172.21.15.26:0/1915420106 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51ca70 0x55ca9a53cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:05:20.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.307+0000 7fc529d9b700 1 --2- 172.21.15.26:0/1915420106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a535f40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc52000b2e0 tx=0x7fc520009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0cc2b70b5427645 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:20.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.307+0000 7fc511ffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:20.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.307+0000 7fc511ffb700 1 -- 172.21.15.26:0/1915420106 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520083ea0 con 0x55ca9a51c0f0 2023-12-01T01:05:20.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.307+0000 7fc511ffb700 1 -- 172.21.15.26:0/1915420106 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc52009a650 con 0x55ca9a51c0f0 2023-12-01T01:05:20.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.307+0000 7fc53d171b80 1 -- 172.21.15.26:0/1915420106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca9a496d10 con 0x55ca9a51c0f0 2023-12-01T01:05:20.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.307+0000 7fc511ffb700 1 -- 172.21.15.26:0/1915420106 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc52009e480 con 0x55ca9a51c0f0 2023-12-01T01:05:20.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.307+0000 7fc53d171b80 10 client.15585 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:20.320 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.307+0000 7fc53d171b80 1 -- 172.21.15.26:0/1915420106 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ca9a282c60 con 0x55ca9a51c0f0 2023-12-01T01:05:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.307+0000 7fc511ffb700 1 -- 172.21.15.26:0/1915420106 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55ca9a496d10 con 0x55ca9a51c0f0 2023-12-01T01:05:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.308+0000 7fc511ffb700 1 -- 172.21.15.26:0/1915420106 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fc5200cad20 con 0x55ca9a51c0f0 2023-12-01T01:05:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.308+0000 7fc53d171b80 10 client.15585 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.308+0000 7fc53d171b80 10 client.15585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.308+0000 7fc53d171b80 20 client.15585 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.308+0000 7fc53d171b80 1 --2- 172.21.15.26:0/1915420106 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ca9a541300 0x55ca9a543720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.308+0000 7fc53d171b80 4 client.15585 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:05:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.308+0000 7fc53d171b80 1 -- 172.21.15.26:0/1915420106 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca9a4e9e10 con 0x55ca9a541300 2023-12-01T01:05:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.308+0000 7fc52a59c700 1 --2- 172.21.15.26:0/1915420106 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ca9a541300 0x55ca9a543720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.308+0000 7fc511ffb700 10 client.15585 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.308+0000 7fc52a59c700 1 --2- 172.21.15.26:0/1915420106 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ca9a541300 0x55ca9a543720 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e60281ff4542cec7 server_cookie=cb4ee46423b00eb in_seq=0 out_seq=0 2023-12-01T01:05:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.309+0000 7fc511ffb700 1 -- 172.21.15.26:0/1915420106 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55ca9a4e9e10 con 0x55ca9a541300 2023-12-01T01:05:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.309+0000 7fc511ffb700 10 client.15585 handle_command_reply: tid=0 2023-12-01T01:05:20.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.309+0000 7fc53d171b80 1 client.15585 shutdown 2023-12-01T01:05:20.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.309+0000 7fc53d171b80 1 -- 172.21.15.26:0/1915420106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 msgr2=0x55ca9a535f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:20.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.309+0000 7fc53d171b80 1 --2- 172.21.15.26:0/1915420106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a535f40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc52000b2e0 tx=0x7fc520009ca0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.309+0000 7fc53d171b80 1 -- 172.21.15.26:0/1915420106 shutdown_connections 2023-12-01T01:05:20.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.309+0000 7fc53d171b80 1 --2- 172.21.15.26:0/1915420106 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ca9a541300 0x55ca9a543720 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.309+0000 7fc53d171b80 1 --2- 172.21.15.26:0/1915420106 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51ca70 0x55ca9a53cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.309+0000 7fc53d171b80 1 --2- 172.21.15.26:0/1915420106 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51b3f0 0x55ca9a535a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.309+0000 7fc53d171b80 1 --2- 172.21.15.26:0/1915420106 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a535f40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.309+0000 7fc53d171b80 1 -- 172.21.15.26:0/1915420106 >> 172.21.15.26:0/1915420106 conn(0x55ca9a47a0d0 msgr2=0x55ca9a5150b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:20.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.309+0000 7fc511ffb700 0 client.15585 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:20.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.309+0000 7fc53d171b80 1 -- 172.21.15.26:0/1915420106 shutdown_connections 2023-12-01T01:05:20.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.310+0000 7fc53d171b80 1 -- 172.21.15.26:0/1915420106 wait complete. 2023-12-01T01:05:20.322 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.310+0000 7fc53d171b80 20 client.15585 trim_cache size 0 max 16384 2023-12-01T01:05:20.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.326+0000 7fc53d171b80 1 Processor -- start 2023-12-01T01:05:20.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc53d171b80 1 -- start start 2023-12-01T01:05:20.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc53d171b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51b3f0 0x55ca9a51ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc53d171b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a53ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc53d171b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51ca70 0x55ca9a535a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc53d171b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9a517470 con 0x55ca9a51c0f0 2023-12-01T01:05:20.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc53d171b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9a535570 con 0x55ca9a51b3f0 2023-12-01T01:05:20.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc53d171b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9a516810 con 0x55ca9a51ca70 2023-12-01T01:05:20.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc529d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a53ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc529d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a53ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55658/0 (socket says 172.21.15.26:55658) 2023-12-01T01:05:20.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc529d9b700 1 -- 172.21.15.26:0/2193259739 learned_addr learned my addr 172.21.15.26:0/2193259739 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc52a59c700 1 --2- 172.21.15.26:0/2193259739 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51b3f0 0x55ca9a51ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc52ad9d700 1 --2- 172.21.15.26:0/2193259739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51ca70 0x55ca9a535a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc529d9b700 1 -- 172.21.15.26:0/2193259739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51ca70 msgr2=0x55ca9a535a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc529d9b700 1 --2- 172.21.15.26:0/2193259739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51ca70 0x55ca9a535a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc529d9b700 1 -- 172.21.15.26:0/2193259739 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51b3f0 msgr2=0x55ca9a51ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc529d9b700 1 --2- 172.21.15.26:0/2193259739 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51b3f0 0x55ca9a51ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc529d9b700 1 -- 172.21.15.26:0/2193259739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca9a2c0250 con 0x55ca9a51c0f0 2023-12-01T01:05:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.327+0000 7fc52a59c700 1 --2- 172.21.15.26:0/2193259739 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51b3f0 0x55ca9a51ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:05:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.328+0000 7fc529d9b700 1 --2- 172.21.15.26:0/2193259739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a53ae90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc52000b780 tx=0x7fc520098c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57bff68898a94fc server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.328+0000 7fc5197fa700 1 -- 172.21.15.26:0/2193259739 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520083ea0 con 0x55ca9a51c0f0 2023-12-01T01:05:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.328+0000 7fc5197fa700 1 -- 172.21.15.26:0/2193259739 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc520096990 con 0x55ca9a51c0f0 2023-12-01T01:05:20.330 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.328+0000 7fc5197fa700 1 -- 172.21.15.26:0/2193259739 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200a2400 con 0x55ca9a51c0f0 2023-12-01T01:05:20.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.329+0000 7fc53d171b80 1 -- 172.21.15.26:0/2193259739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 msgr2=0x55ca9a53ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:20.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.329+0000 7fc53d171b80 1 --2- 172.21.15.26:0/2193259739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a53ae90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc52000b780 tx=0x7fc520098c00 comp rx=0 tx=0).stop 2023-12-01T01:05:20.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.329+0000 7fc53d171b80 1 -- 172.21.15.26:0/2193259739 shutdown_connections 2023-12-01T01:05:20.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.329+0000 7fc53d171b80 1 --2- 172.21.15.26:0/2193259739 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51ca70 0x55ca9a535a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.334 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.329+0000 7fc53d171b80 1 --2- 172.21.15.26:0/2193259739 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51b3f0 0x55ca9a51ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.329+0000 7fc53d171b80 1 --2- 172.21.15.26:0/2193259739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51c0f0 0x55ca9a53ae90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.329+0000 7fc53d171b80 1 -- 172.21.15.26:0/2193259739 >> 172.21.15.26:0/2193259739 conn(0x55ca9a47a0d0 msgr2=0x55ca9a522820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:20.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.329+0000 7fc53d171b80 1 -- 172.21.15.26:0/2193259739 shutdown_connections 2023-12-01T01:05:20.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.329+0000 7fc53d171b80 1 -- 172.21.15.26:0/2193259739 wait complete. 2023-12-01T01:05:20.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.329+0000 7fc53d171b80 1 -- start start 2023-12-01T01:05:20.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.329+0000 7fc53d171b80 1 Processor -- start 2023-12-01T01:05:20.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc53d171b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51b3f0 0x55ca9a53a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc53d171b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51c0f0 0x55ca9a53ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc53d171b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51ca70 0x55ca9a538dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc53d171b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9a539460 con 0x55ca9a51ca70 2023-12-01T01:05:20.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc53d171b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9a5395d0 con 0x55ca9a51c0f0 2023-12-01T01:05:20.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc53d171b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca9a539790 con 0x55ca9a51b3f0 2023-12-01T01:05:20.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc53d171b80 10 client.0 _ll_register_callbacks cb 0x55ca9a355a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:20.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc52ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51ca70 0x55ca9a538dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.335 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc529d9b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51c0f0 0x55ca9a53ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc52ad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51ca70 0x55ca9a538dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55666/0 (socket says 172.21.15.26:55666) 2023-12-01T01:05:20.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc52ad9d700 1 -- 172.21.15.26:0/1025796067 learned_addr learned my addr 172.21.15.26:0/1025796067 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:20.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc52a59c700 1 --2- 172.21.15.26:0/1025796067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51b3f0 0x55ca9a53a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc52ad9d700 1 -- 172.21.15.26:0/1025796067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51b3f0 msgr2=0x55ca9a53a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:20.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc52ad9d700 1 --2- 172.21.15.26:0/1025796067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51b3f0 0x55ca9a53a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc52ad9d700 1 -- 172.21.15.26:0/1025796067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51c0f0 msgr2=0x55ca9a53ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:20.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc52ad9d700 1 --2- 172.21.15.26:0/1025796067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51c0f0 0x55ca9a53ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc52ad9d700 1 -- 172.21.15.26:0/1025796067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca9a282c60 con 0x55ca9a51ca70 2023-12-01T01:05:20.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc529d9b700 1 --2- 172.21.15.26:0/1025796067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51c0f0 0x55ca9a53ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:20.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc52ad9d700 1 --2- 172.21.15.26:0/1025796067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51ca70 0x55ca9a538dd0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc524007b90 tx=0x7fc524007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=581bbdcdaa26a886 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:20.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.330+0000 7fc511ffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:20.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.331+0000 7fc511ffb700 1 -- 172.21.15.26:0/1025796067 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc524004db0 con 0x55ca9a51ca70 2023-12-01T01:05:20.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.331+0000 7fc511ffb700 1 -- 172.21.15.26:0/1025796067 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc5240175b0 con 0x55ca9a51ca70 2023-12-01T01:05:20.336 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.331+0000 7fc53d171b80 1 -- 172.21.15.26:0/1025796067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc51c01e0d0 con 0x55ca9a51ca70 2023-12-01T01:05:20.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.331+0000 7fc511ffb700 1 -- 172.21.15.26:0/1025796067 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc524027030 con 0x55ca9a51ca70 2023-12-01T01:05:20.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.331+0000 7fc53d171b80 10 client.15591 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:20.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.331+0000 7fc53d171b80 1 -- 172.21.15.26:0/1025796067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55ca9a2982b0 con 0x55ca9a51ca70 2023-12-01T01:05:20.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.331+0000 7fc511ffb700 1 -- 172.21.15.26:0/1025796067 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc51c01e0d0 con 0x55ca9a51ca70 2023-12-01T01:05:20.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.331+0000 7fc511ffb700 1 -- 172.21.15.26:0/1025796067 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fc524021ac0 con 0x55ca9a51ca70 2023-12-01T01:05:20.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.331+0000 7fc53d171b80 10 client.15591 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:20.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.331+0000 7fc53d171b80 10 client.15591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:20.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.331+0000 7fc53d171b80 20 client.15591 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:20.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.331+0000 7fc53d171b80 1 --2- 172.21.15.26:0/1025796067 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ca9a5942b0 0x55ca9a5966d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.331+0000 7fc53d171b80 4 client.15591 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-01T01:05:20.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.331+0000 7fc53d171b80 1 -- 172.21.15.26:0/1025796067 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ca9a464d40 con 0x55ca9a5942b0 2023-12-01T01:05:20.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.332+0000 7fc52a59c700 1 --2- 172.21.15.26:0/1025796067 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ca9a5942b0 0x55ca9a5966d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.332+0000 7fc511ffb700 10 client.15591 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:20.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.332+0000 7fc52a59c700 1 --2- 172.21.15.26:0/1025796067 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ca9a5942b0 0x55ca9a5966d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d125463087b4828a server_cookie=6374c649813a9c02 in_seq=0 out_seq=0 2023-12-01T01:05:20.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.332+0000 7fc511ffb700 1 -- 172.21.15.26:0/1025796067 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ca9a464d40 con 0x55ca9a5942b0 2023-12-01T01:05:20.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.332+0000 7fc511ffb700 10 client.15591 handle_command_reply: tid=0 2023-12-01T01:05:20.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.332+0000 7fc53d171b80 1 client.15591 shutdown 2023-12-01T01:05:20.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.332+0000 7fc53d171b80 1 -- 172.21.15.26:0/1025796067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51ca70 msgr2=0x55ca9a538dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:20.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.332+0000 7fc53d171b80 1 --2- 172.21.15.26:0/1025796067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51ca70 0x55ca9a538dd0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc524007b90 tx=0x7fc524007bc0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.332+0000 7fc53d171b80 1 -- 172.21.15.26:0/1025796067 shutdown_connections 2023-12-01T01:05:20.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.332+0000 7fc53d171b80 1 --2- 172.21.15.26:0/1025796067 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ca9a5942b0 0x55ca9a5966d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.332+0000 7fc53d171b80 1 --2- 172.21.15.26:0/1025796067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ca9a51ca70 0x55ca9a538dd0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.332+0000 7fc53d171b80 1 --2- 172.21.15.26:0/1025796067 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ca9a51b3f0 0x55ca9a53a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.332+0000 7fc511ffb700 0 client.15591 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:20.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.332+0000 7fc53d171b80 1 --2- 172.21.15.26:0/1025796067 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ca9a51c0f0 0x55ca9a53ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.332+0000 7fc53d171b80 1 -- 172.21.15.26:0/1025796067 >> 172.21.15.26:0/1025796067 conn(0x55ca9a47a0d0 msgr2=0x55ca9a51f330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:20.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.332+0000 7fc53d171b80 1 -- 172.21.15.26:0/1025796067 shutdown_connections 2023-12-01T01:05:20.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.333+0000 7fc53d171b80 1 -- 172.21.15.26:0/1025796067 wait complete. 2023-12-01T01:05:20.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.333+0000 7fc53d171b80 20 client.15591 trim_cache size 0 max 16384 2023-12-01T01:05:20.339 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:05:20.339 INFO:teuthology.orchestra.run.smithi026.stdout: "status": "no active scrubs running", 2023-12-01T01:05:20.339 INFO:teuthology.orchestra.run.smithi026.stdout: "scrubs": {} 2023-12-01T01:05:20.339 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:05:20.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.333+0000 7fc530fe1700 1 -- 172.21.15.26:0/4247367657 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc5140a05a0 msgr2=0x7fc5140a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:20.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.333+0000 7fc530fe1700 1 --2- 172.21.15.26:0/4247367657 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc5140a05a0 0x7fc5140a2a60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc51c011490 tx=0x7fc51c009260 comp rx=0 tx=0).stop 2023-12-01T01:05:20.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.333+0000 7fc530fe1700 1 -- 172.21.15.26:0/4247367657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52c104160 msgr2=0x7fc52c197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:20.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.333+0000 7fc530fe1700 1 --2- 172.21.15.26:0/4247367657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52c104160 0x7fc52c197030 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc5200059d0 tx=0x7fc52000f690 comp rx=0 tx=0).stop 2023-12-01T01:05:20.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.333+0000 7fc530fe1700 1 -- 172.21.15.26:0/4247367657 shutdown_connections 2023-12-01T01:05:20.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.333+0000 7fc530fe1700 1 --2- 172.21.15.26:0/4247367657 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc5140a05a0 0x7fc5140a2a60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.333+0000 7fc530fe1700 1 --2- 172.21.15.26:0/4247367657 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc52c106a90 0x7fc52c19e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.333+0000 7fc530fe1700 1 --2- 172.21.15.26:0/4247367657 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc52c101830 0x7fc52c196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.333+0000 7fc530fe1700 1 --2- 172.21.15.26:0/4247367657 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc52c104160 0x7fc52c197030 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.333+0000 7fc530fe1700 1 -- 172.21.15.26:0/4247367657 >> 172.21.15.26:0/4247367657 conn(0x7fc52c0fb220 msgr2=0x7fc52c1024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:20.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.333+0000 7fc530fe1700 1 -- 172.21.15.26:0/4247367657 shutdown_connections 2023-12-01T01:05:20.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.333+0000 7fc530fe1700 1 -- 172.21.15.26:0/4247367657 wait complete. 2023-12-01T01:05:20.350 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-01T01:05:20.350 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:05:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.499+0000 7f6dd6de3700 1 -- 172.21.15.26:0/216668479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd00ff400 msgr2=0x7f6dd00ff820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.499+0000 7f6dd6de3700 1 --2- 172.21.15.26:0/216668479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd00ff400 0x7f6dd00ff820 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400aad0 tx=0x7f6dc400ade0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.500+0000 7f6dd6de3700 1 -- 172.21.15.26:0/216668479 shutdown_connections 2023-12-01T01:05:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.500+0000 7f6dd6de3700 1 --2- 172.21.15.26:0/216668479 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6dd0100f90 0x7f6dd0107840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.500+0000 7f6dd6de3700 1 --2- 172.21.15.26:0/216668479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd00ff400 0x7f6dd00ff820 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.500+0000 7f6dd6de3700 1 --2- 172.21.15.26:0/216668479 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6dd01005f0 0x7f6dd0100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.500+0000 7f6dd6de3700 1 -- 172.21.15.26:0/216668479 >> 172.21.15.26:0/216668479 conn(0x7f6dd00fa950 msgr2=0x7f6dd00fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.500+0000 7f6dd6de3700 1 -- 172.21.15.26:0/216668479 shutdown_connections 2023-12-01T01:05:20.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.500+0000 7f6dd6de3700 1 -- 172.21.15.26:0/216668479 wait complete. 2023-12-01T01:05:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.500+0000 7f6dd6de3700 1 Processor -- start 2023-12-01T01:05:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dd6de3700 1 -- start start 2023-12-01T01:05:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dd6de3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd00ff400 0x7f6dd01948e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dd6de3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6dd01005f0 0x7f6dd0194e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dd6de3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6dd0100f90 0x7f6dd019be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dd6de3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd019c460 con 0x7f6dd00ff400 2023-12-01T01:05:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dd6de3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd019c5a0 con 0x7f6dd01005f0 2023-12-01T01:05:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dd6de3700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd019c730 con 0x7f6dd0100f90 2023-12-01T01:05:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dd4b7f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd00ff400 0x7f6dd01948e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dd4b7f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd00ff400 0x7f6dd01948e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55676/0 (socket says 172.21.15.26:55676) 2023-12-01T01:05:20.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dd4b7f700 1 -- 172.21.15.26:0/2804244880 learned_addr learned my addr 172.21.15.26:0/2804244880 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dcffff700 1 --2- 172.21.15.26:0/2804244880 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6dd01005f0 0x7f6dd0194e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dd4b7f700 1 -- 172.21.15.26:0/2804244880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6dd0100f90 msgr2=0x7f6dd019be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dd4b7f700 1 --2- 172.21.15.26:0/2804244880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6dd0100f90 0x7f6dd019be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dd4b7f700 1 -- 172.21.15.26:0/2804244880 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6dd01005f0 msgr2=0x7f6dd0194e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dd4b7f700 1 --2- 172.21.15.26:0/2804244880 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6dd01005f0 0x7f6dd0194e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dd4b7f700 1 -- 172.21.15.26:0/2804244880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc400a700 con 0x7f6dd00ff400 2023-12-01T01:05:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.501+0000 7f6dcffff700 1 --2- 172.21.15.26:0/2804244880 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6dd01005f0 0x7f6dd0194e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:05:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.502+0000 7f6dd4b7f700 1 --2- 172.21.15.26:0/2804244880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd00ff400 0x7f6dd01948e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400af50 tx=0x7f6dc400cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.502+0000 7f6dcdffb700 1 -- 172.21.15.26:0/2804244880 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc40052e0 con 0x7f6dd00ff400 2023-12-01T01:05:20.504 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.502+0000 7f6dd6de3700 1 -- 172.21.15.26:0/2804244880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd019c9b0 con 0x7f6dd00ff400 2023-12-01T01:05:20.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.502+0000 7f6dcdffb700 1 -- 172.21.15.26:0/2804244880 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f6dc4005440 con 0x7f6dd00ff400 2023-12-01T01:05:20.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.502+0000 7f6dcdffb700 1 -- 172.21.15.26:0/2804244880 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4019b20 con 0x7f6dd00ff400 2023-12-01T01:05:20.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.502+0000 7f6dd6de3700 1 -- 172.21.15.26:0/2804244880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd019cde0 con 0x7f6dd00ff400 2023-12-01T01:05:20.505 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.503+0000 7f6dd6de3700 1 -- 172.21.15.26:0/2804244880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db4005320 con 0x7f6dd00ff400 2023-12-01T01:05:20.506 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.506+0000 7f6dcdffb700 1 -- 172.21.15.26:0/2804244880 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f6dc4019c80 con 0x7f6dd00ff400 2023-12-01T01:05:20.507 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.506+0000 7f6dcdffb700 1 --2- 172.21.15.26:0/2804244880 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6dc00a0570 0x7f6dc00a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.507+0000 7f6dcdffb700 1 -- 172.21.15.26:0/2804244880 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f6dc4015070 con 0x7f6dd00ff400 2023-12-01T01:05:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.507+0000 7f6dcffff700 1 --2- 172.21.15.26:0/2804244880 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6dc00a0570 0x7f6dc00a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:20.508 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.507+0000 7f6dcffff700 1 --2- 172.21.15.26:0/2804244880 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6dc00a0570 0x7f6dc00a2a30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc005950 tx=0x7f6dbc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:20.514 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.513+0000 7f6dcdffb700 1 -- 172.21.15.26:0/2804244880 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f6dc409b680 con 0x7f6dd00ff400 2023-12-01T01:05:20.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.862+0000 7f6dd6de3700 1 -- 172.21.15.26:0/2804244880 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6db4005cc0 con 0x7f6dd00ff400 2023-12-01T01:05:20.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.863+0000 7f6dcdffb700 1 -- 172.21.15.26:0/2804244880 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10777 (secure 0 0 0) 0x7f6dc409eca0 con 0x7f6dd00ff400 2023-12-01T01:05:20.864 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:05:20.864 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6841/3515135915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6840","nonce":3515135915},{"type":"v1","addr":"172.21.15.26:6841","nonce":3515135915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-01T01:02:47.252972+0000","modified":"2023-12-01T01:02:52.326753+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24493,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.93:6837/3333520218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3333520218},{"type":"v1","addr":"172.21.15.93:6837","nonce":3333520218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6839/3364532241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":3364532241},{"type":"v1","addr":"172.21.15.93:6839","nonce":3364532241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T01:05:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.866+0000 7f6dd6de3700 1 -- 172.21.15.26:0/2804244880 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6dc00a0570 msgr2=0x7f6dc00a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.866+0000 7f6dd6de3700 1 --2- 172.21.15.26:0/2804244880 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6dc00a0570 0x7f6dc00a2a30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc005950 tx=0x7f6dbc0058e0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.866+0000 7f6dd6de3700 1 -- 172.21.15.26:0/2804244880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd00ff400 msgr2=0x7f6dd01948e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.866+0000 7f6dd6de3700 1 --2- 172.21.15.26:0/2804244880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd00ff400 0x7f6dd01948e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400af50 tx=0x7f6dc400cd90 comp rx=0 tx=0).stop 2023-12-01T01:05:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.866+0000 7f6dd6de3700 1 -- 172.21.15.26:0/2804244880 shutdown_connections 2023-12-01T01:05:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.866+0000 7f6dd6de3700 1 --2- 172.21.15.26:0/2804244880 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f6dc00a0570 0x7f6dc00a2a30 secure :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc005950 tx=0x7f6dbc0058e0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.866+0000 7f6dd6de3700 1 --2- 172.21.15.26:0/2804244880 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f6dd0100f90 0x7f6dd019be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.866+0000 7f6dd6de3700 1 --2- 172.21.15.26:0/2804244880 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6dd00ff400 0x7f6dd01948e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.866+0000 7f6dd6de3700 1 --2- 172.21.15.26:0/2804244880 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6dd01005f0 0x7f6dd0194e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.866+0000 7f6dd6de3700 1 -- 172.21.15.26:0/2804244880 >> 172.21.15.26:0/2804244880 conn(0x7f6dd00fa950 msgr2=0x7f6dd00fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.866+0000 7f6dd6de3700 1 -- 172.21.15.26:0/2804244880 shutdown_connections 2023-12-01T01:05:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:20.866+0000 7f6dd6de3700 1 -- 172.21.15.26:0/2804244880 wait complete. 2023-12-01T01:05:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 23 2023-12-01T01:05:20.883 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-01T01:05:21.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.035+0000 7f3cce6c5700 1 -- 172.21.15.26:0/2775513155 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cc8100e70 msgr2=0x7f3cc81012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.035+0000 7f3cce6c5700 1 --2- 172.21.15.26:0/2775513155 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cc8100e70 0x7f3cc81012d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009920 tx=0x7f3cbc009c30 comp rx=0 tx=0).stop 2023-12-01T01:05:21.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.035+0000 7f3cce6c5700 1 -- 172.21.15.26:0/2775513155 shutdown_connections 2023-12-01T01:05:21.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.035+0000 7f3cce6c5700 1 --2- 172.21.15.26:0/2775513155 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc8101810 0x7f3cc81080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.035+0000 7f3cce6c5700 1 --2- 172.21.15.26:0/2775513155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cc80ffc80 0x7f3cc81000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.037 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.035+0000 7f3cce6c5700 1 --2- 172.21.15.26:0/2775513155 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cc8100e70 0x7f3cc81012d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.035+0000 7f3cce6c5700 1 -- 172.21.15.26:0/2775513155 >> 172.21.15.26:0/2775513155 conn(0x7f3cc80fb1f0 msgr2=0x7f3cc80fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.035+0000 7f3cce6c5700 1 -- 172.21.15.26:0/2775513155 shutdown_connections 2023-12-01T01:05:21.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.035+0000 7f3cce6c5700 1 -- 172.21.15.26:0/2775513155 wait complete. 2023-12-01T01:05:21.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.036+0000 7f3cce6c5700 1 Processor -- start 2023-12-01T01:05:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.036+0000 7f3cce6c5700 1 -- start start 2023-12-01T01:05:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.036+0000 7f3cce6c5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cc80ffc80 0x7f3cc8068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.036+0000 7f3cce6c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cc8100e70 0x7f3cc81997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.036+0000 7f3cce6c5700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc8101810 0x7f3cc8199e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.036+0000 7f3cce6c5700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc819a5c0 con 0x7f3cc8100e70 2023-12-01T01:05:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.036+0000 7f3cce6c5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc819a730 con 0x7f3cc80ffc80 2023-12-01T01:05:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.036+0000 7f3cce6c5700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc819a8f0 con 0x7f3cc8101810 2023-12-01T01:05:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.036+0000 7f3cc77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cc8100e70 0x7f3cc81997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.040 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.036+0000 7f3cc77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cc8100e70 0x7f3cc81997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55692/0 (socket says 172.21.15.26:55692) 2023-12-01T01:05:21.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.036+0000 7f3cc77fe700 1 -- 172.21.15.26:0/4292766710 learned_addr learned my addr 172.21.15.26:0/4292766710 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:21.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.036+0000 7f3cc7fff700 1 --2- 172.21.15.26:0/4292766710 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cc80ffc80 0x7f3cc8068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.037+0000 7f3cccc62700 1 --2- 172.21.15.26:0/4292766710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc8101810 0x7f3cc8199e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.037+0000 7f3cc77fe700 1 -- 172.21.15.26:0/4292766710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc8101810 msgr2=0x7f3cc8199e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.037+0000 7f3cc77fe700 1 --2- 172.21.15.26:0/4292766710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc8101810 0x7f3cc8199e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.037+0000 7f3cc77fe700 1 -- 172.21.15.26:0/4292766710 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cc80ffc80 msgr2=0x7f3cc8068ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.037+0000 7f3cc77fe700 1 --2- 172.21.15.26:0/4292766710 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cc80ffc80 0x7f3cc8068ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.037+0000 7f3cc77fe700 1 -- 172.21.15.26:0/4292766710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cbc009520 con 0x7f3cc8100e70 2023-12-01T01:05:21.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.037+0000 7f3cccc62700 1 --2- 172.21.15.26:0/4292766710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc8101810 0x7f3cc8199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:05:21.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.037+0000 7f3cc77fe700 1 --2- 172.21.15.26:0/4292766710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cc8100e70 0x7f3cc81997a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009230 tx=0x7f3cbc005320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.037+0000 7f3cc57fa700 1 -- 172.21.15.26:0/4292766710 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc01c070 con 0x7f3cc8100e70 2023-12-01T01:05:21.041 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.037+0000 7f3cce6c5700 1 -- 172.21.15.26:0/4292766710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc819ab70 con 0x7f3cc8100e70 2023-12-01T01:05:21.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.037+0000 7f3cc57fa700 1 -- 172.21.15.26:0/4292766710 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3cbc00f950 con 0x7f3cc8100e70 2023-12-01T01:05:21.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.037+0000 7f3cc57fa700 1 -- 172.21.15.26:0/4292766710 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc003b00 con 0x7f3cc8100e70 2023-12-01T01:05:21.042 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.037+0000 7f3cce6c5700 1 -- 172.21.15.26:0/4292766710 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc819b020 con 0x7f3cc8100e70 2023-12-01T01:05:21.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.040+0000 7f3cc57fa700 1 -- 172.21.15.26:0/4292766710 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f3cbc020030 con 0x7f3cc8100e70 2023-12-01T01:05:21.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.041+0000 7f3cc57fa700 1 --2- 172.21.15.26:0/4292766710 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3cb00a0520 0x7f3cb00a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.044 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.041+0000 7f3cc57fa700 1 -- 172.21.15.26:0/4292766710 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3cbc0cc9b0 con 0x7f3cc8100e70 2023-12-01T01:05:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.041+0000 7f3cda855b80 1 Processor -- start 2023-12-01T01:05:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.042+0000 7f3cda855b80 1 -- start start 2023-12-01T01:05:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.042+0000 7f3cda855b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d490f0 0x558313d49530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.042+0000 7f3cda855b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d47e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.042+0000 7f3cda855b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d483f0 0x558313d48870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.042+0000 7f3cda855b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313c9fa10 con 0x558313d49a70 2023-12-01T01:05:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.042+0000 7f3cda855b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313c9d3d0 con 0x558313d483f0 2023-12-01T01:05:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.042+0000 7f3cda855b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313c98cc0 con 0x558313d490f0 2023-12-01T01:05:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.042+0000 7f3cc77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d47e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.042+0000 7f3cc7fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d490f0 0x558313d49530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.042+0000 7f3cc77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d47e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55702/0 (socket says 172.21.15.26:55702) 2023-12-01T01:05:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.042+0000 7f3cc77fe700 1 -- 172.21.15.26:0/161019100 learned_addr learned my addr 172.21.15.26:0/161019100 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:21.045 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.042+0000 7f3cccc62700 1 --2- 172.21.15.26:0/161019100 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d483f0 0x558313d48870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.043+0000 7f3cc77fe700 1 -- 172.21.15.26:0/161019100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d490f0 msgr2=0x558313d49530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.043+0000 7f3cc77fe700 1 --2- 172.21.15.26:0/161019100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d490f0 0x558313d49530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.043+0000 7f3cc77fe700 1 -- 172.21.15.26:0/161019100 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d483f0 msgr2=0x558313d48870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.043+0000 7f3cc77fe700 1 --2- 172.21.15.26:0/161019100 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d483f0 0x558313d48870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.043+0000 7f3cc77fe700 1 -- 172.21.15.26:0/161019100 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558313ac6de0 con 0x558313d49a70 2023-12-01T01:05:21.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.043+0000 7f3cccc62700 1 --2- 172.21.15.26:0/161019100 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d483f0 0x558313d48870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:21.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.043+0000 7f3cc7fff700 1 --2- 172.21.15.26:0/161019100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d490f0 0x558313d49530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:21.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.043+0000 7f3cc7fff700 1 --2- 172.21.15.26:0/4292766710 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3cb00a0520 0x7f3cb00a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.043+0000 7f3cc77fe700 1 --2- 172.21.15.26:0/161019100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d47e60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0967b0 tx=0x7f3cbc00bc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9e86bdf0c7a0f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.043+0000 7f3cae7fc700 1 -- 172.21.15.26:0/161019100 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc09a9b0 con 0x558313d49a70 2023-12-01T01:05:21.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.043+0000 7f3cc7fff700 1 --2- 172.21.15.26:0/4292766710 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3cb00a0520 0x7f3cb00a29e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x558313d48e90 tx=0x7f3cb80047c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.043+0000 7f3cae7fc700 1 -- 172.21.15.26:0/161019100 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3cbc09a2b0 con 0x558313d49a70 2023-12-01T01:05:21.046 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.043+0000 7f3cae7fc700 1 -- 172.21.15.26:0/161019100 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc0a01e0 con 0x558313d49a70 2023-12-01T01:05:21.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.044+0000 7f3cda855b80 1 -- 172.21.15.26:0/161019100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 msgr2=0x558313d47e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.044+0000 7f3cda855b80 1 --2- 172.21.15.26:0/161019100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d47e60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc0967b0 tx=0x7f3cbc00bc90 comp rx=0 tx=0).stop 2023-12-01T01:05:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.044+0000 7f3cda855b80 1 -- 172.21.15.26:0/161019100 shutdown_connections 2023-12-01T01:05:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.044+0000 7f3cda855b80 1 --2- 172.21.15.26:0/161019100 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d483f0 0x558313d48870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.044+0000 7f3cda855b80 1 --2- 172.21.15.26:0/161019100 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d490f0 0x558313d49530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.044+0000 7f3cda855b80 1 --2- 172.21.15.26:0/161019100 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d47e60 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.044+0000 7f3cda855b80 1 -- 172.21.15.26:0/161019100 >> 172.21.15.26:0/161019100 conn(0x558313ca70d0 msgr2=0x558313d42940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.044+0000 7f3cda855b80 1 -- 172.21.15.26:0/161019100 shutdown_connections 2023-12-01T01:05:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.044+0000 7f3cda855b80 1 -- 172.21.15.26:0/161019100 wait complete. 2023-12-01T01:05:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.045+0000 7f3cda855b80 1 -- start start 2023-12-01T01:05:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.045+0000 7f3cda855b80 1 Processor -- start 2023-12-01T01:05:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.045+0000 7f3cda855b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d483f0 0x558313d51670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.045+0000 7f3cda855b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d490f0 0x558313d51bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.045+0000 7f3cda855b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d58bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.045+0000 7f3cda855b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313c35510 con 0x558313d49a70 2023-12-01T01:05:21.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.045+0000 7f3cda855b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313c351b0 con 0x558313d490f0 2023-12-01T01:05:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.045+0000 7f3cda855b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313b1c920 con 0x558313d483f0 2023-12-01T01:05:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.045+0000 7f3cda855b80 10 client.0 _ll_register_callbacks cb 0x558313b82a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.045+0000 7f3cc7fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d483f0 0x558313d51670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.045+0000 7f3cc7fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d483f0 0x558313d51670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.26:47934/0 (socket says 172.21.15.26:47934) 2023-12-01T01:05:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.045+0000 7f3cc7fff700 1 -- 172.21.15.26:0/337214342 learned_addr learned my addr 172.21.15.26:0/337214342 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.045+0000 7f3cccc62700 1 --2- 172.21.15.26:0/337214342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d58bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.046+0000 7f3cc77fe700 1 --2- 172.21.15.26:0/337214342 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d490f0 0x558313d51bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.046+0000 7f3cccc62700 1 -- 172.21.15.26:0/337214342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d483f0 msgr2=0x558313d51670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.046+0000 7f3cccc62700 1 --2- 172.21.15.26:0/337214342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d483f0 0x558313d51670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.046+0000 7f3cccc62700 1 -- 172.21.15.26:0/337214342 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d490f0 msgr2=0x558313d51bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.046+0000 7f3cccc62700 1 --2- 172.21.15.26:0/337214342 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d490f0 0x558313d51bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.046+0000 7f3cccc62700 1 -- 172.21.15.26:0/337214342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc0009050 con 0x558313d49a70 2023-12-01T01:05:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.046+0000 7f3cccc62700 1 --2- 172.21.15.26:0/337214342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d58bf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0007f70 tx=0x7f3cc0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836f2ffe63b52bc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.047+0000 7f3ca77fe700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:21.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.047+0000 7f3ca77fe700 1 -- 172.21.15.26:0/337214342 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc000e050 con 0x558313d49a70 2023-12-01T01:05:21.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.047+0000 7f3ca77fe700 1 -- 172.21.15.26:0/337214342 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3cc0004db0 con 0x558313d49a70 2023-12-01T01:05:21.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.047+0000 7f3cda855b80 1 -- 172.21.15.26:0/337214342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558313cc3d10 con 0x558313d49a70 2023-12-01T01:05:21.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.047+0000 7f3ca77fe700 1 -- 172.21.15.26:0/337214342 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cc00093b0 con 0x558313d49a70 2023-12-01T01:05:21.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.047+0000 7f3cda855b80 10 client.15609 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.047+0000 7f3cda855b80 1 -- 172.21.15.26:0/337214342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f3cb8009a20 con 0x558313d49a70 2023-12-01T01:05:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.047+0000 7f3ca77fe700 1 -- 172.21.15.26:0/337214342 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x558313cc3d10 con 0x558313d49a70 2023-12-01T01:05:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.047+0000 7f3ca77fe700 1 -- 172.21.15.26:0/337214342 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f3cc00041e0 con 0x558313d49a70 2023-12-01T01:05:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.047+0000 7f3cda855b80 10 client.15609 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.047+0000 7f3cda855b80 10 client.15609 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-12-01T01:05:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.047+0000 7f3cda855b80 20 client.15609 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.047+0000 7f3cda855b80 1 --2- 172.21.15.26:0/337214342 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x558313d5d550 0x558313d5f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.047+0000 7f3cda855b80 4 client.15609 mds_command: new command op to 24481 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:05:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.047+0000 7f3cda855b80 1 -- 172.21.15.26:0/337214342 --> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558313d16e10 con 0x558313d5d550 2023-12-01T01:05:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.048+0000 7f3cc7fff700 1 --2- 172.21.15.26:0/337214342 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x558313d5d550 0x558313d5f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.048+0000 7f3ca77fe700 10 client.15609 ms_handle_connect on v2:172.21.15.116:6838/261568108 2023-12-01T01:05:21.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.048+0000 7f3cc7fff700 1 --2- 172.21.15.26:0/337214342 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x558313d5d550 0x558313d5f970 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=52172a7a957051b6 server_cookie=94afb113e268cfd7 in_seq=0 out_seq=0 2023-12-01T01:05:21.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.049+0000 7f3ca77fe700 1 -- 172.21.15.26:0/337214342 <== mds.2 v2:172.21.15.116:6838/261568108 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x558313d16e10 con 0x558313d5d550 2023-12-01T01:05:21.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.049+0000 7f3ca77fe700 10 client.15609 handle_command_reply: tid=0 2023-12-01T01:05:21.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.049+0000 7f3cda855b80 1 client.15609 shutdown 2023-12-01T01:05:21.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.049+0000 7f3cda855b80 1 -- 172.21.15.26:0/337214342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 msgr2=0x558313d58bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.049+0000 7f3cda855b80 1 --2- 172.21.15.26:0/337214342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d58bf0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0007f70 tx=0x7f3cc0009220 comp rx=0 tx=0).stop 2023-12-01T01:05:21.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.049+0000 7f3cda855b80 1 -- 172.21.15.26:0/337214342 shutdown_connections 2023-12-01T01:05:21.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.049+0000 7f3cda855b80 1 --2- 172.21.15.26:0/337214342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d58bf0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.049+0000 7f3cda855b80 1 --2- 172.21.15.26:0/337214342 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d483f0 0x558313d51670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.049+0000 7f3cda855b80 1 --2- 172.21.15.26:0/337214342 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x558313d5d550 0x558313d5f970 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.049+0000 7f3cda855b80 1 --2- 172.21.15.26:0/337214342 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d490f0 0x558313d51bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.049+0000 7f3ca77fe700 0 client.15609 ms_handle_reset on v2:172.21.15.116:6838/261568108 2023-12-01T01:05:21.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.049+0000 7f3cda855b80 1 -- 172.21.15.26:0/337214342 >> 172.21.15.26:0/337214342 conn(0x558313ca70d0 msgr2=0x558313d420b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.049+0000 7f3cda855b80 1 -- 172.21.15.26:0/337214342 shutdown_connections 2023-12-01T01:05:21.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.049+0000 7f3cda855b80 1 -- 172.21.15.26:0/337214342 wait complete. 2023-12-01T01:05:21.060 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.050+0000 7f3cda855b80 20 client.15609 trim_cache size 0 max 16384 2023-12-01T01:05:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.074+0000 7f3cda855b80 1 Processor -- start 2023-12-01T01:05:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.074+0000 7f3cda855b80 1 -- start start 2023-12-01T01:05:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.074+0000 7f3cda855b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d483f0 0x558313d47e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.074+0000 7f3cda855b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d490f0 0x558313d56b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.074+0000 7f3cda855b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d41820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.074+0000 7f3cda855b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313d50b50 con 0x558313d49a70 2023-12-01T01:05:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.074+0000 7f3cda855b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313d51210 con 0x558313d483f0 2023-12-01T01:05:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.074+0000 7f3cda855b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313d43290 con 0x558313d490f0 2023-12-01T01:05:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.074+0000 7f3cccc62700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d41820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.074+0000 7f3cccc62700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d41820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55716/0 (socket says 172.21.15.26:55716) 2023-12-01T01:05:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.074+0000 7f3cc7fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d483f0 0x558313d47e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.074+0000 7f3cccc62700 1 -- 172.21.15.26:0/2872405319 learned_addr learned my addr 172.21.15.26:0/2872405319 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:21.076 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.075+0000 7f3cc77fe700 1 --2- 172.21.15.26:0/2872405319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d490f0 0x558313d56b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.075+0000 7f3cccc62700 1 -- 172.21.15.26:0/2872405319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d490f0 msgr2=0x558313d56b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.075+0000 7f3cccc62700 1 --2- 172.21.15.26:0/2872405319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d490f0 0x558313d56b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.075+0000 7f3cccc62700 1 -- 172.21.15.26:0/2872405319 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d483f0 msgr2=0x558313d47e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.075+0000 7f3cccc62700 1 --2- 172.21.15.26:0/2872405319 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d483f0 0x558313d47e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.075+0000 7f3cccc62700 1 -- 172.21.15.26:0/2872405319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc819b020 con 0x558313d49a70 2023-12-01T01:05:21.077 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.075+0000 7f3cccc62700 1 --2- 172.21.15.26:0/2872405319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d41820 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0004610 tx=0x7f3cc0009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c93126a84f137d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.075+0000 7f3caeffd700 1 -- 172.21.15.26:0/2872405319 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc000e070 con 0x558313d49a70 2023-12-01T01:05:21.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.075+0000 7f3caeffd700 1 -- 172.21.15.26:0/2872405319 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3cc000f040 con 0x558313d49a70 2023-12-01T01:05:21.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.075+0000 7f3caeffd700 1 -- 172.21.15.26:0/2872405319 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0003c60 con 0x558313d49a70 2023-12-01T01:05:21.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.076+0000 7f3cda855b80 1 -- 172.21.15.26:0/2872405319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 msgr2=0x558313d41820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.076+0000 7f3cda855b80 1 --2- 172.21.15.26:0/2872405319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d41820 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0004610 tx=0x7f3cc0009a50 comp rx=0 tx=0).stop 2023-12-01T01:05:21.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.076+0000 7f3cda855b80 1 -- 172.21.15.26:0/2872405319 shutdown_connections 2023-12-01T01:05:21.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.076+0000 7f3cda855b80 1 --2- 172.21.15.26:0/2872405319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d49a70 0x558313d41820 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.076+0000 7f3cda855b80 1 --2- 172.21.15.26:0/2872405319 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d483f0 0x558313d47e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.076+0000 7f3cda855b80 1 --2- 172.21.15.26:0/2872405319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d490f0 0x558313d56b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.076+0000 7f3cda855b80 1 -- 172.21.15.26:0/2872405319 >> 172.21.15.26:0/2872405319 conn(0x558313ca70d0 msgr2=0x558313d51670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.076+0000 7f3cda855b80 1 -- 172.21.15.26:0/2872405319 shutdown_connections 2023-12-01T01:05:21.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.076+0000 7f3cda855b80 1 -- 172.21.15.26:0/2872405319 wait complete. 2023-12-01T01:05:21.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.076+0000 7f3cda855b80 1 -- start start 2023-12-01T01:05:21.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.077+0000 7f3cda855b80 1 Processor -- start 2023-12-01T01:05:21.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.077+0000 7f3cda855b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d483f0 0x558313d569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.077+0000 7f3cda855b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d490f0 0x558313d54fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.077+0000 7f3cda855b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d49a70 0x558313d55500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.077+0000 7f3cda855b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313d55be0 con 0x558313d490f0 2023-12-01T01:05:21.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.077+0000 7f3cda855b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313d55d50 con 0x558313d49a70 2023-12-01T01:05:21.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.077+0000 7f3cda855b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x558313daf060 con 0x558313d483f0 2023-12-01T01:05:21.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.077+0000 7f3cda855b80 10 client.0 _ll_register_callbacks cb 0x7f3cc00078a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:21.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.077+0000 7f3cc7fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d483f0 0x558313d569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.077+0000 7f3cc77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d490f0 0x558313d54fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.077+0000 7f3cc7fff700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d483f0 0x558313d569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.26:47948/0 (socket says 172.21.15.26:47948) 2023-12-01T01:05:21.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.077+0000 7f3cc7fff700 1 -- 172.21.15.26:0/3109635871 learned_addr learned my addr 172.21.15.26:0/3109635871 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:21.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.077+0000 7f3cccc62700 1 --2- 172.21.15.26:0/3109635871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d49a70 0x558313d55500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.078+0000 7f3cc7fff700 1 -- 172.21.15.26:0/3109635871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d49a70 msgr2=0x558313d55500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.078+0000 7f3cc7fff700 1 --2- 172.21.15.26:0/3109635871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d49a70 0x558313d55500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.078+0000 7f3cc7fff700 1 -- 172.21.15.26:0/3109635871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d490f0 msgr2=0x558313d54fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.078+0000 7f3cc7fff700 1 --2- 172.21.15.26:0/3109635871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d490f0 0x558313d54fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.078+0000 7f3cc7fff700 1 -- 172.21.15.26:0/3109635871 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb8009a20 con 0x558313d483f0 2023-12-01T01:05:21.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.078+0000 7f3cc7fff700 1 --2- 172.21.15.26:0/3109635871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d483f0 0x558313d569b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8005950 tx=0x7f3cb8009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bce00e8f404e31e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.078+0000 7f3ca77fe700 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2023-12-01T01:05:21.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.078+0000 7f3ca77fe700 1 -- 172.21.15.26:0/3109635871 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb802c970 con 0x558313d483f0 2023-12-01T01:05:21.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.078+0000 7f3ca77fe700 1 -- 172.21.15.26:0/3109635871 <== mon.1 v2:172.21.15.116:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3cb8010e40 con 0x558313d483f0 2023-12-01T01:05:21.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.078+0000 7f3cda855b80 1 -- 172.21.15.26:0/3109635871 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3cbc09a2b0 con 0x558313d483f0 2023-12-01T01:05:21.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.079+0000 7f3ca77fe700 1 -- 172.21.15.26:0/3109635871 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cb802cad0 con 0x558313d483f0 2023-12-01T01:05:21.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.079+0000 7f3cda855b80 10 client.25291 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:21.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.079+0000 7f3cda855b80 1 -- 172.21.15.26:0/3109635871 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x558313aafc60 con 0x558313d483f0 2023-12-01T01:05:21.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.079+0000 7f3ca77fe700 1 -- 172.21.15.26:0/3109635871 <== mon.1 v2:172.21.15.116:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3cbc09a2b0 con 0x558313d483f0 2023-12-01T01:05:21.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.079+0000 7f3ca77fe700 1 -- 172.21.15.26:0/3109635871 <== mon.1 v2:172.21.15.116:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f3cb801ba40 con 0x558313d483f0 2023-12-01T01:05:21.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.079+0000 7f3cda855b80 10 client.25291 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:21.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.079+0000 7f3cda855b80 10 client.25291 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-12-01T01:05:21.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.079+0000 7f3cda855b80 20 client.25291 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:21.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.079+0000 7f3cda855b80 1 --2- 172.21.15.26:0/3109635871 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x558313db0920 0x558313db2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.079+0000 7f3cda855b80 4 client.25291 mds_command: new command op to 24481 tid=0[{"prefix": "damage ls"}] 2023-12-01T01:05:21.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.079+0000 7f3cda855b80 1 -- 172.21.15.26:0/3109635871 --> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558313c91d40 con 0x558313db0920 2023-12-01T01:05:21.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.079+0000 7f3cc77fe700 1 --2- 172.21.15.26:0/3109635871 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x558313db0920 0x558313db2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.080+0000 7f3cc77fe700 1 --2- 172.21.15.26:0/3109635871 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x558313db0920 0x558313db2d40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=399e8d684a32181c server_cookie=ac0e87b02ba5068d in_seq=0 out_seq=0 2023-12-01T01:05:21.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.080+0000 7f3ca77fe700 10 client.25291 ms_handle_connect on v2:172.21.15.116:6838/261568108 2023-12-01T01:05:21.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.080+0000 7f3ca77fe700 1 -- 172.21.15.26:0/3109635871 <== mds.2 v2:172.21.15.116:6838/261568108 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558313c91d40 con 0x558313db0920 2023-12-01T01:05:21.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.080+0000 7f3ca77fe700 10 client.25291 handle_command_reply: tid=0 2023-12-01T01:05:21.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.080+0000 7f3cda855b80 1 client.25291 shutdown 2023-12-01T01:05:21.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.080+0000 7f3cda855b80 1 -- 172.21.15.26:0/3109635871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d483f0 msgr2=0x558313d569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.080+0000 7f3cda855b80 1 --2- 172.21.15.26:0/3109635871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d483f0 0x558313d569b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8005950 tx=0x7f3cb8009310 comp rx=0 tx=0).stop 2023-12-01T01:05:21.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.080+0000 7f3cda855b80 1 -- 172.21.15.26:0/3109635871 shutdown_connections 2023-12-01T01:05:21.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.080+0000 7f3cda855b80 1 --2- 172.21.15.26:0/3109635871 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x558313db0920 0x558313db2d40 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.080+0000 7f3cda855b80 1 --2- 172.21.15.26:0/3109635871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558313d49a70 0x558313d55500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.080+0000 7f3cda855b80 1 --2- 172.21.15.26:0/3109635871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558313d483f0 0x558313d569b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.080+0000 7f3cda855b80 1 --2- 172.21.15.26:0/3109635871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558313d490f0 0x558313d54fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.080+0000 7f3ca77fe700 0 client.25291 ms_handle_reset on v2:172.21.15.116:6838/261568108 2023-12-01T01:05:21.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.080+0000 7f3cda855b80 1 -- 172.21.15.26:0/3109635871 >> 172.21.15.26:0/3109635871 conn(0x558313ca70d0 msgr2=0x558313d46e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.080+0000 7f3cda855b80 1 -- 172.21.15.26:0/3109635871 shutdown_connections 2023-12-01T01:05:21.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.080+0000 7f3cda855b80 1 -- 172.21.15.26:0/3109635871 wait complete. 2023-12-01T01:05:21.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.081+0000 7f3cda855b80 20 client.25291 trim_cache size 0 max 16384 2023-12-01T01:05:21.086 INFO:teuthology.orchestra.run.smithi026.stdout:[] 2023-12-01T01:05:21.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.081+0000 7f3cce6c5700 1 -- 172.21.15.26:0/4292766710 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3cb00a0520 msgr2=0x7f3cb00a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.081+0000 7f3cce6c5700 1 --2- 172.21.15.26:0/4292766710 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3cb00a0520 0x7f3cb00a29e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x558313d48e90 tx=0x7f3cb80047c0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.081+0000 7f3cce6c5700 1 -- 172.21.15.26:0/4292766710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cc8100e70 msgr2=0x7f3cc81997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.081+0000 7f3cce6c5700 1 --2- 172.21.15.26:0/4292766710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cc8100e70 0x7f3cc81997a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc009230 tx=0x7f3cbc005320 comp rx=0 tx=0).stop 2023-12-01T01:05:21.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.081+0000 7f3cce6c5700 1 -- 172.21.15.26:0/4292766710 shutdown_connections 2023-12-01T01:05:21.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.081+0000 7f3cce6c5700 1 --2- 172.21.15.26:0/4292766710 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3cb00a0520 0x7f3cb00a29e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.081+0000 7f3cce6c5700 1 --2- 172.21.15.26:0/4292766710 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3cc8101810 0x7f3cc8199e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.081+0000 7f3cce6c5700 1 --2- 172.21.15.26:0/4292766710 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3cc80ffc80 0x7f3cc8068ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.081+0000 7f3cce6c5700 1 --2- 172.21.15.26:0/4292766710 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3cc8100e70 0x7f3cc81997a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.081+0000 7f3cce6c5700 1 -- 172.21.15.26:0/4292766710 >> 172.21.15.26:0/4292766710 conn(0x7f3cc80fb1f0 msgr2=0x7f3cc80fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.081+0000 7f3cce6c5700 1 -- 172.21.15.26:0/4292766710 shutdown_connections 2023-12-01T01:05:21.087 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.081+0000 7f3cce6c5700 1 -- 172.21.15.26:0/4292766710 wait complete. 2023-12-01T01:05:21.099 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-01T01:05:21.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.235+0000 7fe554bc9700 1 -- 172.21.15.26:0/3047902206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe550100ce0 msgr2=0x7fe550101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.235+0000 7fe554bc9700 1 --2- 172.21.15.26:0/3047902206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe550100ce0 0x7fe550101140 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe544009990 tx=0x7fe544009ca0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.236 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.235+0000 7fe554bc9700 1 -- 172.21.15.26:0/3047902206 shutdown_connections 2023-12-01T01:05:21.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.235+0000 7fe554bc9700 1 --2- 172.21.15.26:0/3047902206 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe550101680 0x7fe550107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.235+0000 7fe554bc9700 1 --2- 172.21.15.26:0/3047902206 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe5500ffaf0 0x7fe5500fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.235+0000 7fe554bc9700 1 --2- 172.21.15.26:0/3047902206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe550100ce0 0x7fe550101140 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.235+0000 7fe554bc9700 1 -- 172.21.15.26:0/3047902206 >> 172.21.15.26:0/3047902206 conn(0x7fe5500fb040 msgr2=0x7fe5500fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.235+0000 7fe554bc9700 1 -- 172.21.15.26:0/3047902206 shutdown_connections 2023-12-01T01:05:21.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.235+0000 7fe554bc9700 1 -- 172.21.15.26:0/3047902206 wait complete. 2023-12-01T01:05:21.237 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.236+0000 7fe554bc9700 1 Processor -- start 2023-12-01T01:05:21.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.236+0000 7fe554bc9700 1 -- start start 2023-12-01T01:05:21.238 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.236+0000 7fe554bc9700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5500ffaf0 0x7fe550196890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.236+0000 7fe554bc9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe550100ce0 0x7fe550196dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.236+0000 7fe554bc9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe550101680 0x7fe55019de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.236+0000 7fe554bc9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55019e410 con 0x7fe550100ce0 2023-12-01T01:05:21.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.236+0000 7fe554bc9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55019e550 con 0x7fe550101680 2023-12-01T01:05:21.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.236+0000 7fe554bc9700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5501086f0 con 0x7fe5500ffaf0 2023-12-01T01:05:21.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.236+0000 7fe54effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe550100ce0 0x7fe550196dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.236+0000 7fe54effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe550100ce0 0x7fe550196dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55734/0 (socket says 172.21.15.26:55734) 2023-12-01T01:05:21.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.236+0000 7fe54effd700 1 -- 172.21.15.26:0/1277268708 learned_addr learned my addr 172.21.15.26:0/1277268708 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:21.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.236+0000 7fe54ffff700 1 --2- 172.21.15.26:0/1277268708 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe550101680 0x7fe55019de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.236+0000 7fe54f7fe700 1 --2- 172.21.15.26:0/1277268708 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5500ffaf0 0x7fe550196890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.237+0000 7fe54effd700 1 -- 172.21.15.26:0/1277268708 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5500ffaf0 msgr2=0x7fe550196890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.237+0000 7fe54effd700 1 --2- 172.21.15.26:0/1277268708 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5500ffaf0 0x7fe550196890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.237+0000 7fe54effd700 1 -- 172.21.15.26:0/1277268708 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe550101680 msgr2=0x7fe55019de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.237+0000 7fe54effd700 1 --2- 172.21.15.26:0/1277268708 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe550101680 0x7fe55019de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.239 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.237+0000 7fe54effd700 1 -- 172.21.15.26:0/1277268708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5440095f0 con 0x7fe550100ce0 2023-12-01T01:05:21.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.237+0000 7fe54effd700 1 --2- 172.21.15.26:0/1277268708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe550100ce0 0x7fe550196dd0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe5440036f0 tx=0x7fe54400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.237+0000 7fe54cff9700 1 -- 172.21.15.26:0/1277268708 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54401d070 con 0x7fe550100ce0 2023-12-01T01:05:21.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.237+0000 7fe554bc9700 1 -- 172.21.15.26:0/1277268708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe550108970 con 0x7fe550100ce0 2023-12-01T01:05:21.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.237+0000 7fe54cff9700 1 -- 172.21.15.26:0/1277268708 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe544005030 con 0x7fe550100ce0 2023-12-01T01:05:21.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.237+0000 7fe54cff9700 1 -- 172.21.15.26:0/1277268708 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544004ba0 con 0x7fe550100ce0 2023-12-01T01:05:21.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.237+0000 7fe554bc9700 1 -- 172.21.15.26:0/1277268708 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe550108e40 con 0x7fe550100ce0 2023-12-01T01:05:21.240 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.240+0000 7fe54cff9700 1 -- 172.21.15.26:0/1277268708 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fe544004d00 con 0x7fe550100ce0 2023-12-01T01:05:21.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.241+0000 7fe54cff9700 1 --2- 172.21.15.26:0/1277268708 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe5380a05c0 0x7fe5380a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.241 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.241+0000 7fe54f7fe700 1 --2- 172.21.15.26:0/1277268708 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe5380a05c0 0x7fe5380a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.241+0000 7fe54cff9700 1 -- 172.21.15.26:0/1277268708 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe5440cc900 con 0x7fe550100ce0 2023-12-01T01:05:21.242 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.241+0000 7fe54f7fe700 1 --2- 172.21.15.26:0/1277268708 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe5380a05c0 0x7fe5380a2a80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe550100b40 tx=0x7fe54000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.242+0000 7fe561fbbb80 1 Processor -- start 2023-12-01T01:05:21.244 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.242+0000 7fe561fbbb80 1 -- start start 2023-12-01T01:05:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe561fbbb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0bf1d0 0x55745e0bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe561fbbb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bffd0 0x55745e0c0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe561fbbb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0c0990 0x55745e0c7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe561fbbb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745e016a10 con 0x55745e0bf1d0 2023-12-01T01:05:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe561fbbb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745e0143d0 con 0x55745e0c0990 2023-12-01T01:05:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe561fbbb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745e00fcc0 con 0x55745e0bffd0 2023-12-01T01:05:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe54f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0bf1d0 0x55745e0bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe54f7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0bf1d0 0x55745e0bf5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55740/0 (socket says 172.21.15.26:55740) 2023-12-01T01:05:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe54f7fe700 1 -- 172.21.15.26:0/2601669828 learned_addr learned my addr 172.21.15.26:0/2601669828 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe54effd700 1 --2- 172.21.15.26:0/2601669828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bffd0 0x55745e0c0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe54ffff700 1 --2- 172.21.15.26:0/2601669828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0c0990 0x55745e0c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe54f7fe700 1 -- 172.21.15.26:0/2601669828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bffd0 msgr2=0x55745e0c0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe54f7fe700 1 --2- 172.21.15.26:0/2601669828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bffd0 0x55745e0c0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe54f7fe700 1 -- 172.21.15.26:0/2601669828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0c0990 msgr2=0x55745e0c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe54f7fe700 1 --2- 172.21.15.26:0/2601669828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0c0990 0x55745e0c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.245 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe54f7fe700 1 -- 172.21.15.26:0/2601669828 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55745de3dde0 con 0x55745e0bf1d0 2023-12-01T01:05:21.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.243+0000 7fe54f7fe700 1 --2- 172.21.15.26:0/2601669828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0bf1d0 0x55745e0bf5f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe540010f70 tx=0x7fe540013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89428f583c99cfc6 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.244+0000 7fe535ffb700 1 -- 172.21.15.26:0/2601669828 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540011db0 con 0x55745e0bf1d0 2023-12-01T01:05:21.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.244+0000 7fe535ffb700 1 -- 172.21.15.26:0/2601669828 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe540015070 con 0x55745e0bf1d0 2023-12-01T01:05:21.246 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.244+0000 7fe535ffb700 1 -- 172.21.15.26:0/2601669828 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54001c610 con 0x55745e0bf1d0 2023-12-01T01:05:21.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.244+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2601669828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0bf1d0 msgr2=0x55745e0bf5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.244+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/2601669828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0bf1d0 0x55745e0bf5f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fe540010f70 tx=0x7fe540013000 comp rx=0 tx=0).stop 2023-12-01T01:05:21.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.244+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2601669828 shutdown_connections 2023-12-01T01:05:21.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.244+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/2601669828 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0c0990 0x55745e0c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.244+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/2601669828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0bf1d0 0x55745e0bf5f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.244+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/2601669828 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bffd0 0x55745e0c0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.244+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2601669828 >> 172.21.15.26:0/2601669828 conn(0x55745e01e0d0 msgr2=0x55745e0b9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.245+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2601669828 shutdown_connections 2023-12-01T01:05:21.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.245+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2601669828 wait complete. 2023-12-01T01:05:21.249 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.245+0000 7fe561fbbb80 1 -- start start 2023-12-01T01:05:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.245+0000 7fe561fbbb80 1 Processor -- start 2023-12-01T01:05:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.245+0000 7fe561fbbb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0bf1d0 0x55745e0c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.245+0000 7fe561fbbb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bffd0 0x55745e0c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.245+0000 7fe561fbbb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0c0990 0x55745e0d0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.245+0000 7fe561fbbb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745dfac510 con 0x55745e0c0990 2023-12-01T01:05:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.245+0000 7fe561fbbb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745dfac1b0 con 0x55745e0bf1d0 2023-12-01T01:05:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.245+0000 7fe561fbbb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745de93920 con 0x55745e0bffd0 2023-12-01T01:05:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.245+0000 7fe561fbbb80 10 client.0 _ll_register_callbacks cb 0x55745def9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.246+0000 7fe54ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0c0990 0x55745e0d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.246+0000 7fe54ffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0c0990 0x55745e0d0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55750/0 (socket says 172.21.15.26:55750) 2023-12-01T01:05:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.246+0000 7fe54ffff700 1 -- 172.21.15.26:0/2785193629 learned_addr learned my addr 172.21.15.26:0/2785193629 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.246+0000 7fe54effd700 1 --2- 172.21.15.26:0/2785193629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bffd0 0x55745e0c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.246+0000 7fe54f7fe700 1 --2- 172.21.15.26:0/2785193629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0bf1d0 0x55745e0c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.246+0000 7fe54ffff700 1 -- 172.21.15.26:0/2785193629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bffd0 msgr2=0x55745e0c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.250 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.246+0000 7fe54ffff700 1 --2- 172.21.15.26:0/2785193629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bffd0 0x55745e0c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.246+0000 7fe54ffff700 1 -- 172.21.15.26:0/2785193629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0bf1d0 msgr2=0x55745e0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.246+0000 7fe54ffff700 1 --2- 172.21.15.26:0/2785193629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0bf1d0 0x55745e0c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.246+0000 7fe54ffff700 1 -- 172.21.15.26:0/2785193629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe540010c50 con 0x55745e0c0990 2023-12-01T01:05:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.246+0000 7fe54ffff700 1 --2- 172.21.15.26:0/2785193629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0c0990 0x55745e0d0120 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe5480042a0 tx=0x7fe5480042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919e53f29cbbbc82 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.246+0000 7fe52effd700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.246+0000 7fe52effd700 1 -- 172.21.15.26:0/2785193629 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe548007700 con 0x55745e0c0990 2023-12-01T01:05:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.246+0000 7fe52effd700 1 -- 172.21.15.26:0/2785193629 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe548007860 con 0x55745e0c0990 2023-12-01T01:05:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.247+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2785193629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55745e03ad10 con 0x55745e0c0990 2023-12-01T01:05:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.247+0000 7fe52effd700 1 -- 172.21.15.26:0/2785193629 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe548007a60 con 0x55745e0c0990 2023-12-01T01:05:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.247+0000 7fe561fbbb80 10 client.15627 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.247+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2785193629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55745de26c60 con 0x55745e0c0990 2023-12-01T01:05:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.248+0000 7fe52effd700 1 -- 172.21.15.26:0/2785193629 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55745e03ad10 con 0x55745e0c0990 2023-12-01T01:05:21.251 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.248+0000 7fe52effd700 1 -- 172.21.15.26:0/2785193629 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fe54801e3b0 con 0x55745e0c0990 2023-12-01T01:05:21.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.248+0000 7fe561fbbb80 10 client.15627 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:21.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.248+0000 7fe561fbbb80 10 client.15627 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2023-12-01T01:05:21.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.248+0000 7fe561fbbb80 20 client.15627 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:21.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.248+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/2785193629 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55745e0d49d0 0x55745e0d6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.248+0000 7fe561fbbb80 4 client.15627 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:05:21.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.248+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2785193629 --> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55745e08de10 con 0x55745e0d49d0 2023-12-01T01:05:21.252 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.248+0000 7fe54f7fe700 1 --2- 172.21.15.26:0/2785193629 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55745e0d49d0 0x55745e0d6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.249+0000 7fe54f7fe700 1 --2- 172.21.15.26:0/2785193629 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55745e0d49d0 0x55745e0d6df0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6646d38fcebd4722 server_cookie=f2edc4be646c25e3 in_seq=0 out_seq=0 2023-12-01T01:05:21.255 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.249+0000 7fe52effd700 10 client.15627 ms_handle_connect on v2:172.21.15.26:6838/1277894156 2023-12-01T01:05:21.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.249+0000 7fe52effd700 1 -- 172.21.15.26:0/2785193629 <== mds.1 v2:172.21.15.26:6838/1277894156 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55745e08de10 con 0x55745e0d49d0 2023-12-01T01:05:21.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.249+0000 7fe52effd700 10 client.15627 handle_command_reply: tid=0 2023-12-01T01:05:21.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.249+0000 7fe561fbbb80 1 client.15627 shutdown 2023-12-01T01:05:21.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.250+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2785193629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0c0990 msgr2=0x55745e0d0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.250+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/2785193629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0c0990 0x55745e0d0120 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe5480042a0 tx=0x7fe5480042d0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.250+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2785193629 shutdown_connections 2023-12-01T01:05:21.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.250+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/2785193629 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55745e0d49d0 0x55745e0d6df0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.250+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/2785193629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0c0990 0x55745e0d0120 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.250+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/2785193629 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0bf1d0 0x55745e0c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.250+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/2785193629 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bffd0 0x55745e0c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.258 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.250+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2785193629 >> 172.21.15.26:0/2785193629 conn(0x55745e01e0d0 msgr2=0x55745e0b92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.250+0000 7fe52effd700 0 client.15627 ms_handle_reset on v2:172.21.15.26:6838/1277894156 2023-12-01T01:05:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.250+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2785193629 shutdown_connections 2023-12-01T01:05:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.250+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2785193629 wait complete. 2023-12-01T01:05:21.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.250+0000 7fe561fbbb80 20 client.15627 trim_cache size 0 max 16384 2023-12-01T01:05:21.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.265+0000 7fe561fbbb80 1 Processor -- start 2023-12-01T01:05:21.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.265+0000 7fe561fbbb80 1 -- start start 2023-12-01T01:05:21.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.266+0000 7fe561fbbb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bf1d0 0x55745e0ce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.266+0000 7fe561fbbb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0bffd0 0x55745e0c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.266+0000 7fe561fbbb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0c0990 0x55745e0c3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.266+0000 7fe561fbbb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745e0b4660 con 0x55745e0bffd0 2023-12-01T01:05:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.266+0000 7fe561fbbb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745e0bfa80 con 0x55745e0c0990 2023-12-01T01:05:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.266+0000 7fe561fbbb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745e0b4380 con 0x55745e0bf1d0 2023-12-01T01:05:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.266+0000 7fe54f7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bf1d0 0x55745e0ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.266+0000 7fe54f7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bf1d0 0x55745e0ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.26:47984/0 (socket says 172.21.15.26:47984) 2023-12-01T01:05:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.266+0000 7fe54f7fe700 1 -- 172.21.15.26:0/2119775337 learned_addr learned my addr 172.21.15.26:0/2119775337 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.266+0000 7fe54ffff700 1 --2- 172.21.15.26:0/2119775337 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0c0990 0x55745e0c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.266+0000 7fe54f7fe700 1 -- 172.21.15.26:0/2119775337 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0c0990 msgr2=0x55745e0c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.266+0000 7fe54f7fe700 1 --2- 172.21.15.26:0/2119775337 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0c0990 0x55745e0c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.266+0000 7fe54f7fe700 1 -- 172.21.15.26:0/2119775337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0bffd0 msgr2=0x55745e0c6e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-01T01:05:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.266+0000 7fe54f7fe700 1 --2- 172.21.15.26:0/2119775337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0bffd0 0x55745e0c6e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.266+0000 7fe54f7fe700 1 -- 172.21.15.26:0/2119775337 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55745de64250 con 0x55745e0bf1d0 2023-12-01T01:05:21.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.266+0000 7fe54f7fe700 1 --2- 172.21.15.26:0/2119775337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bf1d0 0x55745e0ce030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe5400058b0 tx=0x7fe54000bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b509676e24c2a22 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.267+0000 7fe5367fc700 1 -- 172.21.15.26:0/2119775337 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54002c040 con 0x55745e0bf1d0 2023-12-01T01:05:21.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.267+0000 7fe5367fc700 1 -- 172.21.15.26:0/2119775337 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe54002d040 con 0x55745e0bf1d0 2023-12-01T01:05:21.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.267+0000 7fe5367fc700 1 -- 172.21.15.26:0/2119775337 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540034ad0 con 0x55745e0bf1d0 2023-12-01T01:05:21.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.267+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2119775337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bf1d0 msgr2=0x55745e0ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.267+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/2119775337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bf1d0 0x55745e0ce030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe5400058b0 tx=0x7fe54000bab0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.267+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2119775337 shutdown_connections 2023-12-01T01:05:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.267+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/2119775337 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0c0990 0x55745e0c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.267+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/2119775337 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bf1d0 0x55745e0ce030 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.267+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/2119775337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0bffd0 0x55745e0c6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.267+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2119775337 >> 172.21.15.26:0/2119775337 conn(0x55745e01e0d0 msgr2=0x55745e0d69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.267+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2119775337 shutdown_connections 2023-12-01T01:05:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.267+0000 7fe561fbbb80 1 -- 172.21.15.26:0/2119775337 wait complete. 2023-12-01T01:05:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.268+0000 7fe561fbbb80 1 -- start start 2023-12-01T01:05:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.268+0000 7fe561fbbb80 1 Processor -- start 2023-12-01T01:05:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.268+0000 7fe561fbbb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0bf1d0 0x55745e1206a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.268+0000 7fe561fbbb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bffd0 0x55745e122bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.268+0000 7fe561fbbb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0c0990 0x55745e125140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.268+0000 7fe561fbbb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745e125860 con 0x55745e0c0990 2023-12-01T01:05:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.268+0000 7fe561fbbb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745e1259d0 con 0x55745e0bf1d0 2023-12-01T01:05:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.268+0000 7fe561fbbb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55745e125b90 con 0x55745e0bffd0 2023-12-01T01:05:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.268+0000 7fe561fbbb80 10 client.0 _ll_register_callbacks cb 0x7fe548009c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.269+0000 7fe54f7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0bf1d0 0x55745e1206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.269+0000 7fe54f7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0bf1d0 0x55745e1206a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:46496/0 (socket says 172.21.15.26:46496) 2023-12-01T01:05:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.269+0000 7fe54f7fe700 1 -- 172.21.15.26:0/3499621618 learned_addr learned my addr 172.21.15.26:0/3499621618 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.269+0000 7fe54ffff700 1 --2- 172.21.15.26:0/3499621618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0c0990 0x55745e125140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.269+0000 7fe54effd700 1 --2- 172.21.15.26:0/3499621618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bffd0 0x55745e122bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.269+0000 7fe54f7fe700 1 -- 172.21.15.26:0/3499621618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bffd0 msgr2=0x55745e122bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.269+0000 7fe54f7fe700 1 --2- 172.21.15.26:0/3499621618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bffd0 0x55745e122bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.269+0000 7fe54f7fe700 1 -- 172.21.15.26:0/3499621618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0c0990 msgr2=0x55745e125140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.269+0000 7fe54f7fe700 1 --2- 172.21.15.26:0/3499621618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0c0990 0x55745e125140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.269+0000 7fe54f7fe700 1 -- 172.21.15.26:0/3499621618 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55745de3dde0 con 0x55745e0bf1d0 2023-12-01T01:05:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.269+0000 7fe54f7fe700 1 --2- 172.21.15.26:0/3499621618 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0bf1d0 0x55745e1206a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe54000bb40 tx=0x7fe5400340e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62f24160917cf522 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.269+0000 7fe52effd700 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-12-01T01:05:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.269+0000 7fe52effd700 1 -- 172.21.15.26:0/3499621618 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe540034390 con 0x55745e0bf1d0 2023-12-01T01:05:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.270+0000 7fe561fbbb80 1 -- 172.21.15.26:0/3499621618 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe540015070 con 0x55745e0bf1d0 2023-12-01T01:05:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.270+0000 7fe52effd700 1 -- 172.21.15.26:0/3499621618 <== mon.2 v2:172.21.15.93:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe540017070 con 0x55745e0bf1d0 2023-12-01T01:05:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.270+0000 7fe52effd700 1 -- 172.21.15.26:0/3499621618 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe540034870 con 0x55745e0bf1d0 2023-12-01T01:05:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.270+0000 7fe561fbbb80 10 client.25280 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.270+0000 7fe561fbbb80 1 -- 172.21.15.26:0/3499621618 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55745de3c2b0 con 0x55745e0bf1d0 2023-12-01T01:05:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.270+0000 7fe52effd700 1 -- 172.21.15.26:0/3499621618 <== mon.2 v2:172.21.15.93:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe540015070 con 0x55745e0bf1d0 2023-12-01T01:05:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.270+0000 7fe52effd700 1 -- 172.21.15.26:0/3499621618 <== mon.2 v2:172.21.15.93:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fe54004e070 con 0x55745e0bf1d0 2023-12-01T01:05:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.270+0000 7fe561fbbb80 10 client.25280 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.270+0000 7fe561fbbb80 10 client.25280 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2023-12-01T01:05:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.270+0000 7fe561fbbb80 20 client.25280 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.270+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/3499621618 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55745e127060 0x55745e129450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.270+0000 7fe561fbbb80 4 client.25280 mds_command: new command op to 24493 tid=0[{"prefix": "damage ls"}] 2023-12-01T01:05:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.270+0000 7fe561fbbb80 1 -- 172.21.15.26:0/3499621618 --> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55745e008d40 con 0x55745e127060 2023-12-01T01:05:21.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.270+0000 7fe54effd700 1 --2- 172.21.15.26:0/3499621618 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55745e127060 0x55745e129450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.271+0000 7fe54effd700 1 --2- 172.21.15.26:0/3499621618 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55745e127060 0x55745e129450 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7ee16aa206bd4ed server_cookie=cb6a65acbecc0a81 in_seq=0 out_seq=0 2023-12-01T01:05:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.271+0000 7fe52effd700 10 client.25280 ms_handle_connect on v2:172.21.15.26:6838/1277894156 2023-12-01T01:05:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.271+0000 7fe52effd700 1 -- 172.21.15.26:0/3499621618 <== mds.1 v2:172.21.15.26:6838/1277894156 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55745e008d40 con 0x55745e127060 2023-12-01T01:05:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.271+0000 7fe52effd700 10 client.25280 handle_command_reply: tid=0 2023-12-01T01:05:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.271+0000 7fe561fbbb80 1 client.25280 shutdown 2023-12-01T01:05:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.271+0000 7fe561fbbb80 1 -- 172.21.15.26:0/3499621618 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0bf1d0 msgr2=0x55745e1206a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.271+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/3499621618 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0bf1d0 0x55745e1206a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe54000bb40 tx=0x7fe5400340e0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.271+0000 7fe561fbbb80 1 -- 172.21.15.26:0/3499621618 shutdown_connections 2023-12-01T01:05:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.271+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/3499621618 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55745e127060 0x55745e129450 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.271+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/3499621618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55745e0c0990 0x55745e125140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.271+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/3499621618 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55745e0bf1d0 0x55745e1206a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.271+0000 7fe561fbbb80 1 --2- 172.21.15.26:0/3499621618 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55745e0bffd0 0x55745e122bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.272+0000 7fe561fbbb80 1 -- 172.21.15.26:0/3499621618 >> 172.21.15.26:0/3499621618 conn(0x55745e01e0d0 msgr2=0x55745e0c6e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.272+0000 7fe52effd700 0 client.25280 ms_handle_reset on v2:172.21.15.26:6838/1277894156 2023-12-01T01:05:21.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.272+0000 7fe561fbbb80 1 -- 172.21.15.26:0/3499621618 shutdown_connections 2023-12-01T01:05:21.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.272+0000 7fe561fbbb80 1 -- 172.21.15.26:0/3499621618 wait complete. 2023-12-01T01:05:21.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.272+0000 7fe561fbbb80 20 client.25280 trim_cache size 0 max 16384 2023-12-01T01:05:21.278 INFO:teuthology.orchestra.run.smithi026.stdout:[] 2023-12-01T01:05:21.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.272+0000 7fe554bc9700 1 -- 172.21.15.26:0/1277268708 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe5380a05c0 msgr2=0x7fe5380a2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.279 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.272+0000 7fe554bc9700 1 --2- 172.21.15.26:0/1277268708 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe5380a05c0 0x7fe5380a2a80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe550100b40 tx=0x7fe54000b410 comp rx=0 tx=0).stop 2023-12-01T01:05:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.272+0000 7fe554bc9700 1 -- 172.21.15.26:0/1277268708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe550100ce0 msgr2=0x7fe550196dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.272+0000 7fe554bc9700 1 --2- 172.21.15.26:0/1277268708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe550100ce0 0x7fe550196dd0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe5440036f0 tx=0x7fe54400f690 comp rx=0 tx=0).stop 2023-12-01T01:05:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.272+0000 7fe554bc9700 1 -- 172.21.15.26:0/1277268708 shutdown_connections 2023-12-01T01:05:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.272+0000 7fe554bc9700 1 --2- 172.21.15.26:0/1277268708 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe5380a05c0 0x7fe5380a2a80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.272+0000 7fe554bc9700 1 --2- 172.21.15.26:0/1277268708 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe550101680 0x7fe55019de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.272+0000 7fe554bc9700 1 --2- 172.21.15.26:0/1277268708 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe5500ffaf0 0x7fe550196890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.272+0000 7fe554bc9700 1 --2- 172.21.15.26:0/1277268708 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe550100ce0 0x7fe550196dd0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.272+0000 7fe554bc9700 1 -- 172.21.15.26:0/1277268708 >> 172.21.15.26:0/1277268708 conn(0x7fe5500fb040 msgr2=0x7fe5500fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.273+0000 7fe554bc9700 1 -- 172.21.15.26:0/1277268708 shutdown_connections 2023-12-01T01:05:21.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.273+0000 7fe554bc9700 1 -- 172.21.15.26:0/1277268708 wait complete. 2023-12-01T01:05:21.290 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-01T01:05:21.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.429+0000 7f00b84fe700 1 -- 172.21.15.26:0/3499653987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b0101810 msgr2=0x7f00b01080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.429+0000 7f00b84fe700 1 --2- 172.21.15.26:0/3499653987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b0101810 0x7f00b01080c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f00a800b0d0 tx=0x7f00a800b3e0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.429+0000 7f00b84fe700 1 -- 172.21.15.26:0/3499653987 shutdown_connections 2023-12-01T01:05:21.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.429+0000 7f00b84fe700 1 --2- 172.21.15.26:0/3499653987 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b0101810 0x7f00b01080c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.429+0000 7f00b84fe700 1 --2- 172.21.15.26:0/3499653987 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00b00ffc80 0x7f00b01000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.429+0000 7f00b84fe700 1 --2- 172.21.15.26:0/3499653987 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00b0100e70 0x7f00b01012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.429+0000 7f00b84fe700 1 -- 172.21.15.26:0/3499653987 >> 172.21.15.26:0/3499653987 conn(0x7f00b00fb1f0 msgr2=0x7f00b00fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.429+0000 7f00b84fe700 1 -- 172.21.15.26:0/3499653987 shutdown_connections 2023-12-01T01:05:21.431 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.429+0000 7f00b84fe700 1 -- 172.21.15.26:0/3499653987 wait complete. 2023-12-01T01:05:21.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.430+0000 7f00b84fe700 1 Processor -- start 2023-12-01T01:05:21.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.430+0000 7f00b84fe700 1 -- start start 2023-12-01T01:05:21.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.430+0000 7f00b84fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b00ffc80 0x7f00b010a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.430+0000 7f00b84fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00b0100e70 0x7f00b0108e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.430+0000 7f00b84fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00b0101810 0x7f00b0109360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.430+0000 7f00b84fe700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0109b00 con 0x7f00b00ffc80 2023-12-01T01:05:21.433 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.430+0000 7f00b84fe700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0109c70 con 0x7f00b0100e70 2023-12-01T01:05:21.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.430+0000 7f00b84fe700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b01a0c90 con 0x7f00b0101810 2023-12-01T01:05:21.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.431+0000 7f00b629a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b00ffc80 0x7f00b010a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.431+0000 7f00b629a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b00ffc80 0x7f00b010a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55772/0 (socket says 172.21.15.26:55772) 2023-12-01T01:05:21.434 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.431+0000 7f00b629a700 1 -- 172.21.15.26:0/3052443196 learned_addr learned my addr 172.21.15.26:0/3052443196 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:21.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.431+0000 7f00b5a99700 1 --2- 172.21.15.26:0/3052443196 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00b0100e70 0x7f00b0108e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.431+0000 7f00b6a9b700 1 --2- 172.21.15.26:0/3052443196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00b0101810 0x7f00b0109360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.431+0000 7f00b629a700 1 -- 172.21.15.26:0/3052443196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00b0101810 msgr2=0x7f00b0109360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.431+0000 7f00b629a700 1 --2- 172.21.15.26:0/3052443196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00b0101810 0x7f00b0109360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.431+0000 7f00b629a700 1 -- 172.21.15.26:0/3052443196 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00b0100e70 msgr2=0x7f00b0108e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.431+0000 7f00b629a700 1 --2- 172.21.15.26:0/3052443196 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00b0100e70 0x7f00b0108e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.431+0000 7f00b629a700 1 -- 172.21.15.26:0/3052443196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a8009d00 con 0x7f00b00ffc80 2023-12-01T01:05:21.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.431+0000 7f00b6a9b700 1 --2- 172.21.15.26:0/3052443196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00b0101810 0x7f00b0109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:05:21.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.431+0000 7f00b629a700 1 --2- 172.21.15.26:0/3052443196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b00ffc80 0x7f00b010a7e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00d980 tx=0x7f00ac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.435 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.431+0000 7f00a77fe700 1 -- 172.21.15.26:0/3052443196 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac00b950 con 0x7f00b00ffc80 2023-12-01T01:05:21.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.431+0000 7f00b84fe700 1 -- 172.21.15.26:0/3052443196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b01a0f70 con 0x7f00b00ffc80 2023-12-01T01:05:21.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.432+0000 7f00b84fe700 1 -- 172.21.15.26:0/3052443196 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b01a13f0 con 0x7f00b00ffc80 2023-12-01T01:05:21.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.432+0000 7f00a77fe700 1 -- 172.21.15.26:0/3052443196 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f00ac007620 con 0x7f00b00ffc80 2023-12-01T01:05:21.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.432+0000 7f00a77fe700 1 -- 172.21.15.26:0/3052443196 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac00f620 con 0x7f00b00ffc80 2023-12-01T01:05:21.436 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.435+0000 7f00a77fe700 1 -- 172.21.15.26:0/3052443196 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f00ac0106f0 con 0x7f00b00ffc80 2023-12-01T01:05:21.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.436+0000 7f00a77fe700 1 --2- 172.21.15.26:0/3052443196 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f009c0a05a0 0x7f009c0a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.436+0000 7f00c468eb80 1 Processor -- start 2023-12-01T01:05:21.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.436+0000 7f00a77fe700 1 -- 172.21.15.26:0/3052443196 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f00ac0cb7a0 con 0x7f00b00ffc80 2023-12-01T01:05:21.439 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.437+0000 7f00c468eb80 1 -- start start 2023-12-01T01:05:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.437+0000 7f00b5a99700 1 --2- 172.21.15.26:0/3052443196 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f009c0a05a0 0x7f009c0a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.437+0000 7f00c468eb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101100 0x5589c4101540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.437+0000 7f00c468eb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101a80 0x5589c40ffe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.437+0000 7f00c468eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4100400 0x5589c4100880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.437+0000 7f00c468eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589c4046a10 con 0x5589c4100400 2023-12-01T01:05:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.437+0000 7f00c468eb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589c40443d0 con 0x5589c4101100 2023-12-01T01:05:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.437+0000 7f00c468eb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589c403fcc0 con 0x5589c4101a80 2023-12-01T01:05:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.437+0000 7f00b6a9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4100400 0x5589c4100880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.437+0000 7f00b6a9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4100400 0x5589c4100880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55782/0 (socket says 172.21.15.26:55782) 2023-12-01T01:05:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.437+0000 7f00b6a9b700 1 -- 172.21.15.26:0/2422326329 learned_addr learned my addr 172.21.15.26:0/2422326329 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.437+0000 7f00b5a99700 1 --2- 172.21.15.26:0/2422326329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101a80 0x5589c40ffe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.437+0000 7f00b629a700 1 --2- 172.21.15.26:0/2422326329 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101100 0x5589c4101540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.438+0000 7f00b5a99700 1 --2- 172.21.15.26:0/3052443196 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f009c0a05a0 0x7f009c0a2a60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009c30 tx=0x7f00a0011440 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.440 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.438+0000 7f00b5a99700 1 -- 172.21.15.26:0/2422326329 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101100 msgr2=0x5589c4101540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.441 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.438+0000 7f00b5a99700 1 --2- 172.21.15.26:0/2422326329 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101100 0x5589c4101540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.438+0000 7f00b5a99700 1 -- 172.21.15.26:0/2422326329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4100400 msgr2=0x5589c4100880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.438+0000 7f00b5a99700 1 --2- 172.21.15.26:0/2422326329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4100400 0x5589c4100880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.438+0000 7f00b5a99700 1 -- 172.21.15.26:0/2422326329 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589c3e6dde0 con 0x5589c4101a80 2023-12-01T01:05:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.438+0000 7f00b6a9b700 1 --2- 172.21.15.26:0/2422326329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4100400 0x5589c4100880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:21.442 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.438+0000 7f00b5a99700 1 --2- 172.21.15.26:0/2422326329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101a80 0x5589c40ffe70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f00a0011db0 tx=0x7f00a001c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae427626e1aedc36 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.443 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.443+0000 7f00a4ff9700 1 -- 172.21.15.26:0/2422326329 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a001de70 con 0x5589c4101a80 2023-12-01T01:05:21.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.443+0000 7f00a4ff9700 1 -- 172.21.15.26:0/2422326329 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f00a0004d10 con 0x5589c4101a80 2023-12-01T01:05:21.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.443+0000 7f00a4ff9700 1 -- 172.21.15.26:0/2422326329 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a000f620 con 0x5589c4101a80 2023-12-01T01:05:21.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.443+0000 7f00c468eb80 1 -- 172.21.15.26:0/2422326329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101a80 msgr2=0x5589c40ffe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.444 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.443+0000 7f00c468eb80 1 --2- 172.21.15.26:0/2422326329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101a80 0x5589c40ffe70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f00a0011db0 tx=0x7f00a001c000 comp rx=0 tx=0).stop 2023-12-01T01:05:21.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.443+0000 7f00c468eb80 1 -- 172.21.15.26:0/2422326329 shutdown_connections 2023-12-01T01:05:21.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.443+0000 7f00c468eb80 1 --2- 172.21.15.26:0/2422326329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4100400 0x5589c4100880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.443+0000 7f00c468eb80 1 --2- 172.21.15.26:0/2422326329 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101100 0x5589c4101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.443+0000 7f00c468eb80 1 --2- 172.21.15.26:0/2422326329 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101a80 0x5589c40ffe70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.443+0000 7f00c468eb80 1 -- 172.21.15.26:0/2422326329 >> 172.21.15.26:0/2422326329 conn(0x5589c404e0d0 msgr2=0x5589c40e9940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.444+0000 7f00c468eb80 1 -- 172.21.15.26:0/2422326329 shutdown_connections 2023-12-01T01:05:21.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.444+0000 7f00c468eb80 1 -- 172.21.15.26:0/2422326329 wait complete. 2023-12-01T01:05:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.444+0000 7f00c468eb80 1 -- start start 2023-12-01T01:05:21.447 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.444+0000 7f00c468eb80 1 Processor -- start 2023-12-01T01:05:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.444+0000 7f00c468eb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4100400 0x5589c40f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.444+0000 7f00c468eb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101100 0x5589c40f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.444+0000 7f00c468eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4101a80 0x5589c40f80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.445+0000 7f00c468eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589c3fdc510 con 0x5589c4101a80 2023-12-01T01:05:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.445+0000 7f00c468eb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589c3fdc1b0 con 0x5589c4100400 2023-12-01T01:05:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.445+0000 7f00c468eb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589c3ec3920 con 0x5589c4101100 2023-12-01T01:05:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.445+0000 7f00c468eb80 10 client.0 _ll_register_callbacks cb 0x5589c3f29a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.445+0000 7f00b6a9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4101a80 0x5589c40f80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.445+0000 7f00b6a9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4101a80 0x5589c40f80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55788/0 (socket says 172.21.15.26:55788) 2023-12-01T01:05:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.445+0000 7f00b6a9b700 1 -- 172.21.15.26:0/2043281790 learned_addr learned my addr 172.21.15.26:0/2043281790 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.445+0000 7f00b629a700 1 --2- 172.21.15.26:0/2043281790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4100400 0x5589c40f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.445+0000 7f00b6a9b700 1 -- 172.21.15.26:0/2043281790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101100 msgr2=0x5589c40f10b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-01T01:05:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.445+0000 7f00b6a9b700 1 --2- 172.21.15.26:0/2043281790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101100 0x5589c40f10b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.445+0000 7f00b6a9b700 1 -- 172.21.15.26:0/2043281790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4100400 msgr2=0x5589c40f0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.445+0000 7f00b6a9b700 1 --2- 172.21.15.26:0/2043281790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4100400 0x5589c40f0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.445+0000 7f00b6a9b700 1 -- 172.21.15.26:0/2043281790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b0108a10 con 0x5589c4101a80 2023-12-01T01:05:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.445+0000 7f00b629a700 1 --2- 172.21.15.26:0/2043281790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4100400 0x5589c40f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.445+0000 7f00b6a9b700 1 --2- 172.21.15.26:0/2043281790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4101a80 0x5589c40f80f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f00a800bf50 tx=0x7f00a800bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16836499be763b43 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.445+0000 7f0099ffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.446+0000 7f0099ffb700 1 -- 172.21.15.26:0/2043281790 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a800e040 con 0x5589c4101a80 2023-12-01T01:05:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.446+0000 7f0099ffb700 1 -- 172.21.15.26:0/2043281790 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f00a8003c00 con 0x5589c4101a80 2023-12-01T01:05:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.446+0000 7f00c468eb80 1 -- 172.21.15.26:0/2043281790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589c406ad10 con 0x5589c4101a80 2023-12-01T01:05:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.446+0000 7f0099ffb700 1 -- 172.21.15.26:0/2043281790 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00a8009ba0 con 0x5589c4101a80 2023-12-01T01:05:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.446+0000 7f00c468eb80 10 client.15642 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.446+0000 7f00c468eb80 1 -- 172.21.15.26:0/2043281790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f00a0011b20 con 0x5589c4101a80 2023-12-01T01:05:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.446+0000 7f0099ffb700 1 -- 172.21.15.26:0/2043281790 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x5589c406ad10 con 0x5589c4101a80 2023-12-01T01:05:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.446+0000 7f0099ffb700 1 -- 172.21.15.26:0/2043281790 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f00a800b100 con 0x5589c4101a80 2023-12-01T01:05:21.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.446+0000 7f00c468eb80 10 client.15642 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.446+0000 7f00c468eb80 10 client.15642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.446+0000 7f00c468eb80 20 client.15642 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.446+0000 7f00c468eb80 1 --2- 172.21.15.26:0/2043281790 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5589c40fc9a0 0x5589c40fedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.446+0000 7f00c468eb80 4 client.15642 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:05:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.446+0000 7f00c468eb80 1 -- 172.21.15.26:0/2043281790 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589c40bde10 con 0x5589c40fc9a0 2023-12-01T01:05:21.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.447+0000 7f00b629a700 1 --2- 172.21.15.26:0/2043281790 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5589c40fc9a0 0x5589c40fedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.447+0000 7f0099ffb700 10 client.15642 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:21.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.447+0000 7f00b629a700 1 --2- 172.21.15.26:0/2043281790 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5589c40fc9a0 0x5589c40fedc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4085b51e92563f19 server_cookie=ceb172600cd59441 in_seq=0 out_seq=0 2023-12-01T01:05:21.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.448+0000 7f0099ffb700 1 -- 172.21.15.26:0/2043281790 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5589c40bde10 con 0x5589c40fc9a0 2023-12-01T01:05:21.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.448+0000 7f0099ffb700 10 client.15642 handle_command_reply: tid=0 2023-12-01T01:05:21.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.448+0000 7f00c468eb80 1 client.15642 shutdown 2023-12-01T01:05:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.448+0000 7f00c468eb80 1 -- 172.21.15.26:0/2043281790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4101a80 msgr2=0x5589c40f80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.448+0000 7f00c468eb80 1 --2- 172.21.15.26:0/2043281790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4101a80 0x5589c40f80f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f00a800bf50 tx=0x7f00a800bf80 comp rx=0 tx=0).stop 2023-12-01T01:05:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.448+0000 7f00c468eb80 1 -- 172.21.15.26:0/2043281790 shutdown_connections 2023-12-01T01:05:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.448+0000 7f00c468eb80 1 --2- 172.21.15.26:0/2043281790 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5589c40fc9a0 0x5589c40fedc0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.448+0000 7f00c468eb80 1 --2- 172.21.15.26:0/2043281790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4101a80 0x5589c40f80f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.448+0000 7f00c468eb80 1 --2- 172.21.15.26:0/2043281790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4100400 0x5589c40f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.448+0000 7f00c468eb80 1 --2- 172.21.15.26:0/2043281790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101100 0x5589c40f10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.448+0000 7f00c468eb80 1 -- 172.21.15.26:0/2043281790 >> 172.21.15.26:0/2043281790 conn(0x5589c404e0d0 msgr2=0x5589c40e90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.448+0000 7f0099ffb700 0 client.15642 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.448+0000 7f00c468eb80 1 -- 172.21.15.26:0/2043281790 shutdown_connections 2023-12-01T01:05:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.448+0000 7f00c468eb80 1 -- 172.21.15.26:0/2043281790 wait complete. 2023-12-01T01:05:21.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.448+0000 7f00c468eb80 20 client.15642 trim_cache size 0 max 16384 2023-12-01T01:05:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.472+0000 7f00c468eb80 1 Processor -- start 2023-12-01T01:05:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.472+0000 7f00c468eb80 1 -- start start 2023-12-01T01:05:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00c468eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4100400 0x5589c40f60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00c468eb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101100 0x5589c40f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00c468eb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101a80 0x5589c40f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00c468eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589c40ea240 con 0x5589c4100400 2023-12-01T01:05:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00c468eb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589c40f9db0 con 0x5589c4101a80 2023-12-01T01:05:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00c468eb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589c40ef0e0 con 0x5589c4101100 2023-12-01T01:05:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00b629a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4100400 0x5589c40f60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00b629a700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4100400 0x5589c40f60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55794/0 (socket says 172.21.15.26:55794) 2023-12-01T01:05:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00b629a700 1 -- 172.21.15.26:0/3724944156 learned_addr learned my addr 172.21.15.26:0/3724944156 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:21.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00b6a9b700 1 --2- 172.21.15.26:0/3724944156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101a80 0x5589c40f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00b5a99700 1 --2- 172.21.15.26:0/3724944156 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101100 0x5589c40f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00b629a700 1 -- 172.21.15.26:0/3724944156 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101100 msgr2=0x5589c40f0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00b629a700 1 --2- 172.21.15.26:0/3724944156 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101100 0x5589c40f0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00b629a700 1 -- 172.21.15.26:0/3724944156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101a80 msgr2=0x5589c40f10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00b629a700 1 --2- 172.21.15.26:0/3724944156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101a80 0x5589c40f10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00b629a700 1 -- 172.21.15.26:0/3724944156 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589c3e56c60 con 0x5589c4100400 2023-12-01T01:05:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00b6a9b700 1 --2- 172.21.15.26:0/3724944156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101a80 0x5589c40f10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:05:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00b5a99700 1 --2- 172.21.15.26:0/3724944156 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101100 0x5589c40f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:05:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.473+0000 7f00b629a700 1 --2- 172.21.15.26:0/3724944156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4100400 0x5589c40f60a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f00ac098f40 tx=0x7f00ac0cb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f96e28f578d4e09 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.474+0000 7f00a57fa700 1 -- 172.21.15.26:0/3724944156 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0a1020 con 0x5589c4100400 2023-12-01T01:05:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.474+0000 7f00a57fa700 1 -- 172.21.15.26:0/3724944156 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f00ac0c9360 con 0x5589c4100400 2023-12-01T01:05:21.476 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.474+0000 7f00a57fa700 1 -- 172.21.15.26:0/3724944156 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0984a0 con 0x5589c4100400 2023-12-01T01:05:21.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.475+0000 7f00c468eb80 1 -- 172.21.15.26:0/3724944156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4100400 msgr2=0x5589c40f60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.475+0000 7f00c468eb80 1 --2- 172.21.15.26:0/3724944156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4100400 0x5589c40f60a0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f00ac098f40 tx=0x7f00ac0cb040 comp rx=0 tx=0).stop 2023-12-01T01:05:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.475+0000 7f00c468eb80 1 -- 172.21.15.26:0/3724944156 shutdown_connections 2023-12-01T01:05:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.475+0000 7f00c468eb80 1 --2- 172.21.15.26:0/3724944156 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101a80 0x5589c40f10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.475+0000 7f00c468eb80 1 --2- 172.21.15.26:0/3724944156 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4100400 0x5589c40f60a0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.475+0000 7f00c468eb80 1 --2- 172.21.15.26:0/3724944156 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101100 0x5589c40f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.475+0000 7f00c468eb80 1 -- 172.21.15.26:0/3724944156 >> 172.21.15.26:0/3724944156 conn(0x5589c404e0d0 msgr2=0x5589c41048c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.475+0000 7f00c468eb80 1 -- 172.21.15.26:0/3724944156 shutdown_connections 2023-12-01T01:05:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.475+0000 7f00c468eb80 1 -- 172.21.15.26:0/3724944156 wait complete. 2023-12-01T01:05:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.475+0000 7f00c468eb80 1 -- start start 2023-12-01T01:05:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.475+0000 7f00c468eb80 1 Processor -- start 2023-12-01T01:05:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.475+0000 7f00c468eb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101100 0x5589c40f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.475+0000 7f00c468eb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101a80 0x5589c4175030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.475+0000 7f00c468eb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4175570 0x5589c4177960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f00c468eb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589c4177f40 con 0x5589c4175570 2023-12-01T01:05:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f00c468eb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589c41780b0 con 0x5589c4101a80 2023-12-01T01:05:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f00c468eb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589c4178270 con 0x5589c4101100 2023-12-01T01:05:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f00c468eb80 10 client.0 _ll_register_callbacks cb 0x7f00a800baa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f00b6a9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4175570 0x5589c4177960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f00b6a9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4175570 0x5589c4177960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55804/0 (socket says 172.21.15.26:55804) 2023-12-01T01:05:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f00b6a9b700 1 -- 172.21.15.26:0/1669354232 learned_addr learned my addr 172.21.15.26:0/1669354232 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f00b629a700 1 --2- 172.21.15.26:0/1669354232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101100 0x5589c40f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f00b6a9b700 1 -- 172.21.15.26:0/1669354232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101100 msgr2=0x5589c40f5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f00b6a9b700 1 --2- 172.21.15.26:0/1669354232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101100 0x5589c40f5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f00b5a99700 1 --2- 172.21.15.26:0/1669354232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101a80 0x5589c4175030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f00b6a9b700 1 -- 172.21.15.26:0/1669354232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101a80 msgr2=0x5589c4175030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f00b6a9b700 1 --2- 172.21.15.26:0/1669354232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101a80 0x5589c4175030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f00b6a9b700 1 -- 172.21.15.26:0/1669354232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b01a13f0 con 0x5589c4175570 2023-12-01T01:05:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f00b5a99700 1 --2- 172.21.15.26:0/1669354232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101a80 0x5589c4175030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:05:21.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f00b6a9b700 1 --2- 172.21.15.26:0/1669354232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4175570 0x5589c4177960 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f00a8002230 tx=0x7f00a8007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0bc370d469642d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.476+0000 7f0099ffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.477+0000 7f0099ffb700 1 -- 172.21.15.26:0/1669354232 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a800e040 con 0x5589c4175570 2023-12-01T01:05:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.477+0000 7f00c468eb80 1 -- 172.21.15.26:0/1669354232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f00a0004d10 con 0x5589c4175570 2023-12-01T01:05:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.477+0000 7f0099ffb700 1 -- 172.21.15.26:0/1669354232 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f00a801cd60 con 0x5589c4175570 2023-12-01T01:05:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.477+0000 7f0099ffb700 1 -- 172.21.15.26:0/1669354232 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00a8003a00 con 0x5589c4175570 2023-12-01T01:05:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.477+0000 7f00c468eb80 10 client.15648 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.477+0000 7f00c468eb80 1 -- 172.21.15.26:0/1669354232 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5589c3e94250 con 0x5589c4175570 2023-12-01T01:05:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.477+0000 7f0099ffb700 1 -- 172.21.15.26:0/1669354232 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f00a0004d10 con 0x5589c4175570 2023-12-01T01:05:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.477+0000 7f0099ffb700 1 -- 172.21.15.26:0/1669354232 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f00a8005920 con 0x5589c4175570 2023-12-01T01:05:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.477+0000 7f00c468eb80 10 client.15648 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.477+0000 7f00c468eb80 10 client.15648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.477+0000 7f00c468eb80 20 client.15648 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.477+0000 7f00c468eb80 1 --2- 172.21.15.26:0/1669354232 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5589c41798b0 0x5589c417bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:21.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.477+0000 7f00c468eb80 4 client.15648 mds_command: new command op to 24509 tid=0[{"prefix": "damage ls"}] 2023-12-01T01:05:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.477+0000 7f00c468eb80 1 -- 172.21.15.26:0/1669354232 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5589c4038d40 con 0x5589c41798b0 2023-12-01T01:05:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.478+0000 7f00b629a700 1 --2- 172.21.15.26:0/1669354232 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5589c41798b0 0x5589c417bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.478+0000 7f0099ffb700 10 client.15648 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.478+0000 7f00b629a700 1 --2- 172.21.15.26:0/1669354232 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5589c41798b0 0x5589c417bcd0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=411a531e4a25aa0c server_cookie=6fa68234fac47d17 in_seq=0 out_seq=0 2023-12-01T01:05:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.478+0000 7f0099ffb700 1 -- 172.21.15.26:0/1669354232 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5589c4038d40 con 0x5589c41798b0 2023-12-01T01:05:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.478+0000 7f0099ffb700 10 client.15648 handle_command_reply: tid=0 2023-12-01T01:05:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.478+0000 7f00c468eb80 1 client.15648 shutdown 2023-12-01T01:05:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.478+0000 7f00c468eb80 1 -- 172.21.15.26:0/1669354232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4175570 msgr2=0x5589c4177960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.478+0000 7f00c468eb80 1 --2- 172.21.15.26:0/1669354232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4175570 0x5589c4177960 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f00a8002230 tx=0x7f00a8007590 comp rx=0 tx=0).stop 2023-12-01T01:05:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.478+0000 7f00c468eb80 1 -- 172.21.15.26:0/1669354232 shutdown_connections 2023-12-01T01:05:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.478+0000 7f00c468eb80 1 --2- 172.21.15.26:0/1669354232 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5589c41798b0 0x5589c417bcd0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.478+0000 7f00c468eb80 1 --2- 172.21.15.26:0/1669354232 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5589c4175570 0x5589c4177960 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.478+0000 7f00c468eb80 1 --2- 172.21.15.26:0/1669354232 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5589c4101100 0x5589c40f5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.478+0000 7f00c468eb80 1 --2- 172.21.15.26:0/1669354232 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5589c4101a80 0x5589c4175030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.478+0000 7f00c468eb80 1 -- 172.21.15.26:0/1669354232 >> 172.21.15.26:0/1669354232 conn(0x5589c404e0d0 msgr2=0x5589c40f0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.478+0000 7f0099ffb700 0 client.15648 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:21.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.479+0000 7f00c468eb80 1 -- 172.21.15.26:0/1669354232 shutdown_connections 2023-12-01T01:05:21.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.479+0000 7f00c468eb80 1 -- 172.21.15.26:0/1669354232 wait complete. 2023-12-01T01:05:21.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.479+0000 7f00c468eb80 20 client.15648 trim_cache size 0 max 16384 2023-12-01T01:05:21.485 INFO:teuthology.orchestra.run.smithi026.stdout:[] 2023-12-01T01:05:21.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.479+0000 7f00b84fe700 1 -- 172.21.15.26:0/3052443196 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f009c0a05a0 msgr2=0x7f009c0a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.479+0000 7f00b84fe700 1 --2- 172.21.15.26:0/3052443196 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f009c0a05a0 0x7f009c0a2a60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009c30 tx=0x7f00a0011440 comp rx=0 tx=0).stop 2023-12-01T01:05:21.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.479+0000 7f00b84fe700 1 -- 172.21.15.26:0/3052443196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b00ffc80 msgr2=0x7f00b010a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:21.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.479+0000 7f00b84fe700 1 --2- 172.21.15.26:0/3052443196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b00ffc80 0x7f00b010a7e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f00ac00d980 tx=0x7f00ac00dc90 comp rx=0 tx=0).stop 2023-12-01T01:05:21.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.479+0000 7f00b84fe700 1 -- 172.21.15.26:0/3052443196 shutdown_connections 2023-12-01T01:05:21.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.479+0000 7f00b84fe700 1 --2- 172.21.15.26:0/3052443196 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f009c0a05a0 0x7f009c0a2a60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.479+0000 7f00b84fe700 1 --2- 172.21.15.26:0/3052443196 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f00b0101810 0x7f00b0109360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.479+0000 7f00b84fe700 1 --2- 172.21.15.26:0/3052443196 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00b00ffc80 0x7f00b010a7e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.479+0000 7f00b84fe700 1 --2- 172.21.15.26:0/3052443196 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f00b0100e70 0x7f00b0108e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:21.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.479+0000 7f00b84fe700 1 -- 172.21.15.26:0/3052443196 >> 172.21.15.26:0/3052443196 conn(0x7f00b00fb1f0 msgr2=0x7f00b0104260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:21.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.479+0000 7f00b84fe700 1 -- 172.21.15.26:0/3052443196 shutdown_connections 2023-12-01T01:05:21.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:21.479+0000 7f00b84fe700 1 -- 172.21.15.26:0/3052443196 wait complete. 2023-12-01T01:05:22.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:21 smithi026 ceph-mon[98801]: pgmap v324: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:05:22.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:21 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2804244880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:05:22.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:21 smithi116 ceph-mon[103554]: pgmap v324: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:05:22.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:21 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2804244880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:05:22.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:21 smithi093 ceph-mon[103327]: pgmap v324: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:05:22.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:21 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2804244880' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:05:22.497 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-01T01:05:22.498 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-01T01:05:22.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.685+0000 7fda5d3d4700 1 -- 172.21.15.26:0/705533199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda58104170 msgr2=0x7fda58106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.685+0000 7fda5d3d4700 1 --2- 172.21.15.26:0/705533199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda58104170 0x7fda58106560 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009990 tx=0x7fda4c009ca0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.685+0000 7fda5d3d4700 1 -- 172.21.15.26:0/705533199 shutdown_connections 2023-12-01T01:05:22.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.685+0000 7fda5d3d4700 1 --2- 172.21.15.26:0/705533199 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda58106aa0 0x7fda58108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.685+0000 7fda5d3d4700 1 --2- 172.21.15.26:0/705533199 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda58101840 0x7fda58103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.685+0000 7fda5d3d4700 1 --2- 172.21.15.26:0/705533199 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda58104170 0x7fda58106560 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.685+0000 7fda5d3d4700 1 -- 172.21.15.26:0/705533199 >> 172.21.15.26:0/705533199 conn(0x7fda580fb1f0 msgr2=0x7fda580fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:22.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.686+0000 7fda5d3d4700 1 -- 172.21.15.26:0/705533199 shutdown_connections 2023-12-01T01:05:22.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.686+0000 7fda5d3d4700 1 -- 172.21.15.26:0/705533199 wait complete. 2023-12-01T01:05:22.687 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.686+0000 7fda5d3d4700 1 Processor -- start 2023-12-01T01:05:22.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.686+0000 7fda5d3d4700 1 -- start start 2023-12-01T01:05:22.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda5d3d4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda58101840 0x7fda581948f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda5d3d4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda58104170 0x7fda58194e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda5d3d4700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda58106aa0 0x7fda5819bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda5d3d4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5819c470 con 0x7fda58104170 2023-12-01T01:05:22.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda5d3d4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5819c5b0 con 0x7fda58101840 2023-12-01T01:05:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda5d3d4700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5819c740 con 0x7fda58106aa0 2023-12-01T01:05:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda56ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda58101840 0x7fda581948f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda577fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda58106aa0 0x7fda5819bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda56ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda58101840 0x7fda581948f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:46552/0 (socket says 172.21.15.26:46552) 2023-12-01T01:05:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda577fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda58106aa0 0x7fda5819bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.26:48046/0 (socket says 172.21.15.26:48046) 2023-12-01T01:05:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda56ffd700 1 -- 172.21.15.26:0/1226670552 learned_addr learned my addr 172.21.15.26:0/1226670552 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda567fc700 1 --2- 172.21.15.26:0/1226670552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda58104170 0x7fda58194e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda577fe700 1 -- 172.21.15.26:0/1226670552 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda58101840 msgr2=0x7fda581948f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda577fe700 1 --2- 172.21.15.26:0/1226670552 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda58101840 0x7fda581948f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda577fe700 1 -- 172.21.15.26:0/1226670552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda58104170 msgr2=0x7fda58194e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda577fe700 1 --2- 172.21.15.26:0/1226670552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda58104170 0x7fda58194e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.687+0000 7fda577fe700 1 -- 172.21.15.26:0/1226670552 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c0095f0 con 0x7fda58106aa0 2023-12-01T01:05:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.688+0000 7fda577fe700 1 --2- 172.21.15.26:0/1226670552 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda58106aa0 0x7fda5819bea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda5000efc0 tx=0x7fda5000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.688+0000 7fda3ffff700 1 -- 172.21.15.26:0/1226670552 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50018070 con 0x7fda58106aa0 2023-12-01T01:05:22.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.688+0000 7fda5d3d4700 1 -- 172.21.15.26:0/1226670552 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5819c9c0 con 0x7fda58106aa0 2023-12-01T01:05:22.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.688+0000 7fda3ffff700 1 -- 172.21.15.26:0/1226670552 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fda5000f040 con 0x7fda58106aa0 2023-12-01T01:05:22.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.688+0000 7fda3ffff700 1 -- 172.21.15.26:0/1226670552 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5000cd10 con 0x7fda58106aa0 2023-12-01T01:05:22.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.688+0000 7fda5d3d4700 1 -- 172.21.15.26:0/1226670552 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5819ced0 con 0x7fda58106aa0 2023-12-01T01:05:22.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.691+0000 7fda3ffff700 1 -- 172.21.15.26:0/1226670552 <== mon.1 v2:172.21.15.116:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fda50003a00 con 0x7fda58106aa0 2023-12-01T01:05:22.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.692+0000 7fda3ffff700 1 --2- 172.21.15.26:0/1226670552 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fda400a05a0 0x7fda400a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.692+0000 7fda3ffff700 1 -- 172.21.15.26:0/1226670552 <== mon.1 v2:172.21.15.116:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fda500cb3e0 con 0x7fda58106aa0 2023-12-01T01:05:22.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.693+0000 7fda69564b80 1 Processor -- start 2023-12-01T01:05:22.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.693+0000 7fda69564b80 1 -- start start 2023-12-01T01:05:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.693+0000 7fda69564b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9f170 0x562f47a9f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.693+0000 7fda69564b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f47a9faf0 0x562f47a9dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.693+0000 7fda69564b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9e470 0x562f47a9e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.693+0000 7fda69564b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f479f5a90 con 0x562f47a9e470 2023-12-01T01:05:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.693+0000 7fda69564b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f479f3450 con 0x562f47a9f170 2023-12-01T01:05:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.693+0000 7fda69564b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f479eed40 con 0x562f47a9faf0 2023-12-01T01:05:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.693+0000 7fda56ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9f170 0x562f47a9f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.693+0000 7fda56ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9f170 0x562f47a9f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:46560/0 (socket says 172.21.15.26:46560) 2023-12-01T01:05:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.693+0000 7fda577fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9e470 0x562f47a9e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.693+0000 7fda56ffd700 1 -- 172.21.15.26:0/1087801308 learned_addr learned my addr 172.21.15.26:0/1087801308 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.694+0000 7fda567fc700 1 --2- 172.21.15.26:0/1087801308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f47a9faf0 0x562f47a9dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.694+0000 7fda56ffd700 1 -- 172.21.15.26:0/1087801308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f47a9faf0 msgr2=0x562f47a9dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:22.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.694+0000 7fda56ffd700 1 --2- 172.21.15.26:0/1087801308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f47a9faf0 0x562f47a9dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.694+0000 7fda56ffd700 1 -- 172.21.15.26:0/1087801308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9e470 msgr2=0x562f47a9e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:22.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.694+0000 7fda56ffd700 1 --2- 172.21.15.26:0/1087801308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9e470 0x562f47a9e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.694+0000 7fda56ffd700 1 -- 172.21.15.26:0/1087801308 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f4781ce60 con 0x562f47a9f170 2023-12-01T01:05:22.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.694+0000 7fda577fe700 1 --2- 172.21.15.26:0/1087801308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9e470 0x562f47a9e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:22.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.694+0000 7fda56ffd700 1 --2- 172.21.15.26:0/1226670552 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fda400a05a0 0x7fda400a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.696 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.694+0000 7fda56ffd700 1 --2- 172.21.15.26:0/1087801308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9f170 0x562f47a9f5b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fda48007ee0 tx=0x7fda480126d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bfb1de696e64551 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:22.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.694+0000 7fda3d7fa700 1 -- 172.21.15.26:0/1087801308 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48021030 con 0x562f47a9f170 2023-12-01T01:05:22.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.694+0000 7fda56ffd700 1 --2- 172.21.15.26:0/1226670552 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fda400a05a0 0x7fda400a2a60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fda48021000 tx=0x7fda4801e000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:22.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.694+0000 7fda3d7fa700 1 -- 172.21.15.26:0/1087801308 <== mon.2 v2:172.21.15.93:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fda48010d30 con 0x562f47a9f170 2023-12-01T01:05:22.697 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.694+0000 7fda3d7fa700 1 -- 172.21.15.26:0/1087801308 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4801b640 con 0x562f47a9f170 2023-12-01T01:05:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.695+0000 7fda69564b80 1 -- 172.21.15.26:0/1087801308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9f170 msgr2=0x562f47a9f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.695+0000 7fda69564b80 1 --2- 172.21.15.26:0/1087801308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9f170 0x562f47a9f5b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fda48007ee0 tx=0x7fda480126d0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.695+0000 7fda69564b80 1 -- 172.21.15.26:0/1087801308 shutdown_connections 2023-12-01T01:05:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.695+0000 7fda69564b80 1 --2- 172.21.15.26:0/1087801308 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9e470 0x562f47a9e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.695+0000 7fda69564b80 1 --2- 172.21.15.26:0/1087801308 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9f170 0x562f47a9f5b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.695+0000 7fda69564b80 1 --2- 172.21.15.26:0/1087801308 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f47a9faf0 0x562f47a9dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.695+0000 7fda69564b80 1 -- 172.21.15.26:0/1087801308 >> 172.21.15.26:0/1087801308 conn(0x562f479fd150 msgr2=0x562f47a989c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.696+0000 7fda69564b80 1 -- 172.21.15.26:0/1087801308 shutdown_connections 2023-12-01T01:05:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.696+0000 7fda69564b80 1 -- 172.21.15.26:0/1087801308 wait complete. 2023-12-01T01:05:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.696+0000 7fda69564b80 1 -- start start 2023-12-01T01:05:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.696+0000 7fda69564b80 1 Processor -- start 2023-12-01T01:05:22.698 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.696+0000 7fda69564b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f47a9e470 0x562f47aa7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.696+0000 7fda69564b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9f170 0x562f47aa7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.696+0000 7fda69564b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9faf0 0x562f47aaf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.696+0000 7fda69564b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f4798b590 con 0x562f47a9f170 2023-12-01T01:05:22.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.696+0000 7fda69564b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f4798b230 con 0x562f47a9faf0 2023-12-01T01:05:22.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.696+0000 7fda69564b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f478729a0 con 0x562f47a9e470 2023-12-01T01:05:22.700 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.696+0000 7fda69564b80 10 client.0 _ll_register_callbacks cb 0x562f478d8b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.697+0000 7fda567fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9f170 0x562f47aa7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.697+0000 7fda567fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9f170 0x562f47aa7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55830/0 (socket says 172.21.15.26:55830) 2023-12-01T01:05:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.697+0000 7fda567fc700 1 -- 172.21.15.26:0/653496319 learned_addr learned my addr 172.21.15.26:0/653496319 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.697+0000 7fda56ffd700 1 --2- 172.21.15.26:0/653496319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f47a9e470 0x562f47aa7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.697+0000 7fda577fe700 1 --2- 172.21.15.26:0/653496319 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9faf0 0x562f47aaf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.697+0000 7fda567fc700 1 -- 172.21.15.26:0/653496319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f47a9e470 msgr2=0x562f47aa7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.697+0000 7fda567fc700 1 --2- 172.21.15.26:0/653496319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f47a9e470 0x562f47aa7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.697+0000 7fda567fc700 1 -- 172.21.15.26:0/653496319 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9faf0 msgr2=0x562f47aaf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.697+0000 7fda567fc700 1 --2- 172.21.15.26:0/653496319 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9faf0 0x562f47aaf030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.697+0000 7fda567fc700 1 -- 172.21.15.26:0/653496319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5819ced0 con 0x562f47a9f170 2023-12-01T01:05:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.697+0000 7fda567fc700 1 --2- 172.21.15.26:0/653496319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9f170 0x562f47aa7ff0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fda4c01a040 tx=0x7fda4c0094b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c60176d5fc53381 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.697+0000 7fda3aff5700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.698+0000 7fda3aff5700 1 -- 172.21.15.26:0/653496319 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c005a00 con 0x562f47a9f170 2023-12-01T01:05:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.698+0000 7fda3aff5700 1 -- 172.21.15.26:0/653496319 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fda4c0052c0 con 0x562f47a9f170 2023-12-01T01:05:22.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.698+0000 7fda69564b80 1 -- 172.21.15.26:0/653496319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f47a19d90 con 0x562f47a9f170 2023-12-01T01:05:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.698+0000 7fda3aff5700 1 -- 172.21.15.26:0/653496319 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda4c005480 con 0x562f47a9f170 2023-12-01T01:05:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.698+0000 7fda69564b80 10 client.15660 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.698+0000 7fda69564b80 1 -- 172.21.15.26:0/653496319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7fda48007b40 con 0x562f47a9f170 2023-12-01T01:05:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.698+0000 7fda3aff5700 1 -- 172.21.15.26:0/653496319 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x562f47a19d90 con 0x562f47a9f170 2023-12-01T01:05:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.698+0000 7fda3aff5700 1 -- 172.21.15.26:0/653496319 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fda4c036070 con 0x562f47a9f170 2023-12-01T01:05:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.698+0000 7fda69564b80 10 client.15660 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.698+0000 7fda69564b80 10 client.15660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.698+0000 7fda69564b80 20 client.15660 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.699+0000 7fda69564b80 1 --2- 172.21.15.26:0/653496319 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x562f47ab3800 0x562f47ab5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.699+0000 7fda69564b80 4 client.15660 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:05:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.699+0000 7fda69564b80 1 -- 172.21.15.26:0/653496319 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f47a6ce90 con 0x562f47ab3800 2023-12-01T01:05:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.699+0000 7fda56ffd700 1 --2- 172.21.15.26:0/653496319 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x562f47ab3800 0x562f47ab5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.699+0000 7fda3aff5700 10 client.15660 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:22.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.699+0000 7fda56ffd700 1 --2- 172.21.15.26:0/653496319 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x562f47ab3800 0x562f47ab5c20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=add40b55c11e1c3 server_cookie=5602c3d64704be54 in_seq=0 out_seq=0 2023-12-01T01:05:22.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.700+0000 7fda3aff5700 1 -- 172.21.15.26:0/653496319 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x562f47a6ce90 con 0x562f47ab3800 2023-12-01T01:05:22.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.700+0000 7fda3aff5700 10 client.15660 handle_command_reply: tid=0 2023-12-01T01:05:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.700+0000 7fda69564b80 1 client.15660 shutdown 2023-12-01T01:05:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.700+0000 7fda69564b80 1 -- 172.21.15.26:0/653496319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9f170 msgr2=0x562f47aa7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.700+0000 7fda69564b80 1 --2- 172.21.15.26:0/653496319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9f170 0x562f47aa7ff0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fda4c01a040 tx=0x7fda4c0094b0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.700+0000 7fda69564b80 1 -- 172.21.15.26:0/653496319 shutdown_connections 2023-12-01T01:05:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.700+0000 7fda69564b80 1 --2- 172.21.15.26:0/653496319 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x562f47ab3800 0x562f47ab5c20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.700+0000 7fda69564b80 1 --2- 172.21.15.26:0/653496319 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9faf0 0x562f47aaf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.700+0000 7fda69564b80 1 --2- 172.21.15.26:0/653496319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f47a9e470 0x562f47aa7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.700+0000 7fda69564b80 1 --2- 172.21.15.26:0/653496319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9f170 0x562f47aa7ff0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.700+0000 7fda69564b80 1 -- 172.21.15.26:0/653496319 >> 172.21.15.26:0/653496319 conn(0x562f479fd150 msgr2=0x562f47a98130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.700+0000 7fda3aff5700 0 client.15660 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.700+0000 7fda69564b80 1 -- 172.21.15.26:0/653496319 shutdown_connections 2023-12-01T01:05:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.700+0000 7fda69564b80 1 -- 172.21.15.26:0/653496319 wait complete. 2023-12-01T01:05:22.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.701+0000 7fda69564b80 20 client.15660 trim_cache size 0 max 16384 2023-12-01T01:05:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.734+0000 7fda69564b80 1 Processor -- start 2023-12-01T01:05:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.734+0000 7fda69564b80 1 -- start start 2023-12-01T01:05:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.734+0000 7fda69564b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f479fd150 0x562f47aacfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.734+0000 7fda69564b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9e470 0x562f47aa7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.734+0000 7fda69564b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9f170 0x562f47a9ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.734+0000 7fda69564b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f47aa8ca0 con 0x562f47a9e470 2023-12-01T01:05:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.734+0000 7fda69564b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f47a9a4f0 con 0x562f47a9f170 2023-12-01T01:05:22.735 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.734+0000 7fda69564b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f47a997d0 con 0x562f479fd150 2023-12-01T01:05:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.734+0000 7fda567fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9e470 0x562f47aa7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.734+0000 7fda567fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9e470 0x562f47aa7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55838/0 (socket says 172.21.15.26:55838) 2023-12-01T01:05:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.734+0000 7fda567fc700 1 -- 172.21.15.26:0/1821912297 learned_addr learned my addr 172.21.15.26:0/1821912297 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.734+0000 7fda577fe700 1 --2- 172.21.15.26:0/1821912297 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9f170 0x562f47a9ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.734+0000 7fda56ffd700 1 --2- 172.21.15.26:0/1821912297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f479fd150 0x562f47aacfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.735+0000 7fda567fc700 1 -- 172.21.15.26:0/1821912297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f479fd150 msgr2=0x562f47aacfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:22.737 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.735+0000 7fda567fc700 1 --2- 172.21.15.26:0/1821912297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f479fd150 0x562f47aacfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.735+0000 7fda567fc700 1 -- 172.21.15.26:0/1821912297 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9f170 msgr2=0x562f47a9ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.735+0000 7fda567fc700 1 --2- 172.21.15.26:0/1821912297 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9f170 0x562f47a9ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.735+0000 7fda567fc700 1 -- 172.21.15.26:0/1821912297 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f47805ce0 con 0x562f47a9e470 2023-12-01T01:05:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.735+0000 7fda567fc700 1 --2- 172.21.15.26:0/1821912297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9e470 0x562f47aa7f70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0098e0 tx=0x7fda4c024700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91de399ce1ba5f8d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.735+0000 7fda3dffb700 1 -- 172.21.15.26:0/1821912297 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c024850 con 0x562f47a9e470 2023-12-01T01:05:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.735+0000 7fda3dffb700 1 -- 172.21.15.26:0/1821912297 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fda4c033070 con 0x562f47a9e470 2023-12-01T01:05:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.735+0000 7fda3dffb700 1 -- 172.21.15.26:0/1821912297 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c00b4f0 con 0x562f47a9e470 2023-12-01T01:05:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.736+0000 7fda69564b80 1 -- 172.21.15.26:0/1821912297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9e470 msgr2=0x562f47aa7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.736+0000 7fda69564b80 1 --2- 172.21.15.26:0/1821912297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9e470 0x562f47aa7f70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0098e0 tx=0x7fda4c024700 comp rx=0 tx=0).stop 2023-12-01T01:05:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.736+0000 7fda69564b80 1 -- 172.21.15.26:0/1821912297 shutdown_connections 2023-12-01T01:05:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.736+0000 7fda69564b80 1 --2- 172.21.15.26:0/1821912297 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9f170 0x562f47a9ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.736+0000 7fda69564b80 1 --2- 172.21.15.26:0/1821912297 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f479fd150 0x562f47aacfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.736+0000 7fda69564b80 1 --2- 172.21.15.26:0/1821912297 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9e470 0x562f47aa7f70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.736+0000 7fda69564b80 1 -- 172.21.15.26:0/1821912297 >> 172.21.15.26:0/1821912297 conn(0x562f47a98cf0 msgr2=0x562f47aa7860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:22.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.736+0000 7fda69564b80 1 -- 172.21.15.26:0/1821912297 shutdown_connections 2023-12-01T01:05:22.739 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.736+0000 7fda69564b80 1 -- 172.21.15.26:0/1821912297 wait complete. 2023-12-01T01:05:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.737+0000 7fda69564b80 1 -- start start 2023-12-01T01:05:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.737+0000 7fda69564b80 1 Processor -- start 2023-12-01T01:05:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.737+0000 7fda69564b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f479fd150 0x562f47aac740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.737+0000 7fda69564b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9f170 0x562f47aacc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.737+0000 7fda69564b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9faf0 0x562f47b05a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.737+0000 7fda69564b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f47b05f90 con 0x562f47a9faf0 2023-12-01T01:05:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.737+0000 7fda69564b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f47b06100 con 0x562f47a9f170 2023-12-01T01:05:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.737+0000 7fda69564b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f47b062c0 con 0x562f479fd150 2023-12-01T01:05:22.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.737+0000 7fda69564b80 10 client.0 _ll_register_callbacks cb 0x7fda4c003e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.737+0000 7fda56ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f479fd150 0x562f47aac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.737+0000 7fda56ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f479fd150 0x562f47aac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.26:48072/0 (socket says 172.21.15.26:48072) 2023-12-01T01:05:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.737+0000 7fda56ffd700 1 -- 172.21.15.26:0/3740429575 learned_addr learned my addr 172.21.15.26:0/3740429575 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.737+0000 7fda577fe700 1 --2- 172.21.15.26:0/3740429575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9faf0 0x562f47b05a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.738+0000 7fda577fe700 1 -- 172.21.15.26:0/3740429575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f479fd150 msgr2=0x562f47aac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.738+0000 7fda577fe700 1 --2- 172.21.15.26:0/3740429575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f479fd150 0x562f47aac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.738+0000 7fda577fe700 1 -- 172.21.15.26:0/3740429575 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9f170 msgr2=0x562f47aacc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.738+0000 7fda577fe700 1 --2- 172.21.15.26:0/3740429575 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9f170 0x562f47aacc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.738+0000 7fda577fe700 1 -- 172.21.15.26:0/3740429575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda48007b40 con 0x562f47a9faf0 2023-12-01T01:05:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.738+0000 7fda56ffd700 1 --2- 172.21.15.26:0/3740429575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f479fd150 0x562f47aac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.738+0000 7fda577fe700 1 --2- 172.21.15.26:0/3740429575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9faf0 0x562f47b05a50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fda5000ef90 tx=0x7fda5001b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b08f9dd087606eb server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.738+0000 7fda3aff5700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.738+0000 7fda3aff5700 1 -- 172.21.15.26:0/3740429575 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5009cab0 con 0x562f47a9faf0 2023-12-01T01:05:22.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.738+0000 7fda3aff5700 1 -- 172.21.15.26:0/3740429575 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fda500a0c60 con 0x562f47a9faf0 2023-12-01T01:05:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.738+0000 7fda69564b80 1 -- 172.21.15.26:0/3740429575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda48010d30 con 0x562f47a9faf0 2023-12-01T01:05:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.738+0000 7fda3aff5700 1 -- 172.21.15.26:0/3740429575 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda500092e0 con 0x562f47a9faf0 2023-12-01T01:05:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.738+0000 7fda69564b80 10 client.15666 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.738+0000 7fda69564b80 1 -- 172.21.15.26:0/3740429575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x562f478432d0 con 0x562f47a9faf0 2023-12-01T01:05:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.739+0000 7fda3aff5700 1 -- 172.21.15.26:0/3740429575 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fda48010d30 con 0x562f47a9faf0 2023-12-01T01:05:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.739+0000 7fda3aff5700 1 -- 172.21.15.26:0/3740429575 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fda50098170 con 0x562f47a9faf0 2023-12-01T01:05:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.739+0000 7fda69564b80 10 client.15666 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.739+0000 7fda69564b80 10 client.15666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.739+0000 7fda69564b80 20 client.15666 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.739+0000 7fda69564b80 1 --2- 172.21.15.26:0/3740429575 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x562f47b07d20 0x562f47b0a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.739+0000 7fda69564b80 4 client.15666 mds_command: new command op to 24509 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-01T01:05:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.739+0000 7fda69564b80 1 -- 172.21.15.26:0/3740429575 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x562f479e7dc0 con 0x562f47b07d20 2023-12-01T01:05:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.739+0000 7fda56ffd700 1 --2- 172.21.15.26:0/3740429575 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x562f47b07d20 0x562f47b0a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.740+0000 7fda3aff5700 10 client.15666 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:22.743 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.740+0000 7fda56ffd700 1 --2- 172.21.15.26:0/3740429575 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x562f47b07d20 0x562f47b0a140 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eeca52368eb44e9 server_cookie=b4ae777b819582b9 in_seq=0 out_seq=0 2023-12-01T01:05:22.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.741+0000 7fda3aff5700 1 -- 172.21.15.26:0/3740429575 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562f479e7dc0 con 0x562f47b07d20 2023-12-01T01:05:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.741+0000 7fda3aff5700 10 client.15666 handle_command_reply: tid=0 2023-12-01T01:05:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.741+0000 7fda69564b80 1 client.15666 shutdown 2023-12-01T01:05:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.741+0000 7fda69564b80 1 -- 172.21.15.26:0/3740429575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9faf0 msgr2=0x562f47b05a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.741+0000 7fda69564b80 1 --2- 172.21.15.26:0/3740429575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9faf0 0x562f47b05a50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fda5000ef90 tx=0x7fda5001b460 comp rx=0 tx=0).stop 2023-12-01T01:05:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.741+0000 7fda69564b80 1 -- 172.21.15.26:0/3740429575 shutdown_connections 2023-12-01T01:05:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.741+0000 7fda69564b80 1 --2- 172.21.15.26:0/3740429575 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x562f47b07d20 0x562f47b0a140 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.741+0000 7fda69564b80 1 --2- 172.21.15.26:0/3740429575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562f47a9faf0 0x562f47b05a50 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.741+0000 7fda69564b80 1 --2- 172.21.15.26:0/3740429575 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562f479fd150 0x562f47aac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.741+0000 7fda69564b80 1 --2- 172.21.15.26:0/3740429575 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562f47a9f170 0x562f47aacc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.741+0000 7fda69564b80 1 -- 172.21.15.26:0/3740429575 >> 172.21.15.26:0/3740429575 conn(0x562f47a98cf0 msgr2=0x562f47a978a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.741+0000 7fda3aff5700 0 client.15666 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.741+0000 7fda69564b80 1 -- 172.21.15.26:0/3740429575 shutdown_connections 2023-12-01T01:05:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.741+0000 7fda69564b80 1 -- 172.21.15.26:0/3740429575 wait complete. 2023-12-01T01:05:22.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.742+0000 7fda69564b80 20 client.15666 trim_cache size 0 max 16384 2023-12-01T01:05:22.746 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:05:22.746 INFO:teuthology.orchestra.run.smithi026.stdout: "return_code": 0, 2023-12-01T01:05:22.746 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_tag": "30911803-7120-4068-92b9-0f4665fd12b1", 2023-12-01T01:05:22.746 INFO:teuthology.orchestra.run.smithi026.stdout: "mode": "asynchronous" 2023-12-01T01:05:22.746 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:05:22.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.742+0000 7fda5d3d4700 1 -- 172.21.15.26:0/1226670552 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fda400a05a0 msgr2=0x7fda400a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.742+0000 7fda5d3d4700 1 --2- 172.21.15.26:0/1226670552 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fda400a05a0 0x7fda400a2a60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fda48021000 tx=0x7fda4801e000 comp rx=0 tx=0).stop 2023-12-01T01:05:22.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.742+0000 7fda5d3d4700 1 -- 172.21.15.26:0/1226670552 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda58106aa0 msgr2=0x7fda5819bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.742+0000 7fda5d3d4700 1 --2- 172.21.15.26:0/1226670552 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda58106aa0 0x7fda5819bea0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fda5000efc0 tx=0x7fda5000c3a0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.743+0000 7fda5d3d4700 1 -- 172.21.15.26:0/1226670552 shutdown_connections 2023-12-01T01:05:22.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.743+0000 7fda5d3d4700 1 --2- 172.21.15.26:0/1226670552 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fda400a05a0 0x7fda400a2a60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.743+0000 7fda5d3d4700 1 --2- 172.21.15.26:0/1226670552 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fda58106aa0 0x7fda5819bea0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.747 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.743+0000 7fda5d3d4700 1 --2- 172.21.15.26:0/1226670552 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fda58101840 0x7fda581948f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.743+0000 7fda5d3d4700 1 --2- 172.21.15.26:0/1226670552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda58104170 0x7fda58194e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.743+0000 7fda5d3d4700 1 -- 172.21.15.26:0/1226670552 >> 172.21.15.26:0/1226670552 conn(0x7fda580fb1f0 msgr2=0x7fda58102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:22.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.743+0000 7fda5d3d4700 1 -- 172.21.15.26:0/1226670552 shutdown_connections 2023-12-01T01:05:22.748 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.743+0000 7fda5d3d4700 1 -- 172.21.15.26:0/1226670552 wait complete. 2023-12-01T01:05:22.760 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-01T01:05:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.903+0000 7f3d994db700 1 -- 172.21.15.26:0/2080001399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d941041d0 msgr2=0x7f3d941065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.903+0000 7f3d994db700 1 --2- 172.21.15.26:0/2080001399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d941041d0 0x7f3d941065c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009990 tx=0x7f3d88009ca0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.904 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.903+0000 7f3d994db700 1 -- 172.21.15.26:0/2080001399 shutdown_connections 2023-12-01T01:05:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.903+0000 7f3d994db700 1 --2- 172.21.15.26:0/2080001399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d94106b00 0x7f3d94108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.903+0000 7f3d994db700 1 --2- 172.21.15.26:0/2080001399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d941018a0 0x7f3d94103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.903+0000 7f3d994db700 1 --2- 172.21.15.26:0/2080001399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d941041d0 0x7f3d941065c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.903+0000 7f3d994db700 1 -- 172.21.15.26:0/2080001399 >> 172.21.15.26:0/2080001399 conn(0x7f3d940fb210 msgr2=0x7f3d940fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.903+0000 7f3d994db700 1 -- 172.21.15.26:0/2080001399 shutdown_connections 2023-12-01T01:05:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.903+0000 7f3d994db700 1 -- 172.21.15.26:0/2080001399 wait complete. 2023-12-01T01:05:22.905 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.904+0000 7f3d994db700 1 Processor -- start 2023-12-01T01:05:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.904+0000 7f3d994db700 1 -- start start 2023-12-01T01:05:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.904+0000 7f3d994db700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d941018a0 0x7f3d94196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.904+0000 7f3d994db700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d941041d0 0x7f3d94197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.904+0000 7f3d994db700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d94106b00 0x7f3d9419e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.904+0000 7f3d994db700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9419e680 con 0x7f3d941041d0 2023-12-01T01:05:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.904+0000 7f3d994db700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9419e7c0 con 0x7f3d941018a0 2023-12-01T01:05:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.904+0000 7f3d994db700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9419e950 con 0x7f3d94106b00 2023-12-01T01:05:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.904+0000 7f3d927fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d941041d0 0x7f3d94197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.904+0000 7f3d927fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d941041d0 0x7f3d94197040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55856/0 (socket says 172.21.15.26:55856) 2023-12-01T01:05:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.904+0000 7f3d927fc700 1 -- 172.21.15.26:0/1983061633 learned_addr learned my addr 172.21.15.26:0/1983061633 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.904+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/1983061633 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d941018a0 0x7f3d94196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.907 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.904+0000 7f3d937fe700 1 --2- 172.21.15.26:0/1983061633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d94106b00 0x7f3d9419e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.905+0000 7f3d927fc700 1 -- 172.21.15.26:0/1983061633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d94106b00 msgr2=0x7f3d9419e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.905+0000 7f3d927fc700 1 --2- 172.21.15.26:0/1983061633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d94106b00 0x7f3d9419e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.905+0000 7f3d927fc700 1 -- 172.21.15.26:0/1983061633 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d941018a0 msgr2=0x7f3d94196b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.905+0000 7f3d927fc700 1 --2- 172.21.15.26:0/1983061633 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d941018a0 0x7f3d94196b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.905+0000 7f3d927fc700 1 -- 172.21.15.26:0/1983061633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d880095f0 con 0x7f3d941041d0 2023-12-01T01:05:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.905+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/1983061633 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d941018a0 0x7f3d94196b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.905+0000 7f3d927fc700 1 --2- 172.21.15.26:0/1983061633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d941041d0 0x7f3d94197040 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3d880059d0 tx=0x7f3d8800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.905+0000 7f3d7bfff700 1 -- 172.21.15.26:0/1983061633 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8801d070 con 0x7f3d941041d0 2023-12-01T01:05:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.905+0000 7f3d994db700 1 -- 172.21.15.26:0/1983061633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d9419ebd0 con 0x7f3d941041d0 2023-12-01T01:05:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.905+0000 7f3d7bfff700 1 -- 172.21.15.26:0/1983061633 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3d8800fe20 con 0x7f3d941041d0 2023-12-01T01:05:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.905+0000 7f3d7bfff700 1 -- 172.21.15.26:0/1983061633 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88017650 con 0x7f3d941041d0 2023-12-01T01:05:22.908 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.905+0000 7f3d994db700 1 -- 172.21.15.26:0/1983061633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9419f050 con 0x7f3d941041d0 2023-12-01T01:05:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.908+0000 7f3d7bfff700 1 -- 172.21.15.26:0/1983061633 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f3d88022470 con 0x7f3d941041d0 2023-12-01T01:05:22.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.909+0000 7f3d7bfff700 1 --2- 172.21.15.26:0/1983061633 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3d7c0a0520 0x7f3d7c0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.909+0000 7f3d7bfff700 1 -- 172.21.15.26:0/1983061633 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3d880cd000 con 0x7f3d941041d0 2023-12-01T01:05:22.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.909+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/1983061633 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3d7c0a0520 0x7f3d7c0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.910 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.909+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/1983061633 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3d7c0a0520 0x7f3d7c0a29e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3d84011490 tx=0x7f3d84009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.910+0000 7f3da566bb80 1 Processor -- start 2023-12-01T01:05:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.910+0000 7f3da566bb80 1 -- start start 2023-12-01T01:05:22.912 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.910+0000 7f3da566bb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 0x55f5206a9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.910+0000 7f3da566bb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a9a70 0x55f5206a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.910+0000 7f3da566bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a83f0 0x55f5206a8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.910+0000 7f3da566bb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5205ffa10 con 0x55f5206a90f0 2023-12-01T01:05:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.910+0000 7f3da566bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5205fd3d0 con 0x55f5206a83f0 2023-12-01T01:05:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.910+0000 7f3da566bb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5205f8cc0 con 0x55f5206a9a70 2023-12-01T01:05:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.910+0000 7f3d92ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 0x55f5206a9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.910+0000 7f3d92ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 0x55f5206a9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55862/0 (socket says 172.21.15.26:55862) 2023-12-01T01:05:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.910+0000 7f3d92ffd700 1 -- 172.21.15.26:0/3972368295 learned_addr learned my addr 172.21.15.26:0/3972368295 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.911+0000 7f3d937fe700 1 --2- 172.21.15.26:0/3972368295 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a83f0 0x55f5206a8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.911+0000 7f3d927fc700 1 --2- 172.21.15.26:0/3972368295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a9a70 0x55f5206a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.911+0000 7f3d92ffd700 1 -- 172.21.15.26:0/3972368295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a9a70 msgr2=0x55f5206a7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.911+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/3972368295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a9a70 0x55f5206a7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.911+0000 7f3d92ffd700 1 -- 172.21.15.26:0/3972368295 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a83f0 msgr2=0x55f5206a8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.911+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/3972368295 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a83f0 0x55f5206a8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.911+0000 7f3d92ffd700 1 -- 172.21.15.26:0/3972368295 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f520426de0 con 0x55f5206a90f0 2023-12-01T01:05:22.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.911+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/3972368295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 0x55f5206a9530 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3d840043c0 tx=0x7f3d84014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39fd649fedbdb508 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:22.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.911+0000 7f3d797fa700 1 -- 172.21.15.26:0/3972368295 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d84003dc0 con 0x55f5206a90f0 2023-12-01T01:05:22.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.911+0000 7f3d797fa700 1 -- 172.21.15.26:0/3972368295 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3d8401e8d0 con 0x55f5206a90f0 2023-12-01T01:05:22.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.911+0000 7f3d797fa700 1 -- 172.21.15.26:0/3972368295 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8400e910 con 0x55f5206a90f0 2023-12-01T01:05:22.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.912+0000 7f3da566bb80 1 -- 172.21.15.26:0/3972368295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 msgr2=0x55f5206a9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.912+0000 7f3da566bb80 1 --2- 172.21.15.26:0/3972368295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 0x55f5206a9530 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3d840043c0 tx=0x7f3d84014000 comp rx=0 tx=0).stop 2023-12-01T01:05:22.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.912+0000 7f3da566bb80 1 -- 172.21.15.26:0/3972368295 shutdown_connections 2023-12-01T01:05:22.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.912+0000 7f3da566bb80 1 --2- 172.21.15.26:0/3972368295 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a83f0 0x55f5206a8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.912+0000 7f3da566bb80 1 --2- 172.21.15.26:0/3972368295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 0x55f5206a9530 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.912+0000 7f3da566bb80 1 --2- 172.21.15.26:0/3972368295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a9a70 0x55f5206a7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.912+0000 7f3da566bb80 1 -- 172.21.15.26:0/3972368295 >> 172.21.15.26:0/3972368295 conn(0x55f5206070d0 msgr2=0x55f5206a2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:22.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.912+0000 7f3da566bb80 1 -- 172.21.15.26:0/3972368295 shutdown_connections 2023-12-01T01:05:22.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.912+0000 7f3da566bb80 1 -- 172.21.15.26:0/3972368295 wait complete. 2023-12-01T01:05:22.918 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.913+0000 7f3da566bb80 1 -- start start 2023-12-01T01:05:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.913+0000 7f3da566bb80 1 Processor -- start 2023-12-01T01:05:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.913+0000 7f3da566bb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a83f0 0x55f5206b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.913+0000 7f3da566bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a90f0 0x55f5206b6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.913+0000 7f3da566bb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a9a70 0x55f5206bd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.913+0000 7f3da566bb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f520595510 con 0x55f5206a9a70 2023-12-01T01:05:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.913+0000 7f3da566bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5205951b0 con 0x55f5206a90f0 2023-12-01T01:05:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.913+0000 7f3da566bb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52047c920 con 0x55f5206a83f0 2023-12-01T01:05:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.913+0000 7f3da566bb80 10 client.0 _ll_register_callbacks cb 0x55f5204e2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.913+0000 7f3d937fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a9a70 0x55f5206bd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.913+0000 7f3d937fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a9a70 0x55f5206bd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55870/0 (socket says 172.21.15.26:55870) 2023-12-01T01:05:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.913+0000 7f3d937fe700 1 -- 172.21.15.26:0/2381884186 learned_addr learned my addr 172.21.15.26:0/2381884186 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.913+0000 7f3d927fc700 1 --2- 172.21.15.26:0/2381884186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a90f0 0x55f5206b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.913+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/2381884186 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a83f0 0x55f5206b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.914+0000 7f3d937fe700 1 -- 172.21.15.26:0/2381884186 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a83f0 msgr2=0x55f5206b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:22.919 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.914+0000 7f3d937fe700 1 --2- 172.21.15.26:0/2381884186 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a83f0 0x55f5206b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.914+0000 7f3d937fe700 1 -- 172.21.15.26:0/2381884186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a90f0 msgr2=0x55f5206b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:22.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.914+0000 7f3d937fe700 1 --2- 172.21.15.26:0/2381884186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a90f0 0x55f5206b6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.914+0000 7f3d937fe700 1 -- 172.21.15.26:0/2381884186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d84017070 con 0x55f5206a9a70 2023-12-01T01:05:22.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.914+0000 7f3d937fe700 1 --2- 172.21.15.26:0/2381884186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a9a70 0x55f5206bd380 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c007bf0 tx=0x7f3d8c007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b0eac7214d4e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:22.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.914+0000 7f3d76ff5700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:22.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.914+0000 7f3d76ff5700 1 -- 172.21.15.26:0/2381884186 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c00e070 con 0x55f5206a9a70 2023-12-01T01:05:22.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.914+0000 7f3d76ff5700 1 -- 172.21.15.26:0/2381884186 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3d8c012aa0 con 0x55f5206a9a70 2023-12-01T01:05:22.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.914+0000 7f3da566bb80 1 -- 172.21.15.26:0/2381884186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f520623d10 con 0x55f5206a9a70 2023-12-01T01:05:22.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.914+0000 7f3d76ff5700 1 -- 172.21.15.26:0/2381884186 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d8c0090b0 con 0x55f5206a9a70 2023-12-01T01:05:22.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.914+0000 7f3da566bb80 10 client.15678 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:22.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.914+0000 7f3da566bb80 1 -- 172.21.15.26:0/2381884186 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55f52040fc60 con 0x55f5206a9a70 2023-12-01T01:05:22.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.915+0000 7f3d76ff5700 1 -- 172.21.15.26:0/2381884186 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55f520623d10 con 0x55f5206a9a70 2023-12-01T01:05:22.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.915+0000 7f3d76ff5700 1 -- 172.21.15.26:0/2381884186 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f3d8c014040 con 0x55f5206a9a70 2023-12-01T01:05:22.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.915+0000 7f3da566bb80 10 client.15678 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:22.920 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.915+0000 7f3da566bb80 10 client.15678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:22.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.915+0000 7f3da566bb80 20 client.15678 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:22.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.915+0000 7f3da566bb80 1 --2- 172.21.15.26:0/2381884186 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f5206c1cb0 0x55f5206c40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.915+0000 7f3da566bb80 4 client.15678 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:05:22.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.915+0000 7f3da566bb80 1 -- 172.21.15.26:0/2381884186 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f520676e10 con 0x55f5206c1cb0 2023-12-01T01:05:22.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.915+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/2381884186 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f5206c1cb0 0x55f5206c40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.916+0000 7f3d76ff5700 10 client.15678 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:22.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.916+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/2381884186 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f5206c1cb0 0x55f5206c40d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2d31620d55a5f39 server_cookie=64d7941c771d156c in_seq=0 out_seq=0 2023-12-01T01:05:22.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.916+0000 7f3d76ff5700 1 -- 172.21.15.26:0/2381884186 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55f520676e10 con 0x55f5206c1cb0 2023-12-01T01:05:22.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.916+0000 7f3d76ff5700 10 client.15678 handle_command_reply: tid=0 2023-12-01T01:05:22.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.916+0000 7f3da566bb80 1 client.15678 shutdown 2023-12-01T01:05:22.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.916+0000 7f3da566bb80 1 -- 172.21.15.26:0/2381884186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a9a70 msgr2=0x55f5206bd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.916+0000 7f3da566bb80 1 --2- 172.21.15.26:0/2381884186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a9a70 0x55f5206bd380 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c007bf0 tx=0x7f3d8c007f00 comp rx=0 tx=0).stop 2023-12-01T01:05:22.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.916+0000 7f3da566bb80 1 -- 172.21.15.26:0/2381884186 shutdown_connections 2023-12-01T01:05:22.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.916+0000 7f3da566bb80 1 --2- 172.21.15.26:0/2381884186 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f5206c1cb0 0x55f5206c40d0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.916+0000 7f3da566bb80 1 --2- 172.21.15.26:0/2381884186 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a9a70 0x55f5206bd380 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.916+0000 7f3da566bb80 1 --2- 172.21.15.26:0/2381884186 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a83f0 0x55f5206b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.916+0000 7f3da566bb80 1 --2- 172.21.15.26:0/2381884186 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a90f0 0x55f5206b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.916+0000 7f3da566bb80 1 -- 172.21.15.26:0/2381884186 >> 172.21.15.26:0/2381884186 conn(0x55f5206070d0 msgr2=0x55f5206a20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:22.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.917+0000 7f3d76ff5700 0 client.15678 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:22.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.917+0000 7f3da566bb80 1 -- 172.21.15.26:0/2381884186 shutdown_connections 2023-12-01T01:05:22.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.917+0000 7f3da566bb80 1 -- 172.21.15.26:0/2381884186 wait complete. 2023-12-01T01:05:22.922 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.917+0000 7f3da566bb80 20 client.15678 trim_cache size 0 max 16384 2023-12-01T01:05:22.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3da566bb80 1 Processor -- start 2023-12-01T01:05:22.946 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3da566bb80 1 -- start start 2023-12-01T01:05:22.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3da566bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a83f0 0x55f5206a7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3da566bb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 0x55f5206bd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3da566bb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a9a70 0x55f5206ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3da566bb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f520676e10 con 0x55f5206a90f0 2023-12-01T01:05:22.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3da566bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f520623d10 con 0x55f5206a83f0 2023-12-01T01:05:22.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3da566bb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f52069ac50 con 0x55f5206a9a70 2023-12-01T01:05:22.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3d927fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 0x55f5206bd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3d927fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 0x55f5206bd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55878/0 (socket says 172.21.15.26:55878) 2023-12-01T01:05:22.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3d927fc700 1 -- 172.21.15.26:0/889809872 learned_addr learned my addr 172.21.15.26:0/889809872 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:22.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/889809872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a83f0 0x55f5206a7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3d937fe700 1 --2- 172.21.15.26:0/889809872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a9a70 0x55f5206ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3d927fc700 1 -- 172.21.15.26:0/889809872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a9a70 msgr2=0x55f5206ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:22.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3d927fc700 1 --2- 172.21.15.26:0/889809872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a9a70 0x55f5206ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.947 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3d927fc700 1 -- 172.21.15.26:0/889809872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a83f0 msgr2=0x55f5206a7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:22.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3d927fc700 1 --2- 172.21.15.26:0/889809872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a83f0 0x55f5206a7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.945+0000 7f3d927fc700 1 -- 172.21.15.26:0/889809872 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f52044d250 con 0x55f5206a90f0 2023-12-01T01:05:22.948 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.946+0000 7f3d927fc700 1 --2- 172.21.15.26:0/889809872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 0x55f5206bd340 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800b780 tx=0x7f3d88009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc1ab9f0cce384ed server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:22.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.946+0000 7f3d79ffb700 1 -- 172.21.15.26:0/889809872 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8809b000 con 0x55f5206a90f0 2023-12-01T01:05:22.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.946+0000 7f3d79ffb700 1 -- 172.21.15.26:0/889809872 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3d8809a900 con 0x55f5206a90f0 2023-12-01T01:05:22.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.946+0000 7f3d79ffb700 1 -- 172.21.15.26:0/889809872 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d880a2450 con 0x55f5206a90f0 2023-12-01T01:05:22.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.947+0000 7f3da566bb80 1 -- 172.21.15.26:0/889809872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 msgr2=0x55f5206bd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.947+0000 7f3da566bb80 1 --2- 172.21.15.26:0/889809872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 0x55f5206bd340 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800b780 tx=0x7f3d88009ca0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.947+0000 7f3da566bb80 1 -- 172.21.15.26:0/889809872 shutdown_connections 2023-12-01T01:05:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.947+0000 7f3da566bb80 1 --2- 172.21.15.26:0/889809872 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a9a70 0x55f5206ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.947+0000 7f3da566bb80 1 --2- 172.21.15.26:0/889809872 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a83f0 0x55f5206a7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.947+0000 7f3da566bb80 1 --2- 172.21.15.26:0/889809872 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 0x55f5206bd340 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.947+0000 7f3da566bb80 1 -- 172.21.15.26:0/889809872 >> 172.21.15.26:0/889809872 conn(0x55f5206070d0 msgr2=0x55f5206af8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.947+0000 7f3da566bb80 1 -- 172.21.15.26:0/889809872 shutdown_connections 2023-12-01T01:05:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.947+0000 7f3da566bb80 1 -- 172.21.15.26:0/889809872 wait complete. 2023-12-01T01:05:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.948+0000 7f3da566bb80 1 -- start start 2023-12-01T01:05:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.948+0000 7f3da566bb80 1 Processor -- start 2023-12-01T01:05:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.948+0000 7f3da566bb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a83f0 0x55f5206bce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.948+0000 7f3da566bb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 0x55f5206bd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.948+0000 7f3da566bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a9a70 0x55f5206bb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.948+0000 7f3da566bb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5206bbc20 con 0x55f5206a90f0 2023-12-01T01:05:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.948+0000 7f3da566bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5206bbd90 con 0x55f5206a9a70 2023-12-01T01:05:22.950 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.948+0000 7f3da566bb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5206bbf50 con 0x55f5206a83f0 2023-12-01T01:05:22.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.948+0000 7f3da566bb80 10 client.0 _ll_register_callbacks cb 0x7f3d8c007590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:22.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.948+0000 7f3d937fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a9a70 0x55f5206bb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.948+0000 7f3d937fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a9a70 0x55f5206bb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:46622/0 (socket says 172.21.15.26:46622) 2023-12-01T01:05:22.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.948+0000 7f3d937fe700 1 -- 172.21.15.26:0/3154284231 learned_addr learned my addr 172.21.15.26:0/3154284231 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:22.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.948+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/3154284231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a83f0 0x55f5206bce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.949+0000 7f3d927fc700 1 --2- 172.21.15.26:0/3154284231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 0x55f5206bd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.949+0000 7f3d937fe700 1 -- 172.21.15.26:0/3154284231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a83f0 msgr2=0x55f5206bce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:22.953 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.949+0000 7f3d937fe700 1 --2- 172.21.15.26:0/3154284231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a83f0 0x55f5206bce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.949+0000 7f3d937fe700 1 -- 172.21.15.26:0/3154284231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 msgr2=0x55f5206bd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.949+0000 7f3d937fe700 1 --2- 172.21.15.26:0/3154284231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 0x55f5206bd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.949+0000 7f3d937fe700 1 -- 172.21.15.26:0/3154284231 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9419f050 con 0x55f5206a9a70 2023-12-01T01:05:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.949+0000 7f3d937fe700 1 --2- 172.21.15.26:0/3154284231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a9a70 0x55f5206bb580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c002230 tx=0x7f3d8c009e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa1488932bd56f24 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.949+0000 7f3d76ff5700 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-12-01T01:05:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.949+0000 7f3d76ff5700 1 -- 172.21.15.26:0/3154284231 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c00e040 con 0x55f5206a9a70 2023-12-01T01:05:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.949+0000 7f3da566bb80 1 -- 172.21.15.26:0/3154284231 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3d8401e8d0 con 0x55f5206a9a70 2023-12-01T01:05:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.949+0000 7f3d76ff5700 1 -- 172.21.15.26:0/3154284231 <== mon.2 v2:172.21.15.93:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3d8c015a00 con 0x55f5206a9a70 2023-12-01T01:05:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.949+0000 7f3d76ff5700 1 -- 172.21.15.26:0/3154284231 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d8c015c00 con 0x55f5206a9a70 2023-12-01T01:05:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.949+0000 7f3da566bb80 10 client.25328 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:22.954 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.949+0000 7f3da566bb80 1 -- 172.21.15.26:0/3154284231 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55f5204252b0 con 0x55f5206a9a70 2023-12-01T01:05:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.950+0000 7f3d76ff5700 1 -- 172.21.15.26:0/3154284231 <== mon.2 v2:172.21.15.93:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3d8c038020 con 0x55f5206a9a70 2023-12-01T01:05:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.950+0000 7f3d76ff5700 1 -- 172.21.15.26:0/3154284231 <== mon.2 v2:172.21.15.93:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f3d8c014050 con 0x55f5206a9a70 2023-12-01T01:05:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.950+0000 7f3da566bb80 10 client.25328 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.950+0000 7f3da566bb80 10 client.25328 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.950+0000 7f3da566bb80 20 client.25328 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.950+0000 7f3da566bb80 1 --2- 172.21.15.26:0/3154284231 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f520714c90 0x55f5207170b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.950+0000 7f3da566bb80 4 client.25328 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-01T01:05:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.950+0000 7f3da566bb80 1 -- 172.21.15.26:0/3154284231 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f5205f1d40 con 0x55f520714c90 2023-12-01T01:05:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.950+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/3154284231 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f520714c90 0x55f5207170b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3d76ff5700 10 client.25328 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3d92ffd700 1 --2- 172.21.15.26:0/3154284231 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f520714c90 0x55f5207170b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a14025d96febae51 server_cookie=609cc5be26830e44 in_seq=0 out_seq=0 2023-12-01T01:05:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3d76ff5700 1 -- 172.21.15.26:0/3154284231 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f5205f1d40 con 0x55f520714c90 2023-12-01T01:05:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3d76ff5700 10 client.25328 handle_command_reply: tid=0 2023-12-01T01:05:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3da566bb80 1 client.25328 shutdown 2023-12-01T01:05:22.955 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3da566bb80 1 -- 172.21.15.26:0/3154284231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a9a70 msgr2=0x55f5206bb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3da566bb80 1 --2- 172.21.15.26:0/3154284231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a9a70 0x55f5206bb580 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c002230 tx=0x7f3d8c009e10 comp rx=0 tx=0).stop 2023-12-01T01:05:22.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3da566bb80 1 -- 172.21.15.26:0/3154284231 shutdown_connections 2023-12-01T01:05:22.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3da566bb80 1 --2- 172.21.15.26:0/3154284231 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55f520714c90 0x55f5207170b0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3da566bb80 1 --2- 172.21.15.26:0/3154284231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55f5206a9a70 0x55f5206bb580 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3da566bb80 1 --2- 172.21.15.26:0/3154284231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55f5206a83f0 0x55f5206bce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3da566bb80 1 --2- 172.21.15.26:0/3154284231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f5206a90f0 0x55f5206bd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3da566bb80 1 -- 172.21.15.26:0/3154284231 >> 172.21.15.26:0/3154284231 conn(0x55f5206070d0 msgr2=0x55f5206ac3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:22.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3d76ff5700 0 client.25328 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:22.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3da566bb80 1 -- 172.21.15.26:0/3154284231 shutdown_connections 2023-12-01T01:05:22.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3da566bb80 1 -- 172.21.15.26:0/3154284231 wait complete. 2023-12-01T01:05:22.956 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.951+0000 7f3da566bb80 20 client.25328 trim_cache size 0 max 16384 2023-12-01T01:05:22.956 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:05:22.957 INFO:teuthology.orchestra.run.smithi026.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-01T01:05:22.957 INFO:teuthology.orchestra.run.smithi026.stdout: "scrubs": { 2023-12-01T01:05:22.957 INFO:teuthology.orchestra.run.smithi026.stdout: "30911803-7120-4068-92b9-0f4665fd12b1": { 2023-12-01T01:05:22.957 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/", 2023-12-01T01:05:22.957 INFO:teuthology.orchestra.run.smithi026.stdout: "tag": "30911803-7120-4068-92b9-0f4665fd12b1", 2023-12-01T01:05:22.957 INFO:teuthology.orchestra.run.smithi026.stdout: "options": "recursive,force" 2023-12-01T01:05:22.957 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:05:22.957 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:05:22.957 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:05:22.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.952+0000 7f3d994db700 1 -- 172.21.15.26:0/1983061633 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3d7c0a0520 msgr2=0x7f3d7c0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.952+0000 7f3d994db700 1 --2- 172.21.15.26:0/1983061633 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3d7c0a0520 0x7f3d7c0a29e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3d84011490 tx=0x7f3d84009260 comp rx=0 tx=0).stop 2023-12-01T01:05:22.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.952+0000 7f3d994db700 1 -- 172.21.15.26:0/1983061633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d941041d0 msgr2=0x7f3d94197040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:22.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.952+0000 7f3d994db700 1 --2- 172.21.15.26:0/1983061633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d941041d0 0x7f3d94197040 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3d880059d0 tx=0x7f3d8800f690 comp rx=0 tx=0).stop 2023-12-01T01:05:22.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.952+0000 7f3d994db700 1 -- 172.21.15.26:0/1983061633 shutdown_connections 2023-12-01T01:05:22.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.952+0000 7f3d994db700 1 --2- 172.21.15.26:0/1983061633 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3d7c0a0520 0x7f3d7c0a29e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.952+0000 7f3d994db700 1 --2- 172.21.15.26:0/1983061633 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3d94106b00 0x7f3d9419e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.952+0000 7f3d994db700 1 --2- 172.21.15.26:0/1983061633 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d941018a0 0x7f3d94196b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.958 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.952+0000 7f3d994db700 1 --2- 172.21.15.26:0/1983061633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3d941041d0 0x7f3d94197040 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:22.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.952+0000 7f3d994db700 1 -- 172.21.15.26:0/1983061633 >> 172.21.15.26:0/1983061633 conn(0x7f3d940fb210 msgr2=0x7f3d94102510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:22.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.952+0000 7f3d994db700 1 -- 172.21.15.26:0/1983061633 shutdown_connections 2023-12-01T01:05:22.959 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:22.952+0000 7f3d994db700 1 -- 172.21.15.26:0/1983061633 wait complete. 2023-12-01T01:05:22.970 INFO:tasks.cephfs.filesystem:scrub status for tag:30911803-7120-4068-92b9-0f4665fd12b1 - {'path': '/', 'tag': '30911803-7120-4068-92b9-0f4665fd12b1', 'options': 'recursive,force'} 2023-12-01T01:05:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.050+0000 7fe4a8e98700 1 -- 172.21.15.26:0/4216916516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4a4101820 msgr2=0x7fe4a41080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.050+0000 7fe4a8e98700 1 --2- 172.21.15.26:0/4216916516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4a4101820 0x7fe4a41080d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fe49c00b0d0 tx=0x7fe49c00b3e0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.050+0000 7fe4a8e98700 1 -- 172.21.15.26:0/4216916516 shutdown_connections 2023-12-01T01:05:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.050+0000 7fe4a8e98700 1 --2- 172.21.15.26:0/4216916516 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4a4101820 0x7fe4a41080d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.050+0000 7fe4a8e98700 1 --2- 172.21.15.26:0/4216916516 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4a40ffc90 0x7fe4a41000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.050+0000 7fe4a8e98700 1 --2- 172.21.15.26:0/4216916516 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe4a4100e80 0x7fe4a41012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.050+0000 7fe4a8e98700 1 -- 172.21.15.26:0/4216916516 >> 172.21.15.26:0/4216916516 conn(0x7fe4a40fb1e0 msgr2=0x7fe4a40fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.050+0000 7fe4a8e98700 1 -- 172.21.15.26:0/4216916516 shutdown_connections 2023-12-01T01:05:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.050+0000 7fe4a8e98700 1 -- 172.21.15.26:0/4216916516 wait complete. 2023-12-01T01:05:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.051+0000 7fe4a8e98700 1 Processor -- start 2023-12-01T01:05:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.051+0000 7fe4a8e98700 1 -- start start 2023-12-01T01:05:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.051+0000 7fe4a8e98700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4a40ffc90 0x7fe4a4194b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.051+0000 7fe4a8e98700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe4a4100e80 0x7fe4a41950b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.051+0000 7fe4a8e98700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4a4101820 0x7fe4a4195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.051+0000 7fe4a8e98700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4196590 con 0x7fe4a40ffc90 2023-12-01T01:05:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.051+0000 7fe4a8e98700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a4196700 con 0x7fe4a4100e80 2023-12-01T01:05:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.051+0000 7fe4a8e98700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a41968c0 con 0x7fe4a4101820 2023-12-01T01:05:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.051+0000 7fe4a259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4a40ffc90 0x7fe4a4194b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.051+0000 7fe4a259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4a40ffc90 0x7fe4a4194b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55894/0 (socket says 172.21.15.26:55894) 2023-12-01T01:05:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.051+0000 7fe4a259c700 1 -- 172.21.15.26:0/3071070081 learned_addr learned my addr 172.21.15.26:0/3071070081 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.052+0000 7fe4a2d9d700 1 --2- 172.21.15.26:0/3071070081 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4a4101820 0x7fe4a4195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.052+0000 7fe4a1d9b700 1 --2- 172.21.15.26:0/3071070081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe4a4100e80 0x7fe4a41950b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.052+0000 7fe4a259c700 1 -- 172.21.15.26:0/3071070081 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4a4101820 msgr2=0x7fe4a4195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.052+0000 7fe4a259c700 1 --2- 172.21.15.26:0/3071070081 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4a4101820 0x7fe4a4195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.052+0000 7fe4a259c700 1 -- 172.21.15.26:0/3071070081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe4a4100e80 msgr2=0x7fe4a41950b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.052+0000 7fe4a259c700 1 --2- 172.21.15.26:0/3071070081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe4a4100e80 0x7fe4a41950b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.052+0000 7fe4a259c700 1 -- 172.21.15.26:0/3071070081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c009d00 con 0x7fe4a40ffc90 2023-12-01T01:05:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.052+0000 7fe4a259c700 1 --2- 172.21.15.26:0/3071070081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4a40ffc90 0x7fe4a4194b70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe49400d980 tx=0x7fe49400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.052+0000 7fe4937fe700 1 -- 172.21.15.26:0/3071070081 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49400f890 con 0x7fe4a40ffc90 2023-12-01T01:05:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.052+0000 7fe4a8e98700 1 -- 172.21.15.26:0/3071070081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a4196ba0 con 0x7fe4a40ffc90 2023-12-01T01:05:23.055 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.052+0000 7fe4937fe700 1 -- 172.21.15.26:0/3071070081 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe494010460 con 0x7fe4a40ffc90 2023-12-01T01:05:23.055 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.052+0000 7fe4937fe700 1 -- 172.21.15.26:0/3071070081 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4940195c0 con 0x7fe4a40ffc90 2023-12-01T01:05:23.055 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.052+0000 7fe4a8e98700 1 -- 172.21.15.26:0/3071070081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a419d360 con 0x7fe4a40ffc90 2023-12-01T01:05:23.057 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.056+0000 7fe4b5028b80 1 Processor -- start 2023-12-01T01:05:23.065 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.057+0000 7fe4b5028b80 1 -- start start 2023-12-01T01:05:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.057+0000 7fe4937fe700 1 -- 172.21.15.26:0/3071070081 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fe494010940 con 0x7fe4a40ffc90 2023-12-01T01:05:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.057+0000 7fe4b5028b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eee680 0x55e665eeeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.057+0000 7fe4b5028b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eeefe0 0x55e665eef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.057+0000 7fe4b5028b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665ef0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.057+0000 7fe4b5028b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e665e469b0 con 0x55e665eefed0 2023-12-01T01:05:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.057+0000 7fe4b5028b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e665e44370 con 0x55e665eee680 2023-12-01T01:05:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.057+0000 7fe4b5028b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e665e3fc60 con 0x55e665eeefe0 2023-12-01T01:05:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.057+0000 7fe4a259c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eeefe0 0x55e665eef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.057+0000 7fe4a259c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eeefe0 0x55e665eef8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.26:48132/0 (socket says 172.21.15.26:48132) 2023-12-01T01:05:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.057+0000 7fe4a259c700 1 -- 172.21.15.26:0/2998117532 learned_addr learned my addr 172.21.15.26:0/2998117532 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.057+0000 7fe4a1d9b700 1 --2- 172.21.15.26:0/2998117532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665ef0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.066 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.057+0000 7fe4a2d9d700 1 --2- 172.21.15.26:0/2998117532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eee680 0x55e665eeeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.058+0000 7fe4a259c700 1 -- 172.21.15.26:0/2998117532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eee680 msgr2=0x55e665eeeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.058+0000 7fe4a259c700 1 --2- 172.21.15.26:0/2998117532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eee680 0x55e665eeeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.058+0000 7fe4a259c700 1 -- 172.21.15.26:0/2998117532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 msgr2=0x55e665ef0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.058+0000 7fe4a259c700 1 --2- 172.21.15.26:0/2998117532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665ef0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.058+0000 7fe4a259c700 1 -- 172.21.15.26:0/2998117532 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e665c6dd80 con 0x55e665eeefe0 2023-12-01T01:05:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.058+0000 7fe4a1d9b700 1 --2- 172.21.15.26:0/2998117532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665ef0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.058+0000 7fe4937fe700 1 --2- 172.21.15.26:0/3071070081 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe48c0a4930 0x7fe48c0a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.058+0000 7fe4a259c700 1 --2- 172.21.15.26:0/2998117532 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eeefe0 0x55e665eef8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe4940cf9f0 tx=0x7fe4940cfd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93c2d8506b061be1 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.058+0000 7fe4a2d9d700 1 --2- 172.21.15.26:0/3071070081 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe48c0a4930 0x7fe48c0a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.067 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.058+0000 7fe4937fe700 1 -- 172.21.15.26:0/3071070081 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe4940cbab0 con 0x7fe4a40ffc90 2023-12-01T01:05:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.058+0000 7fe490ff9700 1 -- 172.21.15.26:0/2998117532 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4940cfe90 con 0x55e665eeefe0 2023-12-01T01:05:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.058+0000 7fe490ff9700 1 -- 172.21.15.26:0/2998117532 <== mon.1 v2:172.21.15.116:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe494095660 con 0x55e665eeefe0 2023-12-01T01:05:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.059+0000 7fe490ff9700 1 -- 172.21.15.26:0/2998117532 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494099a20 con 0x55e665eeefe0 2023-12-01T01:05:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.059+0000 7fe4b5028b80 1 -- 172.21.15.26:0/2998117532 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eeefe0 msgr2=0x55e665eef8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.059+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/2998117532 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eeefe0 0x55e665eef8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe4940cf9f0 tx=0x7fe4940cfd00 comp rx=0 tx=0).stop 2023-12-01T01:05:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.059+0000 7fe4a2d9d700 1 --2- 172.21.15.26:0/3071070081 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe48c0a4930 0x7fe48c0a6df0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009fd0 tx=0x7fe49c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.059+0000 7fe4b5028b80 1 -- 172.21.15.26:0/2998117532 shutdown_connections 2023-12-01T01:05:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.059+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/2998117532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665ef0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.059+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/2998117532 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eee680 0x55e665eeeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.059+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/2998117532 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eeefe0 0x55e665eef8f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.059+0000 7fe4b5028b80 1 -- 172.21.15.26:0/2998117532 >> 172.21.15.26:0/2998117532 conn(0x55e665e4e070 msgr2=0x55e665eeb040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.060+0000 7fe4b5028b80 1 -- 172.21.15.26:0/2998117532 shutdown_connections 2023-12-01T01:05:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.060+0000 7fe4b5028b80 1 -- 172.21.15.26:0/2998117532 wait complete. 2023-12-01T01:05:23.068 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.060+0000 7fe4b5028b80 1 -- start start 2023-12-01T01:05:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.060+0000 7fe4b5028b80 1 Processor -- start 2023-12-01T01:05:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.060+0000 7fe4b5028b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eee680 0x55e665ef82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.060+0000 7fe4b5028b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eeefe0 0x55e665ef8820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.060+0000 7fe4b5028b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665eff860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.060+0000 7fe4b5028b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e665ddc4b0 con 0x55e665eefed0 2023-12-01T01:05:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.060+0000 7fe4b5028b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e665ddc150 con 0x55e665eeefe0 2023-12-01T01:05:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.060+0000 7fe4b5028b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e665cc38c0 con 0x55e665eee680 2023-12-01T01:05:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.060+0000 7fe4b5028b80 10 client.0 _ll_register_callbacks cb 0x55e665d29a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.061+0000 7fe4a259c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eee680 0x55e665ef82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.061+0000 7fe4a259c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eee680 0x55e665ef82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.26:48138/0 (socket says 172.21.15.26:48138) 2023-12-01T01:05:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.061+0000 7fe4a259c700 1 -- 172.21.15.26:0/454849731 learned_addr learned my addr 172.21.15.26:0/454849731 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.061+0000 7fe4a1d9b700 1 --2- 172.21.15.26:0/454849731 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eeefe0 0x55e665ef8820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.061+0000 7fe4a259c700 1 -- 172.21.15.26:0/454849731 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eeefe0 msgr2=0x55e665ef8820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:23.069 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.061+0000 7fe4a259c700 1 --2- 172.21.15.26:0/454849731 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eeefe0 0x55e665ef8820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.061+0000 7fe4a259c700 1 -- 172.21.15.26:0/454849731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 msgr2=0x55e665eff860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.061+0000 7fe4a259c700 1 --2- 172.21.15.26:0/454849731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665eff860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.061+0000 7fe4a259c700 1 -- 172.21.15.26:0/454849731 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe498009650 con 0x55e665eee680 2023-12-01T01:05:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.061+0000 7fe4a259c700 1 --2- 172.21.15.26:0/454849731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eee680 0x55e665ef82e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe4940992b0 tx=0x7fe4940cf4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ec3129ff6ed0c85 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.061+0000 7fe489ffb700 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2023-12-01T01:05:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.061+0000 7fe489ffb700 1 -- 172.21.15.26:0/454849731 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4940cf680 con 0x55e665eee680 2023-12-01T01:05:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.061+0000 7fe489ffb700 1 -- 172.21.15.26:0/454849731 <== mon.1 v2:172.21.15.116:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe494099a20 con 0x55e665eee680 2023-12-01T01:05:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.061+0000 7fe4b5028b80 1 -- 172.21.15.26:0/454849731 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e665e6acb0 con 0x55e665eee680 2023-12-01T01:05:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.062+0000 7fe489ffb700 1 -- 172.21.15.26:0/454849731 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4940b6020 con 0x55e665eee680 2023-12-01T01:05:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.062+0000 7fe4b5028b80 10 client.25366 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.062+0000 7fe4b5028b80 1 -- 172.21.15.26:0/454849731 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7fe4a419d360 con 0x55e665eee680 2023-12-01T01:05:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.062+0000 7fe489ffb700 1 -- 172.21.15.26:0/454849731 <== mon.1 v2:172.21.15.116:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55e665e6acb0 con 0x55e665eee680 2023-12-01T01:05:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.062+0000 7fe489ffb700 1 -- 172.21.15.26:0/454849731 <== mon.1 v2:172.21.15.116:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fe494095a30 con 0x55e665eee680 2023-12-01T01:05:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.063+0000 7fe4b5028b80 10 client.25366 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:23.070 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.063+0000 7fe4b5028b80 10 client.25366 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.063+0000 7fe4b5028b80 20 client.25366 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.063+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/454849731 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55e665f03b90 0x55e665f05f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.063+0000 7fe4b5028b80 4 client.25366 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:05:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.063+0000 7fe4b5028b80 1 -- 172.21.15.26:0/454849731 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e665ebddb0 con 0x55e665f03b90 2023-12-01T01:05:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.063+0000 7fe4a1d9b700 1 --2- 172.21.15.26:0/454849731 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55e665f03b90 0x55e665f05f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.063+0000 7fe4a1d9b700 1 --2- 172.21.15.26:0/454849731 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55e665f03b90 0x55e665f05f80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beb768eb7bb7a764 server_cookie=8f5cad11dd5c9bcd in_seq=0 out_seq=0 2023-12-01T01:05:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.063+0000 7fe489ffb700 10 client.25366 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.064+0000 7fe489ffb700 1 -- 172.21.15.26:0/454849731 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55e665ebddb0 con 0x55e665f03b90 2023-12-01T01:05:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.064+0000 7fe489ffb700 10 client.25366 handle_command_reply: tid=0 2023-12-01T01:05:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.064+0000 7fe4b5028b80 1 client.25366 shutdown 2023-12-01T01:05:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.064+0000 7fe4b5028b80 1 -- 172.21.15.26:0/454849731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eee680 msgr2=0x55e665ef82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:23.071 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.064+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/454849731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eee680 0x55e665ef82e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe4940992b0 tx=0x7fe4940cf4d0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.064+0000 7fe4b5028b80 1 -- 172.21.15.26:0/454849731 shutdown_connections 2023-12-01T01:05:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.064+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/454849731 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55e665f03b90 0x55e665f05f80 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.064+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/454849731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665eff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.064+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/454849731 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eee680 0x55e665ef82e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.064+0000 7fe489ffb700 0 client.25366 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.064+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/454849731 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eeefe0 0x55e665ef8820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.064+0000 7fe4b5028b80 1 -- 172.21.15.26:0/454849731 >> 172.21.15.26:0/454849731 conn(0x55e665e4e070 msgr2=0x55e665ee93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.064+0000 7fe4b5028b80 1 -- 172.21.15.26:0/454849731 shutdown_connections 2023-12-01T01:05:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.064+0000 7fe4b5028b80 1 -- 172.21.15.26:0/454849731 wait complete. 2023-12-01T01:05:23.072 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.064+0000 7fe4b5028b80 20 client.25366 trim_cache size 0 max 16384 2023-12-01T01:05:23.095 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.092+0000 7fe4b5028b80 1 Processor -- start 2023-12-01T01:05:23.095 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.092+0000 7fe4b5028b80 1 -- start start 2023-12-01T01:05:23.095 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.092+0000 7fe4b5028b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eee680 0x55e665efd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.095 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.092+0000 7fe4b5028b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eeefe0 0x55e665eeac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.095 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.092+0000 7fe4b5028b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665eeb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.095 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.092+0000 7fe4b5028b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e665eea490 con 0x55e665eefed0 2023-12-01T01:05:23.095 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.092+0000 7fe4b5028b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e665ebdde0 con 0x55e665eeefe0 2023-12-01T01:05:23.095 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.092+0000 7fe4b5028b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e665ef94d0 con 0x55e665eee680 2023-12-01T01:05:23.095 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.093+0000 7fe4a2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665eeb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.095 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.093+0000 7fe4a2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665eeb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55918/0 (socket says 172.21.15.26:55918) 2023-12-01T01:05:23.095 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.093+0000 7fe4a2d9d700 1 -- 172.21.15.26:0/19214107 learned_addr learned my addr 172.21.15.26:0/19214107 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:23.095 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.093+0000 7fe4a259c700 1 --2- 172.21.15.26:0/19214107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eee680 0x55e665efd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.096 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.093+0000 7fe4a2d9d700 1 -- 172.21.15.26:0/19214107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eee680 msgr2=0x55e665efd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:23.096 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.093+0000 7fe4a2d9d700 1 --2- 172.21.15.26:0/19214107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eee680 0x55e665efd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.096 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.093+0000 7fe4a1d9b700 1 --2- 172.21.15.26:0/19214107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eeefe0 0x55e665eeac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.096 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.093+0000 7fe4a2d9d700 1 -- 172.21.15.26:0/19214107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eeefe0 msgr2=0x55e665eeac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:23.096 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.093+0000 7fe4a2d9d700 1 --2- 172.21.15.26:0/19214107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eeefe0 0x55e665eeac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.096 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.093+0000 7fe4a2d9d700 1 -- 172.21.15.26:0/19214107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e665c56c00 con 0x55e665eefed0 2023-12-01T01:05:23.096 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.093+0000 7fe4a259c700 1 --2- 172.21.15.26:0/19214107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eee680 0x55e665efd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:23.096 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.093+0000 7fe4a1d9b700 1 --2- 172.21.15.26:0/19214107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eeefe0 0x55e665eeac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:05:23.096 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.093+0000 7fe4a2d9d700 1 --2- 172.21.15.26:0/19214107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665eeb160 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe49c00d010 tx=0x7fe49c0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c89ec17b3b0a0fe server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:23.096 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.093+0000 7fe4917fa700 1 -- 172.21.15.26:0/19214107 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c00e040 con 0x55e665eefed0 2023-12-01T01:05:23.096 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.094+0000 7fe4917fa700 1 -- 172.21.15.26:0/19214107 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe49c032070 con 0x55e665eefed0 2023-12-01T01:05:23.096 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.094+0000 7fe4917fa700 1 -- 172.21.15.26:0/19214107 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49c02e830 con 0x55e665eefed0 2023-12-01T01:05:23.099 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.094+0000 7fe4b5028b80 1 -- 172.21.15.26:0/19214107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 msgr2=0x55e665eeb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:23.099 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.094+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/19214107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665eeb160 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe49c00d010 tx=0x7fe49c0099e0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.099 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.095+0000 7fe4b5028b80 1 -- 172.21.15.26:0/19214107 shutdown_connections 2023-12-01T01:05:23.099 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.095+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/19214107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665eeb160 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.100 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.095+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/19214107 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eee680 0x55e665efd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.100 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.095+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/19214107 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eeefe0 0x55e665eeac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.100 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.095+0000 7fe4b5028b80 1 -- 172.21.15.26:0/19214107 >> 172.21.15.26:0/19214107 conn(0x55e665e4e070 msgr2=0x55e665ef30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:23.100 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.095+0000 7fe4b5028b80 1 -- 172.21.15.26:0/19214107 shutdown_connections 2023-12-01T01:05:23.100 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.095+0000 7fe4b5028b80 1 -- 172.21.15.26:0/19214107 wait complete. 2023-12-01T01:05:23.100 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.095+0000 7fe4b5028b80 1 -- start start 2023-12-01T01:05:23.100 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.095+0000 7fe4b5028b80 1 Processor -- start 2023-12-01T01:05:23.100 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.095+0000 7fe4b5028b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eee680 0x55e665f4d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.100 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.095+0000 7fe4b5028b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eeefe0 0x55e665f4ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.100 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.095+0000 7fe4b5028b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665f549c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.100 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe4b5028b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e665f54f00 con 0x55e665eefed0 2023-12-01T01:05:23.100 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe4b5028b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e665f55040 con 0x55e665eee680 2023-12-01T01:05:23.100 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe4b5028b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e665f55200 con 0x55e665eeefe0 2023-12-01T01:05:23.100 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe4b5028b80 10 client.0 _ll_register_callbacks cb 0x7fe498009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe4a259c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eee680 0x55e665f4d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe4a1d9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eeefe0 0x55e665f4ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe4a1d9b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eeefe0 0x55e665f4ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.26:48154/0 (socket says 172.21.15.26:48154) 2023-12-01T01:05:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe4a2d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665f549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe4a1d9b700 1 -- 172.21.15.26:0/1476514535 learned_addr learned my addr 172.21.15.26:0/1476514535 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe4a1d9b700 1 -- 172.21.15.26:0/1476514535 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eee680 msgr2=0x55e665f4d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe4a1d9b700 1 --2- 172.21.15.26:0/1476514535 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eee680 0x55e665f4d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe4a1d9b700 1 -- 172.21.15.26:0/1476514535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 msgr2=0x55e665f549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe4a1d9b700 1 --2- 172.21.15.26:0/1476514535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665f549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe4a1d9b700 1 -- 172.21.15.26:0/1476514535 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a419d360 con 0x55e665eeefe0 2023-12-01T01:05:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe4a2d9d700 1 --2- 172.21.15.26:0/1476514535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665f549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:23.102 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe4a1d9b700 1 --2- 172.21.15.26:0/1476514535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eeefe0 0x55e665f4ddb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe498006fa0 tx=0x7fe49801e8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=400543a1b3227973 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:23.102 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.096+0000 7fe489ffb700 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2023-12-01T01:05:23.102 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.097+0000 7fe489ffb700 1 -- 172.21.15.26:0/1476514535 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe49801b070 con 0x55e665eeefe0 2023-12-01T01:05:23.102 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.097+0000 7fe4b5028b80 1 -- 172.21.15.26:0/1476514535 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe494095660 con 0x55e665eeefe0 2023-12-01T01:05:23.102 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.097+0000 7fe489ffb700 1 -- 172.21.15.26:0/1476514535 <== mon.1 v2:172.21.15.116:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fe498005a50 con 0x55e665eeefe0 2023-12-01T01:05:23.102 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.097+0000 7fe489ffb700 1 -- 172.21.15.26:0/1476514535 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe498005c10 con 0x55e665eeefe0 2023-12-01T01:05:23.102 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.097+0000 7fe4b5028b80 10 client.25372 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:23.102 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.097+0000 7fe4b5028b80 1 -- 172.21.15.26:0/1476514535 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7fe4a4108a20 con 0x55e665eeefe0 2023-12-01T01:05:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.097+0000 7fe489ffb700 1 -- 172.21.15.26:0/1476514535 <== mon.1 v2:172.21.15.116:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fe494095660 con 0x55e665eeefe0 2023-12-01T01:05:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.097+0000 7fe489ffb700 1 -- 172.21.15.26:0/1476514535 <== mon.1 v2:172.21.15.116:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7fe498015540 con 0x55e665eeefe0 2023-12-01T01:05:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.097+0000 7fe4b5028b80 10 client.25372 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.097+0000 7fe4b5028b80 10 client.25372 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.097+0000 7fe4b5028b80 20 client.25372 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.097+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/1476514535 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55e665f56be0 0x55e665f59000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.097+0000 7fe4b5028b80 4 client.25372 mds_command: new command op to 24509 tid=0[{"prefix": "flush journal"}] 2023-12-01T01:05:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.097+0000 7fe4b5028b80 1 -- 172.21.15.26:0/1476514535 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e665e38ce0 con 0x55e665f56be0 2023-12-01T01:05:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.098+0000 7fe4a259c700 1 --2- 172.21.15.26:0/1476514535 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55e665f56be0 0x55e665f59000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.098+0000 7fe489ffb700 10 client.25372 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.098+0000 7fe4a259c700 1 --2- 172.21.15.26:0/1476514535 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55e665f56be0 0x55e665f59000 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77d565d356cc6ccd server_cookie=408ae31f3a5fccc3 in_seq=0 out_seq=0 2023-12-01T01:05:23.107 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.102+0000 7fe489ffb700 1 -- 172.21.15.26:0/1476514535 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e665e38ce0 con 0x55e665f56be0 2023-12-01T01:05:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.102+0000 7fe489ffb700 10 client.25372 handle_command_reply: tid=0 2023-12-01T01:05:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.102+0000 7fe4b5028b80 1 client.25372 shutdown 2023-12-01T01:05:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.102+0000 7fe4b5028b80 1 -- 172.21.15.26:0/1476514535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eeefe0 msgr2=0x55e665f4ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.102+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/1476514535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eeefe0 0x55e665f4ddb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe498006fa0 tx=0x7fe49801e8d0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.102+0000 7fe4b5028b80 1 -- 172.21.15.26:0/1476514535 shutdown_connections 2023-12-01T01:05:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.102+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/1476514535 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55e665f56be0 0x55e665f59000 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.102+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/1476514535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e665eefed0 0x55e665f549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.102+0000 7fe489ffb700 0 client.25372 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.102+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/1476514535 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55e665eee680 0x55e665f4d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.102+0000 7fe4b5028b80 1 --2- 172.21.15.26:0/1476514535 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55e665eeefe0 0x55e665f4ddb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.102+0000 7fe4b5028b80 1 -- 172.21.15.26:0/1476514535 >> 172.21.15.26:0/1476514535 conn(0x55e665e4e070 msgr2=0x55e665eeac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.102+0000 7fe4b5028b80 1 -- 172.21.15.26:0/1476514535 shutdown_connections 2023-12-01T01:05:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.102+0000 7fe4b5028b80 1 -- 172.21.15.26:0/1476514535 wait complete. 2023-12-01T01:05:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.102+0000 7fe4b5028b80 20 client.25372 trim_cache size 0 max 16384 2023-12-01T01:05:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:{ 2023-12-01T01:05:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "message": "", 2023-12-01T01:05:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "return_code": 0 2023-12-01T01:05:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:} 2023-12-01T01:05:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.103+0000 7fe4a8e98700 1 -- 172.21.15.26:0/3071070081 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe48c0a4930 msgr2=0x7fe48c0a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.103+0000 7fe4a8e98700 1 --2- 172.21.15.26:0/3071070081 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe48c0a4930 0x7fe48c0a6df0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe49c009fd0 tx=0x7fe49c00b040 comp rx=0 tx=0).stop 2023-12-01T01:05:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.103+0000 7fe4a8e98700 1 -- 172.21.15.26:0/3071070081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4a40ffc90 msgr2=0x7fe4a4194b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.103+0000 7fe4a8e98700 1 --2- 172.21.15.26:0/3071070081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4a40ffc90 0x7fe4a4194b70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe49400d980 tx=0x7fe49400dc90 comp rx=0 tx=0).stop 2023-12-01T01:05:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.103+0000 7fe4a8e98700 1 -- 172.21.15.26:0/3071070081 shutdown_connections 2023-12-01T01:05:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.103+0000 7fe4a8e98700 1 --2- 172.21.15.26:0/3071070081 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fe48c0a4930 0x7fe48c0a6df0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.103+0000 7fe4a8e98700 1 --2- 172.21.15.26:0/3071070081 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fe4a4101820 0x7fe4a4195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.103+0000 7fe4a8e98700 1 --2- 172.21.15.26:0/3071070081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4a40ffc90 0x7fe4a4194b70 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.103+0000 7fe4a8e98700 1 --2- 172.21.15.26:0/3071070081 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fe4a4100e80 0x7fe4a41950b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.103+0000 7fe4a8e98700 1 -- 172.21.15.26:0/3071070081 >> 172.21.15.26:0/3071070081 conn(0x7fe4a40fb1e0 msgr2=0x7fe4a40fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.103+0000 7fe4a8e98700 1 -- 172.21.15.26:0/3071070081 shutdown_connections 2023-12-01T01:05:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:23.103+0000 7fe4a8e98700 1 -- 172.21.15.26:0/3071070081 wait complete. 2023-12-01T01:05:24.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:23 smithi026 ceph-mon[98801]: pgmap v325: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:24.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:23 smithi026 ceph-mon[98801]: scrub queued for path: / 2023-12-01T01:05:24.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:23 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:24.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:23 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:24.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:23 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:24.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:23 smithi116 ceph-mon[103554]: pgmap v325: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:24.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:23 smithi116 ceph-mon[103554]: scrub queued for path: / 2023-12-01T01:05:24.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:23 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:24.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:23 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:24.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:23 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:24.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:23 smithi093 ceph-mon[103327]: pgmap v325: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:24.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:23 smithi093 ceph-mon[103327]: scrub queued for path: / 2023-12-01T01:05:24.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:23 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:24.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:23 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:24.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:23 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:26.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:25 smithi026 ceph-mon[98801]: pgmap v326: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:25 smithi116 ceph-mon[103554]: pgmap v326: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:26.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:25 smithi093 ceph-mon[103327]: pgmap v326: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:27.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:26 smithi116 ceph-mon[103554]: scrub summary: idle 2023-12-01T01:05:27.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:26 smithi093 ceph-mon[103327]: scrub summary: idle 2023-12-01T01:05:27.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:26 smithi026 ceph-mon[98801]: scrub summary: idle 2023-12-01T01:05:28.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:27 smithi116 ceph-mon[103554]: pgmap v327: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2023-12-01T01:05:28.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:27 smithi093 ceph-mon[103327]: pgmap v327: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2023-12-01T01:05:28.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:27 smithi026 ceph-mon[98801]: pgmap v327: 97 pgs: 97 active+clean; 663 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 6 op/s 2023-12-01T01:05:29.717 INFO:tasks.workunit.client.0.smithi026.stderr:Note: switching to 'a6f82997ac57b70a895455dfed6256360a1e4c32'. 2023-12-01T01:05:29.717 INFO:tasks.workunit.client.0.smithi026.stderr: 2023-12-01T01:05:29.717 INFO:tasks.workunit.client.0.smithi026.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-01T01:05:29.717 INFO:tasks.workunit.client.0.smithi026.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-01T01:05:29.717 INFO:tasks.workunit.client.0.smithi026.stderr:state without impacting any branches by switching back to a branch. 2023-12-01T01:05:29.717 INFO:tasks.workunit.client.0.smithi026.stderr: 2023-12-01T01:05:29.717 INFO:tasks.workunit.client.0.smithi026.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-01T01:05:29.718 INFO:tasks.workunit.client.0.smithi026.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-01T01:05:29.718 INFO:tasks.workunit.client.0.smithi026.stderr: 2023-12-01T01:05:29.718 INFO:tasks.workunit.client.0.smithi026.stderr: git switch -c 2023-12-01T01:05:29.718 INFO:tasks.workunit.client.0.smithi026.stderr: 2023-12-01T01:05:29.718 INFO:tasks.workunit.client.0.smithi026.stderr:Or undo this operation with: 2023-12-01T01:05:29.718 INFO:tasks.workunit.client.0.smithi026.stderr: 2023-12-01T01:05:29.718 INFO:tasks.workunit.client.0.smithi026.stderr: git switch - 2023-12-01T01:05:29.718 INFO:tasks.workunit.client.0.smithi026.stderr: 2023-12-01T01:05:29.718 INFO:tasks.workunit.client.0.smithi026.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-01T01:05:29.718 INFO:tasks.workunit.client.0.smithi026.stderr: 2023-12-01T01:05:29.718 INFO:tasks.workunit.client.0.smithi026.stderr:HEAD is now at a6f82997ac5 qa/cephfs: try usual umount if client blocklisting cannot be inferred 2023-12-01T01:05:29.722 DEBUG:teuthology.orchestra.run.smithi026:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-01T01:05:29.791 INFO:tasks.workunit.client.0.smithi026.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-01T01:05:29.793 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-01T01:05:29.794 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-01T01:05:30.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:29 smithi116 ceph-mon[103554]: pgmap v328: 97 pgs: 97 active+clean; 664 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-01T01:05:30.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:29 smithi093 ceph-mon[103327]: pgmap v328: 97 pgs: 97 active+clean; 664 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-01T01:05:30.285 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-01T01:05:30.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:29 smithi026 ceph-mon[98801]: pgmap v328: 97 pgs: 97 active+clean; 664 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 7 op/s 2023-12-01T01:05:30.339 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-01T01:05:30.378 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-01T01:05:30.380 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-01T01:05:30.380 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-01T01:05:30.417 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-01T01:05:30.421 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T01:05:30.421 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-01T01:05:30.479 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2023-12-01T01:05:30.480 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2023-12-01T01:05:30.480 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a6f82997ac57b70a895455dfed6256360a1e4c32 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2023-12-01T01:05:32.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:31 smithi116 ceph-mon[103554]: pgmap v329: 97 pgs: 97 active+clean; 664 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:32.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:31 smithi093 ceph-mon[103327]: pgmap v329: 97 pgs: 97 active+clean; 664 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:32.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:31 smithi026 ceph-mon[98801]: pgmap v329: 97 pgs: 97 active+clean; 664 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2023-12-01T01:05:34.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:33 smithi116 ceph-mon[103554]: pgmap v330: 97 pgs: 97 active+clean; 664 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2023-12-01T01:05:34.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:33 smithi093 ceph-mon[103327]: pgmap v330: 97 pgs: 97 active+clean; 664 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2023-12-01T01:05:34.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:33 smithi026 ceph-mon[98801]: pgmap v330: 97 pgs: 97 active+clean; 664 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 341 B/s wr, 7 op/s 2023-12-01T01:05:35.733 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ 2023-12-01T01:05:35.736 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/00-INDEX 2023-12-01T01:05:35.737 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/ 2023-12-01T01:05:35.738 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/README 2023-12-01T01:05:35.739 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2023-12-01T01:05:35.740 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2023-12-01T01:05:35.741 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2023-12-01T01:05:35.743 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2023-12-01T01:05:35.743 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2023-12-01T01:05:35.744 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2023-12-01T01:05:35.746 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2023-12-01T01:05:35.746 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/removed/ 2023-12-01T01:05:35.747 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2023-12-01T01:05:35.748 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2023-12-01T01:05:35.749 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2023-12-01T01:05:35.750 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2023-12-01T01:05:35.753 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2023-12-01T01:05:35.753 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2023-12-01T01:05:35.753 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2023-12-01T01:05:35.754 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/ 2023-12-01T01:05:35.755 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2023-12-01T01:05:35.756 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2023-12-01T01:05:35.757 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2023-12-01T01:05:35.757 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2023-12-01T01:05:35.758 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2023-12-01T01:05:35.759 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2023-12-01T01:05:35.760 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2023-12-01T01:05:35.760 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2023-12-01T01:05:35.761 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2023-12-01T01:05:35.762 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2023-12-01T01:05:35.763 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2023-12-01T01:05:35.764 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2023-12-01T01:05:35.765 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2023-12-01T01:05:35.766 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2023-12-01T01:05:35.767 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2023-12-01T01:05:35.768 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2023-12-01T01:05:35.768 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2023-12-01T01:05:35.769 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2023-12-01T01:05:35.770 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2023-12-01T01:05:35.771 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2023-12-01T01:05:35.771 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2023-12-01T01:05:35.772 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2023-12-01T01:05:35.773 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2023-12-01T01:05:35.773 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2023-12-01T01:05:35.774 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2023-12-01T01:05:35.775 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2023-12-01T01:05:35.776 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/ 2023-12-01T01:05:35.777 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2023-12-01T01:05:35.778 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2023-12-01T01:05:35.779 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2023-12-01T01:05:35.780 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2023-12-01T01:05:35.781 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2023-12-01T01:05:35.781 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2023-12-01T01:05:35.782 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2023-12-01T01:05:35.783 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2023-12-01T01:05:35.784 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2023-12-01T01:05:35.785 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2023-12-01T01:05:35.785 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2023-12-01T01:05:35.786 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2023-12-01T01:05:35.787 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2023-12-01T01:05:35.788 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2023-12-01T01:05:35.789 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2023-12-01T01:05:35.789 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2023-12-01T01:05:35.790 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2023-12-01T01:05:35.791 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2023-12-01T01:05:35.792 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2023-12-01T01:05:35.793 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2023-12-01T01:05:35.793 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2023-12-01T01:05:35.794 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2023-12-01T01:05:35.795 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2023-12-01T01:05:35.796 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2023-12-01T01:05:35.796 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2023-12-01T01:05:35.797 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2023-12-01T01:05:35.798 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2023-12-01T01:05:35.798 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2023-12-01T01:05:35.799 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2023-12-01T01:05:35.800 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2023-12-01T01:05:35.800 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2023-12-01T01:05:35.801 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2023-12-01T01:05:35.802 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2023-12-01T01:05:35.802 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2023-12-01T01:05:35.803 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2023-12-01T01:05:35.804 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2023-12-01T01:05:35.805 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2023-12-01T01:05:35.806 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2023-12-01T01:05:35.806 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2023-12-01T01:05:35.807 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2023-12-01T01:05:35.808 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2023-12-01T01:05:35.809 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2023-12-01T01:05:35.809 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2023-12-01T01:05:35.810 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2023-12-01T01:05:35.810 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2023-12-01T01:05:35.811 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2023-12-01T01:05:35.812 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2023-12-01T01:05:35.813 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2023-12-01T01:05:35.813 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2023-12-01T01:05:35.814 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2023-12-01T01:05:35.815 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2023-12-01T01:05:35.815 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2023-12-01T01:05:35.816 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2023-12-01T01:05:35.817 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2023-12-01T01:05:35.818 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2023-12-01T01:05:35.819 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2023-12-01T01:05:35.819 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2023-12-01T01:05:35.820 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2023-12-01T01:05:35.822 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2023-12-01T01:05:35.822 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2023-12-01T01:05:35.823 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2023-12-01T01:05:35.823 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2023-12-01T01:05:35.824 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2023-12-01T01:05:35.825 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2023-12-01T01:05:35.826 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2023-12-01T01:05:35.827 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2023-12-01T01:05:35.828 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2023-12-01T01:05:35.828 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2023-12-01T01:05:35.829 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2023-12-01T01:05:35.830 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2023-12-01T01:05:35.831 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2023-12-01T01:05:35.832 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2023-12-01T01:05:35.832 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2023-12-01T01:05:35.833 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2023-12-01T01:05:35.834 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2023-12-01T01:05:35.835 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2023-12-01T01:05:35.835 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2023-12-01T01:05:35.836 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2023-12-01T01:05:35.837 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2023-12-01T01:05:35.837 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2023-12-01T01:05:35.838 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2023-12-01T01:05:35.839 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2023-12-01T01:05:35.840 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2023-12-01T01:05:35.841 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2023-12-01T01:05:35.842 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2023-12-01T01:05:35.842 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2023-12-01T01:05:35.843 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2023-12-01T01:05:35.844 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2023-12-01T01:05:35.844 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2023-12-01T01:05:35.845 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2023-12-01T01:05:35.846 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2023-12-01T01:05:35.847 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2023-12-01T01:05:35.847 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2023-12-01T01:05:35.848 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2023-12-01T01:05:35.849 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2023-12-01T01:05:35.850 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2023-12-01T01:05:35.851 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2023-12-01T01:05:35.851 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2023-12-01T01:05:35.852 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2023-12-01T01:05:35.853 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2023-12-01T01:05:35.854 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2023-12-01T01:05:35.854 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2023-12-01T01:05:35.855 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2023-12-01T01:05:35.856 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2023-12-01T01:05:35.857 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2023-12-01T01:05:35.857 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2023-12-01T01:05:35.858 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2023-12-01T01:05:35.859 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2023-12-01T01:05:35.860 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2023-12-01T01:05:35.860 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2023-12-01T01:05:35.861 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2023-12-01T01:05:35.862 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2023-12-01T01:05:35.863 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2023-12-01T01:05:35.863 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2023-12-01T01:05:35.864 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2023-12-01T01:05:35.865 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2023-12-01T01:05:35.866 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2023-12-01T01:05:35.867 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2023-12-01T01:05:35.867 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2023-12-01T01:05:35.868 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2023-12-01T01:05:35.869 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2023-12-01T01:05:35.870 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2023-12-01T01:05:35.870 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2023-12-01T01:05:35.872 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2023-12-01T01:05:35.872 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2023-12-01T01:05:35.873 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2023-12-01T01:05:35.874 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2023-12-01T01:05:35.874 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2023-12-01T01:05:35.875 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2023-12-01T01:05:35.877 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2023-12-01T01:05:35.877 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2023-12-01T01:05:35.877 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2023-12-01T01:05:35.878 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2023-12-01T01:05:35.879 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2023-12-01T01:05:35.880 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2023-12-01T01:05:35.880 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2023-12-01T01:05:35.881 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2023-12-01T01:05:35.882 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2023-12-01T01:05:35.883 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2023-12-01T01:05:35.884 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2023-12-01T01:05:35.885 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2023-12-01T01:05:35.886 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2023-12-01T01:05:35.887 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2023-12-01T01:05:35.888 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2023-12-01T01:05:35.889 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2023-12-01T01:05:35.890 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2023-12-01T01:05:35.891 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2023-12-01T01:05:35.892 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2023-12-01T01:05:35.893 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2023-12-01T01:05:35.894 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2023-12-01T01:05:35.895 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2023-12-01T01:05:35.896 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2023-12-01T01:05:36.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:35 smithi116 ceph-mon[103554]: pgmap v331: 97 pgs: 97 active+clean; 686 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2023-12-01T01:05:36.214 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2023-12-01T01:05:36.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:35 smithi093 ceph-mon[103327]: pgmap v331: 97 pgs: 97 active+clean; 686 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2023-12-01T01:05:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.222+0000 7f025d4b4700 1 -- 172.21.15.26:0/1119505190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02580ffce0 msgr2=0x7f0258100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.222+0000 7f025d4b4700 1 --2- 172.21.15.26:0/1119505190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02580ffce0 0x7f0258100100 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f02500099c0 tx=0x7f0250009cd0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.222+0000 7f025d4b4700 1 -- 172.21.15.26:0/1119505190 shutdown_connections 2023-12-01T01:05:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.222+0000 7f025d4b4700 1 --2- 172.21.15.26:0/1119505190 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0258101870 0x7f0258108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.222+0000 7f025d4b4700 1 --2- 172.21.15.26:0/1119505190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f02580ffce0 0x7f0258100100 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.222+0000 7f025d4b4700 1 --2- 172.21.15.26:0/1119505190 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0258100ed0 0x7f0258101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.222+0000 7f025d4b4700 1 -- 172.21.15.26:0/1119505190 >> 172.21.15.26:0/1119505190 conn(0x7f02580fb250 msgr2=0x7f02580fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.222+0000 7f025d4b4700 1 -- 172.21.15.26:0/1119505190 shutdown_connections 2023-12-01T01:05:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.222+0000 7f025d4b4700 1 -- 172.21.15.26:0/1119505190 wait complete. 2023-12-01T01:05:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.222+0000 7f025d4b4700 1 Processor -- start 2023-12-01T01:05:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f025d4b4700 1 -- start start 2023-12-01T01:05:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f025d4b4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02580ffce0 0x7f0258196d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f025d4b4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0258100ed0 0x7f0258197260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f025d4b4700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0258101870 0x7f0258197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f025d4b4700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02581986a0 con 0x7f0258100ed0 2023-12-01T01:05:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f025d4b4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0258198810 con 0x7f02580ffce0 2023-12-01T01:05:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f025d4b4700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02581989d0 con 0x7f0258101870 2023-12-01T01:05:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f02567fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0258100ed0 0x7f0258197260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f0256ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02580ffce0 0x7f0258196d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f02567fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0258100ed0 0x7f0258197260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55964/0 (socket says 172.21.15.26:55964) 2023-12-01T01:05:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f02567fc700 1 -- 172.21.15.26:0/2122817644 learned_addr learned my addr 172.21.15.26:0/2122817644 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f02577fe700 1 --2- 172.21.15.26:0/2122817644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0258101870 0x7f0258197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f02567fc700 1 -- 172.21.15.26:0/2122817644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0258101870 msgr2=0x7f0258197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f02567fc700 1 --2- 172.21.15.26:0/2122817644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0258101870 0x7f0258197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f02567fc700 1 -- 172.21.15.26:0/2122817644 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02580ffce0 msgr2=0x7f0258196d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f02567fc700 1 --2- 172.21.15.26:0/2122817644 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02580ffce0 0x7f0258196d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f02567fc700 1 -- 172.21.15.26:0/2122817644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02500095f0 con 0x7f0258100ed0 2023-12-01T01:05:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f02567fc700 1 --2- 172.21.15.26:0/2122817644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0258100ed0 0x7f0258197260 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f024000e9a0 tx=0x7f024000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.223+0000 7f024ffff700 1 -- 172.21.15.26:0/2122817644 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240009790 con 0x7f0258100ed0 2023-12-01T01:05:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.224+0000 7f025d4b4700 1 -- 172.21.15.26:0/2122817644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0258198cb0 con 0x7f0258100ed0 2023-12-01T01:05:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.224+0000 7f024ffff700 1 -- 172.21.15.26:0/2122817644 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0240010430 con 0x7f0258100ed0 2023-12-01T01:05:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.224+0000 7f024ffff700 1 -- 172.21.15.26:0/2122817644 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240018680 con 0x7f0258100ed0 2023-12-01T01:05:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.224+0000 7f025d4b4700 1 -- 172.21.15.26:0/2122817644 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025819f480 con 0x7f0258100ed0 2023-12-01T01:05:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.226+0000 7f024ffff700 1 -- 172.21.15.26:0/2122817644 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f0240010910 con 0x7f0258100ed0 2023-12-01T01:05:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.226+0000 7f024ffff700 1 --2- 172.21.15.26:0/2122817644 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f02440a0520 0x7f02440a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.226+0000 7f024ffff700 1 -- 172.21.15.26:0/2122817644 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0240014070 con 0x7f0258100ed0 2023-12-01T01:05:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.226+0000 7f0256ffd700 1 --2- 172.21.15.26:0/2122817644 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f02440a0520 0x7f02440a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.227+0000 7f0256ffd700 1 --2- 172.21.15.26:0/2122817644 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f02440a0520 0x7f02440a29e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f025000b580 tx=0x7f0250005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.227+0000 7f0269644b80 1 Processor -- start 2023-12-01T01:05:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.227+0000 7f0269644b80 1 -- start start 2023-12-01T01:05:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.227+0000 7f0269644b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb1680 0x557258fb1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f0269644b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb1fe0 0x557258fb28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f0269644b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb2ed0 0x557258fb3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f0269644b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x557258f099b0 con 0x557258fb2ed0 2023-12-01T01:05:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f0269644b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x557258f07370 con 0x557258fb1680 2023-12-01T01:05:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f0269644b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x557258f02c60 con 0x557258fb1fe0 2023-12-01T01:05:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f02577fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb2ed0 0x557258fb3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f0256ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb1680 0x557258fb1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f0256ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb1680 0x557258fb1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:46708/0 (socket says 172.21.15.26:46708) 2023-12-01T01:05:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f0256ffd700 1 -- 172.21.15.26:0/1334758008 learned_addr learned my addr 172.21.15.26:0/1334758008 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f02577fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb2ed0 0x557258fb3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55974/0 (socket says 172.21.15.26:55974) 2023-12-01T01:05:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f02567fc700 1 --2- 172.21.15.26:0/1334758008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb1fe0 0x557258fb28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f0256ffd700 1 -- 172.21.15.26:0/1334758008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb1fe0 msgr2=0x557258fb28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f0256ffd700 1 --2- 172.21.15.26:0/1334758008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb1fe0 0x557258fb28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f0256ffd700 1 -- 172.21.15.26:0/1334758008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb2ed0 msgr2=0x557258fb3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f0256ffd700 1 --2- 172.21.15.26:0/1334758008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb2ed0 0x557258fb3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f0256ffd700 1 -- 172.21.15.26:0/1334758008 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557258d30d80 con 0x557258fb1680 2023-12-01T01:05:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f02577fe700 1 --2- 172.21.15.26:0/1334758008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb2ed0 0x557258fb3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f0256ffd700 1 --2- 172.21.15.26:0/1334758008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb1680 0x557258fb1aa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0250015000 tx=0x7f0250020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1d73097e6154c15 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f024d7fa700 1 -- 172.21.15.26:0/1334758008 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025002a070 con 0x557258fb1680 2023-12-01T01:05:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f024d7fa700 1 -- 172.21.15.26:0/1334758008 <== mon.2 v2:172.21.15.93:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f025001e040 con 0x557258fb1680 2023-12-01T01:05:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.228+0000 7f024d7fa700 1 -- 172.21.15.26:0/1334758008 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0250023820 con 0x557258fb1680 2023-12-01T01:05:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.229+0000 7f0269644b80 1 -- 172.21.15.26:0/1334758008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb1680 msgr2=0x557258fb1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.229+0000 7f0269644b80 1 --2- 172.21.15.26:0/1334758008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb1680 0x557258fb1aa0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0250015000 tx=0x7f0250020000 comp rx=0 tx=0).stop 2023-12-01T01:05:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.229+0000 7f0269644b80 1 -- 172.21.15.26:0/1334758008 shutdown_connections 2023-12-01T01:05:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.229+0000 7f0269644b80 1 --2- 172.21.15.26:0/1334758008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb2ed0 0x557258fb3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.229+0000 7f0269644b80 1 --2- 172.21.15.26:0/1334758008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb1680 0x557258fb1aa0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.229+0000 7f0269644b80 1 --2- 172.21.15.26:0/1334758008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb1fe0 0x557258fb28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.229+0000 7f0269644b80 1 -- 172.21.15.26:0/1334758008 >> 172.21.15.26:0/1334758008 conn(0x557258f11070 msgr2=0x557258fae040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.229+0000 7f0269644b80 1 -- 172.21.15.26:0/1334758008 shutdown_connections 2023-12-01T01:05:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.229+0000 7f0269644b80 1 -- 172.21.15.26:0/1334758008 wait complete. 2023-12-01T01:05:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f0269644b80 1 -- start start 2023-12-01T01:05:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f0269644b80 1 Processor -- start 2023-12-01T01:05:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f0269644b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb1680 0x557258fbb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f0269644b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557258fbb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f0269644b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb2ed0 0x557258fc2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f0269644b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x557258e9f4b0 con 0x557258fb1fe0 2023-12-01T01:05:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f0269644b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x557258e9f150 con 0x557258fb2ed0 2023-12-01T01:05:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f0269644b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x557258d868c0 con 0x557258fb1680 2023-12-01T01:05:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f0269644b80 10 client.0 _ll_register_callbacks cb 0x557258deca20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f02567fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557258fbb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f02567fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557258fbb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55978/0 (socket says 172.21.15.26:55978) 2023-12-01T01:05:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f02567fc700 1 -- 172.21.15.26:0/2000671834 learned_addr learned my addr 172.21.15.26:0/2000671834 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f0256ffd700 1 --2- 172.21.15.26:0/2000671834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb1680 0x557258fbb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f02577fe700 1 --2- 172.21.15.26:0/2000671834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb2ed0 0x557258fc2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f02567fc700 1 -- 172.21.15.26:0/2000671834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb1680 msgr2=0x557258fbb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f02567fc700 1 --2- 172.21.15.26:0/2000671834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb1680 0x557258fbb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f02567fc700 1 -- 172.21.15.26:0/2000671834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb2ed0 msgr2=0x557258fc2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f02567fc700 1 --2- 172.21.15.26:0/2000671834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb2ed0 0x557258fc2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f02567fc700 1 -- 172.21.15.26:0/2000671834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0248011230 con 0x557258fb1fe0 2023-12-01T01:05:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f02567fc700 1 --2- 172.21.15.26:0/2000671834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557258fbb9d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f024000c2d0 tx=0x7f0240099940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8cb9c257bda14e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.230+0000 7f023e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.231+0000 7f023e7fc700 1 -- 172.21.15.26:0/2000671834 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240099400 con 0x557258fb1fe0 2023-12-01T01:05:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.231+0000 7f023e7fc700 1 -- 172.21.15.26:0/2000671834 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f024009d230 con 0x557258fb1fe0 2023-12-01T01:05:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.231+0000 7f0269644b80 1 -- 172.21.15.26:0/2000671834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557258f2dcb0 con 0x557258fb1fe0 2023-12-01T01:05:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.231+0000 7f023e7fc700 1 -- 172.21.15.26:0/2000671834 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02400a1470 con 0x557258fb1fe0 2023-12-01T01:05:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.231+0000 7f0269644b80 10 client.15711 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.231+0000 7f0269644b80 1 -- 172.21.15.26:0/2000671834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f0258108a70 con 0x557258fb1fe0 2023-12-01T01:05:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.231+0000 7f023e7fc700 1 -- 172.21.15.26:0/2000671834 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0240063080 con 0x557258fb1fe0 2023-12-01T01:05:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.231+0000 7f023e7fc700 1 -- 172.21.15.26:0/2000671834 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f0240064f70 con 0x557258fb1fe0 2023-12-01T01:05:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.231+0000 7f0269644b80 10 client.15711 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.231+0000 7f0269644b80 10 client.15711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.231+0000 7f0269644b80 20 client.15711 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.231+0000 7f0269644b80 1 --2- 172.21.15.26:0/2000671834 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x557258fc70e0 0x557258fc9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.231+0000 7f0269644b80 4 client.15711 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:05:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.231+0000 7f0269644b80 1 -- 172.21.15.26:0/2000671834 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557258f80db0 con 0x557258fc70e0 2023-12-01T01:05:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.231+0000 7f0256ffd700 1 --2- 172.21.15.26:0/2000671834 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x557258fc70e0 0x557258fc9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.232+0000 7f0256ffd700 1 --2- 172.21.15.26:0/2000671834 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x557258fc70e0 0x557258fc9500 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77f9720b53789d22 server_cookie=f3b07b033ffa259d in_seq=0 out_seq=0 2023-12-01T01:05:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.232+0000 7f023e7fc700 10 client.15711 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:36.248 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2023-12-01T01:05:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.247+0000 7f023e7fc700 1 -- 172.21.15.26:0/2000671834 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x557258f80db0 con 0x557258fc70e0 2023-12-01T01:05:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.247+0000 7f023e7fc700 10 client.15711 handle_command_reply: tid=0 2023-12-01T01:05:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.247+0000 7f0269644b80 1 client.15711 shutdown 2023-12-01T01:05:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.247+0000 7f0269644b80 1 -- 172.21.15.26:0/2000671834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 msgr2=0x557258fbb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.247+0000 7f0269644b80 1 --2- 172.21.15.26:0/2000671834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557258fbb9d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f024000c2d0 tx=0x7f0240099940 comp rx=0 tx=0).stop 2023-12-01T01:05:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.247+0000 7f0269644b80 1 -- 172.21.15.26:0/2000671834 shutdown_connections 2023-12-01T01:05:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.247+0000 7f0269644b80 1 --2- 172.21.15.26:0/2000671834 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x557258fc70e0 0x557258fc9500 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.247+0000 7f0269644b80 1 --2- 172.21.15.26:0/2000671834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb2ed0 0x557258fc2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.247+0000 7f023e7fc700 0 client.15711 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.247+0000 7f0269644b80 1 --2- 172.21.15.26:0/2000671834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb1680 0x557258fbb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.249 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.247+0000 7f0269644b80 1 --2- 172.21.15.26:0/2000671834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557258fbb9d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.247+0000 7f0269644b80 1 -- 172.21.15.26:0/2000671834 >> 172.21.15.26:0/2000671834 conn(0x557258f11070 msgr2=0x557258fac3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.247+0000 7f0269644b80 1 -- 172.21.15.26:0/2000671834 shutdown_connections 2023-12-01T01:05:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.247+0000 7f0269644b80 1 -- 172.21.15.26:0/2000671834 wait complete. 2023-12-01T01:05:36.250 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.248+0000 7f0269644b80 20 client.15711 trim_cache size 0 max 16384 2023-12-01T01:05:36.250 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2023-12-01T01:05:36.250 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2023-12-01T01:05:36.251 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2023-12-01T01:05:36.252 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2023-12-01T01:05:36.253 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2023-12-01T01:05:36.254 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2023-12-01T01:05:36.255 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2023-12-01T01:05:36.256 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2023-12-01T01:05:36.257 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2023-12-01T01:05:36.258 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2023-12-01T01:05:36.259 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2023-12-01T01:05:36.260 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2023-12-01T01:05:36.261 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2023-12-01T01:05:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f0269644b80 1 Processor -- start 2023-12-01T01:05:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f0269644b80 1 -- start start 2023-12-01T01:05:36.263 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2023-12-01T01:05:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f0269644b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb1680 0x557258fc09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f0269644b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557258fb9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f0269644b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb2ed0 0x557258fadc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f0269644b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x557258fbc390 con 0x557258fb1fe0 2023-12-01T01:05:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f0269644b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x557258fa49f0 con 0x557258fb2ed0 2023-12-01T01:05:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f0269644b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x557258fba940 con 0x557258fb1680 2023-12-01T01:05:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f02567fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557258fb9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f02567fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557258fb9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55986/0 (socket says 172.21.15.26:55986) 2023-12-01T01:05:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f02567fc700 1 -- 172.21.15.26:0/338493948 learned_addr learned my addr 172.21.15.26:0/338493948 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f02577fe700 1 --2- 172.21.15.26:0/338493948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb2ed0 0x557258fadc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f0256ffd700 1 --2- 172.21.15.26:0/338493948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb1680 0x557258fc09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f02567fc700 1 -- 172.21.15.26:0/338493948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb1680 msgr2=0x557258fc09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f02567fc700 1 --2- 172.21.15.26:0/338493948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb1680 0x557258fc09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f02567fc700 1 -- 172.21.15.26:0/338493948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb2ed0 msgr2=0x557258fadc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.262+0000 7f02567fc700 1 --2- 172.21.15.26:0/338493948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb2ed0 0x557258fadc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.263+0000 7f02567fc700 1 -- 172.21.15.26:0/338493948 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557258d19c00 con 0x557258fb1fe0 2023-12-01T01:05:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.263+0000 7f02567fc700 1 --2- 172.21.15.26:0/338493948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557258fb9300 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0240000c00 tx=0x7f02400979b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61714f58265ca3a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:36.266 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2023-12-01T01:05:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.263+0000 7f024dffb700 1 -- 172.21.15.26:0/338493948 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240065170 con 0x557258fb1fe0 2023-12-01T01:05:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.263+0000 7f024dffb700 1 -- 172.21.15.26:0/338493948 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x557258f2dcb0 con 0x557258fb1fe0 2023-12-01T01:05:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.263+0000 7f024dffb700 1 -- 172.21.15.26:0/338493948 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02400a0fe0 con 0x557258fb1fe0 2023-12-01T01:05:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.263+0000 7f0269644b80 1 -- 172.21.15.26:0/338493948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 msgr2=0x557258fb9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 1 --2- 172.21.15.26:0/338493948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557258fb9300 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0240000c00 tx=0x7f02400979b0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 1 -- 172.21.15.26:0/338493948 shutdown_connections 2023-12-01T01:05:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 1 --2- 172.21.15.26:0/338493948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb2ed0 0x557258fadc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 1 --2- 172.21.15.26:0/338493948 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb1680 0x557258fc09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 1 --2- 172.21.15.26:0/338493948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557258fb9300 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 1 -- 172.21.15.26:0/338493948 >> 172.21.15.26:0/338493948 conn(0x557258f11070 msgr2=0x557258fba0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:36.268 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 1 -- 172.21.15.26:0/338493948 shutdown_connections 2023-12-01T01:05:36.268 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 1 -- 172.21.15.26:0/338493948 wait complete. 2023-12-01T01:05:36.268 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 1 -- start start 2023-12-01T01:05:36.268 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2023-12-01T01:05:36.269 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 1 Processor -- start 2023-12-01T01:05:36.269 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb1680 0x557259016fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.269 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557259019520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.269 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb2ed0 0x55725901ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.270 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55725901c1a0 con 0x557258fb1fe0 2023-12-01T01:05:36.270 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55725901c310 con 0x557258fb1680 2023-12-01T01:05:36.270 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55725901c4d0 con 0x557258fb2ed0 2023-12-01T01:05:36.270 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0269644b80 10 client.0 _ll_register_callbacks cb 0x7f0240098d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:36.270 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f02567fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557259019520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.270 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f0256ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb1680 0x557259016fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.270 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f02567fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557259019520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55992/0 (socket says 172.21.15.26:55992) 2023-12-01T01:05:36.270 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.264+0000 7f02567fc700 1 -- 172.21.15.26:0/3501953943 learned_addr learned my addr 172.21.15.26:0/3501953943 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:36.270 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.265+0000 7f02577fe700 1 --2- 172.21.15.26:0/3501953943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb2ed0 0x55725901ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.270 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.265+0000 7f02567fc700 1 -- 172.21.15.26:0/3501953943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb2ed0 msgr2=0x55725901ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:36.270 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.265+0000 7f02567fc700 1 --2- 172.21.15.26:0/3501953943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb2ed0 0x55725901ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.270 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.265+0000 7f02567fc700 1 -- 172.21.15.26:0/3501953943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb1680 msgr2=0x557259016fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:36.271 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.265+0000 7f02567fc700 1 --2- 172.21.15.26:0/3501953943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb1680 0x557259016fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:36.271 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.265+0000 7f02567fc700 1 -- 172.21.15.26:0/3501953943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0258108a70 con 0x557258fb1fe0 2023-12-01T01:05:36.271 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2023-12-01T01:05:36.272 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.265+0000 7f02567fc700 1 --2- 172.21.15.26:0/3501953943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557259019520 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0240095900 tx=0x7f0240010650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58e10e52dba20db server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:36.272 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.265+0000 7f023e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:36.272 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.265+0000 7f023e7fc700 1 -- 172.21.15.26:0/3501953943 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0240065170 con 0x557258fb1fe0 2023-12-01T01:05:36.272 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.265+0000 7f023e7fc700 1 -- 172.21.15.26:0/3501953943 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0240099400 con 0x557258fb1fe0 2023-12-01T01:05:36.272 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.265+0000 7f0269644b80 1 -- 172.21.15.26:0/3501953943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f025001e040 con 0x557258fb1fe0 2023-12-01T01:05:36.272 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.265+0000 7f023e7fc700 1 -- 172.21.15.26:0/3501953943 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f024009d230 con 0x557258fb1fe0 2023-12-01T01:05:36.272 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.265+0000 7f0269644b80 10 client.15717 fetch_fsmap learned FSMap version 23 2023-12-01T01:05:36.272 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.265+0000 7f0269644b80 1 -- 172.21.15.26:0/3501953943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x557258d571f0 con 0x557258fb1fe0 2023-12-01T01:05:36.272 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.265+0000 7f023e7fc700 1 -- 172.21.15.26:0/3501953943 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f025001e040 con 0x557258fb1fe0 2023-12-01T01:05:36.273 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2023-12-01T01:05:36.273 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.265+0000 7f023e7fc700 1 -- 172.21.15.26:0/3501953943 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 23) v1 ==== 7454+0+0 (secure 0 0 0) 0x7f024009e000 con 0x557258fb1fe0 2023-12-01T01:05:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.266+0000 7f0269644b80 10 client.15717 fetch_fsmap finished waiting for FSMap version 23 2023-12-01T01:05:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.266+0000 7f0269644b80 10 client.15717 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.266+0000 7f0269644b80 20 client.15717 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.266+0000 7f0269644b80 1 --2- 172.21.15.26:0/3501953943 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55725901d9b0 0x55725901fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.266+0000 7f0269644b80 4 client.15717 mds_command: new command op to 24509 tid=0[{"prefix": "flush journal"}] 2023-12-01T01:05:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.266+0000 7f0269644b80 1 -- 172.21.15.26:0/3501953943 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557258efbce0 con 0x55725901d9b0 2023-12-01T01:05:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.266+0000 7f0256ffd700 1 --2- 172.21.15.26:0/3501953943 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55725901d9b0 0x55725901fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.266+0000 7f023e7fc700 10 client.15717 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:36.274 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:36.266+0000 7f0256ffd700 1 --2- 172.21.15.26:0/3501953943 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55725901d9b0 0x55725901fda0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da79ee230c1e2fb5 server_cookie=eed362443466fac4 in_seq=0 out_seq=0 2023-12-01T01:05:36.275 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2023-12-01T01:05:36.276 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2023-12-01T01:05:36.276 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2023-12-01T01:05:36.276 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2023-12-01T01:05:36.276 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2023-12-01T01:05:36.276 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2023-12-01T01:05:36.276 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2023-12-01T01:05:36.276 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2023-12-01T01:05:36.276 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2023-12-01T01:05:36.277 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2023-12-01T01:05:36.277 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2023-12-01T01:05:36.279 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2023-12-01T01:05:36.280 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2023-12-01T01:05:36.281 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2023-12-01T01:05:36.282 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2023-12-01T01:05:36.283 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2023-12-01T01:05:36.284 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2023-12-01T01:05:36.285 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2023-12-01T01:05:36.286 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2023-12-01T01:05:36.286 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2023-12-01T01:05:36.287 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2023-12-01T01:05:36.288 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2023-12-01T01:05:36.289 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2023-12-01T01:05:36.290 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2023-12-01T01:05:36.290 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2023-12-01T01:05:36.291 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2023-12-01T01:05:36.292 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2023-12-01T01:05:36.293 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2023-12-01T01:05:36.293 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2023-12-01T01:05:36.294 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2023-12-01T01:05:36.295 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2023-12-01T01:05:36.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:35 smithi026 ceph-mon[98801]: pgmap v331: 97 pgs: 97 active+clean; 686 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2023-12-01T01:05:36.296 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2023-12-01T01:05:36.296 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2023-12-01T01:05:36.297 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2023-12-01T01:05:36.298 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2023-12-01T01:05:36.299 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2023-12-01T01:05:36.300 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2023-12-01T01:05:36.300 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2023-12-01T01:05:36.301 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2023-12-01T01:05:36.302 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2023-12-01T01:05:36.303 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2023-12-01T01:05:36.303 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2023-12-01T01:05:36.304 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2023-12-01T01:05:36.305 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/Changes 2023-12-01T01:05:36.305 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/CodeOfConflict 2023-12-01T01:05:36.306 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/CodingStyle 2023-12-01T01:05:36.307 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2023-12-01T01:05:36.308 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DMA-API.txt 2023-12-01T01:05:36.309 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2023-12-01T01:05:36.309 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2023-12-01T01:05:36.310 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/ 2023-12-01T01:05:36.311 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2023-12-01T01:05:36.312 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2023-12-01T01:05:36.313 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2023-12-01T01:05:36.314 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2023-12-01T01:05:36.315 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2023-12-01T01:05:36.315 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2023-12-01T01:05:36.316 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2023-12-01T01:05:36.317 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2023-12-01T01:05:36.317 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2023-12-01T01:05:36.319 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2023-12-01T01:05:36.320 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2023-12-01T01:05:36.320 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2023-12-01T01:05:36.321 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2023-12-01T01:05:36.322 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2023-12-01T01:05:36.322 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2023-12-01T01:05:36.323 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2023-12-01T01:05:36.324 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2023-12-01T01:05:36.325 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2023-12-01T01:05:36.325 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2023-12-01T01:05:36.326 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/ 2023-12-01T01:05:36.327 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2023-12-01T01:05:36.328 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2023-12-01T01:05:36.329 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2023-12-01T01:05:36.330 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2023-12-01T01:05:36.331 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2023-12-01T01:05:36.331 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2023-12-01T01:05:36.332 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2023-12-01T01:05:36.333 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2023-12-01T01:05:36.334 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2023-12-01T01:05:36.334 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2023-12-01T01:05:36.335 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2023-12-01T01:05:36.336 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2023-12-01T01:05:36.336 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2023-12-01T01:05:36.337 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2023-12-01T01:05:36.338 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2023-12-01T01:05:36.338 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2023-12-01T01:05:36.339 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2023-12-01T01:05:36.340 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2023-12-01T01:05:36.340 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2023-12-01T01:05:36.342 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2023-12-01T01:05:36.343 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2023-12-01T01:05:36.345 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2023-12-01T01:05:36.346 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2023-12-01T01:05:36.346 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2023-12-01T01:05:36.347 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2023-12-01T01:05:36.347 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2023-12-01T01:05:36.348 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2023-12-01T01:05:36.349 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2023-12-01T01:05:36.350 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2023-12-01T01:05:36.350 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2023-12-01T01:05:36.351 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2023-12-01T01:05:36.352 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2023-12-01T01:05:36.354 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2023-12-01T01:05:36.355 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2023-12-01T01:05:36.356 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2023-12-01T01:05:36.356 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2023-12-01T01:05:36.357 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2023-12-01T01:05:36.358 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2023-12-01T01:05:36.358 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2023-12-01T01:05:36.359 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2023-12-01T01:05:36.360 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2023-12-01T01:05:36.361 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2023-12-01T01:05:36.361 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2023-12-01T01:05:36.362 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2023-12-01T01:05:36.363 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2023-12-01T01:05:36.363 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2023-12-01T01:05:36.364 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2023-12-01T01:05:36.365 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2023-12-01T01:05:36.365 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2023-12-01T01:05:36.366 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2023-12-01T01:05:36.367 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2023-12-01T01:05:36.367 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2023-12-01T01:05:36.368 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2023-12-01T01:05:36.368 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2023-12-01T01:05:36.369 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2023-12-01T01:05:36.370 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2023-12-01T01:05:36.371 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2023-12-01T01:05:36.371 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2023-12-01T01:05:36.372 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2023-12-01T01:05:36.372 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2023-12-01T01:05:36.373 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2023-12-01T01:05:36.374 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2023-12-01T01:05:36.375 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2023-12-01T01:05:36.375 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2023-12-01T01:05:36.376 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2023-12-01T01:05:36.376 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2023-12-01T01:05:36.377 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2023-12-01T01:05:36.378 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2023-12-01T01:05:36.378 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2023-12-01T01:05:36.379 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2023-12-01T01:05:36.380 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2023-12-01T01:05:36.380 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2023-12-01T01:05:36.381 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2023-12-01T01:05:36.382 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2023-12-01T01:05:36.383 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2023-12-01T01:05:36.383 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2023-12-01T01:05:36.384 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2023-12-01T01:05:36.384 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2023-12-01T01:05:36.385 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2023-12-01T01:05:36.386 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2023-12-01T01:05:36.387 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2023-12-01T01:05:36.387 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2023-12-01T01:05:36.388 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2023-12-01T01:05:36.389 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2023-12-01T01:05:36.389 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2023-12-01T01:05:36.390 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2023-12-01T01:05:36.391 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2023-12-01T01:05:36.391 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2023-12-01T01:05:36.392 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2023-12-01T01:05:36.393 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2023-12-01T01:05:36.393 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2023-12-01T01:05:36.394 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2023-12-01T01:05:36.395 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2023-12-01T01:05:36.395 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2023-12-01T01:05:36.396 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2023-12-01T01:05:36.397 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2023-12-01T01:05:36.398 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2023-12-01T01:05:36.399 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2023-12-01T01:05:36.399 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2023-12-01T01:05:36.400 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2023-12-01T01:05:36.401 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2023-12-01T01:05:36.401 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2023-12-01T01:05:36.402 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2023-12-01T01:05:36.403 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2023-12-01T01:05:36.404 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2023-12-01T01:05:36.404 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2023-12-01T01:05:36.405 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2023-12-01T01:05:36.406 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2023-12-01T01:05:36.407 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2023-12-01T01:05:36.408 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2023-12-01T01:05:36.409 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2023-12-01T01:05:36.409 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2023-12-01T01:05:36.410 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2023-12-01T01:05:36.414 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2023-12-01T01:05:36.414 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2023-12-01T01:05:36.414 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2023-12-01T01:05:36.414 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2023-12-01T01:05:36.414 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2023-12-01T01:05:36.415 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2023-12-01T01:05:36.415 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2023-12-01T01:05:36.416 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2023-12-01T01:05:36.417 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2023-12-01T01:05:36.417 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2023-12-01T01:05:36.418 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2023-12-01T01:05:36.419 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2023-12-01T01:05:36.419 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2023-12-01T01:05:36.420 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2023-12-01T01:05:36.421 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2023-12-01T01:05:36.422 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2023-12-01T01:05:36.423 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2023-12-01T01:05:36.423 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2023-12-01T01:05:36.424 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2023-12-01T01:05:36.425 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2023-12-01T01:05:36.425 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2023-12-01T01:05:36.426 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2023-12-01T01:05:36.427 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2023-12-01T01:05:36.428 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2023-12-01T01:05:36.428 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2023-12-01T01:05:36.429 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2023-12-01T01:05:36.430 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2023-12-01T01:05:36.430 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2023-12-01T01:05:36.431 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2023-12-01T01:05:36.432 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2023-12-01T01:05:36.432 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2023-12-01T01:05:36.433 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2023-12-01T01:05:36.434 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2023-12-01T01:05:36.435 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2023-12-01T01:05:36.435 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2023-12-01T01:05:36.436 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2023-12-01T01:05:36.437 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2023-12-01T01:05:36.438 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2023-12-01T01:05:36.438 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2023-12-01T01:05:36.439 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2023-12-01T01:05:36.440 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2023-12-01T01:05:36.440 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2023-12-01T01:05:36.441 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2023-12-01T01:05:36.442 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2023-12-01T01:05:36.443 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2023-12-01T01:05:36.443 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2023-12-01T01:05:36.444 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2023-12-01T01:05:36.445 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2023-12-01T01:05:36.446 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2023-12-01T01:05:36.446 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2023-12-01T01:05:36.447 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2023-12-01T01:05:36.447 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2023-12-01T01:05:36.449 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2023-12-01T01:05:36.449 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2023-12-01T01:05:36.450 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2023-12-01T01:05:36.451 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2023-12-01T01:05:36.451 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2023-12-01T01:05:36.452 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2023-12-01T01:05:36.453 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2023-12-01T01:05:36.454 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2023-12-01T01:05:36.454 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2023-12-01T01:05:36.455 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2023-12-01T01:05:36.456 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2023-12-01T01:05:36.457 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2023-12-01T01:05:36.457 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2023-12-01T01:05:38.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:37 smithi116 ceph-mon[103554]: pgmap v332: 97 pgs: 97 active+clean; 686 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2023-12-01T01:05:38.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:37 smithi093 ceph-mon[103327]: pgmap v332: 97 pgs: 97 active+clean; 686 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2023-12-01T01:05:38.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:37 smithi026 ceph-mon[98801]: pgmap v332: 97 pgs: 97 active+clean; 686 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 KiB/s wr, 8 op/s 2023-12-01T01:05:40.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:39 smithi116 ceph-mon[103554]: pgmap v333: 97 pgs: 97 active+clean; 9.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 772 KiB/s wr, 13 op/s 2023-12-01T01:05:40.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:39 smithi093 ceph-mon[103327]: pgmap v333: 97 pgs: 97 active+clean; 9.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 772 KiB/s wr, 13 op/s 2023-12-01T01:05:40.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:39 smithi026 ceph-mon[98801]: pgmap v333: 97 pgs: 97 active+clean; 9.6 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 772 KiB/s wr, 13 op/s 2023-12-01T01:05:41.162 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.161+0000 7f023e7fc700 1 -- 172.21.15.26:0/3501953943 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557258efbce0 con 0x55725901d9b0 2023-12-01T01:05:41.162 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.161+0000 7f023e7fc700 10 client.15717 handle_command_reply: tid=0 2023-12-01T01:05:41.162 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2023-12-01T01:05:41.163 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.161+0000 7f0269644b80 1 client.15717 shutdown 2023-12-01T01:05:41.163 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.161+0000 7f0269644b80 1 -- 172.21.15.26:0/3501953943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 msgr2=0x557259019520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:41.163 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.161+0000 7f0269644b80 1 --2- 172.21.15.26:0/3501953943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557259019520 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f0240095900 tx=0x7f0240010650 comp rx=0 tx=0).stop 2023-12-01T01:05:41.163 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.161+0000 7f0269644b80 1 -- 172.21.15.26:0/3501953943 shutdown_connections 2023-12-01T01:05:41.163 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.161+0000 7f0269644b80 1 --2- 172.21.15.26:0/3501953943 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55725901d9b0 0x55725901fda0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.161+0000 7f0269644b80 1 --2- 172.21.15.26:0/3501953943 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557258fb2ed0 0x55725901ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.161+0000 7f0269644b80 1 --2- 172.21.15.26:0/3501953943 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557258fb1680 0x557259016fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.161+0000 7f023e7fc700 0 client.15717 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.161+0000 7f0269644b80 1 --2- 172.21.15.26:0/3501953943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557258fb1fe0 0x557259019520 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.161+0000 7f0269644b80 1 -- 172.21.15.26:0/3501953943 >> 172.21.15.26:0/3501953943 conn(0x557258f11070 msgr2=0x557258fc3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.161+0000 7f0269644b80 1 -- 172.21.15.26:0/3501953943 shutdown_connections 2023-12-01T01:05:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.161+0000 7f0269644b80 1 -- 172.21.15.26:0/3501953943 wait complete. 2023-12-01T01:05:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.161+0000 7f0269644b80 20 client.15717 trim_cache size 0 max 16384 2023-12-01T01:05:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:{ 2023-12-01T01:05:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "message": "", 2023-12-01T01:05:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "return_code": 0 2023-12-01T01:05:41.164 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:} 2023-12-01T01:05:41.165 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2023-12-01T01:05:41.165 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.162+0000 7f025d4b4700 1 -- 172.21.15.26:0/2122817644 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f02440a0520 msgr2=0x7f02440a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.162+0000 7f025d4b4700 1 --2- 172.21.15.26:0/2122817644 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f02440a0520 0x7f02440a29e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f025000b580 tx=0x7f0250005fb0 comp rx=0 tx=0).stop 2023-12-01T01:05:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.162+0000 7f025d4b4700 1 -- 172.21.15.26:0/2122817644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0258100ed0 msgr2=0x7f0258197260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.162+0000 7f025d4b4700 1 --2- 172.21.15.26:0/2122817644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0258100ed0 0x7f0258197260 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f024000e9a0 tx=0x7f024000ecb0 comp rx=0 tx=0).stop 2023-12-01T01:05:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.162+0000 7f025d4b4700 1 -- 172.21.15.26:0/2122817644 shutdown_connections 2023-12-01T01:05:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.162+0000 7f025d4b4700 1 --2- 172.21.15.26:0/2122817644 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f02440a0520 0x7f02440a29e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.162+0000 7f025d4b4700 1 --2- 172.21.15.26:0/2122817644 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0258101870 0x7f0258197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.162+0000 7f025d4b4700 1 --2- 172.21.15.26:0/2122817644 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f02580ffce0 0x7f0258196d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.162+0000 7f025d4b4700 1 --2- 172.21.15.26:0/2122817644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0258100ed0 0x7f0258197260 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:41.166 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.162+0000 7f025d4b4700 1 -- 172.21.15.26:0/2122817644 >> 172.21.15.26:0/2122817644 conn(0x7f02580fb250 msgr2=0x7f0258068d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:41.166 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2023-12-01T01:05:41.167 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.162+0000 7f025d4b4700 1 -- 172.21.15.26:0/2122817644 shutdown_connections 2023-12-01T01:05:41.167 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:41.163+0000 7f025d4b4700 1 -- 172.21.15.26:0/2122817644 wait complete. 2023-12-01T01:05:41.168 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2023-12-01T01:05:41.168 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2023-12-01T01:05:41.168 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2023-12-01T01:05:41.168 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2023-12-01T01:05:41.168 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2023-12-01T01:05:41.168 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2023-12-01T01:05:41.168 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2023-12-01T01:05:41.168 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2023-12-01T01:05:41.169 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2023-12-01T01:05:41.170 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2023-12-01T01:05:41.171 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2023-12-01T01:05:41.172 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2023-12-01T01:05:41.172 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2023-12-01T01:05:41.173 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2023-12-01T01:05:41.173 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2023-12-01T01:05:41.174 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2023-12-01T01:05:41.175 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2023-12-01T01:05:41.176 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2023-12-01T01:05:41.177 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2023-12-01T01:05:41.178 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2023-12-01T01:05:41.179 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2023-12-01T01:05:41.179 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2023-12-01T01:05:41.180 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2023-12-01T01:05:41.181 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2023-12-01T01:05:41.182 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2023-12-01T01:05:41.182 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2023-12-01T01:05:41.183 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2023-12-01T01:05:41.183 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2023-12-01T01:05:41.186 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2023-12-01T01:05:41.187 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2023-12-01T01:05:41.187 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2023-12-01T01:05:41.188 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/EDID/ 2023-12-01T01:05:41.189 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2023-12-01T01:05:41.190 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2023-12-01T01:05:41.191 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2023-12-01T01:05:41.191 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2023-12-01T01:05:41.192 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2023-12-01T01:05:41.192 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2023-12-01T01:05:41.193 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2023-12-01T01:05:41.194 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/EDID/Makefile 2023-12-01T01:05:41.195 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/EDID/edid.S 2023-12-01T01:05:41.195 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/EDID/hex 2023-12-01T01:05:41.196 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/HOWTO 2023-12-01T01:05:41.197 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/IPMI.txt 2023-12-01T01:05:41.198 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2023-12-01T01:05:41.198 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2023-12-01T01:05:41.199 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/IRQ.txt 2023-12-01T01:05:41.200 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2023-12-01T01:05:41.201 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/Makefile 2023-12-01T01:05:41.201 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ManagementStyle 2023-12-01T01:05:41.202 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/PCI/ 2023-12-01T01:05:41.203 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2023-12-01T01:05:41.204 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2023-12-01T01:05:41.205 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2023-12-01T01:05:41.206 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2023-12-01T01:05:41.207 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2023-12-01T01:05:41.207 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2023-12-01T01:05:41.208 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2023-12-01T01:05:41.209 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/ 2023-12-01T01:05:41.210 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2023-12-01T01:05:41.211 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2023-12-01T01:05:41.212 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2023-12-01T01:05:41.213 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2023-12-01T01:05:41.214 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2023-12-01T01:05:41.215 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2023-12-01T01:05:41.216 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2023-12-01T01:05:41.216 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2023-12-01T01:05:41.217 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2023-12-01T01:05:41.219 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2023-12-01T01:05:41.219 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2023-12-01T01:05:41.219 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2023-12-01T01:05:41.221 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2023-12-01T01:05:41.221 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2023-12-01T01:05:41.221 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2023-12-01T01:05:41.222 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2023-12-01T01:05:41.223 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2023-12-01T01:05:41.224 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2023-12-01T01:05:41.224 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/SAK.txt 2023-12-01T01:05:41.225 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/SM501.txt 2023-12-01T01:05:41.226 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/SecurityBugs 2023-12-01T01:05:41.227 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/SubmitChecklist 2023-12-01T01:05:41.228 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2023-12-01T01:05:41.229 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/SubmittingPatches 2023-12-01T01:05:41.229 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2023-12-01T01:05:41.230 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/accounting/ 2023-12-01T01:05:41.231 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2023-12-01T01:05:41.232 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/accounting/Makefile 2023-12-01T01:05:41.233 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2023-12-01T01:05:41.234 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2023-12-01T01:05:41.235 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2023-12-01T01:05:41.235 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2023-12-01T01:05:41.236 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2023-12-01T01:05:41.237 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/acpi/ 2023-12-01T01:05:41.238 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/acpi/apei/ 2023-12-01T01:05:41.239 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2023-12-01T01:05:41.240 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2023-12-01T01:05:41.241 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2023-12-01T01:05:41.242 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2023-12-01T01:05:41.242 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2023-12-01T01:05:41.243 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2023-12-01T01:05:41.244 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2023-12-01T01:05:41.244 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2023-12-01T01:05:41.245 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2023-12-01T01:05:41.245 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2023-12-01T01:05:41.246 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2023-12-01T01:05:41.247 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2023-12-01T01:05:41.248 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/aoe/ 2023-12-01T01:05:41.248 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2023-12-01T01:05:41.249 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2023-12-01T01:05:41.250 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/aoe/status.sh 2023-12-01T01:05:41.250 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2023-12-01T01:05:41.251 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2023-12-01T01:05:41.252 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2023-12-01T01:05:41.252 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/applying-patches.txt 2023-12-01T01:05:41.253 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/ 2023-12-01T01:05:41.254 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2023-12-01T01:05:41.255 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2023-12-01T01:05:41.256 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2023-12-01T01:05:41.257 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Booting 2023-12-01T01:05:41.258 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2023-12-01T01:05:41.258 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2023-12-01T01:05:41.259 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Interrupts 2023-12-01T01:05:41.260 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Makefile 2023-12-01T01:05:41.260 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2023-12-01T01:05:41.261 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2023-12-01T01:05:41.262 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Netwinder 2023-12-01T01:05:41.263 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2023-12-01T01:05:41.264 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2023-12-01T01:05:41.265 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2023-12-01T01:05:41.265 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Porting 2023-12-01T01:05:41.266 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/README 2023-12-01T01:05:41.267 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2023-12-01T01:05:41.268 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2023-12-01T01:05:41.269 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2023-12-01T01:05:41.270 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2023-12-01T01:05:41.270 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2023-12-01T01:05:41.271 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2023-12-01T01:05:41.271 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2023-12-01T01:05:41.272 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2023-12-01T01:05:41.274 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2023-12-01T01:05:41.275 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2023-12-01T01:05:41.275 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2023-12-01T01:05:41.275 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2023-12-01T01:05:41.276 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2023-12-01T01:05:41.276 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2023-12-01T01:05:41.277 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2023-12-01T01:05:41.278 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2023-12-01T01:05:41.278 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2023-12-01T01:05:41.279 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2023-12-01T01:05:41.279 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2023-12-01T01:05:41.280 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2023-12-01T01:05:41.281 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2023-12-01T01:05:41.282 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2023-12-01T01:05:41.282 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2023-12-01T01:05:41.283 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2023-12-01T01:05:41.284 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2023-12-01T01:05:41.284 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2023-12-01T01:05:41.285 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2023-12-01T01:05:41.286 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2023-12-01T01:05:41.287 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2023-12-01T01:05:41.288 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2023-12-01T01:05:41.289 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2023-12-01T01:05:41.290 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2023-12-01T01:05:41.290 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2023-12-01T01:05:41.291 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2023-12-01T01:05:41.291 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2023-12-01T01:05:41.292 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2023-12-01T01:05:41.293 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2023-12-01T01:05:41.293 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2023-12-01T01:05:41.294 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2023-12-01T01:05:41.295 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2023-12-01T01:05:41.296 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2023-12-01T01:05:41.297 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2023-12-01T01:05:41.298 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2023-12-01T01:05:41.298 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/Setup 2023-12-01T01:05:41.299 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/VFP/ 2023-12-01T01:05:41.300 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2023-12-01T01:05:41.301 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2023-12-01T01:05:41.301 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2023-12-01T01:05:41.302 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2023-12-01T01:05:41.304 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2023-12-01T01:05:41.304 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2023-12-01T01:05:41.304 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/memory.txt 2023-12-01T01:05:41.305 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/msm/ 2023-12-01T01:05:41.306 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2023-12-01T01:05:41.307 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2023-12-01T01:05:41.308 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2023-12-01T01:05:41.309 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2023-12-01T01:05:41.310 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2023-12-01T01:05:41.310 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2023-12-01T01:05:41.311 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/pxa/ 2023-12-01T01:05:41.312 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2023-12-01T01:05:41.313 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/sti/ 2023-12-01T01:05:41.313 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2023-12-01T01:05:41.314 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2023-12-01T01:05:41.316 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2023-12-01T01:05:41.316 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2023-12-01T01:05:41.317 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2023-12-01T01:05:41.317 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2023-12-01T01:05:41.318 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2023-12-01T01:05:41.319 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2023-12-01T01:05:41.319 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2023-12-01T01:05:41.320 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2023-12-01T01:05:41.321 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2023-12-01T01:05:41.322 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2023-12-01T01:05:41.323 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm64/ 2023-12-01T01:05:41.324 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2023-12-01T01:05:41.325 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2023-12-01T01:05:41.325 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2023-12-01T01:05:41.326 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2023-12-01T01:05:41.327 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/assoc_array.txt 2023-12-01T01:05:41.328 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2023-12-01T01:05:41.329 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/auxdisplay/ 2023-12-01T01:05:41.330 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2023-12-01T01:05:41.331 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2023-12-01T01:05:41.331 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2023-12-01T01:05:41.332 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2023-12-01T01:05:41.333 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2023-12-01T01:05:41.333 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/backlight/ 2023-12-01T01:05:41.335 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2023-12-01T01:05:41.335 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/bad_memory.txt 2023-12-01T01:05:41.336 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2023-12-01T01:05:41.337 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/bcache.txt 2023-12-01T01:05:41.338 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2023-12-01T01:05:41.338 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blackfin/ 2023-12-01T01:05:41.339 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2023-12-01T01:05:41.340 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2023-12-01T01:05:41.341 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2023-12-01T01:05:41.342 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2023-12-01T01:05:41.342 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2023-12-01T01:05:41.343 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/block/ 2023-12-01T01:05:41.344 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/block/00-INDEX 2023-12-01T01:05:41.345 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2023-12-01T01:05:41.346 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2023-12-01T01:05:41.347 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/block/capability.txt 2023-12-01T01:05:41.347 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2023-12-01T01:05:41.348 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2023-12-01T01:05:41.348 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2023-12-01T01:05:41.349 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2023-12-01T01:05:41.350 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2023-12-01T01:05:41.350 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2023-12-01T01:05:41.351 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2023-12-01T01:05:41.352 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/block/request.txt 2023-12-01T01:05:41.352 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/block/stat.txt 2023-12-01T01:05:41.353 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2023-12-01T01:05:41.354 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2023-12-01T01:05:41.354 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/ 2023-12-01T01:05:41.355 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2023-12-01T01:05:41.356 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2023-12-01T01:05:41.357 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2023-12-01T01:05:41.358 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2023-12-01T01:05:41.358 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2023-12-01T01:05:41.359 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2023-12-01T01:05:41.360 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2023-12-01T01:05:41.361 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2023-12-01T01:05:41.361 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2023-12-01T01:05:41.362 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2023-12-01T01:05:41.362 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2023-12-01T01:05:41.363 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2023-12-01T01:05:41.363 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2023-12-01T01:05:41.364 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2023-12-01T01:05:41.365 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2023-12-01T01:05:41.365 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2023-12-01T01:05:41.366 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2023-12-01T01:05:41.367 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2023-12-01T01:05:41.367 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2023-12-01T01:05:41.368 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/braille-console.txt 2023-12-01T01:05:41.369 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2023-12-01T01:05:41.369 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/btmrvl.txt 2023-12-01T01:05:41.370 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/bus-devices/ 2023-12-01T01:05:41.371 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2023-12-01T01:05:41.373 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2023-12-01T01:05:41.373 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cachetlb.txt 2023-12-01T01:05:41.374 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cdrom/ 2023-12-01T01:05:41.375 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2023-12-01T01:05:41.377 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2023-12-01T01:05:41.377 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2023-12-01T01:05:41.378 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2023-12-01T01:05:41.378 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2023-12-01T01:05:41.379 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cgroups/ 2023-12-01T01:05:41.380 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2023-12-01T01:05:41.381 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2023-12-01T01:05:41.381 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2023-12-01T01:05:41.383 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2023-12-01T01:05:41.383 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2023-12-01T01:05:41.384 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2023-12-01T01:05:41.384 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2023-12-01T01:05:41.385 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2023-12-01T01:05:41.386 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2023-12-01T01:05:41.386 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2023-12-01T01:05:41.387 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2023-12-01T01:05:41.388 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2023-12-01T01:05:41.388 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2023-12-01T01:05:41.389 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2023-12-01T01:05:41.390 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/clk.txt 2023-12-01T01:05:41.391 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/coccinelle.txt 2023-12-01T01:05:41.391 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/connector/ 2023-12-01T01:05:41.392 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/connector/.gitignore 2023-12-01T01:05:41.393 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/connector/Makefile 2023-12-01T01:05:41.394 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2023-12-01T01:05:41.394 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/connector/connector.txt 2023-12-01T01:05:41.395 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/connector/ucon.c 2023-12-01T01:05:41.396 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/console/ 2023-12-01T01:05:41.397 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/console/console.txt 2023-12-01T01:05:41.398 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpu-freq/ 2023-12-01T01:05:41.399 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2023-12-01T01:05:41.400 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2023-12-01T01:05:41.400 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2023-12-01T01:05:41.401 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2023-12-01T01:05:41.402 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2023-12-01T01:05:41.402 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2023-12-01T01:05:41.403 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2023-12-01T01:05:41.404 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2023-12-01T01:05:41.404 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2023-12-01T01:05:41.405 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2023-12-01T01:05:41.406 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2023-12-01T01:05:41.406 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2023-12-01T01:05:41.407 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpu-load.txt 2023-12-01T01:05:41.408 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpuidle/ 2023-12-01T01:05:41.409 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2023-12-01T01:05:41.410 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2023-12-01T01:05:41.411 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2023-12-01T01:05:41.411 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2023-12-01T01:05:41.412 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cputopology.txt 2023-12-01T01:05:41.413 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/crc32.txt 2023-12-01T01:05:41.414 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cris/ 2023-12-01T01:05:41.414 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/cris/README 2023-12-01T01:05:41.415 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/crypto/ 2023-12-01T01:05:41.416 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2023-12-01T01:05:41.417 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2023-12-01T01:05:41.418 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2023-12-01T01:05:41.419 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2023-12-01T01:05:41.419 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2023-12-01T01:05:41.420 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dcdbas.txt 2023-12-01T01:05:41.421 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2023-12-01T01:05:41.422 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2023-12-01T01:05:41.423 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2023-12-01T01:05:41.423 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/development-process/ 2023-12-01T01:05:41.424 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2023-12-01T01:05:41.425 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/development-process/2.Process 2023-12-01T01:05:41.426 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2023-12-01T01:05:41.427 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2023-12-01T01:05:41.427 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2023-12-01T01:05:41.428 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2023-12-01T01:05:41.429 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2023-12-01T01:05:41.429 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2023-12-01T01:05:41.430 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/ 2023-12-01T01:05:41.431 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2023-12-01T01:05:41.432 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2023-12-01T01:05:41.433 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2023-12-01T01:05:41.433 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2023-12-01T01:05:41.434 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2023-12-01T01:05:41.435 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2023-12-01T01:05:41.436 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2023-12-01T01:05:41.436 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2023-12-01T01:05:41.437 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2023-12-01T01:05:41.438 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2023-12-01T01:05:41.438 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2023-12-01T01:05:41.439 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2023-12-01T01:05:41.440 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2023-12-01T01:05:41.440 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2023-12-01T01:05:41.441 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2023-12-01T01:05:41.442 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2023-12-01T01:05:41.442 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2023-12-01T01:05:41.443 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2023-12-01T01:05:41.444 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2023-12-01T01:05:41.444 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2023-12-01T01:05:41.445 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2023-12-01T01:05:41.446 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2023-12-01T01:05:41.446 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devices.txt 2023-12-01T01:05:41.448 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/ 2023-12-01T01:05:41.449 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2023-12-01T01:05:41.449 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2023-12-01T01:05:41.450 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2023-12-01T01:05:41.451 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2023-12-01T01:05:41.452 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2023-12-01T01:05:41.453 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2023-12-01T01:05:41.454 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2023-12-01T01:05:41.455 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2023-12-01T01:05:41.455 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2023-12-01T01:05:41.456 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2023-12-01T01:05:41.457 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2023-12-01T01:05:41.458 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2023-12-01T01:05:41.458 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2023-12-01T01:05:41.459 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2023-12-01T01:05:41.460 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2023-12-01T01:05:41.460 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2023-12-01T01:05:41.461 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2023-12-01T01:05:41.462 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2023-12-01T01:05:41.462 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2023-12-01T01:05:41.463 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2023-12-01T01:05:41.463 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2023-12-01T01:05:41.464 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2023-12-01T01:05:41.465 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2023-12-01T01:05:41.465 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2023-12-01T01:05:41.466 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2023-12-01T01:05:41.467 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2023-12-01T01:05:41.467 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2023-12-01T01:05:41.468 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2023-12-01T01:05:41.469 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2023-12-01T01:05:41.469 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2023-12-01T01:05:41.470 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2023-12-01T01:05:41.470 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2023-12-01T01:05:41.471 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2023-12-01T01:05:41.472 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2023-12-01T01:05:41.472 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2023-12-01T01:05:41.473 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2023-12-01T01:05:41.474 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2023-12-01T01:05:41.474 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2023-12-01T01:05:41.475 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2023-12-01T01:05:41.476 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2023-12-01T01:05:41.477 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2023-12-01T01:05:41.477 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2023-12-01T01:05:41.478 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2023-12-01T01:05:41.478 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2023-12-01T01:05:41.479 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2023-12-01T01:05:41.479 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2023-12-01T01:05:41.480 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2023-12-01T01:05:41.481 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2023-12-01T01:05:41.481 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2023-12-01T01:05:41.482 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2023-12-01T01:05:41.483 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2023-12-01T01:05:41.484 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2023-12-01T01:05:41.485 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2023-12-01T01:05:41.486 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2023-12-01T01:05:41.486 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2023-12-01T01:05:41.487 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2023-12-01T01:05:41.489 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2023-12-01T01:05:41.489 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2023-12-01T01:05:41.490 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2023-12-01T01:05:41.491 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2023-12-01T01:05:41.491 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2023-12-01T01:05:41.492 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2023-12-01T01:05:41.492 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2023-12-01T01:05:41.493 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2023-12-01T01:05:41.494 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2023-12-01T01:05:41.495 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2023-12-01T01:05:41.495 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2023-12-01T01:05:41.496 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2023-12-01T01:05:41.497 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2023-12-01T01:05:41.498 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2023-12-01T01:05:41.499 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2023-12-01T01:05:41.499 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2023-12-01T01:05:41.500 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2023-12-01T01:05:41.501 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2023-12-01T01:05:41.502 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2023-12-01T01:05:41.503 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2023-12-01T01:05:41.503 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2023-12-01T01:05:41.504 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2023-12-01T01:05:41.504 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2023-12-01T01:05:41.505 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2023-12-01T01:05:41.506 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2023-12-01T01:05:41.507 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2023-12-01T01:05:41.508 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2023-12-01T01:05:41.509 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2023-12-01T01:05:41.510 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2023-12-01T01:05:41.510 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2023-12-01T01:05:41.511 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2023-12-01T01:05:41.511 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2023-12-01T01:05:41.512 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2023-12-01T01:05:41.513 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2023-12-01T01:05:41.514 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2023-12-01T01:05:41.515 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2023-12-01T01:05:41.515 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2023-12-01T01:05:41.516 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2023-12-01T01:05:41.517 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2023-12-01T01:05:41.518 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2023-12-01T01:05:41.518 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2023-12-01T01:05:41.519 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2023-12-01T01:05:41.520 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2023-12-01T01:05:41.521 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2023-12-01T01:05:41.521 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2023-12-01T01:05:41.522 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2023-12-01T01:05:41.523 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2023-12-01T01:05:41.524 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2023-12-01T01:05:41.525 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2023-12-01T01:05:41.525 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2023-12-01T01:05:41.526 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2023-12-01T01:05:41.527 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2023-12-01T01:05:41.527 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2023-12-01T01:05:41.528 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2023-12-01T01:05:41.529 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2023-12-01T01:05:41.529 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2023-12-01T01:05:41.530 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2023-12-01T01:05:41.531 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2023-12-01T01:05:41.532 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2023-12-01T01:05:41.534 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2023-12-01T01:05:41.534 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2023-12-01T01:05:41.534 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2023-12-01T01:05:41.535 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2023-12-01T01:05:41.536 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2023-12-01T01:05:41.536 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2023-12-01T01:05:41.537 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2023-12-01T01:05:41.538 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2023-12-01T01:05:41.538 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2023-12-01T01:05:41.539 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2023-12-01T01:05:41.540 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2023-12-01T01:05:41.540 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2023-12-01T01:05:41.541 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2023-12-01T01:05:41.541 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2023-12-01T01:05:41.542 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2023-12-01T01:05:41.543 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2023-12-01T01:05:41.544 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2023-12-01T01:05:41.545 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2023-12-01T01:05:41.546 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2023-12-01T01:05:41.546 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2023-12-01T01:05:41.547 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2023-12-01T01:05:41.548 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2023-12-01T01:05:41.548 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2023-12-01T01:05:41.549 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2023-12-01T01:05:41.550 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2023-12-01T01:05:41.551 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2023-12-01T01:05:41.552 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2023-12-01T01:05:41.553 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2023-12-01T01:05:41.553 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2023-12-01T01:05:41.558 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2023-12-01T01:05:41.558 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2023-12-01T01:05:41.558 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2023-12-01T01:05:41.558 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2023-12-01T01:05:41.558 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2023-12-01T01:05:41.558 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2023-12-01T01:05:41.559 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2023-12-01T01:05:41.559 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2023-12-01T01:05:41.560 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2023-12-01T01:05:41.561 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2023-12-01T01:05:41.562 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2023-12-01T01:05:41.562 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2023-12-01T01:05:41.563 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2023-12-01T01:05:41.564 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2023-12-01T01:05:41.706 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2023-12-01T01:05:41.707 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2023-12-01T01:05:41.708 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2023-12-01T01:05:41.709 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2023-12-01T01:05:41.709 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2023-12-01T01:05:41.710 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2023-12-01T01:05:41.711 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2023-12-01T01:05:41.712 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2023-12-01T01:05:41.713 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2023-12-01T01:05:41.714 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2023-12-01T01:05:41.714 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2023-12-01T01:05:41.715 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2023-12-01T01:05:41.716 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2023-12-01T01:05:41.717 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2023-12-01T01:05:41.717 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2023-12-01T01:05:41.718 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2023-12-01T01:05:41.719 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2023-12-01T01:05:41.720 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2023-12-01T01:05:41.721 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2023-12-01T01:05:41.721 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2023-12-01T01:05:41.722 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2023-12-01T01:05:41.723 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2023-12-01T01:05:41.724 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2023-12-01T01:05:41.725 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2023-12-01T01:05:41.726 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2023-12-01T01:05:41.726 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2023-12-01T01:05:41.727 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2023-12-01T01:05:41.728 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2023-12-01T01:05:41.729 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2023-12-01T01:05:41.730 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2023-12-01T01:05:41.730 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2023-12-01T01:05:41.731 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2023-12-01T01:05:41.732 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2023-12-01T01:05:41.733 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2023-12-01T01:05:41.734 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2023-12-01T01:05:41.735 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2023-12-01T01:05:41.735 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2023-12-01T01:05:41.736 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2023-12-01T01:05:41.737 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2023-12-01T01:05:41.738 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2023-12-01T01:05:41.738 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2023-12-01T01:05:41.739 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2023-12-01T01:05:41.740 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2023-12-01T01:05:41.740 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2023-12-01T01:05:41.741 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2023-12-01T01:05:41.742 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2023-12-01T01:05:41.743 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2023-12-01T01:05:41.744 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2023-12-01T01:05:41.744 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2023-12-01T01:05:41.745 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2023-12-01T01:05:41.746 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2023-12-01T01:05:41.747 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2023-12-01T01:05:41.748 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2023-12-01T01:05:41.748 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2023-12-01T01:05:41.749 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2023-12-01T01:05:41.750 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2023-12-01T01:05:41.750 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2023-12-01T01:05:41.751 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2023-12-01T01:05:41.752 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2023-12-01T01:05:41.752 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2023-12-01T01:05:41.753 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2023-12-01T01:05:41.754 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2023-12-01T01:05:41.754 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2023-12-01T01:05:41.755 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2023-12-01T01:05:41.756 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2023-12-01T01:05:41.757 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2023-12-01T01:05:41.757 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2023-12-01T01:05:41.758 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2023-12-01T01:05:41.759 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2023-12-01T01:05:41.759 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2023-12-01T01:05:41.760 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2023-12-01T01:05:41.761 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2023-12-01T01:05:41.761 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2023-12-01T01:05:41.762 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2023-12-01T01:05:41.763 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2023-12-01T01:05:41.763 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2023-12-01T01:05:41.764 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2023-12-01T01:05:41.765 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2023-12-01T01:05:41.765 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2023-12-01T01:05:41.766 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2023-12-01T01:05:41.767 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2023-12-01T01:05:41.768 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2023-12-01T01:05:41.768 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2023-12-01T01:05:41.769 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2023-12-01T01:05:41.770 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2023-12-01T01:05:41.770 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2023-12-01T01:05:41.771 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2023-12-01T01:05:41.772 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2023-12-01T01:05:41.772 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2023-12-01T01:05:41.773 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2023-12-01T01:05:41.773 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2023-12-01T01:05:41.774 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2023-12-01T01:05:41.775 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2023-12-01T01:05:41.775 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2023-12-01T01:05:41.776 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2023-12-01T01:05:41.777 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2023-12-01T01:05:41.777 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2023-12-01T01:05:41.778 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2023-12-01T01:05:41.779 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2023-12-01T01:05:41.779 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2023-12-01T01:05:41.780 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2023-12-01T01:05:41.780 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2023-12-01T01:05:41.781 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2023-12-01T01:05:41.782 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2023-12-01T01:05:41.783 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2023-12-01T01:05:41.783 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2023-12-01T01:05:41.784 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2023-12-01T01:05:41.784 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2023-12-01T01:05:41.785 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2023-12-01T01:05:41.786 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2023-12-01T01:05:41.786 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2023-12-01T01:05:41.787 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2023-12-01T01:05:41.788 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2023-12-01T01:05:41.789 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2023-12-01T01:05:41.789 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2023-12-01T01:05:41.790 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2023-12-01T01:05:41.790 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2023-12-01T01:05:41.791 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2023-12-01T01:05:41.792 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2023-12-01T01:05:41.792 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2023-12-01T01:05:41.793 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2023-12-01T01:05:41.794 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2023-12-01T01:05:41.795 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2023-12-01T01:05:41.796 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2023-12-01T01:05:41.796 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2023-12-01T01:05:41.797 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2023-12-01T01:05:41.798 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2023-12-01T01:05:41.798 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2023-12-01T01:05:41.801 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2023-12-01T01:05:41.802 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2023-12-01T01:05:41.802 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2023-12-01T01:05:41.802 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2023-12-01T01:05:41.802 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2023-12-01T01:05:41.802 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2023-12-01T01:05:41.803 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2023-12-01T01:05:41.804 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2023-12-01T01:05:41.805 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2023-12-01T01:05:41.806 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2023-12-01T01:05:41.806 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2023-12-01T01:05:41.807 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2023-12-01T01:05:41.807 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2023-12-01T01:05:41.808 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2023-12-01T01:05:41.809 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2023-12-01T01:05:41.810 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2023-12-01T01:05:41.810 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2023-12-01T01:05:41.811 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2023-12-01T01:05:41.812 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2023-12-01T01:05:41.813 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2023-12-01T01:05:41.813 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2023-12-01T01:05:41.814 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2023-12-01T01:05:41.814 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2023-12-01T01:05:41.815 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2023-12-01T01:05:41.816 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2023-12-01T01:05:41.817 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2023-12-01T01:05:41.818 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2023-12-01T01:05:41.818 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2023-12-01T01:05:41.819 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2023-12-01T01:05:41.820 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2023-12-01T01:05:41.821 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2023-12-01T01:05:41.821 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2023-12-01T01:05:41.822 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2023-12-01T01:05:41.822 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2023-12-01T01:05:41.823 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2023-12-01T01:05:41.824 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2023-12-01T01:05:41.824 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2023-12-01T01:05:41.825 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2023-12-01T01:05:41.825 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2023-12-01T01:05:41.826 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2023-12-01T01:05:41.826 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2023-12-01T01:05:41.827 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2023-12-01T01:05:41.828 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2023-12-01T01:05:41.828 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2023-12-01T01:05:41.829 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2023-12-01T01:05:41.830 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2023-12-01T01:05:41.831 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2023-12-01T01:05:41.832 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2023-12-01T01:05:41.832 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2023-12-01T01:05:41.833 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2023-12-01T01:05:41.834 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2023-12-01T01:05:41.834 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2023-12-01T01:05:41.835 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2023-12-01T01:05:41.835 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2023-12-01T01:05:41.836 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2023-12-01T01:05:41.836 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2023-12-01T01:05:41.837 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2023-12-01T01:05:41.838 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2023-12-01T01:05:41.838 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2023-12-01T01:05:41.839 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2023-12-01T01:05:41.840 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2023-12-01T01:05:41.840 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2023-12-01T01:05:41.841 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2023-12-01T01:05:41.841 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2023-12-01T01:05:41.842 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2023-12-01T01:05:41.842 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2023-12-01T01:05:41.843 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2023-12-01T01:05:41.843 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2023-12-01T01:05:41.844 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2023-12-01T01:05:41.845 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2023-12-01T01:05:41.845 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2023-12-01T01:05:41.846 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2023-12-01T01:05:41.846 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2023-12-01T01:05:41.847 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2023-12-01T01:05:41.848 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2023-12-01T01:05:41.848 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2023-12-01T01:05:41.849 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2023-12-01T01:05:41.850 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2023-12-01T01:05:41.850 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2023-12-01T01:05:41.851 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2023-12-01T01:05:41.852 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2023-12-01T01:05:41.853 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2023-12-01T01:05:41.854 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2023-12-01T01:05:41.854 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2023-12-01T01:05:41.855 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2023-12-01T01:05:41.856 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2023-12-01T01:05:41.857 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2023-12-01T01:05:41.858 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2023-12-01T01:05:41.859 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2023-12-01T01:05:41.859 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2023-12-01T01:05:41.860 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2023-12-01T01:05:41.861 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2023-12-01T01:05:41.861 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2023-12-01T01:05:41.862 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2023-12-01T01:05:41.863 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2023-12-01T01:05:41.863 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2023-12-01T01:05:41.864 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2023-12-01T01:05:41.865 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2023-12-01T01:05:41.866 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2023-12-01T01:05:41.867 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2023-12-01T01:05:41.867 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2023-12-01T01:05:41.867 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2023-12-01T01:05:41.868 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2023-12-01T01:05:41.869 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2023-12-01T01:05:41.870 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2023-12-01T01:05:41.871 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2023-12-01T01:05:41.871 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2023-12-01T01:05:41.872 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2023-12-01T01:05:41.873 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2023-12-01T01:05:41.874 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2023-12-01T01:05:41.874 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2023-12-01T01:05:41.875 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2023-12-01T01:05:41.876 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2023-12-01T01:05:41.877 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2023-12-01T01:05:41.878 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2023-12-01T01:05:41.878 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2023-12-01T01:05:41.881 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2023-12-01T01:05:41.881 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2023-12-01T01:05:41.881 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2023-12-01T01:05:41.882 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2023-12-01T01:05:41.882 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2023-12-01T01:05:41.882 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2023-12-01T01:05:41.883 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2023-12-01T01:05:41.884 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2023-12-01T01:05:41.885 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2023-12-01T01:05:41.885 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2023-12-01T01:05:41.885 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2023-12-01T01:05:41.886 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2023-12-01T01:05:41.886 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2023-12-01T01:05:41.887 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2023-12-01T01:05:41.887 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2023-12-01T01:05:41.888 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2023-12-01T01:05:41.889 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2023-12-01T01:05:41.889 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2023-12-01T01:05:41.890 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2023-12-01T01:05:41.890 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2023-12-01T01:05:41.891 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2023-12-01T01:05:41.892 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2023-12-01T01:05:41.892 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2023-12-01T01:05:41.893 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2023-12-01T01:05:41.893 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2023-12-01T01:05:41.894 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2023-12-01T01:05:41.894 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2023-12-01T01:05:41.895 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2023-12-01T01:05:41.896 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2023-12-01T01:05:41.896 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2023-12-01T01:05:41.896 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2023-12-01T01:05:41.897 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2023-12-01T01:05:41.898 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2023-12-01T01:05:41.898 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2023-12-01T01:05:41.899 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2023-12-01T01:05:41.900 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2023-12-01T01:05:41.900 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2023-12-01T01:05:41.901 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2023-12-01T01:05:41.901 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2023-12-01T01:05:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2023-12-01T01:05:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2023-12-01T01:05:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2023-12-01T01:05:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2023-12-01T01:05:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2023-12-01T01:05:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2023-12-01T01:05:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2023-12-01T01:05:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2023-12-01T01:05:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2023-12-01T01:05:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2023-12-01T01:05:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2023-12-01T01:05:41.909 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2023-12-01T01:05:41.909 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2023-12-01T01:05:41.910 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2023-12-01T01:05:41.911 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2023-12-01T01:05:41.912 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2023-12-01T01:05:41.912 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2023-12-01T01:05:41.913 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2023-12-01T01:05:41.914 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2023-12-01T01:05:41.914 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2023-12-01T01:05:41.915 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2023-12-01T01:05:41.916 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2023-12-01T01:05:41.917 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2023-12-01T01:05:41.918 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2023-12-01T01:05:41.919 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2023-12-01T01:05:41.919 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2023-12-01T01:05:41.920 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2023-12-01T01:05:41.921 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2023-12-01T01:05:41.921 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2023-12-01T01:05:41.922 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2023-12-01T01:05:41.923 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2023-12-01T01:05:41.923 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2023-12-01T01:05:41.924 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2023-12-01T01:05:41.925 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2023-12-01T01:05:41.926 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2023-12-01T01:05:41.926 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2023-12-01T01:05:41.927 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2023-12-01T01:05:41.928 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2023-12-01T01:05:41.928 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2023-12-01T01:05:41.929 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2023-12-01T01:05:41.930 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2023-12-01T01:05:41.932 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2023-12-01T01:05:41.932 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2023-12-01T01:05:41.932 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2023-12-01T01:05:41.933 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2023-12-01T01:05:41.933 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2023-12-01T01:05:41.934 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2023-12-01T01:05:41.935 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2023-12-01T01:05:41.935 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2023-12-01T01:05:41.936 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2023-12-01T01:05:41.937 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2023-12-01T01:05:41.937 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2023-12-01T01:05:41.938 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2023-12-01T01:05:41.939 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2023-12-01T01:05:41.940 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2023-12-01T01:05:41.940 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2023-12-01T01:05:41.941 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2023-12-01T01:05:41.942 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2023-12-01T01:05:41.943 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2023-12-01T01:05:41.944 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2023-12-01T01:05:41.944 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2023-12-01T01:05:41.945 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2023-12-01T01:05:41.946 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2023-12-01T01:05:41.946 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2023-12-01T01:05:41.947 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2023-12-01T01:05:41.948 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2023-12-01T01:05:41.948 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2023-12-01T01:05:41.949 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2023-12-01T01:05:41.950 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2023-12-01T01:05:41.950 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2023-12-01T01:05:41.951 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2023-12-01T01:05:41.951 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2023-12-01T01:05:41.953 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2023-12-01T01:05:41.953 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2023-12-01T01:05:41.953 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2023-12-01T01:05:41.954 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2023-12-01T01:05:41.954 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2023-12-01T01:05:41.955 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2023-12-01T01:05:41.956 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2023-12-01T01:05:41.956 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2023-12-01T01:05:41.957 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2023-12-01T01:05:41.957 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2023-12-01T01:05:41.958 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2023-12-01T01:05:41.958 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2023-12-01T01:05:41.959 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2023-12-01T01:05:41.960 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2023-12-01T01:05:41.960 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2023-12-01T01:05:41.961 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2023-12-01T01:05:41.961 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2023-12-01T01:05:41.962 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2023-12-01T01:05:41.963 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2023-12-01T01:05:41.963 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2023-12-01T01:05:41.965 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2023-12-01T01:05:41.965 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2023-12-01T01:05:41.966 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2023-12-01T01:05:41.970 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2023-12-01T01:05:41.970 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2023-12-01T01:05:41.970 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2023-12-01T01:05:41.970 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2023-12-01T01:05:41.970 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2023-12-01T01:05:41.971 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2023-12-01T01:05:41.971 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2023-12-01T01:05:41.972 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2023-12-01T01:05:41.973 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2023-12-01T01:05:41.974 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2023-12-01T01:05:41.974 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2023-12-01T01:05:41.975 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2023-12-01T01:05:41.976 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2023-12-01T01:05:41.977 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2023-12-01T01:05:41.978 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2023-12-01T01:05:41.978 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2023-12-01T01:05:41.979 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2023-12-01T01:05:41.980 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2023-12-01T01:05:41.981 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2023-12-01T01:05:41.982 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2023-12-01T01:05:41.983 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2023-12-01T01:05:41.983 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2023-12-01T01:05:41.984 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2023-12-01T01:05:41.985 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2023-12-01T01:05:41.986 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2023-12-01T01:05:41.987 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2023-12-01T01:05:41.987 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2023-12-01T01:05:41.988 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2023-12-01T01:05:41.989 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2023-12-01T01:05:41.989 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2023-12-01T01:05:41.990 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2023-12-01T01:05:41.991 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2023-12-01T01:05:41.992 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2023-12-01T01:05:41.992 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2023-12-01T01:05:41.993 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2023-12-01T01:05:41.994 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2023-12-01T01:05:41.995 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2023-12-01T01:05:41.995 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2023-12-01T01:05:41.996 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2023-12-01T01:05:41.996 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2023-12-01T01:05:41.997 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2023-12-01T01:05:41.998 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2023-12-01T01:05:41.998 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2023-12-01T01:05:41.999 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2023-12-01T01:05:41.999 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2023-12-01T01:05:42.000 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2023-12-01T01:05:42.001 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2023-12-01T01:05:42.001 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2023-12-01T01:05:42.002 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2023-12-01T01:05:42.002 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2023-12-01T01:05:42.003 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2023-12-01T01:05:42.004 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2023-12-01T01:05:42.004 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2023-12-01T01:05:42.005 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2023-12-01T01:05:42.005 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2023-12-01T01:05:42.006 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2023-12-01T01:05:42.007 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2023-12-01T01:05:42.007 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2023-12-01T01:05:42.008 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2023-12-01T01:05:42.008 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2023-12-01T01:05:42.009 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2023-12-01T01:05:42.009 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2023-12-01T01:05:42.010 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2023-12-01T01:05:42.011 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2023-12-01T01:05:42.012 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2023-12-01T01:05:42.013 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2023-12-01T01:05:42.013 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2023-12-01T01:05:42.014 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2023-12-01T01:05:42.015 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2023-12-01T01:05:42.016 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2023-12-01T01:05:42.017 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2023-12-01T01:05:42.017 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2023-12-01T01:05:42.018 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2023-12-01T01:05:42.019 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2023-12-01T01:05:42.019 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2023-12-01T01:05:42.020 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2023-12-01T01:05:42.020 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2023-12-01T01:05:42.021 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2023-12-01T01:05:42.022 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2023-12-01T01:05:42.023 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2023-12-01T01:05:42.023 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2023-12-01T01:05:42.024 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2023-12-01T01:05:42.025 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2023-12-01T01:05:42.025 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2023-12-01T01:05:42.026 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2023-12-01T01:05:42.026 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2023-12-01T01:05:42.027 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2023-12-01T01:05:42.028 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2023-12-01T01:05:42.029 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2023-12-01T01:05:42.030 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2023-12-01T01:05:42.031 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2023-12-01T01:05:42.032 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2023-12-01T01:05:42.033 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2023-12-01T01:05:42.034 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2023-12-01T01:05:42.034 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2023-12-01T01:05:42.035 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2023-12-01T01:05:42.035 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2023-12-01T01:05:42.036 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2023-12-01T01:05:42.037 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2023-12-01T01:05:42.037 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2023-12-01T01:05:42.038 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2023-12-01T01:05:42.039 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2023-12-01T01:05:42.039 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2023-12-01T01:05:42.040 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2023-12-01T01:05:42.040 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2023-12-01T01:05:42.041 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2023-12-01T01:05:42.042 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2023-12-01T01:05:42.042 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2023-12-01T01:05:42.043 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2023-12-01T01:05:42.044 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2023-12-01T01:05:42.045 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2023-12-01T01:05:42.046 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2023-12-01T01:05:42.047 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2023-12-01T01:05:42.047 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2023-12-01T01:05:42.048 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2023-12-01T01:05:42.049 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2023-12-01T01:05:42.049 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2023-12-01T01:05:42.050 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2023-12-01T01:05:42.051 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2023-12-01T01:05:42.052 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2023-12-01T01:05:42.053 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2023-12-01T01:05:42.054 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2023-12-01T01:05:42.054 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2023-12-01T01:05:42.055 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2023-12-01T01:05:42.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:41 smithi116 ceph-mon[103554]: pgmap v334: 97 pgs: 97 active+clean; 72 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 6.0 MiB/s wr, 23 op/s 2023-12-01T01:05:42.186 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2023-12-01T01:05:42.187 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2023-12-01T01:05:42.188 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2023-12-01T01:05:42.189 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2023-12-01T01:05:42.189 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2023-12-01T01:05:42.190 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2023-12-01T01:05:42.192 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2023-12-01T01:05:42.192 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2023-12-01T01:05:42.193 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2023-12-01T01:05:42.194 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2023-12-01T01:05:42.195 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2023-12-01T01:05:42.196 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2023-12-01T01:05:42.196 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2023-12-01T01:05:42.197 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2023-12-01T01:05:42.198 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2023-12-01T01:05:42.199 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2023-12-01T01:05:42.199 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2023-12-01T01:05:42.200 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2023-12-01T01:05:42.201 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2023-12-01T01:05:42.201 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2023-12-01T01:05:42.202 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2023-12-01T01:05:42.203 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2023-12-01T01:05:42.203 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2023-12-01T01:05:42.205 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2023-12-01T01:05:42.205 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2023-12-01T01:05:42.206 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2023-12-01T01:05:42.206 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2023-12-01T01:05:42.208 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2023-12-01T01:05:42.208 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2023-12-01T01:05:42.209 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2023-12-01T01:05:42.209 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2023-12-01T01:05:42.210 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2023-12-01T01:05:42.211 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2023-12-01T01:05:42.212 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2023-12-01T01:05:42.212 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2023-12-01T01:05:42.213 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2023-12-01T01:05:42.214 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2023-12-01T01:05:42.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:41 smithi093 ceph-mon[103327]: pgmap v334: 97 pgs: 97 active+clean; 72 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 6.0 MiB/s wr, 23 op/s 2023-12-01T01:05:42.215 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2023-12-01T01:05:42.215 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2023-12-01T01:05:42.216 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2023-12-01T01:05:42.217 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2023-12-01T01:05:42.218 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2023-12-01T01:05:42.218 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2023-12-01T01:05:42.219 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2023-12-01T01:05:42.220 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2023-12-01T01:05:42.221 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2023-12-01T01:05:42.222 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2023-12-01T01:05:42.222 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2023-12-01T01:05:42.223 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2023-12-01T01:05:42.225 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2023-12-01T01:05:42.225 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2023-12-01T01:05:42.226 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2023-12-01T01:05:42.227 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2023-12-01T01:05:42.228 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2023-12-01T01:05:42.229 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2023-12-01T01:05:42.229 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2023-12-01T01:05:42.230 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2023-12-01T01:05:42.231 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2023-12-01T01:05:42.232 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2023-12-01T01:05:42.233 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2023-12-01T01:05:42.234 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2023-12-01T01:05:42.235 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2023-12-01T01:05:42.236 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2023-12-01T01:05:42.236 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2023-12-01T01:05:42.237 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2023-12-01T01:05:42.238 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2023-12-01T01:05:42.239 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2023-12-01T01:05:42.239 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2023-12-01T01:05:42.240 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2023-12-01T01:05:42.241 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2023-12-01T01:05:42.241 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2023-12-01T01:05:42.242 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2023-12-01T01:05:42.243 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2023-12-01T01:05:42.243 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2023-12-01T01:05:42.244 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2023-12-01T01:05:42.245 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2023-12-01T01:05:42.245 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2023-12-01T01:05:42.246 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2023-12-01T01:05:42.247 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2023-12-01T01:05:42.247 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2023-12-01T01:05:42.248 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2023-12-01T01:05:42.249 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2023-12-01T01:05:42.250 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2023-12-01T01:05:42.250 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2023-12-01T01:05:42.251 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2023-12-01T01:05:42.252 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2023-12-01T01:05:42.252 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2023-12-01T01:05:42.253 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2023-12-01T01:05:42.254 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2023-12-01T01:05:42.255 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2023-12-01T01:05:42.255 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2023-12-01T01:05:42.256 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2023-12-01T01:05:42.256 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2023-12-01T01:05:42.257 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2023-12-01T01:05:42.257 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2023-12-01T01:05:42.258 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2023-12-01T01:05:42.259 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2023-12-01T01:05:42.259 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2023-12-01T01:05:42.260 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2023-12-01T01:05:42.261 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2023-12-01T01:05:42.261 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2023-12-01T01:05:42.262 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2023-12-01T01:05:42.263 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2023-12-01T01:05:42.264 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2023-12-01T01:05:42.264 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2023-12-01T01:05:42.265 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2023-12-01T01:05:42.265 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2023-12-01T01:05:42.266 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2023-12-01T01:05:42.267 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2023-12-01T01:05:42.268 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2023-12-01T01:05:42.269 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2023-12-01T01:05:42.270 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2023-12-01T01:05:42.271 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2023-12-01T01:05:42.272 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2023-12-01T01:05:42.273 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2023-12-01T01:05:42.274 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2023-12-01T01:05:42.275 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2023-12-01T01:05:42.275 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2023-12-01T01:05:42.276 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2023-12-01T01:05:42.277 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2023-12-01T01:05:42.278 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2023-12-01T01:05:42.278 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2023-12-01T01:05:42.279 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2023-12-01T01:05:42.279 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2023-12-01T01:05:42.280 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2023-12-01T01:05:42.281 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2023-12-01T01:05:42.281 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2023-12-01T01:05:42.282 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2023-12-01T01:05:42.283 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2023-12-01T01:05:42.284 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2023-12-01T01:05:42.285 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2023-12-01T01:05:42.286 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2023-12-01T01:05:42.286 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2023-12-01T01:05:42.287 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2023-12-01T01:05:42.287 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2023-12-01T01:05:42.288 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2023-12-01T01:05:42.289 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2023-12-01T01:05:42.289 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2023-12-01T01:05:42.290 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2023-12-01T01:05:42.290 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2023-12-01T01:05:42.291 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2023-12-01T01:05:42.292 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2023-12-01T01:05:42.293 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2023-12-01T01:05:42.294 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2023-12-01T01:05:42.294 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2023-12-01T01:05:42.295 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2023-12-01T01:05:42.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:41 smithi026 ceph-mon[98801]: pgmap v334: 97 pgs: 97 active+clean; 72 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 6.0 MiB/s wr, 23 op/s 2023-12-01T01:05:42.296 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2023-12-01T01:05:42.296 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2023-12-01T01:05:42.297 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2023-12-01T01:05:42.298 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2023-12-01T01:05:42.298 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2023-12-01T01:05:42.299 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2023-12-01T01:05:42.300 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2023-12-01T01:05:42.300 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2023-12-01T01:05:42.301 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2023-12-01T01:05:42.301 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2023-12-01T01:05:42.302 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2023-12-01T01:05:42.303 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2023-12-01T01:05:42.303 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2023-12-01T01:05:42.304 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2023-12-01T01:05:42.305 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2023-12-01T01:05:42.305 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2023-12-01T01:05:42.306 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2023-12-01T01:05:42.307 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2023-12-01T01:05:42.308 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2023-12-01T01:05:42.308 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2023-12-01T01:05:42.309 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2023-12-01T01:05:42.310 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2023-12-01T01:05:42.311 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2023-12-01T01:05:42.311 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2023-12-01T01:05:42.312 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2023-12-01T01:05:42.312 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2023-12-01T01:05:42.313 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2023-12-01T01:05:42.314 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2023-12-01T01:05:42.315 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2023-12-01T01:05:42.315 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2023-12-01T01:05:42.316 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2023-12-01T01:05:42.316 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2023-12-01T01:05:42.317 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2023-12-01T01:05:42.318 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2023-12-01T01:05:42.318 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2023-12-01T01:05:42.319 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2023-12-01T01:05:42.320 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2023-12-01T01:05:42.320 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2023-12-01T01:05:42.321 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2023-12-01T01:05:42.322 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2023-12-01T01:05:42.322 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2023-12-01T01:05:42.323 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2023-12-01T01:05:42.323 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2023-12-01T01:05:42.324 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2023-12-01T01:05:42.325 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2023-12-01T01:05:42.325 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2023-12-01T01:05:42.326 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2023-12-01T01:05:42.327 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2023-12-01T01:05:42.327 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2023-12-01T01:05:42.328 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2023-12-01T01:05:42.329 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2023-12-01T01:05:42.330 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2023-12-01T01:05:42.330 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2023-12-01T01:05:42.331 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2023-12-01T01:05:42.332 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2023-12-01T01:05:42.333 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2023-12-01T01:05:42.333 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2023-12-01T01:05:42.334 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2023-12-01T01:05:42.337 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2023-12-01T01:05:42.337 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2023-12-01T01:05:42.337 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2023-12-01T01:05:42.338 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2023-12-01T01:05:42.339 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2023-12-01T01:05:42.340 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2023-12-01T01:05:42.342 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2023-12-01T01:05:42.344 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2023-12-01T01:05:42.346 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2023-12-01T01:05:42.348 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2023-12-01T01:05:42.349 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2023-12-01T01:05:42.350 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2023-12-01T01:05:42.352 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2023-12-01T01:05:42.353 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2023-12-01T01:05:42.355 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2023-12-01T01:05:42.356 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2023-12-01T01:05:42.356 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2023-12-01T01:05:42.357 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2023-12-01T01:05:42.358 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2023-12-01T01:05:42.359 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2023-12-01T01:05:42.360 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2023-12-01T01:05:42.360 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2023-12-01T01:05:42.362 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2023-12-01T01:05:42.364 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2023-12-01T01:05:42.365 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2023-12-01T01:05:42.366 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2023-12-01T01:05:42.368 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2023-12-01T01:05:42.369 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2023-12-01T01:05:42.370 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2023-12-01T01:05:42.371 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2023-12-01T01:05:42.372 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2023-12-01T01:05:42.373 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2023-12-01T01:05:42.374 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2023-12-01T01:05:42.377 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2023-12-01T01:05:42.378 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2023-12-01T01:05:42.378 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2023-12-01T01:05:42.378 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2023-12-01T01:05:42.379 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2023-12-01T01:05:42.379 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2023-12-01T01:05:42.380 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2023-12-01T01:05:42.382 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2023-12-01T01:05:42.382 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2023-12-01T01:05:42.383 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2023-12-01T01:05:42.384 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2023-12-01T01:05:42.386 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2023-12-01T01:05:42.387 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2023-12-01T01:05:42.388 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2023-12-01T01:05:42.390 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2023-12-01T01:05:42.391 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2023-12-01T01:05:42.392 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2023-12-01T01:05:42.393 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2023-12-01T01:05:42.395 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2023-12-01T01:05:42.396 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2023-12-01T01:05:42.398 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2023-12-01T01:05:42.399 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2023-12-01T01:05:42.401 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2023-12-01T01:05:42.402 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2023-12-01T01:05:42.403 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2023-12-01T01:05:42.405 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2023-12-01T01:05:42.406 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2023-12-01T01:05:42.407 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2023-12-01T01:05:42.408 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2023-12-01T01:05:42.409 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2023-12-01T01:05:42.410 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2023-12-01T01:05:42.411 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2023-12-01T01:05:42.412 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2023-12-01T01:05:42.413 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2023-12-01T01:05:42.414 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2023-12-01T01:05:42.414 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2023-12-01T01:05:42.415 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2023-12-01T01:05:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2023-12-01T01:05:42.418 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2023-12-01T01:05:42.419 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2023-12-01T01:05:42.420 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2023-12-01T01:05:42.421 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2023-12-01T01:05:42.422 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2023-12-01T01:05:42.423 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2023-12-01T01:05:42.424 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2023-12-01T01:05:42.424 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2023-12-01T01:05:42.425 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2023-12-01T01:05:42.426 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2023-12-01T01:05:42.427 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2023-12-01T01:05:42.428 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2023-12-01T01:05:42.428 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2023-12-01T01:05:42.429 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2023-12-01T01:05:42.430 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2023-12-01T01:05:42.431 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2023-12-01T01:05:42.432 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2023-12-01T01:05:42.433 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2023-12-01T01:05:42.433 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2023-12-01T01:05:42.434 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2023-12-01T01:05:42.435 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2023-12-01T01:05:42.436 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2023-12-01T01:05:42.438 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2023-12-01T01:05:42.438 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2023-12-01T01:05:42.440 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2023-12-01T01:05:42.441 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2023-12-01T01:05:42.443 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2023-12-01T01:05:42.444 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2023-12-01T01:05:42.446 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2023-12-01T01:05:42.447 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2023-12-01T01:05:42.449 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2023-12-01T01:05:42.450 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2023-12-01T01:05:42.452 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2023-12-01T01:05:42.453 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2023-12-01T01:05:42.454 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2023-12-01T01:05:42.455 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2023-12-01T01:05:42.456 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2023-12-01T01:05:42.458 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2023-12-01T01:05:42.459 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2023-12-01T01:05:42.460 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2023-12-01T01:05:42.461 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2023-12-01T01:05:42.462 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2023-12-01T01:05:42.463 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2023-12-01T01:05:42.464 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2023-12-01T01:05:42.466 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2023-12-01T01:05:42.467 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2023-12-01T01:05:42.468 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2023-12-01T01:05:42.469 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2023-12-01T01:05:42.470 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2023-12-01T01:05:42.471 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2023-12-01T01:05:42.472 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2023-12-01T01:05:42.473 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2023-12-01T01:05:42.474 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2023-12-01T01:05:42.475 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2023-12-01T01:05:42.476 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2023-12-01T01:05:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2023-12-01T01:05:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2023-12-01T01:05:42.478 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2023-12-01T01:05:42.481 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2023-12-01T01:05:42.482 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2023-12-01T01:05:42.483 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2023-12-01T01:05:42.484 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2023-12-01T01:05:42.485 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2023-12-01T01:05:42.485 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2023-12-01T01:05:42.486 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2023-12-01T01:05:42.487 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2023-12-01T01:05:42.488 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2023-12-01T01:05:42.488 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2023-12-01T01:05:42.489 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2023-12-01T01:05:42.490 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2023-12-01T01:05:42.491 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2023-12-01T01:05:42.492 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2023-12-01T01:05:42.493 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2023-12-01T01:05:42.496 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2023-12-01T01:05:42.496 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2023-12-01T01:05:42.496 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2023-12-01T01:05:42.497 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2023-12-01T01:05:42.498 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2023-12-01T01:05:42.499 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2023-12-01T01:05:42.500 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2023-12-01T01:05:42.502 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2023-12-01T01:05:42.503 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2023-12-01T01:05:42.504 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2023-12-01T01:05:42.504 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2023-12-01T01:05:42.505 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2023-12-01T01:05:42.505 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2023-12-01T01:05:42.506 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2023-12-01T01:05:42.507 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2023-12-01T01:05:42.508 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2023-12-01T01:05:42.509 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2023-12-01T01:05:42.509 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2023-12-01T01:05:42.510 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2023-12-01T01:05:42.511 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2023-12-01T01:05:42.512 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2023-12-01T01:05:42.512 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2023-12-01T01:05:42.514 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2023-12-01T01:05:42.514 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2023-12-01T01:05:42.514 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2023-12-01T01:05:42.515 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2023-12-01T01:05:42.516 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2023-12-01T01:05:42.517 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2023-12-01T01:05:42.518 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2023-12-01T01:05:42.519 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2023-12-01T01:05:42.519 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2023-12-01T01:05:42.520 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2023-12-01T01:05:42.521 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2023-12-01T01:05:42.521 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2023-12-01T01:05:42.522 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2023-12-01T01:05:42.522 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2023-12-01T01:05:42.523 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2023-12-01T01:05:42.524 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2023-12-01T01:05:42.524 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2023-12-01T01:05:42.525 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2023-12-01T01:05:42.526 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2023-12-01T01:05:42.526 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2023-12-01T01:05:42.527 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2023-12-01T01:05:42.527 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2023-12-01T01:05:42.528 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2023-12-01T01:05:42.528 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2023-12-01T01:05:42.529 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2023-12-01T01:05:42.530 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2023-12-01T01:05:42.531 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2023-12-01T01:05:42.532 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2023-12-01T01:05:42.532 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2023-12-01T01:05:42.533 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2023-12-01T01:05:42.534 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2023-12-01T01:05:42.534 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2023-12-01T01:05:42.535 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2023-12-01T01:05:42.535 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2023-12-01T01:05:42.536 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2023-12-01T01:05:42.537 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2023-12-01T01:05:42.537 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2023-12-01T01:05:42.538 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2023-12-01T01:05:42.539 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2023-12-01T01:05:42.539 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2023-12-01T01:05:42.540 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2023-12-01T01:05:42.540 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2023-12-01T01:05:42.541 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2023-12-01T01:05:42.542 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2023-12-01T01:05:42.542 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2023-12-01T01:05:42.543 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2023-12-01T01:05:42.543 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2023-12-01T01:05:42.544 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2023-12-01T01:05:42.545 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2023-12-01T01:05:42.545 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2023-12-01T01:05:42.546 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2023-12-01T01:05:42.547 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2023-12-01T01:05:42.548 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2023-12-01T01:05:42.548 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2023-12-01T01:05:42.549 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2023-12-01T01:05:42.550 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2023-12-01T01:05:42.550 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2023-12-01T01:05:42.551 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2023-12-01T01:05:42.552 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2023-12-01T01:05:42.552 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2023-12-01T01:05:42.553 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2023-12-01T01:05:42.554 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2023-12-01T01:05:42.555 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2023-12-01T01:05:42.556 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2023-12-01T01:05:42.557 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2023-12-01T01:05:42.558 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2023-12-01T01:05:42.558 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2023-12-01T01:05:42.559 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2023-12-01T01:05:42.560 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2023-12-01T01:05:42.560 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2023-12-01T01:05:42.561 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2023-12-01T01:05:42.562 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2023-12-01T01:05:42.563 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2023-12-01T01:05:42.564 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2023-12-01T01:05:42.565 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2023-12-01T01:05:42.565 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2023-12-01T01:05:42.566 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2023-12-01T01:05:42.566 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2023-12-01T01:05:42.567 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2023-12-01T01:05:42.568 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2023-12-01T01:05:42.569 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2023-12-01T01:05:42.570 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2023-12-01T01:05:42.570 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2023-12-01T01:05:42.571 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2023-12-01T01:05:42.572 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2023-12-01T01:05:42.573 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2023-12-01T01:05:42.573 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2023-12-01T01:05:42.574 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2023-12-01T01:05:42.575 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2023-12-01T01:05:42.575 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2023-12-01T01:05:42.576 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2023-12-01T01:05:42.576 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2023-12-01T01:05:42.577 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2023-12-01T01:05:42.578 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2023-12-01T01:05:42.578 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2023-12-01T01:05:42.582 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2023-12-01T01:05:42.582 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2023-12-01T01:05:42.582 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2023-12-01T01:05:42.582 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2023-12-01T01:05:42.583 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2023-12-01T01:05:42.583 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2023-12-01T01:05:42.584 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2023-12-01T01:05:42.585 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2023-12-01T01:05:42.586 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2023-12-01T01:05:42.586 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2023-12-01T01:05:42.586 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2023-12-01T01:05:42.587 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2023-12-01T01:05:42.588 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2023-12-01T01:05:42.588 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2023-12-01T01:05:42.589 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2023-12-01T01:05:42.590 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2023-12-01T01:05:42.591 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2023-12-01T01:05:42.591 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2023-12-01T01:05:42.592 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2023-12-01T01:05:42.593 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2023-12-01T01:05:42.594 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2023-12-01T01:05:42.595 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2023-12-01T01:05:42.597 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2023-12-01T01:05:42.597 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2023-12-01T01:05:42.597 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2023-12-01T01:05:42.597 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2023-12-01T01:05:42.598 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2023-12-01T01:05:42.598 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2023-12-01T01:05:42.599 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2023-12-01T01:05:42.600 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2023-12-01T01:05:42.601 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2023-12-01T01:05:42.601 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2023-12-01T01:05:42.602 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2023-12-01T01:05:42.603 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2023-12-01T01:05:42.603 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2023-12-01T01:05:42.604 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2023-12-01T01:05:42.605 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2023-12-01T01:05:42.605 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2023-12-01T01:05:42.606 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2023-12-01T01:05:42.606 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2023-12-01T01:05:42.607 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2023-12-01T01:05:42.607 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2023-12-01T01:05:42.608 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2023-12-01T01:05:42.609 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2023-12-01T01:05:42.610 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2023-12-01T01:05:42.610 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2023-12-01T01:05:42.611 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2023-12-01T01:05:42.612 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2023-12-01T01:05:42.612 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2023-12-01T01:05:42.613 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2023-12-01T01:05:42.613 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2023-12-01T01:05:42.614 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2023-12-01T01:05:42.615 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2023-12-01T01:05:42.615 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2023-12-01T01:05:42.616 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2023-12-01T01:05:42.617 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2023-12-01T01:05:42.617 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2023-12-01T01:05:42.618 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2023-12-01T01:05:42.618 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2023-12-01T01:05:42.619 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2023-12-01T01:05:42.620 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2023-12-01T01:05:42.621 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2023-12-01T01:05:42.621 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2023-12-01T01:05:42.622 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2023-12-01T01:05:42.624 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2023-12-01T01:05:42.624 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2023-12-01T01:05:42.625 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2023-12-01T01:05:42.626 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2023-12-01T01:05:42.627 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2023-12-01T01:05:42.627 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2023-12-01T01:05:42.628 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2023-12-01T01:05:42.629 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2023-12-01T01:05:42.630 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2023-12-01T01:05:42.630 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2023-12-01T01:05:42.631 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2023-12-01T01:05:42.632 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2023-12-01T01:05:42.632 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2023-12-01T01:05:42.633 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2023-12-01T01:05:42.633 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2023-12-01T01:05:42.634 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2023-12-01T01:05:42.635 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2023-12-01T01:05:42.635 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2023-12-01T01:05:42.636 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2023-12-01T01:05:42.637 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2023-12-01T01:05:42.637 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2023-12-01T01:05:42.638 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2023-12-01T01:05:42.639 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2023-12-01T01:05:42.640 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2023-12-01T01:05:42.640 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2023-12-01T01:05:42.641 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2023-12-01T01:05:42.642 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2023-12-01T01:05:42.642 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2023-12-01T01:05:42.643 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2023-12-01T01:05:42.644 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2023-12-01T01:05:42.645 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2023-12-01T01:05:42.646 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2023-12-01T01:05:42.647 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2023-12-01T01:05:42.648 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2023-12-01T01:05:42.648 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2023-12-01T01:05:42.649 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2023-12-01T01:05:42.650 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2023-12-01T01:05:42.650 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2023-12-01T01:05:42.651 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2023-12-01T01:05:42.652 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2023-12-01T01:05:42.652 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2023-12-01T01:05:42.653 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2023-12-01T01:05:42.654 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2023-12-01T01:05:42.654 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2023-12-01T01:05:42.655 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2023-12-01T01:05:42.656 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2023-12-01T01:05:42.656 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2023-12-01T01:05:42.657 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2023-12-01T01:05:42.658 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2023-12-01T01:05:42.659 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2023-12-01T01:05:42.659 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2023-12-01T01:05:42.660 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2023-12-01T01:05:42.661 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2023-12-01T01:05:42.661 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2023-12-01T01:05:42.662 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2023-12-01T01:05:42.663 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2023-12-01T01:05:42.663 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2023-12-01T01:05:42.664 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2023-12-01T01:05:42.664 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2023-12-01T01:05:42.665 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2023-12-01T01:05:42.666 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2023-12-01T01:05:42.666 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2023-12-01T01:05:42.667 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2023-12-01T01:05:42.668 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2023-12-01T01:05:42.668 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2023-12-01T01:05:42.669 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2023-12-01T01:05:42.669 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2023-12-01T01:05:42.670 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2023-12-01T01:05:42.671 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2023-12-01T01:05:42.672 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2023-12-01T01:05:42.672 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2023-12-01T01:05:42.673 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2023-12-01T01:05:42.674 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2023-12-01T01:05:42.675 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2023-12-01T01:05:42.676 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2023-12-01T01:05:42.676 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2023-12-01T01:05:42.677 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2023-12-01T01:05:42.678 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2023-12-01T01:05:42.678 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2023-12-01T01:05:42.679 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2023-12-01T01:05:42.679 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2023-12-01T01:05:42.680 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2023-12-01T01:05:42.681 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2023-12-01T01:05:42.682 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2023-12-01T01:05:42.683 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2023-12-01T01:05:42.683 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2023-12-01T01:05:42.684 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2023-12-01T01:05:42.685 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2023-12-01T01:05:42.686 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2023-12-01T01:05:42.687 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2023-12-01T01:05:42.687 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2023-12-01T01:05:42.688 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2023-12-01T01:05:42.689 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2023-12-01T01:05:42.690 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2023-12-01T01:05:42.690 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2023-12-01T01:05:42.691 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2023-12-01T01:05:42.691 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2023-12-01T01:05:42.692 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2023-12-01T01:05:42.692 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2023-12-01T01:05:42.693 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2023-12-01T01:05:42.694 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2023-12-01T01:05:42.694 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2023-12-01T01:05:42.695 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2023-12-01T01:05:42.696 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2023-12-01T01:05:42.696 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2023-12-01T01:05:42.697 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2023-12-01T01:05:42.697 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2023-12-01T01:05:42.698 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2023-12-01T01:05:42.699 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2023-12-01T01:05:42.699 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2023-12-01T01:05:42.700 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2023-12-01T01:05:42.701 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2023-12-01T01:05:42.701 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2023-12-01T01:05:42.702 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2023-12-01T01:05:42.703 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2023-12-01T01:05:42.703 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2023-12-01T01:05:42.704 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2023-12-01T01:05:42.705 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2023-12-01T01:05:42.706 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2023-12-01T01:05:42.707 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2023-12-01T01:05:42.708 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2023-12-01T01:05:42.709 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2023-12-01T01:05:42.710 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2023-12-01T01:05:42.710 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2023-12-01T01:05:42.711 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2023-12-01T01:05:42.712 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2023-12-01T01:05:42.712 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2023-12-01T01:05:42.713 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2023-12-01T01:05:42.714 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2023-12-01T01:05:42.714 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2023-12-01T01:05:42.715 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2023-12-01T01:05:42.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: *** Caught signal (Segmentation fault) ** 2023-12-01T01:05:42.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: in thread 7f2592931700 thread_name:md_log_replay 2023-12-01T01:05:42.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: ceph version 18.2.0-1249-ga6f82997 (a6f82997ac57b70a895455dfed6256360a1e4c32) reef (stable) 2023-12-01T01:05:42.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f25a34e0cf0] 2023-12-01T01:05:42.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 2: (Locker::mark_updated_scatterlock(ScatterLock*)+0x29) [0x558bc419a1f9] 2023-12-01T01:05:42.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 3: (EMetaBlob::replay(MDSRank*, LogSegment*, int, MDPeerUpdate*)+0x22ac) [0x558bc438578c] 2023-12-01T01:05:42.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 4: (EUpdate::replay(MDSRank*)+0x61) [0x558bc4389f81] 2023-12-01T01:05:42.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 5: (MDLog::_replay_thread()+0x6c9) [0x558bc43101d9] 2023-12-01T01:05:42.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 6: (MDLog::ReplayThread::entry()+0x11) [0x558bc3fbe2d1] 2023-12-01T01:05:42.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f25a34d61ca] 2023-12-01T01:05:42.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 8: clone() 2023-12-01T01:05:42.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 2023-12-01T01:05:42.334+0000 7f2592931700 -1 *** Caught signal (Segmentation fault) ** 2023-12-01T01:05:42.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: in thread 7f2592931700 thread_name:md_log_replay 2023-12-01T01:05:42.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 2023-12-01T01:05:42.717 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: ceph version 18.2.0-1249-ga6f82997 (a6f82997ac57b70a895455dfed6256360a1e4c32) reef (stable) 2023-12-01T01:05:42.717 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f25a34e0cf0] 2023-12-01T01:05:42.717 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 2: (Locker::mark_updated_scatterlock(ScatterLock*)+0x29) [0x558bc419a1f9] 2023-12-01T01:05:42.717 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 3: (EMetaBlob::replay(MDSRank*, LogSegment*, int, MDPeerUpdate*)+0x22ac) [0x558bc438578c] 2023-12-01T01:05:42.717 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 4: (EUpdate::replay(MDSRank*)+0x61) [0x558bc4389f81] 2023-12-01T01:05:42.717 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 5: (MDLog::_replay_thread()+0x6c9) [0x558bc43101d9] 2023-12-01T01:05:42.717 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 6: (MDLog::ReplayThread::entry()+0x11) [0x558bc3fbe2d1] 2023-12-01T01:05:42.717 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f25a34d61ca] 2023-12-01T01:05:42.717 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 8: clone() 2023-12-01T01:05:42.717 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-01T01:05:42.717 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 2023-12-01T01:05:42.717 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 0> 2023-12-01T01:05:42.334+0000 7f2592931700 -1 *** Caught signal (Segmentation fault) ** 2023-12-01T01:05:42.717 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: in thread 7f2592931700 thread_name:md_log_replay 2023-12-01T01:05:42.717 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 2023-12-01T01:05:42.717 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: ceph version 18.2.0-1249-ga6f82997 (a6f82997ac57b70a895455dfed6256360a1e4c32) reef (stable) 2023-12-01T01:05:42.718 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f25a34e0cf0] 2023-12-01T01:05:42.718 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 2: (Locker::mark_updated_scatterlock(ScatterLock*)+0x29) [0x558bc419a1f9] 2023-12-01T01:05:42.718 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 3: (EMetaBlob::replay(MDSRank*, LogSegment*, int, MDPeerUpdate*)+0x22ac) [0x558bc438578c] 2023-12-01T01:05:42.718 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 4: (EUpdate::replay(MDSRank*)+0x61) [0x558bc4389f81] 2023-12-01T01:05:42.718 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 5: (MDLog::_replay_thread()+0x6c9) [0x558bc43101d9] 2023-12-01T01:05:42.718 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 6: (MDLog::ReplayThread::entry()+0x11) [0x558bc3fbe2d1] 2023-12-01T01:05:42.718 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f25a34d61ca] 2023-12-01T01:05:42.718 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 8: clone() 2023-12-01T01:05:42.718 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-01T01:05:42.718 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 2023-12-01T01:05:42.718 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 0> 2023-12-01T01:05:42.334+0000 7f2592931700 -1 *** Caught signal (Segmentation fault) ** 2023-12-01T01:05:42.718 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: in thread 7f2592931700 thread_name:md_log_replay 2023-12-01T01:05:42.718 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 2023-12-01T01:05:42.718 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: ceph version 18.2.0-1249-ga6f82997 (a6f82997ac57b70a895455dfed6256360a1e4c32) reef (stable) 2023-12-01T01:05:42.719 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f25a34e0cf0] 2023-12-01T01:05:42.719 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 2: (Locker::mark_updated_scatterlock(ScatterLock*)+0x29) [0x558bc419a1f9] 2023-12-01T01:05:42.719 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 3: (EMetaBlob::replay(MDSRank*, LogSegment*, int, MDPeerUpdate*)+0x22ac) [0x558bc438578c] 2023-12-01T01:05:42.719 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 4: (EUpdate::replay(MDSRank*)+0x61) [0x558bc4389f81] 2023-12-01T01:05:42.719 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 5: (MDLog::_replay_thread()+0x6c9) [0x558bc43101d9] 2023-12-01T01:05:42.719 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 6: (MDLog::ReplayThread::entry()+0x11) [0x558bc3fbe2d1] 2023-12-01T01:05:42.719 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 7: /lib64/libpthread.so.0(+0x81ca) [0x7f25a34d61ca] 2023-12-01T01:05:42.719 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 8: clone() 2023-12-01T01:05:42.719 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-01T01:05:42.719 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[139037]: 2023-12-01T01:05:42.725 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2023-12-01T01:05:42.725 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2023-12-01T01:05:42.725 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2023-12-01T01:05:42.725 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2023-12-01T01:05:42.725 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2023-12-01T01:05:42.725 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2023-12-01T01:05:42.725 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2023-12-01T01:05:42.725 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2023-12-01T01:05:42.725 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2023-12-01T01:05:42.725 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2023-12-01T01:05:42.725 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2023-12-01T01:05:42.725 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2023-12-01T01:05:42.726 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2023-12-01T01:05:42.726 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2023-12-01T01:05:42.726 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2023-12-01T01:05:42.726 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2023-12-01T01:05:42.726 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2023-12-01T01:05:42.726 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2023-12-01T01:05:42.727 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2023-12-01T01:05:42.727 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2023-12-01T01:05:42.728 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2023-12-01T01:05:42.729 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2023-12-01T01:05:42.730 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2023-12-01T01:05:42.731 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2023-12-01T01:05:42.732 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2023-12-01T01:05:42.733 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2023-12-01T01:05:42.734 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2023-12-01T01:05:42.736 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2023-12-01T01:05:42.738 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2023-12-01T01:05:42.739 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2023-12-01T01:05:42.740 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2023-12-01T01:05:42.740 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2023-12-01T01:05:42.740 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2023-12-01T01:05:42.741 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2023-12-01T01:05:42.742 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2023-12-01T01:05:42.742 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2023-12-01T01:05:42.743 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2023-12-01T01:05:42.743 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2023-12-01T01:05:42.744 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2023-12-01T01:05:42.745 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2023-12-01T01:05:42.746 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2023-12-01T01:05:42.747 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2023-12-01T01:05:42.748 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2023-12-01T01:05:42.749 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2023-12-01T01:05:42.750 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2023-12-01T01:05:42.751 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2023-12-01T01:05:42.751 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2023-12-01T01:05:42.752 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2023-12-01T01:05:42.753 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2023-12-01T01:05:42.754 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2023-12-01T01:05:42.754 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2023-12-01T01:05:42.755 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2023-12-01T01:05:42.755 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2023-12-01T01:05:42.756 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2023-12-01T01:05:42.757 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2023-12-01T01:05:42.758 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2023-12-01T01:05:42.758 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2023-12-01T01:05:42.759 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2023-12-01T01:05:42.759 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2023-12-01T01:05:42.760 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2023-12-01T01:05:42.761 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2023-12-01T01:05:42.761 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2023-12-01T01:05:42.762 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2023-12-01T01:05:42.763 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2023-12-01T01:05:42.765 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2023-12-01T01:05:42.765 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2023-12-01T01:05:42.765 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2023-12-01T01:05:42.766 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2023-12-01T01:05:42.767 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2023-12-01T01:05:42.767 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2023-12-01T01:05:42.768 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2023-12-01T01:05:42.768 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2023-12-01T01:05:42.769 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2023-12-01T01:05:42.770 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2023-12-01T01:05:42.770 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2023-12-01T01:05:42.771 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2023-12-01T01:05:42.771 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2023-12-01T01:05:42.772 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2023-12-01T01:05:42.772 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2023-12-01T01:05:42.773 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2023-12-01T01:05:42.774 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2023-12-01T01:05:42.774 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2023-12-01T01:05:42.775 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2023-12-01T01:05:42.776 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2023-12-01T01:05:42.777 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2023-12-01T01:05:42.778 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2023-12-01T01:05:42.778 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2023-12-01T01:05:42.779 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2023-12-01T01:05:42.779 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2023-12-01T01:05:42.780 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2023-12-01T01:05:42.780 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2023-12-01T01:05:42.781 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2023-12-01T01:05:42.782 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2023-12-01T01:05:42.786 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2023-12-01T01:05:42.786 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2023-12-01T01:05:42.786 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2023-12-01T01:05:42.787 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2023-12-01T01:05:42.787 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2023-12-01T01:05:42.787 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2023-12-01T01:05:42.787 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2023-12-01T01:05:42.787 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2023-12-01T01:05:42.788 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2023-12-01T01:05:42.788 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2023-12-01T01:05:42.789 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2023-12-01T01:05:42.789 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2023-12-01T01:05:42.790 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2023-12-01T01:05:42.791 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2023-12-01T01:05:42.791 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2023-12-01T01:05:42.792 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2023-12-01T01:05:42.792 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2023-12-01T01:05:42.793 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2023-12-01T01:05:42.794 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2023-12-01T01:05:42.794 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2023-12-01T01:05:42.795 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2023-12-01T01:05:42.795 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2023-12-01T01:05:42.796 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2023-12-01T01:05:42.796 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2023-12-01T01:05:42.797 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2023-12-01T01:05:42.798 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2023-12-01T01:05:42.798 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2023-12-01T01:05:42.801 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2023-12-01T01:05:42.801 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2023-12-01T01:05:42.802 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2023-12-01T01:05:42.803 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2023-12-01T01:05:42.804 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2023-12-01T01:05:42.804 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2023-12-01T01:05:42.804 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2023-12-01T01:05:42.805 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2023-12-01T01:05:42.805 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2023-12-01T01:05:42.806 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2023-12-01T01:05:42.807 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2023-12-01T01:05:42.807 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2023-12-01T01:05:42.808 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2023-12-01T01:05:42.808 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2023-12-01T01:05:42.809 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2023-12-01T01:05:42.810 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2023-12-01T01:05:42.810 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2023-12-01T01:05:42.811 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2023-12-01T01:05:42.812 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2023-12-01T01:05:42.813 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2023-12-01T01:05:42.813 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2023-12-01T01:05:42.814 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2023-12-01T01:05:42.814 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2023-12-01T01:05:42.815 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2023-12-01T01:05:42.816 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2023-12-01T01:05:42.816 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2023-12-01T01:05:42.817 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2023-12-01T01:05:42.817 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2023-12-01T01:05:42.818 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2023-12-01T01:05:42.818 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2023-12-01T01:05:42.819 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2023-12-01T01:05:42.820 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2023-12-01T01:05:42.820 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2023-12-01T01:05:42.821 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2023-12-01T01:05:42.823 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2023-12-01T01:05:42.823 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2023-12-01T01:05:42.823 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2023-12-01T01:05:42.824 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2023-12-01T01:05:42.824 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2023-12-01T01:05:42.825 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2023-12-01T01:05:42.826 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2023-12-01T01:05:42.826 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2023-12-01T01:05:42.827 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2023-12-01T01:05:42.828 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2023-12-01T01:05:42.829 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2023-12-01T01:05:42.830 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2023-12-01T01:05:42.831 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2023-12-01T01:05:42.832 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2023-12-01T01:05:42.833 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2023-12-01T01:05:42.833 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2023-12-01T01:05:42.834 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2023-12-01T01:05:42.835 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2023-12-01T01:05:42.837 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2023-12-01T01:05:42.838 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2023-12-01T01:05:42.839 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2023-12-01T01:05:42.839 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2023-12-01T01:05:42.840 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2023-12-01T01:05:42.840 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2023-12-01T01:05:42.841 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2023-12-01T01:05:42.843 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2023-12-01T01:05:42.843 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2023-12-01T01:05:42.843 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2023-12-01T01:05:42.843 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2023-12-01T01:05:42.844 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2023-12-01T01:05:42.844 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2023-12-01T01:05:42.845 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2023-12-01T01:05:42.846 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2023-12-01T01:05:42.846 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2023-12-01T01:05:42.847 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2023-12-01T01:05:42.847 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2023-12-01T01:05:42.848 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2023-12-01T01:05:42.849 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2023-12-01T01:05:42.849 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2023-12-01T01:05:42.850 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2023-12-01T01:05:42.850 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2023-12-01T01:05:42.851 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2023-12-01T01:05:42.852 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2023-12-01T01:05:42.853 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2023-12-01T01:05:42.854 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2023-12-01T01:05:42.855 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2023-12-01T01:05:42.856 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2023-12-01T01:05:42.857 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2023-12-01T01:05:42.858 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2023-12-01T01:05:42.859 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2023-12-01T01:05:42.859 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2023-12-01T01:05:42.860 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2023-12-01T01:05:42.860 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2023-12-01T01:05:42.861 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2023-12-01T01:05:42.862 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2023-12-01T01:05:42.863 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2023-12-01T01:05:42.864 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2023-12-01T01:05:42.865 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2023-12-01T01:05:42.866 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2023-12-01T01:05:42.867 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2023-12-01T01:05:42.868 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2023-12-01T01:05:42.869 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2023-12-01T01:05:42.870 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2023-12-01T01:05:42.870 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2023-12-01T01:05:42.871 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2023-12-01T01:05:42.872 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2023-12-01T01:05:42.873 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2023-12-01T01:05:42.874 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2023-12-01T01:05:42.875 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2023-12-01T01:05:42.876 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2023-12-01T01:05:42.876 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2023-12-01T01:05:42.877 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2023-12-01T01:05:42.878 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2023-12-01T01:05:42.878 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2023-12-01T01:05:42.879 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2023-12-01T01:05:42.880 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2023-12-01T01:05:42.880 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2023-12-01T01:05:42.881 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2023-12-01T01:05:42.882 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2023-12-01T01:05:42.883 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2023-12-01T01:05:42.884 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2023-12-01T01:05:42.885 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2023-12-01T01:05:42.886 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2023-12-01T01:05:42.886 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2023-12-01T01:05:42.887 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2023-12-01T01:05:42.887 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2023-12-01T01:05:42.888 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2023-12-01T01:05:42.889 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2023-12-01T01:05:42.890 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2023-12-01T01:05:42.891 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2023-12-01T01:05:42.891 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2023-12-01T01:05:42.892 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2023-12-01T01:05:42.892 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2023-12-01T01:05:42.894 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2023-12-01T01:05:42.894 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2023-12-01T01:05:42.894 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2023-12-01T01:05:42.895 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2023-12-01T01:05:42.896 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2023-12-01T01:05:42.896 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2023-12-01T01:05:42.897 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2023-12-01T01:05:42.897 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2023-12-01T01:05:42.898 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2023-12-01T01:05:42.899 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2023-12-01T01:05:42.899 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2023-12-01T01:05:42.900 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2023-12-01T01:05:42.901 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2023-12-01T01:05:42.902 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2023-12-01T01:05:42.904 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2023-12-01T01:05:42.905 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2023-12-01T01:05:42.907 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2023-12-01T01:05:42.909 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2023-12-01T01:05:42.910 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2023-12-01T01:05:42.911 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2023-12-01T01:05:42.912 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2023-12-01T01:05:42.914 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2023-12-01T01:05:42.915 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2023-12-01T01:05:42.916 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2023-12-01T01:05:42.917 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2023-12-01T01:05:42.918 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2023-12-01T01:05:42.919 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2023-12-01T01:05:42.921 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2023-12-01T01:05:42.922 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2023-12-01T01:05:42.923 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2023-12-01T01:05:42.924 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2023-12-01T01:05:42.925 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2023-12-01T01:05:42.926 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2023-12-01T01:05:42.927 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2023-12-01T01:05:42.928 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2023-12-01T01:05:42.929 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2023-12-01T01:05:42.931 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2023-12-01T01:05:42.932 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2023-12-01T01:05:42.933 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2023-12-01T01:05:42.934 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2023-12-01T01:05:42.935 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2023-12-01T01:05:42.937 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2023-12-01T01:05:42.938 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2023-12-01T01:05:42.939 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2023-12-01T01:05:42.940 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2023-12-01T01:05:42.940 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2023-12-01T01:05:42.941 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2023-12-01T01:05:42.942 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2023-12-01T01:05:42.942 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2023-12-01T01:05:42.944 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2023-12-01T01:05:42.944 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2023-12-01T01:05:42.945 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2023-12-01T01:05:42.946 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 systemd[1]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.h.service: Main process exited, code=exited, status=139/n/a 2023-12-01T01:05:42.946 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2023-12-01T01:05:42.947 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2023-12-01T01:05:42.948 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2023-12-01T01:05:42.948 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2023-12-01T01:05:42.949 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2023-12-01T01:05:42.949 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2023-12-01T01:05:42.950 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2023-12-01T01:05:42.951 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2023-12-01T01:05:42.952 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2023-12-01T01:05:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2023-12-01T01:05:42.954 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2023-12-01T01:05:42.955 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2023-12-01T01:05:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2023-12-01T01:05:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2023-12-01T01:05:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2023-12-01T01:05:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2023-12-01T01:05:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2023-12-01T01:05:42.960 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2023-12-01T01:05:42.960 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2023-12-01T01:05:42.961 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2023-12-01T01:05:42.962 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2023-12-01T01:05:42.963 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2023-12-01T01:05:42.963 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2023-12-01T01:05:42.964 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2023-12-01T01:05:42.965 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2023-12-01T01:05:42.966 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2023-12-01T01:05:42.966 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2023-12-01T01:05:42.967 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2023-12-01T01:05:42.968 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2023-12-01T01:05:42.969 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2023-12-01T01:05:42.969 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2023-12-01T01:05:42.971 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2023-12-01T01:05:42.971 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2023-12-01T01:05:42.971 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2023-12-01T01:05:42.972 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2023-12-01T01:05:42.973 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2023-12-01T01:05:42.973 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2023-12-01T01:05:42.974 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2023-12-01T01:05:42.975 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2023-12-01T01:05:42.976 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2023-12-01T01:05:42.976 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2023-12-01T01:05:42.977 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2023-12-01T01:05:42.978 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2023-12-01T01:05:42.978 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2023-12-01T01:05:43.215 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2023-12-01T01:05:43.215 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:42 smithi093 systemd[1]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.h.service: Failed with result 'exit-code'. 2023-12-01T01:05:43.215 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2023-12-01T01:05:43.216 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2023-12-01T01:05:43.217 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2023-12-01T01:05:43.217 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2023-12-01T01:05:43.218 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2023-12-01T01:05:43.219 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2023-12-01T01:05:43.219 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2023-12-01T01:05:43.220 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2023-12-01T01:05:43.221 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2023-12-01T01:05:43.222 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2023-12-01T01:05:43.223 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2023-12-01T01:05:43.224 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2023-12-01T01:05:43.224 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2023-12-01T01:05:43.225 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2023-12-01T01:05:43.226 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2023-12-01T01:05:43.227 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2023-12-01T01:05:43.228 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2023-12-01T01:05:43.228 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2023-12-01T01:05:43.229 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2023-12-01T01:05:43.230 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2023-12-01T01:05:43.231 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2023-12-01T01:05:43.232 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2023-12-01T01:05:43.232 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2023-12-01T01:05:43.234 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2023-12-01T01:05:43.235 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2023-12-01T01:05:43.236 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2023-12-01T01:05:43.237 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2023-12-01T01:05:43.237 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2023-12-01T01:05:43.238 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2023-12-01T01:05:43.239 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2023-12-01T01:05:43.240 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2023-12-01T01:05:43.240 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2023-12-01T01:05:43.241 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2023-12-01T01:05:43.242 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2023-12-01T01:05:43.242 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2023-12-01T01:05:43.243 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2023-12-01T01:05:43.243 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2023-12-01T01:05:43.244 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2023-12-01T01:05:43.245 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2023-12-01T01:05:43.245 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2023-12-01T01:05:43.246 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2023-12-01T01:05:43.247 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2023-12-01T01:05:43.247 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2023-12-01T01:05:43.248 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2023-12-01T01:05:43.249 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2023-12-01T01:05:43.249 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2023-12-01T01:05:43.250 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2023-12-01T01:05:43.250 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2023-12-01T01:05:43.251 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2023-12-01T01:05:43.252 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2023-12-01T01:05:43.253 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2023-12-01T01:05:43.253 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2023-12-01T01:05:43.254 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2023-12-01T01:05:43.254 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2023-12-01T01:05:43.255 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2023-12-01T01:05:43.256 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2023-12-01T01:05:43.257 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2023-12-01T01:05:43.259 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2023-12-01T01:05:43.259 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2023-12-01T01:05:43.259 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2023-12-01T01:05:43.260 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2023-12-01T01:05:43.261 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2023-12-01T01:05:43.262 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2023-12-01T01:05:43.263 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2023-12-01T01:05:43.263 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2023-12-01T01:05:43.264 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2023-12-01T01:05:43.265 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2023-12-01T01:05:43.266 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2023-12-01T01:05:43.267 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2023-12-01T01:05:43.267 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/digsig.txt 2023-12-01T01:05:43.269 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2023-12-01T01:05:43.269 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dmaengine/ 2023-12-01T01:05:43.270 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2023-12-01T01:05:43.271 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2023-12-01T01:05:43.271 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2023-12-01T01:05:43.272 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2023-12-01T01:05:43.273 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dontdiff 2023-12-01T01:05:43.273 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/driver-model/ 2023-12-01T01:05:43.275 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2023-12-01T01:05:43.275 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2023-12-01T01:05:43.276 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2023-12-01T01:05:43.277 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2023-12-01T01:05:43.277 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2023-12-01T01:05:43.278 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2023-12-01T01:05:43.279 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2023-12-01T01:05:43.280 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2023-12-01T01:05:43.281 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2023-12-01T01:05:43.281 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2023-12-01T01:05:43.282 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dvb/ 2023-12-01T01:05:43.283 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2023-12-01T01:05:43.285 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2023-12-01T01:05:43.285 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2023-12-01T01:05:43.285 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2023-12-01T01:05:43.286 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2023-12-01T01:05:43.287 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2023-12-01T01:05:43.287 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2023-12-01T01:05:43.288 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2023-12-01T01:05:43.289 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2023-12-01T01:05:43.289 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2023-12-01T01:05:43.290 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2023-12-01T01:05:43.291 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2023-12-01T01:05:43.291 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2023-12-01T01:05:43.292 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2023-12-01T01:05:43.292 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2023-12-01T01:05:43.293 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/early-userspace/ 2023-12-01T01:05:43.294 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/early-userspace/README 2023-12-01T01:05:43.296 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2023-12-01T01:05:43.296 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/edac.txt 2023-12-01T01:05:43.297 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/efi-stub.txt 2023-12-01T01:05:43.297 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/eisa.txt 2023-12-01T01:05:43.298 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/email-clients.txt 2023-12-01T01:05:43.298 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/extcon/ 2023-12-01T01:05:43.299 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2023-12-01T01:05:43.300 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fault-injection/ 2023-12-01T01:05:43.301 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2023-12-01T01:05:43.302 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2023-12-01T01:05:43.302 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2023-12-01T01:05:43.303 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/ 2023-12-01T01:05:43.304 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2023-12-01T01:05:43.306 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/api.txt 2023-12-01T01:05:43.306 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2023-12-01T01:05:43.306 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2023-12-01T01:05:43.307 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2023-12-01T01:05:43.307 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2023-12-01T01:05:43.309 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2023-12-01T01:05:43.309 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2023-12-01T01:05:43.310 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2023-12-01T01:05:43.310 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2023-12-01T01:05:43.311 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2023-12-01T01:05:43.312 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2023-12-01T01:05:43.313 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2023-12-01T01:05:43.313 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2023-12-01T01:05:43.314 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/internals.txt 2023-12-01T01:05:43.314 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2023-12-01T01:05:43.315 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2023-12-01T01:05:43.316 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2023-12-01T01:05:43.316 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2023-12-01T01:05:43.317 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2023-12-01T01:05:43.317 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2023-12-01T01:05:43.318 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2023-12-01T01:05:43.319 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2023-12-01T01:05:43.319 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2023-12-01T01:05:43.320 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2023-12-01T01:05:43.321 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2023-12-01T01:05:43.322 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2023-12-01T01:05:43.322 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2023-12-01T01:05:43.323 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2023-12-01T01:05:43.323 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2023-12-01T01:05:43.325 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2023-12-01T01:05:43.325 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2023-12-01T01:05:43.326 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2023-12-01T01:05:43.326 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2023-12-01T01:05:43.327 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2023-12-01T01:05:43.328 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/ 2023-12-01T01:05:43.329 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2023-12-01T01:05:43.330 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2023-12-01T01:05:43.330 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2023-12-01T01:05:43.331 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/Locking 2023-12-01T01:05:43.332 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2023-12-01T01:05:43.332 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2023-12-01T01:05:43.333 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2023-12-01T01:05:43.333 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2023-12-01T01:05:43.334 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2023-12-01T01:05:43.335 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2023-12-01T01:05:43.336 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2023-12-01T01:05:43.336 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2023-12-01T01:05:43.337 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2023-12-01T01:05:43.337 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2023-12-01T01:05:43.338 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2023-12-01T01:05:43.339 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2023-12-01T01:05:43.339 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2023-12-01T01:05:43.340 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2023-12-01T01:05:43.341 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2023-12-01T01:05:43.341 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2023-12-01T01:05:43.342 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2023-12-01T01:05:43.343 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2023-12-01T01:05:43.343 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2023-12-01T01:05:43.344 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2023-12-01T01:05:43.345 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2023-12-01T01:05:43.345 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2023-12-01T01:05:43.346 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2023-12-01T01:05:43.347 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2023-12-01T01:05:43.347 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2023-12-01T01:05:43.348 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2023-12-01T01:05:43.348 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2023-12-01T01:05:43.349 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2023-12-01T01:05:43.350 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2023-12-01T01:05:43.351 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2023-12-01T01:05:43.352 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2023-12-01T01:05:43.352 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2023-12-01T01:05:43.353 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2023-12-01T01:05:43.354 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2023-12-01T01:05:43.354 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2023-12-01T01:05:43.355 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2023-12-01T01:05:43.356 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2023-12-01T01:05:43.356 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2023-12-01T01:05:43.357 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2023-12-01T01:05:43.358 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2023-12-01T01:05:43.359 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2023-12-01T01:05:43.359 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2023-12-01T01:05:43.359 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2023-12-01T01:05:43.360 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2023-12-01T01:05:43.360 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2023-12-01T01:05:43.361 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2023-12-01T01:05:43.361 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2023-12-01T01:05:43.362 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2023-12-01T01:05:43.363 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2023-12-01T01:05:43.363 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2023-12-01T01:05:43.364 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2023-12-01T01:05:43.364 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2023-12-01T01:05:43.365 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2023-12-01T01:05:43.366 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2023-12-01T01:05:43.366 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2023-12-01T01:05:43.367 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2023-12-01T01:05:43.367 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2023-12-01T01:05:43.368 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2023-12-01T01:05:43.369 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2023-12-01T01:05:43.370 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2023-12-01T01:05:43.370 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2023-12-01T01:05:43.371 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2023-12-01T01:05:43.372 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2023-12-01T01:05:43.372 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2023-12-01T01:05:43.373 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2023-12-01T01:05:43.374 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2023-12-01T01:05:43.374 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2023-12-01T01:05:43.375 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2023-12-01T01:05:43.376 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2023-12-01T01:05:43.376 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2023-12-01T01:05:43.377 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2023-12-01T01:05:43.378 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2023-12-01T01:05:43.378 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2023-12-01T01:05:43.379 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2023-12-01T01:05:43.379 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2023-12-01T01:05:43.380 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2023-12-01T01:05:43.381 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2023-12-01T01:05:43.381 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2023-12-01T01:05:43.382 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2023-12-01T01:05:43.382 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2023-12-01T01:05:43.383 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2023-12-01T01:05:43.383 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2023-12-01T01:05:43.384 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2023-12-01T01:05:43.385 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2023-12-01T01:05:43.386 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2023-12-01T01:05:43.387 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2023-12-01T01:05:43.387 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2023-12-01T01:05:43.388 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/porting 2023-12-01T01:05:43.389 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2023-12-01T01:05:43.389 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2023-12-01T01:05:43.390 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2023-12-01T01:05:43.390 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2023-12-01T01:05:43.391 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2023-12-01T01:05:43.392 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2023-12-01T01:05:43.393 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2023-12-01T01:05:43.393 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2023-12-01T01:05:43.394 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2023-12-01T01:05:43.399 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2023-12-01T01:05:43.399 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2023-12-01T01:05:43.399 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2023-12-01T01:05:43.399 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2023-12-01T01:05:43.399 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2023-12-01T01:05:43.399 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2023-12-01T01:05:43.399 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2023-12-01T01:05:43.399 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2023-12-01T01:05:43.400 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2023-12-01T01:05:43.400 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2023-12-01T01:05:43.401 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2023-12-01T01:05:43.401 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2023-12-01T01:05:43.402 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2023-12-01T01:05:43.402 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2023-12-01T01:05:43.403 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/firmware_class/ 2023-12-01T01:05:43.404 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/firmware_class/README 2023-12-01T01:05:43.405 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2023-12-01T01:05:43.405 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2023-12-01T01:05:43.406 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fmc/ 2023-12-01T01:05:43.407 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2023-12-01T01:05:43.408 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fmc/API.txt 2023-12-01T01:05:43.408 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2023-12-01T01:05:43.409 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2023-12-01T01:05:43.410 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2023-12-01T01:05:43.410 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2023-12-01T01:05:43.411 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2023-12-01T01:05:43.412 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2023-12-01T01:05:43.413 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2023-12-01T01:05:43.413 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2023-12-01T01:05:43.414 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2023-12-01T01:05:43.414 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/frv/ 2023-12-01T01:05:43.415 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/frv/README.txt 2023-12-01T01:05:43.416 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2023-12-01T01:05:43.417 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/frv/booting.txt 2023-12-01T01:05:43.418 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/frv/clock.txt 2023-12-01T01:05:43.418 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2023-12-01T01:05:43.419 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/frv/features.txt 2023-12-01T01:05:43.419 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/frv/gdbinit 2023-12-01T01:05:43.420 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2023-12-01T01:05:43.421 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2023-12-01T01:05:43.421 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2023-12-01T01:05:43.422 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2023-12-01T01:05:43.423 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/gcov.txt 2023-12-01T01:05:43.423 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2023-12-01T01:05:43.424 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/gpio/ 2023-12-01T01:05:43.425 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2023-12-01T01:05:43.426 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/gpio/board.txt 2023-12-01T01:05:43.427 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2023-12-01T01:05:43.428 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2023-12-01T01:05:43.428 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2023-12-01T01:05:43.429 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2023-12-01T01:05:43.430 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2023-12-01T01:05:43.430 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hid/ 2023-12-01T01:05:43.431 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2023-12-01T01:05:43.432 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2023-12-01T01:05:43.433 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2023-12-01T01:05:43.434 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2023-12-01T01:05:43.434 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2023-12-01T01:05:43.435 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/highuid.txt 2023-12-01T01:05:43.436 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hsi.txt 2023-12-01T01:05:43.437 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hw_random.txt 2023-12-01T01:05:43.438 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ 2023-12-01T01:05:43.439 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2023-12-01T01:05:43.440 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2023-12-01T01:05:43.440 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2023-12-01T01:05:43.441 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2023-12-01T01:05:43.442 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/abx500 2023-12-01T01:05:43.442 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2023-12-01T01:05:43.443 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2023-12-01T01:05:43.444 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2023-12-01T01:05:43.444 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2023-12-01T01:05:43.445 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2023-12-01T01:05:43.445 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2023-12-01T01:05:43.447 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2023-12-01T01:05:43.447 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2023-12-01T01:05:43.447 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2023-12-01T01:05:43.448 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2023-12-01T01:05:43.448 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2023-12-01T01:05:43.449 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2023-12-01T01:05:43.450 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2023-12-01T01:05:43.450 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2023-12-01T01:05:43.451 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2023-12-01T01:05:43.452 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2023-12-01T01:05:43.452 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2023-12-01T01:05:43.453 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/asb100 2023-12-01T01:05:43.453 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2023-12-01T01:05:43.454 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2023-12-01T01:05:43.455 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/da9052 2023-12-01T01:05:43.455 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/da9055 2023-12-01T01:05:43.456 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2023-12-01T01:05:43.457 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2023-12-01T01:05:43.457 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ds620 2023-12-01T01:05:43.458 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2023-12-01T01:05:43.459 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2023-12-01T01:05:43.459 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2023-12-01T01:05:43.460 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2023-12-01T01:05:43.461 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2023-12-01T01:05:43.462 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2023-12-01T01:05:43.463 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/g760a 2023-12-01T01:05:43.463 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/g762 2023-12-01T01:05:43.464 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2023-12-01T01:05:43.465 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2023-12-01T01:05:43.466 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/htu21 2023-12-01T01:05:43.466 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2023-12-01T01:05:43.467 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2023-12-01T01:05:43.468 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2023-12-01T01:05:43.468 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ina209 2023-12-01T01:05:43.469 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2023-12-01T01:05:43.469 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/it87 2023-12-01T01:05:43.470 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/jc42 2023-12-01T01:05:43.471 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2023-12-01T01:05:43.471 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2023-12-01T01:05:43.472 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2023-12-01T01:05:43.472 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2023-12-01T01:05:43.473 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lm63 2023-12-01T01:05:43.474 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lm70 2023-12-01T01:05:43.474 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lm73 2023-12-01T01:05:43.475 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lm75 2023-12-01T01:05:43.475 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lm77 2023-12-01T01:05:43.476 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lm78 2023-12-01T01:05:43.477 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lm80 2023-12-01T01:05:43.478 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lm83 2023-12-01T01:05:43.479 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lm85 2023-12-01T01:05:43.479 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lm87 2023-12-01T01:05:43.480 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lm90 2023-12-01T01:05:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lm92 2023-12-01T01:05:43.481 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lm93 2023-12-01T01:05:43.482 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2023-12-01T01:05:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2023-12-01T01:05:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2023-12-01T01:05:43.484 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2023-12-01T01:05:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2023-12-01T01:05:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2023-12-01T01:05:43.486 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2023-12-01T01:05:43.487 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2023-12-01T01:05:43.488 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2023-12-01T01:05:43.488 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/max16064 2023-12-01T01:05:43.489 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/max16065 2023-12-01T01:05:43.491 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/max1619 2023-12-01T01:05:43.491 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/max1668 2023-12-01T01:05:43.491 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/max197 2023-12-01T01:05:43.492 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/max34440 2023-12-01T01:05:43.493 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/max6639 2023-12-01T01:05:43.493 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/max6642 2023-12-01T01:05:43.494 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/max6650 2023-12-01T01:05:43.494 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/max6697 2023-12-01T01:05:43.495 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/max8688 2023-12-01T01:05:43.495 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2023-12-01T01:05:43.496 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2023-12-01T01:05:43.497 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2023-12-01T01:05:43.497 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2023-12-01T01:05:43.498 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2023-12-01T01:05:43.499 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2023-12-01T01:05:43.499 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2023-12-01T01:05:43.500 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2023-12-01T01:05:43.500 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2023-12-01T01:05:43.501 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2023-12-01T01:05:43.501 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2023-12-01T01:05:43.502 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2023-12-01T01:05:43.503 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2023-12-01T01:05:43.503 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2023-12-01T01:05:43.504 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2023-12-01T01:05:43.505 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2023-12-01T01:05:43.505 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/sht15 2023-12-01T01:05:43.506 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/sht21 2023-12-01T01:05:43.506 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2023-12-01T01:05:43.507 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2023-12-01T01:05:43.508 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/smm665 2023-12-01T01:05:43.508 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2023-12-01T01:05:43.509 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2023-12-01T01:05:43.509 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2023-12-01T01:05:43.510 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2023-12-01T01:05:43.510 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2023-12-01T01:05:43.511 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2023-12-01T01:05:43.512 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2023-12-01T01:05:43.512 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2023-12-01T01:05:43.513 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2023-12-01T01:05:43.514 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2023-12-01T01:05:43.515 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2023-12-01T01:05:43.516 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2023-12-01T01:05:43.517 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2023-12-01T01:05:43.518 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2023-12-01T01:05:43.519 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2023-12-01T01:05:43.520 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2023-12-01T01:05:43.521 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/via686a 2023-12-01T01:05:43.522 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2023-12-01T01:05:43.523 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2023-12-01T01:05:43.524 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2023-12-01T01:05:43.525 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2023-12-01T01:05:43.526 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2023-12-01T01:05:43.527 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2023-12-01T01:05:43.528 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/w83793 2023-12-01T01:05:43.529 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/w83795 2023-12-01T01:05:43.530 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2023-12-01T01:05:43.531 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2023-12-01T01:05:43.532 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2023-12-01T01:05:43.533 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2023-12-01T01:05:43.534 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2023-12-01T01:05:43.535 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2023-12-01T01:05:43.537 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/ 2023-12-01T01:05:43.539 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/ 2023-12-01T01:05:43.540 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2023-12-01T01:05:43.541 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2023-12-01T01:05:43.542 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2023-12-01T01:05:43.543 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2023-12-01T01:05:43.544 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2023-12-01T01:05:43.545 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2023-12-01T01:05:43.546 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2023-12-01T01:05:43.547 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2023-12-01T01:05:43.548 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2023-12-01T01:05:43.549 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2023-12-01T01:05:43.550 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2023-12-01T01:05:43.551 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2023-12-01T01:05:43.552 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2023-12-01T01:05:43.553 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2023-12-01T01:05:43.554 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2023-12-01T01:05:43.555 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2023-12-01T01:05:43.556 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2023-12-01T01:05:43.557 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2023-12-01T01:05:43.558 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2023-12-01T01:05:43.559 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2023-12-01T01:05:43.560 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2023-12-01T01:05:43.561 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2023-12-01T01:05:43.562 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2023-12-01T01:05:43.563 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/functionality 2023-12-01T01:05:43.564 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2023-12-01T01:05:43.565 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2023-12-01T01:05:43.566 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2023-12-01T01:05:43.566 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2023-12-01T01:05:43.568 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2023-12-01T01:05:43.569 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2023-12-01T01:05:43.570 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2023-12-01T01:05:43.571 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/summary 2023-12-01T01:05:43.572 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2023-12-01T01:05:43.573 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2023-12-01T01:05:43.574 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2023-12-01T01:05:43.575 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2o/ 2023-12-01T01:05:43.576 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2o/README 2023-12-01T01:05:43.578 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/i2o/ioctl 2023-12-01T01:05:43.579 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ia64/ 2023-12-01T01:05:43.580 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2023-12-01T01:05:43.581 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2023-12-01T01:05:43.582 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ia64/Makefile 2023-12-01T01:05:43.583 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ia64/README 2023-12-01T01:05:43.584 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2023-12-01T01:05:43.585 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2023-12-01T01:05:43.738 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2023-12-01T01:05:43.739 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2023-12-01T01:05:43.739 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2023-12-01T01:05:43.740 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2023-12-01T01:05:43.741 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2023-12-01T01:05:43.741 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2023-12-01T01:05:43.742 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ide/ 2023-12-01T01:05:43.743 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2023-12-01T01:05:43.743 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2023-12-01T01:05:43.744 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2023-12-01T01:05:43.745 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2023-12-01T01:05:43.745 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2023-12-01T01:05:43.746 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ide/ide.txt 2023-12-01T01:05:43.746 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2023-12-01T01:05:43.747 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/infiniband/ 2023-12-01T01:05:43.748 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2023-12-01T01:05:43.749 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2023-12-01T01:05:43.749 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2023-12-01T01:05:43.750 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2023-12-01T01:05:43.750 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2023-12-01T01:05:43.751 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/init.txt 2023-12-01T01:05:43.752 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/initrd.txt 2023-12-01T01:05:43.753 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/ 2023-12-01T01:05:43.754 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/alps.txt 2023-12-01T01:05:43.755 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2023-12-01T01:05:43.755 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2023-12-01T01:05:43.756 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2023-12-01T01:05:43.757 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2023-12-01T01:05:43.757 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/cd32.txt 2023-12-01T01:05:43.758 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2023-12-01T01:05:43.759 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2023-12-01T01:05:43.759 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2023-12-01T01:05:43.760 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/elantech.txt 2023-12-01T01:05:43.760 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2023-12-01T01:05:43.761 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/ff.txt 2023-12-01T01:05:43.762 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2023-12-01T01:05:43.762 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2023-12-01T01:05:43.763 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2023-12-01T01:05:43.763 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2023-12-01T01:05:43.764 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2023-12-01T01:05:43.764 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/input.txt 2023-12-01T01:05:43.765 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/interactive.fig 2023-12-01T01:05:43.766 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2023-12-01T01:05:43.767 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2023-12-01T01:05:43.767 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/joystick.txt 2023-12-01T01:05:43.768 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2023-12-01T01:05:43.768 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/notifier.txt 2023-12-01T01:05:43.769 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2023-12-01T01:05:43.770 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2023-12-01T01:05:43.770 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2023-12-01T01:05:43.771 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/shape.fig 2023-12-01T01:05:43.771 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2023-12-01T01:05:43.772 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/xpad.txt 2023-12-01T01:05:43.773 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/input/yealink.txt 2023-12-01T01:05:43.773 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/intel_txt.txt 2023-12-01T01:05:43.774 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/io-mapping.txt 2023-12-01T01:05:43.775 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/io_ordering.txt 2023-12-01T01:05:43.775 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ioctl/ 2023-12-01T01:05:43.776 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2023-12-01T01:05:43.777 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2023-12-01T01:05:43.778 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2023-12-01T01:05:43.778 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2023-12-01T01:05:43.779 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2023-12-01T01:05:43.779 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2023-12-01T01:05:43.780 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/iostats.txt 2023-12-01T01:05:43.781 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2023-12-01T01:05:43.781 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isapnp.txt 2023-12-01T01:05:43.782 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/ 2023-12-01T01:05:43.783 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2023-12-01T01:05:43.784 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2023-12-01T01:05:43.784 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2023-12-01T01:05:43.785 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2023-12-01T01:05:43.785 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2023-12-01T01:05:43.786 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2023-12-01T01:05:43.786 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README 2023-12-01T01:05:43.787 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2023-12-01T01:05:43.787 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2023-12-01T01:05:43.788 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2023-12-01T01:05:43.789 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.audio 2023-12-01T01:05:43.789 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2023-12-01T01:05:43.790 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.concap 2023-12-01T01:05:43.790 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2023-12-01T01:05:43.791 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.fax 2023-12-01T01:05:43.791 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2023-12-01T01:05:43.792 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2023-12-01T01:05:43.793 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2023-12-01T01:05:43.794 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.icn 2023-12-01T01:05:43.795 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2023-12-01T01:05:43.796 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2023-12-01T01:05:43.796 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.sc 2023-12-01T01:05:43.797 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2023-12-01T01:05:43.797 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/README.x25 2023-12-01T01:05:43.798 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2023-12-01T01:05:43.799 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ja_JP/ 2023-12-01T01:05:43.800 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2023-12-01T01:05:43.800 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2023-12-01T01:05:43.801 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2023-12-01T01:05:43.802 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2023-12-01T01:05:43.802 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2023-12-01T01:05:43.803 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/java.txt 2023-12-01T01:05:43.805 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kasan.txt 2023-12-01T01:05:43.805 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kbuild/ 2023-12-01T01:05:43.805 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2023-12-01T01:05:43.806 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2023-12-01T01:05:43.807 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2023-12-01T01:05:43.808 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2023-12-01T01:05:43.809 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2023-12-01T01:05:43.809 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2023-12-01T01:05:43.809 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2023-12-01T01:05:43.810 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kdump/ 2023-12-01T01:05:43.811 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2023-12-01T01:05:43.811 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2023-12-01T01:05:43.812 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2023-12-01T01:05:43.814 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2023-12-01T01:05:43.814 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2023-12-01T01:05:43.815 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2023-12-01T01:05:43.816 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2023-12-01T01:05:43.816 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kmemleak.txt 2023-12-01T01:05:43.817 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ko_KR/ 2023-12-01T01:05:43.818 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2023-12-01T01:05:43.819 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2023-12-01T01:05:43.819 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kobject.txt 2023-12-01T01:05:43.820 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kprobes.txt 2023-12-01T01:05:43.821 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kref.txt 2023-12-01T01:05:43.821 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/kselftest.txt 2023-12-01T01:05:43.822 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/laptops/ 2023-12-01T01:05:43.823 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2023-12-01T01:05:43.824 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2023-12-01T01:05:43.824 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/laptops/Makefile 2023-12-01T01:05:43.825 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2023-12-01T01:05:43.826 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2023-12-01T01:05:43.826 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2023-12-01T01:05:43.827 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2023-12-01T01:05:43.827 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2023-12-01T01:05:43.828 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2023-12-01T01:05:43.829 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2023-12-01T01:05:43.830 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2023-12-01T01:05:43.830 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2023-12-01T01:05:43.831 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ldm.txt 2023-12-01T01:05:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/leds/ 2023-12-01T01:05:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2023-12-01T01:05:43.833 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2023-12-01T01:05:43.834 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2023-12-01T01:05:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2023-12-01T01:05:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2023-12-01T01:05:43.836 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2023-12-01T01:05:43.836 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2023-12-01T01:05:43.837 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2023-12-01T01:05:43.838 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2023-12-01T01:05:43.838 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2023-12-01T01:05:43.839 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2023-12-01T01:05:43.839 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/local_ops.txt 2023-12-01T01:05:43.840 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/locking/ 2023-12-01T01:05:43.841 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2023-12-01T01:05:43.842 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2023-12-01T01:05:43.842 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2023-12-01T01:05:43.843 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2023-12-01T01:05:43.843 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2023-12-01T01:05:43.844 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2023-12-01T01:05:43.845 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2023-12-01T01:05:43.845 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2023-12-01T01:05:43.846 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2023-12-01T01:05:43.847 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2023-12-01T01:05:43.847 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2023-12-01T01:05:43.848 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/logo.gif 2023-12-01T01:05:43.848 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/logo.txt 2023-12-01T01:05:43.849 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/lzo.txt 2023-12-01T01:05:43.850 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/m68k/ 2023-12-01T01:05:43.851 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2023-12-01T01:05:43.851 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2023-12-01T01:05:43.852 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2023-12-01T01:05:43.853 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/magic-number.txt 2023-12-01T01:05:43.853 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mailbox.txt 2023-12-01T01:05:43.854 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/md.txt 2023-12-01T01:05:43.855 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/media-framework.txt 2023-12-01T01:05:43.856 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2023-12-01T01:05:43.940 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/memory-devices/ 2023-12-01T01:05:43.941 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2023-12-01T01:05:43.943 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2023-12-01T01:05:43.944 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/metag/ 2023-12-01T01:05:43.945 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2023-12-01T01:05:43.946 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2023-12-01T01:05:43.948 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mic/ 2023-12-01T01:05:43.949 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mic/Makefile 2023-12-01T01:05:43.950 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2023-12-01T01:05:43.951 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2023-12-01T01:05:43.952 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2023-12-01T01:05:43.953 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2023-12-01T01:05:43.953 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2023-12-01T01:05:43.954 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2023-12-01T01:05:43.955 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2023-12-01T01:05:43.955 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2023-12-01T01:05:43.956 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2023-12-01T01:05:43.956 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mips/ 2023-12-01T01:05:43.957 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2023-12-01T01:05:43.958 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2023-12-01T01:05:43.959 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/ 2023-12-01T01:05:43.960 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2023-12-01T01:05:43.961 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2023-12-01T01:05:43.961 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2023-12-01T01:05:43.962 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2023-12-01T01:05:43.963 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2023-12-01T01:05:43.963 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2023-12-01T01:05:43.964 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2023-12-01T01:05:43.964 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2023-12-01T01:05:43.965 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2023-12-01T01:05:43.966 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2023-12-01T01:05:43.967 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2023-12-01T01:05:43.968 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2023-12-01T01:05:43.969 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2023-12-01T01:05:43.969 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2023-12-01T01:05:43.970 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2023-12-01T01:05:43.971 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2023-12-01T01:05:43.972 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2023-12-01T01:05:43.972 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2023-12-01T01:05:43.973 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mmc/ 2023-12-01T01:05:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2023-12-01T01:05:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2023-12-01T01:05:43.975 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2023-12-01T01:05:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2023-12-01T01:05:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mn10300/ 2023-12-01T01:05:43.977 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2023-12-01T01:05:43.978 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2023-12-01T01:05:43.978 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/module-signing.txt 2023-12-01T01:05:43.979 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mono.txt 2023-12-01T01:05:43.980 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mtd/ 2023-12-01T01:05:43.981 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mtd/nand/ 2023-12-01T01:05:43.982 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2023-12-01T01:05:43.982 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2023-12-01T01:05:43.983 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2023-12-01T01:05:43.984 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/namespaces/ 2023-12-01T01:05:43.985 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2023-12-01T01:05:43.986 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2023-12-01T01:05:43.986 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/netlabel/ 2023-12-01T01:05:43.987 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2023-12-01T01:05:43.988 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2023-12-01T01:05:43.988 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2023-12-01T01:05:43.989 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2023-12-01T01:05:43.990 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2023-12-01T01:05:43.990 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/ 2023-12-01T01:05:43.991 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2023-12-01T01:05:43.992 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2023-12-01T01:05:43.993 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2023-12-01T01:05:43.993 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2023-12-01T01:05:43.994 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2023-12-01T01:05:43.995 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2023-12-01T01:05:43.996 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/Makefile 2023-12-01T01:05:43.996 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2023-12-01T01:05:43.997 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2023-12-01T01:05:43.997 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2023-12-01T01:05:43.998 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2023-12-01T01:05:43.999 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/alias.txt 2023-12-01T01:05:43.999 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2023-12-01T01:05:44.000 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2023-12-01T01:05:44.001 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2023-12-01T01:05:44.002 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/atm.txt 2023-12-01T01:05:44.002 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2023-12-01T01:05:44.003 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2023-12-01T01:05:44.003 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2023-12-01T01:05:44.004 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2023-12-01T01:05:44.005 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2023-12-01T01:05:44.006 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/caif/ 2023-12-01T01:05:44.006 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2023-12-01T01:05:44.007 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/caif/README 2023-12-01T01:05:44.008 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2023-12-01T01:05:44.009 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/can.txt 2023-12-01T01:05:44.009 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2023-12-01T01:05:44.010 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/cops.txt 2023-12-01T01:05:44.010 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2023-12-01T01:05:44.012 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2023-12-01T01:05:44.013 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2023-12-01T01:05:44.013 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2023-12-01T01:05:44.013 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2023-12-01T01:05:44.014 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2023-12-01T01:05:44.014 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2023-12-01T01:05:44.015 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2023-12-01T01:05:44.016 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2023-12-01T01:05:44.016 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2023-12-01T01:05:44.017 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2023-12-01T01:05:44.017 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2023-12-01T01:05:44.018 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/driver.txt 2023-12-01T01:05:44.019 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/e100.txt 2023-12-01T01:05:44.019 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2023-12-01T01:05:44.020 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2023-12-01T01:05:44.021 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/eql.txt 2023-12-01T01:05:44.021 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2023-12-01T01:05:44.022 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/filter.txt 2023-12-01T01:05:44.023 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2023-12-01T01:05:44.023 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2023-12-01T01:05:44.024 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2023-12-01T01:05:44.024 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2023-12-01T01:05:44.025 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2023-12-01T01:05:44.030 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2023-12-01T01:05:44.031 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2023-12-01T01:05:44.031 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2023-12-01T01:05:44.031 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2023-12-01T01:05:44.031 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/igb.txt 2023-12-01T01:05:44.031 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2023-12-01T01:05:44.031 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2023-12-01T01:05:44.031 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2023-12-01T01:05:44.031 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2023-12-01T01:05:44.031 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2023-12-01T01:05:44.032 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2023-12-01T01:05:44.032 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2023-12-01T01:05:44.033 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2023-12-01T01:05:44.034 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2023-12-01T01:05:44.034 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/irda.txt 2023-12-01T01:05:44.035 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2023-12-01T01:05:44.036 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2023-12-01T01:05:44.036 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2023-12-01T01:05:44.037 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2023-12-01T01:05:44.037 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2023-12-01T01:05:44.038 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2023-12-01T01:05:44.038 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2023-12-01T01:05:44.039 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2023-12-01T01:05:44.040 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2023-12-01T01:05:44.040 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2023-12-01T01:05:44.041 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2023-12-01T01:05:44.042 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2023-12-01T01:05:44.042 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2023-12-01T01:05:44.043 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2023-12-01T01:05:44.043 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2023-12-01T01:05:44.044 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2023-12-01T01:05:44.045 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2023-12-01T01:05:44.045 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2023-12-01T01:05:44.046 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2023-12-01T01:05:44.047 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2023-12-01T01:05:44.047 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2023-12-01T01:05:44.048 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2023-12-01T01:05:44.048 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2023-12-01T01:05:44.049 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2023-12-01T01:05:44.050 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2023-12-01T01:05:44.050 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/phy.txt 2023-12-01T01:05:44.051 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2023-12-01T01:05:44.051 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2023-12-01T01:05:44.052 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2023-12-01T01:05:44.053 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2023-12-01T01:05:44.053 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2023-12-01T01:05:44.054 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2023-12-01T01:05:44.054 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/rds.txt 2023-12-01T01:05:44.055 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2023-12-01T01:05:44.056 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2023-12-01T01:05:44.057 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2023-12-01T01:05:44.057 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2023-12-01T01:05:44.058 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2023-12-01T01:05:44.059 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/secid.txt 2023-12-01T01:05:44.059 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2023-12-01T01:05:44.060 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2023-12-01T01:05:44.061 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2023-12-01T01:05:44.062 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2023-12-01T01:05:44.062 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2023-12-01T01:05:44.063 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2023-12-01T01:05:44.066 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2023-12-01T01:05:44.066 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2023-12-01T01:05:44.067 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/team.txt 2023-12-01T01:05:44.067 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2023-12-01T01:05:44.067 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2023-12-01T01:05:44.067 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2023-12-01T01:05:44.068 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2023-12-01T01:05:44.069 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2023-12-01T01:05:44.070 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2023-12-01T01:05:44.071 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2023-12-01T01:05:44.071 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2023-12-01T01:05:44.072 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2023-12-01T01:05:44.073 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2023-12-01T01:05:44.074 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2023-12-01T01:05:44.074 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2023-12-01T01:05:44.075 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2023-12-01T01:05:44.076 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2023-12-01T01:05:44.077 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2023-12-01T01:05:44.077 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/x25.txt 2023-12-01T01:05:44.078 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2023-12-01T01:05:44.079 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2023-12-01T01:05:44.080 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2023-12-01T01:05:44.080 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2023-12-01T01:05:44.081 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/nfc/ 2023-12-01T01:05:44.082 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2023-12-01T01:05:44.083 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2023-12-01T01:05:44.083 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/nios2/ 2023-12-01T01:05:44.084 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/nios2/README 2023-12-01T01:05:44.085 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2023-12-01T01:05:44.086 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/numastat.txt 2023-12-01T01:05:44.086 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2023-12-01T01:05:44.087 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/padata.txt 2023-12-01T01:05:44.088 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/parisc/ 2023-12-01T01:05:44.089 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2023-12-01T01:05:44.090 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/parisc/debugging 2023-12-01T01:05:44.091 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/parisc/registers 2023-12-01T01:05:44.092 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2023-12-01T01:05:44.093 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/parport.txt 2023-12-01T01:05:44.093 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/pcmcia/ 2023-12-01T01:05:44.094 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2023-12-01T01:05:44.095 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2023-12-01T01:05:44.096 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2023-12-01T01:05:44.097 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2023-12-01T01:05:44.097 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2023-12-01T01:05:44.098 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2023-12-01T01:05:44.099 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2023-12-01T01:05:44.100 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2023-12-01T01:05:44.101 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/phy.txt 2023-12-01T01:05:44.101 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/phy/ 2023-12-01T01:05:44.102 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2023-12-01T01:05:44.103 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/pi-futex.txt 2023-12-01T01:05:44.104 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/pinctrl.txt 2023-12-01T01:05:44.105 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/platform/ 2023-12-01T01:05:44.106 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2023-12-01T01:05:44.107 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/pnp.txt 2023-12-01T01:05:44.108 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/ 2023-12-01T01:05:44.109 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/00-INDEX 2023-12-01T01:05:44.111 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2023-12-01T01:05:44.112 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2023-12-01T01:05:44.112 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2023-12-01T01:05:44.112 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/devices.txt 2023-12-01T01:05:44.113 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2023-12-01T01:05:44.114 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2023-12-01T01:05:44.115 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/interface.txt 2023-12-01T01:05:44.115 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2023-12-01T01:05:44.116 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/opp.txt 2023-12-01T01:05:44.116 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/pci.txt 2023-12-01T01:05:44.117 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2023-12-01T01:05:44.118 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2023-12-01T01:05:44.118 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/powercap/ 2023-12-01T01:05:44.119 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2023-12-01T01:05:44.120 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/regulator/ 2023-12-01T01:05:44.122 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2023-12-01T01:05:44.122 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2023-12-01T01:05:44.122 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2023-12-01T01:05:44.123 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2023-12-01T01:05:44.123 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2023-12-01T01:05:44.124 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2023-12-01T01:05:44.125 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2023-12-01T01:05:44.125 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/states.txt 2023-12-01T01:05:44.126 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2023-12-01T01:05:44.126 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2023-12-01T01:05:44.127 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2023-12-01T01:05:44.128 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2023-12-01T01:05:44.128 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2023-12-01T01:05:44.129 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/tricks.txt 2023-12-01T01:05:44.130 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2023-12-01T01:05:44.130 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/power/video.txt 2023-12-01T01:05:44.131 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/powerpc/ 2023-12-01T01:05:44.132 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2023-12-01T01:05:44.133 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2023-12-01T01:05:44.134 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2023-12-01T01:05:44.134 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2023-12-01T01:05:44.135 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2023-12-01T01:05:44.135 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2023-12-01T01:05:44.136 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2023-12-01T01:05:44.137 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2023-12-01T01:05:44.137 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2023-12-01T01:05:44.138 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2023-12-01T01:05:44.138 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2023-12-01T01:05:44.139 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2023-12-01T01:05:44.139 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2023-12-01T01:05:44.140 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/pps/ 2023-12-01T01:05:44.141 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/pps/pps.txt 2023-12-01T01:05:44.142 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/prctl/ 2023-12-01T01:05:44.143 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2023-12-01T01:05:44.144 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/prctl/Makefile 2023-12-01T01:05:44.144 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2023-12-01T01:05:44.145 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2023-12-01T01:05:44.146 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2023-12-01T01:05:44.146 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2023-12-01T01:05:44.147 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2023-12-01T01:05:44.148 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2023-12-01T01:05:44.148 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/printk-formats.txt 2023-12-01T01:05:44.149 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/pti/ 2023-12-01T01:05:44.149 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2023-12-01T01:05:44.150 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ptp/ 2023-12-01T01:05:44.151 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2023-12-01T01:05:44.152 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ptp/Makefile 2023-12-01T01:05:44.154 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2023-12-01T01:05:44.154 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2023-12-01T01:05:44.154 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2023-12-01T01:05:44.156 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/pwm.txt 2023-12-01T01:05:44.156 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/ramoops.txt 2023-12-01T01:05:44.156 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/rapidio/ 2023-12-01T01:05:44.157 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2023-12-01T01:05:44.157 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2023-12-01T01:05:44.158 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2023-12-01T01:05:44.159 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/rbtree.txt 2023-12-01T01:05:44.159 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/remoteproc.txt 2023-12-01T01:05:44.160 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/rfkill.txt 2023-12-01T01:05:44.161 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2023-12-01T01:05:44.161 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2023-12-01T01:05:44.162 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/rpmsg.txt 2023-12-01T01:05:44.163 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/rtc.txt 2023-12-01T01:05:44.163 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/s390/ 2023-12-01T01:05:44.164 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2023-12-01T01:05:44.165 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2023-12-01T01:05:44.166 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/s390/3270.txt 2023-12-01T01:05:44.167 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/s390/CommonIO 2023-12-01T01:05:44.167 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/s390/DASD 2023-12-01T01:05:44.168 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2023-12-01T01:05:44.169 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/s390/cds.txt 2023-12-01T01:05:44.170 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2023-12-01T01:05:44.170 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2023-12-01T01:05:44.171 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2023-12-01T01:05:44.172 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2023-12-01T01:05:44.172 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2023-12-01T01:05:44.173 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2023-12-01T01:05:44.173 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2023-12-01T01:05:44.174 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scheduler/ 2023-12-01T01:05:44.175 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2023-12-01T01:05:44.176 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2023-12-01T01:05:44.176 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2023-12-01T01:05:44.177 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2023-12-01T01:05:44.178 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2023-12-01T01:05:44.178 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2023-12-01T01:05:44.179 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2023-12-01T01:05:44.180 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2023-12-01T01:05:44.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:43 smithi116 ceph-mon[103554]: pgmap v335: 97 pgs: 97 active+clean; 81 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 6.7 MiB/s wr, 35 op/s 2023-12-01T01:05:44.180 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2023-12-01T01:05:44.181 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2023-12-01T01:05:44.182 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/ 2023-12-01T01:05:44.183 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2023-12-01T01:05:44.184 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2023-12-01T01:05:44.184 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2023-12-01T01:05:44.185 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2023-12-01T01:05:44.185 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2023-12-01T01:05:44.186 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2023-12-01T01:05:44.187 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2023-12-01T01:05:44.188 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2023-12-01T01:05:44.190 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2023-12-01T01:05:44.190 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2023-12-01T01:05:44.190 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2023-12-01T01:05:44.191 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2023-12-01T01:05:44.191 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2023-12-01T01:05:44.192 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2023-12-01T01:05:44.192 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2023-12-01T01:05:44.193 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2023-12-01T01:05:44.193 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2023-12-01T01:05:44.194 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2023-12-01T01:05:44.195 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2023-12-01T01:05:44.195 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2023-12-01T01:05:44.196 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2023-12-01T01:05:44.197 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2023-12-01T01:05:44.198 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2023-12-01T01:05:44.199 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2023-12-01T01:05:44.199 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2023-12-01T01:05:44.200 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2023-12-01T01:05:44.201 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2023-12-01T01:05:44.201 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2023-12-01T01:05:44.202 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2023-12-01T01:05:44.202 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2023-12-01T01:05:44.203 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2023-12-01T01:05:44.204 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2023-12-01T01:05:44.204 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2023-12-01T01:05:44.205 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2023-12-01T01:05:44.205 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2023-12-01T01:05:44.206 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2023-12-01T01:05:44.206 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2023-12-01T01:05:44.207 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2023-12-01T01:05:44.208 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2023-12-01T01:05:44.209 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2023-12-01T01:05:44.209 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2023-12-01T01:05:44.210 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2023-12-01T01:05:44.210 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2023-12-01T01:05:44.211 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2023-12-01T01:05:44.211 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2023-12-01T01:05:44.212 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2023-12-01T01:05:44.212 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2023-12-01T01:05:44.213 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2023-12-01T01:05:44.214 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2023-12-01T01:05:44.214 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2023-12-01T01:05:44.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:43 smithi093 ceph-mon[103327]: pgmap v335: 97 pgs: 97 active+clean; 81 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 6.7 MiB/s wr, 35 op/s 2023-12-01T01:05:44.215 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2023-12-01T01:05:44.216 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2023-12-01T01:05:44.217 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2023-12-01T01:05:44.217 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/st.txt 2023-12-01T01:05:44.218 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2023-12-01T01:05:44.219 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2023-12-01T01:05:44.219 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2023-12-01T01:05:44.220 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2023-12-01T01:05:44.221 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2023-12-01T01:05:44.221 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/security/ 2023-12-01T01:05:44.222 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/security/00-INDEX 2023-12-01T01:05:44.223 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2023-12-01T01:05:44.223 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/security/LSM.txt 2023-12-01T01:05:44.224 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2023-12-01T01:05:44.225 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/security/Smack.txt 2023-12-01T01:05:44.225 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/security/Yama.txt 2023-12-01T01:05:44.226 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2023-12-01T01:05:44.227 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/security/credentials.txt 2023-12-01T01:05:44.228 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2023-12-01T01:05:44.229 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2023-12-01T01:05:44.229 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2023-12-01T01:05:44.230 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/security/keys.txt 2023-12-01T01:05:44.231 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2023-12-01T01:05:44.231 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/serial-console.txt 2023-12-01T01:05:44.232 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/serial/ 2023-12-01T01:05:44.233 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2023-12-01T01:05:44.234 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2023-12-01T01:05:44.234 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/serial/driver 2023-12-01T01:05:44.235 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2023-12-01T01:05:44.236 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2023-12-01T01:05:44.237 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2023-12-01T01:05:44.238 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2023-12-01T01:05:44.238 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/serial/tty.txt 2023-12-01T01:05:44.239 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2023-12-01T01:05:44.240 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sh/ 2023-12-01T01:05:44.240 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2023-12-01T01:05:44.241 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2023-12-01T01:05:44.242 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2023-12-01T01:05:44.242 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/ 2023-12-01T01:05:44.243 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/ 2023-12-01T01:05:44.244 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2023-12-01T01:05:44.245 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2023-12-01T01:05:44.246 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2023-12-01T01:05:44.246 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2023-12-01T01:05:44.247 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2023-12-01T01:05:44.247 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2023-12-01T01:05:44.248 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2023-12-01T01:05:44.249 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2023-12-01T01:05:44.249 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2023-12-01T01:05:44.250 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2023-12-01T01:05:44.250 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2023-12-01T01:05:44.251 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2023-12-01T01:05:44.251 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2023-12-01T01:05:44.252 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2023-12-01T01:05:44.253 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2023-12-01T01:05:44.253 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2023-12-01T01:05:44.254 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2023-12-01T01:05:44.255 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2023-12-01T01:05:44.255 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2023-12-01T01:05:44.256 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2023-12-01T01:05:44.257 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2023-12-01T01:05:44.257 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2023-12-01T01:05:44.258 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2023-12-01T01:05:44.261 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2023-12-01T01:05:44.261 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2023-12-01T01:05:44.261 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2023-12-01T01:05:44.261 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2023-12-01T01:05:44.261 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2023-12-01T01:05:44.262 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2023-12-01T01:05:44.262 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2023-12-01T01:05:44.263 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2023-12-01T01:05:44.264 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2023-12-01T01:05:44.264 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2023-12-01T01:05:44.265 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2023-12-01T01:05:44.265 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2023-12-01T01:05:44.266 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2023-12-01T01:05:44.266 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/ 2023-12-01T01:05:44.267 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2023-12-01T01:05:44.268 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2023-12-01T01:05:44.269 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2023-12-01T01:05:44.269 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2023-12-01T01:05:44.270 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2023-12-01T01:05:44.270 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2023-12-01T01:05:44.271 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2023-12-01T01:05:44.271 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2023-12-01T01:05:44.272 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2023-12-01T01:05:44.273 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2023-12-01T01:05:44.273 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2023-12-01T01:05:44.274 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2023-12-01T01:05:44.275 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2023-12-01T01:05:44.275 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2023-12-01T01:05:44.276 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2023-12-01T01:05:44.277 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2023-12-01T01:05:44.277 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2023-12-01T01:05:44.278 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2023-12-01T01:05:44.278 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2023-12-01T01:05:44.279 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2023-12-01T01:05:44.279 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2023-12-01T01:05:44.280 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2023-12-01T01:05:44.281 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2023-12-01T01:05:44.282 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2023-12-01T01:05:44.282 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sparse.txt 2023-12-01T01:05:44.283 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/spi/ 2023-12-01T01:05:44.284 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/spi/.gitignore 2023-12-01T01:05:44.285 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2023-12-01T01:05:44.286 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/spi/Makefile 2023-12-01T01:05:44.286 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/spi/butterfly 2023-12-01T01:05:44.287 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2023-12-01T01:05:44.288 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2023-12-01T01:05:44.288 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2023-12-01T01:05:44.289 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2023-12-01T01:05:44.290 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/spi/spi-summary 2023-12-01T01:05:44.291 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/spi/spidev 2023-12-01T01:05:44.291 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2023-12-01T01:05:44.292 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2023-12-01T01:05:44.292 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2023-12-01T01:05:44.294 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2023-12-01T01:05:44.294 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/static-keys.txt 2023-12-01T01:05:44.295 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/svga.txt 2023-12-01T01:05:44.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:43 smithi026 ceph-mon[98801]: pgmap v335: 97 pgs: 97 active+clean; 81 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 6.7 MiB/s wr, 35 op/s 2023-12-01T01:05:44.296 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sysctl/ 2023-12-01T01:05:44.297 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2023-12-01T01:05:44.298 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sysctl/README 2023-12-01T01:05:44.300 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2023-12-01T01:05:44.300 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2023-12-01T01:05:44.301 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2023-12-01T01:05:44.302 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2023-12-01T01:05:44.303 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2023-12-01T01:05:44.303 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2023-12-01T01:05:44.304 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2023-12-01T01:05:44.305 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/sysrq.txt 2023-12-01T01:05:44.306 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/target/ 2023-12-01T01:05:44.307 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2023-12-01T01:05:44.308 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2023-12-01T01:05:44.310 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2023-12-01T01:05:44.311 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/thermal/ 2023-12-01T01:05:44.312 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2023-12-01T01:05:44.313 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2023-12-01T01:05:44.314 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2023-12-01T01:05:44.315 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2023-12-01T01:05:44.315 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2023-12-01T01:05:44.316 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2023-12-01T01:05:44.317 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2023-12-01T01:05:44.318 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2023-12-01T01:05:44.319 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/timers/ 2023-12-01T01:05:44.320 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/timers/.gitignore 2023-12-01T01:05:44.321 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2023-12-01T01:05:44.322 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/timers/Makefile 2023-12-01T01:05:44.323 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2023-12-01T01:05:44.324 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/timers/highres.txt 2023-12-01T01:05:44.325 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2023-12-01T01:05:44.325 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2023-12-01T01:05:44.326 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2023-12-01T01:05:44.327 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2023-12-01T01:05:44.328 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2023-12-01T01:05:44.328 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2023-12-01T01:05:44.329 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/tpm/ 2023-12-01T01:05:44.330 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2023-12-01T01:05:44.332 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/ 2023-12-01T01:05:44.333 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2023-12-01T01:05:44.334 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2023-12-01T01:05:44.336 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2023-12-01T01:05:44.336 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2023-12-01T01:05:44.337 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/events.txt 2023-12-01T01:05:44.338 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2023-12-01T01:05:44.339 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2023-12-01T01:05:44.340 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2023-12-01T01:05:44.341 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2023-12-01T01:05:44.342 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2023-12-01T01:05:44.343 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2023-12-01T01:05:44.344 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2023-12-01T01:05:44.345 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2023-12-01T01:05:44.346 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2023-12-01T01:05:44.347 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2023-12-01T01:05:44.347 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2023-12-01T01:05:44.348 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2023-12-01T01:05:44.349 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2023-12-01T01:05:44.350 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/unicode.txt 2023-12-01T01:05:44.352 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/unshare.txt 2023-12-01T01:05:44.353 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/ 2023-12-01T01:05:44.354 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/CREDITS 2023-12-01T01:05:44.355 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/URB.txt 2023-12-01T01:05:44.356 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2023-12-01T01:05:44.357 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/acm.txt 2023-12-01T01:05:44.358 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2023-12-01T01:05:44.359 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2023-12-01T01:05:44.359 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2023-12-01T01:05:44.360 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2023-12-01T01:05:44.361 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2023-12-01T01:05:44.362 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/dma.txt 2023-12-01T01:05:44.363 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2023-12-01T01:05:44.364 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2023-12-01T01:05:44.365 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2023-12-01T01:05:44.366 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2023-12-01T01:05:44.367 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2023-12-01T01:05:44.367 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2023-12-01T01:05:44.368 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2023-12-01T01:05:44.369 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2023-12-01T01:05:44.370 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2023-12-01T01:05:44.371 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2023-12-01T01:05:44.371 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2023-12-01T01:05:44.372 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2023-12-01T01:05:44.373 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2023-12-01T01:05:44.374 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/linux.inf 2023-12-01T01:05:44.374 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2023-12-01T01:05:44.376 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2023-12-01T01:05:44.376 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2023-12-01T01:05:44.377 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2023-12-01T01:05:44.379 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/persist.txt 2023-12-01T01:05:44.379 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2023-12-01T01:05:44.380 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2023-12-01T01:05:44.381 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/rio.txt 2023-12-01T01:05:44.382 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2023-12-01T01:05:44.383 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2023-12-01T01:05:44.384 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2023-12-01T01:05:44.385 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2023-12-01T01:05:44.386 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vDSO/ 2023-12-01T01:05:44.387 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2023-12-01T01:05:44.388 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2023-12-01T01:05:44.389 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2023-12-01T01:05:44.389 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2023-12-01T01:05:44.390 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2023-12-01T01:05:44.391 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vfio.txt 2023-12-01T01:05:44.392 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2023-12-01T01:05:44.393 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video-output.txt 2023-12-01T01:05:44.394 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/ 2023-12-01T01:05:44.395 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2023-12-01T01:05:44.396 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/API.html 2023-12-01T01:05:44.397 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2023-12-01T01:05:44.398 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2023-12-01T01:05:44.399 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2023-12-01T01:05:44.400 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2023-12-01T01:05:44.401 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2023-12-01T01:05:44.402 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2023-12-01T01:05:44.402 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2023-12-01T01:05:44.403 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2023-12-01T01:05:44.405 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2023-12-01T01:05:44.405 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2023-12-01T01:05:44.406 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2023-12-01T01:05:44.407 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2023-12-01T01:05:44.408 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2023-12-01T01:05:44.408 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2023-12-01T01:05:44.409 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2023-12-01T01:05:44.410 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2023-12-01T01:05:44.411 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2023-12-01T01:05:44.411 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2023-12-01T01:05:44.412 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2023-12-01T01:05:44.413 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2023-12-01T01:05:44.414 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2023-12-01T01:05:44.415 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2023-12-01T01:05:44.416 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2023-12-01T01:05:44.418 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2023-12-01T01:05:44.418 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2023-12-01T01:05:44.418 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2023-12-01T01:05:44.419 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2023-12-01T01:05:44.420 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2023-12-01T01:05:44.421 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2023-12-01T01:05:44.421 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2023-12-01T01:05:44.422 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2023-12-01T01:05:44.423 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2023-12-01T01:05:44.424 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2023-12-01T01:05:44.424 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2023-12-01T01:05:44.425 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2023-12-01T01:05:44.425 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2023-12-01T01:05:44.426 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2023-12-01T01:05:44.427 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2023-12-01T01:05:44.428 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2023-12-01T01:05:44.429 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2023-12-01T01:05:44.430 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2023-12-01T01:05:44.431 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2023-12-01T01:05:44.432 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2023-12-01T01:05:44.433 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2023-12-01T01:05:44.434 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2023-12-01T01:05:44.434 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2023-12-01T01:05:44.435 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2023-12-01T01:05:44.436 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2023-12-01T01:05:44.437 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2023-12-01T01:05:44.438 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2023-12-01T01:05:44.438 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2023-12-01T01:05:44.439 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2023-12-01T01:05:44.441 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2023-12-01T01:05:44.441 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2023-12-01T01:05:44.443 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2023-12-01T01:05:44.443 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2023-12-01T01:05:44.444 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2023-12-01T01:05:44.445 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2023-12-01T01:05:44.446 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2023-12-01T01:05:44.446 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2023-12-01T01:05:44.447 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2023-12-01T01:05:44.448 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2023-12-01T01:05:44.449 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2023-12-01T01:05:44.450 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2023-12-01T01:05:44.451 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2023-12-01T01:05:44.454 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2023-12-01T01:05:44.454 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2023-12-01T01:05:44.454 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2023-12-01T01:05:44.454 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2023-12-01T01:05:44.455 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2023-12-01T01:05:44.456 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2023-12-01T01:05:44.457 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2023-12-01T01:05:44.457 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2023-12-01T01:05:44.458 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2023-12-01T01:05:44.459 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2023-12-01T01:05:44.460 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2023-12-01T01:05:44.460 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/ 2023-12-01T01:05:44.461 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2023-12-01T01:05:44.462 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2023-12-01T01:05:44.464 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2023-12-01T01:05:44.465 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2023-12-01T01:05:44.466 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2023-12-01T01:05:44.467 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2023-12-01T01:05:44.468 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2023-12-01T01:05:44.469 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2023-12-01T01:05:44.471 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2023-12-01T01:05:44.472 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2023-12-01T01:05:44.472 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2023-12-01T01:05:44.472 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2023-12-01T01:05:44.473 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2023-12-01T01:05:44.473 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2023-12-01T01:05:44.474 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2023-12-01T01:05:44.475 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2023-12-01T01:05:44.476 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2023-12-01T01:05:44.477 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2023-12-01T01:05:44.477 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2023-12-01T01:05:44.478 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2023-12-01T01:05:44.479 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2023-12-01T01:05:44.480 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2023-12-01T01:05:44.480 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2023-12-01T01:05:44.482 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/uml/ 2023-12-01T01:05:44.483 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2023-12-01T01:05:44.484 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/ 2023-12-01T01:05:44.485 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/.gitignore 2023-12-01T01:05:44.486 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2023-12-01T01:05:44.487 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2023-12-01T01:05:44.488 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/balance 2023-12-01T01:05:44.488 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2023-12-01T01:05:44.489 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2023-12-01T01:05:44.490 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2023-12-01T01:05:44.492 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2023-12-01T01:05:44.492 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2023-12-01T01:05:44.493 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2023-12-01T01:05:44.493 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/numa 2023-12-01T01:05:44.494 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2023-12-01T01:05:44.495 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2023-12-01T01:05:44.495 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/page_migration 2023-12-01T01:05:44.496 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2023-12-01T01:05:44.497 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2023-12-01T01:05:44.498 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2023-12-01T01:05:44.498 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/slub.txt 2023-12-01T01:05:44.499 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2023-12-01T01:05:44.500 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2023-12-01T01:05:44.501 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2023-12-01T01:05:44.501 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2023-12-01T01:05:44.502 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2023-12-01T01:05:44.503 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/vme_api.txt 2023-12-01T01:05:44.503 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2023-12-01T01:05:44.504 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/ 2023-12-01T01:05:44.505 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2023-12-01T01:05:44.507 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/masters/ 2023-12-01T01:05:44.508 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2023-12-01T01:05:44.508 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2023-12-01T01:05:44.510 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2023-12-01T01:05:44.511 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2023-12-01T01:05:44.511 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2023-12-01T01:05:44.512 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2023-12-01T01:05:44.513 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/slaves/ 2023-12-01T01:05:44.514 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2023-12-01T01:05:44.515 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2023-12-01T01:05:44.516 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2023-12-01T01:05:44.517 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2023-12-01T01:05:44.518 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2023-12-01T01:05:44.518 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/w1.generic 2023-12-01T01:05:44.519 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2023-12-01T01:05:44.520 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/watchdog/ 2023-12-01T01:05:44.521 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2023-12-01T01:05:44.522 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2023-12-01T01:05:44.523 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2023-12-01T01:05:44.523 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2023-12-01T01:05:44.524 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/watchdog/src/ 2023-12-01T01:05:44.525 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2023-12-01T01:05:44.526 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2023-12-01T01:05:44.527 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2023-12-01T01:05:44.527 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2023-12-01T01:05:44.529 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2023-12-01T01:05:44.529 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2023-12-01T01:05:44.530 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2023-12-01T01:05:44.530 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2023-12-01T01:05:44.531 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/wimax/ 2023-12-01T01:05:44.532 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2023-12-01T01:05:44.533 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2023-12-01T01:05:44.534 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/workqueue.txt 2023-12-01T01:05:44.535 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/ 2023-12-01T01:05:44.536 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2023-12-01T01:05:44.537 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/boot.txt 2023-12-01T01:05:44.538 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2023-12-01T01:05:44.539 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2023-12-01T01:05:44.540 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2023-12-01T01:05:44.540 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2023-12-01T01:05:44.541 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/i386/ 2023-12-01T01:05:44.542 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2023-12-01T01:05:44.543 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2023-12-01T01:05:44.544 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2023-12-01T01:05:44.545 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/pat.txt 2023-12-01T01:05:44.546 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2023-12-01T01:05:44.547 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2023-12-01T01:05:44.547 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2023-12-01T01:05:44.549 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2023-12-01T01:05:44.549 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2023-12-01T01:05:44.550 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2023-12-01T01:05:44.551 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2023-12-01T01:05:44.552 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2023-12-01T01:05:44.553 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2023-12-01T01:05:44.553 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2023-12-01T01:05:44.554 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2023-12-01T01:05:44.555 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2023-12-01T01:05:44.555 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/xillybus.txt 2023-12-01T01:05:44.556 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/xtensa/ 2023-12-01T01:05:44.557 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2023-12-01T01:05:44.558 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2023-12-01T01:05:44.560 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/xz.txt 2023-12-01T01:05:44.560 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/ 2023-12-01T01:05:44.561 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2023-12-01T01:05:44.562 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2023-12-01T01:05:44.564 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2023-12-01T01:05:44.564 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2023-12-01T01:05:44.565 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2023-12-01T01:05:44.566 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2023-12-01T01:05:44.566 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2023-12-01T01:05:44.567 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2023-12-01T01:05:44.569 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2023-12-01T01:05:44.569 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2023-12-01T01:05:44.570 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2023-12-01T01:05:44.572 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2023-12-01T01:05:44.572 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2023-12-01T01:05:44.573 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2023-12-01T01:05:44.575 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2023-12-01T01:05:44.575 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2023-12-01T01:05:44.575 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2023-12-01T01:05:44.577 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2023-12-01T01:05:44.578 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2023-12-01T01:05:44.578 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2023-12-01T01:05:44.579 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2023-12-01T01:05:44.580 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2023-12-01T01:05:44.580 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2023-12-01T01:05:44.581 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2023-12-01T01:05:44.582 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2023-12-01T01:05:44.583 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2023-12-01T01:05:44.584 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2023-12-01T01:05:44.585 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2023-12-01T01:05:44.586 INFO:tasks.workunit.client.0.smithi026.stdout:linux-4.0.5/Documentation/zorro.txt 2023-12-01T01:05:46.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:45 smithi116 ceph-mon[103554]: pgmap v336: 97 pgs: 97 active+clean; 82 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 6.8 MiB/s wr, 40 op/s 2023-12-01T01:05:46.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:45 smithi093 ceph-mon[103327]: pgmap v336: 97 pgs: 97 active+clean; 82 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 6.8 MiB/s wr, 40 op/s 2023-12-01T01:05:46.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:45 smithi026 ceph-mon[98801]: pgmap v336: 97 pgs: 97 active+clean; 82 MiB data, 566 MiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 6.8 MiB/s wr, 40 op/s 2023-12-01T01:05:48.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:47 smithi116 ceph-mon[103554]: pgmap v337: 97 pgs: 97 active+clean; 86 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 7.2 MiB/s wr, 74 op/s 2023-12-01T01:05:48.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:47 smithi093 ceph-mon[103327]: pgmap v337: 97 pgs: 97 active+clean; 86 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 7.2 MiB/s wr, 74 op/s 2023-12-01T01:05:48.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:47 smithi026 ceph-mon[98801]: pgmap v337: 97 pgs: 97 active+clean; 86 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 7.2 MiB/s wr, 74 op/s 2023-12-01T01:05:50.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:49 smithi116 ceph-mon[103554]: pgmap v338: 97 pgs: 97 active+clean; 88 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 7.3 MiB/s wr, 74 op/s 2023-12-01T01:05:50.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:49 smithi093 ceph-mon[103327]: pgmap v338: 97 pgs: 97 active+clean; 88 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 7.3 MiB/s wr, 74 op/s 2023-12-01T01:05:50.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:49 smithi026 ceph-mon[98801]: pgmap v338: 97 pgs: 97 active+clean; 88 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 7.3 MiB/s wr, 74 op/s 2023-12-01T01:05:52.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:51 smithi116 ceph-mon[103554]: pgmap v339: 97 pgs: 97 active+clean; 88 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 6.6 MiB/s wr, 70 op/s 2023-12-01T01:05:52.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:51 smithi093 ceph-mon[103327]: pgmap v339: 97 pgs: 97 active+clean; 88 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 6.6 MiB/s wr, 70 op/s 2023-12-01T01:05:52.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:51 smithi026 ceph-mon[98801]: pgmap v339: 97 pgs: 97 active+clean; 88 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 6.6 MiB/s wr, 70 op/s 2023-12-01T01:05:52.971 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-01T01:05:53.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.098+0000 7f7978fa1700 1 -- 172.21.15.26:0/1327397565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79740ffcc0 msgr2=0x7f79741000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.098+0000 7f7978fa1700 1 --2- 172.21.15.26:0/1327397565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79740ffcc0 0x7f79741000e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f79680099c0 tx=0x7f7968009cd0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.098+0000 7f7978fa1700 1 -- 172.21.15.26:0/1327397565 shutdown_connections 2023-12-01T01:05:53.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.098+0000 7f7978fa1700 1 --2- 172.21.15.26:0/1327397565 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7974101850 0x7f7974108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.098+0000 7f7978fa1700 1 --2- 172.21.15.26:0/1327397565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f79740ffcc0 0x7f79741000e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.098+0000 7f7978fa1700 1 --2- 172.21.15.26:0/1327397565 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7974100eb0 0x7f7974101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.098+0000 7f7978fa1700 1 -- 172.21.15.26:0/1327397565 >> 172.21.15.26:0/1327397565 conn(0x7f79740fb250 msgr2=0x7f79740fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.098+0000 7f7978fa1700 1 -- 172.21.15.26:0/1327397565 shutdown_connections 2023-12-01T01:05:53.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.098+0000 7f7978fa1700 1 -- 172.21.15.26:0/1327397565 wait complete. 2023-12-01T01:05:53.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.099+0000 7f7978fa1700 1 Processor -- start 2023-12-01T01:05:53.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.099+0000 7f7978fa1700 1 -- start start 2023-12-01T01:05:53.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.099+0000 7f7978fa1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79740ffcc0 0x7f7974069a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.099+0000 7f7978fa1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7974100eb0 0x7f797419b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.099+0000 7f7978fa1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7974101850 0x7f797419ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.099+0000 7f7978fa1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797419e670 con 0x7f7974101850 2023-12-01T01:05:53.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.099+0000 7f7978fa1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797419e7e0 con 0x7f79740ffcc0 2023-12-01T01:05:53.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.099+0000 7f7978fa1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797419e9a0 con 0x7f7974100eb0 2023-12-01T01:05:53.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.099+0000 7f7972d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7974101850 0x7f797419ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.099+0000 7f7972d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7974101850 0x7f797419ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56008/0 (socket says 172.21.15.26:56008) 2023-12-01T01:05:53.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.099+0000 7f7972d9d700 1 -- 172.21.15.26:0/4256913160 learned_addr learned my addr 172.21.15.26:0/4256913160 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:53.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.099+0000 7f797259c700 1 --2- 172.21.15.26:0/4256913160 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79740ffcc0 0x7f7974069a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.100+0000 7f7971d9b700 1 --2- 172.21.15.26:0/4256913160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7974100eb0 0x7f797419b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.100+0000 7f7972d9d700 1 -- 172.21.15.26:0/4256913160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7974100eb0 msgr2=0x7f797419b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.100+0000 7f7972d9d700 1 --2- 172.21.15.26:0/4256913160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7974100eb0 0x7f797419b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.100+0000 7f7972d9d700 1 -- 172.21.15.26:0/4256913160 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79740ffcc0 msgr2=0x7f7974069a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.100+0000 7f7972d9d700 1 --2- 172.21.15.26:0/4256913160 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79740ffcc0 0x7f7974069a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.100+0000 7f7972d9d700 1 -- 172.21.15.26:0/4256913160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79680095f0 con 0x7f7974101850 2023-12-01T01:05:53.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.100+0000 7f7972d9d700 1 --2- 172.21.15.26:0/4256913160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7974101850 0x7f797419ded0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f796c00ada0 tx=0x7f796c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.100+0000 7f79637fe700 1 -- 172.21.15.26:0/4256913160 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c00f070 con 0x7f7974101850 2023-12-01T01:05:53.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.100+0000 7f79637fe700 1 -- 172.21.15.26:0/4256913160 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f796c007b30 con 0x7f7974101850 2023-12-01T01:05:53.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.100+0000 7f7978fa1700 1 -- 172.21.15.26:0/4256913160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797419ec80 con 0x7f7974101850 2023-12-01T01:05:53.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.100+0000 7f79637fe700 1 -- 172.21.15.26:0/4256913160 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0053e0 con 0x7f7974101850 2023-12-01T01:05:53.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.100+0000 7f7978fa1700 1 -- 172.21.15.26:0/4256913160 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797419f190 con 0x7f7974101850 2023-12-01T01:05:53.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.102+0000 7f79637fe700 1 -- 172.21.15.26:0/4256913160 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f796c005540 con 0x7f7974101850 2023-12-01T01:05:53.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.103+0000 7f79637fe700 1 --2- 172.21.15.26:0/4256913160 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f795c0a05a0 0x7f795c0a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.103+0000 7f797259c700 1 --2- 172.21.15.26:0/4256913160 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f795c0a05a0 0x7f795c0a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.103+0000 7f79637fe700 1 -- 172.21.15.26:0/4256913160 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f796c0cae20 con 0x7f7974101850 2023-12-01T01:05:53.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.104+0000 7f797259c700 1 --2- 172.21.15.26:0/4256913160 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f795c0a05a0 0x7f795c0a2a60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f796800b580 tx=0x7f7968005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.104+0000 7f7985131b80 1 Processor -- start 2023-12-01T01:05:53.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.104+0000 7f7985131b80 1 -- start start 2023-12-01T01:05:53.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.104+0000 7f7985131b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb968500 0x564cdb968940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.104+0000 7f7985131b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968e80 0x564cdb967270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.104+0000 7f7985131b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb967800 0x564cdb967c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.106 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.104+0000 7f7985131b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb8baa10 con 0x564cdb968500 2023-12-01T01:05:53.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.104+0000 7f7985131b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb8b83d0 con 0x564cdb968e80 2023-12-01T01:05:53.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.104+0000 7f7985131b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb8b3cc0 con 0x564cdb967800 2023-12-01T01:05:53.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.104+0000 7f797259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb968500 0x564cdb968940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.104+0000 7f797259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb968500 0x564cdb968940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56012/0 (socket says 172.21.15.26:56012) 2023-12-01T01:05:53.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.104+0000 7f797259c700 1 -- 172.21.15.26:0/2542855685 learned_addr learned my addr 172.21.15.26:0/2542855685 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:53.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.104+0000 7f7971d9b700 1 --2- 172.21.15.26:0/2542855685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968e80 0x564cdb967270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.104+0000 7f7972d9d700 1 --2- 172.21.15.26:0/2542855685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb967800 0x564cdb967c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.105+0000 7f797259c700 1 -- 172.21.15.26:0/2542855685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb967800 msgr2=0x564cdb967c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.105+0000 7f797259c700 1 --2- 172.21.15.26:0/2542855685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb967800 0x564cdb967c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.105+0000 7f797259c700 1 -- 172.21.15.26:0/2542855685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968e80 msgr2=0x564cdb967270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.105+0000 7f797259c700 1 --2- 172.21.15.26:0/2542855685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968e80 0x564cdb967270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.105+0000 7f797259c700 1 -- 172.21.15.26:0/2542855685 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cdb6e1de0 con 0x564cdb968500 2023-12-01T01:05:53.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.105+0000 7f7971d9b700 1 --2- 172.21.15.26:0/2542855685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968e80 0x564cdb967270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:53.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.105+0000 7f797259c700 1 --2- 172.21.15.26:0/2542855685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb968500 0x564cdb968940 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7968015000 tx=0x7f7968020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5077b789058781bd server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.107 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.105+0000 7f7960ff9700 1 -- 172.21.15.26:0/2542855685 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796802a070 con 0x564cdb968500 2023-12-01T01:05:53.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.105+0000 7f7960ff9700 1 -- 172.21.15.26:0/2542855685 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f796801e040 con 0x564cdb968500 2023-12-01T01:05:53.108 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.105+0000 7f7960ff9700 1 -- 172.21.15.26:0/2542855685 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7968023940 con 0x564cdb968500 2023-12-01T01:05:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 -- 172.21.15.26:0/2542855685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb968500 msgr2=0x564cdb968940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 --2- 172.21.15.26:0/2542855685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb968500 0x564cdb968940 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7968015000 tx=0x7f7968020000 comp rx=0 tx=0).stop 2023-12-01T01:05:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 -- 172.21.15.26:0/2542855685 shutdown_connections 2023-12-01T01:05:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 --2- 172.21.15.26:0/2542855685 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb967800 0x564cdb967c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 --2- 172.21.15.26:0/2542855685 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb968500 0x564cdb968940 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 --2- 172.21.15.26:0/2542855685 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968e80 0x564cdb967270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 -- 172.21.15.26:0/2542855685 >> 172.21.15.26:0/2542855685 conn(0x564cdb8c20d0 msgr2=0x564cdb95d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 -- 172.21.15.26:0/2542855685 shutdown_connections 2023-12-01T01:05:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 -- 172.21.15.26:0/2542855685 wait complete. 2023-12-01T01:05:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 -- start start 2023-12-01T01:05:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 Processor -- start 2023-12-01T01:05:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb970d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb968500 0x564cdb971260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968e80 0x564cdb9782a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb850510 con 0x564cdb967800 2023-12-01T01:05:53.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb8501b0 con 0x564cdb968e80 2023-12-01T01:05:53.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.106+0000 7f7985131b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb737920 con 0x564cdb968500 2023-12-01T01:05:53.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f7985131b80 10 client.0 _ll_register_callbacks cb 0x564cdb79da80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:53.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f797259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb970d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f797259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb970d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56018/0 (socket says 172.21.15.26:56018) 2023-12-01T01:05:53.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f797259c700 1 -- 172.21.15.26:0/4065360406 learned_addr learned my addr 172.21.15.26:0/4065360406 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:53.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f7972d9d700 1 --2- 172.21.15.26:0/4065360406 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968e80 0x564cdb9782a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f7971d9b700 1 --2- 172.21.15.26:0/4065360406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb968500 0x564cdb971260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f797259c700 1 -- 172.21.15.26:0/4065360406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb968500 msgr2=0x564cdb971260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f797259c700 1 --2- 172.21.15.26:0/4065360406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb968500 0x564cdb971260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f797259c700 1 -- 172.21.15.26:0/4065360406 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968e80 msgr2=0x564cdb9782a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f797259c700 1 --2- 172.21.15.26:0/4065360406 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968e80 0x564cdb9782a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f797259c700 1 -- 172.21.15.26:0/4065360406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79640098e0 con 0x564cdb967800 2023-12-01T01:05:53.113 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f7971d9b700 1 --2- 172.21.15.26:0/4065360406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb968500 0x564cdb971260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:05:53.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f797259c700 1 --2- 172.21.15.26:0/4065360406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb970d20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f796800b8c0 tx=0x7f7968005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b441ddc5d31d34 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f7959ffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:53.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f7959ffb700 1 -- 172.21.15.26:0/4065360406 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796802a040 con 0x564cdb967800 2023-12-01T01:05:53.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f7959ffb700 1 -- 172.21.15.26:0/4065360406 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7968024d30 con 0x564cdb967800 2023-12-01T01:05:53.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f7985131b80 1 -- 172.21.15.26:0/4065360406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564cdb8ded10 con 0x564cdb967800 2023-12-01T01:05:53.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f7959ffb700 1 -- 172.21.15.26:0/4065360406 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f796800f460 con 0x564cdb967800 2023-12-01T01:05:53.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f7985131b80 10 client.15729 fetch_fsmap learned FSMap version 24 2023-12-01T01:05:53.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.107+0000 7f7985131b80 1 -- 172.21.15.26:0/4065360406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7f7974108a50 con 0x564cdb967800 2023-12-01T01:05:53.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.108+0000 7f7959ffb700 1 -- 172.21.15.26:0/4065360406 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x564cdb8ded10 con 0x564cdb967800 2023-12-01T01:05:53.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.108+0000 7f7959ffb700 1 -- 172.21.15.26:0/4065360406 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 24) v1 ==== 7458+0+0 (secure 0 0 0) 0x7f796802e760 con 0x564cdb967800 2023-12-01T01:05:53.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.108+0000 7f7985131b80 10 client.15729 fetch_fsmap finished waiting for FSMap version 24 2023-12-01T01:05:53.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.108+0000 7f7985131b80 10 client.15729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:53.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.108+0000 7f7985131b80 20 client.15729 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:53.114 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.108+0000 7f7985131b80 1 --2- 172.21.15.26:0/4065360406 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x564cdb97c5d0 0x564cdb97e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.108+0000 7f7985131b80 4 client.15729 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:05:53.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.108+0000 7f7985131b80 1 -- 172.21.15.26:0/4065360406 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564cdb931e10 con 0x564cdb97c5d0 2023-12-01T01:05:53.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.108+0000 7f7971d9b700 1 --2- 172.21.15.26:0/4065360406 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x564cdb97c5d0 0x564cdb97e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.108+0000 7f7959ffb700 10 client.15729 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:53.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.108+0000 7f7971d9b700 1 --2- 172.21.15.26:0/4065360406 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x564cdb97c5d0 0x564cdb97e9f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58861611340eb6f6 server_cookie=be3770b7dab78d7e in_seq=0 out_seq=0 2023-12-01T01:05:53.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.110+0000 7f7959ffb700 1 -- 172.21.15.26:0/4065360406 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x564cdb931e10 con 0x564cdb97c5d0 2023-12-01T01:05:53.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.110+0000 7f7959ffb700 10 client.15729 handle_command_reply: tid=0 2023-12-01T01:05:53.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.110+0000 7f7985131b80 1 client.15729 shutdown 2023-12-01T01:05:53.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.110+0000 7f7985131b80 1 -- 172.21.15.26:0/4065360406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 msgr2=0x564cdb970d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.110+0000 7f7985131b80 1 --2- 172.21.15.26:0/4065360406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb970d20 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f796800b8c0 tx=0x7f7968005800 comp rx=0 tx=0).stop 2023-12-01T01:05:53.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.110+0000 7f7985131b80 1 -- 172.21.15.26:0/4065360406 shutdown_connections 2023-12-01T01:05:53.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.110+0000 7f7985131b80 1 --2- 172.21.15.26:0/4065360406 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x564cdb97c5d0 0x564cdb97e9f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.110+0000 7f7985131b80 1 --2- 172.21.15.26:0/4065360406 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968e80 0x564cdb9782a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.110+0000 7f7959ffb700 0 client.15729 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:53.115 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.110+0000 7f7985131b80 1 --2- 172.21.15.26:0/4065360406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb970d20 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.110+0000 7f7985131b80 1 --2- 172.21.15.26:0/4065360406 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb968500 0x564cdb971260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.110+0000 7f7985131b80 1 -- 172.21.15.26:0/4065360406 >> 172.21.15.26:0/4065360406 conn(0x564cdb8c20d0 msgr2=0x564cdb95d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.110+0000 7f7985131b80 1 -- 172.21.15.26:0/4065360406 shutdown_connections 2023-12-01T01:05:53.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.110+0000 7f7985131b80 1 -- 172.21.15.26:0/4065360406 wait complete. 2023-12-01T01:05:53.116 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.110+0000 7f7985131b80 20 client.15729 trim_cache size 0 max 16384 2023-12-01T01:05:53.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f7985131b80 1 Processor -- start 2023-12-01T01:05:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f7985131b80 1 -- start start 2023-12-01T01:05:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f7985131b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb976250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f7985131b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968500 0x564cdb978b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f7985131b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb968e80 0x564cdb95d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f7985131b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb95e7d0 con 0x564cdb967800 2023-12-01T01:05:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f7985131b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb96ea60 con 0x564cdb968500 2023-12-01T01:05:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f7985131b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb97c350 con 0x564cdb968e80 2023-12-01T01:05:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f797259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb976250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f797259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb976250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56026/0 (socket says 172.21.15.26:56026) 2023-12-01T01:05:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f797259c700 1 -- 172.21.15.26:0/3431520161 learned_addr learned my addr 172.21.15.26:0/3431520161 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f7971d9b700 1 --2- 172.21.15.26:0/3431520161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968500 0x564cdb978b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f7972d9d700 1 --2- 172.21.15.26:0/3431520161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb968e80 0x564cdb95d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f797259c700 1 -- 172.21.15.26:0/3431520161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb968e80 msgr2=0x564cdb95d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f797259c700 1 --2- 172.21.15.26:0/3431520161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb968e80 0x564cdb95d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f797259c700 1 -- 172.21.15.26:0/3431520161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968500 msgr2=0x564cdb978b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f797259c700 1 --2- 172.21.15.26:0/3431520161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968500 0x564cdb978b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.127+0000 7f797259c700 1 -- 172.21.15.26:0/3431520161 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cdb6cac60 con 0x564cdb967800 2023-12-01T01:05:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.128+0000 7f797259c700 1 --2- 172.21.15.26:0/3431520161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb976250 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f796802eac0 tx=0x7f7968005940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade459ad1de83291 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.128+0000 7f79617fa700 1 -- 172.21.15.26:0/3431520161 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796802a040 con 0x564cdb967800 2023-12-01T01:05:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.128+0000 7f79617fa700 1 -- 172.21.15.26:0/3431520161 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f796802e8e0 con 0x564cdb967800 2023-12-01T01:05:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.128+0000 7f79617fa700 1 -- 172.21.15.26:0/3431520161 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7968023570 con 0x564cdb967800 2023-12-01T01:05:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.128+0000 7f7985131b80 1 -- 172.21.15.26:0/3431520161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 msgr2=0x564cdb976250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.128+0000 7f7985131b80 1 --2- 172.21.15.26:0/3431520161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb976250 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f796802eac0 tx=0x7f7968005940 comp rx=0 tx=0).stop 2023-12-01T01:05:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.128+0000 7f7985131b80 1 -- 172.21.15.26:0/3431520161 shutdown_connections 2023-12-01T01:05:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.128+0000 7f7985131b80 1 --2- 172.21.15.26:0/3431520161 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb968e80 0x564cdb95d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.128+0000 7f7985131b80 1 --2- 172.21.15.26:0/3431520161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb976250 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.128+0000 7f7985131b80 1 --2- 172.21.15.26:0/3431520161 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968500 0x564cdb978b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.128+0000 7f7985131b80 1 -- 172.21.15.26:0/3431520161 >> 172.21.15.26:0/3431520161 conn(0x564cdb8c20d0 msgr2=0x564cdb96f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.128+0000 7f7985131b80 1 -- 172.21.15.26:0/3431520161 shutdown_connections 2023-12-01T01:05:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.128+0000 7f7985131b80 1 -- 172.21.15.26:0/3431520161 wait complete. 2023-12-01T01:05:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f7985131b80 1 -- start start 2023-12-01T01:05:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f7985131b80 1 Processor -- start 2023-12-01T01:05:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f7985131b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb9c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f7985131b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968500 0x564cdb9ca850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f7985131b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb968e80 0x564cdb9ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f7985131b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb9cd640 con 0x564cdb967800 2023-12-01T01:05:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f7985131b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb9cd7b0 con 0x564cdb968500 2023-12-01T01:05:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f7985131b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cdb9cd970 con 0x564cdb968e80 2023-12-01T01:05:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f7985131b80 10 client.0 _ll_register_callbacks cb 0x7f7964009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f797259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb9c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f7971d9b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968500 0x564cdb9ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f797259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb9c82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56032/0 (socket says 172.21.15.26:56032) 2023-12-01T01:05:53.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f797259c700 1 -- 172.21.15.26:0/3873831651 learned_addr learned my addr 172.21.15.26:0/3873831651 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f7972d9d700 1 --2- 172.21.15.26:0/3873831651 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb968e80 0x564cdb9ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f797259c700 1 -- 172.21.15.26:0/3873831651 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb968e80 msgr2=0x564cdb9ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f797259c700 1 --2- 172.21.15.26:0/3873831651 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb968e80 0x564cdb9ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f797259c700 1 -- 172.21.15.26:0/3873831651 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968500 msgr2=0x564cdb9ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f797259c700 1 --2- 172.21.15.26:0/3873831651 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968500 0x564cdb9ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.129+0000 7f797259c700 1 -- 172.21.15.26:0/3873831651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7974108a50 con 0x564cdb967800 2023-12-01T01:05:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f797259c700 1 --2- 172.21.15.26:0/3873831651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb9c82a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f79680243a0 tx=0x7f7968009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b000fd0761df9c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f7959ffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f7959ffb700 1 -- 172.21.15.26:0/3873831651 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796802a070 con 0x564cdb967800 2023-12-01T01:05:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f7959ffb700 1 -- 172.21.15.26:0/3873831651 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f796802e400 con 0x564cdb967800 2023-12-01T01:05:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f7985131b80 1 -- 172.21.15.26:0/3873831651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f796801e040 con 0x564cdb967800 2023-12-01T01:05:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f7959ffb700 1 -- 172.21.15.26:0/3873831651 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f796802e5c0 con 0x564cdb967800 2023-12-01T01:05:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f7985131b80 10 client.15735 fetch_fsmap learned FSMap version 24 2023-12-01T01:05:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f7985131b80 1 -- 172.21.15.26:0/3873831651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x564cdb708250 con 0x564cdb967800 2023-12-01T01:05:53.137 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f7959ffb700 1 -- 172.21.15.26:0/3873831651 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f796801e040 con 0x564cdb967800 2023-12-01T01:05:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f7959ffb700 1 -- 172.21.15.26:0/3873831651 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 24) v1 ==== 7458+0+0 (secure 0 0 0) 0x7f7968054070 con 0x564cdb967800 2023-12-01T01:05:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f7985131b80 10 client.15735 fetch_fsmap finished waiting for FSMap version 24 2023-12-01T01:05:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f7985131b80 10 client.15735 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f7985131b80 20 client.15735 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f7985131b80 1 --2- 172.21.15.26:0/3873831651 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x564cdb9ceed0 0x564cdb9d12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f7985131b80 4 client.15735 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-01T01:05:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f7985131b80 1 -- 172.21.15.26:0/3873831651 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564cdb8acd40 con 0x564cdb9ceed0 2023-12-01T01:05:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.130+0000 7f7971d9b700 1 --2- 172.21.15.26:0/3873831651 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x564cdb9ceed0 0x564cdb9d12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.131+0000 7f7959ffb700 10 client.15735 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.131+0000 7f7971d9b700 1 --2- 172.21.15.26:0/3873831651 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x564cdb9ceed0 0x564cdb9d12f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9164eca3ac467271 server_cookie=e310f9435279116a in_seq=0 out_seq=0 2023-12-01T01:05:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.131+0000 7f7959ffb700 1 -- 172.21.15.26:0/3873831651 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x564cdb8acd40 con 0x564cdb9ceed0 2023-12-01T01:05:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.131+0000 7f7959ffb700 10 client.15735 handle_command_reply: tid=0 2023-12-01T01:05:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.131+0000 7f7985131b80 1 client.15735 shutdown 2023-12-01T01:05:53.138 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.131+0000 7f7985131b80 1 -- 172.21.15.26:0/3873831651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 msgr2=0x564cdb9c82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.131+0000 7f7985131b80 1 --2- 172.21.15.26:0/3873831651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb9c82a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f79680243a0 tx=0x7f7968009cd0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.131+0000 7f7985131b80 1 -- 172.21.15.26:0/3873831651 shutdown_connections 2023-12-01T01:05:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.131+0000 7f7985131b80 1 --2- 172.21.15.26:0/3873831651 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x564cdb9ceed0 0x564cdb9d12f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.131+0000 7f7985131b80 1 --2- 172.21.15.26:0/3873831651 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564cdb968e80 0x564cdb9ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.131+0000 7f7959ffb700 0 client.15735 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.131+0000 7f7985131b80 1 --2- 172.21.15.26:0/3873831651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564cdb967800 0x564cdb9c82a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.131+0000 7f7985131b80 1 --2- 172.21.15.26:0/3873831651 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564cdb968500 0x564cdb9ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.132+0000 7f7985131b80 1 -- 172.21.15.26:0/3873831651 >> 172.21.15.26:0/3873831651 conn(0x564cdb8c20d0 msgr2=0x564cdb96b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.132+0000 7f7985131b80 1 -- 172.21.15.26:0/3873831651 shutdown_connections 2023-12-01T01:05:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.132+0000 7f7985131b80 1 -- 172.21.15.26:0/3873831651 wait complete. 2023-12-01T01:05:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.132+0000 7f7985131b80 20 client.15735 trim_cache size 0 max 16384 2023-12-01T01:05:53.140 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:05:53.140 INFO:teuthology.orchestra.run.smithi026.stdout: "status": "no active scrubs running", 2023-12-01T01:05:53.140 INFO:teuthology.orchestra.run.smithi026.stdout: "scrubs": {} 2023-12-01T01:05:53.140 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:05:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.132+0000 7f7978fa1700 1 -- 172.21.15.26:0/4256913160 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f795c0a05a0 msgr2=0x7f795c0a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.132+0000 7f7978fa1700 1 --2- 172.21.15.26:0/4256913160 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f795c0a05a0 0x7f795c0a2a60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f796800b580 tx=0x7f7968005fb0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.132+0000 7f7978fa1700 1 -- 172.21.15.26:0/4256913160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7974101850 msgr2=0x7f797419ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.132+0000 7f7978fa1700 1 --2- 172.21.15.26:0/4256913160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7974101850 0x7f797419ded0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f796c00ada0 tx=0x7f796c00c330 comp rx=0 tx=0).stop 2023-12-01T01:05:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.132+0000 7f7978fa1700 1 -- 172.21.15.26:0/4256913160 shutdown_connections 2023-12-01T01:05:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.132+0000 7f7978fa1700 1 --2- 172.21.15.26:0/4256913160 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f795c0a05a0 0x7f795c0a2a60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.132+0000 7f7978fa1700 1 --2- 172.21.15.26:0/4256913160 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7974101850 0x7f797419ded0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.132+0000 7f7978fa1700 1 --2- 172.21.15.26:0/4256913160 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f79740ffcc0 0x7f7974069a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.132+0000 7f7978fa1700 1 --2- 172.21.15.26:0/4256913160 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7974100eb0 0x7f797419b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.132+0000 7f7978fa1700 1 -- 172.21.15.26:0/4256913160 >> 172.21.15.26:0/4256913160 conn(0x7f79740fb250 msgr2=0x7f79740fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.132+0000 7f7978fa1700 1 -- 172.21.15.26:0/4256913160 shutdown_connections 2023-12-01T01:05:53.141 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.132+0000 7f7978fa1700 1 -- 172.21.15.26:0/4256913160 wait complete. 2023-12-01T01:05:53.144 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:52 smithi026 ceph-mon[98801]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:05:53.145 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-01T01:05:53.145 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:05:53.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:52 smithi116 ceph-mon[103554]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:05:53.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:52 smithi093 ceph-mon[103327]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:05:53.215 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:52 smithi093 systemd[1]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.h.service: Service RestartSec=10s expired, scheduling restart. 2023-12-01T01:05:53.215 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:52 smithi093 systemd[1]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.h.service: Scheduled restart job, restart counter is at 1. 2023-12-01T01:05:53.215 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:52 smithi093 systemd[1]: Stopped Ceph mds.h for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T01:05:53.215 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:52 smithi093 systemd[1]: Starting Ceph mds.h for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:05:53.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.271+0000 7fc2e614c700 1 -- 172.21.15.26:0/1190242386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2e0101800 msgr2=0x7fc2e01080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.271+0000 7fc2e614c700 1 --2- 172.21.15.26:0/1190242386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2e0101800 0x7fc2e01080b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800b0a0 tx=0x7fc2d800b3b0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.271+0000 7fc2e614c700 1 -- 172.21.15.26:0/1190242386 shutdown_connections 2023-12-01T01:05:53.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.271+0000 7fc2e614c700 1 --2- 172.21.15.26:0/1190242386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2e0101800 0x7fc2e01080b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.271+0000 7fc2e614c700 1 --2- 172.21.15.26:0/1190242386 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2e00ffc70 0x7fc2e0100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.271+0000 7fc2e614c700 1 --2- 172.21.15.26:0/1190242386 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2e0100e60 0x7fc2e01012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.271+0000 7fc2e614c700 1 -- 172.21.15.26:0/1190242386 >> 172.21.15.26:0/1190242386 conn(0x7fc2e00fb1c0 msgr2=0x7fc2e00fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.271+0000 7fc2e614c700 1 -- 172.21.15.26:0/1190242386 shutdown_connections 2023-12-01T01:05:53.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.271+0000 7fc2e614c700 1 -- 172.21.15.26:0/1190242386 wait complete. 2023-12-01T01:05:53.273 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2e614c700 1 Processor -- start 2023-12-01T01:05:53.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2e614c700 1 -- start start 2023-12-01T01:05:53.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2e614c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2e00ffc70 0x7fc2e010a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2e614c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2e0100e60 0x7fc2e01087b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2e614c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2e0101800 0x7fc2e0108cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2e614c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e0109490 con 0x7fc2e00ffc70 2023-12-01T01:05:53.275 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2e614c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e0109600 con 0x7fc2e0100e60 2023-12-01T01:05:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2e614c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e01a0ca0 con 0x7fc2e0101800 2023-12-01T01:05:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2df7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2e00ffc70 0x7fc2e010a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2df7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2e00ffc70 0x7fc2e010a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56046/0 (socket says 172.21.15.26:56046) 2023-12-01T01:05:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2df7fe700 1 -- 172.21.15.26:0/493137999 learned_addr learned my addr 172.21.15.26:0/493137999 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2deffd700 1 --2- 172.21.15.26:0/493137999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2e0100e60 0x7fc2e01087b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2dffff700 1 --2- 172.21.15.26:0/493137999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2e0101800 0x7fc2e0108cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2df7fe700 1 -- 172.21.15.26:0/493137999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2e0101800 msgr2=0x7fc2e0108cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2df7fe700 1 --2- 172.21.15.26:0/493137999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2e0101800 0x7fc2e0108cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2df7fe700 1 -- 172.21.15.26:0/493137999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2e0100e60 msgr2=0x7fc2e01087b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.272+0000 7fc2df7fe700 1 --2- 172.21.15.26:0/493137999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2e0100e60 0x7fc2e01087b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.273+0000 7fc2df7fe700 1 -- 172.21.15.26:0/493137999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d8009d00 con 0x7fc2e00ffc70 2023-12-01T01:05:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.273+0000 7fc2df7fe700 1 --2- 172.21.15.26:0/493137999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2e00ffc70 0x7fc2e010a170 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000e970 tx=0x7fc2d000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.273+0000 7fc2dcff9700 1 -- 172.21.15.26:0/493137999 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0009790 con 0x7fc2e00ffc70 2023-12-01T01:05:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.273+0000 7fc2dcff9700 1 -- 172.21.15.26:0/493137999 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc2d000ccc0 con 0x7fc2e00ffc70 2023-12-01T01:05:53.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.273+0000 7fc2e614c700 1 -- 172.21.15.26:0/493137999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e01a0f80 con 0x7fc2e00ffc70 2023-12-01T01:05:53.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.273+0000 7fc2dcff9700 1 -- 172.21.15.26:0/493137999 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0003d80 con 0x7fc2e00ffc70 2023-12-01T01:05:53.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.273+0000 7fc2e614c700 1 -- 172.21.15.26:0/493137999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e01a1400 con 0x7fc2e00ffc70 2023-12-01T01:05:53.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.274+0000 7fc2e614c700 1 -- 172.21.15.26:0/493137999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e0107170 con 0x7fc2e00ffc70 2023-12-01T01:05:53.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.275+0000 7fc2dcff9700 1 -- 172.21.15.26:0/493137999 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fc2d000c7e0 con 0x7fc2e00ffc70 2023-12-01T01:05:53.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.275+0000 7fc2dcff9700 1 --2- 172.21.15.26:0/493137999 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc2cc0a05f0 0x7fc2cc0a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.276+0000 7fc2deffd700 1 --2- 172.21.15.26:0/493137999 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc2cc0a05f0 0x7fc2cc0a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.276+0000 7fc2dcff9700 1 -- 172.21.15.26:0/493137999 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fc2d0014070 con 0x7fc2e00ffc70 2023-12-01T01:05:53.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.276+0000 7fc2deffd700 1 --2- 172.21.15.26:0/493137999 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc2cc0a05f0 0x7fc2cc0a2ab0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8007b60 tx=0x7fc2c80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.279+0000 7fc2dcff9700 1 -- 172.21.15.26:0/493137999 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc2d00956f0 con 0x7fc2e00ffc70 2023-12-01T01:05:53.528 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:53 smithi093 podman[141443]: 2023-12-01T01:05:53.530 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.529+0000 7fc2e614c700 1 -- 172.21.15.26:0/493137999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2e002cc70 con 0x7fc2e00ffc70 2023-12-01T01:05:53.531 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.530+0000 7fc2dcff9700 1 -- 172.21.15.26:0/493137999 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+10778 (secure 0 0 0) 0x7fc2d0098d10 con 0x7fc2e00ffc70 2023-12-01T01:05:53.531 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:05:53.531 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6841/3515135915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6840","nonce":3515135915},{"type":"v1","addr":"172.21.15.26:6841","nonce":3515135915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-01T01:02:47.252972+0000","modified":"2023-12-01T01:05:51.825918+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24493,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24479":{"gid":24479,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.93:6837/3333520218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":3333520218},{"type":"v1","addr":"172.21.15.93:6837","nonce":3333520218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6839/3364532241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":3364532241},{"type":"v1","addr":"172.21.15.93:6839","nonce":3364532241}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T01:05:53.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.532+0000 7fc2e614c700 1 -- 172.21.15.26:0/493137999 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc2cc0a05f0 msgr2=0x7fc2cc0a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.532+0000 7fc2e614c700 1 --2- 172.21.15.26:0/493137999 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc2cc0a05f0 0x7fc2cc0a2ab0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8007b60 tx=0x7fc2c80073d0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.532+0000 7fc2e614c700 1 -- 172.21.15.26:0/493137999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2e00ffc70 msgr2=0x7fc2e010a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.532+0000 7fc2e614c700 1 --2- 172.21.15.26:0/493137999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2e00ffc70 0x7fc2e010a170 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000e970 tx=0x7fc2d000ec80 comp rx=0 tx=0).stop 2023-12-01T01:05:53.533 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.532+0000 7fc2e614c700 1 -- 172.21.15.26:0/493137999 shutdown_connections 2023-12-01T01:05:53.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.532+0000 7fc2e614c700 1 --2- 172.21.15.26:0/493137999 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc2cc0a05f0 0x7fc2cc0a2ab0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.532+0000 7fc2e614c700 1 --2- 172.21.15.26:0/493137999 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc2e0101800 0x7fc2e0108cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.532+0000 7fc2e614c700 1 --2- 172.21.15.26:0/493137999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2e00ffc70 0x7fc2e010a170 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.532+0000 7fc2e614c700 1 --2- 172.21.15.26:0/493137999 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc2e0100e60 0x7fc2e01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.532+0000 7fc2e614c700 1 -- 172.21.15.26:0/493137999 >> 172.21.15.26:0/493137999 conn(0x7fc2e00fb1c0 msgr2=0x7fc2e01042b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.532+0000 7fc2e614c700 1 -- 172.21.15.26:0/493137999 shutdown_connections 2023-12-01T01:05:53.534 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.532+0000 7fc2e614c700 1 -- 172.21.15.26:0/493137999 wait complete. 2023-12-01T01:05:53.534 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 24 2023-12-01T01:05:53.546 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-01T01:05:53.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.674+0000 7fb78c128700 1 -- 172.21.15.26:0/2520455556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb784100ea0 msgr2=0x7fb784101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.677 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.674+0000 7fb78c128700 1 --2- 172.21.15.26:0/2520455556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb784100ea0 0x7fb784101300 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb7740099c0 tx=0x7fb774009cd0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.674+0000 7fb78c128700 1 -- 172.21.15.26:0/2520455556 shutdown_connections 2023-12-01T01:05:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.674+0000 7fb78c128700 1 --2- 172.21.15.26:0/2520455556 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb784101840 0x7fb7841080f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.674+0000 7fb78c128700 1 --2- 172.21.15.26:0/2520455556 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb7840ffcb0 0x7fb7841000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.674+0000 7fb78c128700 1 --2- 172.21.15.26:0/2520455556 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb784100ea0 0x7fb784101300 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.674+0000 7fb78c128700 1 -- 172.21.15.26:0/2520455556 >> 172.21.15.26:0/2520455556 conn(0x7fb7840fb220 msgr2=0x7fb7840fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.674+0000 7fb78c128700 1 -- 172.21.15.26:0/2520455556 shutdown_connections 2023-12-01T01:05:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.674+0000 7fb78c128700 1 -- 172.21.15.26:0/2520455556 wait complete. 2023-12-01T01:05:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb78c128700 1 Processor -- start 2023-12-01T01:05:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb78c128700 1 -- start start 2023-12-01T01:05:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb78c128700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7840ffcb0 0x7fb784103c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb78c128700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb784100ea0 0x7fb784102280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb78c128700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb784101840 0x7fb7841027c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb78c128700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb784102f60 con 0x7fb7840ffcb0 2023-12-01T01:05:53.678 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb78c128700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7841030d0 con 0x7fb784100ea0 2023-12-01T01:05:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb78c128700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7841a0c30 con 0x7fb784101840 2023-12-01T01:05:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb789ec4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7840ffcb0 0x7fb784103c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb789ec4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7840ffcb0 0x7fb784103c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56060/0 (socket says 172.21.15.26:56060) 2023-12-01T01:05:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb789ec4700 1 -- 172.21.15.26:0/845398922 learned_addr learned my addr 172.21.15.26:0/845398922 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb7896c3700 1 --2- 172.21.15.26:0/845398922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb784100ea0 0x7fb784102280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb78a6c5700 1 --2- 172.21.15.26:0/845398922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb784101840 0x7fb7841027c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb789ec4700 1 -- 172.21.15.26:0/845398922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb784101840 msgr2=0x7fb7841027c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb789ec4700 1 --2- 172.21.15.26:0/845398922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb784101840 0x7fb7841027c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb789ec4700 1 -- 172.21.15.26:0/845398922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb784100ea0 msgr2=0x7fb784102280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb789ec4700 1 --2- 172.21.15.26:0/845398922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb784100ea0 0x7fb784102280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.675+0000 7fb789ec4700 1 -- 172.21.15.26:0/845398922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7740095f0 con 0x7fb7840ffcb0 2023-12-01T01:05:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.676+0000 7fb78a6c5700 1 --2- 172.21.15.26:0/845398922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb784101840 0x7fb7841027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:05:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.676+0000 7fb7896c3700 1 --2- 172.21.15.26:0/845398922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb784100ea0 0x7fb784102280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.676+0000 7fb789ec4700 1 --2- 172.21.15.26:0/845398922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7840ffcb0 0x7fb784103c40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb78000d980 tx=0x7fb78000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.676+0000 7fb77affd700 1 -- 172.21.15.26:0/845398922 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780004020 con 0x7fb7840ffcb0 2023-12-01T01:05:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.676+0000 7fb77affd700 1 -- 172.21.15.26:0/845398922 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb780009730 con 0x7fb7840ffcb0 2023-12-01T01:05:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.676+0000 7fb78c128700 1 -- 172.21.15.26:0/845398922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7841a0f10 con 0x7fb7840ffcb0 2023-12-01T01:05:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.676+0000 7fb77affd700 1 -- 172.21.15.26:0/845398922 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780003be0 con 0x7fb7840ffcb0 2023-12-01T01:05:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.676+0000 7fb78c128700 1 -- 172.21.15.26:0/845398922 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7841a1330 con 0x7fb7840ffcb0 2023-12-01T01:05:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.678+0000 7fb77affd700 1 -- 172.21.15.26:0/845398922 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fb780009ba0 con 0x7fb7840ffcb0 2023-12-01T01:05:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.679+0000 7fb77affd700 1 --2- 172.21.15.26:0/845398922 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb7700a0520 0x7fb7700a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.679+0000 7fb77affd700 1 -- 172.21.15.26:0/845398922 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb7800cb600 con 0x7fb7840ffcb0 2023-12-01T01:05:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.679+0000 7fb7896c3700 1 --2- 172.21.15.26:0/845398922 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb7700a0520 0x7fb7700a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.679+0000 7fb7896c3700 1 --2- 172.21.15.26:0/845398922 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb7700a0520 0x7fb7700a29e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb77400b580 tx=0x7fb774009530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.679+0000 7fb7982b8b80 1 Processor -- start 2023-12-01T01:05:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb7982b8b80 1 -- start start 2023-12-01T01:05:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb7982b8b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100b0f0 0x559b7100b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb7982b8b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100ba70 0x559b71009e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb7982b8b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100a3f0 0x559b7100a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb7982b8b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b70f61a10 con 0x559b7100b0f0 2023-12-01T01:05:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb7982b8b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b70f5f3d0 con 0x559b7100a3f0 2023-12-01T01:05:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb7982b8b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b70f5acc0 con 0x559b7100ba70 2023-12-01T01:05:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb789ec4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100b0f0 0x559b7100b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb789ec4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100b0f0 0x559b7100b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56068/0 (socket says 172.21.15.26:56068) 2023-12-01T01:05:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb789ec4700 1 -- 172.21.15.26:0/2337012548 learned_addr learned my addr 172.21.15.26:0/2337012548 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb78a6c5700 1 --2- 172.21.15.26:0/2337012548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100a3f0 0x559b7100a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb7896c3700 1 --2- 172.21.15.26:0/2337012548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100ba70 0x559b71009e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb789ec4700 1 -- 172.21.15.26:0/2337012548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100ba70 msgr2=0x559b71009e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb789ec4700 1 --2- 172.21.15.26:0/2337012548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100ba70 0x559b71009e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb789ec4700 1 -- 172.21.15.26:0/2337012548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100a3f0 msgr2=0x559b7100a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb789ec4700 1 --2- 172.21.15.26:0/2337012548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100a3f0 0x559b7100a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb789ec4700 1 -- 172.21.15.26:0/2337012548 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b70d88de0 con 0x559b7100b0f0 2023-12-01T01:05:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb7896c3700 1 --2- 172.21.15.26:0/2337012548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100ba70 0x559b71009e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:05:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.680+0000 7fb78a6c5700 1 --2- 172.21.15.26:0/2337012548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100a3f0 0x559b7100a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.681+0000 7fb789ec4700 1 --2- 172.21.15.26:0/2337012548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100b0f0 0x559b7100b530 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb780098e00 tx=0x7fb7800987d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4293117080ab1d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.681+0000 7fb76ffff700 1 -- 172.21.15.26:0/2337012548 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78009cca0 con 0x559b7100b0f0 2023-12-01T01:05:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.681+0000 7fb76ffff700 1 -- 172.21.15.26:0/2337012548 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb7800a0ee0 con 0x559b7100b0f0 2023-12-01T01:05:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.681+0000 7fb76ffff700 1 -- 172.21.15.26:0/2337012548 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780098360 con 0x559b7100b0f0 2023-12-01T01:05:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.681+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2337012548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100b0f0 msgr2=0x559b7100b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.681+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/2337012548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100b0f0 0x559b7100b530 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fb780098e00 tx=0x7fb7800987d0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.682+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2337012548 shutdown_connections 2023-12-01T01:05:53.690 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.682+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/2337012548 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100a3f0 0x559b7100a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.682+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/2337012548 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100b0f0 0x559b7100b530 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.682+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/2337012548 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100ba70 0x559b71009e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.682+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2337012548 >> 172.21.15.26:0/2337012548 conn(0x559b70f690d0 msgr2=0x559b71004940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.682+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2337012548 shutdown_connections 2023-12-01T01:05:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.682+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2337012548 wait complete. 2023-12-01T01:05:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.682+0000 7fb7982b8b80 1 -- start start 2023-12-01T01:05:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.682+0000 7fb7982b8b80 1 Processor -- start 2023-12-01T01:05:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb7982b8b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100a3f0 0x559b710139b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb7982b8b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100b0f0 0x559b71013ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb7982b8b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100ba70 0x559b7101af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb7982b8b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b70ef7510 con 0x559b7100b0f0 2023-12-01T01:05:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb7982b8b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b70ef71b0 con 0x559b7100ba70 2023-12-01T01:05:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb7982b8b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b70dde920 con 0x559b7100a3f0 2023-12-01T01:05:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb7982b8b80 10 client.0 _ll_register_callbacks cb 0x559b70e44a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb7896c3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100b0f0 0x559b71013ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb7896c3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100b0f0 0x559b71013ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56076/0 (socket says 172.21.15.26:56076) 2023-12-01T01:05:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb7896c3700 1 -- 172.21.15.26:0/2085841695 learned_addr learned my addr 172.21.15.26:0/2085841695 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb789ec4700 1 --2- 172.21.15.26:0/2085841695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100a3f0 0x559b710139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb78a6c5700 1 --2- 172.21.15.26:0/2085841695 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100ba70 0x559b7101af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb7896c3700 1 -- 172.21.15.26:0/2085841695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100a3f0 msgr2=0x559b710139b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb7896c3700 1 --2- 172.21.15.26:0/2085841695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100a3f0 0x559b710139b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb7896c3700 1 -- 172.21.15.26:0/2085841695 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100ba70 msgr2=0x559b7101af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb7896c3700 1 --2- 172.21.15.26:0/2085841695 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100ba70 0x559b7101af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb7896c3700 1 -- 172.21.15.26:0/2085841695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c009050 con 0x559b7100b0f0 2023-12-01T01:05:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb7896c3700 1 --2- 172.21.15.26:0/2085841695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100b0f0 0x559b71013ef0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb7740099c0 tx=0x7fb774009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a628430d21f5c062 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.692 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb76d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.683+0000 7fb76d7fa700 1 -- 172.21.15.26:0/2085841695 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77400f870 con 0x559b7100b0f0 2023-12-01T01:05:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.684+0000 7fb76d7fa700 1 -- 172.21.15.26:0/2085841695 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb77400f9d0 con 0x559b7100b0f0 2023-12-01T01:05:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.684+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2085841695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559b70f85d10 con 0x559b7100b0f0 2023-12-01T01:05:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.684+0000 7fb76d7fa700 1 -- 172.21.15.26:0/2085841695 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb77400fb90 con 0x559b7100b0f0 2023-12-01T01:05:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.684+0000 7fb7982b8b80 10 client.15759 fetch_fsmap learned FSMap version 24 2023-12-01T01:05:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.684+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2085841695 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x7fb7841a1330 con 0x559b7100b0f0 2023-12-01T01:05:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.684+0000 7fb76d7fa700 1 -- 172.21.15.26:0/2085841695 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x559b70f85d10 con 0x559b7100b0f0 2023-12-01T01:05:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.684+0000 7fb76d7fa700 1 -- 172.21.15.26:0/2085841695 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 24) v1 ==== 7458+0+0 (secure 0 0 0) 0x7fb77402f3f0 con 0x559b7100b0f0 2023-12-01T01:05:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.684+0000 7fb7982b8b80 10 client.15759 fetch_fsmap finished waiting for FSMap version 24 2023-12-01T01:05:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.684+0000 7fb7982b8b80 10 client.15759 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-12-01T01:05:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.684+0000 7fb7982b8b80 20 client.15759 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.684+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/2085841695 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x559b7101f7e0 0x559b71021c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.684+0000 7fb7982b8b80 4 client.15759 mds_command: new command op to 24481 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:05:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.684+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2085841695 --> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559b70fd8e10 con 0x559b7101f7e0 2023-12-01T01:05:53.693 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.684+0000 7fb789ec4700 1 --2- 172.21.15.26:0/2085841695 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x559b7101f7e0 0x559b71021c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.685+0000 7fb789ec4700 1 --2- 172.21.15.26:0/2085841695 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x559b7101f7e0 0x559b71021c00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aa0ddeae40fb37c server_cookie=1f2bc278672a41f5 in_seq=0 out_seq=0 2023-12-01T01:05:53.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.685+0000 7fb76d7fa700 10 client.15759 ms_handle_connect on v2:172.21.15.116:6838/261568108 2023-12-01T01:05:53.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.685+0000 7fb76d7fa700 1 -- 172.21.15.26:0/2085841695 <== mds.2 v2:172.21.15.116:6838/261568108 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x559b70fd8e10 con 0x559b7101f7e0 2023-12-01T01:05:53.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.685+0000 7fb76d7fa700 10 client.15759 handle_command_reply: tid=0 2023-12-01T01:05:53.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.685+0000 7fb7982b8b80 1 client.15759 shutdown 2023-12-01T01:05:53.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.686+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2085841695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100b0f0 msgr2=0x559b71013ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.686+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/2085841695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100b0f0 0x559b71013ef0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb7740099c0 tx=0x7fb774009cd0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.686+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2085841695 shutdown_connections 2023-12-01T01:05:53.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.686+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/2085841695 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x559b7101f7e0 0x559b71021c00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.686+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/2085841695 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100ba70 0x559b7101af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.686+0000 7fb76d7fa700 0 client.15759 ms_handle_reset on v2:172.21.15.116:6838/261568108 2023-12-01T01:05:53.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.686+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/2085841695 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100a3f0 0x559b710139b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.694 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.686+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/2085841695 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100b0f0 0x559b71013ef0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.686+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2085841695 >> 172.21.15.26:0/2085841695 conn(0x559b70f690d0 msgr2=0x559b710040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.686+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2085841695 shutdown_connections 2023-12-01T01:05:53.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.686+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2085841695 wait complete. 2023-12-01T01:05:53.695 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.686+0000 7fb7982b8b80 20 client.15759 trim_cache size 0 max 16384 2023-12-01T01:05:53.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.699+0000 7fb7982b8b80 1 Processor -- start 2023-12-01T01:05:53.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.699+0000 7fb7982b8b80 1 -- start start 2023-12-01T01:05:53.701 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.699+0000 7fb7982b8b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100a3f0 0x559b71009e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.699+0000 7fb7982b8b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100b0f0 0x559b71018ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.699+0000 7fb7982b8b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100ba70 0x559b71011860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.700+0000 7fb7982b8b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b71012e60 con 0x559b7100a3f0 2023-12-01T01:05:53.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.700+0000 7fb7982b8b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b71013520 con 0x559b7100ba70 2023-12-01T01:05:53.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.700+0000 7fb7982b8b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b71014b30 con 0x559b7100b0f0 2023-12-01T01:05:53.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.700+0000 7fb789ec4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100a3f0 0x559b71009e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.700+0000 7fb789ec4700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100a3f0 0x559b71009e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56082/0 (socket says 172.21.15.26:56082) 2023-12-01T01:05:53.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.700+0000 7fb789ec4700 1 -- 172.21.15.26:0/3573905416 learned_addr learned my addr 172.21.15.26:0/3573905416 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:53.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.700+0000 7fb78a6c5700 1 --2- 172.21.15.26:0/3573905416 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100ba70 0x559b71011860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.700+0000 7fb7896c3700 1 --2- 172.21.15.26:0/3573905416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100b0f0 0x559b71018ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.702 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.700+0000 7fb789ec4700 1 -- 172.21.15.26:0/3573905416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100b0f0 msgr2=0x559b71018ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.700+0000 7fb789ec4700 1 --2- 172.21.15.26:0/3573905416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100b0f0 0x559b71018ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.700+0000 7fb789ec4700 1 -- 172.21.15.26:0/3573905416 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100ba70 msgr2=0x559b71011860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.700+0000 7fb789ec4700 1 --2- 172.21.15.26:0/3573905416 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100ba70 0x559b71011860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.700+0000 7fb789ec4700 1 -- 172.21.15.26:0/3573905416 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559b70d71c60 con 0x559b7100a3f0 2023-12-01T01:05:53.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.700+0000 7fb78a6c5700 1 --2- 172.21.15.26:0/3573905416 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100ba70 0x559b71011860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:53.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.700+0000 7fb789ec4700 1 --2- 172.21.15.26:0/3573905416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100a3f0 0x559b71009e60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb780000c00 tx=0x7fb7800952e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c280ad3611d80b9c server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.700+0000 7fb778ff9700 1 -- 172.21.15.26:0/3573905416 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7800b5070 con 0x559b7100a3f0 2023-12-01T01:05:53.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.701+0000 7fb778ff9700 1 -- 172.21.15.26:0/3573905416 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb78009cd20 con 0x559b7100a3f0 2023-12-01T01:05:53.703 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.701+0000 7fb778ff9700 1 -- 172.21.15.26:0/3573905416 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7800985c0 con 0x559b7100a3f0 2023-12-01T01:05:53.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.701+0000 7fb7982b8b80 1 -- 172.21.15.26:0/3573905416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100a3f0 msgr2=0x559b71009e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.701+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/3573905416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100a3f0 0x559b71009e60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb780000c00 tx=0x7fb7800952e0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.701+0000 7fb7982b8b80 1 -- 172.21.15.26:0/3573905416 shutdown_connections 2023-12-01T01:05:53.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.701+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/3573905416 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100ba70 0x559b71011860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.701+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/3573905416 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100a3f0 0x559b71009e60 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.701+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/3573905416 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100b0f0 0x559b71018ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.707 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.701+0000 7fb7982b8b80 1 -- 172.21.15.26:0/3573905416 >> 172.21.15.26:0/3573905416 conn(0x559b70f690d0 msgr2=0x559b71012650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.701+0000 7fb7982b8b80 1 -- 172.21.15.26:0/3573905416 shutdown_connections 2023-12-01T01:05:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.701+0000 7fb7982b8b80 1 -- 172.21.15.26:0/3573905416 wait complete. 2023-12-01T01:05:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.702+0000 7fb7982b8b80 1 -- start start 2023-12-01T01:05:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.702+0000 7fb7982b8b80 1 Processor -- start 2023-12-01T01:05:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.702+0000 7fb7982b8b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100a3f0 0x559b71016c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.702+0000 7fb7982b8b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100b0f0 0x559b710171d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.702+0000 7fb7982b8b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100ba70 0x559b710181e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.702+0000 7fb7982b8b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b71018720 con 0x559b7100ba70 2023-12-01T01:05:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.702+0000 7fb7982b8b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b71018890 con 0x559b7100a3f0 2023-12-01T01:05:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.702+0000 7fb7982b8b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x559b71018a50 con 0x559b7100b0f0 2023-12-01T01:05:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.702+0000 7fb7982b8b80 10 client.0 _ll_register_callbacks cb 0x559b70e44a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.702+0000 7fb78a6c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100ba70 0x559b710181e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb7896c3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100b0f0 0x559b710171d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb789ec4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100a3f0 0x559b71016c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.708 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb789ec4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100a3f0 0x559b71016c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:46826/0 (socket says 172.21.15.26:46826) 2023-12-01T01:05:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb78a6c5700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100ba70 0x559b710181e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56092/0 (socket says 172.21.15.26:56092) 2023-12-01T01:05:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb789ec4700 1 -- 172.21.15.26:0/2280664158 learned_addr learned my addr 172.21.15.26:0/2280664158 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb7896c3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100b0f0 0x559b710171d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.26:48318/0 (socket says 172.21.15.26:48318) 2023-12-01T01:05:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb789ec4700 1 -- 172.21.15.26:0/2280664158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100b0f0 msgr2=0x559b710171d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb789ec4700 1 --2- 172.21.15.26:0/2280664158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100b0f0 0x559b710171d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb789ec4700 1 -- 172.21.15.26:0/2280664158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100ba70 msgr2=0x559b710181e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb789ec4700 1 --2- 172.21.15.26:0/2280664158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100ba70 0x559b710181e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb789ec4700 1 -- 172.21.15.26:0/2280664158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77c008450 con 0x559b7100a3f0 2023-12-01T01:05:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb789ec4700 1 --2- 172.21.15.26:0/2280664158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100a3f0 0x559b71016c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb780098b70 tx=0x7fb7800987d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d947152e2e68a93 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb76d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-12-01T01:05:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb76d7fa700 1 -- 172.21.15.26:0/2280664158 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7800b5070 con 0x559b7100a3f0 2023-12-01T01:05:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2280664158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb7800a0ee0 con 0x559b7100a3f0 2023-12-01T01:05:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb76d7fa700 1 -- 172.21.15.26:0/2280664158 <== mon.2 v2:172.21.15.93:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb780097210 con 0x559b7100a3f0 2023-12-01T01:05:53.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.703+0000 7fb76d7fa700 1 -- 172.21.15.26:0/2280664158 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7800b1410 con 0x559b7100a3f0 2023-12-01T01:05:53.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.704+0000 7fb7982b8b80 10 client.25403 fetch_fsmap learned FSMap version 24 2023-12-01T01:05:53.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.704+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2280664158 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x559b70d88de0 con 0x559b7100a3f0 2023-12-01T01:05:53.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.704+0000 7fb76d7fa700 1 -- 172.21.15.26:0/2280664158 <== mon.2 v2:172.21.15.93:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb7800a0ee0 con 0x559b7100a3f0 2023-12-01T01:05:53.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.704+0000 7fb76d7fa700 1 -- 172.21.15.26:0/2280664158 <== mon.2 v2:172.21.15.93:3300/0 5 ==== fsmap(e 24) v1 ==== 7458+0+0 (secure 0 0 0) 0x7fb7800a0a50 con 0x559b7100a3f0 2023-12-01T01:05:53.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.704+0000 7fb7982b8b80 10 client.25403 fetch_fsmap finished waiting for FSMap version 24 2023-12-01T01:05:53.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.704+0000 7fb7982b8b80 10 client.25403 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-12-01T01:05:53.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.704+0000 7fb7982b8b80 20 client.25403 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:53.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.704+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/2280664158 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x559b7101f7e0 0x559b71073da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.704+0000 7fb7982b8b80 4 client.25403 mds_command: new command op to 24481 tid=0[{"prefix": "damage ls"}] 2023-12-01T01:05:53.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.704+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2280664158 --> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559b70f53d40 con 0x559b7101f7e0 2023-12-01T01:05:53.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.704+0000 7fb7896c3700 1 --2- 172.21.15.26:0/2280664158 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x559b7101f7e0 0x559b71073da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.705+0000 7fb7896c3700 1 --2- 172.21.15.26:0/2280664158 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x559b7101f7e0 0x559b71073da0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f0db6744e547f224 server_cookie=cecdb10d09123960 in_seq=0 out_seq=0 2023-12-01T01:05:53.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.705+0000 7fb76d7fa700 10 client.25403 ms_handle_connect on v2:172.21.15.116:6838/261568108 2023-12-01T01:05:53.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.706+0000 7fb76d7fa700 1 -- 172.21.15.26:0/2280664158 <== mds.2 v2:172.21.15.116:6838/261568108 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559b70f53d40 con 0x559b7101f7e0 2023-12-01T01:05:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.706+0000 7fb76d7fa700 10 client.25403 handle_command_reply: tid=0 2023-12-01T01:05:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.706+0000 7fb7982b8b80 1 client.25403 shutdown 2023-12-01T01:05:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.706+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2280664158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100a3f0 msgr2=0x559b71016c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.706+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/2280664158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100a3f0 0x559b71016c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb780098b70 tx=0x7fb7800987d0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.706+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2280664158 shutdown_connections 2023-12-01T01:05:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.706+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/2280664158 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559b7100ba70 0x559b710181e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.706+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/2280664158 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x559b7101f7e0 0x559b71073da0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.706+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/2280664158 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x559b7100a3f0 0x559b71016c90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.706+0000 7fb7982b8b80 1 --2- 172.21.15.26:0/2280664158 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x559b7100b0f0 0x559b710171d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.706+0000 7fb76d7fa700 0 client.25403 ms_handle_reset on v2:172.21.15.116:6838/261568108 2023-12-01T01:05:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.706+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2280664158 >> 172.21.15.26:0/2280664158 conn(0x559b70f690d0 msgr2=0x559b7100e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.706+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2280664158 shutdown_connections 2023-12-01T01:05:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.706+0000 7fb7982b8b80 1 -- 172.21.15.26:0/2280664158 wait complete. 2023-12-01T01:05:53.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.706+0000 7fb7982b8b80 20 client.25403 trim_cache size 0 max 16384 2023-12-01T01:05:53.712 INFO:teuthology.orchestra.run.smithi026.stdout:[] 2023-12-01T01:05:53.712 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.707+0000 7fb78c128700 1 -- 172.21.15.26:0/845398922 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb7700a0520 msgr2=0x7fb7700a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.707+0000 7fb78c128700 1 --2- 172.21.15.26:0/845398922 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb7700a0520 0x7fb7700a29e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb77400b580 tx=0x7fb774009530 comp rx=0 tx=0).stop 2023-12-01T01:05:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.707+0000 7fb78c128700 1 -- 172.21.15.26:0/845398922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7840ffcb0 msgr2=0x7fb784103c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.707+0000 7fb78c128700 1 --2- 172.21.15.26:0/845398922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7840ffcb0 0x7fb784103c40 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fb78000d980 tx=0x7fb78000dc90 comp rx=0 tx=0).stop 2023-12-01T01:05:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.707+0000 7fb78c128700 1 -- 172.21.15.26:0/845398922 shutdown_connections 2023-12-01T01:05:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.707+0000 7fb78c128700 1 --2- 172.21.15.26:0/845398922 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb7700a0520 0x7fb7700a29e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.707+0000 7fb78c128700 1 --2- 172.21.15.26:0/845398922 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb784101840 0x7fb7841027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.707+0000 7fb78c128700 1 --2- 172.21.15.26:0/845398922 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7840ffcb0 0x7fb784103c40 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.707+0000 7fb78c128700 1 --2- 172.21.15.26:0/845398922 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb784100ea0 0x7fb784102280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.707+0000 7fb78c128700 1 -- 172.21.15.26:0/845398922 >> 172.21.15.26:0/845398922 conn(0x7fb7840fb220 msgr2=0x7fb784069120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.707+0000 7fb78c128700 1 -- 172.21.15.26:0/845398922 shutdown_connections 2023-12-01T01:05:53.713 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.707+0000 7fb78c128700 1 -- 172.21.15.26:0/845398922 wait complete. 2023-12-01T01:05:53.721 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-01T01:05:53.838 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:53 smithi093 bash[141443]: 506ed01402f2e1eacaf7322d7e309657b64f0160a8c1c53b432b3f90f12eceb5 2023-12-01T01:05:53.839 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:53 smithi093 ceph-mds[141483]: -- 172.21.15.93:0/324762877 <== mon.2 v2:172.21.15.93:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55be895951e0 con 0x55be8956a800 2023-12-01T01:05:53.839 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:53 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[141459]: starting mds.h at 2023-12-01T01:05:53.839 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:05:53 smithi093 systemd[1]: Started Ceph mds.h for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T01:05:53.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.852+0000 7f25e04b9700 1 -- 172.21.15.26:0/3897637224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25d8100fc0 msgr2=0x7f25d8107870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.853 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.852+0000 7f25e04b9700 1 --2- 172.21.15.26:0/3897637224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25d8100fc0 0x7f25d8107870 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f25d000c240 tx=0x7f25d000c550 comp rx=0 tx=0).stop 2023-12-01T01:05:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.852+0000 7f25e04b9700 1 -- 172.21.15.26:0/3897637224 shutdown_connections 2023-12-01T01:05:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.852+0000 7f25e04b9700 1 --2- 172.21.15.26:0/3897637224 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25d8100fc0 0x7f25d8107870 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.852+0000 7f25e04b9700 1 --2- 172.21.15.26:0/3897637224 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25d80ff430 0x7f25d80ff850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.852+0000 7f25e04b9700 1 --2- 172.21.15.26:0/3897637224 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d8100620 0x7f25d8100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.852+0000 7f25e04b9700 1 -- 172.21.15.26:0/3897637224 >> 172.21.15.26:0/3897637224 conn(0x7f25d80fa980 msgr2=0x7f25d80fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.852+0000 7f25e04b9700 1 -- 172.21.15.26:0/3897637224 shutdown_connections 2023-12-01T01:05:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.852+0000 7f25e04b9700 1 -- 172.21.15.26:0/3897637224 wait complete. 2023-12-01T01:05:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25e04b9700 1 Processor -- start 2023-12-01T01:05:53.854 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25e04b9700 1 -- start start 2023-12-01T01:05:53.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25e04b9700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d80ff430 0x7f25d8198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25e04b9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25d8100620 0x7f25d8199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25e04b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25d8100fc0 0x7f25d81a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.857 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25e04b9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d81a0950 con 0x7f25d8100fc0 2023-12-01T01:05:53.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25e04b9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d81a0a90 con 0x7f25d8100620 2023-12-01T01:05:53.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25e04b9700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d81a0c20 con 0x7f25d80ff430 2023-12-01T01:05:53.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25dea56700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25d8100fc0 0x7f25d81a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25dda54700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25d8100620 0x7f25d8199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25dea56700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25d8100fc0 0x7f25d81a0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56106/0 (socket says 172.21.15.26:56106) 2023-12-01T01:05:53.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25dea56700 1 -- 172.21.15.26:0/3043958445 learned_addr learned my addr 172.21.15.26:0/3043958445 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:53.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25de255700 1 --2- 172.21.15.26:0/3043958445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d80ff430 0x7f25d8198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25dea56700 1 -- 172.21.15.26:0/3043958445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d80ff430 msgr2=0x7f25d8198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25dea56700 1 --2- 172.21.15.26:0/3043958445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d80ff430 0x7f25d8198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25dea56700 1 -- 172.21.15.26:0/3043958445 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25d8100620 msgr2=0x7f25d8199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25dea56700 1 --2- 172.21.15.26:0/3043958445 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25d8100620 0x7f25d8199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25dea56700 1 -- 172.21.15.26:0/3043958445 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d000ae10 con 0x7f25d8100fc0 2023-12-01T01:05:53.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.853+0000 7f25de255700 1 --2- 172.21.15.26:0/3043958445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d80ff430 0x7f25d8198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:05:53.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.854+0000 7f25dea56700 1 --2- 172.21.15.26:0/3043958445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25d8100fc0 0x7f25d81a0380 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f25d00062a0 tx=0x7f25d00082f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.858 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.854+0000 7f25cf7fe700 1 -- 172.21.15.26:0/3043958445 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d000f040 con 0x7f25d8100fc0 2023-12-01T01:05:53.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.854+0000 7f25cf7fe700 1 -- 172.21.15.26:0/3043958445 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f25d000a560 con 0x7f25d8100fc0 2023-12-01T01:05:53.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.854+0000 7f25e04b9700 1 -- 172.21.15.26:0/3043958445 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d81a0ea0 con 0x7f25d8100fc0 2023-12-01T01:05:53.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.854+0000 7f25cf7fe700 1 -- 172.21.15.26:0/3043958445 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d001e9c0 con 0x7f25d8100fc0 2023-12-01T01:05:53.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.854+0000 7f25e04b9700 1 -- 172.21.15.26:0/3043958445 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d81a12d0 con 0x7f25d8100fc0 2023-12-01T01:05:53.859 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.856+0000 7f25cf7fe700 1 -- 172.21.15.26:0/3043958445 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f25d00074a0 con 0x7f25d8100fc0 2023-12-01T01:05:53.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.857+0000 7f25cf7fe700 1 --2- 172.21.15.26:0/3043958445 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f25c40a05a0 0x7f25c40a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.857+0000 7f25de255700 1 --2- 172.21.15.26:0/3043958445 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f25c40a05a0 0x7f25c40a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.863 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.857+0000 7f25cf7fe700 1 -- 172.21.15.26:0/3043958445 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f25d00cd200 con 0x7f25d8100fc0 2023-12-01T01:05:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.858+0000 7f25de255700 1 --2- 172.21.15.26:0/3043958445 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f25c40a05a0 0x7f25c40a2a60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f25d8100480 tx=0x7f25d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.858+0000 7f25ec649b80 1 Processor -- start 2023-12-01T01:05:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.858+0000 7f25ec649b80 1 -- start start 2023-12-01T01:05:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.858+0000 7f25ec649b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x55631421b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.858+0000 7f25ec649b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421ba70 0x556314219e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.858+0000 7f25ec649b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421a3f0 0x55631421a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.858+0000 7f25ec649b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x556314171a10 con 0x55631421b0f0 2023-12-01T01:05:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.858+0000 7f25ec649b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55631416f3d0 con 0x55631421a3f0 2023-12-01T01:05:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.858+0000 7f25ec649b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55631416acc0 con 0x55631421ba70 2023-12-01T01:05:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.858+0000 7f25de255700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x55631421b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.858+0000 7f25de255700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x55631421b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56110/0 (socket says 172.21.15.26:56110) 2023-12-01T01:05:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.858+0000 7f25de255700 1 -- 172.21.15.26:0/2176129923 learned_addr learned my addr 172.21.15.26:0/2176129923 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.858+0000 7f25dea56700 1 --2- 172.21.15.26:0/2176129923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421a3f0 0x55631421a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.859+0000 7f25dda54700 1 --2- 172.21.15.26:0/2176129923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421ba70 0x556314219e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.859+0000 7f25de255700 1 -- 172.21.15.26:0/2176129923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421ba70 msgr2=0x556314219e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.859+0000 7f25de255700 1 --2- 172.21.15.26:0/2176129923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421ba70 0x556314219e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.859+0000 7f25de255700 1 -- 172.21.15.26:0/2176129923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421a3f0 msgr2=0x55631421a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.859+0000 7f25de255700 1 --2- 172.21.15.26:0/2176129923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421a3f0 0x55631421a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.859+0000 7f25de255700 1 -- 172.21.15.26:0/2176129923 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556313f98de0 con 0x55631421b0f0 2023-12-01T01:05:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.859+0000 7f25dea56700 1 --2- 172.21.15.26:0/2176129923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421a3f0 0x55631421a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.859+0000 7f25de255700 1 --2- 172.21.15.26:0/2176129923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x55631421b530 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f25d4011ed0 tx=0x7f25d4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11542e57163379d server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.859+0000 7f25ccff9700 1 -- 172.21.15.26:0/2176129923 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d4012dc0 con 0x55631421b0f0 2023-12-01T01:05:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.859+0000 7f25ccff9700 1 -- 172.21.15.26:0/2176129923 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f25d4016070 con 0x55631421b0f0 2023-12-01T01:05:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.859+0000 7f25ccff9700 1 -- 172.21.15.26:0/2176129923 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d401d6a0 con 0x55631421b0f0 2023-12-01T01:05:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.860+0000 7f25ec649b80 1 -- 172.21.15.26:0/2176129923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 msgr2=0x55631421b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.860+0000 7f25ec649b80 1 --2- 172.21.15.26:0/2176129923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x55631421b530 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f25d4011ed0 tx=0x7f25d4014000 comp rx=0 tx=0).stop 2023-12-01T01:05:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.860+0000 7f25ec649b80 1 -- 172.21.15.26:0/2176129923 shutdown_connections 2023-12-01T01:05:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.860+0000 7f25ec649b80 1 --2- 172.21.15.26:0/2176129923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421a3f0 0x55631421a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.860+0000 7f25ec649b80 1 --2- 172.21.15.26:0/2176129923 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x55631421b530 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.860+0000 7f25ec649b80 1 --2- 172.21.15.26:0/2176129923 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421ba70 0x556314219e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.860+0000 7f25ec649b80 1 -- 172.21.15.26:0/2176129923 >> 172.21.15.26:0/2176129923 conn(0x5563141790d0 msgr2=0x556314214940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.860+0000 7f25ec649b80 1 -- 172.21.15.26:0/2176129923 shutdown_connections 2023-12-01T01:05:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.860+0000 7f25ec649b80 1 -- 172.21.15.26:0/2176129923 wait complete. 2023-12-01T01:05:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.861+0000 7f25ec649b80 1 -- start start 2023-12-01T01:05:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.861+0000 7f25ec649b80 1 Processor -- start 2023-12-01T01:05:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.861+0000 7f25ec649b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421a3f0 0x5563142239f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.861+0000 7f25ec649b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421b0f0 0x556314223f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.861+0000 7f25ec649b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421ba70 0x55631422af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.861+0000 7f25ec649b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x556314107510 con 0x55631421a3f0 2023-12-01T01:05:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.861+0000 7f25ec649b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563141071b0 con 0x55631421b0f0 2023-12-01T01:05:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.861+0000 7f25ec649b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x556313fee920 con 0x55631421ba70 2023-12-01T01:05:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.861+0000 7f25ec649b80 10 client.0 _ll_register_callbacks cb 0x556314054a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.861+0000 7f25de255700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421a3f0 0x5563142239f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.861+0000 7f25dda54700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421b0f0 0x556314223f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.861+0000 7f25de255700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421a3f0 0x5563142239f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56116/0 (socket says 172.21.15.26:56116) 2023-12-01T01:05:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.861+0000 7f25de255700 1 -- 172.21.15.26:0/681677019 learned_addr learned my addr 172.21.15.26:0/681677019 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.861+0000 7f25dea56700 1 --2- 172.21.15.26:0/681677019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421ba70 0x55631422af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.862+0000 7f25de255700 1 -- 172.21.15.26:0/681677019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421ba70 msgr2=0x55631422af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.862+0000 7f25de255700 1 --2- 172.21.15.26:0/681677019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421ba70 0x55631422af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.862+0000 7f25de255700 1 -- 172.21.15.26:0/681677019 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421b0f0 msgr2=0x556314223f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.862+0000 7f25de255700 1 --2- 172.21.15.26:0/681677019 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421b0f0 0x556314223f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.862+0000 7f25de255700 1 -- 172.21.15.26:0/681677019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d81a12d0 con 0x55631421a3f0 2023-12-01T01:05:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.862+0000 7f25de255700 1 --2- 172.21.15.26:0/681677019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421a3f0 0x5563142239f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f25d40059d0 tx=0x7f25d401f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2451f6fcf11584b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.862+0000 7f25c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.862+0000 7f25c1ffb700 1 -- 172.21.15.26:0/681677019 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d402d070 con 0x55631421a3f0 2023-12-01T01:05:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.862+0000 7f25c1ffb700 1 -- 172.21.15.26:0/681677019 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f25d4018070 con 0x55631421a3f0 2023-12-01T01:05:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.862+0000 7f25ec649b80 1 -- 172.21.15.26:0/681677019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556314195d10 con 0x55631421a3f0 2023-12-01T01:05:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.862+0000 7f25c1ffb700 1 -- 172.21.15.26:0/681677019 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25d4009a20 con 0x55631421a3f0 2023-12-01T01:05:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.862+0000 7f25ec649b80 10 client.15777 fetch_fsmap learned FSMap version 26 2023-12-01T01:05:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.862+0000 7f25ec649b80 1 -- 172.21.15.26:0/681677019 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f25d4011c60 con 0x55631421a3f0 2023-12-01T01:05:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.862+0000 7f25c1ffb700 1 -- 172.21.15.26:0/681677019 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x556314195d10 con 0x55631421a3f0 2023-12-01T01:05:53.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.863+0000 7f25c1ffb700 1 -- 172.21.15.26:0/681677019 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 26) v1 ==== 7458+0+0 (secure 0 0 0) 0x7f25d4004aa0 con 0x55631421a3f0 2023-12-01T01:05:53.870 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.863+0000 7f25ec649b80 10 client.15777 fetch_fsmap finished waiting for FSMap version 26 2023-12-01T01:05:53.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.863+0000 7f25ec649b80 10 client.15777 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2023-12-01T01:05:53.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.863+0000 7f25ec649b80 20 client.15777 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:53.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.863+0000 7f25ec649b80 1 --2- 172.21.15.26:0/681677019 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55631422f6f0 0x556314231b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.863+0000 7f25ec649b80 4 client.15777 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:05:53.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.863+0000 7f25ec649b80 1 -- 172.21.15.26:0/681677019 --> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563141e8e10 con 0x55631422f6f0 2023-12-01T01:05:53.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.863+0000 7f25dda54700 1 --2- 172.21.15.26:0/681677019 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55631422f6f0 0x556314231b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.863+0000 7f25c1ffb700 10 client.15777 ms_handle_connect on v2:172.21.15.26:6838/1277894156 2023-12-01T01:05:53.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.863+0000 7f25dda54700 1 --2- 172.21.15.26:0/681677019 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55631422f6f0 0x556314231b10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=47674e710101cf81 server_cookie=4519a68699a243db in_seq=0 out_seq=0 2023-12-01T01:05:53.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.864+0000 7f25c1ffb700 1 -- 172.21.15.26:0/681677019 <== mds.1 v2:172.21.15.26:6838/1277894156 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5563141e8e10 con 0x55631422f6f0 2023-12-01T01:05:53.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.864+0000 7f25c1ffb700 10 client.15777 handle_command_reply: tid=0 2023-12-01T01:05:53.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.864+0000 7f25ec649b80 1 client.15777 shutdown 2023-12-01T01:05:53.871 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.864+0000 7f25ec649b80 1 -- 172.21.15.26:0/681677019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421a3f0 msgr2=0x5563142239f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.864+0000 7f25ec649b80 1 --2- 172.21.15.26:0/681677019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421a3f0 0x5563142239f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f25d40059d0 tx=0x7f25d401f6a0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.864+0000 7f25ec649b80 1 -- 172.21.15.26:0/681677019 shutdown_connections 2023-12-01T01:05:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.864+0000 7f25ec649b80 1 --2- 172.21.15.26:0/681677019 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421ba70 0x55631422af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.864+0000 7f25ec649b80 1 --2- 172.21.15.26:0/681677019 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55631422f6f0 0x556314231b10 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.864+0000 7f25ec649b80 1 --2- 172.21.15.26:0/681677019 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421a3f0 0x5563142239f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.864+0000 7f25ec649b80 1 --2- 172.21.15.26:0/681677019 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421b0f0 0x556314223f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.864+0000 7f25c1ffb700 0 client.15777 ms_handle_reset on v2:172.21.15.26:6838/1277894156 2023-12-01T01:05:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.864+0000 7f25ec649b80 1 -- 172.21.15.26:0/681677019 >> 172.21.15.26:0/681677019 conn(0x5563141790d0 msgr2=0x5563142140b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.864+0000 7f25ec649b80 1 -- 172.21.15.26:0/681677019 shutdown_connections 2023-12-01T01:05:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.864+0000 7f25ec649b80 1 -- 172.21.15.26:0/681677019 wait complete. 2023-12-01T01:05:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.864+0000 7f25ec649b80 20 client.15777 trim_cache size 0 max 16384 2023-12-01T01:05:53.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.877+0000 7f25ec649b80 1 Processor -- start 2023-12-01T01:05:53.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.877+0000 7f25ec649b80 1 -- start start 2023-12-01T01:05:53.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.877+0000 7f25ec649b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421a3f0 0x556314219e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.877+0000 7f25ec649b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x556314228f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.883 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.877+0000 7f25ec649b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421ba70 0x5563142237a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.877+0000 7f25ec649b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563142153a0 con 0x55631421b0f0 2023-12-01T01:05:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.877+0000 7f25ec649b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55631422f1e0 con 0x55631421ba70 2023-12-01T01:05:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.877+0000 7f25ec649b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x556314232170 con 0x55631421a3f0 2023-12-01T01:05:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.877+0000 7f25dda54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x556314228f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.878+0000 7f25dda54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x556314228f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56126/0 (socket says 172.21.15.26:56126) 2023-12-01T01:05:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.878+0000 7f25dda54700 1 -- 172.21.15.26:0/1613996317 learned_addr learned my addr 172.21.15.26:0/1613996317 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.878+0000 7f25dea56700 1 --2- 172.21.15.26:0/1613996317 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421ba70 0x5563142237a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.878+0000 7f25de255700 1 --2- 172.21.15.26:0/1613996317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421a3f0 0x556314219e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.878+0000 7f25dda54700 1 -- 172.21.15.26:0/1613996317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421a3f0 msgr2=0x556314219e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.878+0000 7f25dda54700 1 --2- 172.21.15.26:0/1613996317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421a3f0 0x556314219e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.878+0000 7f25dda54700 1 -- 172.21.15.26:0/1613996317 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421ba70 msgr2=0x5563142237a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.878+0000 7f25dda54700 1 --2- 172.21.15.26:0/1613996317 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421ba70 0x5563142237a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.878+0000 7f25dda54700 1 -- 172.21.15.26:0/1613996317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556313f81c60 con 0x55631421b0f0 2023-12-01T01:05:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.878+0000 7f25de255700 1 --2- 172.21.15.26:0/1613996317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421a3f0 0x556314219e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:05:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.878+0000 7f25dda54700 1 --2- 172.21.15.26:0/1613996317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x556314228f20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f25c8004790 tx=0x7f25c8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd7a3e0a5334951 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.884 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.878+0000 7f25cd7fa700 1 -- 172.21.15.26:0/1613996317 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8017030 con 0x55631421b0f0 2023-12-01T01:05:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.878+0000 7f25cd7fa700 1 -- 172.21.15.26:0/1613996317 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f25c8018040 con 0x55631421b0f0 2023-12-01T01:05:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.878+0000 7f25cd7fa700 1 -- 172.21.15.26:0/1613996317 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c80038e0 con 0x55631421b0f0 2023-12-01T01:05:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.879+0000 7f25ec649b80 1 -- 172.21.15.26:0/1613996317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 msgr2=0x556314228f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.879+0000 7f25ec649b80 1 --2- 172.21.15.26:0/1613996317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x556314228f20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f25c8004790 tx=0x7f25c8009260 comp rx=0 tx=0).stop 2023-12-01T01:05:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.879+0000 7f25ec649b80 1 -- 172.21.15.26:0/1613996317 shutdown_connections 2023-12-01T01:05:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.879+0000 7f25ec649b80 1 --2- 172.21.15.26:0/1613996317 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421ba70 0x5563142237a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.879+0000 7f25ec649b80 1 --2- 172.21.15.26:0/1613996317 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421a3f0 0x556314219e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.879+0000 7f25ec649b80 1 --2- 172.21.15.26:0/1613996317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x556314228f20 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.879+0000 7f25ec649b80 1 -- 172.21.15.26:0/1613996317 >> 172.21.15.26:0/1613996317 conn(0x5563141790d0 msgr2=0x55631421e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.879+0000 7f25ec649b80 1 -- 172.21.15.26:0/1613996317 shutdown_connections 2023-12-01T01:05:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.879+0000 7f25ec649b80 1 -- 172.21.15.26:0/1613996317 wait complete. 2023-12-01T01:05:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.879+0000 7f25ec649b80 1 -- start start 2023-12-01T01:05:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.879+0000 7f25ec649b80 1 Processor -- start 2023-12-01T01:05:53.885 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25ec649b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421a3f0 0x5563142793f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25ec649b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x556314279930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25ec649b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421ba70 0x556314280250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25ec649b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x556314280790 con 0x55631421b0f0 2023-12-01T01:05:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25ec649b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563142808d0 con 0x55631421a3f0 2023-12-01T01:05:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25ec649b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x556314280a90 con 0x55631421ba70 2023-12-01T01:05:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25ec649b80 10 client.0 _ll_register_callbacks cb 0x7f25d0007c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25dda54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x556314279930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25dda54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x556314279930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56132/0 (socket says 172.21.15.26:56132) 2023-12-01T01:05:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25de255700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421a3f0 0x5563142793f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25dda54700 1 -- 172.21.15.26:0/3594529769 learned_addr learned my addr 172.21.15.26:0/3594529769 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25dea56700 1 --2- 172.21.15.26:0/3594529769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421ba70 0x556314280250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25dda54700 1 -- 172.21.15.26:0/3594529769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421ba70 msgr2=0x556314280250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25dda54700 1 --2- 172.21.15.26:0/3594529769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421ba70 0x556314280250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25dda54700 1 -- 172.21.15.26:0/3594529769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421a3f0 msgr2=0x5563142793f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:53.886 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25dda54700 1 --2- 172.21.15.26:0/3594529769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421a3f0 0x5563142793f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25dda54700 1 -- 172.21.15.26:0/3594529769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c8010430 con 0x55631421b0f0 2023-12-01T01:05:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25dda54700 1 --2- 172.21.15.26:0/3594529769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x556314279930 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f25c8000c00 tx=0x7f25c8010e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04b96c5e4044d62 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25c1ffb700 1 -- 172.21.15.26:0/3594529769 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c8017040 con 0x55631421b0f0 2023-12-01T01:05:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25c1ffb700 1 -- 172.21.15.26:0/3594529769 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f25c801ea00 con 0x55631421b0f0 2023-12-01T01:05:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.880+0000 7f25ec649b80 1 -- 172.21.15.26:0/3594529769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25d4016070 con 0x55631421b0f0 2023-12-01T01:05:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.881+0000 7f25c1ffb700 1 -- 172.21.15.26:0/3594529769 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25c801ebc0 con 0x55631421b0f0 2023-12-01T01:05:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.881+0000 7f25ec649b80 10 client.15783 fetch_fsmap learned FSMap version 26 2023-12-01T01:05:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.881+0000 7f25ec649b80 1 -- 172.21.15.26:0/3594529769 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x556313fbf250 con 0x55631421b0f0 2023-12-01T01:05:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.881+0000 7f25c1ffb700 1 -- 172.21.15.26:0/3594529769 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f25d4016070 con 0x55631421b0f0 2023-12-01T01:05:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.881+0000 7f25c1ffb700 1 -- 172.21.15.26:0/3594529769 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 26) v1 ==== 7458+0+0 (secure 0 0 0) 0x7f25c803a070 con 0x55631421b0f0 2023-12-01T01:05:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.881+0000 7f25ec649b80 10 client.15783 fetch_fsmap finished waiting for FSMap version 26 2023-12-01T01:05:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.881+0000 7f25ec649b80 10 client.15783 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2023-12-01T01:05:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.881+0000 7f25ec649b80 20 client.15783 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:53.887 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.881+0000 7f25ec649b80 1 --2- 172.21.15.26:0/3594529769 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x556314282370 0x556314284790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.881+0000 7f25ec649b80 4 client.15783 mds_command: new command op to 24493 tid=0[{"prefix": "damage ls"}] 2023-12-01T01:05:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.881+0000 7f25ec649b80 1 -- 172.21.15.26:0/3594529769 --> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556314163d40 con 0x556314282370 2023-12-01T01:05:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.881+0000 7f25de255700 1 --2- 172.21.15.26:0/3594529769 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x556314282370 0x556314284790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.881+0000 7f25c1ffb700 10 client.15783 ms_handle_connect on v2:172.21.15.26:6838/1277894156 2023-12-01T01:05:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.881+0000 7f25de255700 1 --2- 172.21.15.26:0/3594529769 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x556314282370 0x556314284790 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8645225f3094e1bb server_cookie=be6bc49130c01713 in_seq=0 out_seq=0 2023-12-01T01:05:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25c1ffb700 1 -- 172.21.15.26:0/3594529769 <== mds.1 v2:172.21.15.26:6838/1277894156 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556314163d40 con 0x556314282370 2023-12-01T01:05:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25c1ffb700 10 client.15783 handle_command_reply: tid=0 2023-12-01T01:05:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25ec649b80 1 client.15783 shutdown 2023-12-01T01:05:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25ec649b80 1 -- 172.21.15.26:0/3594529769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 msgr2=0x556314279930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25ec649b80 1 --2- 172.21.15.26:0/3594529769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x556314279930 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f25c8000c00 tx=0x7f25c8010e40 comp rx=0 tx=0).stop 2023-12-01T01:05:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25ec649b80 1 -- 172.21.15.26:0/3594529769 shutdown_connections 2023-12-01T01:05:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25ec649b80 1 --2- 172.21.15.26:0/3594529769 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55631421ba70 0x556314280250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25ec649b80 1 --2- 172.21.15.26:0/3594529769 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55631421a3f0 0x5563142793f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25ec649b80 1 --2- 172.21.15.26:0/3594529769 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x556314282370 0x556314284790 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25ec649b80 1 --2- 172.21.15.26:0/3594529769 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55631421b0f0 0x556314279930 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.888 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25ec649b80 1 -- 172.21.15.26:0/3594529769 >> 172.21.15.26:0/3594529769 conn(0x5563141790d0 msgr2=0x5563142237a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25c1ffb700 0 client.15783 ms_handle_reset on v2:172.21.15.26:6838/1277894156 2023-12-01T01:05:53.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25ec649b80 1 -- 172.21.15.26:0/3594529769 shutdown_connections 2023-12-01T01:05:53.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25ec649b80 1 -- 172.21.15.26:0/3594529769 wait complete. 2023-12-01T01:05:53.889 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25ec649b80 20 client.15783 trim_cache size 0 max 16384 2023-12-01T01:05:53.889 INFO:teuthology.orchestra.run.smithi026.stdout:[] 2023-12-01T01:05:53.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25e04b9700 1 -- 172.21.15.26:0/3043958445 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f25c40a05a0 msgr2=0x7f25c40a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25e04b9700 1 --2- 172.21.15.26:0/3043958445 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f25c40a05a0 0x7f25c40a2a60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f25d8100480 tx=0x7f25d4009260 comp rx=0 tx=0).stop 2023-12-01T01:05:53.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25e04b9700 1 -- 172.21.15.26:0/3043958445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25d8100fc0 msgr2=0x7f25d81a0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:53.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25e04b9700 1 --2- 172.21.15.26:0/3043958445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25d8100fc0 0x7f25d81a0380 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f25d00062a0 tx=0x7f25d00082f0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25e04b9700 1 -- 172.21.15.26:0/3043958445 shutdown_connections 2023-12-01T01:05:53.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25e04b9700 1 --2- 172.21.15.26:0/3043958445 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f25c40a05a0 0x7f25c40a2a60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25e04b9700 1 --2- 172.21.15.26:0/3043958445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25d8100fc0 0x7f25d81a0380 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25e04b9700 1 --2- 172.21.15.26:0/3043958445 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f25d80ff430 0x7f25d8198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.882+0000 7f25e04b9700 1 --2- 172.21.15.26:0/3043958445 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f25d8100620 0x7f25d8199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:53.890 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.883+0000 7f25e04b9700 1 -- 172.21.15.26:0/3043958445 >> 172.21.15.26:0/3043958445 conn(0x7f25d80fa980 msgr2=0x7f25d81039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:53.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.883+0000 7f25e04b9700 1 -- 172.21.15.26:0/3043958445 shutdown_connections 2023-12-01T01:05:53.891 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:53.883+0000 7f25e04b9700 1 -- 172.21.15.26:0/3043958445 wait complete. 2023-12-01T01:05:53.895 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-01T01:05:54.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.029+0000 7fb168a97700 1 -- 172.21.15.26:0/1822737356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1640ff050 msgr2=0x7fb1640ff470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:54.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.029+0000 7fb168a97700 1 --2- 172.21.15.26:0/1822737356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1640ff050 0x7fb1640ff470 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fb154009990 tx=0x7fb154009ca0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.029+0000 7fb168a97700 1 -- 172.21.15.26:0/1822737356 shutdown_connections 2023-12-01T01:05:54.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.029+0000 7fb168a97700 1 --2- 172.21.15.26:0/1822737356 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb164102a60 0x7fb164109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.029+0000 7fb168a97700 1 --2- 172.21.15.26:0/1822737356 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1640ff050 0x7fb1640ff470 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.029+0000 7fb168a97700 1 --2- 172.21.15.26:0/1822737356 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1641020c0 0x7fb164102520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.029+0000 7fb168a97700 1 -- 172.21.15.26:0/1822737356 >> 172.21.15.26:0/1822737356 conn(0x7fb1640fa960 msgr2=0x7fb1640fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:54.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.029+0000 7fb168a97700 1 -- 172.21.15.26:0/1822737356 shutdown_connections 2023-12-01T01:05:54.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.029+0000 7fb168a97700 1 -- 172.21.15.26:0/1822737356 wait complete. 2023-12-01T01:05:54.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb168a97700 1 Processor -- start 2023-12-01T01:05:54.031 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb168a97700 1 -- start start 2023-12-01T01:05:54.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb168a97700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1640ff050 0x7fb164196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb168a97700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1641020c0 0x7fb164197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb168a97700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb164102a60 0x7fb16419e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb168a97700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16419e790 con 0x7fb1641020c0 2023-12-01T01:05:54.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb168a97700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16419e900 con 0x7fb1640ff050 2023-12-01T01:05:54.033 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb168a97700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16419eac0 con 0x7fb164102a60 2023-12-01T01:05:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb161d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1641020c0 0x7fb164197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb161d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1641020c0 0x7fb164197190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56144/0 (socket says 172.21.15.26:56144) 2023-12-01T01:05:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb16259c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1640ff050 0x7fb164196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb161d9b700 1 -- 172.21.15.26:0/3963491258 learned_addr learned my addr 172.21.15.26:0/3963491258 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb162d9d700 1 --2- 172.21.15.26:0/3963491258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb164102a60 0x7fb16419e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb161d9b700 1 -- 172.21.15.26:0/3963491258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb164102a60 msgr2=0x7fb16419e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb161d9b700 1 --2- 172.21.15.26:0/3963491258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb164102a60 0x7fb16419e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb161d9b700 1 -- 172.21.15.26:0/3963491258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1640ff050 msgr2=0x7fb164196c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb161d9b700 1 --2- 172.21.15.26:0/3963491258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1640ff050 0x7fb164196c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb161d9b700 1 -- 172.21.15.26:0/3963491258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1540095f0 con 0x7fb1641020c0 2023-12-01T01:05:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.030+0000 7fb16259c700 1 --2- 172.21.15.26:0/3963491258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1640ff050 0x7fb164196c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.031+0000 7fb161d9b700 1 --2- 172.21.15.26:0/3963491258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1641020c0 0x7fb164197190 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb15800e9a0 tx=0x7fb15800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.031+0000 7fb1537fe700 1 -- 172.21.15.26:0/3963491258 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158009790 con 0x7fb1641020c0 2023-12-01T01:05:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.031+0000 7fb1537fe700 1 -- 172.21.15.26:0/3963491258 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb15800cbd0 con 0x7fb1641020c0 2023-12-01T01:05:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.031+0000 7fb168a97700 1 -- 172.21.15.26:0/3963491258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb16419eda0 con 0x7fb1641020c0 2023-12-01T01:05:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.031+0000 7fb1537fe700 1 -- 172.21.15.26:0/3963491258 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158018680 con 0x7fb1641020c0 2023-12-01T01:05:54.038 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.031+0000 7fb168a97700 1 -- 172.21.15.26:0/3963491258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16419f270 con 0x7fb1641020c0 2023-12-01T01:05:54.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.033+0000 7fb1537fe700 1 -- 172.21.15.26:0/3963491258 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fb1580188a0 con 0x7fb1641020c0 2023-12-01T01:05:54.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.034+0000 7fb1537fe700 1 --2- 172.21.15.26:0/3963491258 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb14c0a05a0 0x7fb14c0a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.034+0000 7fb16259c700 1 --2- 172.21.15.26:0/3963491258 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb14c0a05a0 0x7fb14c0a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.034+0000 7fb1537fe700 1 -- 172.21.15.26:0/3963491258 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb158014070 con 0x7fb1641020c0 2023-12-01T01:05:54.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.034+0000 7fb16259c700 1 --2- 172.21.15.26:0/3963491258 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb14c0a05a0 0x7fb14c0a2a60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb154000c00 tx=0x7fb154005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:54.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.034+0000 7fb174c27b80 1 Processor -- start 2023-12-01T01:05:54.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb174c27b80 1 -- start start 2023-12-01T01:05:54.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb174c27b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627f0f0 0x5602b627f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb174c27b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b627de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.047 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb174c27b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627e3f0 0x5602b627e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb174c27b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602b61d5a10 con 0x5602b627fa70 2023-12-01T01:05:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb174c27b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602b61d33d0 con 0x5602b627f0f0 2023-12-01T01:05:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb174c27b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602b61cecc0 con 0x5602b627e3f0 2023-12-01T01:05:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb161d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b627de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb16259c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627f0f0 0x5602b627f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb161d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b627de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56152/0 (socket says 172.21.15.26:56152) 2023-12-01T01:05:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb161d9b700 1 -- 172.21.15.26:0/1687761606 learned_addr learned my addr 172.21.15.26:0/1687761606 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb162d9d700 1 --2- 172.21.15.26:0/1687761606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627e3f0 0x5602b627e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb161d9b700 1 -- 172.21.15.26:0/1687761606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627e3f0 msgr2=0x5602b627e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb161d9b700 1 --2- 172.21.15.26:0/1687761606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627e3f0 0x5602b627e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb161d9b700 1 -- 172.21.15.26:0/1687761606 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627f0f0 msgr2=0x5602b627f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb161d9b700 1 --2- 172.21.15.26:0/1687761606 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627f0f0 0x5602b627f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb161d9b700 1 -- 172.21.15.26:0/1687761606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602b5ffcde0 con 0x5602b627fa70 2023-12-01T01:05:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.035+0000 7fb161d9b700 1 --2- 172.21.15.26:0/1687761606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b627de60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb1580a0fb0 tx=0x7fb158098dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ea82fc0ad490de server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:54.048 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.036+0000 7fb150ff9700 1 -- 172.21.15.26:0/1687761606 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158099470 con 0x5602b627fa70 2023-12-01T01:05:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.036+0000 7fb150ff9700 1 -- 172.21.15.26:0/1687761606 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb15809d2a0 con 0x5602b627fa70 2023-12-01T01:05:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.036+0000 7fb150ff9700 1 -- 172.21.15.26:0/1687761606 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158098960 con 0x5602b627fa70 2023-12-01T01:05:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.036+0000 7fb174c27b80 1 -- 172.21.15.26:0/1687761606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 msgr2=0x5602b627de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.036+0000 7fb174c27b80 1 --2- 172.21.15.26:0/1687761606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b627de60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb1580a0fb0 tx=0x7fb158098dd0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.036+0000 7fb174c27b80 1 -- 172.21.15.26:0/1687761606 shutdown_connections 2023-12-01T01:05:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.036+0000 7fb174c27b80 1 --2- 172.21.15.26:0/1687761606 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627e3f0 0x5602b627e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.036+0000 7fb174c27b80 1 --2- 172.21.15.26:0/1687761606 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627f0f0 0x5602b627f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.036+0000 7fb174c27b80 1 --2- 172.21.15.26:0/1687761606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b627de60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.036+0000 7fb174c27b80 1 -- 172.21.15.26:0/1687761606 >> 172.21.15.26:0/1687761606 conn(0x5602b61dd0d0 msgr2=0x5602b6278940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.036+0000 7fb174c27b80 1 -- 172.21.15.26:0/1687761606 shutdown_connections 2023-12-01T01:05:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.037+0000 7fb174c27b80 1 -- 172.21.15.26:0/1687761606 wait complete. 2023-12-01T01:05:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.037+0000 7fb174c27b80 1 -- start start 2023-12-01T01:05:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.037+0000 7fb174c27b80 1 Processor -- start 2023-12-01T01:05:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.037+0000 7fb174c27b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627e3f0 0x5602b6287990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.049 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.037+0000 7fb174c27b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627f0f0 0x5602b6287ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.037+0000 7fb174c27b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b628ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.037+0000 7fb174c27b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602b616b510 con 0x5602b627fa70 2023-12-01T01:05:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.037+0000 7fb174c27b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602b616b1b0 con 0x5602b627e3f0 2023-12-01T01:05:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.037+0000 7fb174c27b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602b6052920 con 0x5602b627f0f0 2023-12-01T01:05:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.037+0000 7fb174c27b80 10 client.0 _ll_register_callbacks cb 0x5602b60b8a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.037+0000 7fb16259c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627e3f0 0x5602b6287990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.037+0000 7fb162d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b628ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.037+0000 7fb16259c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627e3f0 0x5602b6287990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:46894/0 (socket says 172.21.15.26:46894) 2023-12-01T01:05:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.037+0000 7fb16259c700 1 -- 172.21.15.26:0/3390503197 learned_addr learned my addr 172.21.15.26:0/3390503197 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.037+0000 7fb162d9d700 1 --2- 172.21.15.26:0/3390503197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b628ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56158/0 (socket says 172.21.15.26:56158) 2023-12-01T01:05:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.038+0000 7fb16259c700 1 -- 172.21.15.26:0/3390503197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627f0f0 msgr2=0x5602b6287ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.038+0000 7fb16259c700 1 --2- 172.21.15.26:0/3390503197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627f0f0 0x5602b6287ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.038+0000 7fb16259c700 1 -- 172.21.15.26:0/3390503197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 msgr2=0x5602b628ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:54.050 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.038+0000 7fb16259c700 1 --2- 172.21.15.26:0/3390503197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b628ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.038+0000 7fb16259c700 1 -- 172.21.15.26:0/3390503197 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb16419f270 con 0x5602b627e3f0 2023-12-01T01:05:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.038+0000 7fb16259c700 1 --2- 172.21.15.26:0/3390503197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627e3f0 0x5602b6287990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb164067c30 tx=0x7fb15401a050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49bad83d6cab4c81 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.038+0000 7fb149ffb700 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-12-01T01:05:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.038+0000 7fb149ffb700 1 -- 172.21.15.26:0/3390503197 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154034070 con 0x5602b627e3f0 2023-12-01T01:05:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.038+0000 7fb149ffb700 1 -- 172.21.15.26:0/3390503197 <== mon.2 v2:172.21.15.93:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb154005020 con 0x5602b627e3f0 2023-12-01T01:05:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.038+0000 7fb174c27b80 1 -- 172.21.15.26:0/3390503197 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5602b61f9d10 con 0x5602b627e3f0 2023-12-01T01:05:54.051 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.038+0000 7fb149ffb700 1 -- 172.21.15.26:0/3390503197 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb15402b050 con 0x5602b627e3f0 2023-12-01T01:05:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.038+0000 7fb174c27b80 10 client.25433 fetch_fsmap learned FSMap version 26 2023-12-01T01:05:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.038+0000 7fb174c27b80 1 -- 172.21.15.26:0/3390503197 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5602b5fe5c60 con 0x5602b627e3f0 2023-12-01T01:05:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.038+0000 7fb149ffb700 1 -- 172.21.15.26:0/3390503197 <== mon.2 v2:172.21.15.93:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb15403f020 con 0x5602b627e3f0 2023-12-01T01:05:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.039+0000 7fb149ffb700 1 -- 172.21.15.26:0/3390503197 <== mon.2 v2:172.21.15.93:3300/0 5 ==== fsmap(e 26) v1 ==== 7458+0+0 (secure 0 0 0) 0x7fb154037020 con 0x5602b627e3f0 2023-12-01T01:05:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.039+0000 7fb174c27b80 10 client.25433 fetch_fsmap finished waiting for FSMap version 26 2023-12-01T01:05:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.039+0000 7fb174c27b80 10 client.25433 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.039+0000 7fb174c27b80 20 client.25433 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.039+0000 7fb174c27b80 1 --2- 172.21.15.26:0/3390503197 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5602b6293860 0x5602b6295c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.052 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.039+0000 7fb174c27b80 4 client.25433 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:05:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.039+0000 7fb174c27b80 1 -- 172.21.15.26:0/3390503197 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5602b624ce10 con 0x5602b6293860 2023-12-01T01:05:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.039+0000 7fb161d9b700 1 --2- 172.21.15.26:0/3390503197 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5602b6293860 0x5602b6295c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.039+0000 7fb149ffb700 10 client.25433 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.039+0000 7fb161d9b700 1 --2- 172.21.15.26:0/3390503197 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5602b6293860 0x5602b6295c80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb1d3af52ba1caa7 server_cookie=af46144b06a6ffa8 in_seq=0 out_seq=0 2023-12-01T01:05:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.042+0000 7fb149ffb700 1 -- 172.21.15.26:0/3390503197 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5602b624ce10 con 0x5602b6293860 2023-12-01T01:05:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.042+0000 7fb149ffb700 10 client.25433 handle_command_reply: tid=0 2023-12-01T01:05:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.042+0000 7fb174c27b80 1 client.25433 shutdown 2023-12-01T01:05:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.042+0000 7fb174c27b80 1 -- 172.21.15.26:0/3390503197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627e3f0 msgr2=0x5602b6287990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.042+0000 7fb174c27b80 1 --2- 172.21.15.26:0/3390503197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627e3f0 0x5602b6287990 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb164067c30 tx=0x7fb15401a050 comp rx=0 tx=0).stop 2023-12-01T01:05:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.042+0000 7fb174c27b80 1 -- 172.21.15.26:0/3390503197 shutdown_connections 2023-12-01T01:05:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.042+0000 7fb174c27b80 1 --2- 172.21.15.26:0/3390503197 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5602b6293860 0x5602b6295c80 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.042+0000 7fb174c27b80 1 --2- 172.21.15.26:0/3390503197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b628ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.042+0000 7fb174c27b80 1 --2- 172.21.15.26:0/3390503197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627e3f0 0x5602b6287990 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.042+0000 7fb149ffb700 0 client.25433 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:54.053 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.042+0000 7fb174c27b80 1 --2- 172.21.15.26:0/3390503197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627f0f0 0x5602b6287ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.042+0000 7fb174c27b80 1 -- 172.21.15.26:0/3390503197 >> 172.21.15.26:0/3390503197 conn(0x5602b61dd0d0 msgr2=0x5602b62780b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:54.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.042+0000 7fb174c27b80 1 -- 172.21.15.26:0/3390503197 shutdown_connections 2023-12-01T01:05:54.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.042+0000 7fb174c27b80 1 -- 172.21.15.26:0/3390503197 wait complete. 2023-12-01T01:05:54.054 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.042+0000 7fb174c27b80 20 client.25433 trim_cache size 0 max 16384 2023-12-01T01:05:54.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb174c27b80 1 Processor -- start 2023-12-01T01:05:54.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb174c27b80 1 -- start start 2023-12-01T01:05:54.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb174c27b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627e3f0 0x5602b627de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb174c27b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627f0f0 0x5602b628cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb174c27b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627fa70 0x5602b62787e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb174c27b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602b6273440 con 0x5602b627e3f0 2023-12-01T01:05:54.064 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb174c27b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602b624ce10 con 0x5602b627fa70 2023-12-01T01:05:54.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb174c27b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602b6288b80 con 0x5602b627f0f0 2023-12-01T01:05:54.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb16259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627e3f0 0x5602b627de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb16259c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627e3f0 0x5602b627de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56164/0 (socket says 172.21.15.26:56164) 2023-12-01T01:05:54.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb16259c700 1 -- 172.21.15.26:0/1133082460 learned_addr learned my addr 172.21.15.26:0/1133082460 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:54.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb162d9d700 1 --2- 172.21.15.26:0/1133082460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627fa70 0x5602b62787e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb161d9b700 1 --2- 172.21.15.26:0/1133082460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627f0f0 0x5602b628cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb16259c700 1 -- 172.21.15.26:0/1133082460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627f0f0 msgr2=0x5602b628cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:54.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb16259c700 1 --2- 172.21.15.26:0/1133082460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627f0f0 0x5602b628cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb16259c700 1 -- 172.21.15.26:0/1133082460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627fa70 msgr2=0x5602b62787e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:54.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb16259c700 1 --2- 172.21.15.26:0/1133082460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627fa70 0x5602b62787e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb16259c700 1 -- 172.21.15.26:0/1133082460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602b6023250 con 0x5602b627e3f0 2023-12-01T01:05:54.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb161d9b700 1 --2- 172.21.15.26:0/1133082460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627f0f0 0x5602b628cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:05:54.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb16259c700 1 --2- 172.21.15.26:0/1133082460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627e3f0 0x5602b627de60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb154009990 tx=0x7fb154009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c0d6aaff9aedde server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:54.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.055+0000 7fb1517fa700 1 -- 172.21.15.26:0/1133082460 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb154034070 con 0x5602b627e3f0 2023-12-01T01:05:54.065 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.056+0000 7fb1517fa700 1 -- 172.21.15.26:0/1133082460 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb15403f040 con 0x5602b627e3f0 2023-12-01T01:05:54.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.056+0000 7fb1517fa700 1 -- 172.21.15.26:0/1133082460 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15402b040 con 0x5602b627e3f0 2023-12-01T01:05:54.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.056+0000 7fb174c27b80 1 -- 172.21.15.26:0/1133082460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627e3f0 msgr2=0x5602b627de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:54.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.056+0000 7fb174c27b80 1 --2- 172.21.15.26:0/1133082460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627e3f0 0x5602b627de60 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb154009990 tx=0x7fb154009290 comp rx=0 tx=0).stop 2023-12-01T01:05:54.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.056+0000 7fb174c27b80 1 -- 172.21.15.26:0/1133082460 shutdown_connections 2023-12-01T01:05:54.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.056+0000 7fb174c27b80 1 --2- 172.21.15.26:0/1133082460 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627fa70 0x5602b62787e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.056+0000 7fb174c27b80 1 --2- 172.21.15.26:0/1133082460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627e3f0 0x5602b627de60 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.056+0000 7fb174c27b80 1 --2- 172.21.15.26:0/1133082460 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627f0f0 0x5602b628cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.056+0000 7fb174c27b80 1 -- 172.21.15.26:0/1133082460 >> 172.21.15.26:0/1133082460 conn(0x5602b61dd0d0 msgr2=0x5602b62866b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:54.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.056+0000 7fb174c27b80 1 -- 172.21.15.26:0/1133082460 shutdown_connections 2023-12-01T01:05:54.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.056+0000 7fb174c27b80 1 -- 172.21.15.26:0/1133082460 wait complete. 2023-12-01T01:05:54.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.056+0000 7fb174c27b80 1 -- start start 2023-12-01T01:05:54.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.056+0000 7fb174c27b80 1 Processor -- start 2023-12-01T01:05:54.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb174c27b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627e3f0 0x5602b628c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb174c27b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627f0f0 0x5602b628ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.066 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb174c27b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b628af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb174c27b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602b628b680 con 0x5602b627fa70 2023-12-01T01:05:54.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb174c27b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602b628b7f0 con 0x5602b627e3f0 2023-12-01T01:05:54.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb174c27b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602b628b9b0 con 0x5602b627f0f0 2023-12-01T01:05:54.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb174c27b80 10 client.0 _ll_register_callbacks cb 0x7fb15400f900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:54.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb162d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b628af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb16259c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627e3f0 0x5602b628c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb16259c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627e3f0 0x5602b628c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:46908/0 (socket says 172.21.15.26:46908) 2023-12-01T01:05:54.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb16259c700 1 -- 172.21.15.26:0/3234616178 learned_addr learned my addr 172.21.15.26:0/3234616178 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:54.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb162d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b628af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56174/0 (socket says 172.21.15.26:56174) 2023-12-01T01:05:54.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb161d9b700 1 --2- 172.21.15.26:0/3234616178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627f0f0 0x5602b628ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb16259c700 1 -- 172.21.15.26:0/3234616178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627f0f0 msgr2=0x5602b628ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:54.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb16259c700 1 --2- 172.21.15.26:0/3234616178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627f0f0 0x5602b628ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb16259c700 1 -- 172.21.15.26:0/3234616178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 msgr2=0x5602b628af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:54.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb16259c700 1 --2- 172.21.15.26:0/3234616178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b628af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.067 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb16259c700 1 -- 172.21.15.26:0/3234616178 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602b5fe5c60 con 0x5602b627e3f0 2023-12-01T01:05:54.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb162d9d700 1 --2- 172.21.15.26:0/3234616178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b628af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:54.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb16259c700 1 --2- 172.21.15.26:0/3234616178 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627e3f0 0x5602b628c8e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb154036030 tx=0x7fb1540269f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49c69655f256c922 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:54.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.057+0000 7fb149ffb700 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-12-01T01:05:54.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.058+0000 7fb149ffb700 1 -- 172.21.15.26:0/3234616178 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15402b030 con 0x5602b627e3f0 2023-12-01T01:05:54.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.058+0000 7fb174c27b80 1 -- 172.21.15.26:0/3234616178 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb15809d2a0 con 0x5602b627e3f0 2023-12-01T01:05:54.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.058+0000 7fb149ffb700 1 -- 172.21.15.26:0/3234616178 <== mon.2 v2:172.21.15.93:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb154040080 con 0x5602b627e3f0 2023-12-01T01:05:54.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.058+0000 7fb149ffb700 1 -- 172.21.15.26:0/3234616178 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb154034040 con 0x5602b627e3f0 2023-12-01T01:05:54.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.058+0000 7fb174c27b80 10 client.25439 fetch_fsmap learned FSMap version 26 2023-12-01T01:05:54.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.058+0000 7fb174c27b80 1 -- 172.21.15.26:0/3234616178 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5602b5ffb2b0 con 0x5602b627e3f0 2023-12-01T01:05:54.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.058+0000 7fb149ffb700 1 -- 172.21.15.26:0/3234616178 <== mon.2 v2:172.21.15.93:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb15809d2a0 con 0x5602b627e3f0 2023-12-01T01:05:54.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.058+0000 7fb149ffb700 1 -- 172.21.15.26:0/3234616178 <== mon.2 v2:172.21.15.93:3300/0 5 ==== fsmap(e 26) v1 ==== 7458+0+0 (secure 0 0 0) 0x7fb154037070 con 0x5602b627e3f0 2023-12-01T01:05:54.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.058+0000 7fb174c27b80 10 client.25439 fetch_fsmap finished waiting for FSMap version 26 2023-12-01T01:05:54.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.058+0000 7fb174c27b80 10 client.25439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:54.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.058+0000 7fb174c27b80 20 client.25439 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:54.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.058+0000 7fb174c27b80 1 --2- 172.21.15.26:0/3234616178 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5602b62e6340 0x5602b62e8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.068 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.058+0000 7fb174c27b80 4 client.25439 mds_command: new command op to 24509 tid=0[{"prefix": "damage ls"}] 2023-12-01T01:05:54.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.058+0000 7fb174c27b80 1 -- 172.21.15.26:0/3234616178 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5602b61c7d40 con 0x5602b62e6340 2023-12-01T01:05:54.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.058+0000 7fb161d9b700 1 --2- 172.21.15.26:0/3234616178 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5602b62e6340 0x5602b62e8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.059+0000 7fb149ffb700 10 client.25439 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:54.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.059+0000 7fb161d9b700 1 --2- 172.21.15.26:0/3234616178 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5602b62e6340 0x5602b62e8730 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9643cb962104c12 server_cookie=90f55d0ef58df392 in_seq=0 out_seq=0 2023-12-01T01:05:54.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.062+0000 7fb149ffb700 1 -- 172.21.15.26:0/3234616178 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5602b61c7d40 con 0x5602b62e6340 2023-12-01T01:05:54.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.062+0000 7fb149ffb700 10 client.25439 handle_command_reply: tid=0 2023-12-01T01:05:54.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.062+0000 7fb174c27b80 1 client.25439 shutdown 2023-12-01T01:05:54.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.062+0000 7fb174c27b80 1 -- 172.21.15.26:0/3234616178 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627e3f0 msgr2=0x5602b628c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:54.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.062+0000 7fb174c27b80 1 --2- 172.21.15.26:0/3234616178 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627e3f0 0x5602b628c8e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb154036030 tx=0x7fb1540269f0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.062+0000 7fb174c27b80 1 -- 172.21.15.26:0/3234616178 shutdown_connections 2023-12-01T01:05:54.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.062+0000 7fb174c27b80 1 --2- 172.21.15.26:0/3234616178 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x5602b62e6340 0x5602b62e8730 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.062+0000 7fb174c27b80 1 --2- 172.21.15.26:0/3234616178 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5602b627fa70 0x5602b628af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.062+0000 7fb174c27b80 1 --2- 172.21.15.26:0/3234616178 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x5602b627e3f0 0x5602b628c8e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.062+0000 7fb149ffb700 0 client.25439 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:54.069 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.062+0000 7fb174c27b80 1 --2- 172.21.15.26:0/3234616178 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x5602b627f0f0 0x5602b628ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.062+0000 7fb174c27b80 1 -- 172.21.15.26:0/3234616178 >> 172.21.15.26:0/3234616178 conn(0x5602b61dd0d0 msgr2=0x5602b6282370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:54.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.062+0000 7fb174c27b80 1 -- 172.21.15.26:0/3234616178 shutdown_connections 2023-12-01T01:05:54.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.062+0000 7fb174c27b80 1 -- 172.21.15.26:0/3234616178 wait complete. 2023-12-01T01:05:54.070 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.062+0000 7fb174c27b80 20 client.25439 trim_cache size 0 max 16384 2023-12-01T01:05:54.070 INFO:teuthology.orchestra.run.smithi026.stdout:[] 2023-12-01T01:05:54.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.063+0000 7fb168a97700 1 -- 172.21.15.26:0/3963491258 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb14c0a05a0 msgr2=0x7fb14c0a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:54.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.063+0000 7fb168a97700 1 --2- 172.21.15.26:0/3963491258 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb14c0a05a0 0x7fb14c0a2a60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb154000c00 tx=0x7fb154005fb0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.063+0000 7fb168a97700 1 -- 172.21.15.26:0/3963491258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1641020c0 msgr2=0x7fb164197190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:54.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.063+0000 7fb168a97700 1 --2- 172.21.15.26:0/3963491258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1641020c0 0x7fb164197190 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fb15800e9a0 tx=0x7fb15800ecb0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.063+0000 7fb168a97700 1 -- 172.21.15.26:0/3963491258 shutdown_connections 2023-12-01T01:05:54.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.063+0000 7fb168a97700 1 --2- 172.21.15.26:0/3963491258 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb14c0a05a0 0x7fb14c0a2a60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.063+0000 7fb168a97700 1 --2- 172.21.15.26:0/3963491258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb164102a60 0x7fb16419e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.063+0000 7fb168a97700 1 --2- 172.21.15.26:0/3963491258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb1640ff050 0x7fb164196c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.063+0000 7fb168a97700 1 --2- 172.21.15.26:0/3963491258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb1641020c0 0x7fb164197190 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.063+0000 7fb168a97700 1 -- 172.21.15.26:0/3963491258 >> 172.21.15.26:0/3963491258 conn(0x7fb1640fa960 msgr2=0x7fb1641055a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:54.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.063+0000 7fb168a97700 1 -- 172.21.15.26:0/3963491258 shutdown_connections 2023-12-01T01:05:54.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:54.063+0000 7fb168a97700 1 -- 172.21.15.26:0/3963491258 wait complete. 2023-12-01T01:05:54.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:53 smithi116 ceph-mon[103554]: pgmap v340: 97 pgs: 97 active+clean; 88 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.4 MiB/s wr, 60 op/s 2023-12-01T01:05:54.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:53 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/493137999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:05:54.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:53 smithi116 ceph-mon[103554]: daemon mds.h restarted 2023-12-01T01:05:54.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:53 smithi116 ceph-mon[103554]: osdmap e84: 12 total, 12 up, 12 in 2023-12-01T01:05:54.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:53 smithi093 ceph-mon[103327]: pgmap v340: 97 pgs: 97 active+clean; 88 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.4 MiB/s wr, 60 op/s 2023-12-01T01:05:54.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:53 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/493137999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:05:54.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:53 smithi093 ceph-mon[103327]: daemon mds.h restarted 2023-12-01T01:05:54.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:53 smithi093 ceph-mon[103327]: osdmap e84: 12 total, 12 up, 12 in 2023-12-01T01:05:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.275+0000 7f1cb58c9700 1 -- 172.21.15.26:0/2396857400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb0100e80 msgr2=0x7f1cb01012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:54.276 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.275+0000 7f1cb58c9700 1 --2- 172.21.15.26:0/2396857400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb0100e80 0x7f1cb01012e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f1ca40099c0 tx=0x7f1ca4009cd0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.275+0000 7f1cb58c9700 1 -- 172.21.15.26:0/2396857400 shutdown_connections 2023-12-01T01:05:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.275+0000 7f1cb58c9700 1 --2- 172.21.15.26:0/2396857400 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1cb0101820 0x7f1cb01080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.275+0000 7f1cb58c9700 1 --2- 172.21.15.26:0/2396857400 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cb00ffc90 0x7f1cb01000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.275+0000 7f1cb58c9700 1 --2- 172.21.15.26:0/2396857400 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb0100e80 0x7f1cb01012e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.275+0000 7f1cb58c9700 1 -- 172.21.15.26:0/2396857400 >> 172.21.15.26:0/2396857400 conn(0x7f1cb00fb1e0 msgr2=0x7f1cb00fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.275+0000 7f1cb58c9700 1 -- 172.21.15.26:0/2396857400 shutdown_connections 2023-12-01T01:05:54.277 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.275+0000 7f1cb58c9700 1 -- 172.21.15.26:0/2396857400 wait complete. 2023-12-01T01:05:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.276+0000 7f1cb58c9700 1 Processor -- start 2023-12-01T01:05:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.276+0000 7f1cb58c9700 1 -- start start 2023-12-01T01:05:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.276+0000 7f1cb58c9700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cb00ffc90 0x7f1cb0196c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.276+0000 7f1cb58c9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1cb0100e80 0x7f1cb0197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.276+0000 7f1cb58c9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb0101820 0x7f1cb0197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.276+0000 7f1cb58c9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0198650 con 0x7f1cb0101820 2023-12-01T01:05:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.276+0000 7f1cb58c9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb01987c0 con 0x7f1cb0100e80 2023-12-01T01:05:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.276+0000 7f1cb58c9700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb0198980 con 0x7f1cb00ffc90 2023-12-01T01:05:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.276+0000 7f1caf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb0101820 0x7f1cb0197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.276+0000 7f1cae7fc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1cb0100e80 0x7f1cb0197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.276+0000 7f1caf7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb0101820 0x7f1cb0197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56188/0 (socket says 172.21.15.26:56188) 2023-12-01T01:05:54.279 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.276+0000 7f1caf7fe700 1 -- 172.21.15.26:0/964043423 learned_addr learned my addr 172.21.15.26:0/964043423 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.276+0000 7f1caeffd700 1 --2- 172.21.15.26:0/964043423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cb00ffc90 0x7f1cb0196c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.277+0000 7f1caf7fe700 1 -- 172.21.15.26:0/964043423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cb00ffc90 msgr2=0x7f1cb0196c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.277+0000 7f1caf7fe700 1 --2- 172.21.15.26:0/964043423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cb00ffc90 0x7f1cb0196c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.277+0000 7f1caf7fe700 1 -- 172.21.15.26:0/964043423 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1cb0100e80 msgr2=0x7f1cb0197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.277+0000 7f1caf7fe700 1 --2- 172.21.15.26:0/964043423 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1cb0100e80 0x7f1cb0197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.277+0000 7f1caf7fe700 1 -- 172.21.15.26:0/964043423 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca40095f0 con 0x7f1cb0101820 2023-12-01T01:05:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.277+0000 7f1caeffd700 1 --2- 172.21.15.26:0/964043423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cb00ffc90 0x7f1cb0196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:05:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.277+0000 7f1caf7fe700 1 --2- 172.21.15.26:0/964043423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb0101820 0x7f1cb0197ff0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1ca800ef30 tx=0x7f1ca800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.277+0000 7f1cb48c7700 1 -- 172.21.15.26:0/964043423 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8018070 con 0x7f1cb0101820 2023-12-01T01:05:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.277+0000 7f1cb48c7700 1 -- 172.21.15.26:0/964043423 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1ca800f040 con 0x7f1cb0101820 2023-12-01T01:05:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.277+0000 7f1cb58c9700 1 -- 172.21.15.26:0/964043423 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb0198c00 con 0x7f1cb0101820 2023-12-01T01:05:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.277+0000 7f1cb48c7700 1 -- 172.21.15.26:0/964043423 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca800ce00 con 0x7f1cb0101820 2023-12-01T01:05:54.280 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.277+0000 7f1cb58c9700 1 -- 172.21.15.26:0/964043423 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb019f420 con 0x7f1cb0101820 2023-12-01T01:05:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.279+0000 7f1cb48c7700 1 -- 172.21.15.26:0/964043423 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f1ca8003a00 con 0x7f1cb0101820 2023-12-01T01:05:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.280+0000 7f1cb48c7700 1 --2- 172.21.15.26:0/964043423 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1c980a0520 0x7f1c980a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.280+0000 7f1cb48c7700 1 -- 172.21.15.26:0/964043423 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1ca80cb610 con 0x7f1cb0101820 2023-12-01T01:05:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.280+0000 7f1caeffd700 1 --2- 172.21.15.26:0/964043423 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1c980a0520 0x7f1c980a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.280+0000 7f1caeffd700 1 --2- 172.21.15.26:0/964043423 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1c980a0520 0x7f1c980a29e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0100ce0 tx=0x7f1ca0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cc1a59b80 1 Processor -- start 2023-12-01T01:05:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cc1a59b80 1 -- start start 2023-12-01T01:05:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cc1a59b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a4a90 0x55a47d7a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cc1a59b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a53f0 0x55a47d7a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cc1a59b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a62e0 0x55a47d7a6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cc1a59b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47d6f89b0 con 0x55a47d7a53f0 2023-12-01T01:05:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cc1a59b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47d6f6370 con 0x55a47d7a62e0 2023-12-01T01:05:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cc1a59b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47d6f1c60 con 0x55a47d7a4a90 2023-12-01T01:05:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cae7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a53f0 0x55a47d7a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cae7fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a53f0 0x55a47d7a5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56194/0 (socket says 172.21.15.26:56194) 2023-12-01T01:05:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cae7fc700 1 -- 172.21.15.26:0/3856320459 learned_addr learned my addr 172.21.15.26:0/3856320459 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1caf7fe700 1 --2- 172.21.15.26:0/3856320459 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a62e0 0x55a47d7a6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1caeffd700 1 --2- 172.21.15.26:0/3856320459 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a4a90 0x55a47d7a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cae7fc700 1 -- 172.21.15.26:0/3856320459 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a4a90 msgr2=0x55a47d7a4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cae7fc700 1 --2- 172.21.15.26:0/3856320459 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a4a90 0x55a47d7a4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cae7fc700 1 -- 172.21.15.26:0/3856320459 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a62e0 msgr2=0x55a47d7a6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cae7fc700 1 --2- 172.21.15.26:0/3856320459 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a62e0 0x55a47d7a6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cae7fc700 1 -- 172.21.15.26:0/3856320459 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a47d51fd80 con 0x55a47d7a53f0 2023-12-01T01:05:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1caf7fe700 1 --2- 172.21.15.26:0/3856320459 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a62e0 0x55a47d7a6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:54.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.281+0000 7f1cae7fc700 1 --2- 172.21.15.26:0/3856320459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a53f0 0x55a47d7a5d00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1ca40099c0 tx=0x7f1ca4005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df92c1a6b991207 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.282+0000 7f1c95ffb700 1 -- 172.21.15.26:0/3856320459 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca401d050 con 0x55a47d7a53f0 2023-12-01T01:05:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.282+0000 7f1c95ffb700 1 -- 172.21.15.26:0/3856320459 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1ca401e040 con 0x55a47d7a53f0 2023-12-01T01:05:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.282+0000 7f1c95ffb700 1 -- 172.21.15.26:0/3856320459 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca400ba70 con 0x55a47d7a53f0 2023-12-01T01:05:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.282+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/3856320459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a53f0 msgr2=0x55a47d7a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.282+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/3856320459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a53f0 0x55a47d7a5d00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1ca40099c0 tx=0x7f1ca4005ee0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.282+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/3856320459 shutdown_connections 2023-12-01T01:05:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.282+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/3856320459 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a62e0 0x55a47d7a6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.282+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/3856320459 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a4a90 0x55a47d7a4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.282+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/3856320459 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a53f0 0x55a47d7a5d00 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.282+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/3856320459 >> 172.21.15.26:0/3856320459 conn(0x55a47d700070 msgr2=0x55a47d79d040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.282+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/3856320459 shutdown_connections 2023-12-01T01:05:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.282+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/3856320459 wait complete. 2023-12-01T01:05:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.283+0000 7f1cc1a59b80 1 -- start start 2023-12-01T01:05:54.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.283+0000 7f1cc1a59b80 1 Processor -- start 2023-12-01T01:05:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.283+0000 7f1cc1a59b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d7ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.283+0000 7f1cc1a59b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a53f0 0x55a47d7aed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.283+0000 7f1cc1a59b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a62e0 0x55a47d7b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.283+0000 7f1cc1a59b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47d68e4b0 con 0x55a47d7a4a90 2023-12-01T01:05:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.283+0000 7f1cc1a59b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47d68e150 con 0x55a47d7a53f0 2023-12-01T01:05:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.283+0000 7f1cc1a59b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47d5758c0 con 0x55a47d7a62e0 2023-12-01T01:05:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.283+0000 7f1cc1a59b80 10 client.0 _ll_register_callbacks cb 0x55a47d5dba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.283+0000 7f1caeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d7ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.283+0000 7f1caeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d7ae7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56198/0 (socket says 172.21.15.26:56198) 2023-12-01T01:05:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.283+0000 7f1caeffd700 1 -- 172.21.15.26:0/2955713806 learned_addr learned my addr 172.21.15.26:0/2955713806 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.283+0000 7f1cae7fc700 1 --2- 172.21.15.26:0/2955713806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a53f0 0x55a47d7aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.284+0000 7f1caeffd700 1 -- 172.21.15.26:0/2955713806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a62e0 msgr2=0x55a47d7b5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.284+0000 7f1caeffd700 1 --2- 172.21.15.26:0/2955713806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a62e0 0x55a47d7b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.290 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.284+0000 7f1caeffd700 1 -- 172.21.15.26:0/2955713806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a53f0 msgr2=0x55a47d7aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.284+0000 7f1caeffd700 1 --2- 172.21.15.26:0/2955713806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a53f0 0x55a47d7aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.284+0000 7f1caeffd700 1 -- 172.21.15.26:0/2955713806 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb019f420 con 0x55a47d7a4a90 2023-12-01T01:05:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.284+0000 7f1caeffd700 1 --2- 172.21.15.26:0/2955713806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d7ae7e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00128a0 tx=0x7f1ca00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85c3bc07d3ce856b server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.284+0000 7f1c8effd700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.284+0000 7f1c8effd700 1 -- 172.21.15.26:0/2955713806 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca001f6c0 con 0x55a47d7a4a90 2023-12-01T01:05:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.284+0000 7f1c8effd700 1 -- 172.21.15.26:0/2955713806 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1ca0018070 con 0x55a47d7a4a90 2023-12-01T01:05:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.284+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/2955713806 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a47d71ccb0 con 0x55a47d7a4a90 2023-12-01T01:05:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.284+0000 7f1c8effd700 1 -- 172.21.15.26:0/2955713806 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ca001f820 con 0x55a47d7a4a90 2023-12-01T01:05:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.284+0000 7f1cc1a59b80 10 client.15813 fetch_fsmap learned FSMap version 26 2023-12-01T01:05:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.284+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/2955713806 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f1cb0108a20 con 0x55a47d7a4a90 2023-12-01T01:05:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.284+0000 7f1c8effd700 1 -- 172.21.15.26:0/2955713806 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55a47d71ccb0 con 0x55a47d7a4a90 2023-12-01T01:05:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.285+0000 7f1c8effd700 1 -- 172.21.15.26:0/2955713806 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 26) v1 ==== 7458+0+0 (secure 0 0 0) 0x7f1ca0029c60 con 0x55a47d7a4a90 2023-12-01T01:05:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.285+0000 7f1cc1a59b80 10 client.15813 fetch_fsmap finished waiting for FSMap version 26 2023-12-01T01:05:54.291 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.285+0000 7f1cc1a59b80 10 client.15813 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.285+0000 7f1cc1a59b80 20 client.15813 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.285+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/2955713806 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a47d7ba6f0 0x55a47d7bcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.285+0000 7f1cc1a59b80 4 client.15813 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:05:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.285+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/2955713806 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a47d76fdb0 con 0x55a47d7ba6f0 2023-12-01T01:05:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.285+0000 7f1cae7fc700 1 --2- 172.21.15.26:0/2955713806 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a47d7ba6f0 0x55a47d7bcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.285+0000 7f1c8effd700 10 client.15813 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:54.292 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.285+0000 7f1cae7fc700 1 --2- 172.21.15.26:0/2955713806 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a47d7ba6f0 0x55a47d7bcb10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b72890a8b3c5a57 server_cookie=6045db04934647cc in_seq=0 out_seq=0 2023-12-01T01:05:54.293 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.289+0000 7f1c8effd700 1 -- 172.21.15.26:0/2955713806 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55a47d76fdb0 con 0x55a47d7ba6f0 2023-12-01T01:05:54.293 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.289+0000 7f1c8effd700 10 client.15813 handle_command_reply: tid=0 2023-12-01T01:05:54.293 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.289+0000 7f1cc1a59b80 1 client.15813 shutdown 2023-12-01T01:05:54.293 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.289+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/2955713806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 msgr2=0x55a47d7ae7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:54.293 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.289+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/2955713806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d7ae7e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00128a0 tx=0x7f1ca00047c0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.293 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.289+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/2955713806 shutdown_connections 2023-12-01T01:05:54.293 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.289+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/2955713806 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a47d7ba6f0 0x55a47d7bcb10 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.293 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.290+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/2955713806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a62e0 0x55a47d7b5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.290+0000 7f1c8effd700 0 client.15813 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.290+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/2955713806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d7ae7e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.290+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/2955713806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a53f0 0x55a47d7aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.290+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/2955713806 >> 172.21.15.26:0/2955713806 conn(0x55a47d700070 msgr2=0x55a47d79b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.290+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/2955713806 shutdown_connections 2023-12-01T01:05:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.290+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/2955713806 wait complete. 2023-12-01T01:05:54.294 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.290+0000 7f1cc1a59b80 20 client.15813 trim_cache size 0 max 16384 2023-12-01T01:05:54.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:53 smithi026 ceph-mon[98801]: pgmap v340: 97 pgs: 97 active+clean; 88 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.4 MiB/s wr, 60 op/s 2023-12-01T01:05:54.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:53 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/493137999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:05:54.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:53 smithi026 ceph-mon[98801]: daemon mds.h restarted 2023-12-01T01:05:54.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:53 smithi026 ceph-mon[98801]: osdmap e84: 12 total, 12 up, 12 in 2023-12-01T01:05:54.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.304+0000 7f1cc1a59b80 1 Processor -- start 2023-12-01T01:05:54.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.304+0000 7f1cc1a59b80 1 -- start start 2023-12-01T01:05:54.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1cc1a59b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d7b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1cc1a59b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a53f0 0x55a47d7ade90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.317 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1cc1a59b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a62e0 0x55a47d79a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.317 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1cc1a59b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47d7937a0 con 0x55a47d7a4a90 2023-12-01T01:05:54.317 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1cc1a59b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47d7adc90 con 0x55a47d7a53f0 2023-12-01T01:05:54.317 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1cc1a59b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47d796500 con 0x55a47d7a62e0 2023-12-01T01:05:54.317 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1caeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d7b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.317 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1caeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d7b3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56206/0 (socket says 172.21.15.26:56206) 2023-12-01T01:05:54.317 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1caeffd700 1 -- 172.21.15.26:0/1308360382 learned_addr learned my addr 172.21.15.26:0/1308360382 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:54.318 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1cae7fc700 1 --2- 172.21.15.26:0/1308360382 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a53f0 0x55a47d7ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.318 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1caf7fe700 1 --2- 172.21.15.26:0/1308360382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a62e0 0x55a47d79a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.318 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1caeffd700 1 -- 172.21.15.26:0/1308360382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a62e0 msgr2=0x55a47d79a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:54.318 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1caeffd700 1 --2- 172.21.15.26:0/1308360382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a62e0 0x55a47d79a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.318 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1caeffd700 1 -- 172.21.15.26:0/1308360382 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a53f0 msgr2=0x55a47d7ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:54.318 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1caeffd700 1 --2- 172.21.15.26:0/1308360382 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a53f0 0x55a47d7ade90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.319 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1caeffd700 1 -- 172.21.15.26:0/1308360382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a47d508c00 con 0x55a47d7a4a90 2023-12-01T01:05:54.319 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1caf7fe700 1 --2- 172.21.15.26:0/1308360382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a62e0 0x55a47d79a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:05:54.319 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1caeffd700 1 --2- 172.21.15.26:0/1308360382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d7b3d10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0000c00 tx=0x7f1ca0009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c76d2dd084276eb server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:54.319 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1c967fc700 1 -- 172.21.15.26:0/1308360382 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca001b590 con 0x55a47d7a4a90 2023-12-01T01:05:54.319 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.305+0000 7f1c967fc700 1 -- 172.21.15.26:0/1308360382 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1ca0024070 con 0x55a47d7a4a90 2023-12-01T01:05:54.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.306+0000 7f1c967fc700 1 -- 172.21.15.26:0/1308360382 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca001bcf0 con 0x55a47d7a4a90 2023-12-01T01:05:54.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.306+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/1308360382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 msgr2=0x55a47d7b3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:54.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.306+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/1308360382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d7b3d10 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f1ca0000c00 tx=0x7f1ca0009350 comp rx=0 tx=0).stop 2023-12-01T01:05:54.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.306+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/1308360382 shutdown_connections 2023-12-01T01:05:54.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.306+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/1308360382 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a62e0 0x55a47d79a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.306+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/1308360382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d7b3d10 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.306+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/1308360382 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a53f0 0x55a47d7ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.306+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/1308360382 >> 172.21.15.26:0/1308360382 conn(0x55a47d700070 msgr2=0x55a47d7ad520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:54.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.306+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/1308360382 shutdown_connections 2023-12-01T01:05:54.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.306+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/1308360382 wait complete. 2023-12-01T01:05:54.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.306+0000 7f1cc1a59b80 1 -- start start 2023-12-01T01:05:54.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1cc1a59b80 1 Processor -- start 2023-12-01T01:05:54.322 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1cc1a59b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d8043f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.322 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1cc1a59b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a53f0 0x55a47d804930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.322 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1cc1a59b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a62e0 0x55a47d80b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.322 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1cc1a59b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47d80b9b0 con 0x55a47d7a4a90 2023-12-01T01:05:54.322 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1cc1a59b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47d80baf0 con 0x55a47d7a62e0 2023-12-01T01:05:54.322 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1cc1a59b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a47d80bcb0 con 0x55a47d7a53f0 2023-12-01T01:05:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1cc1a59b80 10 client.0 _ll_register_callbacks cb 0x7f1ca0012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1caeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d8043f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1caeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d8043f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56212/0 (socket says 172.21.15.26:56212) 2023-12-01T01:05:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1caeffd700 1 -- 172.21.15.26:0/3172082696 learned_addr learned my addr 172.21.15.26:0/3172082696 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1caf7fe700 1 --2- 172.21.15.26:0/3172082696 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a62e0 0x55a47d80b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1cae7fc700 1 --2- 172.21.15.26:0/3172082696 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a53f0 0x55a47d804930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.323 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1caeffd700 1 -- 172.21.15.26:0/3172082696 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a53f0 msgr2=0x55a47d804930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1caeffd700 1 --2- 172.21.15.26:0/3172082696 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a53f0 0x55a47d804930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1caeffd700 1 -- 172.21.15.26:0/3172082696 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a62e0 msgr2=0x55a47d80b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1caeffd700 1 --2- 172.21.15.26:0/3172082696 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a62e0 0x55a47d80b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1caeffd700 1 -- 172.21.15.26:0/3172082696 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb0108a20 con 0x55a47d7a4a90 2023-12-01T01:05:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.307+0000 7f1cae7fc700 1 --2- 172.21.15.26:0/3172082696 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a53f0 0x55a47d804930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:05:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1caeffd700 1 --2- 172.21.15.26:0/3172082696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d8043f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00205c0 tx=0x7f1ca00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63596db77b004bb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1c8effd700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:54.324 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1c8effd700 1 -- 172.21.15.26:0/3172082696 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca001bc70 con 0x55a47d7a4a90 2023-12-01T01:05:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1c8effd700 1 -- 172.21.15.26:0/3172082696 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f1ca0038070 con 0x55a47d7a4a90 2023-12-01T01:05:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/3172082696 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1ca401e040 con 0x55a47d7a4a90 2023-12-01T01:05:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1c8effd700 1 -- 172.21.15.26:0/3172082696 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1ca001bdd0 con 0x55a47d7a4a90 2023-12-01T01:05:54.325 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1cc1a59b80 10 client.15819 fetch_fsmap learned FSMap version 26 2023-12-01T01:05:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/3172082696 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a47d5461f0 con 0x55a47d7a4a90 2023-12-01T01:05:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1c8effd700 1 -- 172.21.15.26:0/3172082696 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f1ca401e040 con 0x55a47d7a4a90 2023-12-01T01:05:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1c8effd700 1 -- 172.21.15.26:0/3172082696 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 26) v1 ==== 7458+0+0 (secure 0 0 0) 0x7f1ca004e070 con 0x55a47d7a4a90 2023-12-01T01:05:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1cc1a59b80 10 client.15819 fetch_fsmap finished waiting for FSMap version 26 2023-12-01T01:05:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1cc1a59b80 10 client.15819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1cc1a59b80 20 client.15819 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:54.326 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/3172082696 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a47d80d2e0 0x55a47d80f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:54.327 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1cc1a59b80 4 client.15819 mds_command: new command op to 24509 tid=0[{"prefix": "flush journal"}] 2023-12-01T01:05:54.327 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/3172082696 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a47d6eace0 con 0x55a47d80d2e0 2023-12-01T01:05:54.327 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.308+0000 7f1cae7fc700 1 --2- 172.21.15.26:0/3172082696 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a47d80d2e0 0x55a47d80f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:54.327 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.309+0000 7f1c8effd700 10 client.15819 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:54.327 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:54.309+0000 7f1cae7fc700 1 --2- 172.21.15.26:0/3172082696 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a47d80d2e0 0x55a47d80f700 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a72f4d99886c236 server_cookie=51ee714cb2e9054 in_seq=0 out_seq=0 2023-12-01T01:05:55.076 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-12-01T01:05:55.123 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-12-01T01:05:55.149 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:54 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.93:6836/1672758793,v1:172.21.15.93:6837/1672758793] up:boot 2023-12-01T01:05:55.149 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:54 smithi026 ceph-mon[98801]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2023-12-01T01:05:55.149 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:54 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-01T01:05:55.149 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:54 smithi026 ceph-mon[98801]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:05:55.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:54 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.93:6836/1672758793,v1:172.21.15.93:6837/1672758793] up:boot 2023-12-01T01:05:55.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:54 smithi116 ceph-mon[103554]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2023-12-01T01:05:55.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:54 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-01T01:05:55.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:54 smithi116 ceph-mon[103554]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:05:55.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:54 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.93:6836/1672758793,v1:172.21.15.93:6837/1672758793] up:boot 2023-12-01T01:05:55.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:54 smithi093 ceph-mon[103327]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 2 up:standby-replay 7 up:standby 2023-12-01T01:05:55.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:54 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-01T01:05:55.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:54 smithi093 ceph-mon[103327]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:05:55.256 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.255+0000 7fd0693a1700 1 -- 172.21.15.26:0/1267901569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd064101810 msgr2=0x7fd0641080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.255+0000 7fd0693a1700 1 --2- 172.21.15.26:0/1267901569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd064101810 0x7fd0641080c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd05c0099c0 tx=0x7fd05c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:05:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.255+0000 7fd0693a1700 1 -- 172.21.15.26:0/1267901569 shutdown_connections 2023-12-01T01:05:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.255+0000 7fd0693a1700 1 --2- 172.21.15.26:0/1267901569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd064101810 0x7fd0641080c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.255+0000 7fd0693a1700 1 --2- 172.21.15.26:0/1267901569 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd0640ffc80 0x7fd0641000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.255+0000 7fd0693a1700 1 --2- 172.21.15.26:0/1267901569 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd064100e70 0x7fd0641012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.255+0000 7fd0693a1700 1 -- 172.21.15.26:0/1267901569 >> 172.21.15.26:0/1267901569 conn(0x7fd0640fb1f0 msgr2=0x7fd0640fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.255+0000 7fd0693a1700 1 -- 172.21.15.26:0/1267901569 shutdown_connections 2023-12-01T01:05:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.255+0000 7fd0693a1700 1 -- 172.21.15.26:0/1267901569 wait complete. 2023-12-01T01:05:55.257 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.256+0000 7fd0693a1700 1 Processor -- start 2023-12-01T01:05:55.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.256+0000 7fd0693a1700 1 -- start start 2023-12-01T01:05:55.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.256+0000 7fd0693a1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0640ffc80 0x7fd064198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:55.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.256+0000 7fd0693a1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd064100e70 0x7fd064199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:55.259 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.256+0000 7fd0693a1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd064101810 0x7fd0641a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.256+0000 7fd0693a1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0641a0850 con 0x7fd0640ffc80 2023-12-01T01:05:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.256+0000 7fd0693a1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0641a09c0 con 0x7fd064100e70 2023-12-01T01:05:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.256+0000 7fd0693a1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0641a0b80 con 0x7fd064101810 2023-12-01T01:05:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.256+0000 7fd062ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0640ffc80 0x7fd064198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.256+0000 7fd062ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0640ffc80 0x7fd064198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56226/0 (socket says 172.21.15.26:56226) 2023-12-01T01:05:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.256+0000 7fd062ffd700 1 -- 172.21.15.26:0/1649146184 learned_addr learned my addr 172.21.15.26:0/1649146184 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.256+0000 7fd0627fc700 1 --2- 172.21.15.26:0/1649146184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd064100e70 0x7fd064199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.257+0000 7fd0637fe700 1 --2- 172.21.15.26:0/1649146184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd064101810 0x7fd0641a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.257+0000 7fd062ffd700 1 -- 172.21.15.26:0/1649146184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd064101810 msgr2=0x7fd0641a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.257+0000 7fd062ffd700 1 --2- 172.21.15.26:0/1649146184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd064101810 0x7fd0641a0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.257+0000 7fd062ffd700 1 -- 172.21.15.26:0/1649146184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd064100e70 msgr2=0x7fd064199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.257+0000 7fd062ffd700 1 --2- 172.21.15.26:0/1649146184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd064100e70 0x7fd064199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.257+0000 7fd062ffd700 1 -- 172.21.15.26:0/1649146184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd05c0095f0 con 0x7fd0640ffc80 2023-12-01T01:05:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.257+0000 7fd0637fe700 1 --2- 172.21.15.26:0/1649146184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd064101810 0x7fd0641a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:05:55.260 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.257+0000 7fd0627fc700 1 --2- 172.21.15.26:0/1649146184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd064100e70 0x7fd064199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:55.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.257+0000 7fd062ffd700 1 --2- 172.21.15.26:0/1649146184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0640ffc80 0x7fd064198d10 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd05400efc0 tx=0x7fd05400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:55.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.257+0000 7fd05bfff700 1 -- 172.21.15.26:0/1649146184 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054018070 con 0x7fd0640ffc80 2023-12-01T01:05:55.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.257+0000 7fd05bfff700 1 -- 172.21.15.26:0/1649146184 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd05400f040 con 0x7fd0640ffc80 2023-12-01T01:05:55.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.257+0000 7fd0693a1700 1 -- 172.21.15.26:0/1649146184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0641a0e00 con 0x7fd0640ffc80 2023-12-01T01:05:55.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.257+0000 7fd05bfff700 1 -- 172.21.15.26:0/1649146184 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054004380 con 0x7fd0640ffc80 2023-12-01T01:05:55.261 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.257+0000 7fd0693a1700 1 -- 172.21.15.26:0/1649146184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0641a1220 con 0x7fd0640ffc80 2023-12-01T01:05:55.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.260+0000 7fd05bfff700 1 -- 172.21.15.26:0/1649146184 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fd054003a00 con 0x7fd0640ffc80 2023-12-01T01:05:55.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.261+0000 7fd05bfff700 1 --2- 172.21.15.26:0/1649146184 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd0500a0520 0x7fd0500a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:55.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.261+0000 7fd05bfff700 1 -- 172.21.15.26:0/1649146184 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd0540cb860 con 0x7fd0640ffc80 2023-12-01T01:05:55.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.261+0000 7fd0627fc700 1 --2- 172.21.15.26:0/1649146184 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd0500a0520 0x7fd0500a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:55.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.261+0000 7fd075531b80 1 Processor -- start 2023-12-01T01:05:55.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.261+0000 7fd075531b80 1 -- start start 2023-12-01T01:05:55.262 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.261+0000 7fd0627fc700 1 --2- 172.21.15.26:0/1649146184 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd0500a0520 0x7fd0500a29e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd04c011490 tx=0x7fd04c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:55.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd075531b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59035170 0x55cd590355b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:55.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd075531b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035af0 0x55cd59033ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:55.267 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd075531b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd590348f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:55.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd075531b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd58f8ba90 con 0x55cd59034470 2023-12-01T01:05:55.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd075531b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd58f89450 con 0x55cd59035af0 2023-12-01T01:05:55.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd075531b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd58f84d40 con 0x55cd59035170 2023-12-01T01:05:55.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd0637fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd590348f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:55.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd0637fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd590348f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56238/0 (socket says 172.21.15.26:56238) 2023-12-01T01:05:55.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd0637fe700 1 -- 172.21.15.26:0/704294968 learned_addr learned my addr 172.21.15.26:0/704294968 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:55.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd0627fc700 1 --2- 172.21.15.26:0/704294968 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035af0 0x55cd59033ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:55.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd062ffd700 1 --2- 172.21.15.26:0/704294968 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59035170 0x55cd590355b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:55.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd0637fe700 1 -- 172.21.15.26:0/704294968 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59035170 msgr2=0x55cd590355b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:55.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd0637fe700 1 --2- 172.21.15.26:0/704294968 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59035170 0x55cd590355b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:55.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd0637fe700 1 -- 172.21.15.26:0/704294968 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035af0 msgr2=0x55cd59033ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:55.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd0637fe700 1 --2- 172.21.15.26:0/704294968 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035af0 0x55cd59033ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:55.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd0637fe700 1 -- 172.21.15.26:0/704294968 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd58db2e60 con 0x55cd59034470 2023-12-01T01:05:55.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd0637fe700 1 --2- 172.21.15.26:0/704294968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd590348f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00b580 tx=0x7fd05c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611cd168d17ead90 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:55.268 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd0597fa700 1 -- 172.21.15.26:0/704294968 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c003a90 con 0x55cd59034470 2023-12-01T01:05:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd0597fa700 1 -- 172.21.15.26:0/704294968 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd05c01d040 con 0x55cd59034470 2023-12-01T01:05:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.262+0000 7fd0597fa700 1 -- 172.21.15.26:0/704294968 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c00bc50 con 0x55cd59034470 2023-12-01T01:05:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.263+0000 7fd075531b80 1 -- 172.21.15.26:0/704294968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 msgr2=0x55cd590348f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.263+0000 7fd075531b80 1 --2- 172.21.15.26:0/704294968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd590348f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd05c00b580 tx=0x7fd05c005ef0 comp rx=0 tx=0).stop 2023-12-01T01:05:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.263+0000 7fd075531b80 1 -- 172.21.15.26:0/704294968 shutdown_connections 2023-12-01T01:05:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.263+0000 7fd075531b80 1 --2- 172.21.15.26:0/704294968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd590348f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.263+0000 7fd075531b80 1 --2- 172.21.15.26:0/704294968 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59035170 0x55cd590355b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.263+0000 7fd075531b80 1 --2- 172.21.15.26:0/704294968 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035af0 0x55cd59033ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.263+0000 7fd075531b80 1 -- 172.21.15.26:0/704294968 >> 172.21.15.26:0/704294968 conn(0x55cd58f93150 msgr2=0x55cd5902e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.263+0000 7fd075531b80 1 -- 172.21.15.26:0/704294968 shutdown_connections 2023-12-01T01:05:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.263+0000 7fd075531b80 1 -- 172.21.15.26:0/704294968 wait complete. 2023-12-01T01:05:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.264+0000 7fd075531b80 1 -- start start 2023-12-01T01:05:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.264+0000 7fd075531b80 1 Processor -- start 2023-12-01T01:05:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.264+0000 7fd075531b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59034470 0x55cd5903d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:55.269 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.264+0000 7fd075531b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59035170 0x55cd5903dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:55.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.264+0000 7fd075531b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035af0 0x55cd59044f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:55.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.264+0000 7fd075531b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd58f21590 con 0x55cd59035170 2023-12-01T01:05:55.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.264+0000 7fd075531b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd58f21230 con 0x55cd59035af0 2023-12-01T01:05:55.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.264+0000 7fd075531b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd58e089a0 con 0x55cd59034470 2023-12-01T01:05:55.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.264+0000 7fd075531b80 10 client.0 _ll_register_callbacks cb 0x55cd58e6eb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:55.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.264+0000 7fd0627fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59035170 0x55cd5903dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:55.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.264+0000 7fd0637fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035af0 0x55cd59044f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:55.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.264+0000 7fd0627fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59035170 0x55cd5903dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56242/0 (socket says 172.21.15.26:56242) 2023-12-01T01:05:55.270 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.264+0000 7fd0627fc700 1 -- 172.21.15.26:0/1915308212 learned_addr learned my addr 172.21.15.26:0/1915308212 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.264+0000 7fd062ffd700 1 --2- 172.21.15.26:0/1915308212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59034470 0x55cd5903d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.265+0000 7fd0627fc700 1 -- 172.21.15.26:0/1915308212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59034470 msgr2=0x55cd5903d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.265+0000 7fd0627fc700 1 --2- 172.21.15.26:0/1915308212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59034470 0x55cd5903d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.265+0000 7fd0627fc700 1 -- 172.21.15.26:0/1915308212 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035af0 msgr2=0x55cd59044f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.265+0000 7fd0627fc700 1 --2- 172.21.15.26:0/1915308212 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035af0 0x55cd59044f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.265+0000 7fd0627fc700 1 -- 172.21.15.26:0/1915308212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd064108a10 con 0x55cd59035170 2023-12-01T01:05:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.265+0000 7fd0637fe700 1 --2- 172.21.15.26:0/1915308212 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035af0 0x55cd59044f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.265+0000 7fd0627fc700 1 --2- 172.21.15.26:0/1915308212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59035170 0x55cd5903dee0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0039b0 tx=0x7fd04c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7ac79d35a3641d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.265+0000 7fd04a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.265+0000 7fd04a7fc700 1 -- 172.21.15.26:0/1915308212 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c01fa50 con 0x55cd59035170 2023-12-01T01:05:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.265+0000 7fd04a7fc700 1 -- 172.21.15.26:0/1915308212 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd04c01fbb0 con 0x55cd59035170 2023-12-01T01:05:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.265+0000 7fd075531b80 1 -- 172.21.15.26:0/1915308212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd58fafd90 con 0x55cd59035170 2023-12-01T01:05:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.265+0000 7fd04a7fc700 1 -- 172.21.15.26:0/1915308212 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd04c01fdb0 con 0x55cd59035170 2023-12-01T01:05:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.265+0000 7fd075531b80 10 client.15831 fetch_fsmap learned FSMap version 26 2023-12-01T01:05:55.271 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.265+0000 7fd075531b80 1 -- 172.21.15.26:0/1915308212 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55cd58d9bce0 con 0x55cd59035170 2023-12-01T01:05:55.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.265+0000 7fd04a7fc700 1 -- 172.21.15.26:0/1915308212 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55cd58fafd90 con 0x55cd59035170 2023-12-01T01:05:55.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.265+0000 7fd04a7fc700 1 -- 172.21.15.26:0/1915308212 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 26) v1 ==== 7458+0+0 (secure 0 0 0) 0x7fd04c032530 con 0x55cd59035170 2023-12-01T01:05:55.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.266+0000 7fd075531b80 10 client.15831 fetch_fsmap finished waiting for FSMap version 26 2023-12-01T01:05:55.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.266+0000 7fd075531b80 10 client.15831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:55.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.266+0000 7fd075531b80 20 client.15831 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:55.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.266+0000 7fd075531b80 1 --2- 172.21.15.26:0/1915308212 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55cd590497d0 0x55cd5904bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:55.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.266+0000 7fd075531b80 4 client.15831 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:05:55.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.266+0000 7fd075531b80 1 -- 172.21.15.26:0/1915308212 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cd59002e90 con 0x55cd590497d0 2023-12-01T01:05:55.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.266+0000 7fd062ffd700 1 --2- 172.21.15.26:0/1915308212 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55cd590497d0 0x55cd5904bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:55.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.266+0000 7fd04a7fc700 10 client.15831 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:55.272 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:55.266+0000 7fd062ffd700 1 --2- 172.21.15.26:0/1915308212 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55cd590497d0 0x55cd5904bbf0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e244e868aae8b11 server_cookie=50f96b968a2876a9 in_seq=0 out_seq=0 2023-12-01T01:05:56.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:55 smithi116 ceph-mon[103554]: pgmap v342: 97 pgs: 97 active+clean; 88 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 732 KiB/s wr, 53 op/s 2023-12-01T01:05:56.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:55 smithi093 ceph-mon[103327]: pgmap v342: 97 pgs: 97 active+clean; 88 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 732 KiB/s wr, 53 op/s 2023-12-01T01:05:56.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:55 smithi026 ceph-mon[98801]: pgmap v342: 97 pgs: 97 active+clean; 88 MiB data, 570 MiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 732 KiB/s wr, 53 op/s 2023-12-01T01:05:57.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:56 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:05:57.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:56 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:05:57.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:56 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:05:57.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:56 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:05:57.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:56 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:05:57.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:56 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:05:57.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:56 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:05:57.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:56 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:05:57.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:56 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:05:57.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:56 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:05:57.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:56 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:05:57.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:56 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:05:57.894 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.892+0000 7f1c8effd700 1 -- 172.21.15.26:0/3172082696 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a47d6eace0 con 0x55a47d80d2e0 2023-12-01T01:05:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.892+0000 7f1c8effd700 10 client.15819 handle_command_reply: tid=0 2023-12-01T01:05:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.892+0000 7f1cc1a59b80 1 client.15819 shutdown 2023-12-01T01:05:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.892+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/3172082696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 msgr2=0x55a47d8043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.892+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/3172082696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d8043f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f1ca00205c0 tx=0x7f1ca00057f0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.892+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/3172082696 shutdown_connections 2023-12-01T01:05:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.892+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/3172082696 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55a47d80d2e0 0x55a47d80f700 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.892+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/3172082696 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55a47d7a62e0 0x55a47d80b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.892+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/3172082696 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55a47d7a4a90 0x55a47d8043f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.892+0000 7f1cc1a59b80 1 --2- 172.21.15.26:0/3172082696 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55a47d7a53f0 0x55a47d804930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.892+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/3172082696 >> 172.21.15.26:0/3172082696 conn(0x55a47d700070 msgr2=0x55a47d7ad520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.892+0000 7f1c8effd700 0 client.15819 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.893+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/3172082696 shutdown_connections 2023-12-01T01:05:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.893+0000 7f1cc1a59b80 1 -- 172.21.15.26:0/3172082696 wait complete. 2023-12-01T01:05:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.893+0000 7f1cc1a59b80 20 client.15819 trim_cache size 0 max 16384 2023-12-01T01:05:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:{ 2023-12-01T01:05:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "message": "", 2023-12-01T01:05:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "return_code": 0 2023-12-01T01:05:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:} 2023-12-01T01:05:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.893+0000 7f1cb58c9700 1 -- 172.21.15.26:0/964043423 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1c980a0520 msgr2=0x7f1c980a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.893+0000 7f1cb58c9700 1 --2- 172.21.15.26:0/964043423 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1c980a0520 0x7f1c980a29e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1cb0100ce0 tx=0x7f1ca0009260 comp rx=0 tx=0).stop 2023-12-01T01:05:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.893+0000 7f1cb58c9700 1 -- 172.21.15.26:0/964043423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb0101820 msgr2=0x7f1cb0197ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.893+0000 7f1cb58c9700 1 --2- 172.21.15.26:0/964043423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb0101820 0x7f1cb0197ff0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f1ca800ef30 tx=0x7f1ca800c3a0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.893+0000 7f1cb58c9700 1 -- 172.21.15.26:0/964043423 shutdown_connections 2023-12-01T01:05:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.893+0000 7f1cb58c9700 1 --2- 172.21.15.26:0/964043423 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f1c980a0520 0x7f1c980a29e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.893+0000 7f1cb58c9700 1 --2- 172.21.15.26:0/964043423 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1cb0101820 0x7f1cb0197ff0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.893+0000 7f1cb58c9700 1 --2- 172.21.15.26:0/964043423 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f1cb00ffc90 0x7f1cb0196c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.893+0000 7f1cb58c9700 1 --2- 172.21.15.26:0/964043423 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1cb0100e80 0x7f1cb0197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.893+0000 7f1cb58c9700 1 -- 172.21.15.26:0/964043423 >> 172.21.15.26:0/964043423 conn(0x7f1cb00fb1e0 msgr2=0x7f1cb00fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.894+0000 7f1cb58c9700 1 -- 172.21.15.26:0/964043423 shutdown_connections 2023-12-01T01:05:57.899 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:05:57.894+0000 7f1cb58c9700 1 -- 172.21.15.26:0/964043423 wait complete. 2023-12-01T01:05:57.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.894+0000 7fd04a7fc700 1 -- 172.21.15.26:0/1915308212 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55cd59002e90 con 0x55cd590497d0 2023-12-01T01:05:57.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.894+0000 7fd04a7fc700 10 client.15831 handle_command_reply: tid=0 2023-12-01T01:05:57.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.894+0000 7fd075531b80 1 client.15831 shutdown 2023-12-01T01:05:57.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.895+0000 7fd075531b80 1 -- 172.21.15.26:0/1915308212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59035170 msgr2=0x55cd5903dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:57.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.895+0000 7fd075531b80 1 --2- 172.21.15.26:0/1915308212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59035170 0x55cd5903dee0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd04c0039b0 tx=0x7fd04c0047c0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.900 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.895+0000 7fd075531b80 1 -- 172.21.15.26:0/1915308212 shutdown_connections 2023-12-01T01:05:57.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.895+0000 7fd075531b80 1 --2- 172.21.15.26:0/1915308212 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55cd590497d0 0x55cd5904bbf0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.895+0000 7fd075531b80 1 --2- 172.21.15.26:0/1915308212 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035af0 0x55cd59044f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.895+0000 7fd04a7fc700 0 client.15831 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:57.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.895+0000 7fd075531b80 1 --2- 172.21.15.26:0/1915308212 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59034470 0x55cd5903d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.901 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.895+0000 7fd075531b80 1 --2- 172.21.15.26:0/1915308212 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59035170 0x55cd5903dee0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.895+0000 7fd075531b80 1 -- 172.21.15.26:0/1915308212 >> 172.21.15.26:0/1915308212 conn(0x55cd58f93150 msgr2=0x55cd5902e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:57.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.895+0000 7fd075531b80 1 -- 172.21.15.26:0/1915308212 shutdown_connections 2023-12-01T01:05:57.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.895+0000 7fd075531b80 1 -- 172.21.15.26:0/1915308212 wait complete. 2023-12-01T01:05:57.902 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.895+0000 7fd075531b80 20 client.15831 trim_cache size 0 max 16384 2023-12-01T01:05:57.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.918+0000 7fd075531b80 1 Processor -- start 2023-12-01T01:05:57.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.918+0000 7fd075531b80 1 -- start start 2023-12-01T01:05:57.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd075531b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd59033ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:57.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd075531b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035170 0x55cd59042ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:57.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd075531b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59035af0 0x55cd590382f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:57.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd075531b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd5903d510 con 0x55cd59034470 2023-12-01T01:05:57.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd075531b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd59046be0 con 0x55cd59035170 2023-12-01T01:05:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd075531b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd5902eee0 con 0x55cd59035af0 2023-12-01T01:05:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd062ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd59033ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd062ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd59033ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56250/0 (socket says 172.21.15.26:56250) 2023-12-01T01:05:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd062ffd700 1 -- 172.21.15.26:0/782193087 learned_addr learned my addr 172.21.15.26:0/782193087 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd0637fe700 1 --2- 172.21.15.26:0/782193087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59035af0 0x55cd590382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd0627fc700 1 --2- 172.21.15.26:0/782193087 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035170 0x55cd59042ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd062ffd700 1 -- 172.21.15.26:0/782193087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59035af0 msgr2=0x55cd590382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd062ffd700 1 --2- 172.21.15.26:0/782193087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59035af0 0x55cd590382f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd062ffd700 1 -- 172.21.15.26:0/782193087 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035170 msgr2=0x55cd59042ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd062ffd700 1 --2- 172.21.15.26:0/782193087 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035170 0x55cd59042ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd062ffd700 1 -- 172.21.15.26:0/782193087 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd5903c9d0 con 0x55cd59034470 2023-12-01T01:05:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.919+0000 7fd062ffd700 1 --2- 172.21.15.26:0/782193087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd59033ee0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd0540c93c0 tx=0x7fd054009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c086f56ab6a7507 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.920+0000 7fd059ffb700 1 -- 172.21.15.26:0/782193087 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05409cf90 con 0x55cd59034470 2023-12-01T01:05:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.920+0000 7fd059ffb700 1 -- 172.21.15.26:0/782193087 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd0540a1140 con 0x55cd59034470 2023-12-01T01:05:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.920+0000 7fd059ffb700 1 -- 172.21.15.26:0/782193087 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054099620 con 0x55cd59034470 2023-12-01T01:05:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.920+0000 7fd075531b80 1 -- 172.21.15.26:0/782193087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 msgr2=0x55cd59033ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.920+0000 7fd075531b80 1 --2- 172.21.15.26:0/782193087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd59033ee0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd0540c93c0 tx=0x7fd054009f10 comp rx=0 tx=0).stop 2023-12-01T01:05:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.920+0000 7fd075531b80 1 -- 172.21.15.26:0/782193087 shutdown_connections 2023-12-01T01:05:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.920+0000 7fd075531b80 1 --2- 172.21.15.26:0/782193087 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59035af0 0x55cd590382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.920+0000 7fd075531b80 1 --2- 172.21.15.26:0/782193087 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd59033ee0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.920+0000 7fd075531b80 1 --2- 172.21.15.26:0/782193087 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035170 0x55cd59042ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.920+0000 7fd075531b80 1 -- 172.21.15.26:0/782193087 >> 172.21.15.26:0/782193087 conn(0x55cd58f93150 msgr2=0x55cd5903d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.920+0000 7fd075531b80 1 -- 172.21.15.26:0/782193087 shutdown_connections 2023-12-01T01:05:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.920+0000 7fd075531b80 1 -- 172.21.15.26:0/782193087 wait complete. 2023-12-01T01:05:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd075531b80 1 -- start start 2023-12-01T01:05:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd075531b80 1 Processor -- start 2023-12-01T01:05:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd075531b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd59041580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd075531b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59035170 0x55cd59041ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd075531b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035af0 0x55cd59042000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd075531b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd59043200 con 0x55cd59034470 2023-12-01T01:05:57.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd075531b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd5909b2a0 con 0x55cd59035af0 2023-12-01T01:05:57.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd075531b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd5909b3e0 con 0x55cd59035170 2023-12-01T01:05:57.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd075531b80 10 client.0 _ll_register_callbacks cb 0x7fd04c004620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:57.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd062ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd59041580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:57.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd062ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd59041580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56256/0 (socket says 172.21.15.26:56256) 2023-12-01T01:05:57.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd062ffd700 1 -- 172.21.15.26:0/21801293 learned_addr learned my addr 172.21.15.26:0/21801293 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:57.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd0627fc700 1 --2- 172.21.15.26:0/21801293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59035170 0x55cd59041ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:57.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd0637fe700 1 --2- 172.21.15.26:0/21801293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035af0 0x55cd59042000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:57.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd062ffd700 1 -- 172.21.15.26:0/21801293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59035170 msgr2=0x55cd59041ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:57.932 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd062ffd700 1 --2- 172.21.15.26:0/21801293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59035170 0x55cd59041ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd062ffd700 1 -- 172.21.15.26:0/21801293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035af0 msgr2=0x55cd59042000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:57.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.921+0000 7fd062ffd700 1 --2- 172.21.15.26:0/21801293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035af0 0x55cd59042000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd062ffd700 1 -- 172.21.15.26:0/21801293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0641a1220 con 0x55cd59034470 2023-12-01T01:05:57.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd062ffd700 1 --2- 172.21.15.26:0/21801293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd59041580 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd054098e60 tx=0x7fd054003e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9cfc19ae63952a server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:57.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd04a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:05:57.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd04a7fc700 1 -- 172.21.15.26:0/21801293 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0540972a0 con 0x55cd59034470 2023-12-01T01:05:57.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd04a7fc700 1 -- 172.21.15.26:0/21801293 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fd05409cf90 con 0x55cd59034470 2023-12-01T01:05:57.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd075531b80 1 -- 172.21.15.26:0/21801293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd05c01d040 con 0x55cd59034470 2023-12-01T01:05:57.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd04a7fc700 1 -- 172.21.15.26:0/21801293 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd054098650 con 0x55cd59034470 2023-12-01T01:05:57.933 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd075531b80 10 client.15837 fetch_fsmap learned FSMap version 27 2023-12-01T01:05:57.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd075531b80 1 -- 172.21.15.26:0/21801293 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55cd58dd92d0 con 0x55cd59034470 2023-12-01T01:05:57.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd04a7fc700 1 -- 172.21.15.26:0/21801293 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fd05c01d040 con 0x55cd59034470 2023-12-01T01:05:57.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd04a7fc700 1 -- 172.21.15.26:0/21801293 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd0540acb90 con 0x55cd59034470 2023-12-01T01:05:57.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd075531b80 10 client.15837 fetch_fsmap finished waiting for FSMap version 27 2023-12-01T01:05:57.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd075531b80 10 client.15837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:57.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd075531b80 20 client.15837 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:57.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd075531b80 1 --2- 172.21.15.26:0/21801293 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55cd5909ca60 0x55cd5909ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:57.934 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd075531b80 4 client.15837 mds_command: new command op to 24509 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-12-01T01:05:57.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.922+0000 7fd075531b80 1 -- 172.21.15.26:0/21801293 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55cd58f7ddc0 con 0x55cd5909ca60 2023-12-01T01:05:57.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.923+0000 7fd0627fc700 1 --2- 172.21.15.26:0/21801293 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55cd5909ca60 0x55cd5909ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:57.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.923+0000 7fd0627fc700 1 --2- 172.21.15.26:0/21801293 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55cd5909ca60 0x55cd5909ee80 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3bc2986bda6db94 server_cookie=6e55833226dc3bdf in_seq=0 out_seq=0 2023-12-01T01:05:57.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.923+0000 7fd04a7fc700 10 client.15837 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:57.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.924+0000 7fd04a7fc700 1 -- 172.21.15.26:0/21801293 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55cd58f7ddc0 con 0x55cd5909ca60 2023-12-01T01:05:57.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.924+0000 7fd04a7fc700 10 client.15837 handle_command_reply: tid=0 2023-12-01T01:05:57.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.924+0000 7fd075531b80 1 client.15837 shutdown 2023-12-01T01:05:57.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.924+0000 7fd075531b80 1 -- 172.21.15.26:0/21801293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 msgr2=0x55cd59041580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:57.935 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.924+0000 7fd075531b80 1 --2- 172.21.15.26:0/21801293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd59041580 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fd054098e60 tx=0x7fd054003e00 comp rx=0 tx=0).stop 2023-12-01T01:05:57.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.924+0000 7fd075531b80 1 -- 172.21.15.26:0/21801293 shutdown_connections 2023-12-01T01:05:57.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.924+0000 7fd075531b80 1 --2- 172.21.15.26:0/21801293 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55cd5909ca60 0x55cd5909ee80 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.924+0000 7fd075531b80 1 --2- 172.21.15.26:0/21801293 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55cd59035af0 0x55cd59042000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.924+0000 7fd04a7fc700 0 client.15837 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:57.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.924+0000 7fd075531b80 1 --2- 172.21.15.26:0/21801293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cd59034470 0x55cd59041580 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.924+0000 7fd075531b80 1 --2- 172.21.15.26:0/21801293 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55cd59035170 0x55cd59041ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.924+0000 7fd075531b80 1 -- 172.21.15.26:0/21801293 >> 172.21.15.26:0/21801293 conn(0x55cd58f93150 msgr2=0x55cd5903d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:57.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.924+0000 7fd075531b80 1 -- 172.21.15.26:0/21801293 shutdown_connections 2023-12-01T01:05:57.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.924+0000 7fd075531b80 1 -- 172.21.15.26:0/21801293 wait complete. 2023-12-01T01:05:57.936 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.924+0000 7fd075531b80 20 client.15837 trim_cache size 0 max 16384 2023-12-01T01:05:57.937 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:05:57.937 INFO:teuthology.orchestra.run.smithi026.stdout: "return_code": 0, 2023-12-01T01:05:57.937 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_tag": "66638425-8d59-4f7e-97c6-28c2e46b24ad", 2023-12-01T01:05:57.938 INFO:teuthology.orchestra.run.smithi026.stdout: "mode": "asynchronous" 2023-12-01T01:05:57.938 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:05:57.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.925+0000 7fd0693a1700 1 -- 172.21.15.26:0/1649146184 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd0500a0520 msgr2=0x7fd0500a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:57.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.925+0000 7fd0693a1700 1 --2- 172.21.15.26:0/1649146184 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd0500a0520 0x7fd0500a29e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd04c011490 tx=0x7fd04c009260 comp rx=0 tx=0).stop 2023-12-01T01:05:57.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.925+0000 7fd0693a1700 1 -- 172.21.15.26:0/1649146184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0640ffc80 msgr2=0x7fd064198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:57.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.925+0000 7fd0693a1700 1 --2- 172.21.15.26:0/1649146184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0640ffc80 0x7fd064198d10 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd05400efc0 tx=0x7fd05400c3a0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.925+0000 7fd0693a1700 1 -- 172.21.15.26:0/1649146184 shutdown_connections 2023-12-01T01:05:57.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.925+0000 7fd0693a1700 1 --2- 172.21.15.26:0/1649146184 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fd0500a0520 0x7fd0500a29e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.940 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.925+0000 7fd0693a1700 1 --2- 172.21.15.26:0/1649146184 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fd064101810 0x7fd0641a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.925+0000 7fd0693a1700 1 --2- 172.21.15.26:0/1649146184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0640ffc80 0x7fd064198d10 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.925+0000 7fd0693a1700 1 --2- 172.21.15.26:0/1649146184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd064100e70 0x7fd064199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:57.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.925+0000 7fd0693a1700 1 -- 172.21.15.26:0/1649146184 >> 172.21.15.26:0/1649146184 conn(0x7fd0640fb1f0 msgr2=0x7fd064067f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:57.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.925+0000 7fd0693a1700 1 -- 172.21.15.26:0/1649146184 shutdown_connections 2023-12-01T01:05:57.941 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:57.925+0000 7fd0693a1700 1 -- 172.21.15.26:0/1649146184 wait complete. 2023-12-01T01:05:57.941 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-01T01:05:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.117+0000 7f8df5db6700 1 -- 172.21.15.26:0/1212267887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8df01018b0 msgr2=0x7f8df0108140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.117+0000 7f8df5db6700 1 --2- 172.21.15.26:0/1212267887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8df01018b0 0x7f8df0108140 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009990 tx=0x7f8de0009ca0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.117+0000 7f8df5db6700 1 -- 172.21.15.26:0/1212267887 shutdown_connections 2023-12-01T01:05:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.117+0000 7f8df5db6700 1 --2- 172.21.15.26:0/1212267887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8df01018b0 0x7f8df0108140 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.117+0000 7f8df5db6700 1 --2- 172.21.15.26:0/1212267887 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8df01001e0 0x7f8df0100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.117+0000 7f8df5db6700 1 --2- 172.21.15.26:0/1212267887 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8df0100ef0 0x7f8df0101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.117+0000 7f8df5db6700 1 -- 172.21.15.26:0/1212267887 >> 172.21.15.26:0/1212267887 conn(0x7f8df00fa9b0 msgr2=0x7f8df00fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.118+0000 7f8df5db6700 1 -- 172.21.15.26:0/1212267887 shutdown_connections 2023-12-01T01:05:58.119 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.118+0000 7f8df5db6700 1 -- 172.21.15.26:0/1212267887 wait complete. 2023-12-01T01:05:58.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.118+0000 7f8df5db6700 1 Processor -- start 2023-12-01T01:05:58.121 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8df5db6700 1 -- start start 2023-12-01T01:05:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8df5db6700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8df01001e0 0x7f8df0194950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8df5db6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8df0100ef0 0x7f8df0194e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8df5db6700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8df01018b0 0x7f8df019bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8df5db6700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df019c4d0 con 0x7f8df01001e0 2023-12-01T01:05:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8df5db6700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df019c610 con 0x7f8df0100ef0 2023-12-01T01:05:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8df5db6700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df019c7a0 con 0x7f8df01018b0 2023-12-01T01:05:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8def7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8df01001e0 0x7f8df0194950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8def7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8df01001e0 0x7f8df0194950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56270/0 (socket says 172.21.15.26:56270) 2023-12-01T01:05:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8def7fe700 1 -- 172.21.15.26:0/2311790126 learned_addr learned my addr 172.21.15.26:0/2311790126 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8deeffd700 1 --2- 172.21.15.26:0/2311790126 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8df0100ef0 0x7f8df0194e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8deffff700 1 --2- 172.21.15.26:0/2311790126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8df01018b0 0x7f8df019bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8def7fe700 1 -- 172.21.15.26:0/2311790126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8df01018b0 msgr2=0x7f8df019bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8def7fe700 1 --2- 172.21.15.26:0/2311790126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8df01018b0 0x7f8df019bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8def7fe700 1 -- 172.21.15.26:0/2311790126 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8df0100ef0 msgr2=0x7f8df0194e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:58.122 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8def7fe700 1 --2- 172.21.15.26:0/2311790126 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8df0100ef0 0x7f8df0194e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8def7fe700 1 -- 172.21.15.26:0/2311790126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de00095f0 con 0x7f8df01001e0 2023-12-01T01:05:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.119+0000 7f8def7fe700 1 --2- 172.21.15.26:0/2311790126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8df01001e0 0x7f8df0194950 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8de80123f0 tx=0x7f8de800ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.120+0000 7f8decff9700 1 -- 172.21.15.26:0/2311790126 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de801c070 con 0x7f8df01001e0 2023-12-01T01:05:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.120+0000 7f8df5db6700 1 -- 172.21.15.26:0/2311790126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df019ca20 con 0x7f8df01001e0 2023-12-01T01:05:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.120+0000 7f8decff9700 1 -- 172.21.15.26:0/2311790126 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8de8013040 con 0x7f8df01001e0 2023-12-01T01:05:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.120+0000 7f8decff9700 1 -- 172.21.15.26:0/2311790126 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de800d3c0 con 0x7f8df01001e0 2023-12-01T01:05:58.123 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.120+0000 7f8df5db6700 1 -- 172.21.15.26:0/2311790126 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df019cf80 con 0x7f8df01001e0 2023-12-01T01:05:58.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.122+0000 7f8decff9700 1 -- 172.21.15.26:0/2311790126 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f8de800b9a0 con 0x7f8df01001e0 2023-12-01T01:05:58.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.122+0000 7f8decff9700 1 --2- 172.21.15.26:0/2311790126 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8ddc0a0520 0x7f8ddc0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.123+0000 7f8deeffd700 1 --2- 172.21.15.26:0/2311790126 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8ddc0a0520 0x7f8ddc0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.123+0000 7f8decff9700 1 -- 172.21.15.26:0/2311790126 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8de80cfd10 con 0x7f8df01001e0 2023-12-01T01:05:58.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.123+0000 7f8deeffd700 1 --2- 172.21.15.26:0/2311790126 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8ddc0a0520 0x7f8ddc0a29e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8df00fff00 tx=0x7f8dd800d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:58.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.123+0000 7f8e01f46b80 1 Processor -- start 2023-12-01T01:05:58.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.123+0000 7f8e01f46b80 1 -- start start 2023-12-01T01:05:58.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.123+0000 7f8e01f46b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5c0f0 0x55559dd5c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.123+0000 7f8e01f46b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5ca70 0x55559dd5ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.123+0000 7f8e01f46b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5b3f0 0x55559dd5b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.123+0000 7f8e01f46b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559dcb2a10 con 0x55559dd5b3f0 2023-12-01T01:05:58.125 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.123+0000 7f8e01f46b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559dcb03d0 con 0x55559dd5ca70 2023-12-01T01:05:58.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.123+0000 7f8e01f46b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559dcabcc0 con 0x55559dd5c0f0 2023-12-01T01:05:58.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.123+0000 7f8deeffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5ca70 0x55559dd5ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.123+0000 7f8deffff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5b3f0 0x55559dd5b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.123+0000 7f8def7fe700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5c0f0 0x55559dd5c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.123+0000 7f8deeffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5ca70 0x55559dd5ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:47018/0 (socket says 172.21.15.26:47018) 2023-12-01T01:05:58.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.123+0000 7f8deeffd700 1 -- 172.21.15.26:0/2729119397 learned_addr learned my addr 172.21.15.26:0/2729119397 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:58.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.124+0000 7f8deeffd700 1 -- 172.21.15.26:0/2729119397 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5c0f0 msgr2=0x55559dd5c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:58.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.124+0000 7f8deeffd700 1 --2- 172.21.15.26:0/2729119397 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5c0f0 0x55559dd5c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.124+0000 7f8deeffd700 1 -- 172.21.15.26:0/2729119397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5b3f0 msgr2=0x55559dd5b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:58.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.124+0000 7f8deeffd700 1 --2- 172.21.15.26:0/2729119397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5b3f0 0x55559dd5b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.124+0000 7f8deeffd700 1 -- 172.21.15.26:0/2729119397 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55559dad9de0 con 0x55559dd5ca70 2023-12-01T01:05:58.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.124+0000 7f8def7fe700 1 --2- 172.21.15.26:0/2729119397 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5c0f0 0x55559dd5c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:58.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.124+0000 7f8deeffd700 1 --2- 172.21.15.26:0/2729119397 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5ca70 0x55559dd5ae60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8012d90 tx=0x7f8dd8015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb9e4a9cbbf3bc9e server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:58.126 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.124+0000 7f8de5ffb700 1 -- 172.21.15.26:0/2729119397 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8010040 con 0x55559dd5ca70 2023-12-01T01:05:58.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.124+0000 7f8de5ffb700 1 -- 172.21.15.26:0/2729119397 <== mon.2 v2:172.21.15.93:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8dd8018da0 con 0x55559dd5ca70 2023-12-01T01:05:58.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.124+0000 7f8de5ffb700 1 -- 172.21.15.26:0/2729119397 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8022700 con 0x55559dd5ca70 2023-12-01T01:05:58.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.125+0000 7f8e01f46b80 1 -- 172.21.15.26:0/2729119397 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5ca70 msgr2=0x55559dd5ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:58.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.125+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/2729119397 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5ca70 0x55559dd5ae60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8012d90 tx=0x7f8dd8015000 comp rx=0 tx=0).stop 2023-12-01T01:05:58.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.125+0000 7f8e01f46b80 1 -- 172.21.15.26:0/2729119397 shutdown_connections 2023-12-01T01:05:58.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.125+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/2729119397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5b3f0 0x55559dd5b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.125+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/2729119397 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5c0f0 0x55559dd5c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.125+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/2729119397 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5ca70 0x55559dd5ae60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.131 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.125+0000 7f8e01f46b80 1 -- 172.21.15.26:0/2729119397 >> 172.21.15.26:0/2729119397 conn(0x55559dcba0d0 msgr2=0x55559dd55940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:58.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.125+0000 7f8e01f46b80 1 -- 172.21.15.26:0/2729119397 shutdown_connections 2023-12-01T01:05:58.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.125+0000 7f8e01f46b80 1 -- 172.21.15.26:0/2729119397 wait complete. 2023-12-01T01:05:58.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.125+0000 7f8e01f46b80 1 -- start start 2023-12-01T01:05:58.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8e01f46b80 1 Processor -- start 2023-12-01T01:05:58.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8e01f46b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5b3f0 0x55559dd649a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8e01f46b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5c0f0 0x55559dd64ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8e01f46b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5ca70 0x55559dd6bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8e01f46b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559dc48510 con 0x55559dd5b3f0 2023-12-01T01:05:58.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8e01f46b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559dc481b0 con 0x55559dd5ca70 2023-12-01T01:05:58.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8e01f46b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559db2f920 con 0x55559dd5c0f0 2023-12-01T01:05:58.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8e01f46b80 10 client.0 _ll_register_callbacks cb 0x55559db95a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:58.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8def7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5b3f0 0x55559dd649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8deeffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5c0f0 0x55559dd64ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8deffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5ca70 0x55559dd6bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.132 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8def7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5b3f0 0x55559dd649a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56284/0 (socket says 172.21.15.26:56284) 2023-12-01T01:05:58.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8deeffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5c0f0 0x55559dd64ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.26:48516/0 (socket says 172.21.15.26:48516) 2023-12-01T01:05:58.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8deffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5ca70 0x55559dd6bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:47026/0 (socket says 172.21.15.26:47026) 2023-12-01T01:05:58.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8def7fe700 1 -- 172.21.15.26:0/2028985437 learned_addr learned my addr 172.21.15.26:0/2028985437 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:58.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8deffff700 1 -- 172.21.15.26:0/2028985437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5c0f0 msgr2=0x55559dd64ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:58.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8deffff700 1 --2- 172.21.15.26:0/2028985437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5c0f0 0x55559dd64ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8deffff700 1 -- 172.21.15.26:0/2028985437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5b3f0 msgr2=0x55559dd649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:58.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8deffff700 1 --2- 172.21.15.26:0/2028985437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5b3f0 0x55559dd649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8deffff700 1 -- 172.21.15.26:0/2028985437 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df019cf80 con 0x55559dd5ca70 2023-12-01T01:05:58.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8deeffd700 1 --2- 172.21.15.26:0/2028985437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5c0f0 0x55559dd64ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:58.133 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8deffff700 1 --2- 172.21.15.26:0/2028985437 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5ca70 0x55559dd6bf20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8de000b750 tx=0x7f8de0005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fdff79b327442ed server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:58.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.126+0000 7f8dceffd700 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-12-01T01:05:58.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.127+0000 7f8dceffd700 1 -- 172.21.15.26:0/2028985437 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de001d070 con 0x55559dd5ca70 2023-12-01T01:05:58.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.127+0000 7f8e01f46b80 1 -- 172.21.15.26:0/2028985437 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55559dcd6d10 con 0x55559dd5ca70 2023-12-01T01:05:58.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.127+0000 7f8dceffd700 1 -- 172.21.15.26:0/2028985437 <== mon.2 v2:172.21.15.93:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8de00056c0 con 0x55559dd5ca70 2023-12-01T01:05:58.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.127+0000 7f8dceffd700 1 -- 172.21.15.26:0/2028985437 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8de000beb0 con 0x55559dd5ca70 2023-12-01T01:05:58.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.127+0000 7f8e01f46b80 10 client.25487 fetch_fsmap learned FSMap version 27 2023-12-01T01:05:58.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.127+0000 7f8e01f46b80 1 -- 172.21.15.26:0/2028985437 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f8dd8012a40 con 0x55559dd5ca70 2023-12-01T01:05:58.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.127+0000 7f8dceffd700 1 -- 172.21.15.26:0/2028985437 <== mon.2 v2:172.21.15.93:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55559dcd6d10 con 0x55559dd5ca70 2023-12-01T01:05:58.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.127+0000 7f8dceffd700 1 -- 172.21.15.26:0/2028985437 <== mon.2 v2:172.21.15.93:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8de000f990 con 0x55559dd5ca70 2023-12-01T01:05:58.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.127+0000 7f8e01f46b80 10 client.25487 fetch_fsmap finished waiting for FSMap version 27 2023-12-01T01:05:58.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.127+0000 7f8e01f46b80 10 client.25487 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:58.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.127+0000 7f8e01f46b80 20 client.25487 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:58.134 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.127+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/2028985437 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55559dd70740 0x55559dd72b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.127+0000 7f8e01f46b80 4 client.25487 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:05:58.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.127+0000 7f8e01f46b80 1 -- 172.21.15.26:0/2028985437 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55559dd29e10 con 0x55559dd70740 2023-12-01T01:05:58.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.127+0000 7f8def7fe700 1 --2- 172.21.15.26:0/2028985437 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55559dd70740 0x55559dd72b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.128+0000 7f8dceffd700 10 client.25487 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:58.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.128+0000 7f8def7fe700 1 --2- 172.21.15.26:0/2028985437 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55559dd70740 0x55559dd72b60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5f4d03d3f56200d server_cookie=8897327cda8ca53 in_seq=0 out_seq=0 2023-12-01T01:05:58.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.128+0000 7f8dceffd700 1 -- 172.21.15.26:0/2028985437 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55559dd29e10 con 0x55559dd70740 2023-12-01T01:05:58.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.128+0000 7f8dceffd700 10 client.25487 handle_command_reply: tid=0 2023-12-01T01:05:58.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.128+0000 7f8e01f46b80 1 client.25487 shutdown 2023-12-01T01:05:58.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.129+0000 7f8e01f46b80 1 -- 172.21.15.26:0/2028985437 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5ca70 msgr2=0x55559dd6bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:58.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.129+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/2028985437 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5ca70 0x55559dd6bf20 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8de000b750 tx=0x7f8de0005270 comp rx=0 tx=0).stop 2023-12-01T01:05:58.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.129+0000 7f8e01f46b80 1 -- 172.21.15.26:0/2028985437 shutdown_connections 2023-12-01T01:05:58.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.129+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/2028985437 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55559dd70740 0x55559dd72b60 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.129+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/2028985437 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5ca70 0x55559dd6bf20 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.129+0000 7f8dceffd700 0 client.25487 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:58.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.129+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/2028985437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5b3f0 0x55559dd649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.135 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.129+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/2028985437 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5c0f0 0x55559dd64ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.129+0000 7f8e01f46b80 1 -- 172.21.15.26:0/2028985437 >> 172.21.15.26:0/2028985437 conn(0x55559dcba0d0 msgr2=0x55559dd550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:58.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.129+0000 7f8e01f46b80 1 -- 172.21.15.26:0/2028985437 shutdown_connections 2023-12-01T01:05:58.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.129+0000 7f8e01f46b80 1 -- 172.21.15.26:0/2028985437 wait complete. 2023-12-01T01:05:58.136 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.129+0000 7f8e01f46b80 20 client.25487 trim_cache size 0 max 16384 2023-12-01T01:05:58.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.146+0000 7f8e01f46b80 1 Processor -- start 2023-12-01T01:05:58.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.146+0000 7f8e01f46b80 1 -- start start 2023-12-01T01:05:58.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.146+0000 7f8e01f46b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5b3f0 0x55559dd5ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.146+0000 7f8e01f46b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5c0f0 0x55559dd69ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.146+0000 7f8e01f46b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5ca70 0x55559dd5f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.146+0000 7f8e01f46b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559dd56c30 con 0x55559dd5c0f0 2023-12-01T01:05:58.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.146+0000 7f8e01f46b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559dd29e10 con 0x55559dd5b3f0 2023-12-01T01:05:58.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.146+0000 7f8e01f46b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559dd63e50 con 0x55559dd5ca70 2023-12-01T01:05:58.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.146+0000 7f8deeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5c0f0 0x55559dd69ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.146+0000 7f8deeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5c0f0 0x55559dd69ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56294/0 (socket says 172.21.15.26:56294) 2023-12-01T01:05:58.149 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.146+0000 7f8deeffd700 1 -- 172.21.15.26:0/590430834 learned_addr learned my addr 172.21.15.26:0/590430834 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:58.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.146+0000 7f8def7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5b3f0 0x55559dd5ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.146+0000 7f8deffff700 1 --2- 172.21.15.26:0/590430834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5ca70 0x55559dd5f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.147+0000 7f8deeffd700 1 -- 172.21.15.26:0/590430834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5ca70 msgr2=0x55559dd5f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:58.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.147+0000 7f8deeffd700 1 --2- 172.21.15.26:0/590430834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5ca70 0x55559dd5f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.147+0000 7f8deeffd700 1 -- 172.21.15.26:0/590430834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5b3f0 msgr2=0x55559dd5ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:58.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.147+0000 7f8deeffd700 1 --2- 172.21.15.26:0/590430834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5b3f0 0x55559dd5ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.147+0000 7f8deeffd700 1 -- 172.21.15.26:0/590430834 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55559dac2c60 con 0x55559dd5c0f0 2023-12-01T01:05:58.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.147+0000 7f8def7fe700 1 --2- 172.21.15.26:0/590430834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5b3f0 0x55559dd5ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:05:58.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.147+0000 7f8deeffd700 1 --2- 172.21.15.26:0/590430834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5c0f0 0x55559dd69ed0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8012d30 tx=0x7f8dd800b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c742d03449de27e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:58.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.147+0000 7f8de67fc700 1 -- 172.21.15.26:0/590430834 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8016710 con 0x55559dd5c0f0 2023-12-01T01:05:58.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.147+0000 7f8de67fc700 1 -- 172.21.15.26:0/590430834 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8dd8016d50 con 0x55559dd5c0f0 2023-12-01T01:05:58.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.147+0000 7f8de67fc700 1 -- 172.21.15.26:0/590430834 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd802ae70 con 0x55559dd5c0f0 2023-12-01T01:05:58.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.148+0000 7f8e01f46b80 1 -- 172.21.15.26:0/590430834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5c0f0 msgr2=0x55559dd69ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:58.150 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.148+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/590430834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5c0f0 0x55559dd69ed0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8012d30 tx=0x7f8dd800b770 comp rx=0 tx=0).stop 2023-12-01T01:05:58.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.148+0000 7f8e01f46b80 1 -- 172.21.15.26:0/590430834 shutdown_connections 2023-12-01T01:05:58.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.148+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/590430834 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5ca70 0x55559dd5f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.148+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/590430834 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5b3f0 0x55559dd5ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.148+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/590430834 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5c0f0 0x55559dd69ed0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.148+0000 7f8e01f46b80 1 -- 172.21.15.26:0/590430834 >> 172.21.15.26:0/590430834 conn(0x55559dcba0d0 msgr2=0x55559dd649a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:58.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.148+0000 7f8e01f46b80 1 -- 172.21.15.26:0/590430834 shutdown_connections 2023-12-01T01:05:58.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.148+0000 7f8e01f46b80 1 -- 172.21.15.26:0/590430834 wait complete. 2023-12-01T01:05:58.151 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.148+0000 7f8e01f46b80 1 -- start start 2023-12-01T01:05:58.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.148+0000 7f8e01f46b80 1 Processor -- start 2023-12-01T01:05:58.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8e01f46b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5b3f0 0x55559ddba460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8e01f46b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5c0f0 0x55559ddba9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8e01f46b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5ca70 0x55559ddc1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.154 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8e01f46b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559ddc1c40 con 0x55559dd5c0f0 2023-12-01T01:05:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8e01f46b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559ddc1d80 con 0x55559dd5b3f0 2023-12-01T01:05:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8e01f46b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55559ddc1f40 con 0x55559dd5ca70 2023-12-01T01:05:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8e01f46b80 10 client.0 _ll_register_callbacks cb 0x7f8de000bc30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:05:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8def7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5b3f0 0x55559ddba460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8def7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5b3f0 0x55559ddba460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:47036/0 (socket says 172.21.15.26:47036) 2023-12-01T01:05:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8deeffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5c0f0 0x55559ddba9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8def7fe700 1 -- 172.21.15.26:0/626284002 learned_addr learned my addr 172.21.15.26:0/626284002 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:05:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8deffff700 1 --2- 172.21.15.26:0/626284002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5ca70 0x55559ddc1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8def7fe700 1 -- 172.21.15.26:0/626284002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5ca70 msgr2=0x55559ddc1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8def7fe700 1 --2- 172.21.15.26:0/626284002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5ca70 0x55559ddc1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8def7fe700 1 -- 172.21.15.26:0/626284002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5c0f0 msgr2=0x55559ddba9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:05:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8def7fe700 1 --2- 172.21.15.26:0/626284002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5c0f0 0x55559ddba9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8def7fe700 1 -- 172.21.15.26:0/626284002 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df019ca20 con 0x55559dd5b3f0 2023-12-01T01:05:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8def7fe700 1 --2- 172.21.15.26:0/626284002 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5b3f0 0x55559ddba460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8de8000f80 tx=0x7f8de80991d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55bd37f71c56f0f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:05:58.155 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8dceffd700 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-12-01T01:05:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8dceffd700 1 -- 172.21.15.26:0/626284002 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de80a5590 con 0x55559dd5b3f0 2023-12-01T01:05:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8dceffd700 1 -- 172.21.15.26:0/626284002 <== mon.2 v2:172.21.15.93:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8de80a1120 con 0x55559dd5b3f0 2023-12-01T01:05:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.149+0000 7f8e01f46b80 1 -- 172.21.15.26:0/626284002 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8dd8018da0 con 0x55559dd5b3f0 2023-12-01T01:05:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.150+0000 7f8dceffd700 1 -- 172.21.15.26:0/626284002 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8de809b950 con 0x55559dd5b3f0 2023-12-01T01:05:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.150+0000 7f8e01f46b80 10 client.25493 fetch_fsmap learned FSMap version 27 2023-12-01T01:05:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.150+0000 7f8e01f46b80 1 -- 172.21.15.26:0/626284002 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55559dad9de0 con 0x55559dd5b3f0 2023-12-01T01:05:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.150+0000 7f8dceffd700 1 -- 172.21.15.26:0/626284002 <== mon.2 v2:172.21.15.93:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8de8080080 con 0x55559dd5b3f0 2023-12-01T01:05:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.150+0000 7f8dceffd700 1 -- 172.21.15.26:0/626284002 <== mon.2 v2:172.21.15.93:3300/0 5 ==== fsmap(e 27) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f8de809d810 con 0x55559dd5b3f0 2023-12-01T01:05:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.150+0000 7f8e01f46b80 10 client.25493 fetch_fsmap finished waiting for FSMap version 27 2023-12-01T01:05:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.150+0000 7f8e01f46b80 10 client.25493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:05:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.150+0000 7f8e01f46b80 20 client.25493 populate_metadata read hostname 'smithi026' 2023-12-01T01:05:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.150+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/626284002 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55559ddc38d0 0x55559ddc5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:05:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.150+0000 7f8e01f46b80 4 client.25493 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-01T01:05:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.150+0000 7f8e01f46b80 1 -- 172.21.15.26:0/626284002 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55559dca4d40 con 0x55559ddc38d0 2023-12-01T01:05:58.156 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.150+0000 7f8deeffd700 1 --2- 172.21.15.26:0/626284002 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55559ddc38d0 0x55559ddc5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:05:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.151+0000 7f8deeffd700 1 --2- 172.21.15.26:0/626284002 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55559ddc38d0 0x55559ddc5cf0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a7a7fc6d6ce2e86 server_cookie=edecd3487696f2a5 in_seq=0 out_seq=0 2023-12-01T01:05:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.151+0000 7f8dceffd700 10 client.25493 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.151+0000 7f8dceffd700 1 -- 172.21.15.26:0/626284002 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+267 (crc 0 0 0) 0x55559dca4d40 con 0x55559ddc38d0 2023-12-01T01:05:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.151+0000 7f8dceffd700 10 client.25493 handle_command_reply: tid=0 2023-12-01T01:05:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.151+0000 7f8e01f46b80 1 client.25493 shutdown 2023-12-01T01:05:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.151+0000 7f8e01f46b80 1 -- 172.21.15.26:0/626284002 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5b3f0 msgr2=0x55559ddba460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.151+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/626284002 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5b3f0 0x55559ddba460 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8de8000f80 tx=0x7f8de80991d0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.151+0000 7f8e01f46b80 1 -- 172.21.15.26:0/626284002 shutdown_connections 2023-12-01T01:05:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.151+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/626284002 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55559ddc38d0 0x55559ddc5cf0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.151+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/626284002 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55559dd5ca70 0x55559ddc1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.151+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/626284002 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55559dd5b3f0 0x55559ddba460 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.151+0000 7f8dceffd700 0 client.25493 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:05:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.151+0000 7f8e01f46b80 1 --2- 172.21.15.26:0/626284002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55559dd5c0f0 0x55559ddba9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.151+0000 7f8e01f46b80 1 -- 172.21.15.26:0/626284002 >> 172.21.15.26:0/626284002 conn(0x55559dcba0d0 msgr2=0x55559dd64940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:58.157 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.151+0000 7f8e01f46b80 1 -- 172.21.15.26:0/626284002 shutdown_connections 2023-12-01T01:05:58.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.152+0000 7f8e01f46b80 1 -- 172.21.15.26:0/626284002 wait complete. 2023-12-01T01:05:58.158 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.152+0000 7f8e01f46b80 20 client.25493 trim_cache size 0 max 16384 2023-12-01T01:05:58.158 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:05:58.158 INFO:teuthology.orchestra.run.smithi026.stdout: "status": "scrub active (407 inodes in the stack)", 2023-12-01T01:05:58.158 INFO:teuthology.orchestra.run.smithi026.stdout: "scrubs": { 2023-12-01T01:05:58.158 INFO:teuthology.orchestra.run.smithi026.stdout: "66638425-8d59-4f7e-97c6-28c2e46b24ad": { 2023-12-01T01:05:58.158 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/", 2023-12-01T01:05:58.158 INFO:teuthology.orchestra.run.smithi026.stdout: "tag": "66638425-8d59-4f7e-97c6-28c2e46b24ad", 2023-12-01T01:05:58.158 INFO:teuthology.orchestra.run.smithi026.stdout: "options": "recursive,force" 2023-12-01T01:05:58.158 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:05:58.158 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:05:58.158 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:05:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.152+0000 7f8df5db6700 1 -- 172.21.15.26:0/2311790126 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8ddc0a0520 msgr2=0x7f8ddc0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.152+0000 7f8df5db6700 1 --2- 172.21.15.26:0/2311790126 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8ddc0a0520 0x7f8ddc0a29e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8df00fff00 tx=0x7f8dd800d040 comp rx=0 tx=0).stop 2023-12-01T01:05:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.153+0000 7f8df5db6700 1 -- 172.21.15.26:0/2311790126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8df01001e0 msgr2=0x7f8df0194950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:05:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.153+0000 7f8df5db6700 1 --2- 172.21.15.26:0/2311790126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8df01001e0 0x7f8df0194950 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8de80123f0 tx=0x7f8de800ff90 comp rx=0 tx=0).stop 2023-12-01T01:05:58.159 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.153+0000 7f8df5db6700 1 -- 172.21.15.26:0/2311790126 shutdown_connections 2023-12-01T01:05:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.153+0000 7f8df5db6700 1 --2- 172.21.15.26:0/2311790126 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8ddc0a0520 0x7f8ddc0a29e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.153+0000 7f8df5db6700 1 --2- 172.21.15.26:0/2311790126 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8df01018b0 0x7f8df019bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.153+0000 7f8df5db6700 1 --2- 172.21.15.26:0/2311790126 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8df01001e0 0x7f8df0194950 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.153+0000 7f8df5db6700 1 --2- 172.21.15.26:0/2311790126 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8df0100ef0 0x7f8df0194e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:05:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.153+0000 7f8df5db6700 1 -- 172.21.15.26:0/2311790126 >> 172.21.15.26:0/2311790126 conn(0x7f8df00fa9b0 msgr2=0x7f8df00fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:05:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.153+0000 7f8df5db6700 1 -- 172.21.15.26:0/2311790126 shutdown_connections 2023-12-01T01:05:58.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:05:58.153+0000 7f8df5db6700 1 -- 172.21.15.26:0/2311790126 wait complete. 2023-12-01T01:05:58.166 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:57 smithi026 ceph-mon[98801]: pgmap v343: 97 pgs: 97 active+clean; 92 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 723 KiB/s wr, 49 op/s 2023-12-01T01:05:58.166 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:57 smithi026 ceph-mon[98801]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:05:58.167 INFO:tasks.cephfs.filesystem:scrub status for tag:66638425-8d59-4f7e-97c6-28c2e46b24ad - {'path': '/', 'tag': '66638425-8d59-4f7e-97c6-28c2e46b24ad', 'options': 'recursive,force'} 2023-12-01T01:05:58.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:57 smithi116 ceph-mon[103554]: pgmap v343: 97 pgs: 97 active+clean; 92 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 723 KiB/s wr, 49 op/s 2023-12-01T01:05:58.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:57 smithi116 ceph-mon[103554]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:05:58.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:57 smithi093 ceph-mon[103327]: pgmap v343: 97 pgs: 97 active+clean; 92 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 723 KiB/s wr, 49 op/s 2023-12-01T01:05:58.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:57 smithi093 ceph-mon[103327]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:05:58.685 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.178+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf8 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/00-INDEX auth{0=1} v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b31600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cf8:[<0x10000000cf7/00-INDEX v2>,<0x10000000203/gpio v1965>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000cf8:[<0x10000000cf7/00-INDEX v2>,<0x10000000203/gpio v1965>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.685 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.179+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cfa [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/consumer.txt auth{0=1} v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b31b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cfa:[<0x10000000cf7/consumer.txt v6>,<0x10000000203/gpio v1965>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000cfa:[<0x10000000cf7/consumer.txt v6>,<0x10000000203/gpio v1965>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.685 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.179+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cfc [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/gpio-legacy.txt auth{0=1} v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b32100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cfc:[<0x10000000cf7/gpio-legacy.txt v10>,<0x10000000203/gpio v1965>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000cfc:[<0x10000000cf7/gpio-legacy.txt v10>,<0x10000000203/gpio v1965>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.685 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.180+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cfe [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/sysfs.txt auth{0=1} v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b32680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cfe:[<0x10000000cf7/sysfs.txt v14>,<0x10000000203/gpio v1965>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000cfe:[<0x10000000cf7/sysfs.txt v14>,<0x10000000203/gpio v1965>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.685 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.180+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cf9 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/board.txt auth{0=1} v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b32c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cf9:[<0x10000000cf7/board.txt v4>,<0x10000000203/gpio v1965>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000cf9:[<0x10000000cf7/board.txt v4>,<0x10000000203/gpio v1965>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.685 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.181+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000df2 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/sentelic.txt auth{0=1} v54 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b33700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000df2:[<0x10000000dd7/sentelic.txt v54>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000df2:[<0x10000000dd7/sentelic.txt v54>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.685 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.181+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000cfb [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/driver.txt auth{0=1} v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b33180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000cfb:[<0x10000000cf7/driver.txt v8>,<0x10000000203/gpio v1965>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000cfb:[<0x10000000cf7/driver.txt v8>,<0x10000000203/gpio v1965>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.685 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.182+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de2 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/event-codes.txt auth{0=1} v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b38000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de2:[<0x10000000dd7/event-codes.txt v22>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000de2:[<0x10000000dd7/event-codes.txt v22>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.685 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.183+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de5 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gameport-programming.txt auth{0=1} v28 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b38580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de5:[<0x10000000dd7/gameport-programming.txt v28>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000de5:[<0x10000000dd7/gameport-programming.txt v28>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.685 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.183+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de4 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gamepad.txt auth{0=1} v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b38b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de4:[<0x10000000dd7/gamepad.txt v26>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000de4:[<0x10000000dd7/gamepad.txt v26>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.685 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.184+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dec [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick-parport.txt auth{0=1} v42 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b39080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dec:[<0x10000000dd7/joystick-parport.txt v42>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000dec:[<0x10000000dd7/joystick-parport.txt v42>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.686 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.185+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000deb [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick-api.txt auth{0=1} v40 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b39600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000deb:[<0x10000000dd7/joystick-api.txt v40>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000deb:[<0x10000000dd7/joystick-api.txt v40>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.686 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.187+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de1 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/elantech.txt auth{0=1} v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b3a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de1:[<0x10000000dd7/elantech.txt v20>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000de1:[<0x10000000dd7/elantech.txt v20>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.686 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.187+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000df3 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/shape.fig auth{0=1} v56 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b39b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000df3:[<0x10000000dd7/shape.fig v56>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000df3:[<0x10000000dd7/shape.fig v56>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.686 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.188+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000df1 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/rotary-encoder.txt auth{0=1} v52 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b3a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000df1:[<0x10000000dd7/rotary-encoder.txt v52>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000df1:[<0x10000000dd7/rotary-encoder.txt v52>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.686 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.188+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de6 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gpio-tilt.txt auth{0=1} v30 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b3ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de6:[<0x10000000dd7/gpio-tilt.txt v30>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000de6:[<0x10000000dd7/gpio-tilt.txt v30>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.686 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.189+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ddc [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/bcm5974.txt auth{0=1} v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b3b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ddc:[<0x10000000dd7/bcm5974.txt v10>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000ddc:[<0x10000000dd7/bcm5974.txt v10>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.686 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.190+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de7 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/iforce-protocol.txt auth{0=1} v32 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b3b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de7:[<0x10000000dd7/iforce-protocol.txt v32>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000de7:[<0x10000000dd7/iforce-protocol.txt v32>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.686 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.190+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de0 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/edt-ft5x06.txt auth{0=1} v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b42000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de0:[<0x10000000dd7/edt-ft5x06.txt v18>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000de0:[<0x10000000dd7/edt-ft5x06.txt v18>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.686 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.190+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dee [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/multi-touch-protocol.txt auth{0=1} v46 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b42580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dee:[<0x10000000dd7/multi-touch-protocol.txt v46>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000dee:[<0x10000000dd7/multi-touch-protocol.txt v46>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.686 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.192+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000df4 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/walkera0701.txt auth{0=1} v58 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b42b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000df4:[<0x10000000dd7/walkera0701.txt v58>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000df4:[<0x10000000dd7/walkera0701.txt v58>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.686 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.192+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ddf [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cs461x.txt auth{0=1} v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b43080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ddf:[<0x10000000dd7/cs461x.txt v16>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000ddf:[<0x10000000dd7/cs461x.txt v16>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.686 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.192+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dda [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/appletouch.txt auth{0=1} v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b43600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dda:[<0x10000000dd7/appletouch.txt v6>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000dda:[<0x10000000dd7/appletouch.txt v6>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.687 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.192+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd8 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/alps.txt auth{0=1} v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b43b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd8:[<0x10000000dd7/alps.txt v2>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000dd8:[<0x10000000dd7/alps.txt v2>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.687 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.194+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dde [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cma3000_d0x.txt auth{0=1} v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b44100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dde:[<0x10000000dd7/cma3000_d0x.txt v14>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000dde:[<0x10000000dd7/cma3000_d0x.txt v14>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.687 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.194+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de3 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/ff.txt auth{0=1} v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b44680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de3:[<0x10000000dd7/ff.txt v24>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000de3:[<0x10000000dd7/ff.txt v24>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.687 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.195+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000def [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/notifier.txt auth{0=1} v48 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b44c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000def:[<0x10000000dd7/notifier.txt v48>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000def:[<0x10000000dd7/notifier.txt v48>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.687 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.195+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de8 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/input-programming.txt auth{0=1} v34 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b45180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de8:[<0x10000000dd7/input-programming.txt v34>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000de8:[<0x10000000dd7/input-programming.txt v34>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.687 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.196+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000df5 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/xpad.txt auth{0=1} v60 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b45700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000df5:[<0x10000000dd7/xpad.txt v60>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000df5:[<0x10000000dd7/xpad.txt v60>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.687 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.196+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000df6 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/yealink.txt auth{0=1} v62 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b4c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000df6:[<0x10000000dd7/yealink.txt v62>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000df6:[<0x10000000dd7/yealink.txt v62>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.687 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.197+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd9 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/amijoy.txt auth{0=1} v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b4c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd9:[<0x10000000dd7/amijoy.txt v4>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000dd9:[<0x10000000dd7/amijoy.txt v4>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.687 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.197+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000de9 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/input.txt auth{0=1} v36 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b4cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000de9:[<0x10000000dd7/input.txt v36>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000de9:[<0x10000000dd7/input.txt v36>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.687 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.198+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ddd [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cd32.txt auth{0=1} v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b4d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ddd:[<0x10000000dd7/cd32.txt v12>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000ddd:[<0x10000000dd7/cd32.txt v12>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.687 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.198+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ded [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick.txt auth{0=1} v44 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b4d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ded:[<0x10000000dd7/joystick.txt v44>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000ded:[<0x10000000dd7/joystick.txt v44>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.687 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.199+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dea [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/interactive.fig auth{0=1} v38 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b4db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dea:[<0x10000000dd7/interactive.fig v38>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000dea:[<0x10000000dd7/interactive.fig v38>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.687 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.200+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000ddb [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/atarikbd.txt auth{0=1} v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b4e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000ddb:[<0x10000000dd7/atarikbd.txt v8>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000ddb:[<0x10000000dd7/atarikbd.txt v8>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.687 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.201+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000df0 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/ntrig.txt auth{0=1} v50 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b4e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000df0:[<0x10000000dd7/ntrig.txt v50>,<0x10000000203/input v1967>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000df0:[<0x10000000dd7/ntrig.txt v50>,<0x10000000203/input v1967>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.688 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.202+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001016 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/tty.txt auth{0=1} v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b4ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001016:[<0x1000000100e/tty.txt v16>,<0x10000000203/serial v1969>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001016:[<0x1000000100e/tty.txt v16>,<0x10000000203/serial v1969>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.688 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.202+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001011 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/driver auth{0=1} v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b4f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001011:[<0x1000000100e/driver v6>,<0x10000000203/serial v1969>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001011:[<0x1000000100e/driver v6>,<0x10000000203/serial v1969>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.688 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.203+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000100f [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/00-INDEX auth{0=1} v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b4f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000100f:[<0x1000000100e/00-INDEX v2>,<0x10000000203/serial v1969>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x1000000100f:[<0x1000000100e/00-INDEX v2>,<0x10000000203/serial v1969>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.688 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.204+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001014 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/rocket.txt auth{0=1} v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b58000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001014:[<0x1000000100e/rocket.txt v12>,<0x10000000203/serial v1969>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001014:[<0x1000000100e/rocket.txt v12>,<0x10000000203/serial v1969>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.688 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.204+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001013 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/n_gsm.txt auth{0=1} v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b58580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001013:[<0x1000000100e/n_gsm.txt v10>,<0x10000000203/serial v1969>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001013:[<0x1000000100e/n_gsm.txt v10>,<0x10000000203/serial v1969>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.688 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.205+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001015 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/serial-rs485.txt auth{0=1} v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b58b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001015:[<0x1000000100e/serial-rs485.txt v14>,<0x10000000203/serial v1969>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001015:[<0x1000000100e/serial-rs485.txt v14>,<0x10000000203/serial v1969>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.688 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.206+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001010 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/README.cycladesZ auth{0=1} v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b59080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001010:[<0x1000000100e/README.cycladesZ v4>,<0x10000000203/serial v1969>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001010:[<0x1000000100e/README.cycladesZ v4>,<0x10000000203/serial v1969>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.688 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.206+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001012 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/moxa-smartio auth{0=1} v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b59600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001012:[<0x1000000100e/moxa-smartio v8>,<0x10000000203/serial v1969>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001012:[<0x1000000100e/moxa-smartio v8>,<0x10000000203/serial v1969>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.688 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.207+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000108e [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timekeeping.txt auth{0=1} v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b59b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000108e:[<0x10000001085/timekeeping.txt v18>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x1000000108e:[<0x10000001085/timekeeping.txt v18>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.688 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.208+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000108b [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hpet.txt auth{0=1} v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b5a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000108b:[<0x10000001085/hpet.txt v12>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x1000000108b:[<0x10000001085/hpet.txt v12>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.688 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.208+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001087 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/00-INDEX auth{0=1} v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b5a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001087:[<0x10000001085/00-INDEX v4>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001087:[<0x10000001085/00-INDEX v4>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.688 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.208+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000108a [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/highres.txt auth{0=1} v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b5ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000108a:[<0x10000001085/highres.txt v10>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x1000000108a:[<0x10000001085/highres.txt v10>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.688 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.210+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000108f [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timer_stats.txt auth{0=1} v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b5b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000108f:[<0x10000001085/timer_stats.txt v20>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x1000000108f:[<0x10000001085/timer_stats.txt v20>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.689 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.210+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000108d [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hrtimers.txt auth{0=1} v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b5b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000108d:[<0x10000001085/hrtimers.txt v16>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x1000000108d:[<0x10000001085/hrtimers.txt v16>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.689 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.210+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001088 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/Makefile auth{0=1} v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b62000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001088:[<0x10000001085/Makefile v6>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001088:[<0x10000001085/Makefile v6>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.689 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.211+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001090 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timers-howto.txt auth{0=1} v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b62b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001090:[<0x10000001085/timers-howto.txt v22>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001090:[<0x10000001085/timers-howto.txt v22>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.689 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.211+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000108c [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hpet_example.c auth{0=1} v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b62580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000108c:[<0x10000001085/hpet_example.c v14>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x1000000108c:[<0x10000001085/hpet_example.c v14>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.689 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.213+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001086 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/.gitignore auth{0=1} v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b63080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001086:[<0x10000001085/.gitignore v2>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001086:[<0x10000001085/.gitignore v2>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.689 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.214+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001089 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/NO_HZ.txt auth{0=1} v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b63600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001089:[<0x10000001085/NO_HZ.txt v8>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001089:[<0x10000001085/NO_HZ.txt v8>,<0x10000000203/timers v1971>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.689 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.215+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001019 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh/new-machine.txt auth{0=1} v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b63b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001019:[<0x10000001018/new-machine.txt v2>,<0x10000000203/sh v1973>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001019:[<0x10000001018/new-machine.txt v2>,<0x10000000203/sh v1973>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.689 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.215+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000101a [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh/register-banks.txt auth{0=1} v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b64100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000101a:[<0x10000001018/register-banks.txt v4>,<0x10000000203/sh v1973>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x1000000101a:[<0x10000001018/register-banks.txt v4>,<0x10000000203/sh v1973>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.689 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.215+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001193 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/zero-page.txt auth{0=1} v46 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b64680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001193:[<0x1000000117c/zero-page.txt v46>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001193:[<0x1000000117c/zero-page.txt v46>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.689 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.216+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000117d [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/00-INDEX auth{0=1} v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b64c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000117d:[<0x1000000117c/00-INDEX v2>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x1000000117d:[<0x1000000117c/00-INDEX v2>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.689 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.217+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000118a [...2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/ auth{0=1,1=1} v48 ap=1 f(v0 m2023-12-01T01:05:44.553212+0000 8=8+0) n(v0 rc2023-12-01T01:05:44.554212+0000 9=8+1) (inest lock) (ifile excl) (iversion lock) caps={24964=pAsLsXsFsx/pAsLsXsFsx@1},l=24964 | importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 authpin=1 discoverbase=0 scrubqueue=0 0x55b0b2cad080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000118a:[<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(2)0x1000000118a:[<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-01T01:05:44.553212+0000 8=8+0)","ondisk_value.rstat":"n(v0 rc2023-12-01T01:05:44.553212+0000 9=8+1)","memory_value.dirstat":"f(v0 m2023-12-01T01:05:44.553212+0000 8=8+0)","memory_value.rstat":"n(v0 rc2023-12-01T01:05:44.554212+0000 9=8+1)","error_str":""},"return_code":0} 2023-12-01T01:05:58.689 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.217+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001192 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/uefi.txt auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b0b3b6b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001192:[<0x1000000118a/uefi.txt v16>,<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001192:[<0x1000000118a/uefi.txt v16>,<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.689 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.218+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000118f [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/kernel-stacks auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b0b3b6ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000118f:[<0x1000000118a/kernel-stacks v10>,<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x1000000118f:[<0x1000000118a/kernel-stacks v10>,<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.690 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.218+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000118b [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/00-INDEX auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b0b3b6b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000118b:[<0x1000000118a/00-INDEX v2>,<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x1000000118b:[<0x1000000118a/00-INDEX v2>,<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.690 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.218+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000118c [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/boot-options.txt auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b0b3b72000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000118c:[<0x1000000118a/boot-options.txt v4>,<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x1000000118c:[<0x1000000118a/boot-options.txt v4>,<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.690 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.219+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001190 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/machinecheck auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b0b3b72580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001190:[<0x1000000118a/machinecheck v12>,<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001190:[<0x1000000118a/machinecheck v12>,<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.690 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.219+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000117e [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/boot.txt auth{0=1} v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b65180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000117e:[<0x1000000117c/boot.txt v4>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x1000000117e:[<0x1000000117c/boot.txt v4>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.690 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.219+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000118e [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b0b3b72b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000118e:[<0x1000000118a/fake-numa-for-cpusets v8>,<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x1000000118e:[<0x1000000118a/fake-numa-for-cpusets v8>,<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.690 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.220+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001180 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/earlyprintk.txt auth{0=1} v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b65700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001180:[<0x1000000117c/earlyprintk.txt v8>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001180:[<0x1000000117c/earlyprintk.txt v8>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.690 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.221+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001189 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/usb-legacy-support.txt auth{0=1} v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b68000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001189:[<0x1000000117c/usb-legacy-support.txt v26>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001189:[<0x1000000117c/usb-legacy-support.txt v26>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.690 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.221+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001191 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/mm.txt auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b0b3b73080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001191:[<0x1000000118a/mm.txt v14>,<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001191:[<0x1000000118a/mm.txt v14>,<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.690 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.221+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000118d [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b0b3b73600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000118d:[<0x1000000118a/cpu-hotplug-spec v6>,<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x1000000118d:[<0x1000000118a/cpu-hotplug-spec v6>,<0x1000000117c/x86_64 v48>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.690 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.222+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001182 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/exception-tables.txt auth{0=1} v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b68580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001182:[<0x1000000117c/exception-tables.txt v12>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001182:[<0x1000000117c/exception-tables.txt v12>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.690 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.222+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001185 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/intel_mpx.txt auth{0=1} v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b68b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001185:[<0x1000000117c/intel_mpx.txt v18>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001185:[<0x1000000117c/intel_mpx.txt v18>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.690 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.223+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001183 [...2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386/ auth{0=1,1=1} v50 ap=1 f(v0 m2023-12-01T01:05:44.541212+0000 1=1+0) n(v0 rc2023-12-01T01:05:44.542212+0000 2=1+1) (inest lock) (ifile excl) (iversion lock) caps={24964=pAsLsXsFsx/pAsLsXsFsx@1},l=24964 | importingcaps=0 dirfrag=1 caps=1 dirwaiter=0 replicated=1 authpin=1 discoverbase=0 scrubqueue=0 0x55b0b2cad600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000001183:[<0x1000000117c/i386 v50>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(2)0x10000001183:[<0x1000000117c/i386 v50>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-12-01T01:05:44.541212+0000 1=1+0)","ondisk_value.rstat":"n(v0 rc2023-12-01T01:05:44.541212+0000 2=1+1)","memory_value.dirstat":"f(v0 m2023-12-01T01:05:44.541212+0000 1=1+0)","memory_value.rstat":"n(v0 rc2023-12-01T01:05:44.542212+0000 2=1+1)","error_str":""},"return_code":0} 2023-12-01T01:05:58.691 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.223+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001184 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386/IO-APIC.txt auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55b0b3b73b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001184:[<0x10000001183/IO-APIC.txt v2>,<0x1000000117c/i386 v50>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001184:[<0x10000001183/IO-APIC.txt v2>,<0x1000000117c/i386 v50>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.691 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.223+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001181 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/entry_64.txt auth{0=1} v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b69080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001181:[<0x1000000117c/entry_64.txt v10>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001181:[<0x1000000117c/entry_64.txt v10>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.691 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.224+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000117f [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/early-microcode.txt auth{0=1} v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b69600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000117f:[<0x1000000117c/early-microcode.txt v6>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x1000000117f:[<0x1000000117c/early-microcode.txt v6>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.691 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.224+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001188 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/tlb.txt auth{0=1} v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b69b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001188:[<0x1000000117c/tlb.txt v24>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001188:[<0x1000000117c/tlb.txt v24>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.691 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.225+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001187 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/pat.txt auth{0=1} v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b6a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001187:[<0x1000000117c/pat.txt v22>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001187:[<0x1000000117c/pat.txt v22>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.691 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.225+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000001186 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/mtrr.txt auth{0=1} v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b6a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000001186:[<0x1000000117c/mtrr.txt v20>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000001186:[<0x1000000117c/mtrr.txt v20>,<0x10000000203/x86 v1986>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.691 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.226+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000f3c [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nios2/README auth{0=1} v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b74100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000f3c:[<0x10000000f3b/README v2>,<0x10000000203/nios2 v1981>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000f3c:[<0x10000000f3b/README v2>,<0x10000000203/nios2 v1981>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.691 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.226+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd3 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/user_mad.txt auth{0=1} v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b74680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd3:[<0x10000000dcf/user_mad.txt v8>,<0x10000000203/infiniband v1983>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000dd3:[<0x10000000dcf/user_mad.txt v8>,<0x10000000203/infiniband v1983>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.691 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.227+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd1 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/ipoib.txt auth{0=1} v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b74c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd1:[<0x10000000dcf/ipoib.txt v4>,<0x10000000203/infiniband v1983>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000dd1:[<0x10000000dcf/ipoib.txt v4>,<0x10000000203/infiniband v1983>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.691 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.227+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd0 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/core_locking.txt auth{0=1} v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b75180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd0:[<0x10000000dcf/core_locking.txt v2>,<0x10000000203/infiniband v1983>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000dd0:[<0x10000000dcf/core_locking.txt v2>,<0x10000000203/infiniband v1983>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.691 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.228+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd4 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/user_verbs.txt auth{0=1} v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b75700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd4:[<0x10000000dcf/user_verbs.txt v10>,<0x10000000203/infiniband v1983>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000dd4:[<0x10000000dcf/user_verbs.txt v10>,<0x10000000203/infiniband v1983>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:58.691 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:05:58.228+0000 7f7f6de47700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000dd2 [2,head] /volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/sysfs.txt auth{0=1} v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24964=0-4194304@1} caps={24964=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24964 | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55b0b3b7c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000dd2:[<0x10000000dcf/sysfs.txt v6>,<0x10000000203/infiniband v1983>,<0x10000000202/Documentation v784>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v60>,<0x10000000005/tmp v54>,<0x100000001fb/client.0 v42>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v60>,<0x10000000001/sv_1 v77>,<0x10000000000/_nogroup v64>,<0x1/volumes v59>]//[]","memoryvalue":"(3)0x10000000dd2:[<0x10000000dcf/sysfs.txt v6>,<0x10000000203/infiniband v1983>,<0x10000000202/Documentation v778>,<0x10000000201/linux-4.0.5 v42>,<0x10000000006/untar_tar v65>,<0x10000000005/tmp v58>,<0x100000001fb/client.0 v48>,<0x100000001fa/1269805c-0108-4654-9485-1af971b31c50 v51>,<0x10000000001/sv_1 v81>,<0x10000000000/_nogroup v23>,<0x1/volumes v63>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-01T01:05:59.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub queued for path: / 2023-12-01T01:05:59.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000cf8 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/00-INDEX) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000cfa (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/consumer.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000cfc (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/gpio-legacy.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000cfe (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/sysfs.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000cf9 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/board.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000df2 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/sentelic.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000cfb (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/driver.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000de2 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/event-codes.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000de5 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gameport-programming.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000de4 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gamepad.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000dec (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick-parport.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000deb (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick-api.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000de1 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/elantech.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000df3 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/shape.fig) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000df1 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/rotary-encoder.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000de6 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gpio-tilt.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000ddc (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/bcm5974.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000de7 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/iforce-protocol.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000de0 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/edt-ft5x06.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000dee (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/multi-touch-protocol.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000df4 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/walkera0701.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.184 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000ddf (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cs461x.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.184 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000dda (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/appletouch.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.184 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000dd8 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/alps.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.184 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.184 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.184 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000dde (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cma3000_d0x.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.184 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000de3 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/ff.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.184 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000def (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/notifier.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.184 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000de8 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/input-programming.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.184 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.184 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.184 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000df5 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/xpad.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.184 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000df6 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/yealink.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.184 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000dd9 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/amijoy.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.184 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000de9 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/input.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.185 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.185 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.185 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000ddd (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cd32.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.185 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000ded (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.185 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000dea (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/interactive.fig) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.185 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000ddb (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/atarikbd.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.185 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.185 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.185 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000df0 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/ntrig.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.185 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.185 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.185 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001016 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/tty.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.185 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001011 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/driver) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.186 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000100f (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/00-INDEX) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.186 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.186 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.186 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001014 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/rocket.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.186 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001013 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/n_gsm.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001015 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/serial-rs485.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001010 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/README.cycladesZ) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001012 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/moxa-smartio) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000108e (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timekeeping.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000108b (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hpet.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001087 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/00-INDEX) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000108a (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/highres.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000108f (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timer_stats.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.187 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000108d (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hrtimers.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.188 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001088 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/Makefile) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.188 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.188 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.188 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001090 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timers-howto.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.188 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000108c (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hpet_example.c) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.188 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001086 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/.gitignore) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.188 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.188 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.188 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001089 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/NO_HZ.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.188 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.188 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.188 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001019 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh/new-machine.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.188 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000101a (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh/register-banks.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.188 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001193 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/zero-page.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.188 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000117d (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/00-INDEX) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.189 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.189 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: active paths [/] 2023-12-01T01:05:59.189 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000118a (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.189 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001192 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/uefi.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.189 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000118f (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/kernel-stacks) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.189 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000118b (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/00-INDEX) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.189 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000118c (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/boot-options.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.189 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001190 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/machinecheck) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.189 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000117e (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/boot.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.189 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000118e (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.189 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001180 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/earlyprintk.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.189 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001189 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/usb-legacy-support.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.189 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001191 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/mm.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.189 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000118d (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.190 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001182 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/exception-tables.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.190 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001185 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/intel_mpx.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.190 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001183 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.190 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001184 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386/IO-APIC.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.190 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001181 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/entry_64.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.190 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x1000000117f (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/early-microcode.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.190 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001188 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/tlb.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.190 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001187 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/pat.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.190 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000001186 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/mtrr.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.190 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000f3c (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nios2/README) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.190 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000dd3 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/user_mad.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.190 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000dd1 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/ipoib.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.190 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000dd0 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/core_locking.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.190 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000dd4 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/user_verbs.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.190 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: Scrub error on inode 0x10000000dd2 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/sysfs.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.191 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:58 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub queued for path: / 2023-12-01T01:05:59.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000cf8 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/00-INDEX) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000cfa (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/consumer.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000cfc (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/gpio-legacy.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000cfe (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/sysfs.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000cf9 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/board.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000df2 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/sentelic.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000cfb (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/driver.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000de2 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/event-codes.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000de5 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gameport-programming.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000de4 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gamepad.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000dec (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick-parport.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000deb (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick-api.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000de1 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/elantech.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000df3 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/shape.fig) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000df1 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/rotary-encoder.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000de6 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gpio-tilt.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000ddc (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/bcm5974.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000de7 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/iforce-protocol.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000de0 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/edt-ft5x06.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000dee (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/multi-touch-protocol.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000df4 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/walkera0701.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000ddf (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cs461x.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000dda (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/appletouch.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000dd8 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/alps.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.220 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000dde (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cma3000_d0x.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.220 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000de3 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/ff.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.220 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000def (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/notifier.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.220 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000de8 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/input-programming.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.220 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.220 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.220 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000df5 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/xpad.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.220 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000df6 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/yealink.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.220 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000dd9 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/amijoy.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.220 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000de9 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/input.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.220 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.221 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.221 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000ddd (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cd32.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.221 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000ded (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.221 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000dea (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/interactive.fig) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.221 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000ddb (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/atarikbd.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.221 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.221 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.221 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000df0 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/ntrig.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.221 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.221 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.221 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001016 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/tty.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.221 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001011 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/driver) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.221 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000100f (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/00-INDEX) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.221 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.221 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.222 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001014 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/rocket.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.222 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001013 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/n_gsm.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.222 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001015 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/serial-rs485.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.222 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001010 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/README.cycladesZ) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.222 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.222 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.222 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001012 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/moxa-smartio) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.222 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000108e (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timekeeping.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.223 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000108b (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hpet.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.223 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001087 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/00-INDEX) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.223 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.223 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.223 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000108a (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/highres.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.223 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.223 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.223 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000108f (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timer_stats.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.224 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000108d (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hrtimers.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.224 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001088 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/Makefile) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.224 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.224 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.224 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001090 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timers-howto.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.224 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000108c (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hpet_example.c) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.224 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001086 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/.gitignore) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.224 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.224 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.224 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001089 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/NO_HZ.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.224 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.224 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.224 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001019 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh/new-machine.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.224 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000101a (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh/register-banks.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.224 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001193 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/zero-page.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.225 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000117d (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/00-INDEX) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.225 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.225 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: active paths [/] 2023-12-01T01:05:59.225 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000118a (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.225 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001192 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/uefi.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.225 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000118f (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/kernel-stacks) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.225 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000118b (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/00-INDEX) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.225 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000118c (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/boot-options.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.225 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001190 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/machinecheck) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.225 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000117e (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/boot.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.225 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000118e (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.225 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001180 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/earlyprintk.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.225 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001189 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/usb-legacy-support.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.225 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001191 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/mm.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.226 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000118d (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.226 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001182 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/exception-tables.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.226 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001185 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/intel_mpx.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.226 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001183 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.226 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001184 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386/IO-APIC.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.226 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001181 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/entry_64.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.226 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x1000000117f (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/early-microcode.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.226 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001188 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/tlb.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.226 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001187 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/pat.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.226 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000001186 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/mtrr.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.226 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000f3c (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nios2/README) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.226 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000dd3 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/user_mad.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.226 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000dd1 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/ipoib.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.226 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000dd0 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/core_locking.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.226 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000dd4 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/user_verbs.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.227 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: Scrub error on inode 0x10000000dd2 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/sysfs.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.227 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:58 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub queued for path: / 2023-12-01T01:05:59.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000cf8 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/00-INDEX) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.297 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000cfa (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/consumer.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000cfc (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/gpio-legacy.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000cfe (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/sysfs.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000cf9 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/board.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000df2 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/sentelic.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000cfb (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/driver.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000de2 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/event-codes.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000de5 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gameport-programming.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000de4 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gamepad.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.298 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000dec (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick-parport.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.299 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.299 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.299 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000deb (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick-api.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.299 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.299 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.299 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000de1 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/elantech.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.299 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000df3 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/shape.fig) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.299 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000df1 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/rotary-encoder.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.299 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000de6 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gpio-tilt.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.299 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.299 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.299 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000ddc (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/bcm5974.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.300 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000de7 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/iforce-protocol.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.300 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000de0 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/edt-ft5x06.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.300 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000dee (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/multi-touch-protocol.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.300 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000df4 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/walkera0701.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.300 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000ddf (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cs461x.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.300 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000dda (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/appletouch.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.300 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000dd8 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/alps.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.300 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.300 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.300 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000dde (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cma3000_d0x.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.300 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000de3 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/ff.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.300 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000def (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/notifier.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.300 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000de8 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/input-programming.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.301 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.301 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.301 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000df5 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/xpad.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.301 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000df6 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/yealink.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.301 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000dd9 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/amijoy.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.301 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000de9 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/input.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.301 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.301 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.301 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000ddd (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cd32.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.301 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000ded (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.301 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000dea (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/interactive.fig) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.301 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000ddb (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/atarikbd.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.302 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.302 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.302 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000df0 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/ntrig.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.302 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.302 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.302 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001016 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/tty.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.302 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001011 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/driver) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.302 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000100f (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/00-INDEX) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.302 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.302 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.302 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001014 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/rocket.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.302 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001013 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/n_gsm.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.302 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001015 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/serial-rs485.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.303 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001010 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/README.cycladesZ) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.303 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.303 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.303 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001012 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/moxa-smartio) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.303 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000108e (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timekeeping.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.303 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000108b (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hpet.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.303 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001087 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/00-INDEX) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.303 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.303 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.303 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000108a (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/highres.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.303 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.303 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.303 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000108f (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timer_stats.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.304 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000108d (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hrtimers.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.304 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001088 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/Makefile) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.304 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.304 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.304 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001090 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timers-howto.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.304 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000108c (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hpet_example.c) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.304 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001086 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/.gitignore) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.304 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.304 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.304 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001089 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/NO_HZ.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.304 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.304 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.304 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001019 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh/new-machine.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.305 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000101a (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh/register-banks.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.305 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001193 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/zero-page.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.305 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000117d (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/00-INDEX) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.305 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:05:59.305 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: active paths [/] 2023-12-01T01:05:59.305 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000118a (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.305 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001192 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/uefi.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.305 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000118f (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/kernel-stacks) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.305 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000118b (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/00-INDEX) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.305 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000118c (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/boot-options.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.305 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001190 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/machinecheck) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.306 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000117e (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/boot.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.306 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000118e (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.306 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001180 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/earlyprintk.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.306 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001189 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/usb-legacy-support.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.306 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001191 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/mm.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.306 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000118d (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.306 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001182 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/exception-tables.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.306 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001185 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/intel_mpx.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.306 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001183 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.306 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001184 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386/IO-APIC.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.306 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001181 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/entry_64.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.306 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x1000000117f (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/early-microcode.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.307 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001188 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/tlb.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.307 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001187 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/pat.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.307 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000001186 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/mtrr.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.307 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000f3c (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nios2/README) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.307 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000dd3 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/user_mad.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.307 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000dd1 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/ipoib.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.307 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000dd0 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/core_locking.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.307 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000dd4 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/user_verbs.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.307 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: Scrub error on inode 0x10000000dd2 (/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/sysfs.txt) see mds.i log and `damage ls` output for details 2023-12-01T01:05:59.307 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:58 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:06:00.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:05:59 smithi116 ceph-mon[103554]: pgmap v344: 97 pgs: 97 active+clean; 100 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 51 op/s 2023-12-01T01:06:00.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:05:59 smithi093 ceph-mon[103327]: pgmap v344: 97 pgs: 97 active+clean; 100 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 51 op/s 2023-12-01T01:06:00.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:59 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mon-a[98777]: 2023-12-01T01:05:59.860+0000 7f626e3ce700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-12-01T01:06:00.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:05:59 smithi026 ceph-mon[98801]: pgmap v344: 97 pgs: 97 active+clean; 100 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.4 MiB/s wr, 51 op/s 2023-12-01T01:06:01.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:00 smithi116 ceph-mon[103554]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-12-01T01:06:01.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:00 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] up:active 2023-12-01T01:06:01.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:00 smithi116 ceph-mon[103554]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:06:01.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:00 smithi116 ceph-mon[103554]: pgmap v345: 97 pgs: 97 active+clean; 96 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 650 op/s 2023-12-01T01:06:01.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:00 smithi093 ceph-mon[103327]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-12-01T01:06:01.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:00 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] up:active 2023-12-01T01:06:01.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:00 smithi093 ceph-mon[103327]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:06:01.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:00 smithi093 ceph-mon[103327]: pgmap v345: 97 pgs: 97 active+clean; 96 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 650 op/s 2023-12-01T01:06:01.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:00 smithi026 ceph-mon[98801]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-12-01T01:06:01.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:00 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] up:active 2023-12-01T01:06:01.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:00 smithi026 ceph-mon[98801]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:06:01.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:00 smithi026 ceph-mon[98801]: pgmap v345: 97 pgs: 97 active+clean; 96 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.9 MiB/s wr, 650 op/s 2023-12-01T01:06:03.430 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:03 smithi116 ceph-mon[103554]: pgmap v346: 97 pgs: 97 active+clean; 98 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.6 MiB/s wr, 1k op/s 2023-12-01T01:06:03.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:03 smithi093 ceph-mon[103327]: pgmap v346: 97 pgs: 97 active+clean; 98 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.6 MiB/s wr, 1k op/s 2023-12-01T01:06:03.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:03 smithi026 ceph-mon[98801]: pgmap v346: 97 pgs: 97 active+clean; 98 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 2.6 MiB/s wr, 1k op/s 2023-12-01T01:06:05.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:05 smithi116 ceph-mon[103554]: pgmap v347: 97 pgs: 97 active+clean; 90 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 1.02k op/s 2023-12-01T01:06:05.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:05 smithi093 ceph-mon[103327]: pgmap v347: 97 pgs: 97 active+clean; 90 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 1.02k op/s 2023-12-01T01:06:05.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:05 smithi026 ceph-mon[98801]: pgmap v347: 97 pgs: 97 active+clean; 90 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.5 MiB/s wr, 1.02k op/s 2023-12-01T01:06:07.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:07 smithi116 ceph-mon[103554]: pgmap v348: 97 pgs: 97 active+clean; 142 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.1 MiB/s wr, 1.43k op/s 2023-12-01T01:06:07.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:07 smithi093 ceph-mon[103327]: pgmap v348: 97 pgs: 97 active+clean; 142 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.1 MiB/s wr, 1.43k op/s 2023-12-01T01:06:07.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:07 smithi026 ceph-mon[98801]: pgmap v348: 97 pgs: 97 active+clean; 142 MiB data, 722 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.1 MiB/s wr, 1.43k op/s 2023-12-01T01:06:09.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:09 smithi116 ceph-mon[103554]: pgmap v349: 97 pgs: 97 active+clean; 159 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.6 MiB/s wr, 1.59k op/s 2023-12-01T01:06:09.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:09 smithi093 ceph-mon[103327]: pgmap v349: 97 pgs: 97 active+clean; 159 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.6 MiB/s wr, 1.59k op/s 2023-12-01T01:06:09.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:09 smithi026 ceph-mon[98801]: pgmap v349: 97 pgs: 97 active+clean; 159 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.6 MiB/s wr, 1.59k op/s 2023-12-01T01:06:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.015+0000 7efeed7e8700 1 -- 172.21.15.26:0/75067153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee8100e80 msgr2=0x7efee81012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.015+0000 7efeed7e8700 1 --2- 172.21.15.26:0/75067153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee8100e80 0x7efee81012e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7efed00099c0 tx=0x7efed0009cd0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.015+0000 7efeed7e8700 1 -- 172.21.15.26:0/75067153 shutdown_connections 2023-12-01T01:06:11.017 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.015+0000 7efeed7e8700 1 --2- 172.21.15.26:0/75067153 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efee8101820 0x7efee81080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.015+0000 7efeed7e8700 1 --2- 172.21.15.26:0/75067153 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efee80ffc90 0x7efee81000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.015+0000 7efeed7e8700 1 --2- 172.21.15.26:0/75067153 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee8100e80 0x7efee81012e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.015+0000 7efeed7e8700 1 -- 172.21.15.26:0/75067153 >> 172.21.15.26:0/75067153 conn(0x7efee80fb1e0 msgr2=0x7efee80fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.015+0000 7efeed7e8700 1 -- 172.21.15.26:0/75067153 shutdown_connections 2023-12-01T01:06:11.018 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.015+0000 7efeed7e8700 1 -- 172.21.15.26:0/75067153 wait complete. 2023-12-01T01:06:11.020 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.016+0000 7efeed7e8700 1 Processor -- start 2023-12-01T01:06:11.020 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.016+0000 7efeed7e8700 1 -- start start 2023-12-01T01:06:11.020 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.016+0000 7efeed7e8700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee80ffc90 0x7efee8196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.020 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.016+0000 7efeed7e8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efee8100e80 0x7efee8197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.020 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.016+0000 7efeed7e8700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efee8101820 0x7efee8197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.020 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.016+0000 7efeed7e8700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee8198690 con 0x7efee80ffc90 2023-12-01T01:06:11.020 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.016+0000 7efeed7e8700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee8198800 con 0x7efee8100e80 2023-12-01T01:06:11.020 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.016+0000 7efeed7e8700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee81989c0 con 0x7efee8101820 2023-12-01T01:06:11.020 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.016+0000 7efee6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee80ffc90 0x7efee8196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.020 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.016+0000 7efee6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee80ffc90 0x7efee8196d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56314/0 (socket says 172.21.15.26:56314) 2023-12-01T01:06:11.020 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.016+0000 7efee6ffd700 1 -- 172.21.15.26:0/3282173123 learned_addr learned my addr 172.21.15.26:0/3282173123 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:11.021 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.016+0000 7efede7fc700 1 --2- 172.21.15.26:0/3282173123 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efee8100e80 0x7efee8197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.021 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.016+0000 7efee77fe700 1 --2- 172.21.15.26:0/3282173123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efee8101820 0x7efee8197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.021 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.017+0000 7efee6ffd700 1 -- 172.21.15.26:0/3282173123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efee8101820 msgr2=0x7efee8197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:11.021 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.017+0000 7efee6ffd700 1 --2- 172.21.15.26:0/3282173123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efee8101820 0x7efee8197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.021 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.017+0000 7efee6ffd700 1 -- 172.21.15.26:0/3282173123 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efee8100e80 msgr2=0x7efee8197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:11.021 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.017+0000 7efee6ffd700 1 --2- 172.21.15.26:0/3282173123 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efee8100e80 0x7efee8197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.021 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.017+0000 7efee6ffd700 1 -- 172.21.15.26:0/3282173123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed00095f0 con 0x7efee80ffc90 2023-12-01T01:06:11.021 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.017+0000 7efee6ffd700 1 --2- 172.21.15.26:0/3282173123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee80ffc90 0x7efee8196d10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7efed800e970 tx=0x7efed800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:11.021 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.017+0000 7efee4ff9700 1 -- 172.21.15.26:0/3282173123 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed8009790 con 0x7efee80ffc90 2023-12-01T01:06:11.021 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.017+0000 7efee4ff9700 1 -- 172.21.15.26:0/3282173123 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efed800ccc0 con 0x7efee80ffc90 2023-12-01T01:06:11.021 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.017+0000 7efeed7e8700 1 -- 172.21.15.26:0/3282173123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee8198ca0 con 0x7efee80ffc90 2023-12-01T01:06:11.021 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.017+0000 7efee4ff9700 1 -- 172.21.15.26:0/3282173123 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed8003d80 con 0x7efee80ffc90 2023-12-01T01:06:11.021 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.017+0000 7efeed7e8700 1 -- 172.21.15.26:0/3282173123 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee819f410 con 0x7efee80ffc90 2023-12-01T01:06:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.019+0000 7efee4ff9700 1 -- 172.21.15.26:0/3282173123 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7efed800c7e0 con 0x7efee80ffc90 2023-12-01T01:06:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.020+0000 7efee4ff9700 1 --2- 172.21.15.26:0/3282173123 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efed40a0520 0x7efed40a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.020+0000 7efede7fc700 1 --2- 172.21.15.26:0/3282173123 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efed40a0520 0x7efed40a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.020+0000 7efee4ff9700 1 -- 172.21.15.26:0/3282173123 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efed8014070 con 0x7efee80ffc90 2023-12-01T01:06:11.022 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.020+0000 7efede7fc700 1 --2- 172.21.15.26:0/3282173123 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efed40a0520 0x7efed40a29e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efed000b580 tx=0x7efed00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.021+0000 7efef9978b80 1 Processor -- start 2023-12-01T01:06:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.021+0000 7efef9978b80 1 -- start start 2023-12-01T01:06:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.021+0000 7efef9978b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afa680 0x562867afaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.021+0000 7efef9978b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afafe0 0x562867afb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.024 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.021+0000 7efef9978b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867afc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.021+0000 7efef9978b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x562867a529b0 con 0x562867afbed0 2023-12-01T01:06:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.021+0000 7efef9978b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x562867a50370 con 0x562867afafe0 2023-12-01T01:06:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.021+0000 7efef9978b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x562867a4bc60 con 0x562867afa680 2023-12-01T01:06:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.022+0000 7efee77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867afc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.022+0000 7efede7fc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afafe0 0x562867afb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.022+0000 7efee77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867afc350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56324/0 (socket says 172.21.15.26:56324) 2023-12-01T01:06:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.022+0000 7efee77fe700 1 -- 172.21.15.26:0/3855804237 learned_addr learned my addr 172.21.15.26:0/3855804237 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.022+0000 7efede7fc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afafe0 0x562867afb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:47060/0 (socket says 172.21.15.26:47060) 2023-12-01T01:06:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.022+0000 7efee6ffd700 1 --2- 172.21.15.26:0/3855804237 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afa680 0x562867afaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.022+0000 7efee77fe700 1 -- 172.21.15.26:0/3855804237 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afa680 msgr2=0x562867afaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.022+0000 7efee77fe700 1 --2- 172.21.15.26:0/3855804237 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afa680 0x562867afaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.022+0000 7efee77fe700 1 -- 172.21.15.26:0/3855804237 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afafe0 msgr2=0x562867afb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.022+0000 7efee77fe700 1 --2- 172.21.15.26:0/3855804237 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afafe0 0x562867afb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.022+0000 7efee77fe700 1 -- 172.21.15.26:0/3855804237 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562867879d80 con 0x562867afbed0 2023-12-01T01:06:11.025 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.022+0000 7efede7fc700 1 --2- 172.21.15.26:0/3855804237 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afafe0 0x562867afb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:06:11.026 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.022+0000 7efee77fe700 1 --2- 172.21.15.26:0/3855804237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867afc350 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7efee00115e0 tx=0x7efee0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7300dcbeaf7203f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:11.026 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.022+0000 7efedd7fa700 1 -- 172.21.15.26:0/3855804237 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee000e040 con 0x562867afbed0 2023-12-01T01:06:11.026 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.022+0000 7efedd7fa700 1 -- 172.21.15.26:0/3855804237 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efee000f040 con 0x562867afbed0 2023-12-01T01:06:11.026 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.022+0000 7efedd7fa700 1 -- 172.21.15.26:0/3855804237 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee0004780 con 0x562867afbed0 2023-12-01T01:06:11.030 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.023+0000 7efef9978b80 1 -- 172.21.15.26:0/3855804237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 msgr2=0x562867afc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:11.030 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.023+0000 7efef9978b80 1 --2- 172.21.15.26:0/3855804237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867afc350 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7efee00115e0 tx=0x7efee0009920 comp rx=0 tx=0).stop 2023-12-01T01:06:11.030 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.023+0000 7efef9978b80 1 -- 172.21.15.26:0/3855804237 shutdown_connections 2023-12-01T01:06:11.030 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.023+0000 7efef9978b80 1 --2- 172.21.15.26:0/3855804237 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867afc350 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.030 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.023+0000 7efef9978b80 1 --2- 172.21.15.26:0/3855804237 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afa680 0x562867afaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.030 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.023+0000 7efef9978b80 1 --2- 172.21.15.26:0/3855804237 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afafe0 0x562867afb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.030 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.023+0000 7efef9978b80 1 -- 172.21.15.26:0/3855804237 >> 172.21.15.26:0/3855804237 conn(0x562867a5a070 msgr2=0x562867af7040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:11.030 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.023+0000 7efef9978b80 1 -- 172.21.15.26:0/3855804237 shutdown_connections 2023-12-01T01:06:11.031 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.023+0000 7efef9978b80 1 -- 172.21.15.26:0/3855804237 wait complete. 2023-12-01T01:06:11.031 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efef9978b80 1 -- start start 2023-12-01T01:06:11.031 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efef9978b80 1 Processor -- start 2023-12-01T01:06:11.031 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efef9978b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 0x562867b04430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.031 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efef9978b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 0x562867b04970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.031 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efef9978b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867b0b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.031 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efef9978b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628679e84b0 con 0x562867afbed0 2023-12-01T01:06:11.031 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efef9978b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628679e8150 con 0x562867afa680 2023-12-01T01:06:11.031 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efef9978b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628678cf8c0 con 0x562867afafe0 2023-12-01T01:06:11.031 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efef9978b80 10 client.0 _ll_register_callbacks cb 0x562867935a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:11.031 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efede7fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 0x562867b04970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.031 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efee77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867b0b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.031 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efede7fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 0x562867b04970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.26:48562/0 (socket says 172.21.15.26:48562) 2023-12-01T01:06:11.031 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efede7fc700 1 -- 172.21.15.26:0/1090278990 learned_addr learned my addr 172.21.15.26:0/1090278990 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:11.032 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efee6ffd700 1 --2- 172.21.15.26:0/1090278990 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 0x562867b04430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.032 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efede7fc700 1 -- 172.21.15.26:0/1090278990 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 msgr2=0x562867b04430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:11.032 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efede7fc700 1 --2- 172.21.15.26:0/1090278990 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 0x562867b04430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.032 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efede7fc700 1 -- 172.21.15.26:0/1090278990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 msgr2=0x562867b0b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:11.032 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efede7fc700 1 --2- 172.21.15.26:0/1090278990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867b0b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.032 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efede7fc700 1 -- 172.21.15.26:0/1090278990 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee8108a20 con 0x562867afafe0 2023-12-01T01:06:11.032 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.024+0000 7efee77fe700 1 --2- 172.21.15.26:0/1090278990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867b0b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:06:11.032 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.025+0000 7efede7fc700 1 --2- 172.21.15.26:0/1090278990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 0x562867b04970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efed00099c0 tx=0x7efed0009cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=322992c84621be36 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:11.032 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.025+0000 7efece7fc700 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2023-12-01T01:06:11.032 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.025+0000 7efece7fc700 1 -- 172.21.15.26:0/1090278990 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed002a050 con 0x562867afafe0 2023-12-01T01:06:11.032 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.025+0000 7efef9978b80 1 -- 172.21.15.26:0/1090278990 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562867a76cb0 con 0x562867afafe0 2023-12-01T01:06:11.032 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.025+0000 7efece7fc700 1 -- 172.21.15.26:0/1090278990 <== mon.1 v2:172.21.15.116:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efed0023460 con 0x562867afafe0 2023-12-01T01:06:11.032 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.025+0000 7efece7fc700 1 -- 172.21.15.26:0/1090278990 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7efed0023620 con 0x562867afafe0 2023-12-01T01:06:11.032 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.025+0000 7efef9978b80 10 client.25516 fetch_fsmap learned FSMap version 28 2023-12-01T01:06:11.032 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.025+0000 7efef9978b80 1 -- 172.21.15.26:0/1090278990 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x7efee0011290 con 0x562867afafe0 2023-12-01T01:06:11.032 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.025+0000 7efece7fc700 1 -- 172.21.15.26:0/1090278990 <== mon.1 v2:172.21.15.116:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x562867a76cb0 con 0x562867afafe0 2023-12-01T01:06:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.025+0000 7efece7fc700 1 -- 172.21.15.26:0/1090278990 <== mon.1 v2:172.21.15.116:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7efed000f8b0 con 0x562867afafe0 2023-12-01T01:06:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.025+0000 7efef9978b80 10 client.25516 fetch_fsmap finished waiting for FSMap version 28 2023-12-01T01:06:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.025+0000 7efef9978b80 10 client.25516 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:06:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.026+0000 7efef9978b80 20 client.25516 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.026+0000 7efef9978b80 1 --2- 172.21.15.26:0/1090278990 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x562867b102e0 0x562867b12700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.026+0000 7efef9978b80 4 client.25516 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:06:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.026+0000 7efef9978b80 1 -- 172.21.15.26:0/1090278990 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562867ac9db0 con 0x562867b102e0 2023-12-01T01:06:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.026+0000 7efee6ffd700 1 --2- 172.21.15.26:0/1090278990 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x562867b102e0 0x562867b12700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.026+0000 7efece7fc700 10 client.25516 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.026+0000 7efee6ffd700 1 --2- 172.21.15.26:0/1090278990 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x562867b102e0 0x562867b12700 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73c7133ad6647f0f server_cookie=c408d79130e1e32 in_seq=0 out_seq=0 2023-12-01T01:06:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.027+0000 7efece7fc700 1 -- 172.21.15.26:0/1090278990 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x562867ac9db0 con 0x562867b102e0 2023-12-01T01:06:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.027+0000 7efece7fc700 10 client.25516 handle_command_reply: tid=0 2023-12-01T01:06:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.027+0000 7efef9978b80 1 client.25516 shutdown 2023-12-01T01:06:11.033 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.027+0000 7efef9978b80 1 -- 172.21.15.26:0/1090278990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 msgr2=0x562867b04970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.027+0000 7efef9978b80 1 --2- 172.21.15.26:0/1090278990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 0x562867b04970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efed00099c0 tx=0x7efed0009cd0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.027+0000 7efef9978b80 1 -- 172.21.15.26:0/1090278990 shutdown_connections 2023-12-01T01:06:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.027+0000 7efef9978b80 1 --2- 172.21.15.26:0/1090278990 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x562867b102e0 0x562867b12700 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.027+0000 7efef9978b80 1 --2- 172.21.15.26:0/1090278990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867b0b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.027+0000 7efef9978b80 1 --2- 172.21.15.26:0/1090278990 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 0x562867b04430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.027+0000 7efece7fc700 0 client.25516 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.027+0000 7efef9978b80 1 --2- 172.21.15.26:0/1090278990 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 0x562867b04970 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.027+0000 7efef9978b80 1 -- 172.21.15.26:0/1090278990 >> 172.21.15.26:0/1090278990 conn(0x562867a5a070 msgr2=0x562867af53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.027+0000 7efef9978b80 1 -- 172.21.15.26:0/1090278990 shutdown_connections 2023-12-01T01:06:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.027+0000 7efef9978b80 1 -- 172.21.15.26:0/1090278990 wait complete. 2023-12-01T01:06:11.034 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.027+0000 7efef9978b80 20 client.25516 trim_cache size 0 max 16384 2023-12-01T01:06:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.042+0000 7efef9978b80 1 Processor -- start 2023-12-01T01:06:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.042+0000 7efef9978b80 1 -- start start 2023-12-01T01:06:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.042+0000 7efef9978b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 0x562867b09960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.042+0000 7efef9978b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 0x562867afc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.042+0000 7efef9978b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867af4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.042+0000 7efef9978b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x562867aed7e0 con 0x562867afbed0 2023-12-01T01:06:11.045 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.042+0000 7efef9978b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x562867b03910 con 0x562867afa680 2023-12-01T01:06:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.042+0000 7efef9978b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x562867b03fa0 con 0x562867afafe0 2023-12-01T01:06:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.042+0000 7efede7fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 0x562867afc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.042+0000 7efee6ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 0x562867b09960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.042+0000 7efee77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867af4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.042+0000 7efee6ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 0x562867b09960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:47074/0 (socket says 172.21.15.26:47074) 2023-12-01T01:06:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.042+0000 7efede7fc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 0x562867afc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.116:3300/0 says I am v2:172.21.15.26:48568/0 (socket says 172.21.15.26:48568) 2023-12-01T01:06:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.042+0000 7efee6ffd700 1 -- 172.21.15.26:0/4220604650 learned_addr learned my addr 172.21.15.26:0/4220604650 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.043+0000 7efee6ffd700 1 -- 172.21.15.26:0/4220604650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 msgr2=0x562867afc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.043+0000 7efee6ffd700 1 --2- 172.21.15.26:0/4220604650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 0x562867afc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.043+0000 7efee6ffd700 1 -- 172.21.15.26:0/4220604650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 msgr2=0x562867af4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.043+0000 7efee6ffd700 1 --2- 172.21.15.26:0/4220604650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867af4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.043+0000 7efee6ffd700 1 -- 172.21.15.26:0/4220604650 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562867862c00 con 0x562867afa680 2023-12-01T01:06:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.043+0000 7efede7fc700 1 --2- 172.21.15.26:0/4220604650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 0x562867afc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:06:11.046 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.043+0000 7efee77fe700 1 --2- 172.21.15.26:0/4220604650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867af4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:06:11.047 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.043+0000 7efee6ffd700 1 --2- 172.21.15.26:0/4220604650 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 0x562867b09960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efed8095880 tx=0x7efed8084040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80b4267663c3cfab server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:11.047 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.043+0000 7efeddffb700 1 -- 172.21.15.26:0/4220604650 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed8099a80 con 0x562867afa680 2023-12-01T01:06:11.047 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.043+0000 7efeddffb700 1 -- 172.21.15.26:0/4220604650 <== mon.2 v2:172.21.15.93:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efed8099380 con 0x562867afa680 2023-12-01T01:06:11.047 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.043+0000 7efeddffb700 1 -- 172.21.15.26:0/4220604650 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed80974c0 con 0x562867afa680 2023-12-01T01:06:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 -- 172.21.15.26:0/4220604650 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 msgr2=0x562867b09960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 --2- 172.21.15.26:0/4220604650 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 0x562867b09960 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7efed8095880 tx=0x7efed8084040 comp rx=0 tx=0).stop 2023-12-01T01:06:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 -- 172.21.15.26:0/4220604650 shutdown_connections 2023-12-01T01:06:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 --2- 172.21.15.26:0/4220604650 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867af4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 --2- 172.21.15.26:0/4220604650 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 0x562867b09960 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 --2- 172.21.15.26:0/4220604650 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 0x562867afc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 -- 172.21.15.26:0/4220604650 >> 172.21.15.26:0/4220604650 conn(0x562867a5a070 msgr2=0x562867b03170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 -- 172.21.15.26:0/4220604650 shutdown_connections 2023-12-01T01:06:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 -- 172.21.15.26:0/4220604650 wait complete. 2023-12-01T01:06:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 -- start start 2023-12-01T01:06:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 Processor -- start 2023-12-01T01:06:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 0x562867b5bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.050 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 0x562867b5e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867b60820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x562867b60ee0 con 0x562867afbed0 2023-12-01T01:06:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x562867b61050 con 0x562867afa680 2023-12-01T01:06:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.044+0000 7efef9978b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x562867b61210 con 0x562867afafe0 2023-12-01T01:06:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efef9978b80 10 client.0 _ll_register_callbacks cb 0x7efed000bf60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efee6ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 0x562867b5bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efee6ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 0x562867b5bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:47080/0 (socket says 172.21.15.26:47080) 2023-12-01T01:06:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efee77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867b60820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efee6ffd700 1 -- 172.21.15.26:0/711719663 learned_addr learned my addr 172.21.15.26:0/711719663 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efede7fc700 1 --2- 172.21.15.26:0/711719663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 0x562867b5e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efee6ffd700 1 -- 172.21.15.26:0/711719663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 msgr2=0x562867b5e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efee6ffd700 1 --2- 172.21.15.26:0/711719663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 0x562867b5e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efee6ffd700 1 -- 172.21.15.26:0/711719663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 msgr2=0x562867b60820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efee6ffd700 1 --2- 172.21.15.26:0/711719663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867b60820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efee6ffd700 1 -- 172.21.15.26:0/711719663 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee0011290 con 0x562867afa680 2023-12-01T01:06:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efee6ffd700 1 --2- 172.21.15.26:0/711719663 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 0x562867b5bd80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efed80c9670 tx=0x7efed8093f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=288d2c43f677ce8 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efece7fc700 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-12-01T01:06:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efece7fc700 1 -- 172.21.15.26:0/711719663 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed8099a80 con 0x562867afa680 2023-12-01T01:06:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efece7fc700 1 -- 172.21.15.26:0/711719663 <== mon.2 v2:172.21.15.93:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efed80ace40 con 0x562867afa680 2023-12-01T01:06:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efef9978b80 1 -- 172.21.15.26:0/711719663 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efee000f040 con 0x562867afa680 2023-12-01T01:06:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efece7fc700 1 -- 172.21.15.26:0/711719663 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7efed809d1b0 con 0x562867afa680 2023-12-01T01:06:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efef9978b80 10 client.25511 fetch_fsmap learned FSMap version 28 2023-12-01T01:06:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.045+0000 7efef9978b80 1 -- 172.21.15.26:0/711719663 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) v3 -- 0x562867879d80 con 0x562867afa680 2023-12-01T01:06:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.046+0000 7efece7fc700 1 -- 172.21.15.26:0/711719663 <== mon.2 v2:172.21.15.93:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efed8063080 con 0x562867afa680 2023-12-01T01:06:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.046+0000 7efece7fc700 1 -- 172.21.15.26:0/711719663 <== mon.2 v2:172.21.15.93:3300/0 5 ==== fsmap(e 28) v1 ==== 7462+0+0 (secure 0 0 0) 0x7efed8064f80 con 0x562867afa680 2023-12-01T01:06:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.046+0000 7efef9978b80 10 client.25511 fetch_fsmap finished waiting for FSMap version 28 2023-12-01T01:06:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.046+0000 7efef9978b80 10 client.25511 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:06:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.046+0000 7efef9978b80 20 client.25511 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.046+0000 7efef9978b80 1 --2- 172.21.15.26:0/711719663 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x562867b629a0 0x562867b64dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.046+0000 7efef9978b80 4 client.25511 mds_command: new command op to 24509 tid=0[{"prefix": "flush journal"}] 2023-12-01T01:06:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.046+0000 7efef9978b80 1 -- 172.21.15.26:0/711719663 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562867a44ce0 con 0x562867b629a0 2023-12-01T01:06:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.046+0000 7efede7fc700 1 --2- 172.21.15.26:0/711719663 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x562867b629a0 0x562867b64dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.046+0000 7efece7fc700 10 client.25511 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.046+0000 7efede7fc700 1 --2- 172.21.15.26:0/711719663 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x562867b629a0 0x562867b64dc0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46f0d8384044778d server_cookie=3ce20cecc5f5c542 in_seq=0 out_seq=0 2023-12-01T01:06:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.167+0000 7efece7fc700 1 -- 172.21.15.26:0/711719663 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562867a44ce0 con 0x562867b629a0 2023-12-01T01:06:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.167+0000 7efece7fc700 10 client.25511 handle_command_reply: tid=0 2023-12-01T01:06:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.167+0000 7efef9978b80 1 client.25511 shutdown 2023-12-01T01:06:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.167+0000 7efef9978b80 1 -- 172.21.15.26:0/711719663 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 msgr2=0x562867b5bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.167+0000 7efef9978b80 1 --2- 172.21.15.26:0/711719663 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 0x562867b5bd80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efed80c9670 tx=0x7efed8093f90 comp rx=0 tx=0).stop 2023-12-01T01:06:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.168+0000 7efef9978b80 1 -- 172.21.15.26:0/711719663 shutdown_connections 2023-12-01T01:06:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.168+0000 7efef9978b80 1 --2- 172.21.15.26:0/711719663 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x562867b629a0 0x562867b64dc0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.168+0000 7efef9978b80 1 --2- 172.21.15.26:0/711719663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562867afbed0 0x562867b60820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.168+0000 7efece7fc700 0 client.25511 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.168+0000 7efef9978b80 1 --2- 172.21.15.26:0/711719663 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x562867afa680 0x562867b5bd80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.168+0000 7efef9978b80 1 --2- 172.21.15.26:0/711719663 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x562867afafe0 0x562867b5e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.168+0000 7efef9978b80 1 -- 172.21.15.26:0/711719663 >> 172.21.15.26:0/711719663 conn(0x562867a5a070 msgr2=0x562867af6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.168+0000 7efef9978b80 1 -- 172.21.15.26:0/711719663 shutdown_connections 2023-12-01T01:06:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.168+0000 7efef9978b80 1 -- 172.21.15.26:0/711719663 wait complete. 2023-12-01T01:06:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.168+0000 7efef9978b80 20 client.25511 trim_cache size 0 max 16384 2023-12-01T01:06:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:{ 2023-12-01T01:06:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "message": "", 2023-12-01T01:06:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "return_code": 0 2023-12-01T01:06:11.172 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:} 2023-12-01T01:06:11.172 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.169+0000 7efeed7e8700 1 -- 172.21.15.26:0/3282173123 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efed40a0520 msgr2=0x7efed40a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:11.172 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.169+0000 7efeed7e8700 1 --2- 172.21.15.26:0/3282173123 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efed40a0520 0x7efed40a29e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7efed000b580 tx=0x7efed00058e0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.172 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.169+0000 7efeed7e8700 1 -- 172.21.15.26:0/3282173123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee80ffc90 msgr2=0x7efee8196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:11.172 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.169+0000 7efeed7e8700 1 --2- 172.21.15.26:0/3282173123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee80ffc90 0x7efee8196d10 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7efed800e970 tx=0x7efed800ec80 comp rx=0 tx=0).stop 2023-12-01T01:06:11.173 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.169+0000 7efeed7e8700 1 -- 172.21.15.26:0/3282173123 shutdown_connections 2023-12-01T01:06:11.173 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.169+0000 7efeed7e8700 1 --2- 172.21.15.26:0/3282173123 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efed40a0520 0x7efed40a29e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.173 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.169+0000 7efeed7e8700 1 --2- 172.21.15.26:0/3282173123 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efee8101820 0x7efee8197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.173 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.169+0000 7efeed7e8700 1 --2- 172.21.15.26:0/3282173123 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efee80ffc90 0x7efee8196d10 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.173 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.169+0000 7efeed7e8700 1 --2- 172.21.15.26:0/3282173123 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efee8100e80 0x7efee8197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:11.173 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.169+0000 7efeed7e8700 1 -- 172.21.15.26:0/3282173123 >> 172.21.15.26:0/3282173123 conn(0x7efee80fb1e0 msgr2=0x7efee80681a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:11.173 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.169+0000 7efeed7e8700 1 -- 172.21.15.26:0/3282173123 shutdown_connections 2023-12-01T01:06:11.173 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:11.169+0000 7efeed7e8700 1 -- 172.21.15.26:0/3282173123 wait complete. 2023-12-01T01:06:11.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:11 smithi116 ceph-mon[103554]: pgmap v350: 97 pgs: 97 active+clean; 157 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.4 MiB/s wr, 1.75k op/s 2023-12-01T01:06:11.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:11 smithi093 ceph-mon[103327]: pgmap v350: 97 pgs: 97 active+clean; 157 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.4 MiB/s wr, 1.75k op/s 2023-12-01T01:06:11.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:11 smithi026 ceph-mon[98801]: pgmap v350: 97 pgs: 97 active+clean; 157 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.4 MiB/s wr, 1.75k op/s 2023-12-01T01:06:13.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:13 smithi116 ceph-mon[103554]: pgmap v351: 97 pgs: 97 active+clean; 149 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.0 MiB/s wr, 1.29k op/s 2023-12-01T01:06:13.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:13 smithi093 ceph-mon[103327]: pgmap v351: 97 pgs: 97 active+clean; 149 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.0 MiB/s wr, 1.29k op/s 2023-12-01T01:06:13.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:13 smithi026 ceph-mon[98801]: pgmap v351: 97 pgs: 97 active+clean; 149 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.0 MiB/s wr, 1.29k op/s 2023-12-01T01:06:15.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:15 smithi116 ceph-mon[103554]: pgmap v352: 97 pgs: 97 active+clean; 149 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.4 MiB/s wr, 1.01k op/s 2023-12-01T01:06:15.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:15 smithi093 ceph-mon[103327]: pgmap v352: 97 pgs: 97 active+clean; 149 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.4 MiB/s wr, 1.01k op/s 2023-12-01T01:06:15.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:15 smithi026 ceph-mon[98801]: pgmap v352: 97 pgs: 97 active+clean; 149 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 7.4 MiB/s wr, 1.01k op/s 2023-12-01T01:06:17.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:17 smithi116 ceph-mon[103554]: pgmap v353: 97 pgs: 97 active+clean; 147 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.8 MiB/s wr, 1.08k op/s 2023-12-01T01:06:17.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:17 smithi093 ceph-mon[103327]: pgmap v353: 97 pgs: 97 active+clean; 147 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.8 MiB/s wr, 1.08k op/s 2023-12-01T01:06:17.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:17 smithi026 ceph-mon[98801]: pgmap v353: 97 pgs: 97 active+clean; 147 MiB data, 762 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 7.8 MiB/s wr, 1.08k op/s 2023-12-01T01:06:19.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:19 smithi116 ceph-mon[103554]: pgmap v354: 97 pgs: 97 active+clean; 148 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 574 op/s 2023-12-01T01:06:19.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:19 smithi093 ceph-mon[103327]: pgmap v354: 97 pgs: 97 active+clean; 148 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 574 op/s 2023-12-01T01:06:19.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:19 smithi026 ceph-mon[98801]: pgmap v354: 97 pgs: 97 active+clean; 148 MiB data, 766 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 3.0 MiB/s wr, 574 op/s 2023-12-01T01:06:20.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:20 smithi116 ceph-mon[103554]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:06:20.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:20 smithi093 ceph-mon[103327]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:06:20.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:20 smithi026 ceph-mon[98801]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:06:21.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:21 smithi116 ceph-mon[103554]: pgmap v355: 97 pgs: 97 active+clean; 149 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 484 op/s 2023-12-01T01:06:21.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:21 smithi093 ceph-mon[103327]: pgmap v355: 97 pgs: 97 active+clean; 149 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 484 op/s 2023-12-01T01:06:21.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:21 smithi026 ceph-mon[98801]: pgmap v355: 97 pgs: 97 active+clean; 149 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 484 op/s 2023-12-01T01:06:23.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:23 smithi116 ceph-mon[103554]: pgmap v356: 97 pgs: 97 active+clean; 148 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 381 op/s 2023-12-01T01:06:23.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:23 smithi093 ceph-mon[103327]: pgmap v356: 97 pgs: 97 active+clean; 148 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 381 op/s 2023-12-01T01:06:23.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:23 smithi026 ceph-mon[98801]: pgmap v356: 97 pgs: 97 active+clean; 148 MiB data, 758 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 381 op/s 2023-12-01T01:06:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.282+0000 7f7f3526c700 1 -- 172.21.15.26:0/3463739359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f30100e80 msgr2=0x7f7f301012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.282+0000 7f7f3526c700 1 --2- 172.21.15.26:0/3463739359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f30100e80 0x7f7f301012e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f7f180099c0 tx=0x7f7f18009cd0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.286 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.282+0000 7f7f3526c700 1 -- 172.21.15.26:0/3463739359 shutdown_connections 2023-12-01T01:06:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.282+0000 7f7f3526c700 1 --2- 172.21.15.26:0/3463739359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f30101820 0x7f7f301080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.282+0000 7f7f3526c700 1 --2- 172.21.15.26:0/3463739359 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f300ffc90 0x7f7f301000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.282+0000 7f7f3526c700 1 --2- 172.21.15.26:0/3463739359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f30100e80 0x7f7f301012e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.282+0000 7f7f3526c700 1 -- 172.21.15.26:0/3463739359 >> 172.21.15.26:0/3463739359 conn(0x7f7f300fb1e0 msgr2=0x7f7f300fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.282+0000 7f7f3526c700 1 -- 172.21.15.26:0/3463739359 shutdown_connections 2023-12-01T01:06:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.282+0000 7f7f3526c700 1 -- 172.21.15.26:0/3463739359 wait complete. 2023-12-01T01:06:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.283+0000 7f7f3526c700 1 Processor -- start 2023-12-01T01:06:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.283+0000 7f7f3526c700 1 -- start start 2023-12-01T01:06:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.283+0000 7f7f3526c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f300ffc90 0x7f7f30196ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.287 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.283+0000 7f7f3526c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f30100e80 0x7f7f30197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.283+0000 7f7f3526c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f30101820 0x7f7f30197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.283+0000 7f7f3526c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f30198660 con 0x7f7f30100e80 2023-12-01T01:06:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.283+0000 7f7f3526c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f301987d0 con 0x7f7f300ffc90 2023-12-01T01:06:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.283+0000 7f7f3526c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f30198990 con 0x7f7f30101820 2023-12-01T01:06:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.283+0000 7f7f267fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f30100e80 0x7f7f30197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.283+0000 7f7f267fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f30100e80 0x7f7f30197220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56358/0 (socket says 172.21.15.26:56358) 2023-12-01T01:06:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.284+0000 7f7f267fc700 1 -- 172.21.15.26:0/2244451824 learned_addr learned my addr 172.21.15.26:0/2244451824 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:24.288 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.284+0000 7f7f2effd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f300ffc90 0x7f7f30196ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.284+0000 7f7f2f7fe700 1 --2- 172.21.15.26:0/2244451824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f30101820 0x7f7f30197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.284+0000 7f7f267fc700 1 -- 172.21.15.26:0/2244451824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f30101820 msgr2=0x7f7f30197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.284+0000 7f7f267fc700 1 --2- 172.21.15.26:0/2244451824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f30101820 0x7f7f30197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.284+0000 7f7f267fc700 1 -- 172.21.15.26:0/2244451824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f300ffc90 msgr2=0x7f7f30196ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.284+0000 7f7f267fc700 1 --2- 172.21.15.26:0/2244451824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f300ffc90 0x7f7f30196ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.284+0000 7f7f267fc700 1 -- 172.21.15.26:0/2244451824 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f180095f0 con 0x7f7f30100e80 2023-12-01T01:06:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.284+0000 7f7f2effd700 1 --2- 172.21.15.26:0/2244451824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f300ffc90 0x7f7f30196ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:06:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.284+0000 7f7f2f7fe700 1 --2- 172.21.15.26:0/2244451824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f30101820 0x7f7f30197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:06:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.284+0000 7f7f267fc700 1 --2- 172.21.15.26:0/2244451824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f30100e80 0x7f7f30197220 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800f690 tx=0x7f7f1800bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.284+0000 7f7f2cff9700 1 -- 172.21.15.26:0/2244451824 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1801d070 con 0x7f7f30100e80 2023-12-01T01:06:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.284+0000 7f7f2cff9700 1 -- 172.21.15.26:0/2244451824 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7f1800fb70 con 0x7f7f30100e80 2023-12-01T01:06:24.289 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.284+0000 7f7f3526c700 1 -- 172.21.15.26:0/2244451824 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f30198c10 con 0x7f7f30100e80 2023-12-01T01:06:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.284+0000 7f7f2cff9700 1 -- 172.21.15.26:0/2244451824 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f180173f0 con 0x7f7f30100e80 2023-12-01T01:06:24.290 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.284+0000 7f7f3526c700 1 -- 172.21.15.26:0/2244451824 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3019f390 con 0x7f7f30100e80 2023-12-01T01:06:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.286+0000 7f7f2cff9700 1 -- 172.21.15.26:0/2244451824 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f7f1800fce0 con 0x7f7f30100e80 2023-12-01T01:06:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.287+0000 7f7f2cff9700 1 --2- 172.21.15.26:0/2244451824 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7f1c0a05a0 0x7f7f1c0a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.287+0000 7f7f2cff9700 1 -- 172.21.15.26:0/2244451824 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7f180cca50 con 0x7f7f30100e80 2023-12-01T01:06:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.287+0000 7f7f2effd700 1 --2- 172.21.15.26:0/2244451824 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7f1c0a05a0 0x7f7f1c0a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.288+0000 7f7f2effd700 1 --2- 172.21.15.26:0/2244451824 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7f1c0a05a0 0x7f7f1c0a2a60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7f30100ce0 tx=0x7f7f20009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.288+0000 7f7f413fcb80 1 Processor -- start 2023-12-01T01:06:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.288+0000 7f7f413fcb80 1 -- start start 2023-12-01T01:06:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.288+0000 7f7f413fcb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268aa90 0x55ddc268aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.297 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.288+0000 7f7f413fcb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268b3f0 0x55ddc268bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.298 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.288+0000 7f7f413fcb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268c2e0 0x55ddc268c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.298 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.288+0000 7f7f413fcb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc25de9b0 con 0x55ddc268b3f0 2023-12-01T01:06:24.298 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.288+0000 7f7f413fcb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc25dc370 con 0x55ddc268aa90 2023-12-01T01:06:24.298 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.288+0000 7f7f413fcb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc25d7c60 con 0x55ddc268c2e0 2023-12-01T01:06:24.298 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.289+0000 7f7f267fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268b3f0 0x55ddc268bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.298 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.289+0000 7f7f2effd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268aa90 0x55ddc268aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.298 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.289+0000 7f7f267fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268b3f0 0x55ddc268bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56366/0 (socket says 172.21.15.26:56366) 2023-12-01T01:06:24.298 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.289+0000 7f7f2effd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268aa90 0x55ddc268aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:47102/0 (socket says 172.21.15.26:47102) 2023-12-01T01:06:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.289+0000 7f7f267fc700 1 -- 172.21.15.26:0/2949095841 learned_addr learned my addr 172.21.15.26:0/2949095841 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.289+0000 7f7f2f7fe700 1 --2- 172.21.15.26:0/2949095841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268c2e0 0x55ddc268c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.289+0000 7f7f267fc700 1 -- 172.21.15.26:0/2949095841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268c2e0 msgr2=0x55ddc268c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.289+0000 7f7f267fc700 1 --2- 172.21.15.26:0/2949095841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268c2e0 0x55ddc268c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.289+0000 7f7f267fc700 1 -- 172.21.15.26:0/2949095841 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268aa90 msgr2=0x55ddc268aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.289+0000 7f7f267fc700 1 --2- 172.21.15.26:0/2949095841 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268aa90 0x55ddc268aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.289+0000 7f7f267fc700 1 -- 172.21.15.26:0/2949095841 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddc2405d80 con 0x55ddc268b3f0 2023-12-01T01:06:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.289+0000 7f7f267fc700 1 --2- 172.21.15.26:0/2949095841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268b3f0 0x55ddc268bd00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7f18096850 tx=0x7f7f18000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acdfd2d081982be server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.289+0000 7f7f257fa700 1 -- 172.21.15.26:0/2949095841 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18099cb0 con 0x55ddc268b3f0 2023-12-01T01:06:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.289+0000 7f7f257fa700 1 -- 172.21.15.26:0/2949095841 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7f1809aa50 con 0x55ddc268b3f0 2023-12-01T01:06:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.289+0000 7f7f257fa700 1 -- 172.21.15.26:0/2949095841 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1809a810 con 0x55ddc268b3f0 2023-12-01T01:06:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.290+0000 7f7f413fcb80 1 -- 172.21.15.26:0/2949095841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268b3f0 msgr2=0x55ddc268bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.290+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/2949095841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268b3f0 0x55ddc268bd00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f7f18096850 tx=0x7f7f18000bc0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.299 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.290+0000 7f7f413fcb80 1 -- 172.21.15.26:0/2949095841 shutdown_connections 2023-12-01T01:06:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.290+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/2949095841 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268c2e0 0x55ddc268c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.290+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/2949095841 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268aa90 0x55ddc268aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.290+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/2949095841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268b3f0 0x55ddc268bd00 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.290+0000 7f7f413fcb80 1 -- 172.21.15.26:0/2949095841 >> 172.21.15.26:0/2949095841 conn(0x55ddc25e6070 msgr2=0x55ddc2683040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.290+0000 7f7f413fcb80 1 -- 172.21.15.26:0/2949095841 shutdown_connections 2023-12-01T01:06:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.290+0000 7f7f413fcb80 1 -- 172.21.15.26:0/2949095841 wait complete. 2023-12-01T01:06:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f413fcb80 1 -- start start 2023-12-01T01:06:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f413fcb80 1 Processor -- start 2023-12-01T01:06:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f413fcb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc2694520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f413fcb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268b3f0 0x55ddc2694a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f413fcb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 0x55ddc269baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.300 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f413fcb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc25744b0 con 0x55ddc268aa90 2023-12-01T01:06:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f413fcb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc2574150 con 0x55ddc268c2e0 2023-12-01T01:06:24.301 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f413fcb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc245b8c0 con 0x55ddc268b3f0 2023-12-01T01:06:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f413fcb80 10 client.0 _ll_register_callbacks cb 0x55ddc24c1a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f2effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc2694520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f2effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc2694520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56370/0 (socket says 172.21.15.26:56370) 2023-12-01T01:06:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f2effd700 1 -- 172.21.15.26:0/1217159934 learned_addr learned my addr 172.21.15.26:0/1217159934 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f2f7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 0x55ddc269baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f267fc700 1 --2- 172.21.15.26:0/1217159934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268b3f0 0x55ddc2694a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f2f7fe700 1 -- 172.21.15.26:0/1217159934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268b3f0 msgr2=0x55ddc2694a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f2f7fe700 1 --2- 172.21.15.26:0/1217159934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268b3f0 0x55ddc2694a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f2f7fe700 1 -- 172.21.15.26:0/1217159934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 msgr2=0x55ddc2694520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f2f7fe700 1 --2- 172.21.15.26:0/1217159934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc2694520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.291+0000 7f7f2f7fe700 1 -- 172.21.15.26:0/1217159934 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3019f390 con 0x55ddc268c2e0 2023-12-01T01:06:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.292+0000 7f7f2f7fe700 1 --2- 172.21.15.26:0/1217159934 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 0x55ddc269baa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7f28007a60 tx=0x7f7f28007d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77d35f21ccc9a8fc server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:24.302 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.292+0000 7f7f167fc700 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-12-01T01:06:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.292+0000 7f7f167fc700 1 -- 172.21.15.26:0/1217159934 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2800e070 con 0x55ddc268c2e0 2023-12-01T01:06:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.292+0000 7f7f413fcb80 1 -- 172.21.15.26:0/1217159934 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ddc2602cb0 con 0x55ddc268c2e0 2023-12-01T01:06:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.292+0000 7f7f167fc700 1 -- 172.21.15.26:0/1217159934 <== mon.2 v2:172.21.15.93:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7f28003c00 con 0x55ddc268c2e0 2023-12-01T01:06:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.292+0000 7f7f167fc700 1 -- 172.21.15.26:0/1217159934 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f28003dc0 con 0x55ddc268c2e0 2023-12-01T01:06:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.292+0000 7f7f413fcb80 10 client.25523 fetch_fsmap learned FSMap version 29 2023-12-01T01:06:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.292+0000 7f7f413fcb80 1 -- 172.21.15.26:0/1217159934 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ddc23eec00 con 0x55ddc268c2e0 2023-12-01T01:06:24.303 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.292+0000 7f7f167fc700 1 -- 172.21.15.26:0/1217159934 <== mon.2 v2:172.21.15.93:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55ddc2602cb0 con 0x55ddc268c2e0 2023-12-01T01:06:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.292+0000 7f7f167fc700 1 -- 172.21.15.26:0/1217159934 <== mon.2 v2:172.21.15.93:3300/0 5 ==== fsmap(e 29) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f7f28014040 con 0x55ddc268c2e0 2023-12-01T01:06:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.292+0000 7f7f413fcb80 10 client.25523 fetch_fsmap finished waiting for FSMap version 29 2023-12-01T01:06:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.292+0000 7f7f413fcb80 10 client.25523 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:06:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.292+0000 7f7f413fcb80 20 client.25523 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.292+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/1217159934 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ddc26a03b0 0x55ddc26a27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.292+0000 7f7f413fcb80 4 client.25523 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:06:24.304 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.292+0000 7f7f413fcb80 1 -- 172.21.15.26:0/1217159934 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ddc2655db0 con 0x55ddc26a03b0 2023-12-01T01:06:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.293+0000 7f7f2effd700 1 --2- 172.21.15.26:0/1217159934 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ddc26a03b0 0x55ddc26a27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.293+0000 7f7f167fc700 10 client.25523 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.293+0000 7f7f2effd700 1 --2- 172.21.15.26:0/1217159934 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ddc26a03b0 0x55ddc26a27d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b393f2bc1dfd23bc server_cookie=14066f8c14f138a9 in_seq=0 out_seq=0 2023-12-01T01:06:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.294+0000 7f7f167fc700 1 -- 172.21.15.26:0/1217159934 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55ddc2655db0 con 0x55ddc26a03b0 2023-12-01T01:06:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.294+0000 7f7f167fc700 10 client.25523 handle_command_reply: tid=0 2023-12-01T01:06:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.294+0000 7f7f413fcb80 1 client.25523 shutdown 2023-12-01T01:06:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.295+0000 7f7f413fcb80 1 -- 172.21.15.26:0/1217159934 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 msgr2=0x55ddc269baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.295+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/1217159934 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 0x55ddc269baa0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7f28007a60 tx=0x7f7f28007d70 comp rx=0 tx=0).stop 2023-12-01T01:06:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.295+0000 7f7f413fcb80 1 -- 172.21.15.26:0/1217159934 shutdown_connections 2023-12-01T01:06:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.295+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/1217159934 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ddc26a03b0 0x55ddc26a27d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.295+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/1217159934 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 0x55ddc269baa0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.305 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.295+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/1217159934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc2694520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.295+0000 7f7f167fc700 0 client.25523 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.295+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/1217159934 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268b3f0 0x55ddc2694a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.295+0000 7f7f413fcb80 1 -- 172.21.15.26:0/1217159934 >> 172.21.15.26:0/1217159934 conn(0x55ddc25e6070 msgr2=0x55ddc26813c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.295+0000 7f7f413fcb80 1 -- 172.21.15.26:0/1217159934 shutdown_connections 2023-12-01T01:06:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.295+0000 7f7f413fcb80 1 -- 172.21.15.26:0/1217159934 wait complete. 2023-12-01T01:06:24.306 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.295+0000 7f7f413fcb80 20 client.25523 trim_cache size 0 max 16384 2023-12-01T01:06:24.313 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.310+0000 7f7f413fcb80 1 Processor -- start 2023-12-01T01:06:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.310+0000 7f7f413fcb80 1 -- start start 2023-12-01T01:06:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f413fcb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc2699a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f413fcb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268b3f0 0x55ddc268c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f413fcb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 0x55ddc2682ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f413fcb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc267c500 con 0x55ddc268aa90 2023-12-01T01:06:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f413fcb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc2694090 con 0x55ddc268c2e0 2023-12-01T01:06:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f413fcb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc26831e0 con 0x55ddc268b3f0 2023-12-01T01:06:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f2effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc2699a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f2effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc2699a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56378/0 (socket says 172.21.15.26:56378) 2023-12-01T01:06:24.314 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f2effd700 1 -- 172.21.15.26:0/3348621612 learned_addr learned my addr 172.21.15.26:0/3348621612 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f2f7fe700 1 --2- 172.21.15.26:0/3348621612 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 0x55ddc2682ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f267fc700 1 --2- 172.21.15.26:0/3348621612 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268b3f0 0x55ddc268c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f2effd700 1 -- 172.21.15.26:0/3348621612 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268b3f0 msgr2=0x55ddc268c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f2effd700 1 --2- 172.21.15.26:0/3348621612 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268b3f0 0x55ddc268c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f2effd700 1 -- 172.21.15.26:0/3348621612 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 msgr2=0x55ddc2682ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f2effd700 1 --2- 172.21.15.26:0/3348621612 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 0x55ddc2682ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f2effd700 1 -- 172.21.15.26:0/3348621612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddc242c1f0 con 0x55ddc268aa90 2023-12-01T01:06:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f2f7fe700 1 --2- 172.21.15.26:0/3348621612 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 0x55ddc2682ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:06:24.315 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f2effd700 1 --2- 172.21.15.26:0/3348621612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc2699a50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7f20013010 tx=0x7f7f20014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201f20f936df9739 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f25ffb700 1 -- 172.21.15.26:0/3348621612 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f20024040 con 0x55ddc268aa90 2023-12-01T01:06:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f25ffb700 1 -- 172.21.15.26:0/3348621612 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7f20004d10 con 0x55ddc268aa90 2023-12-01T01:06:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.311+0000 7f7f25ffb700 1 -- 172.21.15.26:0/3348621612 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f20005610 con 0x55ddc268aa90 2023-12-01T01:06:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.312+0000 7f7f413fcb80 1 -- 172.21.15.26:0/3348621612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 msgr2=0x55ddc2699a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.312+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/3348621612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc2699a50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f7f20013010 tx=0x7f7f20014000 comp rx=0 tx=0).stop 2023-12-01T01:06:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.312+0000 7f7f413fcb80 1 -- 172.21.15.26:0/3348621612 shutdown_connections 2023-12-01T01:06:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.312+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/3348621612 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 0x55ddc2682ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.312+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/3348621612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc2699a50 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.312+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/3348621612 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268b3f0 0x55ddc268c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.312+0000 7f7f413fcb80 1 -- 172.21.15.26:0/3348621612 >> 172.21.15.26:0/3348621612 conn(0x55ddc25e6070 msgr2=0x55ddc268f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.312+0000 7f7f413fcb80 1 -- 172.21.15.26:0/3348621612 shutdown_connections 2023-12-01T01:06:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.312+0000 7f7f413fcb80 1 -- 172.21.15.26:0/3348621612 wait complete. 2023-12-01T01:06:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f413fcb80 1 -- start start 2023-12-01T01:06:24.316 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f413fcb80 1 Processor -- start 2023-12-01T01:06:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f413fcb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc26ec040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f413fcb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268b3f0 0x55ddc26ee590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f413fcb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 0x55ddc26f0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f413fcb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc26f1310 con 0x55ddc268aa90 2023-12-01T01:06:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f413fcb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc26f1480 con 0x55ddc268c2e0 2023-12-01T01:06:24.319 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f413fcb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddc26f1640 con 0x55ddc268b3f0 2023-12-01T01:06:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f413fcb80 10 client.0 _ll_register_callbacks cb 0x7f7f28009450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f2effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc26ec040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f2effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc26ec040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56384/0 (socket says 172.21.15.26:56384) 2023-12-01T01:06:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f2effd700 1 -- 172.21.15.26:0/1000806909 learned_addr learned my addr 172.21.15.26:0/1000806909 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f267fc700 1 --2- 172.21.15.26:0/1000806909 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268b3f0 0x55ddc26ee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f2f7fe700 1 --2- 172.21.15.26:0/1000806909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 0x55ddc26f0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f2effd700 1 -- 172.21.15.26:0/1000806909 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268b3f0 msgr2=0x55ddc26ee590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f2effd700 1 --2- 172.21.15.26:0/1000806909 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268b3f0 0x55ddc26ee590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f2effd700 1 -- 172.21.15.26:0/1000806909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 msgr2=0x55ddc26f0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f2effd700 1 --2- 172.21.15.26:0/1000806909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 0x55ddc26f0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.313+0000 7f7f2effd700 1 -- 172.21.15.26:0/1000806909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ddc23eec00 con 0x55ddc268aa90 2023-12-01T01:06:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.314+0000 7f7f2effd700 1 --2- 172.21.15.26:0/1000806909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc26ec040 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7f20011bb0 tx=0x7f7f20005090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d7c54d66566961 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.314+0000 7f7f167fc700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:06:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.314+0000 7f7f167fc700 1 -- 172.21.15.26:0/1000806909 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f20024050 con 0x55ddc268aa90 2023-12-01T01:06:24.320 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.314+0000 7f7f413fcb80 1 -- 172.21.15.26:0/1000806909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f1809aa50 con 0x55ddc268aa90 2023-12-01T01:06:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.314+0000 7f7f167fc700 1 -- 172.21.15.26:0/1000806909 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f7f20005550 con 0x55ddc268aa90 2023-12-01T01:06:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.314+0000 7f7f167fc700 1 -- 172.21.15.26:0/1000806909 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f20040030 con 0x55ddc268aa90 2023-12-01T01:06:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.314+0000 7f7f413fcb80 10 client.15891 fetch_fsmap learned FSMap version 29 2023-12-01T01:06:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.314+0000 7f7f413fcb80 1 -- 172.21.15.26:0/1000806909 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f7f20017070 con 0x55ddc268aa90 2023-12-01T01:06:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.314+0000 7f7f167fc700 1 -- 172.21.15.26:0/1000806909 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f7f1809aa50 con 0x55ddc268aa90 2023-12-01T01:06:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.314+0000 7f7f167fc700 1 -- 172.21.15.26:0/1000806909 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 29) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f7f2002f020 con 0x55ddc268aa90 2023-12-01T01:06:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.314+0000 7f7f413fcb80 10 client.15891 fetch_fsmap finished waiting for FSMap version 29 2023-12-01T01:06:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.314+0000 7f7f413fcb80 10 client.15891 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:06:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.314+0000 7f7f413fcb80 20 client.15891 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.314+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/1000806909 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ddc26f3030 0x55ddc26f5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.314+0000 7f7f413fcb80 4 client.15891 mds_command: new command op to 24509 tid=0[{"prefix": "flush journal"}] 2023-12-01T01:06:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.314+0000 7f7f413fcb80 1 -- 172.21.15.26:0/1000806909 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ddc25d0ce0 con 0x55ddc26f3030 2023-12-01T01:06:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.315+0000 7f7f267fc700 1 --2- 172.21.15.26:0/1000806909 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ddc26f3030 0x55ddc26f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.315+0000 7f7f167fc700 10 client.15891 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:24.321 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:24.315+0000 7f7f267fc700 1 --2- 172.21.15.26:0/1000806909 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ddc26f3030 0x55ddc26f5450 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ec0a8e93a24278 server_cookie=48f803fd81bd3139 in_seq=0 out_seq=0 2023-12-01T01:06:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.394+0000 7f7f167fc700 1 -- 172.21.15.26:0/1000806909 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ddc25d0ce0 con 0x55ddc26f3030 2023-12-01T01:06:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.394+0000 7f7f167fc700 10 client.15891 handle_command_reply: tid=0 2023-12-01T01:06:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.394+0000 7f7f413fcb80 1 client.15891 shutdown 2023-12-01T01:06:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.394+0000 7f7f413fcb80 1 -- 172.21.15.26:0/1000806909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 msgr2=0x55ddc26ec040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.394+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/1000806909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc26ec040 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f7f20011bb0 tx=0x7f7f20005090 comp rx=0 tx=0).stop 2023-12-01T01:06:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.394+0000 7f7f413fcb80 1 -- 172.21.15.26:0/1000806909 shutdown_connections 2023-12-01T01:06:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.394+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/1000806909 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ddc26f3030 0x55ddc26f5450 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.394+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/1000806909 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ddc268c2e0 0x55ddc26f0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.394+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/1000806909 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ddc268aa90 0x55ddc26ec040 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:25.396 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.394+0000 7f7f167fc700 0 client.15891 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.394+0000 7f7f413fcb80 1 --2- 172.21.15.26:0/1000806909 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ddc268b3f0 0x55ddc26ee590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.394+0000 7f7f413fcb80 1 -- 172.21.15.26:0/1000806909 >> 172.21.15.26:0/1000806909 conn(0x55ddc25e6070 msgr2=0x55ddc2692660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.394+0000 7f7f413fcb80 1 -- 172.21.15.26:0/1000806909 shutdown_connections 2023-12-01T01:06:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.394+0000 7f7f413fcb80 1 -- 172.21.15.26:0/1000806909 wait complete. 2023-12-01T01:06:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.395+0000 7f7f413fcb80 20 client.15891 trim_cache size 0 max 16384 2023-12-01T01:06:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:{ 2023-12-01T01:06:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "message": "", 2023-12-01T01:06:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "return_code": 0 2023-12-01T01:06:25.397 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:} 2023-12-01T01:06:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.395+0000 7f7f3526c700 1 -- 172.21.15.26:0/2244451824 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7f1c0a05a0 msgr2=0x7f7f1c0a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.395+0000 7f7f3526c700 1 --2- 172.21.15.26:0/2244451824 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7f1c0a05a0 0x7f7f1c0a2a60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7f30100ce0 tx=0x7f7f20009260 comp rx=0 tx=0).stop 2023-12-01T01:06:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.395+0000 7f7f3526c700 1 -- 172.21.15.26:0/2244451824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f30100e80 msgr2=0x7f7f30197220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.395+0000 7f7f3526c700 1 --2- 172.21.15.26:0/2244451824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f30100e80 0x7f7f30197220 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800f690 tx=0x7f7f1800bfd0 comp rx=0 tx=0).stop 2023-12-01T01:06:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.395+0000 7f7f3526c700 1 -- 172.21.15.26:0/2244451824 shutdown_connections 2023-12-01T01:06:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.395+0000 7f7f3526c700 1 --2- 172.21.15.26:0/2244451824 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f7f1c0a05a0 0x7f7f1c0a2a60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.395+0000 7f7f3526c700 1 --2- 172.21.15.26:0/2244451824 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7f30101820 0x7f7f30197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.395+0000 7f7f3526c700 1 --2- 172.21.15.26:0/2244451824 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7f300ffc90 0x7f7f30196ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.395+0000 7f7f3526c700 1 --2- 172.21.15.26:0/2244451824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f30100e80 0x7f7f30197220 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.395+0000 7f7f3526c700 1 -- 172.21.15.26:0/2244451824 >> 172.21.15.26:0/2244451824 conn(0x7f7f300fb1e0 msgr2=0x7f7f300681a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.395+0000 7f7f3526c700 1 -- 172.21.15.26:0/2244451824 shutdown_connections 2023-12-01T01:06:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:25.395+0000 7f7f3526c700 1 -- 172.21.15.26:0/2244451824 wait complete. 2023-12-01T01:06:25.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:25 smithi116 ceph-mon[103554]: pgmap v357: 97 pgs: 97 active+clean; 148 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 347 op/s 2023-12-01T01:06:25.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:25 smithi116 ceph-mon[103554]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:06:25.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:25 smithi093 ceph-mon[103327]: pgmap v357: 97 pgs: 97 active+clean; 148 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 347 op/s 2023-12-01T01:06:25.716 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:25 smithi093 ceph-mon[103327]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:06:25.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:25 smithi026 ceph-mon[98801]: pgmap v357: 97 pgs: 97 active+clean; 148 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 347 op/s 2023-12-01T01:06:25.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:25 smithi026 ceph-mon[98801]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:06:27.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:27 smithi116 ceph-mon[103554]: pgmap v358: 97 pgs: 97 active+clean; 147 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 450 op/s 2023-12-01T01:06:27.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:27 smithi093 ceph-mon[103327]: pgmap v358: 97 pgs: 97 active+clean; 147 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 450 op/s 2023-12-01T01:06:27.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:27 smithi026 ceph-mon[98801]: pgmap v358: 97 pgs: 97 active+clean; 147 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 450 op/s 2023-12-01T01:06:28.168 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-01T01:06:28.299 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.296+0000 7fbfb080b700 1 -- 172.21.15.26:0/876950248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac101810 msgr2=0x7fbfac1080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:28.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.296+0000 7fbfb080b700 1 --2- 172.21.15.26:0/876950248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac101810 0x7fbfac1080c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400b0d0 tx=0x7fbfa400b3e0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.296+0000 7fbfb080b700 1 -- 172.21.15.26:0/876950248 shutdown_connections 2023-12-01T01:06:28.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.296+0000 7fbfb080b700 1 --2- 172.21.15.26:0/876950248 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac101810 0x7fbfac1080c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.296+0000 7fbfb080b700 1 --2- 172.21.15.26:0/876950248 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfac0ffc80 0x7fbfac1000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.296+0000 7fbfb080b700 1 --2- 172.21.15.26:0/876950248 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbfac100e70 0x7fbfac1012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.296+0000 7fbfb080b700 1 -- 172.21.15.26:0/876950248 >> 172.21.15.26:0/876950248 conn(0x7fbfac0fb1f0 msgr2=0x7fbfac0fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:28.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.297+0000 7fbfb080b700 1 -- 172.21.15.26:0/876950248 shutdown_connections 2023-12-01T01:06:28.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.297+0000 7fbfb080b700 1 -- 172.21.15.26:0/876950248 wait complete. 2023-12-01T01:06:28.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.297+0000 7fbfb080b700 1 Processor -- start 2023-12-01T01:06:28.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.297+0000 7fbfb080b700 1 -- start start 2023-12-01T01:06:28.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.297+0000 7fbfb080b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbfac0ffc80 0x7fbfac068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.297+0000 7fbfb080b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfac100e70 0x7fbfac19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.300 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.297+0000 7fbfb080b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac101810 0x7fbfac19dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfb080b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac19e780 con 0x7fbfac101810 2023-12-01T01:06:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfb080b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac19e8f0 con 0x7fbfac0ffc80 2023-12-01T01:06:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfb080b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfac19eab0 con 0x7fbfac100e70 2023-12-01T01:06:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfaad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac101810 0x7fbfac19dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfaa59c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbfac0ffc80 0x7fbfac068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfaad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac101810 0x7fbfac19dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56402/0 (socket says 172.21.15.26:56402) 2023-12-01T01:06:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfaad9d700 1 -- 172.21.15.26:0/4103900707 learned_addr learned my addr 172.21.15.26:0/4103900707 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfa9d9b700 1 --2- 172.21.15.26:0/4103900707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfac100e70 0x7fbfac19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfaad9d700 1 -- 172.21.15.26:0/4103900707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfac100e70 msgr2=0x7fbfac19b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfaad9d700 1 --2- 172.21.15.26:0/4103900707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfac100e70 0x7fbfac19b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfaad9d700 1 -- 172.21.15.26:0/4103900707 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbfac0ffc80 msgr2=0x7fbfac068a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfaad9d700 1 --2- 172.21.15.26:0/4103900707 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbfac0ffc80 0x7fbfac068a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfaad9d700 1 -- 172.21.15.26:0/4103900707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa4009d00 con 0x7fbfac101810 2023-12-01T01:06:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfaa59c700 1 --2- 172.21.15.26:0/4103900707 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbfac0ffc80 0x7fbfac068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:06:28.301 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfaad9d700 1 --2- 172.21.15.26:0/4103900707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac101810 0x7fbfac19dfe0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400d010 tx=0x7fbfa400bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:28.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbf9b7fe700 1 -- 172.21.15.26:0/4103900707 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa400e040 con 0x7fbfac101810 2023-12-01T01:06:28.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfb080b700 1 -- 172.21.15.26:0/4103900707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfac19ed30 con 0x7fbfac101810 2023-12-01T01:06:28.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbf9b7fe700 1 -- 172.21.15.26:0/4103900707 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbfa4006060 con 0x7fbfac101810 2023-12-01T01:06:28.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbf9b7fe700 1 -- 172.21.15.26:0/4103900707 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa401be10 con 0x7fbfac101810 2023-12-01T01:06:28.302 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.298+0000 7fbfb080b700 1 -- 172.21.15.26:0/4103900707 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfac195770 con 0x7fbfac101810 2023-12-01T01:06:28.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.300+0000 7fbf9b7fe700 1 -- 172.21.15.26:0/4103900707 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fbfa401b450 con 0x7fbfac101810 2023-12-01T01:06:28.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.301+0000 7fbf9b7fe700 1 --2- 172.21.15.26:0/4103900707 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbf940a4930 0x7fbf940a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.301+0000 7fbfaa59c700 1 --2- 172.21.15.26:0/4103900707 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbf940a4930 0x7fbf940a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.301+0000 7fbf9b7fe700 1 -- 172.21.15.26:0/4103900707 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbfa40cd220 con 0x7fbfac101810 2023-12-01T01:06:28.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.302+0000 7fbfaa59c700 1 --2- 172.21.15.26:0/4103900707 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbf940a4930 0x7fbf940a6df0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbfac100cd0 tx=0x7fbf9c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:28.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.302+0000 7fbfbc99bb80 1 Processor -- start 2023-12-01T01:06:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.302+0000 7fbfbc99bb80 1 -- start start 2023-12-01T01:06:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfbc99bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 0x564fc3cf8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfbc99bb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf8a70 0x564fc3cf6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfbc99bb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf73f0 0x564fc3cf7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfbc99bb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc3c4ea10 con 0x564fc3cf73f0 2023-12-01T01:06:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfbc99bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc3c4c3d0 con 0x564fc3cf80f0 2023-12-01T01:06:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfbc99bb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc3c47cc0 con 0x564fc3cf8a70 2023-12-01T01:06:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfaad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf73f0 0x564fc3cf7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfaad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf73f0 0x564fc3cf7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56410/0 (socket says 172.21.15.26:56410) 2023-12-01T01:06:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfaad9d700 1 -- 172.21.15.26:0/1952379939 learned_addr learned my addr 172.21.15.26:0/1952379939 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfaa59c700 1 --2- 172.21.15.26:0/1952379939 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 0x564fc3cf8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfa9d9b700 1 --2- 172.21.15.26:0/1952379939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf8a70 0x564fc3cf6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfaad9d700 1 -- 172.21.15.26:0/1952379939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf8a70 msgr2=0x564fc3cf6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfaad9d700 1 --2- 172.21.15.26:0/1952379939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf8a70 0x564fc3cf6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfaad9d700 1 -- 172.21.15.26:0/1952379939 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 msgr2=0x564fc3cf8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfaad9d700 1 --2- 172.21.15.26:0/1952379939 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 0x564fc3cf8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfaad9d700 1 -- 172.21.15.26:0/1952379939 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fc3a75de0 con 0x564fc3cf73f0 2023-12-01T01:06:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfa9d9b700 1 --2- 172.21.15.26:0/1952379939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf8a70 0x564fc3cf6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:06:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfaa59c700 1 --2- 172.21.15.26:0/1952379939 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 0x564fc3cf8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:06:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbfaad9d700 1 --2- 172.21.15.26:0/1952379939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf73f0 0x564fc3cf7870 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4097020 tx=0x7fbfa409a9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9152f1eb73ef4f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.303+0000 7fbf98ff9700 1 -- 172.21.15.26:0/1952379939 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa409ab20 con 0x564fc3cf73f0 2023-12-01T01:06:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.304+0000 7fbf98ff9700 1 -- 172.21.15.26:0/1952379939 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbfa409e950 con 0x564fc3cf73f0 2023-12-01T01:06:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.304+0000 7fbf98ff9700 1 -- 172.21.15.26:0/1952379939 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa409afa0 con 0x564fc3cf73f0 2023-12-01T01:06:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.304+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1952379939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf73f0 msgr2=0x564fc3cf7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.304+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/1952379939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf73f0 0x564fc3cf7870 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4097020 tx=0x7fbfa409a9c0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.304+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1952379939 shutdown_connections 2023-12-01T01:06:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.304+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/1952379939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf73f0 0x564fc3cf7870 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.304+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/1952379939 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 0x564fc3cf8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.304+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/1952379939 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf8a70 0x564fc3cf6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.304+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1952379939 >> 172.21.15.26:0/1952379939 conn(0x564fc3c560d0 msgr2=0x564fc3cf1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:28.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.304+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1952379939 shutdown_connections 2023-12-01T01:06:28.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.304+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1952379939 wait complete. 2023-12-01T01:06:28.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.305+0000 7fbfbc99bb80 1 -- start start 2023-12-01T01:06:28.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.305+0000 7fbfbc99bb80 1 Processor -- start 2023-12-01T01:06:28.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.305+0000 7fbfbc99bb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf73f0 0x564fc3d00790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.305+0000 7fbfbc99bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 0x564fc3d00cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.305+0000 7fbfbc99bb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf8a70 0x564fc3d07d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.305+0000 7fbfbc99bb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc3be4510 con 0x564fc3cf73f0 2023-12-01T01:06:28.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.305+0000 7fbfbc99bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc3be41b0 con 0x564fc3cf80f0 2023-12-01T01:06:28.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.305+0000 7fbfbc99bb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc3acb920 con 0x564fc3cf8a70 2023-12-01T01:06:28.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.305+0000 7fbfbc99bb80 10 client.0 _ll_register_callbacks cb 0x564fc3b31a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:28.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.305+0000 7fbfaa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf73f0 0x564fc3d00790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.305+0000 7fbfaa59c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf73f0 0x564fc3d00790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56412/0 (socket says 172.21.15.26:56412) 2023-12-01T01:06:28.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.305+0000 7fbfaa59c700 1 -- 172.21.15.26:0/1215426493 learned_addr learned my addr 172.21.15.26:0/1215426493 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.305+0000 7fbfa9d9b700 1 --2- 172.21.15.26:0/1215426493 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 0x564fc3d00cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.305+0000 7fbfaad9d700 1 --2- 172.21.15.26:0/1215426493 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf8a70 0x564fc3d07d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.305+0000 7fbfaa59c700 1 -- 172.21.15.26:0/1215426493 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf8a70 msgr2=0x564fc3d07d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbfaa59c700 1 --2- 172.21.15.26:0/1215426493 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf8a70 0x564fc3d07d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbfaa59c700 1 -- 172.21.15.26:0/1215426493 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 msgr2=0x564fc3d00cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbfaa59c700 1 --2- 172.21.15.26:0/1215426493 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 0x564fc3d00cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbfaa59c700 1 -- 172.21.15.26:0/1215426493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf9c017070 con 0x564fc3cf73f0 2023-12-01T01:06:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbfaad9d700 1 --2- 172.21.15.26:0/1215426493 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf8a70 0x564fc3d07d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:06:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbfa9d9b700 1 --2- 172.21.15.26:0/1215426493 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 0x564fc3d00cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:06:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbfaa59c700 1 --2- 172.21.15.26:0/1215426493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf73f0 0x564fc3d00790 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c0039b0 tx=0x7fbf9c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf00105d9e92aad server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbf91ffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:06:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbf91ffb700 1 -- 172.21.15.26:0/1215426493 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c01fcd0 con 0x564fc3cf73f0 2023-12-01T01:06:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbf91ffb700 1 -- 172.21.15.26:0/1215426493 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbf9c01fe30 con 0x564fc3cf73f0 2023-12-01T01:06:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1215426493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564fc3c72d10 con 0x564fc3cf73f0 2023-12-01T01:06:28.312 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbf91ffb700 1 -- 172.21.15.26:0/1215426493 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf9c004830 con 0x564fc3cf73f0 2023-12-01T01:06:28.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbfbc99bb80 10 client.15903 fetch_fsmap learned FSMap version 31 2023-12-01T01:06:28.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1215426493 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7fbfac195770 con 0x564fc3cf73f0 2023-12-01T01:06:28.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbf91ffb700 1 -- 172.21.15.26:0/1215426493 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x564fc3c72d10 con 0x564fc3cf73f0 2023-12-01T01:06:28.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbf91ffb700 1 -- 172.21.15.26:0/1215426493 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 31) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fbf9c0313f0 con 0x564fc3cf73f0 2023-12-01T01:06:28.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbfbc99bb80 10 client.15903 fetch_fsmap finished waiting for FSMap version 31 2023-12-01T01:06:28.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbfbc99bb80 10 client.15903 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:06:28.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbfbc99bb80 20 client.15903 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:28.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.306+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/1215426493 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x564fc3d0c5c0 0x564fc3d0e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.307+0000 7fbfbc99bb80 4 client.15903 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:06:28.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.307+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1215426493 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564fc3cc5e10 con 0x564fc3d0c5c0 2023-12-01T01:06:28.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.309+0000 7fbfa9d9b700 1 --2- 172.21.15.26:0/1215426493 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x564fc3d0c5c0 0x564fc3d0e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.309+0000 7fbfa9d9b700 1 --2- 172.21.15.26:0/1215426493 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x564fc3d0c5c0 0x564fc3d0e9e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2623716f294b4181 server_cookie=e19545e617eea003 in_seq=0 out_seq=0 2023-12-01T01:06:28.313 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.309+0000 7fbf91ffb700 10 client.15903 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:28.314 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.311+0000 7fbf91ffb700 1 -- 172.21.15.26:0/1215426493 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x564fc3cc5e10 con 0x564fc3d0c5c0 2023-12-01T01:06:28.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.311+0000 7fbf91ffb700 10 client.15903 handle_command_reply: tid=0 2023-12-01T01:06:28.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.311+0000 7fbfbc99bb80 1 client.15903 shutdown 2023-12-01T01:06:28.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.312+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1215426493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf73f0 msgr2=0x564fc3d00790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:28.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.312+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/1215426493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf73f0 0x564fc3d00790 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c0039b0 tx=0x7fbf9c0047c0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.315 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.312+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1215426493 shutdown_connections 2023-12-01T01:06:28.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.312+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/1215426493 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x564fc3d0c5c0 0x564fc3d0e9e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.312+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/1215426493 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf8a70 0x564fc3d07d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.312+0000 7fbf91ffb700 0 client.15903 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:28.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.312+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/1215426493 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf73f0 0x564fc3d00790 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.312+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/1215426493 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 0x564fc3d00cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.312+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1215426493 >> 172.21.15.26:0/1215426493 conn(0x564fc3c560d0 msgr2=0x564fc3cf10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:28.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.312+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1215426493 shutdown_connections 2023-12-01T01:06:28.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.312+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1215426493 wait complete. 2023-12-01T01:06:28.316 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.312+0000 7fbfbc99bb80 20 client.15903 trim_cache size 0 max 16384 2023-12-01T01:06:28.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.328+0000 7fbfbc99bb80 1 Processor -- start 2023-12-01T01:06:28.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.328+0000 7fbfbc99bb80 1 -- start start 2023-12-01T01:06:28.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.328+0000 7fbfbc99bb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf73f0 0x564fc3cf6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.328+0000 7fbfbc99bb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf80f0 0x564fc3d05cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.328+0000 7fbfbc99bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf8a70 0x564fc3cfb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.328+0000 7fbfbc99bb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc3cffc40 con 0x564fc3cf80f0 2023-12-01T01:06:28.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.328+0000 7fbfbc99bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc3cf2dd0 con 0x564fc3cf8a70 2023-12-01T01:06:28.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.328+0000 7fbfbc99bb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc3cf2240 con 0x564fc3cf73f0 2023-12-01T01:06:28.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.329+0000 7fbfa9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf80f0 0x564fc3d05cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.329+0000 7fbfa9d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf80f0 0x564fc3d05cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56422/0 (socket says 172.21.15.26:56422) 2023-12-01T01:06:28.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.329+0000 7fbfa9d9b700 1 -- 172.21.15.26:0/674336418 learned_addr learned my addr 172.21.15.26:0/674336418 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:28.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.329+0000 7fbfaad9d700 1 --2- 172.21.15.26:0/674336418 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf8a70 0x564fc3cfb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.329+0000 7fbfaa59c700 1 --2- 172.21.15.26:0/674336418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf73f0 0x564fc3cf6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.329+0000 7fbfa9d9b700 1 -- 172.21.15.26:0/674336418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf73f0 msgr2=0x564fc3cf6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:28.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.329+0000 7fbfa9d9b700 1 --2- 172.21.15.26:0/674336418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf73f0 0x564fc3cf6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.329+0000 7fbfa9d9b700 1 -- 172.21.15.26:0/674336418 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf8a70 msgr2=0x564fc3cfb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:28.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.329+0000 7fbfa9d9b700 1 --2- 172.21.15.26:0/674336418 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf8a70 0x564fc3cfb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.329+0000 7fbfa9d9b700 1 -- 172.21.15.26:0/674336418 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fc3a5ec60 con 0x564fc3cf80f0 2023-12-01T01:06:28.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.329+0000 7fbfa9d9b700 1 --2- 172.21.15.26:0/674336418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf80f0 0x564fc3d05cc0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x564fc3d0f2c0 tx=0x7fbfa0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93b8bb423b6dcef server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:28.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.329+0000 7fbf997fa700 1 -- 172.21.15.26:0/674336418 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa001f270 con 0x564fc3cf80f0 2023-12-01T01:06:28.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.329+0000 7fbf997fa700 1 -- 172.21.15.26:0/674336418 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbfa0018040 con 0x564fc3cf80f0 2023-12-01T01:06:28.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.329+0000 7fbf997fa700 1 -- 172.21.15.26:0/674336418 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0011e90 con 0x564fc3cf80f0 2023-12-01T01:06:28.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/674336418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf80f0 msgr2=0x564fc3d05cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:28.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/674336418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf80f0 0x564fc3d05cc0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x564fc3d0f2c0 tx=0x7fbfa0009260 comp rx=0 tx=0).stop 2023-12-01T01:06:28.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/674336418 shutdown_connections 2023-12-01T01:06:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/674336418 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf8a70 0x564fc3cfb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/674336418 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf73f0 0x564fc3cf6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/674336418 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf80f0 0x564fc3d05cc0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/674336418 >> 172.21.15.26:0/674336418 conn(0x564fc3c560d0 msgr2=0x564fc3cf17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/674336418 shutdown_connections 2023-12-01T01:06:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/674336418 wait complete. 2023-12-01T01:06:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 -- start start 2023-12-01T01:06:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 Processor -- start 2023-12-01T01:06:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf73f0 0x564fc3d05ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 0x564fc3d04270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf8a70 0x564fc3d047b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc3d04dc0 con 0x564fc3cf8a70 2023-12-01T01:06:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc3d04f30 con 0x564fc3cf80f0 2023-12-01T01:06:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fc3d050f0 con 0x564fc3cf73f0 2023-12-01T01:06:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfbc99bb80 10 client.0 _ll_register_callbacks cb 0x7fbf9c0045f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfaad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf8a70 0x564fc3d047b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.330+0000 7fbfa9d9b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 0x564fc3d04270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbfaad9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf8a70 0x564fc3d047b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56430/0 (socket says 172.21.15.26:56430) 2023-12-01T01:06:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbfaad9d700 1 -- 172.21.15.26:0/1363929752 learned_addr learned my addr 172.21.15.26:0/1363929752 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbfaa59c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf73f0 0x564fc3d05ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbfa9d9b700 1 -- 172.21.15.26:0/1363929752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf73f0 msgr2=0x564fc3d05ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbfa9d9b700 1 --2- 172.21.15.26:0/1363929752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf73f0 0x564fc3d05ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbfa9d9b700 1 -- 172.21.15.26:0/1363929752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf8a70 msgr2=0x564fc3d047b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbfa9d9b700 1 --2- 172.21.15.26:0/1363929752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf8a70 0x564fc3d047b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbfa9d9b700 1 -- 172.21.15.26:0/1363929752 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa001f870 con 0x564fc3cf80f0 2023-12-01T01:06:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbfaad9d700 1 --2- 172.21.15.26:0/1363929752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf8a70 0x564fc3d047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:06:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbfa9d9b700 1 --2- 172.21.15.26:0/1363929752 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 0x564fc3d04270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x564fc3d0c1f0 tx=0x7fbfa001f430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59e67fd4700c13bd server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:28.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbf91ffb700 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-12-01T01:06:28.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbf91ffb700 1 -- 172.21.15.26:0/1363929752 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa00042d0 con 0x564fc3cf80f0 2023-12-01T01:06:28.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1363929752 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbfa409e950 con 0x564fc3cf80f0 2023-12-01T01:06:28.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbf91ffb700 1 -- 172.21.15.26:0/1363929752 <== mon.2 v2:172.21.15.93:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbfa0004430 con 0x564fc3cf80f0 2023-12-01T01:06:28.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbf91ffb700 1 -- 172.21.15.26:0/1363929752 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfa00047c0 con 0x564fc3cf80f0 2023-12-01T01:06:28.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbfbc99bb80 10 client.25547 fetch_fsmap learned FSMap version 31 2023-12-01T01:06:28.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.331+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1363929752 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x564fc3a9c250 con 0x564fc3cf80f0 2023-12-01T01:06:28.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.332+0000 7fbf91ffb700 1 -- 172.21.15.26:0/1363929752 <== mon.2 v2:172.21.15.93:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbfa409e950 con 0x564fc3cf80f0 2023-12-01T01:06:28.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.332+0000 7fbf91ffb700 1 -- 172.21.15.26:0/1363929752 <== mon.2 v2:172.21.15.93:3300/0 5 ==== fsmap(e 31) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fbfa002d070 con 0x564fc3cf80f0 2023-12-01T01:06:28.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.332+0000 7fbfbc99bb80 10 client.25547 fetch_fsmap finished waiting for FSMap version 31 2023-12-01T01:06:28.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.332+0000 7fbfbc99bb80 10 client.25547 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:06:28.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.332+0000 7fbfbc99bb80 20 client.25547 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.332+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/1363929752 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x564fc3d5f840 0x564fc3d61c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.332+0000 7fbfbc99bb80 4 client.25547 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-01T01:06:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.332+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1363929752 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564fc3c40d40 con 0x564fc3d5f840 2023-12-01T01:06:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.332+0000 7fbfaa59c700 1 --2- 172.21.15.26:0/1363929752 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x564fc3d5f840 0x564fc3d61c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.332+0000 7fbf91ffb700 10 client.25547 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.332+0000 7fbfaa59c700 1 --2- 172.21.15.26:0/1363929752 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x564fc3d5f840 0x564fc3d61c60 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3042293dce67f99 server_cookie=cff1ea8766f48775 in_seq=0 out_seq=0 2023-12-01T01:06:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.334+0000 7fbf91ffb700 1 -- 172.21.15.26:0/1363929752 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x564fc3c40d40 con 0x564fc3d5f840 2023-12-01T01:06:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.334+0000 7fbf91ffb700 10 client.25547 handle_command_reply: tid=0 2023-12-01T01:06:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.334+0000 7fbfbc99bb80 1 client.25547 shutdown 2023-12-01T01:06:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1363929752 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 msgr2=0x564fc3d04270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/1363929752 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 0x564fc3d04270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x564fc3d0c1f0 tx=0x7fbfa001f430 comp rx=0 tx=0).stop 2023-12-01T01:06:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1363929752 shutdown_connections 2023-12-01T01:06:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/1363929752 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x564fc3d5f840 0x564fc3d61c60 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/1363929752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564fc3cf8a70 0x564fc3d047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbf91ffb700 0 client.25547 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:28.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/1363929752 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x564fc3cf73f0 0x564fc3d05ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfbc99bb80 1 --2- 172.21.15.26:0/1363929752 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x564fc3cf80f0 0x564fc3d04270 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1363929752 >> 172.21.15.26:0/1363929752 conn(0x564fc3c560d0 msgr2=0x564fc3d00540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:28.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1363929752 shutdown_connections 2023-12-01T01:06:28.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfbc99bb80 1 -- 172.21.15.26:0/1363929752 wait complete. 2023-12-01T01:06:28.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfbc99bb80 20 client.25547 trim_cache size 0 max 16384 2023-12-01T01:06:28.343 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:06:28.343 INFO:teuthology.orchestra.run.smithi026.stdout: "status": "scrub active (1 inodes in the stack)", 2023-12-01T01:06:28.344 INFO:teuthology.orchestra.run.smithi026.stdout: "scrubs": { 2023-12-01T01:06:28.344 INFO:teuthology.orchestra.run.smithi026.stdout: "66638425-8d59-4f7e-97c6-28c2e46b24ad": { 2023-12-01T01:06:28.344 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/", 2023-12-01T01:06:28.344 INFO:teuthology.orchestra.run.smithi026.stdout: "tag": "66638425-8d59-4f7e-97c6-28c2e46b24ad", 2023-12-01T01:06:28.344 INFO:teuthology.orchestra.run.smithi026.stdout: "options": "recursive,force" 2023-12-01T01:06:28.344 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:06:28.344 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:06:28.344 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:06:28.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfb080b700 1 -- 172.21.15.26:0/4103900707 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbf940a4930 msgr2=0x7fbf940a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:28.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfb080b700 1 --2- 172.21.15.26:0/4103900707 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbf940a4930 0x7fbf940a6df0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbfac100cd0 tx=0x7fbf9c009260 comp rx=0 tx=0).stop 2023-12-01T01:06:28.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfb080b700 1 -- 172.21.15.26:0/4103900707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac101810 msgr2=0x7fbfac19dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:28.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfb080b700 1 --2- 172.21.15.26:0/4103900707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac101810 0x7fbfac19dfe0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400d010 tx=0x7fbfa400bd50 comp rx=0 tx=0).stop 2023-12-01T01:06:28.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfb080b700 1 -- 172.21.15.26:0/4103900707 shutdown_connections 2023-12-01T01:06:28.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfb080b700 1 --2- 172.21.15.26:0/4103900707 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbf940a4930 0x7fbf940a6df0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfb080b700 1 --2- 172.21.15.26:0/4103900707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfac101810 0x7fbfac19dfe0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfb080b700 1 --2- 172.21.15.26:0/4103900707 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbfac0ffc80 0x7fbfac068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfb080b700 1 --2- 172.21.15.26:0/4103900707 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfac100e70 0x7fbfac19b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:28.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfb080b700 1 -- 172.21.15.26:0/4103900707 >> 172.21.15.26:0/4103900707 conn(0x7fbfac0fb1f0 msgr2=0x7fbfac1042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:28.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfb080b700 1 -- 172.21.15.26:0/4103900707 shutdown_connections 2023-12-01T01:06:28.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:28.335+0000 7fbfb080b700 1 -- 172.21.15.26:0/4103900707 wait complete. 2023-12-01T01:06:28.348 INFO:tasks.cephfs.filesystem:scrub status for tag:66638425-8d59-4f7e-97c6-28c2e46b24ad - {'path': '/', 'tag': '66638425-8d59-4f7e-97c6-28c2e46b24ad', 'options': 'recursive,force'} 2023-12-01T01:06:28.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:28 smithi026 ceph-mon[98801]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:06:28.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:28 smithi116 ceph-mon[103554]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:06:28.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:28 smithi093 ceph-mon[103327]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:06:29.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:29 smithi116 ceph-mon[103554]: pgmap v359: 97 pgs: 97 active+clean; 146 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 351 op/s 2023-12-01T01:06:29.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:29 smithi116 ceph-mon[103554]: scrub summary: idle+waiting paths [/] 2023-12-01T01:06:29.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:29 smithi093 ceph-mon[103327]: pgmap v359: 97 pgs: 97 active+clean; 146 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 351 op/s 2023-12-01T01:06:29.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:29 smithi093 ceph-mon[103327]: scrub summary: idle+waiting paths [/] 2023-12-01T01:06:29.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:29 smithi026 ceph-mon[98801]: pgmap v359: 97 pgs: 97 active+clean; 146 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 351 op/s 2023-12-01T01:06:29.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:29 smithi026 ceph-mon[98801]: scrub summary: idle+waiting paths [/] 2023-12-01T01:06:31.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:31 smithi116 ceph-mon[103554]: pgmap v360: 97 pgs: 97 active+clean; 157 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 499 op/s 2023-12-01T01:06:31.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:31 smithi093 ceph-mon[103327]: pgmap v360: 97 pgs: 97 active+clean; 157 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 499 op/s 2023-12-01T01:06:31.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:31 smithi026 ceph-mon[98801]: pgmap v360: 97 pgs: 97 active+clean; 157 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 499 op/s 2023-12-01T01:06:33.638 INFO:tasks.workunit.client.0.smithi026.stdout:Ok 2023-12-01T01:06:33.638 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-12-01T01:06:33.638 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-01T01:06:33.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:33 smithi116 ceph-mon[103554]: pgmap v361: 97 pgs: 97 active+clean; 166 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 512 op/s 2023-12-01T01:06:33.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:33 smithi116 ceph-mon[103554]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:06:33.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:33 smithi093 ceph-mon[103327]: pgmap v361: 97 pgs: 97 active+clean; 166 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 512 op/s 2023-12-01T01:06:33.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:33 smithi093 ceph-mon[103327]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:06:33.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:33 smithi026 ceph-mon[98801]: pgmap v361: 97 pgs: 97 active+clean; 166 MiB data, 806 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 512 op/s 2023-12-01T01:06:33.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:33 smithi026 ceph-mon[98801]: fsmap cephfs:3 {0=b=up:active,1=g=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2023-12-01T01:06:35.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:35 smithi093 ceph-mon[103327]: pgmap v362: 97 pgs: 97 active+clean; 167 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 474 op/s 2023-12-01T01:06:35.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:35 smithi026 ceph-mon[98801]: pgmap v362: 97 pgs: 97 active+clean; 167 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 474 op/s 2023-12-01T01:06:35.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:35 smithi116 ceph-mon[103554]: pgmap v362: 97 pgs: 97 active+clean; 167 MiB data, 817 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 474 op/s 2023-12-01T01:06:36.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:36 smithi093 ceph-mon[103327]: scrub summary: idle 2023-12-01T01:06:36.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:36 smithi093 ceph-mon[103327]: scrub summary: idle 2023-12-01T01:06:36.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:36 smithi026 ceph-mon[98801]: scrub summary: idle 2023-12-01T01:06:36.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:36 smithi026 ceph-mon[98801]: scrub summary: idle 2023-12-01T01:06:36.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:36 smithi116 ceph-mon[103554]: scrub summary: idle 2023-12-01T01:06:36.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:36 smithi116 ceph-mon[103554]: scrub summary: idle 2023-12-01T01:06:37.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:37 smithi093 ceph-mon[103327]: pgmap v363: 97 pgs: 97 active+clean; 127 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 537 op/s 2023-12-01T01:06:37.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:37 smithi026 ceph-mon[98801]: pgmap v363: 97 pgs: 97 active+clean; 127 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 537 op/s 2023-12-01T01:06:37.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:37 smithi116 ceph-mon[103554]: pgmap v363: 97 pgs: 97 active+clean; 127 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.8 MiB/s wr, 537 op/s 2023-12-01T01:06:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.523+0000 7f17e2699700 1 -- 172.21.15.26:0/2928551563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc0ffc90 msgr2=0x7f17dc1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.523+0000 7f17e2699700 1 --2- 172.21.15.26:0/2928551563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc0ffc90 0x7f17dc1000b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f17cc0099c0 tx=0x7f17cc009cd0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.524 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.523+0000 7f17e2699700 1 -- 172.21.15.26:0/2928551563 shutdown_connections 2023-12-01T01:06:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.523+0000 7f17e2699700 1 --2- 172.21.15.26:0/2928551563 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17dc101820 0x7f17dc1080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.523+0000 7f17e2699700 1 --2- 172.21.15.26:0/2928551563 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc0ffc90 0x7f17dc1000b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.523+0000 7f17e2699700 1 --2- 172.21.15.26:0/2928551563 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17dc100e80 0x7f17dc1012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.523+0000 7f17e2699700 1 -- 172.21.15.26:0/2928551563 >> 172.21.15.26:0/2928551563 conn(0x7f17dc0fb1e0 msgr2=0x7f17dc0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.523+0000 7f17e2699700 1 -- 172.21.15.26:0/2928551563 shutdown_connections 2023-12-01T01:06:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.523+0000 7f17e2699700 1 -- 172.21.15.26:0/2928551563 wait complete. 2023-12-01T01:06:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17e2699700 1 Processor -- start 2023-12-01T01:06:38.525 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17e2699700 1 -- start start 2023-12-01T01:06:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17e2699700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17dc0ffc90 0x7f17dc102260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17e2699700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc100e80 0x7f17dc1027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17e2699700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17dc101820 0x7f17dc102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17e2699700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc1a0bc0 con 0x7f17dc100e80 2023-12-01T01:06:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17e2699700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc1a0d00 con 0x7f17dc101820 2023-12-01T01:06:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17e2699700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17dc1a0e40 con 0x7f17dc0ffc90 2023-12-01T01:06:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17db7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc100e80 0x7f17dc1027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17db7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc100e80 0x7f17dc1027a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56442/0 (socket says 172.21.15.26:56442) 2023-12-01T01:06:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17db7fe700 1 -- 172.21.15.26:0/1700272790 learned_addr learned my addr 172.21.15.26:0/1700272790 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17dbfff700 1 --2- 172.21.15.26:0/1700272790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17dc0ffc90 0x7f17dc102260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17e0c36700 1 --2- 172.21.15.26:0/1700272790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17dc101820 0x7f17dc102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.527 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17db7fe700 1 -- 172.21.15.26:0/1700272790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17dc0ffc90 msgr2=0x7f17dc102260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17db7fe700 1 --2- 172.21.15.26:0/1700272790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17dc0ffc90 0x7f17dc102260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17db7fe700 1 -- 172.21.15.26:0/1700272790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17dc101820 msgr2=0x7f17dc102ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17db7fe700 1 --2- 172.21.15.26:0/1700272790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17dc101820 0x7f17dc102ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17db7fe700 1 -- 172.21.15.26:0/1700272790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d0009520 con 0x7f17dc100e80 2023-12-01T01:06:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.524+0000 7f17dbfff700 1 --2- 172.21.15.26:0/1700272790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17dc0ffc90 0x7f17dc102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:06:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.525+0000 7f17db7fe700 1 --2- 172.21.15.26:0/1700272790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc100e80 0x7f17dc1027a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f17d000eb30 tx=0x7f17d000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.525+0000 7f17d97fa700 1 -- 172.21.15.26:0/1700272790 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d0009880 con 0x7f17dc100e80 2023-12-01T01:06:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.525+0000 7f17e2699700 1 -- 172.21.15.26:0/1700272790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc0095f0 con 0x7f17dc100e80 2023-12-01T01:06:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.525+0000 7f17d97fa700 1 -- 172.21.15.26:0/1700272790 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f17d0004500 con 0x7f17dc100e80 2023-12-01T01:06:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.525+0000 7f17d97fa700 1 -- 172.21.15.26:0/1700272790 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d0003e70 con 0x7f17dc100e80 2023-12-01T01:06:38.528 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.525+0000 7f17e2699700 1 -- 172.21.15.26:0/1700272790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17dc1a1450 con 0x7f17dc100e80 2023-12-01T01:06:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.528+0000 7f17d97fa700 1 -- 172.21.15.26:0/1700272790 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f17d000cbd0 con 0x7f17dc100e80 2023-12-01T01:06:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.528+0000 7f17d97fa700 1 --2- 172.21.15.26:0/1700272790 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f17c40a0520 0x7f17c40a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.528+0000 7f17d97fa700 1 -- 172.21.15.26:0/1700272790 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f17d0014070 con 0x7f17dc100e80 2023-12-01T01:06:38.529 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.529+0000 7f17dbfff700 1 --2- 172.21.15.26:0/1700272790 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f17c40a0520 0x7f17c40a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.530 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.529+0000 7f17dbfff700 1 --2- 172.21.15.26:0/1700272790 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f17c40a0520 0x7f17c40a29e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009fd0 tx=0x7f17cc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.530+0000 7f17ee829b80 1 Processor -- start 2023-12-01T01:06:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.530+0000 7f17ee829b80 1 -- start start 2023-12-01T01:06:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.530+0000 7f17ee829b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacde90 0x55ccbface2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.530+0000 7f17ee829b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbface7f0 0x55ccbfacf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.530+0000 7f17ee829b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbfacf6e0 0x55ccbfacfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.532 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.530+0000 7f17ee829b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccbfa1d9b0 con 0x55ccbfacde90 2023-12-01T01:06:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.530+0000 7f17ee829b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccbfa1b370 con 0x55ccbfacf6e0 2023-12-01T01:06:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.530+0000 7f17ee829b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccbfa16c60 con 0x55ccbface7f0 2023-12-01T01:06:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.530+0000 7f17dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacde90 0x55ccbface2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.530+0000 7f17dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacde90 0x55ccbface2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56448/0 (socket says 172.21.15.26:56448) 2023-12-01T01:06:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.530+0000 7f17dbfff700 1 -- 172.21.15.26:0/404674583 learned_addr learned my addr 172.21.15.26:0/404674583 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.530+0000 7f17e0c36700 1 --2- 172.21.15.26:0/404674583 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbfacf6e0 0x55ccbfacfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.530+0000 7f17db7fe700 1 --2- 172.21.15.26:0/404674583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbface7f0 0x55ccbfacf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.531+0000 7f17e0c36700 1 -- 172.21.15.26:0/404674583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbface7f0 msgr2=0x55ccbfacf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.531+0000 7f17e0c36700 1 --2- 172.21.15.26:0/404674583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbface7f0 0x55ccbfacf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.531+0000 7f17e0c36700 1 -- 172.21.15.26:0/404674583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacde90 msgr2=0x55ccbface2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.531+0000 7f17e0c36700 1 --2- 172.21.15.26:0/404674583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacde90 0x55ccbface2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.531+0000 7f17e0c36700 1 -- 172.21.15.26:0/404674583 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccbf844d80 con 0x55ccbfacf6e0 2023-12-01T01:06:38.533 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.531+0000 7f17db7fe700 1 --2- 172.21.15.26:0/404674583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbface7f0 0x55ccbfacf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:06:38.534 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.531+0000 7f17e0c36700 1 --2- 172.21.15.26:0/404674583 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbfacf6e0 0x55ccbfacfb60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f17d4011580 tx=0x7f17d4009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8799040cff502964 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:38.534 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.531+0000 7f17c27fc700 1 -- 172.21.15.26:0/404674583 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d400e040 con 0x55ccbfacf6e0 2023-12-01T01:06:38.534 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.531+0000 7f17c27fc700 1 -- 172.21.15.26:0/404674583 <== mon.2 v2:172.21.15.93:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f17d400f040 con 0x55ccbfacf6e0 2023-12-01T01:06:38.534 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.531+0000 7f17c27fc700 1 -- 172.21.15.26:0/404674583 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d40044f0 con 0x55ccbfacf6e0 2023-12-01T01:06:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.532+0000 7f17ee829b80 1 -- 172.21.15.26:0/404674583 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbfacf6e0 msgr2=0x55ccbfacfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.532+0000 7f17ee829b80 1 --2- 172.21.15.26:0/404674583 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbfacf6e0 0x55ccbfacfb60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f17d4011580 tx=0x7f17d4009920 comp rx=0 tx=0).stop 2023-12-01T01:06:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.532+0000 7f17ee829b80 1 -- 172.21.15.26:0/404674583 shutdown_connections 2023-12-01T01:06:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.532+0000 7f17ee829b80 1 --2- 172.21.15.26:0/404674583 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbfacf6e0 0x55ccbfacfb60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.532+0000 7f17ee829b80 1 --2- 172.21.15.26:0/404674583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacde90 0x55ccbface2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.532+0000 7f17ee829b80 1 --2- 172.21.15.26:0/404674583 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbface7f0 0x55ccbfacf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.532+0000 7f17ee829b80 1 -- 172.21.15.26:0/404674583 >> 172.21.15.26:0/404674583 conn(0x55ccbfa25070 msgr2=0x55ccbfac2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.532+0000 7f17ee829b80 1 -- 172.21.15.26:0/404674583 shutdown_connections 2023-12-01T01:06:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.532+0000 7f17ee829b80 1 -- 172.21.15.26:0/404674583 wait complete. 2023-12-01T01:06:38.538 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.532+0000 7f17ee829b80 1 -- start start 2023-12-01T01:06:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.533+0000 7f17ee829b80 1 Processor -- start 2023-12-01T01:06:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.533+0000 7f17ee829b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbfacde90 0x55ccbfac6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.533+0000 7f17ee829b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbface7f0 0x55ccbfac7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.533+0000 7f17ee829b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacf6e0 0x55ccbfacc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.533+0000 7f17ee829b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccbf9b34b0 con 0x55ccbfacf6e0 2023-12-01T01:06:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.533+0000 7f17ee829b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccbf9b3150 con 0x55ccbface7f0 2023-12-01T01:06:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.533+0000 7f17ee829b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccbf89a8c0 con 0x55ccbfacde90 2023-12-01T01:06:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.533+0000 7f17ee829b80 10 client.0 _ll_register_callbacks cb 0x55ccbf900a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.533+0000 7f17db7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbface7f0 0x55ccbfac7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.533+0000 7f17e0c36700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacf6e0 0x55ccbfacc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.533+0000 7f17db7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbface7f0 0x55ccbfac7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.26:47194/0 (socket says 172.21.15.26:47194) 2023-12-01T01:06:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.533+0000 7f17db7fe700 1 -- 172.21.15.26:0/2396167616 learned_addr learned my addr 172.21.15.26:0/2396167616 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.533+0000 7f17e0c36700 1 --2- 172.21.15.26:0/2396167616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacf6e0 0x55ccbfacc190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56458/0 (socket says 172.21.15.26:56458) 2023-12-01T01:06:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.533+0000 7f17dbfff700 1 --2- 172.21.15.26:0/2396167616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbfacde90 0x55ccbfac6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.539 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.534+0000 7f17db7fe700 1 -- 172.21.15.26:0/2396167616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbfacde90 msgr2=0x55ccbfac6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.534+0000 7f17db7fe700 1 --2- 172.21.15.26:0/2396167616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbfacde90 0x55ccbfac6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.534+0000 7f17db7fe700 1 -- 172.21.15.26:0/2396167616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacf6e0 msgr2=0x55ccbfacc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.534+0000 7f17db7fe700 1 --2- 172.21.15.26:0/2396167616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacf6e0 0x55ccbfacc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.534+0000 7f17db7fe700 1 -- 172.21.15.26:0/2396167616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d4011230 con 0x55ccbface7f0 2023-12-01T01:06:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.534+0000 7f17e0c36700 1 --2- 172.21.15.26:0/2396167616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacf6e0 0x55ccbfacc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:06:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.534+0000 7f17bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.93:3300/0 2023-12-01T01:06:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.534+0000 7f17db7fe700 1 --2- 172.21.15.26:0/2396167616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbface7f0 0x55ccbfac7160 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f17d0095b20 tx=0x7f17d0099d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99188625cdbea191 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.534+0000 7f17bb7fe700 1 -- 172.21.15.26:0/2396167616 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d009d450 con 0x55ccbface7f0 2023-12-01T01:06:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.534+0000 7f17bb7fe700 1 -- 172.21.15.26:0/2396167616 <== mon.2 v2:172.21.15.93:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f17d00a1690 con 0x55ccbface7f0 2023-12-01T01:06:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.534+0000 7f17ee829b80 1 -- 172.21.15.26:0/2396167616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ccbfa41cb0 con 0x55ccbface7f0 2023-12-01T01:06:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.534+0000 7f17bb7fe700 1 -- 172.21.15.26:0/2396167616 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17d00b7030 con 0x55ccbface7f0 2023-12-01T01:06:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.534+0000 7f17ee829b80 10 client.25559 fetch_fsmap learned FSMap version 32 2023-12-01T01:06:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.534+0000 7f17ee829b80 1 -- 172.21.15.26:0/2396167616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55ccbf82dc00 con 0x55ccbface7f0 2023-12-01T01:06:38.540 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.534+0000 7f17bb7fe700 1 -- 172.21.15.26:0/2396167616 <== mon.2 v2:172.21.15.93:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f17d0063020 con 0x55ccbface7f0 2023-12-01T01:06:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.535+0000 7f17bb7fe700 1 -- 172.21.15.26:0/2396167616 <== mon.2 v2:172.21.15.93:3300/0 5 ==== fsmap(e 32) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f17d0098b10 con 0x55ccbface7f0 2023-12-01T01:06:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.535+0000 7f17ee829b80 10 client.25559 fetch_fsmap finished waiting for FSMap version 32 2023-12-01T01:06:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.535+0000 7f17ee829b80 10 client.25559 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:06:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.535+0000 7f17ee829b80 20 client.25559 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.535+0000 7f17ee829b80 1 --2- 172.21.15.26:0/2396167616 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ccbfaec370 0x55ccbfaee790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.535+0000 7f17ee829b80 4 client.25559 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:06:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.535+0000 7f17ee829b80 1 -- 172.21.15.26:0/2396167616 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ccbfa94db0 con 0x55ccbfaec370 2023-12-01T01:06:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.535+0000 7f17dbfff700 1 --2- 172.21.15.26:0/2396167616 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ccbfaec370 0x55ccbfaee790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.535+0000 7f17bb7fe700 10 client.25559 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.535+0000 7f17dbfff700 1 --2- 172.21.15.26:0/2396167616 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ccbfaec370 0x55ccbfaee790 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff39d0ec5ca655a server_cookie=5358bade7f46fa5 in_seq=0 out_seq=0 2023-12-01T01:06:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.536+0000 7f17bb7fe700 1 -- 172.21.15.26:0/2396167616 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55ccbfa94db0 con 0x55ccbfaec370 2023-12-01T01:06:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.536+0000 7f17bb7fe700 10 client.25559 handle_command_reply: tid=0 2023-12-01T01:06:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.536+0000 7f17ee829b80 1 client.25559 shutdown 2023-12-01T01:06:38.541 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.536+0000 7f17ee829b80 1 -- 172.21.15.26:0/2396167616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbface7f0 msgr2=0x55ccbfac7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.536+0000 7f17ee829b80 1 --2- 172.21.15.26:0/2396167616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbface7f0 0x55ccbfac7160 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f17d0095b20 tx=0x7f17d0099d20 comp rx=0 tx=0).stop 2023-12-01T01:06:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.536+0000 7f17ee829b80 1 -- 172.21.15.26:0/2396167616 shutdown_connections 2023-12-01T01:06:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.536+0000 7f17ee829b80 1 --2- 172.21.15.26:0/2396167616 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ccbfaec370 0x55ccbfaee790 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.536+0000 7f17ee829b80 1 --2- 172.21.15.26:0/2396167616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacf6e0 0x55ccbfacc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.536+0000 7f17ee829b80 1 --2- 172.21.15.26:0/2396167616 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbfacde90 0x55ccbfac6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.536+0000 7f17ee829b80 1 --2- 172.21.15.26:0/2396167616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbface7f0 0x55ccbfac7160 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.536+0000 7f17bb7fe700 0 client.25559 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.536+0000 7f17ee829b80 1 -- 172.21.15.26:0/2396167616 >> 172.21.15.26:0/2396167616 conn(0x55ccbfa25070 msgr2=0x55ccbfac03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.536+0000 7f17ee829b80 1 -- 172.21.15.26:0/2396167616 shutdown_connections 2023-12-01T01:06:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.536+0000 7f17ee829b80 1 -- 172.21.15.26:0/2396167616 wait complete. 2023-12-01T01:06:38.542 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.536+0000 7f17ee829b80 20 client.25559 trim_cache size 0 max 16384 2023-12-01T01:06:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.558+0000 7f17ee829b80 1 Processor -- start 2023-12-01T01:06:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.558+0000 7f17ee829b80 1 -- start start 2023-12-01T01:06:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.558+0000 7f17ee829b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbfacde90 0x55ccbface270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.558+0000 7f17ee829b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbface7f0 0x55ccbfaf30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.558+0000 7f17ee829b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbfacf6e0 0x55ccbfafbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.558+0000 7f17ee829b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccbfac60d0 con 0x55ccbface7f0 2023-12-01T01:06:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.558+0000 7f17ee829b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccbfabb500 con 0x55ccbfacde90 2023-12-01T01:06:38.560 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.558+0000 7f17ee829b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccbfab87a0 con 0x55ccbfacf6e0 2023-12-01T01:06:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.558+0000 7f17db7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbface7f0 0x55ccbfaf30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.558+0000 7f17dbfff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbfacde90 0x55ccbface270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.558+0000 7f17db7fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbface7f0 0x55ccbfaf30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56464/0 (socket says 172.21.15.26:56464) 2023-12-01T01:06:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.558+0000 7f17db7fe700 1 -- 172.21.15.26:0/2645157409 learned_addr learned my addr 172.21.15.26:0/2645157409 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.558+0000 7f17e0c36700 1 --2- 172.21.15.26:0/2645157409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbfacf6e0 0x55ccbfafbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.559+0000 7f17dbfff700 1 -- 172.21.15.26:0/2645157409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbfacf6e0 msgr2=0x55ccbfafbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.559+0000 7f17dbfff700 1 --2- 172.21.15.26:0/2645157409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbfacf6e0 0x55ccbfafbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.559+0000 7f17dbfff700 1 -- 172.21.15.26:0/2645157409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbface7f0 msgr2=0x55ccbfaf30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.559+0000 7f17dbfff700 1 --2- 172.21.15.26:0/2645157409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbface7f0 0x55ccbfaf30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.559+0000 7f17dbfff700 1 -- 172.21.15.26:0/2645157409 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccbf86b1f0 con 0x55ccbfacde90 2023-12-01T01:06:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.559+0000 7f17dbfff700 1 --2- 172.21.15.26:0/2645157409 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbfacde90 0x55ccbface270 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55ccbfaef0a0 tx=0x7f17cc005000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22ed197c6c9478f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.559+0000 7f17c2ffd700 1 -- 172.21.15.26:0/2645157409 <== mon.2 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc02a040 con 0x55ccbfacde90 2023-12-01T01:06:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.559+0000 7f17c2ffd700 1 -- 172.21.15.26:0/2645157409 <== mon.2 v2:172.21.15.93:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f17cc02b040 con 0x55ccbfacde90 2023-12-01T01:06:38.561 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.559+0000 7f17c2ffd700 1 -- 172.21.15.26:0/2645157409 <== mon.2 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc023460 con 0x55ccbfacde90 2023-12-01T01:06:38.563 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.560+0000 7f17ee829b80 1 -- 172.21.15.26:0/2645157409 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbfacde90 msgr2=0x55ccbface270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.560+0000 7f17ee829b80 1 --2- 172.21.15.26:0/2645157409 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbfacde90 0x55ccbface270 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55ccbfaef0a0 tx=0x7f17cc005000 comp rx=0 tx=0).stop 2023-12-01T01:06:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.560+0000 7f17ee829b80 1 -- 172.21.15.26:0/2645157409 shutdown_connections 2023-12-01T01:06:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.560+0000 7f17ee829b80 1 --2- 172.21.15.26:0/2645157409 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbfacf6e0 0x55ccbfafbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.560+0000 7f17ee829b80 1 --2- 172.21.15.26:0/2645157409 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbfacde90 0x55ccbface270 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.560+0000 7f17ee829b80 1 --2- 172.21.15.26:0/2645157409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbface7f0 0x55ccbfaf30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.560+0000 7f17ee829b80 1 -- 172.21.15.26:0/2645157409 >> 172.21.15.26:0/2645157409 conn(0x55ccbfa25070 msgr2=0x55ccbfac1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.560+0000 7f17ee829b80 1 -- 172.21.15.26:0/2645157409 shutdown_connections 2023-12-01T01:06:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.560+0000 7f17ee829b80 1 -- 172.21.15.26:0/2645157409 wait complete. 2023-12-01T01:06:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.560+0000 7f17ee829b80 1 -- start start 2023-12-01T01:06:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17ee829b80 1 Processor -- start 2023-12-01T01:06:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17ee829b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacde90 0x55ccbfafb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17ee829b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbface7f0 0x55ccbfafb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17ee829b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbfacf6e0 0x55ccbfb3cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.564 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17ee829b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccbfb3d070 con 0x55ccbfacde90 2023-12-01T01:06:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17ee829b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccbfb3d1b0 con 0x55ccbface7f0 2023-12-01T01:06:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17ee829b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccbfb3d340 con 0x55ccbfacf6e0 2023-12-01T01:06:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17ee829b80 10 client.0 _ll_register_callbacks cb 0x7f17d00994e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacde90 0x55ccbfafb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17dbfff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacde90 0x55ccbfafb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56468/0 (socket says 172.21.15.26:56468) 2023-12-01T01:06:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17dbfff700 1 -- 172.21.15.26:0/2088139531 learned_addr learned my addr 172.21.15.26:0/2088139531 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17e0c36700 1 --2- 172.21.15.26:0/2088139531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbfacf6e0 0x55ccbfb3cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17db7fe700 1 --2- 172.21.15.26:0/2088139531 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbface7f0 0x55ccbfafb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17dbfff700 1 -- 172.21.15.26:0/2088139531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbfacf6e0 msgr2=0x55ccbfb3cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17dbfff700 1 --2- 172.21.15.26:0/2088139531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbfacf6e0 0x55ccbfb3cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17dbfff700 1 -- 172.21.15.26:0/2088139531 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbface7f0 msgr2=0x55ccbfafb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17dbfff700 1 --2- 172.21.15.26:0/2088139531 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbface7f0 0x55ccbfafb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.565 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17dbfff700 1 -- 172.21.15.26:0/2088139531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17dc108a20 con 0x55ccbfacde90 2023-12-01T01:06:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.561+0000 7f17e0c36700 1 --2- 172.21.15.26:0/2088139531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbfacf6e0 0x55ccbfb3cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:06:38.571 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.562+0000 7f17dbfff700 1 --2- 172.21.15.26:0/2088139531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacde90 0x55ccbfafb3e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009350 tx=0x7f17cc034440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf62e9c6103b4a73 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.562+0000 7f17bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:06:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.562+0000 7f17bb7fe700 1 -- 172.21.15.26:0/2088139531 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc02a040 con 0x55ccbfacde90 2023-12-01T01:06:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.562+0000 7f17bb7fe700 1 -- 172.21.15.26:0/2088139531 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f17cc034af0 con 0x55ccbfacde90 2023-12-01T01:06:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.562+0000 7f17ee829b80 1 -- 172.21.15.26:0/2088139531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17d400f040 con 0x55ccbfacde90 2023-12-01T01:06:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.562+0000 7f17bb7fe700 1 -- 172.21.15.26:0/2088139531 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17cc0056e0 con 0x55ccbfacde90 2023-12-01T01:06:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.562+0000 7f17ee829b80 10 client.15927 fetch_fsmap learned FSMap version 32 2023-12-01T01:06:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.562+0000 7f17ee829b80 1 -- 172.21.15.26:0/2088139531 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55ccbf843250 con 0x55ccbfacde90 2023-12-01T01:06:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.562+0000 7f17bb7fe700 1 -- 172.21.15.26:0/2088139531 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f17d400f040 con 0x55ccbfacde90 2023-12-01T01:06:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.562+0000 7f17bb7fe700 1 -- 172.21.15.26:0/2088139531 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 32) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f17cc03d450 con 0x55ccbfacde90 2023-12-01T01:06:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.563+0000 7f17ee829b80 10 client.15927 fetch_fsmap finished waiting for FSMap version 32 2023-12-01T01:06:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.563+0000 7f17ee829b80 10 client.15927 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:06:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.563+0000 7f17ee829b80 20 client.15927 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.563+0000 7f17ee829b80 1 --2- 172.21.15.26:0/2088139531 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ccbfb3e910 0x55ccbfb40d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:38.572 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.563+0000 7f17ee829b80 4 client.15927 mds_command: new command op to 24509 tid=0[{"prefix": "flush journal"}] 2023-12-01T01:06:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.563+0000 7f17ee829b80 1 -- 172.21.15.26:0/2088139531 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ccbfa0fce0 con 0x55ccbfb3e910 2023-12-01T01:06:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.563+0000 7f17db7fe700 1 --2- 172.21.15.26:0/2088139531 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ccbfb3e910 0x55ccbfb40d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.563+0000 7f17bb7fe700 10 client.15927 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:38.573 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.563+0000 7f17db7fe700 1 --2- 172.21.15.26:0/2088139531 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ccbfb3e910 0x55ccbfb40d30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de6b79814a429d9 server_cookie=c18df0d09545a4cc in_seq=0 out_seq=0 2023-12-01T01:06:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.702+0000 7f17bb7fe700 1 -- 172.21.15.26:0/2088139531 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ccbfa0fce0 con 0x55ccbfb3e910 2023-12-01T01:06:38.703 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.702+0000 7f17bb7fe700 10 client.15927 handle_command_reply: tid=0 2023-12-01T01:06:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.702+0000 7f17ee829b80 1 client.15927 shutdown 2023-12-01T01:06:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.702+0000 7f17ee829b80 1 -- 172.21.15.26:0/2088139531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacde90 msgr2=0x55ccbfafb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.702+0000 7f17ee829b80 1 --2- 172.21.15.26:0/2088139531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacde90 0x55ccbfafb3e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009350 tx=0x7f17cc034440 comp rx=0 tx=0).stop 2023-12-01T01:06:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.702+0000 7f17ee829b80 1 -- 172.21.15.26:0/2088139531 shutdown_connections 2023-12-01T01:06:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.702+0000 7f17ee829b80 1 --2- 172.21.15.26:0/2088139531 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x55ccbfb3e910 0x55ccbfb40d30 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.702+0000 7f17ee829b80 1 --2- 172.21.15.26:0/2088139531 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55ccbfacf6e0 0x55ccbfb3cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.702+0000 7f17ee829b80 1 --2- 172.21.15.26:0/2088139531 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55ccbfacde90 0x55ccbfafb3e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.702+0000 7f17ee829b80 1 --2- 172.21.15.26:0/2088139531 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55ccbface7f0 0x55ccbfafb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.702+0000 7f17ee829b80 1 -- 172.21.15.26:0/2088139531 >> 172.21.15.26:0/2088139531 conn(0x55ccbfa25070 msgr2=0x55ccbfac5840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.702+0000 7f17bb7fe700 0 client.15927 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.702+0000 7f17ee829b80 1 -- 172.21.15.26:0/2088139531 shutdown_connections 2023-12-01T01:06:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.702+0000 7f17ee829b80 1 -- 172.21.15.26:0/2088139531 wait complete. 2023-12-01T01:06:38.704 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.703+0000 7f17ee829b80 20 client.15927 trim_cache size 0 max 16384 2023-12-01T01:06:38.705 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:{ 2023-12-01T01:06:38.705 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "message": "", 2023-12-01T01:06:38.705 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "return_code": 0 2023-12-01T01:06:38.705 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:} 2023-12-01T01:06:38.706 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.703+0000 7f17e2699700 1 -- 172.21.15.26:0/1700272790 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f17c40a0520 msgr2=0x7f17c40a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:38.706 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.703+0000 7f17e2699700 1 --2- 172.21.15.26:0/1700272790 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f17c40a0520 0x7f17c40a29e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f17cc009fd0 tx=0x7f17cc005fb0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.706 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.703+0000 7f17e2699700 1 -- 172.21.15.26:0/1700272790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc100e80 msgr2=0x7f17dc1027a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:38.706 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.703+0000 7f17e2699700 1 --2- 172.21.15.26:0/1700272790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc100e80 0x7f17dc1027a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f17d000eb30 tx=0x7f17d000ee40 comp rx=0 tx=0).stop 2023-12-01T01:06:38.706 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.704+0000 7f17e2699700 1 -- 172.21.15.26:0/1700272790 shutdown_connections 2023-12-01T01:06:38.706 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.704+0000 7f17e2699700 1 --2- 172.21.15.26:0/1700272790 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f17c40a0520 0x7f17c40a29e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.706 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.704+0000 7f17e2699700 1 --2- 172.21.15.26:0/1700272790 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17dc101820 0x7f17dc102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.706 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.704+0000 7f17e2699700 1 --2- 172.21.15.26:0/1700272790 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f17dc0ffc90 0x7f17dc102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.706 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.704+0000 7f17e2699700 1 --2- 172.21.15.26:0/1700272790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17dc100e80 0x7f17dc1027a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:38.706 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.704+0000 7f17e2699700 1 -- 172.21.15.26:0/1700272790 >> 172.21.15.26:0/1700272790 conn(0x7f17dc0fb1e0 msgr2=0x7f17dc0681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:38.706 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.704+0000 7f17e2699700 1 -- 172.21.15.26:0/1700272790 shutdown_connections 2023-12-01T01:06:38.706 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:38.704+0000 7f17e2699700 1 -- 172.21.15.26:0/1700272790 wait complete. 2023-12-01T01:06:39.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:39 smithi093 ceph-mon[103327]: pgmap v364: 97 pgs: 97 active+clean; 111 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 444 op/s 2023-12-01T01:06:39.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:39 smithi026 ceph-mon[98801]: pgmap v364: 97 pgs: 97 active+clean; 111 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 444 op/s 2023-12-01T01:06:39.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:39 smithi116 ceph-mon[103554]: pgmap v364: 97 pgs: 97 active+clean; 111 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 444 op/s 2023-12-01T01:06:41.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:41 smithi093 ceph-mon[103327]: pgmap v365: 97 pgs: 97 active+clean; 69 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 568 op/s 2023-12-01T01:06:41.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:41 smithi026 ceph-mon[98801]: pgmap v365: 97 pgs: 97 active+clean; 69 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 568 op/s 2023-12-01T01:06:41.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:41 smithi116 ceph-mon[103554]: pgmap v365: 97 pgs: 97 active+clean; 69 MiB data, 572 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 568 op/s 2023-12-01T01:06:43.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:43 smithi093 ceph-mon[103327]: pgmap v366: 97 pgs: 97 active+clean; 60 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 475 op/s 2023-12-01T01:06:43.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:43 smithi026 ceph-mon[98801]: pgmap v366: 97 pgs: 97 active+clean; 60 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 475 op/s 2023-12-01T01:06:43.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:43 smithi116 ceph-mon[103554]: pgmap v366: 97 pgs: 97 active+clean; 60 MiB data, 542 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.5 MiB/s wr, 475 op/s 2023-12-01T01:06:45.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:45 smithi093 ceph-mon[103327]: pgmap v367: 97 pgs: 97 active+clean; 60 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 374 op/s 2023-12-01T01:06:45.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:45 smithi026 ceph-mon[98801]: pgmap v367: 97 pgs: 97 active+clean; 60 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 374 op/s 2023-12-01T01:06:45.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:45 smithi116 ceph-mon[103554]: pgmap v367: 97 pgs: 97 active+clean; 60 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 374 op/s 2023-12-01T01:06:47.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:47 smithi093 ceph-mon[103327]: pgmap v368: 97 pgs: 97 active+clean; 56 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 471 op/s 2023-12-01T01:06:47.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:47 smithi026 ceph-mon[98801]: pgmap v368: 97 pgs: 97 active+clean; 56 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 471 op/s 2023-12-01T01:06:47.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:47 smithi116 ceph-mon[103554]: pgmap v368: 97 pgs: 97 active+clean; 56 MiB data, 519 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 471 op/s 2023-12-01T01:06:49.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:49 smithi093 ceph-mon[103327]: pgmap v369: 97 pgs: 97 active+clean; 55 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 430 op/s 2023-12-01T01:06:49.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:49 smithi026 ceph-mon[98801]: pgmap v369: 97 pgs: 97 active+clean; 55 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 430 op/s 2023-12-01T01:06:49.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:49 smithi116 ceph-mon[103554]: pgmap v369: 97 pgs: 97 active+clean; 55 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 430 op/s 2023-12-01T01:06:51.649 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2023-12-01T01:06:51.649 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-01T01:06:51.713 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:51 smithi026 ceph-mon[98801]: pgmap v370: 97 pgs: 97 active+clean; 54 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 459 op/s 2023-12-01T01:06:51.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:51 smithi093 ceph-mon[103327]: pgmap v370: 97 pgs: 97 active+clean; 54 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 459 op/s 2023-12-01T01:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.816+0000 7f852b1d3700 1 -- 172.21.15.26:0/1005664070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8524101850 msgr2=0x7f8524103c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.816+0000 7f852b1d3700 1 --2- 172.21.15.26:0/1005664070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8524101850 0x7f8524103c40 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f8518009990 tx=0x7f8518009ca0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.816+0000 7f852b1d3700 1 -- 172.21.15.26:0/1005664070 shutdown_connections 2023-12-01T01:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.816+0000 7f852b1d3700 1 --2- 172.21.15.26:0/1005664070 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8524106ab0 0x7f8524108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.816+0000 7f852b1d3700 1 --2- 172.21.15.26:0/1005664070 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8524101850 0x7f8524103c40 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.816+0000 7f852b1d3700 1 --2- 172.21.15.26:0/1005664070 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8524104180 0x7f8524106570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.816+0000 7f852b1d3700 1 -- 172.21.15.26:0/1005664070 >> 172.21.15.26:0/1005664070 conn(0x7f85240fb200 msgr2=0x7f85240fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.816+0000 7f852b1d3700 1 -- 172.21.15.26:0/1005664070 shutdown_connections 2023-12-01T01:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.816+0000 7f852b1d3700 1 -- 172.21.15.26:0/1005664070 wait complete. 2023-12-01T01:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.816+0000 7f852b1d3700 1 Processor -- start 2023-12-01T01:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.816+0000 7f852b1d3700 1 -- start start 2023-12-01T01:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f852b1d3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8524101850 0x7f8524196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f852b1d3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8524104180 0x7f8524197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f852b1d3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8524106ab0 0x7f8524197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f852b1d3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8524198640 con 0x7f8524101850 2023-12-01T01:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f852b1d3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85241987b0 con 0x7f8524104180 2023-12-01T01:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f852b1d3700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8524198970 con 0x7f8524106ab0 2023-12-01T01:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f8528f6f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8524101850 0x7f8524196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f8528f6f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8524101850 0x7f8524196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56480/0 (socket says 172.21.15.26:56480) 2023-12-01T01:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f8528f6f700 1 -- 172.21.15.26:0/4036919322 learned_addr learned my addr 172.21.15.26:0/4036919322 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f8529770700 1 --2- 172.21.15.26:0/4036919322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8524106ab0 0x7f8524197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f8523fff700 1 --2- 172.21.15.26:0/4036919322 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8524104180 0x7f8524197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f8528f6f700 1 -- 172.21.15.26:0/4036919322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8524106ab0 msgr2=0x7f8524197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f8528f6f700 1 --2- 172.21.15.26:0/4036919322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8524106ab0 0x7f8524197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f8528f6f700 1 -- 172.21.15.26:0/4036919322 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8524104180 msgr2=0x7f8524197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f8528f6f700 1 --2- 172.21.15.26:0/4036919322 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8524104180 0x7f8524197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f8528f6f700 1 -- 172.21.15.26:0/4036919322 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85180095f0 con 0x7f8524101850 2023-12-01T01:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f8523fff700 1 --2- 172.21.15.26:0/4036919322 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8524104180 0x7f8524197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f8529770700 1 --2- 172.21.15.26:0/4036919322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8524106ab0 0x7f8524197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f8528f6f700 1 --2- 172.21.15.26:0/4036919322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8524101850 0x7f8524196c20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f85180059d0 tx=0x7f851800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f8521ffb700 1 -- 172.21.15.26:0/4036919322 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851801d070 con 0x7f8524101850 2023-12-01T01:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f8521ffb700 1 -- 172.21.15.26:0/4036919322 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8518022950 con 0x7f8524101850 2023-12-01T01:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f852b1d3700 1 -- 172.21.15.26:0/4036919322 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8524198bf0 con 0x7f8524101850 2023-12-01T01:06:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.817+0000 7f8521ffb700 1 -- 172.21.15.26:0/4036919322 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8518017770 con 0x7f8524101850 2023-12-01T01:06:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.818+0000 7f852b1d3700 1 -- 172.21.15.26:0/4036919322 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852419f410 con 0x7f8524101850 2023-12-01T01:06:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.820+0000 7f8521ffb700 1 -- 172.21.15.26:0/4036919322 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f8518022ac0 con 0x7f8524101850 2023-12-01T01:06:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.820+0000 7f8521ffb700 1 --2- 172.21.15.26:0/4036919322 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f85140a0520 0x7f85140a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.821+0000 7f8523fff700 1 --2- 172.21.15.26:0/4036919322 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f85140a0520 0x7f85140a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.821+0000 7f8521ffb700 1 -- 172.21.15.26:0/4036919322 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f85180ccfe0 con 0x7f8524101850 2023-12-01T01:06:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.821+0000 7f8523fff700 1 --2- 172.21.15.26:0/4036919322 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f85140a0520 0x7f85140a29e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8510005fd0 tx=0x7f8510005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.822+0000 7f8537363b80 1 Processor -- start 2023-12-01T01:06:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.822+0000 7f8537363b80 1 -- start start 2023-12-01T01:06:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8537363b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84680 0x558389d84aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8537363b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84fe0 0x558389d858f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8537363b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 0x558389d86350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8537363b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x558389cdc9b0 con 0x558389d84fe0 2023-12-01T01:06:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8537363b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x558389cda370 con 0x558389d85ed0 2023-12-01T01:06:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8537363b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x558389cd5c60 con 0x558389d84680 2023-12-01T01:06:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8523fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84fe0 0x558389d858f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8523fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84fe0 0x558389d858f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56490/0 (socket says 172.21.15.26:56490) 2023-12-01T01:06:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8523fff700 1 -- 172.21.15.26:0/2347146581 learned_addr learned my addr 172.21.15.26:0/2347146581 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8528f6f700 1 --2- 172.21.15.26:0/2347146581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84680 0x558389d84aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8529770700 1 --2- 172.21.15.26:0/2347146581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 0x558389d86350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8523fff700 1 -- 172.21.15.26:0/2347146581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84680 msgr2=0x558389d84aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8523fff700 1 --2- 172.21.15.26:0/2347146581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84680 0x558389d84aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.826 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8523fff700 1 -- 172.21.15.26:0/2347146581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 msgr2=0x558389d86350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8523fff700 1 --2- 172.21.15.26:0/2347146581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 0x558389d86350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8523fff700 1 -- 172.21.15.26:0/2347146581 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558389b03d80 con 0x558389d84fe0 2023-12-01T01:06:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f8523fff700 1 --2- 172.21.15.26:0/2347146581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84fe0 0x558389d858f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f851000edd0 tx=0x7f8510009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6feb8eae641c44fd server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f850effd700 1 -- 172.21.15.26:0/2347146581 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8510022070 con 0x558389d84fe0 2023-12-01T01:06:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f850effd700 1 -- 172.21.15.26:0/2347146581 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f851000ee00 con 0x558389d84fe0 2023-12-01T01:06:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.823+0000 7f850effd700 1 -- 172.21.15.26:0/2347146581 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8510005450 con 0x558389d84fe0 2023-12-01T01:06:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.824+0000 7f8537363b80 1 -- 172.21.15.26:0/2347146581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84fe0 msgr2=0x558389d858f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.824+0000 7f8537363b80 1 --2- 172.21.15.26:0/2347146581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84fe0 0x558389d858f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f851000edd0 tx=0x7f8510009f90 comp rx=0 tx=0).stop 2023-12-01T01:06:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.824+0000 7f8537363b80 1 -- 172.21.15.26:0/2347146581 shutdown_connections 2023-12-01T01:06:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.824+0000 7f8537363b80 1 --2- 172.21.15.26:0/2347146581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 0x558389d86350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.824+0000 7f8537363b80 1 --2- 172.21.15.26:0/2347146581 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84680 0x558389d84aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.824+0000 7f8537363b80 1 --2- 172.21.15.26:0/2347146581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84fe0 0x558389d858f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.824+0000 7f8537363b80 1 -- 172.21.15.26:0/2347146581 >> 172.21.15.26:0/2347146581 conn(0x558389ce4070 msgr2=0x558389d81040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:51.827 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.824+0000 7f8537363b80 1 -- 172.21.15.26:0/2347146581 shutdown_connections 2023-12-01T01:06:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.824+0000 7f8537363b80 1 -- 172.21.15.26:0/2347146581 wait complete. 2023-12-01T01:06:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.825+0000 7f8537363b80 1 -- start start 2023-12-01T01:06:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.825+0000 7f8537363b80 1 Processor -- start 2023-12-01T01:06:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.825+0000 7f8537363b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d8e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.825+0000 7f8537363b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d84fe0 0x558389d8ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.825+0000 7f8537363b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d85ed0 0x558389d95aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.825+0000 7f8537363b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x558389c724b0 con 0x558389d84680 2023-12-01T01:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.825+0000 7f8537363b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x558389c72150 con 0x558389d84fe0 2023-12-01T01:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.825+0000 7f8537363b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x558389b598c0 con 0x558389d85ed0 2023-12-01T01:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.825+0000 7f8537363b80 10 client.0 _ll_register_callbacks cb 0x558389bbfa20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.825+0000 7f8528f6f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d8e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.825+0000 7f8528f6f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d8e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56494/0 (socket says 172.21.15.26:56494) 2023-12-01T01:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.825+0000 7f8528f6f700 1 -- 172.21.15.26:0/518393592 learned_addr learned my addr 172.21.15.26:0/518393592 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.826+0000 7f8523fff700 1 --2- 172.21.15.26:0/518393592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d84fe0 0x558389d8ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.826+0000 7f8529770700 1 --2- 172.21.15.26:0/518393592 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d85ed0 0x558389d95aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.826+0000 7f8528f6f700 1 -- 172.21.15.26:0/518393592 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d85ed0 msgr2=0x558389d95aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.826+0000 7f8528f6f700 1 --2- 172.21.15.26:0/518393592 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d85ed0 0x558389d95aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.826+0000 7f8528f6f700 1 -- 172.21.15.26:0/518393592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d84fe0 msgr2=0x558389d8ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.826+0000 7f8528f6f700 1 --2- 172.21.15.26:0/518393592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d84fe0 0x558389d8ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.826+0000 7f8528f6f700 1 -- 172.21.15.26:0/518393592 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851000eab0 con 0x558389d84680 2023-12-01T01:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.826+0000 7f8529770700 1 --2- 172.21.15.26:0/518393592 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d85ed0 0x558389d95aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.826+0000 7f8528f6f700 1 --2- 172.21.15.26:0/518393592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d8e520 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f851809a5c0 tx=0x7f851809ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558336d25cfceea9 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.826+0000 7f8503fff700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.826+0000 7f8503fff700 1 -- 172.21.15.26:0/518393592 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85180a2610 con 0x558389d84680 2023-12-01T01:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.826+0000 7f8503fff700 1 -- 172.21.15.26:0/518393592 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f851809e6f0 con 0x558389d84680 2023-12-01T01:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.826+0000 7f8537363b80 1 -- 172.21.15.26:0/518393592 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558389d00cb0 con 0x558389d84680 2023-12-01T01:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.826+0000 7f8503fff700 1 -- 172.21.15.26:0/518393592 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85180a28a0 con 0x558389d84680 2023-12-01T01:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.826+0000 7f8537363b80 10 client.15939 fetch_fsmap learned FSMap version 32 2023-12-01T01:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.826+0000 7f8537363b80 1 -- 172.21.15.26:0/518393592 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x558389aecc00 con 0x558389d84680 2023-12-01T01:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.827+0000 7f8503fff700 1 -- 172.21.15.26:0/518393592 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x558389d00cb0 con 0x558389d84680 2023-12-01T01:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.827+0000 7f8503fff700 1 -- 172.21.15.26:0/518393592 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 32) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f85180999b0 con 0x558389d84680 2023-12-01T01:06:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.827+0000 7f8537363b80 10 client.15939 fetch_fsmap finished waiting for FSMap version 32 2023-12-01T01:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.827+0000 7f8537363b80 10 client.15939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.827+0000 7f8537363b80 20 client.15939 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.827+0000 7f8537363b80 1 --2- 172.21.15.26:0/518393592 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x558389d99f70 0x558389d9c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.827+0000 7f8537363b80 4 client.15939 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.827+0000 7f8537363b80 1 -- 172.21.15.26:0/518393592 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558389d53db0 con 0x558389d99f70 2023-12-01T01:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.827+0000 7f8523fff700 1 --2- 172.21.15.26:0/518393592 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x558389d99f70 0x558389d9c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.827+0000 7f8523fff700 1 --2- 172.21.15.26:0/518393592 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x558389d99f70 0x558389d9c390 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1431b9d4c8780cf0 server_cookie=b9ff49e2669d0ef3 in_seq=0 out_seq=0 2023-12-01T01:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.827+0000 7f8503fff700 10 client.15939 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.828+0000 7f8503fff700 1 -- 172.21.15.26:0/518393592 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x558389d53db0 con 0x558389d99f70 2023-12-01T01:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.828+0000 7f8503fff700 10 client.15939 handle_command_reply: tid=0 2023-12-01T01:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.828+0000 7f8537363b80 1 client.15939 shutdown 2023-12-01T01:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.828+0000 7f8537363b80 1 -- 172.21.15.26:0/518393592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 msgr2=0x558389d8e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.828+0000 7f8537363b80 1 --2- 172.21.15.26:0/518393592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d8e520 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f851809a5c0 tx=0x7f851809ae00 comp rx=0 tx=0).stop 2023-12-01T01:06:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.828+0000 7f8537363b80 1 -- 172.21.15.26:0/518393592 shutdown_connections 2023-12-01T01:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.828+0000 7f8537363b80 1 --2- 172.21.15.26:0/518393592 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x558389d99f70 0x558389d9c390 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.828+0000 7f8537363b80 1 --2- 172.21.15.26:0/518393592 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d85ed0 0x558389d95aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.828+0000 7f8503fff700 0 client.15939 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.828+0000 7f8537363b80 1 --2- 172.21.15.26:0/518393592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d8e520 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.828+0000 7f8537363b80 1 --2- 172.21.15.26:0/518393592 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d84fe0 0x558389d8ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.828+0000 7f8537363b80 1 -- 172.21.15.26:0/518393592 >> 172.21.15.26:0/518393592 conn(0x558389ce4070 msgr2=0x558389d7f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.828+0000 7f8537363b80 1 -- 172.21.15.26:0/518393592 shutdown_connections 2023-12-01T01:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.828+0000 7f8537363b80 1 -- 172.21.15.26:0/518393592 wait complete. 2023-12-01T01:06:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.828+0000 7f8537363b80 20 client.15939 trim_cache size 0 max 16384 2023-12-01T01:06:51.849 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.843+0000 7f8537363b80 1 Processor -- start 2023-12-01T01:06:51.849 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.843+0000 7f8537363b80 1 -- start start 2023-12-01T01:06:51.849 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.843+0000 7f8537363b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d8c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.849 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.843+0000 7f8537363b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84fe0 0x558389d95a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.843+0000 7f8537363b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 0x558389d80c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.843+0000 7f8537363b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x558389d80490 con 0x558389d84680 2023-12-01T01:06:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.843+0000 7f8537363b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x558389d777a0 con 0x558389d85ed0 2023-12-01T01:06:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.843+0000 7f8537363b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x558389d80630 con 0x558389d84fe0 2023-12-01T01:06:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.843+0000 7f8528f6f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d8c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.843+0000 7f8528f6f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d8c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56502/0 (socket says 172.21.15.26:56502) 2023-12-01T01:06:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.843+0000 7f8528f6f700 1 -- 172.21.15.26:0/610167571 learned_addr learned my addr 172.21.15.26:0/610167571 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.843+0000 7f8529770700 1 --2- 172.21.15.26:0/610167571 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 0x558389d80c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.844+0000 7f8523fff700 1 --2- 172.21.15.26:0/610167571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84fe0 0x558389d95a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.844+0000 7f8528f6f700 1 -- 172.21.15.26:0/610167571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84fe0 msgr2=0x558389d95a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:51.850 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.844+0000 7f8528f6f700 1 --2- 172.21.15.26:0/610167571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84fe0 0x558389d95a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.844+0000 7f8528f6f700 1 -- 172.21.15.26:0/610167571 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 msgr2=0x558389d80c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.844+0000 7f8528f6f700 1 --2- 172.21.15.26:0/610167571 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 0x558389d80c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.844+0000 7f8528f6f700 1 -- 172.21.15.26:0/610167571 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558389b2a1f0 con 0x558389d84680 2023-12-01T01:06:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.844+0000 7f8529770700 1 --2- 172.21.15.26:0/610167571 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 0x558389d80c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:06:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.844+0000 7f8523fff700 1 --2- 172.21.15.26:0/610167571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84fe0 0x558389d95a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:06:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.844+0000 7f8528f6f700 1 --2- 172.21.15.26:0/610167571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d8c2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f85180972e0 tx=0x7f8518098e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e8134eecf8b196 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.844+0000 7f850f7fe700 1 -- 172.21.15.26:0/610167571 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851809e6f0 con 0x558389d84680 2023-12-01T01:06:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.844+0000 7f850f7fe700 1 -- 172.21.15.26:0/610167571 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f85180a28a0 con 0x558389d84680 2023-12-01T01:06:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.844+0000 7f850f7fe700 1 -- 172.21.15.26:0/610167571 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8518099a60 con 0x558389d84680 2023-12-01T01:06:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.845+0000 7f8537363b80 1 -- 172.21.15.26:0/610167571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 msgr2=0x558389d8c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.845+0000 7f8537363b80 1 --2- 172.21.15.26:0/610167571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d8c2f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f85180972e0 tx=0x7f8518098e70 comp rx=0 tx=0).stop 2023-12-01T01:06:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.845+0000 7f8537363b80 1 -- 172.21.15.26:0/610167571 shutdown_connections 2023-12-01T01:06:51.851 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.845+0000 7f8537363b80 1 --2- 172.21.15.26:0/610167571 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 0x558389d80c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.845+0000 7f8537363b80 1 --2- 172.21.15.26:0/610167571 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d8c2f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.845+0000 7f8537363b80 1 --2- 172.21.15.26:0/610167571 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84fe0 0x558389d95a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.845+0000 7f8537363b80 1 -- 172.21.15.26:0/610167571 >> 172.21.15.26:0/610167571 conn(0x558389ce4070 msgr2=0x558389d8d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.845+0000 7f8537363b80 1 -- 172.21.15.26:0/610167571 shutdown_connections 2023-12-01T01:06:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.845+0000 7f8537363b80 1 -- 172.21.15.26:0/610167571 wait complete. 2023-12-01T01:06:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.845+0000 7f8537363b80 1 -- start start 2023-12-01T01:06:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.845+0000 7f8537363b80 1 Processor -- start 2023-12-01T01:06:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8537363b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d937a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8537363b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84fe0 0x558389d93ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8537363b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 0x558389d94cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8537363b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x558389d95230 con 0x558389d84680 2023-12-01T01:06:51.852 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8537363b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x558389d953a0 con 0x558389d85ed0 2023-12-01T01:06:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8537363b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x558389d95560 con 0x558389d84fe0 2023-12-01T01:06:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8537363b80 10 client.0 _ll_register_callbacks cb 0x7f851809a4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8528f6f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d937a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8528f6f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d937a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56508/0 (socket says 172.21.15.26:56508) 2023-12-01T01:06:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8528f6f700 1 -- 172.21.15.26:0/548782197 learned_addr learned my addr 172.21.15.26:0/548782197 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8523fff700 1 --2- 172.21.15.26:0/548782197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84fe0 0x558389d93ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8529770700 1 --2- 172.21.15.26:0/548782197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 0x558389d94cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8528f6f700 1 -- 172.21.15.26:0/548782197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84fe0 msgr2=0x558389d93ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8528f6f700 1 --2- 172.21.15.26:0/548782197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84fe0 0x558389d93ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.853 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8528f6f700 1 -- 172.21.15.26:0/548782197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 msgr2=0x558389d94cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8528f6f700 1 --2- 172.21.15.26:0/548782197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 0x558389d94cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8528f6f700 1 -- 172.21.15.26:0/548782197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851c0091b0 con 0x558389d84680 2023-12-01T01:06:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8529770700 1 --2- 172.21.15.26:0/548782197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 0x558389d94cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:06:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.846+0000 7f8523fff700 1 --2- 172.21.15.26:0/548782197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84fe0 0x558389d93ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:06:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8528f6f700 1 --2- 172.21.15.26:0/548782197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d937a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f851809a850 tx=0x7f851809ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c3aa38b2addfc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8503fff700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:06:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8503fff700 1 -- 172.21.15.26:0/548782197 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851809e3b0 con 0x558389d84680 2023-12-01T01:06:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8503fff700 1 -- 172.21.15.26:0/548782197 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f85180b6020 con 0x558389d84680 2023-12-01T01:06:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8537363b80 1 -- 172.21.15.26:0/548782197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f851000ee00 con 0x558389d84680 2023-12-01T01:06:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8503fff700 1 -- 172.21.15.26:0/548782197 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f851809e510 con 0x558389d84680 2023-12-01T01:06:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8537363b80 10 client.15945 fetch_fsmap learned FSMap version 32 2023-12-01T01:06:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8537363b80 1 -- 172.21.15.26:0/548782197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x558389aecc00 con 0x558389d84680 2023-12-01T01:06:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8503fff700 1 -- 172.21.15.26:0/548782197 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f851000ee00 con 0x558389d84680 2023-12-01T01:06:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8503fff700 1 -- 172.21.15.26:0/548782197 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 32) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f85180b8a10 con 0x558389d84680 2023-12-01T01:06:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8537363b80 10 client.15945 fetch_fsmap finished waiting for FSMap version 32 2023-12-01T01:06:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8537363b80 10 client.15945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-12-01T01:06:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8537363b80 20 client.15945 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8537363b80 1 --2- 172.21.15.26:0/548782197 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x558389dec3c0 0x558389dee7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8537363b80 4 client.15945 mds_command: new command op to 24509 tid=0[{"prefix": "flush journal"}] 2023-12-01T01:06:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8537363b80 1 -- 172.21.15.26:0/548782197 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558389ccece0 con 0x558389dec3c0 2023-12-01T01:06:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.847+0000 7f8523fff700 1 --2- 172.21.15.26:0/548782197 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x558389dec3c0 0x558389dee7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.848+0000 7f8503fff700 10 client.15945 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.848+0000 7f8523fff700 1 --2- 172.21.15.26:0/548782197 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x558389dec3c0 0x558389dee7e0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8feeb9fec47d47 server_cookie=33adaa30ce4afd79 in_seq=0 out_seq=0 2023-12-01T01:06:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.869+0000 7f8503fff700 1 -- 172.21.15.26:0/548782197 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558389ccece0 con 0x558389dec3c0 2023-12-01T01:06:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.869+0000 7f8503fff700 10 client.15945 handle_command_reply: tid=0 2023-12-01T01:06:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.869+0000 7f8537363b80 1 client.15945 shutdown 2023-12-01T01:06:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.869+0000 7f8537363b80 1 -- 172.21.15.26:0/548782197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 msgr2=0x558389d937a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.869+0000 7f8537363b80 1 --2- 172.21.15.26:0/548782197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d937a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f851809a850 tx=0x7f851809ae00 comp rx=0 tx=0).stop 2023-12-01T01:06:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.869+0000 7f8537363b80 1 -- 172.21.15.26:0/548782197 shutdown_connections 2023-12-01T01:06:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.869+0000 7f8537363b80 1 --2- 172.21.15.26:0/548782197 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x558389dec3c0 0x558389dee7e0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.871 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.869+0000 7f8537363b80 1 --2- 172.21.15.26:0/548782197 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x558389d85ed0 0x558389d94cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.869+0000 7f8503fff700 0 client.15945 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.869+0000 7f8537363b80 1 --2- 172.21.15.26:0/548782197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558389d84680 0x558389d937a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.869+0000 7f8537363b80 1 --2- 172.21.15.26:0/548782197 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x558389d84fe0 0x558389d93ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.869+0000 7f8537363b80 1 -- 172.21.15.26:0/548782197 >> 172.21.15.26:0/548782197 conn(0x558389ce4070 msgr2=0x558389d96330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.870+0000 7f8537363b80 1 -- 172.21.15.26:0/548782197 shutdown_connections 2023-12-01T01:06:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.870+0000 7f8537363b80 1 -- 172.21.15.26:0/548782197 wait complete. 2023-12-01T01:06:51.872 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.870+0000 7f8537363b80 20 client.15945 trim_cache size 0 max 16384 2023-12-01T01:06:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:{ 2023-12-01T01:06:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "message": "", 2023-12-01T01:06:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout: "return_code": 0 2023-12-01T01:06:51.873 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stdout:} 2023-12-01T01:06:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.870+0000 7f852b1d3700 1 -- 172.21.15.26:0/4036919322 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f85140a0520 msgr2=0x7f85140a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.870+0000 7f852b1d3700 1 --2- 172.21.15.26:0/4036919322 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f85140a0520 0x7f85140a29e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8510005fd0 tx=0x7f8510005ee0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.870+0000 7f852b1d3700 1 -- 172.21.15.26:0/4036919322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8524101850 msgr2=0x7f8524196c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.870+0000 7f852b1d3700 1 --2- 172.21.15.26:0/4036919322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8524101850 0x7f8524196c20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f85180059d0 tx=0x7f851800f740 comp rx=0 tx=0).stop 2023-12-01T01:06:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.870+0000 7f852b1d3700 1 -- 172.21.15.26:0/4036919322 shutdown_connections 2023-12-01T01:06:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.870+0000 7f852b1d3700 1 --2- 172.21.15.26:0/4036919322 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f85140a0520 0x7f85140a29e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.874 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.870+0000 7f852b1d3700 1 --2- 172.21.15.26:0/4036919322 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8524106ab0 0x7f8524197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.870+0000 7f852b1d3700 1 --2- 172.21.15.26:0/4036919322 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8524101850 0x7f8524196c20 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.870+0000 7f852b1d3700 1 --2- 172.21.15.26:0/4036919322 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8524104180 0x7f8524197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.870+0000 7f852b1d3700 1 -- 172.21.15.26:0/4036919322 >> 172.21.15.26:0/4036919322 conn(0x7f85240fb200 msgr2=0x7f8524102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.870+0000 7f852b1d3700 1 -- 172.21.15.26:0/4036919322 shutdown_connections 2023-12-01T01:06:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi026.front.sepia.ceph.com.smithi026.stderr:2023-12-01T01:06:51.870+0000 7f852b1d3700 1 -- 172.21.15.26:0/4036919322 wait complete. 2023-12-01T01:06:51.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:51 smithi116 ceph-mon[103554]: pgmap v370: 97 pgs: 97 active+clean; 54 MiB data, 430 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 459 op/s 2023-12-01T01:06:51.969 DEBUG:teuthology.parallel:result is None 2023-12-01T01:06:51.969 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-12-01T01:06:52.040 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-12-01T01:06:52.041 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-12-01T01:06:52.051 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi026.front.sepia.ceph.com 2023-12-01T01:06:52.089 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-12-01T01:06:52.098 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-12-01T01:06:53.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:53 smithi093 ceph-mon[103327]: pgmap v371: 97 pgs: 97 active+clean; 53 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 837 KiB/s wr, 323 op/s 2023-12-01T01:06:53.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:53 smithi026 ceph-mon[98801]: pgmap v371: 97 pgs: 97 active+clean; 53 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 837 KiB/s wr, 323 op/s 2023-12-01T01:06:53.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:53 smithi116 ceph-mon[103554]: pgmap v371: 97 pgs: 97 active+clean; 53 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 837 KiB/s wr, 323 op/s 2023-12-01T01:06:55.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:55 smithi093 ceph-mon[103327]: pgmap v372: 97 pgs: 97 active+clean; 53 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 721 KiB/s wr, 235 op/s 2023-12-01T01:06:55.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:55 smithi026 ceph-mon[98801]: pgmap v372: 97 pgs: 97 active+clean; 53 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 721 KiB/s wr, 235 op/s 2023-12-01T01:06:55.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:55 smithi116 ceph-mon[103554]: pgmap v372: 97 pgs: 97 active+clean; 53 MiB data, 409 MiB used, 1.0 TiB / 1.0 TiB avail; 880 KiB/s rd, 721 KiB/s wr, 235 op/s 2023-12-01T01:06:57.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:57 smithi093 ceph-mon[103327]: pgmap v373: 97 pgs: 97 active+clean; 53 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 749 KiB/s wr, 236 op/s 2023-12-01T01:06:57.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:57 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:06:57.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:57 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:06:57.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:57 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:06:57.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:57 smithi026 ceph-mon[98801]: pgmap v373: 97 pgs: 97 active+clean; 53 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 749 KiB/s wr, 236 op/s 2023-12-01T01:06:57.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:06:57.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:06:57.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:57 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:06:57.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:57 smithi116 ceph-mon[103554]: pgmap v373: 97 pgs: 97 active+clean; 53 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 749 KiB/s wr, 236 op/s 2023-12-01T01:06:57.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:57 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-01T01:06:57.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:57 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:06:57.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:57 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:06:58.349 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-12-01T01:06:58.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.481+0000 7ff1ad7cc700 1 -- 172.21.15.26:0/2560893231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a8106ac0 msgr2=0x7ff1a8108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:58.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.481+0000 7ff1ad7cc700 1 --2- 172.21.15.26:0/2560893231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a8106ac0 0x7ff1a8108ed0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff198009990 tx=0x7ff198009ca0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.481+0000 7ff1ad7cc700 1 -- 172.21.15.26:0/2560893231 shutdown_connections 2023-12-01T01:06:58.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.481+0000 7ff1ad7cc700 1 --2- 172.21.15.26:0/2560893231 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a8106ac0 0x7ff1a8108ed0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.481+0000 7ff1ad7cc700 1 --2- 172.21.15.26:0/2560893231 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1a8101860 0x7ff1a8103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.481+0000 7ff1ad7cc700 1 --2- 172.21.15.26:0/2560893231 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1a8104190 0x7ff1a8106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.481+0000 7ff1ad7cc700 1 -- 172.21.15.26:0/2560893231 >> 172.21.15.26:0/2560893231 conn(0x7ff1a80fb1f0 msgr2=0x7ff1a80fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:58.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.481+0000 7ff1ad7cc700 1 -- 172.21.15.26:0/2560893231 shutdown_connections 2023-12-01T01:06:58.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.481+0000 7ff1ad7cc700 1 -- 172.21.15.26:0/2560893231 wait complete. 2023-12-01T01:06:58.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.482+0000 7ff1ad7cc700 1 Processor -- start 2023-12-01T01:06:58.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.482+0000 7ff1ad7cc700 1 -- start start 2023-12-01T01:06:58.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.482+0000 7ff1ad7cc700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1a8101860 0x7ff1a8198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.482+0000 7ff1ad7cc700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1a8104190 0x7ff1a8199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.482+0000 7ff1ad7cc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a8106ac0 0x7ff1a81a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.482+0000 7ff1ad7cc700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a81a09a0 con 0x7ff1a8106ac0 2023-12-01T01:06:58.486 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.482+0000 7ff1ad7cc700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a81a0ae0 con 0x7ff1a8101860 2023-12-01T01:06:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.482+0000 7ff1ad7cc700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a81a0c70 con 0x7ff1a8104190 2023-12-01T01:06:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.482+0000 7ff1a77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a8106ac0 0x7ff1a81a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.482+0000 7ff1a77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a8106ac0 0x7ff1a81a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56522/0 (socket says 172.21.15.26:56522) 2023-12-01T01:06:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.482+0000 7ff1a6ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1a8101860 0x7ff1a8198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.482+0000 7ff1a77fe700 1 -- 172.21.15.26:0/1979678503 learned_addr learned my addr 172.21.15.26:0/1979678503 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.482+0000 7ff1a67fc700 1 --2- 172.21.15.26:0/1979678503 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1a8104190 0x7ff1a8199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.483+0000 7ff1a77fe700 1 -- 172.21.15.26:0/1979678503 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1a8104190 msgr2=0x7ff1a8199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.483+0000 7ff1a77fe700 1 --2- 172.21.15.26:0/1979678503 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1a8104190 0x7ff1a8199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.487 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.483+0000 7ff1a77fe700 1 -- 172.21.15.26:0/1979678503 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1a8101860 msgr2=0x7ff1a8198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:58.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.483+0000 7ff1a77fe700 1 --2- 172.21.15.26:0/1979678503 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1a8101860 0x7ff1a8198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.483+0000 7ff1a77fe700 1 -- 172.21.15.26:0/1979678503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1980095f0 con 0x7ff1a8106ac0 2023-12-01T01:06:58.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.483+0000 7ff1a77fe700 1 --2- 172.21.15.26:0/1979678503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a8106ac0 0x7ff1a81a03d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff1980095c0 tx=0x7ff19800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:58.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.483+0000 7ff19ffff700 1 -- 172.21.15.26:0/1979678503 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19801d070 con 0x7ff1a8106ac0 2023-12-01T01:06:58.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.483+0000 7ff19ffff700 1 -- 172.21.15.26:0/1979678503 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff198005030 con 0x7ff1a8106ac0 2023-12-01T01:06:58.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.483+0000 7ff1ad7cc700 1 -- 172.21.15.26:0/1979678503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a81a0ef0 con 0x7ff1a8106ac0 2023-12-01T01:06:58.488 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.483+0000 7ff19ffff700 1 -- 172.21.15.26:0/1979678503 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff198004af0 con 0x7ff1a8106ac0 2023-12-01T01:06:58.489 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.483+0000 7ff1ad7cc700 1 -- 172.21.15.26:0/1979678503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a81a12b0 con 0x7ff1a8106ac0 2023-12-01T01:06:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.485+0000 7ff19ffff700 1 -- 172.21.15.26:0/1979678503 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7ff198004c90 con 0x7ff1a8106ac0 2023-12-01T01:06:58.496 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.486+0000 7ff19ffff700 1 --2- 172.21.15.26:0/1979678503 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff1940a0520 0x7ff1940a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.486+0000 7ff1a6ffd700 1 --2- 172.21.15.26:0/1979678503 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff1940a0520 0x7ff1940a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.486+0000 7ff19ffff700 1 -- 172.21.15.26:0/1979678503 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff1980cc9f0 con 0x7ff1a8106ac0 2023-12-01T01:06:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.487+0000 7ff1a6ffd700 1 --2- 172.21.15.26:0/1979678503 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff1940a0520 0x7ff1940a29e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000a400 tx=0x7ff1a000d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.487+0000 7ff1b995cb80 1 Processor -- start 2023-12-01T01:06:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.487+0000 7ff1b995cb80 1 -- start start 2023-12-01T01:06:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.487+0000 7ff1b995cb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621c0f0 0x563ff621c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.487+0000 7ff1b995cb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff621ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.487+0000 7ff1b995cb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621b3f0 0x563ff621b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.487+0000 7ff1b995cb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6172a10 con 0x563ff621ca70 2023-12-01T01:06:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.487+0000 7ff1b995cb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff61703d0 con 0x563ff621b3f0 2023-12-01T01:06:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.487+0000 7ff1b995cb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff616bcc0 con 0x563ff621c0f0 2023-12-01T01:06:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.487+0000 7ff1a67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff621ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.497 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.488+0000 7ff1a67fc700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff621ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56528/0 (socket says 172.21.15.26:56528) 2023-12-01T01:06:58.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.488+0000 7ff1a67fc700 1 -- 172.21.15.26:0/2669496703 learned_addr learned my addr 172.21.15.26:0/2669496703 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:58.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.488+0000 7ff1a6ffd700 1 --2- 172.21.15.26:0/2669496703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621c0f0 0x563ff621c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.488+0000 7ff1a77fe700 1 --2- 172.21.15.26:0/2669496703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621b3f0 0x563ff621b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.488+0000 7ff1a67fc700 1 -- 172.21.15.26:0/2669496703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621c0f0 msgr2=0x563ff621c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:58.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.488+0000 7ff1a67fc700 1 --2- 172.21.15.26:0/2669496703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621c0f0 0x563ff621c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.488+0000 7ff1a67fc700 1 -- 172.21.15.26:0/2669496703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621b3f0 msgr2=0x563ff621b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:58.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.488+0000 7ff1a67fc700 1 --2- 172.21.15.26:0/2669496703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621b3f0 0x563ff621b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.488+0000 7ff1a67fc700 1 -- 172.21.15.26:0/2669496703 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ff5f99de0 con 0x563ff621ca70 2023-12-01T01:06:58.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.488+0000 7ff1a77fe700 1 --2- 172.21.15.26:0/2669496703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621b3f0 0x563ff621b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:06:58.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.488+0000 7ff1a67fc700 1 --2- 172.21.15.26:0/2669496703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff621ae60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff19000bd70 tx=0x7ff1900106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf6bcf0ce04bda2 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:58.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.488+0000 7ff19d7fa700 1 -- 172.21.15.26:0/2669496703 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190010e10 con 0x563ff621ca70 2023-12-01T01:06:58.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.488+0000 7ff19d7fa700 1 -- 172.21.15.26:0/2669496703 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff190015070 con 0x563ff621ca70 2023-12-01T01:06:58.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.488+0000 7ff19d7fa700 1 -- 172.21.15.26:0/2669496703 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff190011760 con 0x563ff621ca70 2023-12-01T01:06:58.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.489+0000 7ff1b995cb80 1 -- 172.21.15.26:0/2669496703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 msgr2=0x563ff621ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:58.498 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.489+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/2669496703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff621ae60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff19000bd70 tx=0x7ff1900106b0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.489+0000 7ff1b995cb80 1 -- 172.21.15.26:0/2669496703 shutdown_connections 2023-12-01T01:06:58.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.489+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/2669496703 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621b3f0 0x563ff621b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.489+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/2669496703 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621c0f0 0x563ff621c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.489+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/2669496703 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff621ae60 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.489+0000 7ff1b995cb80 1 -- 172.21.15.26:0/2669496703 >> 172.21.15.26:0/2669496703 conn(0x563ff617a0d0 msgr2=0x563ff6215940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:58.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.489+0000 7ff1b995cb80 1 -- 172.21.15.26:0/2669496703 shutdown_connections 2023-12-01T01:06:58.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.489+0000 7ff1b995cb80 1 -- 172.21.15.26:0/2669496703 wait complete. 2023-12-01T01:06:58.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.489+0000 7ff1b995cb80 1 -- start start 2023-12-01T01:06:58.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.489+0000 7ff1b995cb80 1 Processor -- start 2023-12-01T01:06:58.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1b995cb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621b3f0 0x563ff62249b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1b995cb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621c0f0 0x563ff6224ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1b995cb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff622bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1b995cb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6108510 con 0x563ff621ca70 2023-12-01T01:06:58.499 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1b995cb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff61081b0 con 0x563ff621c0f0 2023-12-01T01:06:58.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1b995cb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff5fef920 con 0x563ff621b3f0 2023-12-01T01:06:58.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1b995cb80 10 client.0 _ll_register_callbacks cb 0x563ff6055a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:58.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1a77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff622bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1a6ffd700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621b3f0 0x563ff62249b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1a77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff622bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56536/0 (socket says 172.21.15.26:56536) 2023-12-01T01:06:58.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1a77fe700 1 -- 172.21.15.26:0/2366694399 learned_addr learned my addr 172.21.15.26:0/2366694399 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:58.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1a67fc700 1 --2- 172.21.15.26:0/2366694399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621c0f0 0x563ff6224ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1a77fe700 1 -- 172.21.15.26:0/2366694399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621b3f0 msgr2=0x563ff62249b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:58.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1a77fe700 1 --2- 172.21.15.26:0/2366694399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621b3f0 0x563ff62249b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1a77fe700 1 -- 172.21.15.26:0/2366694399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621c0f0 msgr2=0x563ff6224ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:58.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1a77fe700 1 --2- 172.21.15.26:0/2366694399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621c0f0 0x563ff6224ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1a77fe700 1 -- 172.21.15.26:0/2366694399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff19000b9a0 con 0x563ff621ca70 2023-12-01T01:06:58.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1a6ffd700 1 --2- 172.21.15.26:0/2366694399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621b3f0 0x563ff62249b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:06:58.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff1a77fe700 1 --2- 172.21.15.26:0/2366694399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff622bf30 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff198096d60 tx=0x7ff19809a9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5178243e07478e16 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:58.500 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.490+0000 7ff18e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:06:58.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.491+0000 7ff18e7fc700 1 -- 172.21.15.26:0/2366694399 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19809a2f0 con 0x563ff621ca70 2023-12-01T01:06:58.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.491+0000 7ff18e7fc700 1 -- 172.21.15.26:0/2366694399 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff19809e120 con 0x563ff621ca70 2023-12-01T01:06:58.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.491+0000 7ff1b995cb80 1 -- 172.21.15.26:0/2366694399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ff6196d10 con 0x563ff621ca70 2023-12-01T01:06:58.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.491+0000 7ff18e7fc700 1 -- 172.21.15.26:0/2366694399 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1980a22d0 con 0x563ff621ca70 2023-12-01T01:06:58.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.491+0000 7ff1b995cb80 10 client.15957 fetch_fsmap learned FSMap version 32 2023-12-01T01:06:58.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.491+0000 7ff1b995cb80 1 -- 172.21.15.26:0/2366694399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x563ff5f82c60 con 0x563ff621ca70 2023-12-01T01:06:58.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.491+0000 7ff18e7fc700 1 -- 172.21.15.26:0/2366694399 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff1980b6020 con 0x563ff621ca70 2023-12-01T01:06:58.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.491+0000 7ff18e7fc700 1 -- 172.21.15.26:0/2366694399 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 32) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ff1980add20 con 0x563ff621ca70 2023-12-01T01:06:58.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.491+0000 7ff1b995cb80 10 client.15957 fetch_fsmap finished waiting for FSMap version 32 2023-12-01T01:06:58.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.491+0000 7ff1b995cb80 10 client.15957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:06:58.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.491+0000 7ff1b995cb80 20 client.15957 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:58.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.491+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/2366694399 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x563ff62303b0 0x563ff62327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.491+0000 7ff1b995cb80 4 client.15957 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:06:58.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.491+0000 7ff1b995cb80 1 -- 172.21.15.26:0/2366694399 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ff61e9e10 con 0x563ff62303b0 2023-12-01T01:06:58.501 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.491+0000 7ff1a6ffd700 1 --2- 172.21.15.26:0/2366694399 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x563ff62303b0 0x563ff62327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.492+0000 7ff18e7fc700 10 client.15957 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:58.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.492+0000 7ff1a6ffd700 1 --2- 172.21.15.26:0/2366694399 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x563ff62303b0 0x563ff62327d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bad436f1997884c9 server_cookie=cd59441389a70b43 in_seq=0 out_seq=0 2023-12-01T01:06:58.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.492+0000 7ff18e7fc700 1 -- 172.21.15.26:0/2366694399 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x563ff61e9e10 con 0x563ff62303b0 2023-12-01T01:06:58.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.492+0000 7ff18e7fc700 10 client.15957 handle_command_reply: tid=0 2023-12-01T01:06:58.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.492+0000 7ff1b995cb80 1 client.15957 shutdown 2023-12-01T01:06:58.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.493+0000 7ff1b995cb80 1 -- 172.21.15.26:0/2366694399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 msgr2=0x563ff622bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:58.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.493+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/2366694399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff622bf30 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7ff198096d60 tx=0x7ff19809a9f0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.493+0000 7ff1b995cb80 1 -- 172.21.15.26:0/2366694399 shutdown_connections 2023-12-01T01:06:58.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.493+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/2366694399 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x563ff62303b0 0x563ff62327d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.493+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/2366694399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff622bf30 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.493+0000 7ff18e7fc700 0 client.15957 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:58.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.493+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/2366694399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621b3f0 0x563ff62249b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.493+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/2366694399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621c0f0 0x563ff6224ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.502 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.493+0000 7ff1b995cb80 1 -- 172.21.15.26:0/2366694399 >> 172.21.15.26:0/2366694399 conn(0x563ff617a0d0 msgr2=0x563ff62150b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:58.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.493+0000 7ff1b995cb80 1 -- 172.21.15.26:0/2366694399 shutdown_connections 2023-12-01T01:06:58.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.493+0000 7ff1b995cb80 1 -- 172.21.15.26:0/2366694399 wait complete. 2023-12-01T01:06:58.503 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.493+0000 7ff1b995cb80 20 client.15957 trim_cache size 0 max 16384 2023-12-01T01:06:58.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.509+0000 7ff1b995cb80 1 Processor -- start 2023-12-01T01:06:58.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.509+0000 7ff1b995cb80 1 -- start start 2023-12-01T01:06:58.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff1b995cb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621b3f0 0x563ff621ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.511 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff1b995cb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621c0f0 0x563ff6229ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff1b995cb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621ca70 0x563ff621f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff1b995cb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6217410 con 0x563ff621b3f0 2023-12-01T01:06:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff1b995cb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6223030 con 0x563ff621ca70 2023-12-01T01:06:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff1b995cb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6232e30 con 0x563ff621c0f0 2023-12-01T01:06:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff1a6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621b3f0 0x563ff621ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff1a6ffd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621b3f0 0x563ff621ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56540/0 (socket says 172.21.15.26:56540) 2023-12-01T01:06:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff1a6ffd700 1 -- 172.21.15.26:0/724823634 learned_addr learned my addr 172.21.15.26:0/724823634 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff1a6ffd700 1 -- 172.21.15.26:0/724823634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621c0f0 msgr2=0x563ff6229ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff1a6ffd700 1 --2- 172.21.15.26:0/724823634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621c0f0 0x563ff6229ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff1a6ffd700 1 -- 172.21.15.26:0/724823634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621ca70 msgr2=0x563ff621f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff1a6ffd700 1 --2- 172.21.15.26:0/724823634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621ca70 0x563ff621f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff1a6ffd700 1 -- 172.21.15.26:0/724823634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ff5fc0250 con 0x563ff621b3f0 2023-12-01T01:06:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff1a6ffd700 1 --2- 172.21.15.26:0/724823634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621b3f0 0x563ff621ae60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x563ff621be90 tx=0x7ff1a0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4744d97bd5325fe6 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:58.512 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff19dffb700 1 -- 172.21.15.26:0/724823634 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0029070 con 0x563ff621b3f0 2023-12-01T01:06:58.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff19dffb700 1 -- 172.21.15.26:0/724823634 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff1a001c040 con 0x563ff621b3f0 2023-12-01T01:06:58.513 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.510+0000 7ff19dffb700 1 -- 172.21.15.26:0/724823634 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a0010040 con 0x563ff621b3f0 2023-12-01T01:06:58.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.511+0000 7ff1b995cb80 1 -- 172.21.15.26:0/724823634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621b3f0 msgr2=0x563ff621ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:58.517 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.511+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/724823634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621b3f0 0x563ff621ae60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x563ff621be90 tx=0x7ff1a0011000 comp rx=0 tx=0).stop 2023-12-01T01:06:58.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.511+0000 7ff1b995cb80 1 -- 172.21.15.26:0/724823634 shutdown_connections 2023-12-01T01:06:58.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.511+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/724823634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621ca70 0x563ff621f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.511+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/724823634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621b3f0 0x563ff621ae60 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.511+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/724823634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621c0f0 0x563ff6229ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.511+0000 7ff1b995cb80 1 -- 172.21.15.26:0/724823634 >> 172.21.15.26:0/724823634 conn(0x563ff617a0d0 msgr2=0x563ff62236e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:58.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.511+0000 7ff1b995cb80 1 -- 172.21.15.26:0/724823634 shutdown_connections 2023-12-01T01:06:58.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.511+0000 7ff1b995cb80 1 -- 172.21.15.26:0/724823634 wait complete. 2023-12-01T01:06:58.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.511+0000 7ff1b995cb80 1 -- start start 2023-12-01T01:06:58.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.511+0000 7ff1b995cb80 1 Processor -- start 2023-12-01T01:06:58.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1b995cb80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621b3f0 0x563ff627a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.518 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1b995cb80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621c0f0 0x563ff627a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1b995cb80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff6281500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1b995cb80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6281a40 con 0x563ff621ca70 2023-12-01T01:06:58.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1b995cb80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6281b80 con 0x563ff621c0f0 2023-12-01T01:06:58.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1b995cb80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ff6281d10 con 0x563ff621b3f0 2023-12-01T01:06:58.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1b995cb80 10 client.0 _ll_register_callbacks cb 0x563ff6055a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:58.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1a77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff6281500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1a77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff6281500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56550/0 (socket says 172.21.15.26:56550) 2023-12-01T01:06:58.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1a77fe700 1 -- 172.21.15.26:0/561175311 learned_addr learned my addr 172.21.15.26:0/561175311 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:58.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1a6ffd700 1 --2- 172.21.15.26:0/561175311 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621b3f0 0x563ff627a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1a67fc700 1 --2- 172.21.15.26:0/561175311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621c0f0 0x563ff627a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1a77fe700 1 -- 172.21.15.26:0/561175311 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621b3f0 msgr2=0x563ff627a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:58.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1a77fe700 1 --2- 172.21.15.26:0/561175311 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621b3f0 0x563ff627a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1a77fe700 1 -- 172.21.15.26:0/561175311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621c0f0 msgr2=0x563ff627a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:58.519 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1a77fe700 1 --2- 172.21.15.26:0/561175311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621c0f0 0x563ff627a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1a77fe700 1 -- 172.21.15.26:0/561175311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a0016b80 con 0x563ff621ca70 2023-12-01T01:06:58.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1a77fe700 1 --2- 172.21.15.26:0/561175311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff6281500 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff19809a280 tx=0x7ff1980a1ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01176cab4d8a76a server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:58.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff18e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:06:58.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff18e7fc700 1 -- 172.21.15.26:0/561175311 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19809e120 con 0x563ff621ca70 2023-12-01T01:06:58.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff18e7fc700 1 -- 172.21.15.26:0/561175311 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7ff1980b7080 con 0x563ff621ca70 2023-12-01T01:06:58.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.512+0000 7ff1b995cb80 1 -- 172.21.15.26:0/561175311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff190015070 con 0x563ff621ca70 2023-12-01T01:06:58.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.513+0000 7ff18e7fc700 1 -- 172.21.15.26:0/561175311 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff19809a2f0 con 0x563ff621ca70 2023-12-01T01:06:58.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.513+0000 7ff1b995cb80 10 client.15963 fetch_fsmap learned FSMap version 32 2023-12-01T01:06:58.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.513+0000 7ff1b995cb80 1 -- 172.21.15.26:0/561175311 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x563ff5f982b0 con 0x563ff621ca70 2023-12-01T01:06:58.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.513+0000 7ff18e7fc700 1 -- 172.21.15.26:0/561175311 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7ff190015070 con 0x563ff621ca70 2023-12-01T01:06:58.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.513+0000 7ff18e7fc700 1 -- 172.21.15.26:0/561175311 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 32) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ff198083b40 con 0x563ff621ca70 2023-12-01T01:06:58.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.513+0000 7ff1b995cb80 10 client.15963 fetch_fsmap finished waiting for FSMap version 32 2023-12-01T01:06:58.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.513+0000 7ff1b995cb80 10 client.15963 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:06:58.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.513+0000 7ff1b995cb80 20 client.15963 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:58.520 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.513+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/561175311 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x563ff6283260 0x563ff6285650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.513+0000 7ff1b995cb80 4 client.15963 mds_command: new command op to 24509 tid=0[{"prefix": "scrub status"}] 2023-12-01T01:06:58.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.513+0000 7ff1b995cb80 1 -- 172.21.15.26:0/561175311 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563ff6164d40 con 0x563ff6283260 2023-12-01T01:06:58.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.513+0000 7ff1a6ffd700 1 --2- 172.21.15.26:0/561175311 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x563ff6283260 0x563ff6285650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff18e7fc700 10 client.15963 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:58.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff1a6ffd700 1 --2- 172.21.15.26:0/561175311 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x563ff6283260 0x563ff6285650 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa0d1526d99dcde5 server_cookie=83184cbf544e3e39 in_seq=0 out_seq=0 2023-12-01T01:06:58.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff18e7fc700 1 -- 172.21.15.26:0/561175311 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x563ff6164d40 con 0x563ff6283260 2023-12-01T01:06:58.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff18e7fc700 10 client.15963 handle_command_reply: tid=0 2023-12-01T01:06:58.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff1b995cb80 1 client.15963 shutdown 2023-12-01T01:06:58.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff1b995cb80 1 -- 172.21.15.26:0/561175311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 msgr2=0x563ff6281500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:58.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/561175311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff6281500 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff19809a280 tx=0x7ff1980a1ee0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff1b995cb80 1 -- 172.21.15.26:0/561175311 shutdown_connections 2023-12-01T01:06:58.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/561175311 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x563ff6283260 0x563ff6285650 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/561175311 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x563ff621ca70 0x563ff6281500 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff18e7fc700 0 client.15963 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:58.521 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/561175311 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x563ff621b3f0 0x563ff627a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff1b995cb80 1 --2- 172.21.15.26:0/561175311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x563ff621c0f0 0x563ff627a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff1b995cb80 1 -- 172.21.15.26:0/561175311 >> 172.21.15.26:0/561175311 conn(0x563ff617a0d0 msgr2=0x563ff621f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:58.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff1b995cb80 1 -- 172.21.15.26:0/561175311 shutdown_connections 2023-12-01T01:06:58.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff1b995cb80 1 -- 172.21.15.26:0/561175311 wait complete. 2023-12-01T01:06:58.522 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.514+0000 7ff1b995cb80 20 client.15963 trim_cache size 0 max 16384 2023-12-01T01:06:58.522 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:06:58.522 INFO:teuthology.orchestra.run.smithi026.stdout: "status": "no active scrubs running", 2023-12-01T01:06:58.522 INFO:teuthology.orchestra.run.smithi026.stdout: "scrubs": {} 2023-12-01T01:06:58.522 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:06:58.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.515+0000 7ff1ad7cc700 1 -- 172.21.15.26:0/1979678503 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff1940a0520 msgr2=0x7ff1940a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:58.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.515+0000 7ff1ad7cc700 1 --2- 172.21.15.26:0/1979678503 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff1940a0520 0x7ff1940a29e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff1a000a400 tx=0x7ff1a000d040 comp rx=0 tx=0).stop 2023-12-01T01:06:58.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.515+0000 7ff1ad7cc700 1 -- 172.21.15.26:0/1979678503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a8106ac0 msgr2=0x7ff1a81a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:58.523 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.515+0000 7ff1ad7cc700 1 --2- 172.21.15.26:0/1979678503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a8106ac0 0x7ff1a81a03d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff1980095c0 tx=0x7ff19800f690 comp rx=0 tx=0).stop 2023-12-01T01:06:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.515+0000 7ff1ad7cc700 1 -- 172.21.15.26:0/1979678503 shutdown_connections 2023-12-01T01:06:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.515+0000 7ff1ad7cc700 1 --2- 172.21.15.26:0/1979678503 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7ff1940a0520 0x7ff1940a29e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.515+0000 7ff1ad7cc700 1 --2- 172.21.15.26:0/1979678503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1a8106ac0 0x7ff1a81a03d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.515+0000 7ff1ad7cc700 1 --2- 172.21.15.26:0/1979678503 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff1a8101860 0x7ff1a8198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.515+0000 7ff1ad7cc700 1 --2- 172.21.15.26:0/1979678503 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7ff1a8104190 0x7ff1a8199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.515+0000 7ff1ad7cc700 1 -- 172.21.15.26:0/1979678503 >> 172.21.15.26:0/1979678503 conn(0x7ff1a80fb1f0 msgr2=0x7ff1a81024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.515+0000 7ff1ad7cc700 1 -- 172.21.15.26:0/1979678503 shutdown_connections 2023-12-01T01:06:58.524 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.515+0000 7ff1ad7cc700 1 -- 172.21.15.26:0/1979678503 wait complete. 2023-12-01T01:06:58.529 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-01T01:06:58.529 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:06:58.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.660+0000 7f8f25302700 1 -- 172.21.15.26:0/258939159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f20102920 msgr2=0x7f8f201091d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:58.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.660+0000 7f8f25302700 1 --2- 172.21.15.26:0/258939159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f20102920 0x7f8f201091d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8f1800b0d0 tx=0x7f8f1800b3e0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.660+0000 7f8f25302700 1 -- 172.21.15.26:0/258939159 shutdown_connections 2023-12-01T01:06:58.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.660+0000 7f8f25302700 1 --2- 172.21.15.26:0/258939159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f20102920 0x7f8f201091d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.660+0000 7f8f25302700 1 --2- 172.21.15.26:0/258939159 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f20100d90 0x7f8f201011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.660+0000 7f8f25302700 1 --2- 172.21.15.26:0/258939159 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f20101f80 0x7f8f201023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.660+0000 7f8f25302700 1 -- 172.21.15.26:0/258939159 >> 172.21.15.26:0/258939159 conn(0x7f8f200fc2e0 msgr2=0x7f8f200fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:58.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.660+0000 7f8f25302700 1 -- 172.21.15.26:0/258939159 shutdown_connections 2023-12-01T01:06:58.664 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.660+0000 7f8f25302700 1 -- 172.21.15.26:0/258939159 wait complete. 2023-12-01T01:06:58.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f25302700 1 Processor -- start 2023-12-01T01:06:58.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f25302700 1 -- start start 2023-12-01T01:06:58.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f25302700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f20100d90 0x7f8f20074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f25302700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f20101f80 0x7f8f20073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f25302700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f20102920 0x7f8f200736c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f25302700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f20073e60 con 0x7f8f20100d90 2023-12-01T01:06:58.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f25302700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f20073fd0 con 0x7f8f20101f80 2023-12-01T01:06:58.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f25302700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f201a0c60 con 0x7f8f20102920 2023-12-01T01:06:58.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f1effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f20100d90 0x7f8f20074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f1effd700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f20100d90 0x7f8f20074b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56560/0 (socket says 172.21.15.26:56560) 2023-12-01T01:06:58.665 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f1effd700 1 -- 172.21.15.26:0/1577164075 learned_addr learned my addr 172.21.15.26:0/1577164075 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:58.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f1f7fe700 1 --2- 172.21.15.26:0/1577164075 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f20102920 0x7f8f200736c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f1e7fc700 1 --2- 172.21.15.26:0/1577164075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f20101f80 0x7f8f20073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f1effd700 1 -- 172.21.15.26:0/1577164075 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f20102920 msgr2=0x7f8f200736c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:58.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f1effd700 1 --2- 172.21.15.26:0/1577164075 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f20102920 0x7f8f200736c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f1effd700 1 -- 172.21.15.26:0/1577164075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f20101f80 msgr2=0x7f8f20073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:58.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f1effd700 1 --2- 172.21.15.26:0/1577164075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f20101f80 0x7f8f20073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.661+0000 7f8f1effd700 1 -- 172.21.15.26:0/1577164075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f18009d00 con 0x7f8f20100d90 2023-12-01T01:06:58.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.662+0000 7f8f1effd700 1 --2- 172.21.15.26:0/1577164075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f20100d90 0x7f8f20074b40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400e970 tx=0x7f8f1400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:58.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.662+0000 7f8f07fff700 1 -- 172.21.15.26:0/1577164075 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f14009790 con 0x7f8f20100d90 2023-12-01T01:06:58.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.662+0000 7f8f07fff700 1 -- 172.21.15.26:0/1577164075 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f8f1400eec0 con 0x7f8f20100d90 2023-12-01T01:06:58.666 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.662+0000 7f8f25302700 1 -- 172.21.15.26:0/1577164075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f201a0f40 con 0x7f8f20100d90 2023-12-01T01:06:58.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.662+0000 7f8f07fff700 1 -- 172.21.15.26:0/1577164075 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f14003d90 con 0x7f8f20100d90 2023-12-01T01:06:58.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.662+0000 7f8f25302700 1 -- 172.21.15.26:0/1577164075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f201a1360 con 0x7f8f20100d90 2023-12-01T01:06:58.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.663+0000 7f8f25302700 1 -- 172.21.15.26:0/1577164075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2010c7b0 con 0x7f8f20100d90 2023-12-01T01:06:58.667 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.664+0000 7f8f07fff700 1 -- 172.21.15.26:0/1577164075 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f8f14004000 con 0x7f8f20100d90 2023-12-01T01:06:58.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.664+0000 7f8f07fff700 1 --2- 172.21.15.26:0/1577164075 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8f080a0570 0x7f8f080a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:58.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.665+0000 7f8f07fff700 1 -- 172.21.15.26:0/1577164075 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f8f14014070 con 0x7f8f20100d90 2023-12-01T01:06:58.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.665+0000 7f8f1e7fc700 1 --2- 172.21.15.26:0/1577164075 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8f080a0570 0x7f8f080a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:58.668 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.665+0000 7f8f1e7fc700 1 --2- 172.21.15.26:0/1577164075 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8f080a0570 0x7f8f080a2a30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8f10005950 tx=0x7f8f100058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:58.669 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.668+0000 7f8f07fff700 1 -- 172.21.15.26:0/1577164075 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8f14095840 con 0x7f8f20100d90 2023-12-01T01:06:58.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:06:58.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:06:58.796 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:58 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:06:58.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.924+0000 7f8f25302700 1 -- 172.21.15.26:0/1577164075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f2010c9a0 con 0x7f8f20100d90 2023-12-01T01:06:58.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.925+0000 7f8f07fff700 1 -- 172.21.15.26:0/1577164075 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+10787 (secure 0 0 0) 0x7f8f14098e60 con 0x7f8f20100d90 2023-12-01T01:06:58.926 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:06:58.926 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6841/3515135915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6840","nonce":3515135915},{"type":"v1","addr":"172.21.15.26:6841","nonce":3515135915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-01T01:02:47.252972+0000","modified":"2023-12-01T01:06:32.422091+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24493,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":53,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6839/3364532241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":3364532241},{"type":"v1","addr":"172.21.15.93:6839","nonce":3364532241}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25385":{"gid":25385,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.93:6837/1672758793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":1672758793},{"type":"v1","addr":"172.21.15.93:6837","nonce":1672758793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T01:06:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.927+0000 7f8f25302700 1 -- 172.21.15.26:0/1577164075 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8f080a0570 msgr2=0x7f8f080a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.927+0000 7f8f25302700 1 --2- 172.21.15.26:0/1577164075 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8f080a0570 0x7f8f080a2a30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8f10005950 tx=0x7f8f100058e0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.927+0000 7f8f25302700 1 -- 172.21.15.26:0/1577164075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f20100d90 msgr2=0x7f8f20074b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.927+0000 7f8f25302700 1 --2- 172.21.15.26:0/1577164075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f20100d90 0x7f8f20074b40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400e970 tx=0x7f8f1400ec80 comp rx=0 tx=0).stop 2023-12-01T01:06:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.927+0000 7f8f25302700 1 -- 172.21.15.26:0/1577164075 shutdown_connections 2023-12-01T01:06:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.927+0000 7f8f25302700 1 --2- 172.21.15.26:0/1577164075 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f8f080a0570 0x7f8f080a2a30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.927+0000 7f8f25302700 1 --2- 172.21.15.26:0/1577164075 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f8f20102920 0x7f8f200736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.928 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.927+0000 7f8f25302700 1 --2- 172.21.15.26:0/1577164075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f20100d90 0x7f8f20074b40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.927+0000 7f8f25302700 1 --2- 172.21.15.26:0/1577164075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8f20101f80 0x7f8f20073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:58.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.927+0000 7f8f25302700 1 -- 172.21.15.26:0/1577164075 >> 172.21.15.26:0/1577164075 conn(0x7f8f200fc2e0 msgr2=0x7f8f200fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:58.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.927+0000 7f8f25302700 1 -- 172.21.15.26:0/1577164075 shutdown_connections 2023-12-01T01:06:58.929 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:58.927+0000 7f8f25302700 1 -- 172.21.15.26:0/1577164075 wait complete. 2023-12-01T01:06:58.929 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 32 2023-12-01T01:06:58.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:06:58.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:06:58.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:58 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:06:58.941 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-12-01T01:06:58.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-01T01:06:58.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-01T01:06:58.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:58 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' 2023-12-01T01:06:59.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.068+0000 7f9168093700 1 -- 172.21.15.26:0/1427665814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9160104190 msgr2=0x7f9160106580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.068+0000 7f9168093700 1 --2- 172.21.15.26:0/1427665814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9160104190 0x7f9160106580 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9154009990 tx=0x7f9154009ca0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.068+0000 7f9168093700 1 -- 172.21.15.26:0/1427665814 shutdown_connections 2023-12-01T01:06:59.071 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.068+0000 7f9168093700 1 --2- 172.21.15.26:0/1427665814 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9160106ac0 0x7f9160108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.068+0000 7f9168093700 1 --2- 172.21.15.26:0/1427665814 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9160101860 0x7f9160103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.068+0000 7f9168093700 1 --2- 172.21.15.26:0/1427665814 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9160104190 0x7f9160106580 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.068+0000 7f9168093700 1 -- 172.21.15.26:0/1427665814 >> 172.21.15.26:0/1427665814 conn(0x7f91600fb1f0 msgr2=0x7f91600fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.068+0000 7f9168093700 1 -- 172.21.15.26:0/1427665814 shutdown_connections 2023-12-01T01:06:59.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.068+0000 7f9168093700 1 -- 172.21.15.26:0/1427665814 wait complete. 2023-12-01T01:06:59.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9168093700 1 Processor -- start 2023-12-01T01:06:59.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9168093700 1 -- start start 2023-12-01T01:06:59.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9168093700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9160101860 0x7f9160196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9168093700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9160104190 0x7f9160197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9168093700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9160106ac0 0x7f916019e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9168093700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916019e6c0 con 0x7f9160106ac0 2023-12-01T01:06:59.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9168093700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916019e800 con 0x7f9160101860 2023-12-01T01:06:59.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9168093700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916019e990 con 0x7f9160104190 2023-12-01T01:06:59.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9166630700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9160106ac0 0x7f916019e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.072 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9166630700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9160106ac0 0x7f916019e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56578/0 (socket says 172.21.15.26:56578) 2023-12-01T01:06:59.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9166630700 1 -- 172.21.15.26:0/3952813984 learned_addr learned my addr 172.21.15.26:0/3952813984 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f916562e700 1 --2- 172.21.15.26:0/3952813984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9160104190 0x7f9160197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9165e2f700 1 --2- 172.21.15.26:0/3952813984 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9160101860 0x7f9160196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9166630700 1 -- 172.21.15.26:0/3952813984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9160104190 msgr2=0x7f9160197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9166630700 1 --2- 172.21.15.26:0/3952813984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9160104190 0x7f9160197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9166630700 1 -- 172.21.15.26:0/3952813984 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9160101860 msgr2=0x7f9160196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9166630700 1 --2- 172.21.15.26:0/3952813984 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9160101860 0x7f9160196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9166630700 1 -- 172.21.15.26:0/3952813984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91540095f0 con 0x7f9160106ac0 2023-12-01T01:06:59.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.069+0000 7f9166630700 1 --2- 172.21.15.26:0/3952813984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9160106ac0 0x7f916019e0f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f915800ef30 tx=0x7f915800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.070+0000 7f9152ffd700 1 -- 172.21.15.26:0/3952813984 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158018070 con 0x7f9160106ac0 2023-12-01T01:06:59.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.070+0000 7f9168093700 1 -- 172.21.15.26:0/3952813984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916019ec10 con 0x7f9160106ac0 2023-12-01T01:06:59.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.070+0000 7f9152ffd700 1 -- 172.21.15.26:0/3952813984 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f915800f040 con 0x7f9160106ac0 2023-12-01T01:06:59.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.070+0000 7f9152ffd700 1 -- 172.21.15.26:0/3952813984 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915800ce00 con 0x7f9160106ac0 2023-12-01T01:06:59.073 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.070+0000 7f9168093700 1 -- 172.21.15.26:0/3952813984 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916019f0d0 con 0x7f9160106ac0 2023-12-01T01:06:59.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.072+0000 7f9152ffd700 1 -- 172.21.15.26:0/3952813984 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f9158003a00 con 0x7f9160106ac0 2023-12-01T01:06:59.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.072+0000 7f9152ffd700 1 --2- 172.21.15.26:0/3952813984 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f914c0a0520 0x7f914c0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.073+0000 7f9152ffd700 1 -- 172.21.15.26:0/3952813984 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f91580cb5d0 con 0x7f9160106ac0 2023-12-01T01:06:59.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.073+0000 7f9165e2f700 1 --2- 172.21.15.26:0/3952813984 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f914c0a0520 0x7f914c0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.073+0000 7f9165e2f700 1 --2- 172.21.15.26:0/3952813984 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f914c0a0520 0x7f914c0a29e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f915c009bf0 tx=0x7f915c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.073+0000 7f9174223b80 1 Processor -- start 2023-12-01T01:06:59.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.073+0000 7f9174223b80 1 -- start start 2023-12-01T01:06:59.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.073+0000 7f9174223b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee6a0f0 0x56230ee6a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.073+0000 7f9174223b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee6aa70 0x56230ee68e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.079 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.073+0000 7f9174223b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee693f0 0x56230ee69870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.073+0000 7f9174223b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230edc0a10 con 0x56230ee693f0 2023-12-01T01:06:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.073+0000 7f9174223b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230edbe3d0 con 0x56230ee6a0f0 2023-12-01T01:06:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.074+0000 7f9174223b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230edb9cc0 con 0x56230ee6aa70 2023-12-01T01:06:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.074+0000 7f9166630700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee693f0 0x56230ee69870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.074+0000 7f9166630700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee693f0 0x56230ee69870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56586/0 (socket says 172.21.15.26:56586) 2023-12-01T01:06:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.074+0000 7f9166630700 1 -- 172.21.15.26:0/3222842359 learned_addr learned my addr 172.21.15.26:0/3222842359 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.074+0000 7f916562e700 1 --2- 172.21.15.26:0/3222842359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee6aa70 0x56230ee68e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.074+0000 7f9165e2f700 1 --2- 172.21.15.26:0/3222842359 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee6a0f0 0x56230ee6a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.074+0000 7f9166630700 1 -- 172.21.15.26:0/3222842359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee6aa70 msgr2=0x56230ee68e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.074+0000 7f9166630700 1 --2- 172.21.15.26:0/3222842359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee6aa70 0x56230ee68e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.074+0000 7f9166630700 1 -- 172.21.15.26:0/3222842359 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee6a0f0 msgr2=0x56230ee6a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.074+0000 7f9166630700 1 --2- 172.21.15.26:0/3222842359 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee6a0f0 0x56230ee6a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.074+0000 7f9166630700 1 -- 172.21.15.26:0/3222842359 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56230ebe7de0 con 0x56230ee693f0 2023-12-01T01:06:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.074+0000 7f9166630700 1 --2- 172.21.15.26:0/3222842359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee693f0 0x56230ee69870 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9158095370 tx=0x7f91580989b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66369d117e2b0ca6 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.080 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.074+0000 7f914bfff700 1 -- 172.21.15.26:0/3222842359 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9158098e70 con 0x56230ee693f0 2023-12-01T01:06:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.074+0000 7f914bfff700 1 -- 172.21.15.26:0/3222842359 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f915809cca0 con 0x56230ee693f0 2023-12-01T01:06:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.074+0000 7f914bfff700 1 -- 172.21.15.26:0/3222842359 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915801b520 con 0x56230ee693f0 2023-12-01T01:06:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.075+0000 7f9174223b80 1 -- 172.21.15.26:0/3222842359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee693f0 msgr2=0x56230ee69870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.075+0000 7f9174223b80 1 --2- 172.21.15.26:0/3222842359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee693f0 0x56230ee69870 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f9158095370 tx=0x7f91580989b0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.075+0000 7f9174223b80 1 -- 172.21.15.26:0/3222842359 shutdown_connections 2023-12-01T01:06:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.075+0000 7f9174223b80 1 --2- 172.21.15.26:0/3222842359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee693f0 0x56230ee69870 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.075+0000 7f9174223b80 1 --2- 172.21.15.26:0/3222842359 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee6a0f0 0x56230ee6a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.075+0000 7f9174223b80 1 --2- 172.21.15.26:0/3222842359 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee6aa70 0x56230ee68e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.075+0000 7f9174223b80 1 -- 172.21.15.26:0/3222842359 >> 172.21.15.26:0/3222842359 conn(0x56230edc80d0 msgr2=0x56230ee63940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.075+0000 7f9174223b80 1 -- 172.21.15.26:0/3222842359 shutdown_connections 2023-12-01T01:06:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.075+0000 7f9174223b80 1 -- 172.21.15.26:0/3222842359 wait complete. 2023-12-01T01:06:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.075+0000 7f9174223b80 1 -- start start 2023-12-01T01:06:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.075+0000 7f9174223b80 1 Processor -- start 2023-12-01T01:06:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9174223b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee693f0 0x56230ee72a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.081 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9174223b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee6a0f0 0x56230ee72f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9174223b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee6aa70 0x56230ee79f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9174223b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230ed56510 con 0x56230ee693f0 2023-12-01T01:06:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9174223b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230ed561b0 con 0x56230ee6a0f0 2023-12-01T01:06:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9174223b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230ec3d920 con 0x56230ee6aa70 2023-12-01T01:06:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9174223b80 10 client.0 _ll_register_callbacks cb 0x56230eca3a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9165e2f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee693f0 0x56230ee72a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9165e2f700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee693f0 0x56230ee72a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56588/0 (socket says 172.21.15.26:56588) 2023-12-01T01:06:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9165e2f700 1 -- 172.21.15.26:0/1694751103 learned_addr learned my addr 172.21.15.26:0/1694751103 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f916562e700 1 --2- 172.21.15.26:0/1694751103 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee6a0f0 0x56230ee72f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9166630700 1 --2- 172.21.15.26:0/1694751103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee6aa70 0x56230ee79f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9165e2f700 1 -- 172.21.15.26:0/1694751103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee6aa70 msgr2=0x56230ee79f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9165e2f700 1 --2- 172.21.15.26:0/1694751103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee6aa70 0x56230ee79f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9165e2f700 1 -- 172.21.15.26:0/1694751103 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee6a0f0 msgr2=0x56230ee72f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.082 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9165e2f700 1 --2- 172.21.15.26:0/1694751103 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee6a0f0 0x56230ee72f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9165e2f700 1 -- 172.21.15.26:0/1694751103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916019f0d0 con 0x56230ee693f0 2023-12-01T01:06:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f9165e2f700 1 --2- 172.21.15.26:0/1694751103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee693f0 0x56230ee72a00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f915c0127b0 tx=0x7f915c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07ff2cbfe3d5534 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.076+0000 7f91497fa700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:06:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.077+0000 7f91497fa700 1 -- 172.21.15.26:0/1694751103 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c01f6c0 con 0x56230ee693f0 2023-12-01T01:06:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.077+0000 7f91497fa700 1 -- 172.21.15.26:0/1694751103 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f915c018070 con 0x56230ee693f0 2023-12-01T01:06:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.077+0000 7f9174223b80 1 -- 172.21.15.26:0/1694751103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56230ede4d10 con 0x56230ee693f0 2023-12-01T01:06:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.077+0000 7f91497fa700 1 -- 172.21.15.26:0/1694751103 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f915c01f820 con 0x56230ee693f0 2023-12-01T01:06:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.077+0000 7f9174223b80 10 client.15981 fetch_fsmap learned FSMap version 32 2023-12-01T01:06:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.077+0000 7f9174223b80 1 -- 172.21.15.26:0/1694751103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56230ebd0c60 con 0x56230ee693f0 2023-12-01T01:06:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.077+0000 7f91497fa700 1 -- 172.21.15.26:0/1694751103 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x56230ede4d10 con 0x56230ee693f0 2023-12-01T01:06:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.077+0000 7f91497fa700 1 -- 172.21.15.26:0/1694751103 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 32) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f915c029c60 con 0x56230ee693f0 2023-12-01T01:06:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.077+0000 7f9174223b80 10 client.15981 fetch_fsmap finished waiting for FSMap version 32 2023-12-01T01:06:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.077+0000 7f9174223b80 10 client.15981 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-12-01T01:06:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.077+0000 7f9174223b80 20 client.15981 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:59.083 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.077+0000 7f9174223b80 1 --2- 172.21.15.26:0/1694751103 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x56230ee7e7e0 0x56230ee80c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.077+0000 7f9174223b80 4 client.15981 mds_command: new command op to 24481 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:06:59.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.077+0000 7f9174223b80 1 -- 172.21.15.26:0/1694751103 --> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56230ee37e10 con 0x56230ee7e7e0 2023-12-01T01:06:59.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.078+0000 7f916562e700 1 --2- 172.21.15.26:0/1694751103 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x56230ee7e7e0 0x56230ee80c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.078+0000 7f91497fa700 10 client.15981 ms_handle_connect on v2:172.21.15.116:6838/261568108 2023-12-01T01:06:59.084 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.078+0000 7f916562e700 1 --2- 172.21.15.26:0/1694751103 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x56230ee7e7e0 0x56230ee80c00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=184349abf226aa42 server_cookie=239922d5a717fa07 in_seq=0 out_seq=0 2023-12-01T01:06:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.079+0000 7f91497fa700 1 -- 172.21.15.26:0/1694751103 <== mds.2 v2:172.21.15.116:6838/261568108 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x56230ee37e10 con 0x56230ee7e7e0 2023-12-01T01:06:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.079+0000 7f91497fa700 10 client.15981 handle_command_reply: tid=0 2023-12-01T01:06:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.079+0000 7f9174223b80 1 client.15981 shutdown 2023-12-01T01:06:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.079+0000 7f9174223b80 1 -- 172.21.15.26:0/1694751103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee693f0 msgr2=0x56230ee72a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.079+0000 7f9174223b80 1 --2- 172.21.15.26:0/1694751103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee693f0 0x56230ee72a00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f915c0127b0 tx=0x7f915c0047c0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.079+0000 7f9174223b80 1 -- 172.21.15.26:0/1694751103 shutdown_connections 2023-12-01T01:06:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.079+0000 7f9174223b80 1 --2- 172.21.15.26:0/1694751103 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee6aa70 0x56230ee79f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.079+0000 7f9174223b80 1 --2- 172.21.15.26:0/1694751103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee693f0 0x56230ee72a00 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.079+0000 7f9174223b80 1 --2- 172.21.15.26:0/1694751103 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x56230ee7e7e0 0x56230ee80c00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.085 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.079+0000 7f9174223b80 1 --2- 172.21.15.26:0/1694751103 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee6a0f0 0x56230ee72f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.079+0000 7f91497fa700 0 client.15981 ms_handle_reset on v2:172.21.15.116:6838/261568108 2023-12-01T01:06:59.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.079+0000 7f9174223b80 1 -- 172.21.15.26:0/1694751103 >> 172.21.15.26:0/1694751103 conn(0x56230edc80d0 msgr2=0x56230ee630b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.079+0000 7f9174223b80 1 -- 172.21.15.26:0/1694751103 shutdown_connections 2023-12-01T01:06:59.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.079+0000 7f9174223b80 1 -- 172.21.15.26:0/1694751103 wait complete. 2023-12-01T01:06:59.086 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.079+0000 7f9174223b80 20 client.15981 trim_cache size 0 max 16384 2023-12-01T01:06:59.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9174223b80 1 Processor -- start 2023-12-01T01:06:59.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9174223b80 1 -- start start 2023-12-01T01:06:59.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9174223b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee693f0 0x56230ee68e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9174223b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee6a0f0 0x56230ee77f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9174223b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee6aa70 0x56230ee727b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9174223b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230ee7bc10 con 0x56230ee6aa70 2023-12-01T01:06:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9174223b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230ee64610 con 0x56230ee6a0f0 2023-12-01T01:06:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9174223b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230ee64840 con 0x56230ee693f0 2023-12-01T01:06:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9166630700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee6aa70 0x56230ee727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9166630700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee6aa70 0x56230ee727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56600/0 (socket says 172.21.15.26:56600) 2023-12-01T01:06:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9166630700 1 -- 172.21.15.26:0/2004602310 learned_addr learned my addr 172.21.15.26:0/2004602310 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9165e2f700 1 --2- 172.21.15.26:0/2004602310 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee693f0 0x56230ee68e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9166630700 1 -- 172.21.15.26:0/2004602310 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee693f0 msgr2=0x56230ee68e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9166630700 1 --2- 172.21.15.26:0/2004602310 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee693f0 0x56230ee68e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f916562e700 1 --2- 172.21.15.26:0/2004602310 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee6a0f0 0x56230ee77f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9166630700 1 -- 172.21.15.26:0/2004602310 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee6a0f0 msgr2=0x56230ee77f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9166630700 1 --2- 172.21.15.26:0/2004602310 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee6a0f0 0x56230ee77f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.092+0000 7f9166630700 1 -- 172.21.15.26:0/2004602310 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56230ec0e250 con 0x56230ee6aa70 2023-12-01T01:06:59.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.093+0000 7f9166630700 1 --2- 172.21.15.26:0/2004602310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee6aa70 0x56230ee727b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f91580090a0 tx=0x7f9158094ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55fd250ee524c223 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.093+0000 7f9150ff9700 1 -- 172.21.15.26:0/2004602310 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91580a0e50 con 0x56230ee6aa70 2023-12-01T01:06:59.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.093+0000 7f9150ff9700 1 -- 172.21.15.26:0/2004602310 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f9158096fb0 con 0x56230ee6aa70 2023-12-01T01:06:59.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.093+0000 7f9150ff9700 1 -- 172.21.15.26:0/2004602310 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91580b1380 con 0x56230ee6aa70 2023-12-01T01:06:59.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.093+0000 7f9174223b80 1 -- 172.21.15.26:0/2004602310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee6aa70 msgr2=0x56230ee727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.093+0000 7f9174223b80 1 --2- 172.21.15.26:0/2004602310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee6aa70 0x56230ee727b0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f91580090a0 tx=0x7f9158094ba0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.093+0000 7f9174223b80 1 -- 172.21.15.26:0/2004602310 shutdown_connections 2023-12-01T01:06:59.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.093+0000 7f9174223b80 1 --2- 172.21.15.26:0/2004602310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee6aa70 0x56230ee727b0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.093+0000 7f9174223b80 1 --2- 172.21.15.26:0/2004602310 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee693f0 0x56230ee68e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.093+0000 7f9174223b80 1 --2- 172.21.15.26:0/2004602310 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee6a0f0 0x56230ee77f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.093+0000 7f9174223b80 1 -- 172.21.15.26:0/2004602310 >> 172.21.15.26:0/2004602310 conn(0x56230edc80d0 msgr2=0x56230ee6d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.093+0000 7f9174223b80 1 -- 172.21.15.26:0/2004602310 shutdown_connections 2023-12-01T01:06:59.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.093+0000 7f9174223b80 1 -- 172.21.15.26:0/2004602310 wait complete. 2023-12-01T01:06:59.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.094+0000 7f9174223b80 1 -- start start 2023-12-01T01:06:59.100 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.094+0000 7f9174223b80 1 Processor -- start 2023-12-01T01:06:59.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.094+0000 7f9174223b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee693f0 0x56230ee75db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.094+0000 7f9174223b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee6a0f0 0x56230ee762f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.094+0000 7f9174223b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee6aa70 0x56230ee77300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.094+0000 7f9174223b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230ee77840 con 0x56230ee6aa70 2023-12-01T01:06:59.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.094+0000 7f9174223b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230ee779b0 con 0x56230ee693f0 2023-12-01T01:06:59.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.094+0000 7f9174223b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x56230ee77b70 con 0x56230ee6a0f0 2023-12-01T01:06:59.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.094+0000 7f9174223b80 10 client.0 _ll_register_callbacks cb 0x7f915c011f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:59.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.094+0000 7f9166630700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee6aa70 0x56230ee77300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.094+0000 7f9166630700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee6aa70 0x56230ee77300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56606/0 (socket says 172.21.15.26:56606) 2023-12-01T01:06:59.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.094+0000 7f9166630700 1 -- 172.21.15.26:0/2166380078 learned_addr learned my addr 172.21.15.26:0/2166380078 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.094+0000 7f916562e700 1 --2- 172.21.15.26:0/2166380078 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee6a0f0 0x56230ee762f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.094+0000 7f9165e2f700 1 --2- 172.21.15.26:0/2166380078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee693f0 0x56230ee75db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.094+0000 7f9166630700 1 -- 172.21.15.26:0/2166380078 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee6a0f0 msgr2=0x56230ee762f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f9166630700 1 --2- 172.21.15.26:0/2166380078 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee6a0f0 0x56230ee762f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f9166630700 1 -- 172.21.15.26:0/2166380078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee693f0 msgr2=0x56230ee75db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f9166630700 1 --2- 172.21.15.26:0/2166380078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee693f0 0x56230ee75db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f9166630700 1 -- 172.21.15.26:0/2166380078 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56230ebe7de0 con 0x56230ee6aa70 2023-12-01T01:06:59.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f9165e2f700 1 --2- 172.21.15.26:0/2166380078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee693f0 0x56230ee75db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:06:59.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f916562e700 1 --2- 172.21.15.26:0/2166380078 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee6a0f0 0x56230ee762f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:06:59.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f9166630700 1 --2- 172.21.15.26:0/2166380078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee6aa70 0x56230ee77300 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9158098e00 tx=0x7f915801b320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8f6a3484d0f2fe server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f91497fa700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:06:59.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f91497fa700 1 -- 172.21.15.26:0/2166380078 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91580992d0 con 0x56230ee6aa70 2023-12-01T01:06:59.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f91497fa700 1 -- 172.21.15.26:0/2166380078 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f9158098360 con 0x56230ee6aa70 2023-12-01T01:06:59.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f9174223b80 1 -- 172.21.15.26:0/2166380078 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f915809cca0 con 0x56230ee6aa70 2023-12-01T01:06:59.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f91497fa700 1 -- 172.21.15.26:0/2166380078 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9158098520 con 0x56230ee6aa70 2023-12-01T01:06:59.102 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f9174223b80 10 client.15987 fetch_fsmap learned FSMap version 32 2023-12-01T01:06:59.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f9174223b80 1 -- 172.21.15.26:0/2166380078 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x56230ebe62b0 con 0x56230ee6aa70 2023-12-01T01:06:59.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f91497fa700 1 -- 172.21.15.26:0/2166380078 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f915809cca0 con 0x56230ee6aa70 2023-12-01T01:06:59.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f91497fa700 1 -- 172.21.15.26:0/2166380078 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 32) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f9158097dd0 con 0x56230ee6aa70 2023-12-01T01:06:59.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f9174223b80 10 client.15987 fetch_fsmap finished waiting for FSMap version 32 2023-12-01T01:06:59.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f9174223b80 10 client.15987 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2023-12-01T01:06:59.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f9174223b80 20 client.15987 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:59.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f9174223b80 1 --2- 172.21.15.26:0/2166380078 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x56230eed0e80 0x56230eed32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f9174223b80 4 client.15987 mds_command: new command op to 24481 tid=0[{"prefix": "damage ls"}] 2023-12-01T01:06:59.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.095+0000 7f9174223b80 1 -- 172.21.15.26:0/2166380078 --> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56230edb2d40 con 0x56230eed0e80 2023-12-01T01:06:59.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.096+0000 7f9165e2f700 1 --2- 172.21.15.26:0/2166380078 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x56230eed0e80 0x56230eed32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.096+0000 7f9165e2f700 1 --2- 172.21.15.26:0/2166380078 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x56230eed0e80 0x56230eed32a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6f6484a122ee740b server_cookie=27214f515b3b1fb in_seq=0 out_seq=0 2023-12-01T01:06:59.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.096+0000 7f91497fa700 10 client.15987 ms_handle_connect on v2:172.21.15.116:6838/261568108 2023-12-01T01:06:59.103 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.097+0000 7f91497fa700 1 -- 172.21.15.26:0/2166380078 <== mds.2 v2:172.21.15.116:6838/261568108 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+21880 (crc 0 0 0) 0x56230edb2d40 con 0x56230eed0e80 2023-12-01T01:06:59.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.097+0000 7f91497fa700 10 client.15987 handle_command_reply: tid=0 2023-12-01T01:06:59.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.097+0000 7f9174223b80 1 client.15987 shutdown 2023-12-01T01:06:59.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.097+0000 7f9174223b80 1 -- 172.21.15.26:0/2166380078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee6aa70 msgr2=0x56230ee77300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.097+0000 7f9174223b80 1 --2- 172.21.15.26:0/2166380078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee6aa70 0x56230ee77300 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f9158098e00 tx=0x7f915801b320 comp rx=0 tx=0).stop 2023-12-01T01:06:59.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.097+0000 7f9174223b80 1 -- 172.21.15.26:0/2166380078 shutdown_connections 2023-12-01T01:06:59.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.097+0000 7f9174223b80 1 --2- 172.21.15.26:0/2166380078 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56230ee6aa70 0x56230ee77300 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.097+0000 7f9174223b80 1 --2- 172.21.15.26:0/2166380078 >> [v2:172.21.15.116:6838/261568108,v1:172.21.15.116:6839/261568108] conn(0x56230eed0e80 0x56230eed32a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.097+0000 7f9174223b80 1 --2- 172.21.15.26:0/2166380078 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x56230ee693f0 0x56230ee75db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.097+0000 7f9174223b80 1 --2- 172.21.15.26:0/2166380078 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x56230ee6a0f0 0x56230ee762f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.097+0000 7f91497fa700 0 client.15987 ms_handle_reset on v2:172.21.15.116:6838/261568108 2023-12-01T01:06:59.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.097+0000 7f9174223b80 1 -- 172.21.15.26:0/2166380078 >> 172.21.15.26:0/2166380078 conn(0x56230edc80d0 msgr2=0x56230ee727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.097+0000 7f9174223b80 1 -- 172.21.15.26:0/2166380078 shutdown_connections 2023-12-01T01:06:59.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.097+0000 7f9174223b80 1 -- 172.21.15.26:0/2166380078 wait complete. 2023-12-01T01:06:59.104 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.097+0000 7f9174223b80 20 client.15987 trim_cache size 0 max 16384 2023-12-01T01:06:59.105 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2023-12-01T01:06:59.105 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.105 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.105 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 58446341, 2023-12-01T01:06:59.105 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631343, 2023-12-01T01:06:59.105 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/notifier.txt" 2023-12-01T01:06:59.105 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.105 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.106 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.106 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 94261605, 2023-12-01T01:06:59.106 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631331, 2023-12-01T01:06:59.106 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/ff.txt" 2023-12-01T01:06:59.106 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.106 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.106 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.106 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 129425733, 2023-12-01T01:06:59.106 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631888, 2023-12-01T01:06:59.106 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/README.cycladesZ" 2023-12-01T01:06:59.106 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.106 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.106 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.106 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 152669321, 2023-12-01T01:06:59.107 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631347, 2023-12-01T01:06:59.107 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/shape.fig" 2023-12-01T01:06:59.107 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.107 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.107 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.107 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 218633739, 2023-12-01T01:06:59.107 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631316, 2023-12-01T01:06:59.107 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/user_verbs.txt" 2023-12-01T01:06:59.107 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.107 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.107 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.107 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 386339953, 2023-12-01T01:06:59.107 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632264, 2023-12-01T01:06:59.107 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/tlb.txt" 2023-12-01T01:06:59.108 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.109 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.109 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.110 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 580970615, 2023-12-01T01:06:59.110 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632010, 2023-12-01T01:06:59.110 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/highres.txt" 2023-12-01T01:06:59.110 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.110 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.110 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.110 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 588528755, 2023-12-01T01:06:59.110 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631338, 2023-12-01T01:06:59.110 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/interactive.fig" 2023-12-01T01:06:59.110 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.110 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.110 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.110 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 610830469, 2023-12-01T01:06:59.110 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631332, 2023-12-01T01:06:59.111 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gamepad.txt" 2023-12-01T01:06:59.111 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.111 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.111 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.111 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 676556634, 2023-12-01T01:06:59.111 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631098, 2023-12-01T01:06:59.111 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/consumer.txt" 2023-12-01T01:06:59.111 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.111 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.111 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.111 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 731962053, 2023-12-01T01:06:59.111 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632253, 2023-12-01T01:06:59.111 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/00-INDEX" 2023-12-01T01:06:59.111 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.112 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.112 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.112 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 750673011, 2023-12-01T01:06:59.112 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632006, 2023-12-01T01:06:59.112 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/.gitignore" 2023-12-01T01:06:59.112 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.112 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.112 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.112 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 754320475, 2023-12-01T01:06:59.112 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632261, 2023-12-01T01:06:59.112 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/intel_mpx.txt" 2023-12-01T01:06:59.112 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.112 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.112 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.113 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 759526491, 2023-12-01T01:06:59.113 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632273, 2023-12-01T01:06:59.113 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/mm.txt" 2023-12-01T01:06:59.113 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.113 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.113 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.113 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 771621714, 2023-12-01T01:06:59.113 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631324, 2023-12-01T01:06:59.113 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/bcm5974.txt" 2023-12-01T01:06:59.113 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.113 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.113 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.113 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 772856660, 2023-12-01T01:06:59.113 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632013, 2023-12-01T01:06:59.113 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hrtimers.txt" 2023-12-01T01:06:59.114 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.114 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.114 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.114 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 789663195, 2023-12-01T01:06:59.114 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632255, 2023-12-01T01:06:59.114 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/early-microcode.txt" 2023-12-01T01:06:59.114 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.114 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.114 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.114 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 906036515, 2023-12-01T01:06:59.114 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631676, 2023-12-01T01:06:59.114 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nios2/README" 2023-12-01T01:06:59.114 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.114 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.115 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.115 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 997844613, 2023-12-01T01:06:59.115 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631097, 2023-12-01T01:06:59.115 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/board.txt" 2023-12-01T01:06:59.115 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.115 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.115 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.115 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1005112340, 2023-12-01T01:06:59.115 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632270, 2023-12-01T01:06:59.115 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets" 2023-12-01T01:06:59.115 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.115 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.115 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.115 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1006618001, 2023-12-01T01:06:59.115 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631349, 2023-12-01T01:06:59.116 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/xpad.txt" 2023-12-01T01:06:59.116 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.116 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.116 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.116 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1048344162, 2023-12-01T01:06:59.116 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631350, 2023-12-01T01:06:59.116 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/yealink.txt" 2023-12-01T01:06:59.116 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.116 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.116 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.116 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1054207550, 2023-12-01T01:06:59.116 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631898, 2023-12-01T01:06:59.116 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh/register-banks.txt" 2023-12-01T01:06:59.116 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.116 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.117 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.117 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1111972834, 2023-12-01T01:06:59.117 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632254, 2023-12-01T01:06:59.117 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/boot.txt" 2023-12-01T01:06:59.117 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.117 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.117 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.117 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1230654353, 2023-12-01T01:06:59.117 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631314, 2023-12-01T01:06:59.117 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/sysfs.txt" 2023-12-01T01:06:59.117 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.117 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.117 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.117 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1245848670, 2023-12-01T01:06:59.117 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631344, 2023-12-01T01:06:59.118 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/ntrig.txt" 2023-12-01T01:06:59.118 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.118 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.118 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.118 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1325531038, 2023-12-01T01:06:59.118 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632009, 2023-12-01T01:06:59.118 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/NO_HZ.txt" 2023-12-01T01:06:59.118 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.118 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.118 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.118 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1376117736, 2023-12-01T01:06:59.118 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632012, 2023-12-01T01:06:59.118 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hpet_example.c" 2023-12-01T01:06:59.118 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.119 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.119 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.119 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1392347934, 2023-12-01T01:06:59.119 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631339, 2023-12-01T01:06:59.119 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick-api.txt" 2023-12-01T01:06:59.119 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.119 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.119 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.119 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1402397272, 2023-12-01T01:06:59.119 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632007, 2023-12-01T01:06:59.119 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/00-INDEX" 2023-12-01T01:06:59.119 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.119 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.119 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.119 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1407842612, 2023-12-01T01:06:59.120 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632257, 2023-12-01T01:06:59.120 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/entry_64.txt" 2023-12-01T01:06:59.120 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.120 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.120 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.120 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1411182439, 2023-12-01T01:06:59.120 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631325, 2023-12-01T01:06:59.120 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cd32.txt" 2023-12-01T01:06:59.120 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.120 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.120 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.120 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1419761617, 2023-12-01T01:06:59.120 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631321, 2023-12-01T01:06:59.120 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/amijoy.txt" 2023-12-01T01:06:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1451620687, 2023-12-01T01:06:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631345, 2023-12-01T01:06:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/rotary-encoder.txt" 2023-12-01T01:06:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1493800365, 2023-12-01T01:06:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631329, 2023-12-01T01:06:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/elantech.txt" 2023-12-01T01:06:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.121 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1633098313, 2023-12-01T01:06:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631326, 2023-12-01T01:06:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cma3000_d0x.txt" 2023-12-01T01:06:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1712697548, 2023-12-01T01:06:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632265, 2023-12-01T01:06:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/usb-legacy-support.txt" 2023-12-01T01:06:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1767141053, 2023-12-01T01:06:59.122 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631323, 2023-12-01T01:06:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/atarikbd.txt" 2023-12-01T01:06:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1782323512, 2023-12-01T01:06:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632260, 2023-12-01T01:06:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386/IO-APIC.txt" 2023-12-01T01:06:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1825797750, 2023-12-01T01:06:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631099, 2023-12-01T01:06:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/driver.txt" 2023-12-01T01:06:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.123 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1925079346, 2023-12-01T01:06:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631100, 2023-12-01T01:06:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/gpio-legacy.txt" 2023-12-01T01:06:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 1947119413, 2023-12-01T01:06:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631312, 2023-12-01T01:06:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/core_locking.txt" 2023-12-01T01:06:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2030590783, 2023-12-01T01:06:59.124 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632258, 2023-12-01T01:06:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/exception-tables.txt" 2023-12-01T01:06:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2049349982, 2023-12-01T01:06:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631893, 2023-12-01T01:06:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/serial-rs485.txt" 2023-12-01T01:06:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2115642970, 2023-12-01T01:06:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631897, 2023-12-01T01:06:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh/new-machine.txt" 2023-12-01T01:06:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.125 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2191491150, 2023-12-01T01:06:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632263, 2023-12-01T01:06:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/pat.txt" 2023-12-01T01:06:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2217911882, 2023-12-01T01:06:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632272, 2023-12-01T01:06:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/machinecheck" 2023-12-01T01:06:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.126 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2263465409, 2023-12-01T01:06:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631334, 2023-12-01T01:06:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gpio-tilt.txt" 2023-12-01T01:06:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2325556636, 2023-12-01T01:06:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631342, 2023-12-01T01:06:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/multi-touch-protocol.txt" 2023-12-01T01:06:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2419800994, 2023-12-01T01:06:59.127 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631320, 2023-12-01T01:06:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/alps.txt" 2023-12-01T01:06:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2513715216, 2023-12-01T01:06:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632256, 2023-12-01T01:06:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/earlyprintk.txt" 2023-12-01T01:06:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2579173790, 2023-12-01T01:06:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631892, 2023-12-01T01:06:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/rocket.txt" 2023-12-01T01:06:59.128 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2612133298, 2023-12-01T01:06:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631327, 2023-12-01T01:06:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cs461x.txt" 2023-12-01T01:06:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2773321592, 2023-12-01T01:06:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631333, 2023-12-01T01:06:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gameport-programming.txt" 2023-12-01T01:06:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.129 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2789981648, 2023-12-01T01:06:59.130 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631887, 2023-12-01T01:06:59.130 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/00-INDEX" 2023-12-01T01:06:59.130 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.130 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.130 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.130 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2801329735, 2023-12-01T01:06:59.130 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631102, 2023-12-01T01:06:59.130 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/sysfs.txt" 2023-12-01T01:06:59.130 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.130 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.130 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.130 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2814930084, 2023-12-01T01:06:59.130 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631889, 2023-12-01T01:06:59.130 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/driver" 2023-12-01T01:06:59.131 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.131 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.131 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.131 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2839714955, 2023-12-01T01:06:59.131 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632014, 2023-12-01T01:06:59.131 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timekeeping.txt" 2023-12-01T01:06:59.131 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.131 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.131 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.131 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2849491351, 2023-12-01T01:06:59.131 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631313, 2023-12-01T01:06:59.131 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/ipoib.txt" 2023-12-01T01:06:59.131 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.131 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.131 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.132 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2929549835, 2023-12-01T01:06:59.132 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631348, 2023-12-01T01:06:59.132 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/walkera0701.txt" 2023-12-01T01:06:59.132 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.132 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.132 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.132 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 2962986668, 2023-12-01T01:06:59.132 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631335, 2023-12-01T01:06:59.132 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/iforce-protocol.txt" 2023-12-01T01:06:59.132 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.132 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.132 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.132 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3008294810, 2023-12-01T01:06:59.132 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632011, 2023-12-01T01:06:59.133 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hpet.txt" 2023-12-01T01:06:59.133 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.133 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.133 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.133 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3084068900, 2023-12-01T01:06:59.133 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631346, 2023-12-01T01:06:59.133 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/sentelic.txt" 2023-12-01T01:06:59.133 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.133 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.133 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.133 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3220511958, 2023-12-01T01:06:59.133 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631096, 2023-12-01T01:06:59.133 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/00-INDEX" 2023-12-01T01:06:59.133 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.133 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.134 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.134 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3226302381, 2023-12-01T01:06:59.134 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632275, 2023-12-01T01:06:59.134 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/zero-page.txt" 2023-12-01T01:06:59.134 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.134 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.134 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.134 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3276129160, 2023-12-01T01:06:59.134 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632016, 2023-12-01T01:06:59.134 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timers-howto.txt" 2023-12-01T01:06:59.134 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.134 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.134 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.134 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3316666558, 2023-12-01T01:06:59.135 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631894, 2023-12-01T01:06:59.135 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/tty.txt" 2023-12-01T01:06:59.135 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.135 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.135 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.135 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3332334209, 2023-12-01T01:06:59.135 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631336, 2023-12-01T01:06:59.135 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/input-programming.txt" 2023-12-01T01:06:59.135 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.135 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.135 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.135 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3393213677, 2023-12-01T01:06:59.135 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632268, 2023-12-01T01:06:59.135 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/boot-options.txt" 2023-12-01T01:06:59.135 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.136 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.136 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.136 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3409965248, 2023-12-01T01:06:59.136 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632266, 2023-12-01T01:06:59.136 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64" 2023-12-01T01:06:59.136 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.136 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.136 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.136 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3416350924, 2023-12-01T01:06:59.136 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631315, 2023-12-01T01:06:59.136 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/user_mad.txt" 2023-12-01T01:06:59.136 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.136 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.136 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.137 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3472716653, 2023-12-01T01:06:59.137 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631322, 2023-12-01T01:06:59.137 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/appletouch.txt" 2023-12-01T01:06:59.137 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.137 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.137 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.137 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3500524853, 2023-12-01T01:06:59.137 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632274, 2023-12-01T01:06:59.137 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/uefi.txt" 2023-12-01T01:06:59.137 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.137 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.137 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.137 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3590694870, 2023-12-01T01:06:59.137 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632015, 2023-12-01T01:06:59.137 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timer_stats.txt" 2023-12-01T01:06:59.138 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.138 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.138 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.138 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3735876049, 2023-12-01T01:06:59.138 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632008, 2023-12-01T01:06:59.138 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/Makefile" 2023-12-01T01:06:59.138 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.138 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.138 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.138 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3786673785, 2023-12-01T01:06:59.138 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631330, 2023-12-01T01:06:59.138 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/event-codes.txt" 2023-12-01T01:06:59.138 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.138 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.139 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.139 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3794341028, 2023-12-01T01:06:59.139 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632271, 2023-12-01T01:06:59.139 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/kernel-stacks" 2023-12-01T01:06:59.139 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.139 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.139 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.139 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3852195355, 2023-12-01T01:06:59.139 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632269, 2023-12-01T01:06:59.139 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec" 2023-12-01T01:06:59.139 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.139 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.139 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.139 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3917174253, 2023-12-01T01:06:59.139 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631341, 2023-12-01T01:06:59.140 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick.txt" 2023-12-01T01:06:59.140 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.140 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.140 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.140 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 3943859548, 2023-12-01T01:06:59.140 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631891, 2023-12-01T01:06:59.140 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/n_gsm.txt" 2023-12-01T01:06:59.140 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.140 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.140 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.140 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4014504487, 2023-12-01T01:06:59.140 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632262, 2023-12-01T01:06:59.140 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/mtrr.txt" 2023-12-01T01:06:59.140 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.140 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.141 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.141 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4014689811, 2023-12-01T01:06:59.141 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631328, 2023-12-01T01:06:59.141 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/edt-ft5x06.txt" 2023-12-01T01:06:59.141 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.141 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.141 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.141 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4128071133, 2023-12-01T01:06:59.141 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631337, 2023-12-01T01:06:59.141 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/input.txt" 2023-12-01T01:06:59.141 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.141 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.141 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.141 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4196721339, 2023-12-01T01:06:59.141 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631340, 2023-12-01T01:06:59.142 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick-parport.txt" 2023-12-01T01:06:59.142 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.142 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.142 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.142 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4217959207, 2023-12-01T01:06:59.142 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632259, 2023-12-01T01:06:59.142 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386" 2023-12-01T01:06:59.142 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.142 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.142 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.142 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4234958974, 2023-12-01T01:06:59.142 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511632267, 2023-12-01T01:06:59.142 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/00-INDEX" 2023-12-01T01:06:59.142 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:06:59.143 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:06:59.143 INFO:teuthology.orchestra.run.smithi026.stdout: "damage_type": "backtrace", 2023-12-01T01:06:59.143 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4237821154, 2023-12-01T01:06:59.143 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 1099511631890, 2023-12-01T01:06:59.143 INFO:teuthology.orchestra.run.smithi026.stdout: "path": "/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/moxa-smartio" 2023-12-01T01:06:59.143 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:06:59.143 INFO:teuthology.orchestra.run.smithi026.stdout:] 2023-12-01T01:06:59.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.098+0000 7f9168093700 1 -- 172.21.15.26:0/3952813984 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f914c0a0520 msgr2=0x7f914c0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.098+0000 7f9168093700 1 --2- 172.21.15.26:0/3952813984 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f914c0a0520 0x7f914c0a29e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f915c009bf0 tx=0x7f915c009260 comp rx=0 tx=0).stop 2023-12-01T01:06:59.144 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.098+0000 7f9168093700 1 -- 172.21.15.26:0/3952813984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9160106ac0 msgr2=0x7f916019e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.098+0000 7f9168093700 1 --2- 172.21.15.26:0/3952813984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9160106ac0 0x7f916019e0f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f915800ef30 tx=0x7f915800c3a0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.098+0000 7f9168093700 1 -- 172.21.15.26:0/3952813984 shutdown_connections 2023-12-01T01:06:59.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.098+0000 7f9168093700 1 --2- 172.21.15.26:0/3952813984 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f914c0a0520 0x7f914c0a29e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.098+0000 7f9168093700 1 --2- 172.21.15.26:0/3952813984 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9160106ac0 0x7f916019e0f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.098+0000 7f9168093700 1 --2- 172.21.15.26:0/3952813984 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9160101860 0x7f9160196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.098+0000 7f9168093700 1 --2- 172.21.15.26:0/3952813984 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f9160104190 0x7f9160197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.098+0000 7f9168093700 1 -- 172.21.15.26:0/3952813984 >> 172.21.15.26:0/3952813984 conn(0x7f91600fb1f0 msgr2=0x7f91601024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.098+0000 7f9168093700 1 -- 172.21.15.26:0/3952813984 shutdown_connections 2023-12-01T01:06:59.145 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.098+0000 7f9168093700 1 -- 172.21.15.26:0/3952813984 wait complete. 2023-12-01T01:06:59.146 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-12-01T01:06:59.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.272+0000 7fbfbcada700 1 -- 172.21.15.26:0/439158300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb8100e70 msgr2=0x7fbfb81012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.272+0000 7fbfbcada700 1 --2- 172.21.15.26:0/439158300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb8100e70 0x7fbfb81012d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fbfac0099c0 tx=0x7fbfac009cd0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.272+0000 7fbfbcada700 1 -- 172.21.15.26:0/439158300 shutdown_connections 2023-12-01T01:06:59.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.272+0000 7fbfbcada700 1 --2- 172.21.15.26:0/439158300 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfb8101810 0x7fbfb81080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.272+0000 7fbfbcada700 1 --2- 172.21.15.26:0/439158300 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbfb80ffc80 0x7fbfb81000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.272+0000 7fbfbcada700 1 --2- 172.21.15.26:0/439158300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb8100e70 0x7fbfb81012d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.272+0000 7fbfbcada700 1 -- 172.21.15.26:0/439158300 >> 172.21.15.26:0/439158300 conn(0x7fbfb80fb1f0 msgr2=0x7fbfb80fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.272+0000 7fbfbcada700 1 -- 172.21.15.26:0/439158300 shutdown_connections 2023-12-01T01:06:59.274 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.272+0000 7fbfbcada700 1 -- 172.21.15.26:0/439158300 wait complete. 2023-12-01T01:06:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.273+0000 7fbfbcada700 1 Processor -- start 2023-12-01T01:06:59.276 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.273+0000 7fbfbcada700 1 -- start start 2023-12-01T01:06:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.273+0000 7fbfbcada700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbfb80ffc80 0x7fbfb8196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.273+0000 7fbfbcada700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfb8100e70 0x7fbfb8197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.273+0000 7fbfbcada700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb8101810 0x7fbfb819e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.273+0000 7fbfbcada700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb819e780 con 0x7fbfb8101810 2023-12-01T01:06:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.273+0000 7fbfbcada700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb819e8f0 con 0x7fbfb80ffc80 2023-12-01T01:06:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.273+0000 7fbfbcada700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb819eab0 con 0x7fbfb8100e70 2023-12-01T01:06:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.274+0000 7fbfb6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb8101810 0x7fbfb819e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.274+0000 7fbfb6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb8101810 0x7fbfb819e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56620/0 (socket says 172.21.15.26:56620) 2023-12-01T01:06:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.274+0000 7fbfb6d9d700 1 -- 172.21.15.26:0/4269404626 learned_addr learned my addr 172.21.15.26:0/4269404626 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.274+0000 7fbfb659c700 1 --2- 172.21.15.26:0/4269404626 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbfb80ffc80 0x7fbfb8196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.274+0000 7fbfb5d9b700 1 --2- 172.21.15.26:0/4269404626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfb8100e70 0x7fbfb8197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.274+0000 7fbfb6d9d700 1 -- 172.21.15.26:0/4269404626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfb8100e70 msgr2=0x7fbfb8197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.274+0000 7fbfb6d9d700 1 --2- 172.21.15.26:0/4269404626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfb8100e70 0x7fbfb8197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.277 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.274+0000 7fbfb6d9d700 1 -- 172.21.15.26:0/4269404626 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbfb80ffc80 msgr2=0x7fbfb8196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.274+0000 7fbfb6d9d700 1 --2- 172.21.15.26:0/4269404626 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbfb80ffc80 0x7fbfb8196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.274+0000 7fbfb6d9d700 1 -- 172.21.15.26:0/4269404626 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac0095f0 con 0x7fbfb8101810 2023-12-01T01:06:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.274+0000 7fbfb6d9d700 1 --2- 172.21.15.26:0/4269404626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb8101810 0x7fbfb819e1b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0007ee0 tx=0x7fbfb000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.274+0000 7fbfa77fe700 1 -- 172.21.15.26:0/4269404626 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0017070 con 0x7fbfb8101810 2023-12-01T01:06:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.274+0000 7fbfbcada700 1 -- 172.21.15.26:0/4269404626 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb819ed90 con 0x7fbfb8101810 2023-12-01T01:06:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.274+0000 7fbfa77fe700 1 -- 172.21.15.26:0/4269404626 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbfb000f040 con 0x7fbfb8101810 2023-12-01T01:06:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.274+0000 7fbfa77fe700 1 -- 172.21.15.26:0/4269404626 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0005610 con 0x7fbfb8101810 2023-12-01T01:06:59.278 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.274+0000 7fbfbcada700 1 -- 172.21.15.26:0/4269404626 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb819f1e0 con 0x7fbfb8101810 2023-12-01T01:06:59.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.276+0000 7fbfa77fe700 1 -- 172.21.15.26:0/4269404626 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fbfb0005790 con 0x7fbfb8101810 2023-12-01T01:06:59.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.277+0000 7fbfa77fe700 1 --2- 172.21.15.26:0/4269404626 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbfa00a0520 0x7fbfa00a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.277+0000 7fbfa77fe700 1 -- 172.21.15.26:0/4269404626 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbfb00cb000 con 0x7fbfb8101810 2023-12-01T01:06:59.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.277+0000 7fbfb659c700 1 --2- 172.21.15.26:0/4269404626 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbfa00a0520 0x7fbfa00a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.278+0000 7fbfb659c700 1 --2- 172.21.15.26:0/4269404626 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbfa00a0520 0x7fbfa00a29e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8198110 tx=0x7fbfa800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.280 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.278+0000 7fbfc8c6ab80 1 Processor -- start 2023-12-01T01:06:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.278+0000 7fbfc8c6ab80 1 -- start start 2023-12-01T01:06:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.278+0000 7fbfc8c6ab80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a30f0 0x55b6843a3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.278+0000 7fbfc8c6ab80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a3a70 0x55b6843a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.278+0000 7fbfc8c6ab80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a23f0 0x55b6843a2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.278+0000 7fbfc8c6ab80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6842f9a10 con 0x55b6843a23f0 2023-12-01T01:06:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.278+0000 7fbfc8c6ab80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6842f73d0 con 0x55b6843a3a70 2023-12-01T01:06:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.278+0000 7fbfc8c6ab80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6842f2cc0 con 0x55b6843a30f0 2023-12-01T01:06:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.278+0000 7fbfb6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a23f0 0x55b6843a2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.278+0000 7fbfb6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a23f0 0x55b6843a2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56628/0 (socket says 172.21.15.26:56628) 2023-12-01T01:06:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.278+0000 7fbfb6d9d700 1 -- 172.21.15.26:0/4085674471 learned_addr learned my addr 172.21.15.26:0/4085674471 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.279+0000 7fbfb5d9b700 1 --2- 172.21.15.26:0/4085674471 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a3a70 0x55b6843a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.279+0000 7fbfb6d9d700 1 -- 172.21.15.26:0/4085674471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a30f0 msgr2=0x55b6843a3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.279+0000 7fbfb6d9d700 1 --2- 172.21.15.26:0/4085674471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a30f0 0x55b6843a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.279+0000 7fbfb6d9d700 1 -- 172.21.15.26:0/4085674471 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a3a70 msgr2=0x55b6843a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.281 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.279+0000 7fbfb6d9d700 1 --2- 172.21.15.26:0/4085674471 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a3a70 0x55b6843a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.279+0000 7fbfb6d9d700 1 -- 172.21.15.26:0/4085674471 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b684120de0 con 0x55b6843a23f0 2023-12-01T01:06:59.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.279+0000 7fbfb6d9d700 1 --2- 172.21.15.26:0/4085674471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a23f0 0x55b6843a2870 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0098800 tx=0x7fbfb0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de13ffb56da53f40 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.279+0000 7fbfa4ff9700 1 -- 172.21.15.26:0/4085674471 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb009c6a0 con 0x55b6843a23f0 2023-12-01T01:06:59.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.279+0000 7fbfa4ff9700 1 -- 172.21.15.26:0/4085674471 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbfb00a08e0 con 0x55b6843a23f0 2023-12-01T01:06:59.282 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.279+0000 7fbfa4ff9700 1 -- 172.21.15.26:0/4085674471 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0098cd0 con 0x55b6843a23f0 2023-12-01T01:06:59.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.280+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/4085674471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a23f0 msgr2=0x55b6843a2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.280+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/4085674471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a23f0 0x55b6843a2870 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0098800 tx=0x7fbfb0004ad0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.280+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/4085674471 shutdown_connections 2023-12-01T01:06:59.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.280+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/4085674471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a23f0 0x55b6843a2870 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.280+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/4085674471 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a30f0 0x55b6843a3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.286 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.280+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/4085674471 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a3a70 0x55b6843a1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.280+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/4085674471 >> 172.21.15.26:0/4085674471 conn(0x55b6843010d0 msgr2=0x55b68439c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.280+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/4085674471 shutdown_connections 2023-12-01T01:06:59.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.280+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/4085674471 wait complete. 2023-12-01T01:06:59.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.280+0000 7fbfc8c6ab80 1 -- start start 2023-12-01T01:06:59.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.280+0000 7fbfc8c6ab80 1 Processor -- start 2023-12-01T01:06:59.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfc8c6ab80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a23f0 0x55b6843ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfc8c6ab80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a30f0 0x55b6843abf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfc8c6ab80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a3a70 0x55b6843b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfc8c6ab80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68428f510 con 0x55b6843a3a70 2023-12-01T01:06:59.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfc8c6ab80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68428f1b0 con 0x55b6843a30f0 2023-12-01T01:06:59.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfc8c6ab80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b684176920 con 0x55b6843a23f0 2023-12-01T01:06:59.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfc8c6ab80 10 client.0 _ll_register_callbacks cb 0x55b6841dca80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:59.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfb6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a3a70 0x55b6843b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfb6d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a3a70 0x55b6843b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56634/0 (socket says 172.21.15.26:56634) 2023-12-01T01:06:59.287 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfb659c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a23f0 0x55b6843ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfb6d9d700 1 -- 172.21.15.26:0/3816424138 learned_addr learned my addr 172.21.15.26:0/3816424138 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfb5d9b700 1 --2- 172.21.15.26:0/3816424138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a30f0 0x55b6843abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfb659c700 1 -- 172.21.15.26:0/3816424138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a30f0 msgr2=0x55b6843abf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfb659c700 1 --2- 172.21.15.26:0/3816424138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a30f0 0x55b6843abf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfb659c700 1 -- 172.21.15.26:0/3816424138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a3a70 msgr2=0x55b6843b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfb659c700 1 --2- 172.21.15.26:0/3816424138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a3a70 0x55b6843b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfb659c700 1 -- 172.21.15.26:0/3816424138 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb819f1e0 con 0x55b6843a23f0 2023-12-01T01:06:59.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfb6d9d700 1 --2- 172.21.15.26:0/3816424138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a3a70 0x55b6843b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-01T01:06:59.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfb5d9b700 1 --2- 172.21.15.26:0/3816424138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a30f0 0x55b6843abf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:06:59.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbfb659c700 1 --2- 172.21.15.26:0/3816424138 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a23f0 0x55b6843ab9f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8100cd0 tx=0x7fbfa8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c2da7de021a8552 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.281+0000 7fbf9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.116:3300/0 2023-12-01T01:06:59.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.282+0000 7fbf9dffb700 1 -- 172.21.15.26:0/3816424138 <== mon.1 v2:172.21.15.116:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8025630 con 0x55b6843a23f0 2023-12-01T01:06:59.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.282+0000 7fbf9dffb700 1 -- 172.21.15.26:0/3816424138 <== mon.1 v2:172.21.15.116:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbfa800fe80 con 0x55b6843a23f0 2023-12-01T01:06:59.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.282+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/3816424138 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b68431dd10 con 0x55b6843a23f0 2023-12-01T01:06:59.288 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.282+0000 7fbf9dffb700 1 -- 172.21.15.26:0/3816424138 <== mon.1 v2:172.21.15.116:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfa8010e70 con 0x55b6843a23f0 2023-12-01T01:06:59.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.282+0000 7fbfc8c6ab80 10 client.25639 fetch_fsmap learned FSMap version 32 2023-12-01T01:06:59.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.282+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/3816424138 --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55b684109c60 con 0x55b6843a23f0 2023-12-01T01:06:59.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.282+0000 7fbf9dffb700 1 -- 172.21.15.26:0/3816424138 <== mon.1 v2:172.21.15.116:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x55b68431dd10 con 0x55b6843a23f0 2023-12-01T01:06:59.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.282+0000 7fbf9dffb700 1 -- 172.21.15.26:0/3816424138 <== mon.1 v2:172.21.15.116:3300/0 5 ==== fsmap(e 32) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fbfa801ba70 con 0x55b6843a23f0 2023-12-01T01:06:59.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.282+0000 7fbfc8c6ab80 10 client.25639 fetch_fsmap finished waiting for FSMap version 32 2023-12-01T01:06:59.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.282+0000 7fbfc8c6ab80 10 client.25639 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2023-12-01T01:06:59.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.282+0000 7fbfc8c6ab80 20 client.25639 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:59.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.282+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/3816424138 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55b6843b7850 0x55b6843b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.282+0000 7fbfc8c6ab80 4 client.25639 mds_command: new command op to 24493 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:06:59.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.282+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/3816424138 --> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b684370e10 con 0x55b6843b7850 2023-12-01T01:06:59.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.283+0000 7fbfb5d9b700 1 --2- 172.21.15.26:0/3816424138 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55b6843b7850 0x55b6843b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.283+0000 7fbf9dffb700 10 client.25639 ms_handle_connect on v2:172.21.15.26:6838/1277894156 2023-12-01T01:06:59.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.283+0000 7fbfb5d9b700 1 --2- 172.21.15.26:0/3816424138 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55b6843b7850 0x55b6843b9c70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1c575df266549e52 server_cookie=82a7250e4c49319b in_seq=0 out_seq=0 2023-12-01T01:06:59.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.283+0000 7fbf9dffb700 1 -- 172.21.15.26:0/3816424138 <== mds.1 v2:172.21.15.26:6838/1277894156 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55b684370e10 con 0x55b6843b7850 2023-12-01T01:06:59.289 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.283+0000 7fbf9dffb700 10 client.25639 handle_command_reply: tid=0 2023-12-01T01:06:59.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.283+0000 7fbfc8c6ab80 1 client.25639 shutdown 2023-12-01T01:06:59.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.284+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/3816424138 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a23f0 msgr2=0x55b6843ab9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.284+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/3816424138 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a23f0 0x55b6843ab9f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8100cd0 tx=0x7fbfa8004750 comp rx=0 tx=0).stop 2023-12-01T01:06:59.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.284+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/3816424138 shutdown_connections 2023-12-01T01:06:59.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.284+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/3816424138 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55b6843b7850 0x55b6843b9c70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.284+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/3816424138 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a3a70 0x55b6843b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.284+0000 7fbf9dffb700 0 client.25639 ms_handle_reset on v2:172.21.15.26:6838/1277894156 2023-12-01T01:06:59.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.284+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/3816424138 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a23f0 0x55b6843ab9f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.284+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/3816424138 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a30f0 0x55b6843abf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.284+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/3816424138 >> 172.21.15.26:0/3816424138 conn(0x55b6843010d0 msgr2=0x55b68439c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.284+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/3816424138 shutdown_connections 2023-12-01T01:06:59.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.284+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/3816424138 wait complete. 2023-12-01T01:06:59.290 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.284+0000 7fbfc8c6ab80 20 client.25639 trim_cache size 0 max 16384 2023-12-01T01:06:59.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.297+0000 7fbfc8c6ab80 1 Processor -- start 2023-12-01T01:06:59.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.297+0000 7fbfc8c6ab80 1 -- start start 2023-12-01T01:06:59.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.297+0000 7fbfc8c6ab80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a23f0 0x55b6843b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.297+0000 7fbfc8c6ab80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a30f0 0x55b6843b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.297+0000 7fbfc8c6ab80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a3a70 0x55b6843aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.297+0000 7fbfc8c6ab80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b684370e10 con 0x55b6843a30f0 2023-12-01T01:06:59.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.297+0000 7fbfc8c6ab80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68431dd10 con 0x55b6843a23f0 2023-12-01T01:06:59.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.297+0000 7fbfc8c6ab80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6843acbe0 con 0x55b6843a3a70 2023-12-01T01:06:59.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.297+0000 7fbfb5d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a30f0 0x55b6843b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.297+0000 7fbfb5d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a30f0 0x55b6843b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56640/0 (socket says 172.21.15.26:56640) 2023-12-01T01:06:59.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.297+0000 7fbfb5d9b700 1 -- 172.21.15.26:0/246388118 learned_addr learned my addr 172.21.15.26:0/246388118 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.297+0000 7fbfb659c700 1 --2- 172.21.15.26:0/246388118 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a23f0 0x55b6843b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.297+0000 7fbfb6d9d700 1 --2- 172.21.15.26:0/246388118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a3a70 0x55b6843aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.298+0000 7fbfb5d9b700 1 -- 172.21.15.26:0/246388118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a3a70 msgr2=0x55b6843aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.298+0000 7fbfb5d9b700 1 --2- 172.21.15.26:0/246388118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a3a70 0x55b6843aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.298+0000 7fbfb5d9b700 1 -- 172.21.15.26:0/246388118 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a23f0 msgr2=0x55b6843b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.298+0000 7fbfb5d9b700 1 --2- 172.21.15.26:0/246388118 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a23f0 0x55b6843b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.298+0000 7fbfb5d9b700 1 -- 172.21.15.26:0/246388118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b684147250 con 0x55b6843a30f0 2023-12-01T01:06:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.298+0000 7fbfb6d9d700 1 --2- 172.21.15.26:0/246388118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a3a70 0x55b6843aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:06:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.298+0000 7fbfb5d9b700 1 --2- 172.21.15.26:0/246388118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a30f0 0x55b6843b3860 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbfac006010 tx=0x7fbfac005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0992bb66da8cf2f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.298+0000 7fbfa57fa700 1 -- 172.21.15.26:0/246388118 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac01d040 con 0x55b6843a30f0 2023-12-01T01:06:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.298+0000 7fbfa57fa700 1 -- 172.21.15.26:0/246388118 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbfac02b070 con 0x55b6843a30f0 2023-12-01T01:06:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.298+0000 7fbfa57fa700 1 -- 172.21.15.26:0/246388118 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac00b990 con 0x55b6843a30f0 2023-12-01T01:06:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/246388118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a30f0 msgr2=0x55b6843b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/246388118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a30f0 0x55b6843b3860 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbfac006010 tx=0x7fbfac005990 comp rx=0 tx=0).stop 2023-12-01T01:06:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/246388118 shutdown_connections 2023-12-01T01:06:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/246388118 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a3a70 0x55b6843aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/246388118 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a23f0 0x55b6843b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/246388118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a30f0 0x55b6843b3860 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/246388118 >> 172.21.15.26:0/246388118 conn(0x55b6843010d0 msgr2=0x55b68439c910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/246388118 shutdown_connections 2023-12-01T01:06:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/246388118 wait complete. 2023-12-01T01:06:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 -- start start 2023-12-01T01:06:59.305 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 Processor -- start 2023-12-01T01:06:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a23f0 0x55b684403330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a30f0 0x55b684405880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a3a70 0x55b684407e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b684408520 con 0x55b6843a30f0 2023-12-01T01:06:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b684408690 con 0x55b6843a3a70 2023-12-01T01:06:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b684408850 con 0x55b6843a23f0 2023-12-01T01:06:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfc8c6ab80 10 client.0 _ll_register_callbacks cb 0x7fbfa800fdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfb5d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a30f0 0x55b684405880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfb5d9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a30f0 0x55b684405880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56646/0 (socket says 172.21.15.26:56646) 2023-12-01T01:06:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.299+0000 7fbfb5d9b700 1 -- 172.21.15.26:0/1139911258 learned_addr learned my addr 172.21.15.26:0/1139911258 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbfb659c700 1 --2- 172.21.15.26:0/1139911258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a23f0 0x55b684403330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbfb6d9d700 1 --2- 172.21.15.26:0/1139911258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a3a70 0x55b684407e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.306 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbfb5d9b700 1 -- 172.21.15.26:0/1139911258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a23f0 msgr2=0x55b684403330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbfb5d9b700 1 --2- 172.21.15.26:0/1139911258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a23f0 0x55b684403330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbfb5d9b700 1 -- 172.21.15.26:0/1139911258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a3a70 msgr2=0x55b684407e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbfb5d9b700 1 --2- 172.21.15.26:0/1139911258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a3a70 0x55b684407e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbfb5d9b700 1 -- 172.21.15.26:0/1139911258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb8108a10 con 0x55b6843a30f0 2023-12-01T01:06:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbfb5d9b700 1 --2- 172.21.15.26:0/1139911258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a30f0 0x55b684405880 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009990 tx=0x7fbfac027040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5046ebbb7f23b7f server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbf9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:06:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbf9dffb700 1 -- 172.21.15.26:0/1139911258 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac01d040 con 0x55b6843a30f0 2023-12-01T01:06:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/1139911258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbfb00a08e0 con 0x55b6843a30f0 2023-12-01T01:06:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbf9dffb700 1 -- 172.21.15.26:0/1139911258 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fbfac0052e0 con 0x55b6843a30f0 2023-12-01T01:06:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbf9dffb700 1 -- 172.21.15.26:0/1139911258 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbfac0054a0 con 0x55b6843a30f0 2023-12-01T01:06:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbfc8c6ab80 10 client.16005 fetch_fsmap learned FSMap version 32 2023-12-01T01:06:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/1139911258 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x55b68411f2b0 con 0x55b6843a30f0 2023-12-01T01:06:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbf9dffb700 1 -- 172.21.15.26:0/1139911258 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fbfb00a08e0 con 0x55b6843a30f0 2023-12-01T01:06:59.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.300+0000 7fbf9dffb700 1 -- 172.21.15.26:0/1139911258 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 32) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fbfac042070 con 0x55b6843a30f0 2023-12-01T01:06:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 10 client.16005 fetch_fsmap finished waiting for FSMap version 32 2023-12-01T01:06:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 10 client.16005 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.g 2023-12-01T01:06:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 20 client.16005 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/1139911258 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55b684409e60 0x55b68440c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 4 client.16005 mds_command: new command op to 24493 tid=0[{"prefix": "damage ls"}] 2023-12-01T01:06:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/1139911258 --> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b6842ebd40 con 0x55b684409e60 2023-12-01T01:06:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfb659c700 1 --2- 172.21.15.26:0/1139911258 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55b684409e60 0x55b68440c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbf9dffb700 10 client.16005 ms_handle_connect on v2:172.21.15.26:6838/1277894156 2023-12-01T01:06:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfb659c700 1 --2- 172.21.15.26:0/1139911258 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55b684409e60 0x55b68440c280 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=280ed369aa78c562 server_cookie=3ed18506dfa3ccc2 in_seq=0 out_seq=0 2023-12-01T01:06:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbf9dffb700 1 -- 172.21.15.26:0/1139911258 <== mds.1 v2:172.21.15.26:6838/1277894156 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b6842ebd40 con 0x55b684409e60 2023-12-01T01:06:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbf9dffb700 10 client.16005 handle_command_reply: tid=0 2023-12-01T01:06:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 1 client.16005 shutdown 2023-12-01T01:06:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/1139911258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a30f0 msgr2=0x55b684405880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/1139911258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a30f0 0x55b684405880 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009990 tx=0x7fbfac027040 comp rx=0 tx=0).stop 2023-12-01T01:06:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/1139911258 shutdown_connections 2023-12-01T01:06:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/1139911258 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x55b6843a3a70 0x55b684407e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/1139911258 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x55b6843a23f0 0x55b684403330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/1139911258 >> [v2:172.21.15.26:6838/1277894156,v1:172.21.15.26:6839/1277894156] conn(0x55b684409e60 0x55b68440c280 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 1 --2- 172.21.15.26:0/1139911258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6843a30f0 0x55b684405880 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/1139911258 >> 172.21.15.26:0/1139911258 conn(0x55b6843010d0 msgr2=0x55b6843b3860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbf9dffb700 0 client.16005 ms_handle_reset on v2:172.21.15.26:6838/1277894156 2023-12-01T01:06:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/1139911258 shutdown_connections 2023-12-01T01:06:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.301+0000 7fbfc8c6ab80 1 -- 172.21.15.26:0/1139911258 wait complete. 2023-12-01T01:06:59.309 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.302+0000 7fbfc8c6ab80 20 client.16005 trim_cache size 0 max 16384 2023-12-01T01:06:59.309 INFO:teuthology.orchestra.run.smithi026.stdout:[] 2023-12-01T01:06:59.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.302+0000 7fbfbcada700 1 -- 172.21.15.26:0/4269404626 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbfa00a0520 msgr2=0x7fbfa00a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.302+0000 7fbfbcada700 1 --2- 172.21.15.26:0/4269404626 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbfa00a0520 0x7fbfa00a29e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbfb8198110 tx=0x7fbfa800a380 comp rx=0 tx=0).stop 2023-12-01T01:06:59.310 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.302+0000 7fbfbcada700 1 -- 172.21.15.26:0/4269404626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb8101810 msgr2=0x7fbfb819e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.302+0000 7fbfbcada700 1 --2- 172.21.15.26:0/4269404626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb8101810 0x7fbfb819e1b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbfb0007ee0 tx=0x7fbfb000d3b0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.302+0000 7fbfbcada700 1 -- 172.21.15.26:0/4269404626 shutdown_connections 2023-12-01T01:06:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.302+0000 7fbfbcada700 1 --2- 172.21.15.26:0/4269404626 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fbfa00a0520 0x7fbfa00a29e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.302+0000 7fbfbcada700 1 --2- 172.21.15.26:0/4269404626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbfb8101810 0x7fbfb819e1b0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.302+0000 7fbfbcada700 1 --2- 172.21.15.26:0/4269404626 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbfb80ffc80 0x7fbfb8196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.302+0000 7fbfbcada700 1 --2- 172.21.15.26:0/4269404626 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fbfb8100e70 0x7fbfb8197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.302+0000 7fbfbcada700 1 -- 172.21.15.26:0/4269404626 >> 172.21.15.26:0/4269404626 conn(0x7fbfb80fb1f0 msgr2=0x7fbfb8067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.302+0000 7fbfbcada700 1 -- 172.21.15.26:0/4269404626 shutdown_connections 2023-12-01T01:06:59.311 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.302+0000 7fbfbcada700 1 -- 172.21.15.26:0/4269404626 wait complete. 2023-12-01T01:06:59.315 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-12-01T01:06:59.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.444+0000 7fdd0c4b9700 1 -- 172.21.15.26:0/3121972607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd04100f80 msgr2=0x7fdd04107830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.444+0000 7fdd0c4b9700 1 --2- 172.21.15.26:0/3121972607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd04100f80 0x7fdd04107830 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00c240 tx=0x7fdcfc00c550 comp rx=0 tx=0).stop 2023-12-01T01:06:59.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.444+0000 7fdd0c4b9700 1 -- 172.21.15.26:0/3121972607 shutdown_connections 2023-12-01T01:06:59.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.444+0000 7fdd0c4b9700 1 --2- 172.21.15.26:0/3121972607 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd04100f80 0x7fdd04107830 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.444+0000 7fdd0c4b9700 1 --2- 172.21.15.26:0/3121972607 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd040ff3f0 0x7fdd040ff810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.445 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.444+0000 7fdd0c4b9700 1 --2- 172.21.15.26:0/3121972607 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd041005e0 0x7fdd04100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.444+0000 7fdd0c4b9700 1 -- 172.21.15.26:0/3121972607 >> 172.21.15.26:0/3121972607 conn(0x7fdd040fa960 msgr2=0x7fdd040fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.444+0000 7fdd0c4b9700 1 -- 172.21.15.26:0/3121972607 shutdown_connections 2023-12-01T01:06:59.446 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.444+0000 7fdd0c4b9700 1 -- 172.21.15.26:0/3121972607 wait complete. 2023-12-01T01:06:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0c4b9700 1 Processor -- start 2023-12-01T01:06:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0c4b9700 1 -- start start 2023-12-01T01:06:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0c4b9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd040ff3f0 0x7fdd04194a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0c4b9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd041005e0 0x7fdd04194fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0c4b9700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd04100f80 0x7fdd0419c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0c4b9700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0419c5e0 con 0x7fdd040ff3f0 2023-12-01T01:06:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0c4b9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0419c720 con 0x7fdd041005e0 2023-12-01T01:06:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0c4b9700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0419c8b0 con 0x7fdd04100f80 2023-12-01T01:06:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0a255700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd040ff3f0 0x7fdd04194a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0a255700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd040ff3f0 0x7fdd04194a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56658/0 (socket says 172.21.15.26:56658) 2023-12-01T01:06:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0a255700 1 -- 172.21.15.26:0/3400716627 learned_addr learned my addr 172.21.15.26:0/3400716627 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.448 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0aa56700 1 --2- 172.21.15.26:0/3400716627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd04100f80 0x7fdd0419c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd09a54700 1 --2- 172.21.15.26:0/3400716627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd041005e0 0x7fdd04194fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0a255700 1 -- 172.21.15.26:0/3400716627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd04100f80 msgr2=0x7fdd0419c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0a255700 1 --2- 172.21.15.26:0/3400716627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd04100f80 0x7fdd0419c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0a255700 1 -- 172.21.15.26:0/3400716627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd041005e0 msgr2=0x7fdd04194fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0a255700 1 --2- 172.21.15.26:0/3400716627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd041005e0 0x7fdd04194fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0a255700 1 -- 172.21.15.26:0/3400716627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcfc00ae10 con 0x7fdd040ff3f0 2023-12-01T01:06:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0aa56700 1 --2- 172.21.15.26:0/3400716627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd04100f80 0x7fdd0419c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:06:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd09a54700 1 --2- 172.21.15.26:0/3400716627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd041005e0 0x7fdd04194fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:06:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.445+0000 7fdd0a255700 1 --2- 172.21.15.26:0/3400716627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd040ff3f0 0x7fdd04194a60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000e970 tx=0x7fdd0000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.446+0000 7fdcfb7fe700 1 -- 172.21.15.26:0/3400716627 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00009790 con 0x7fdd040ff3f0 2023-12-01T01:06:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.446+0000 7fdd0c4b9700 1 -- 172.21.15.26:0/3400716627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd0419cb90 con 0x7fdd040ff3f0 2023-12-01T01:06:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.446+0000 7fdcfb7fe700 1 -- 172.21.15.26:0/3400716627 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdd00004500 con 0x7fdd040ff3f0 2023-12-01T01:06:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.446+0000 7fdcfb7fe700 1 -- 172.21.15.26:0/3400716627 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00010430 con 0x7fdd040ff3f0 2023-12-01T01:06:59.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.446+0000 7fdd0c4b9700 1 -- 172.21.15.26:0/3400716627 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd0419d0f0 con 0x7fdd040ff3f0 2023-12-01T01:06:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.448+0000 7fdcfb7fe700 1 -- 172.21.15.26:0/3400716627 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fdd0000cbd0 con 0x7fdd040ff3f0 2023-12-01T01:06:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.449+0000 7fdcfb7fe700 1 --2- 172.21.15.26:0/3400716627 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdcf00a0520 0x7fdcf00a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.449+0000 7fdcfb7fe700 1 -- 172.21.15.26:0/3400716627 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdd00014070 con 0x7fdd040ff3f0 2023-12-01T01:06:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.449+0000 7fdd09a54700 1 --2- 172.21.15.26:0/3400716627 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdcf00a0520 0x7fdcf00a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.449+0000 7fdd09a54700 1 --2- 172.21.15.26:0/3400716627 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdcf00a0520 0x7fdcf00a29e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009be0 tx=0x7fdcf4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.449+0000 7fdd18649b80 1 Processor -- start 2023-12-01T01:06:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd18649b80 1 -- start start 2023-12-01T01:06:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd18649b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9b300 0x557643e9b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd18649b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643e9a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd18649b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9a600 0x557643e9aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd18649b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x557643defa10 con 0x557643e9a600 2023-12-01T01:06:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd18649b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x557643ded3d0 con 0x557643e9b300 2023-12-01T01:06:59.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd18649b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x557643de8cc0 con 0x557643e9bc80 2023-12-01T01:06:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd0aa56700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9a600 0x557643e9aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd0aa56700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9a600 0x557643e9aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56670/0 (socket says 172.21.15.26:56670) 2023-12-01T01:06:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd0aa56700 1 -- 172.21.15.26:0/2578399008 learned_addr learned my addr 172.21.15.26:0/2578399008 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd09a54700 1 --2- 172.21.15.26:0/2578399008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643e9a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd0a255700 1 --2- 172.21.15.26:0/2578399008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9b300 0x557643e9b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd0aa56700 1 -- 172.21.15.26:0/2578399008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 msgr2=0x557643e9a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd0aa56700 1 --2- 172.21.15.26:0/2578399008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643e9a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd0aa56700 1 -- 172.21.15.26:0/2578399008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9b300 msgr2=0x557643e9b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd0aa56700 1 --2- 172.21.15.26:0/2578399008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9b300 0x557643e9b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd0aa56700 1 -- 172.21.15.26:0/2578399008 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557643c16de0 con 0x557643e9a600 2023-12-01T01:06:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd0a255700 1 --2- 172.21.15.26:0/2578399008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9b300 0x557643e9b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:06:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd09a54700 1 --2- 172.21.15.26:0/2578399008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643e9a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:06:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdd0aa56700 1 --2- 172.21.15.26:0/2578399008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9a600 0x557643e9aa80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00c210 tx=0x7fdcfc00ad90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d47a3f01f99d4b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.450+0000 7fdcf8ff9700 1 -- 172.21.15.26:0/2578399008 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc00f040 con 0x557643e9a600 2023-12-01T01:06:59.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.451+0000 7fdcf8ff9700 1 -- 172.21.15.26:0/2578399008 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdcfc00a0d0 con 0x557643e9a600 2023-12-01T01:06:59.454 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.451+0000 7fdcf8ff9700 1 -- 172.21.15.26:0/2578399008 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc0085b0 con 0x557643e9a600 2023-12-01T01:06:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.451+0000 7fdd18649b80 1 -- 172.21.15.26:0/2578399008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9a600 msgr2=0x557643e9aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.451+0000 7fdd18649b80 1 --2- 172.21.15.26:0/2578399008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9a600 0x557643e9aa80 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00c210 tx=0x7fdcfc00ad90 comp rx=0 tx=0).stop 2023-12-01T01:06:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.451+0000 7fdd18649b80 1 -- 172.21.15.26:0/2578399008 shutdown_connections 2023-12-01T01:06:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.451+0000 7fdd18649b80 1 --2- 172.21.15.26:0/2578399008 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9a600 0x557643e9aa80 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.451+0000 7fdd18649b80 1 --2- 172.21.15.26:0/2578399008 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9b300 0x557643e9b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.451+0000 7fdd18649b80 1 --2- 172.21.15.26:0/2578399008 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643e9a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.451+0000 7fdd18649b80 1 -- 172.21.15.26:0/2578399008 >> 172.21.15.26:0/2578399008 conn(0x557643df70d0 msgr2=0x557643e92940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.451+0000 7fdd18649b80 1 -- 172.21.15.26:0/2578399008 shutdown_connections 2023-12-01T01:06:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.451+0000 7fdd18649b80 1 -- 172.21.15.26:0/2578399008 wait complete. 2023-12-01T01:06:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd18649b80 1 -- start start 2023-12-01T01:06:59.458 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd18649b80 1 Processor -- start 2023-12-01T01:06:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd18649b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9a600 0x557643ea3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd18649b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd18649b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643eab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd18649b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x557643d85510 con 0x557643e9b300 2023-12-01T01:06:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd18649b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x557643d851b0 con 0x557643e9a600 2023-12-01T01:06:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd18649b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x557643c6c920 con 0x557643e9bc80 2023-12-01T01:06:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd18649b80 10 client.0 _ll_register_callbacks cb 0x557643cd2a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd09a54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd09a54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea4060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56674/0 (socket says 172.21.15.26:56674) 2023-12-01T01:06:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd09a54700 1 -- 172.21.15.26:0/3454698929 learned_addr learned my addr 172.21.15.26:0/3454698929 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd0a255700 1 --2- 172.21.15.26:0/3454698929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9a600 0x557643ea3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd0aa56700 1 --2- 172.21.15.26:0/3454698929 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643eab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd09a54700 1 -- 172.21.15.26:0/3454698929 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 msgr2=0x557643eab0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.459 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd09a54700 1 --2- 172.21.15.26:0/3454698929 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643eab0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd09a54700 1 -- 172.21.15.26:0/3454698929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9a600 msgr2=0x557643ea3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd09a54700 1 --2- 172.21.15.26:0/3454698929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9a600 0x557643ea3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.452+0000 7fdd09a54700 1 -- 172.21.15.26:0/3454698929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd04108180 con 0x557643e9b300 2023-12-01T01:06:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.453+0000 7fdd09a54700 1 --2- 172.21.15.26:0/3454698929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea4060 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4005d30 tx=0x7fdcf4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1540e9bfdc6128f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.453+0000 7fdcedffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:06:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.453+0000 7fdcedffb700 1 -- 172.21.15.26:0/3454698929 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4020630 con 0x557643e9b300 2023-12-01T01:06:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.453+0000 7fdcedffb700 1 -- 172.21.15.26:0/3454698929 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdcf4020790 con 0x557643e9b300 2023-12-01T01:06:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.453+0000 7fdd18649b80 1 -- 172.21.15.26:0/3454698929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557643e13d10 con 0x557643e9b300 2023-12-01T01:06:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.453+0000 7fdcedffb700 1 -- 172.21.15.26:0/3454698929 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcf4012e50 con 0x557643e9b300 2023-12-01T01:06:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.453+0000 7fdd18649b80 10 client.16017 fetch_fsmap learned FSMap version 32 2023-12-01T01:06:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.453+0000 7fdd18649b80 1 -- 172.21.15.26:0/3454698929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x557643bffc60 con 0x557643e9b300 2023-12-01T01:06:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.453+0000 7fdcedffb700 1 -- 172.21.15.26:0/3454698929 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x557643e13d10 con 0x557643e9b300 2023-12-01T01:06:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.453+0000 7fdcedffb700 1 -- 172.21.15.26:0/3454698929 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 32) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fdcf4031070 con 0x557643e9b300 2023-12-01T01:06:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.453+0000 7fdd18649b80 10 client.16017 fetch_fsmap finished waiting for FSMap version 32 2023-12-01T01:06:59.460 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.453+0000 7fdd18649b80 10 client.16017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:06:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.453+0000 7fdd18649b80 20 client.16017 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.453+0000 7fdd18649b80 1 --2- 172.21.15.26:0/3454698929 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x557643eaf980 0x557643eb1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.453+0000 7fdd18649b80 4 client.16017 mds_command: new command op to 24509 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-01T01:06:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.453+0000 7fdd18649b80 1 -- 172.21.15.26:0/3454698929 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557643e66e10 con 0x557643eaf980 2023-12-01T01:06:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.454+0000 7fdd0a255700 1 --2- 172.21.15.26:0/3454698929 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x557643eaf980 0x557643eb1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.454+0000 7fdcedffb700 10 client.16017 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.454+0000 7fdd0a255700 1 --2- 172.21.15.26:0/3454698929 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x557643eaf980 0x557643eb1da0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27e13c24c8e2bc41 server_cookie=65439632db66f236 in_seq=0 out_seq=0 2023-12-01T01:06:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.455+0000 7fdcedffb700 1 -- 172.21.15.26:0/3454698929 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x557643e66e10 con 0x557643eaf980 2023-12-01T01:06:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.455+0000 7fdcedffb700 10 client.16017 handle_command_reply: tid=0 2023-12-01T01:06:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.455+0000 7fdd18649b80 1 client.16017 shutdown 2023-12-01T01:06:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.455+0000 7fdd18649b80 1 -- 172.21.15.26:0/3454698929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 msgr2=0x557643ea4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.455+0000 7fdd18649b80 1 --2- 172.21.15.26:0/3454698929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea4060 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4005d30 tx=0x7fdcf4004750 comp rx=0 tx=0).stop 2023-12-01T01:06:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.455+0000 7fdd18649b80 1 -- 172.21.15.26:0/3454698929 shutdown_connections 2023-12-01T01:06:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.455+0000 7fdd18649b80 1 --2- 172.21.15.26:0/3454698929 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x557643eaf980 0x557643eb1da0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.461 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.455+0000 7fdd18649b80 1 --2- 172.21.15.26:0/3454698929 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643eab0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.455+0000 7fdd18649b80 1 --2- 172.21.15.26:0/3454698929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9a600 0x557643ea3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.455+0000 7fdcedffb700 0 client.16017 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.455+0000 7fdd18649b80 1 --2- 172.21.15.26:0/3454698929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea4060 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.455+0000 7fdd18649b80 1 -- 172.21.15.26:0/3454698929 >> 172.21.15.26:0/3454698929 conn(0x557643df70d0 msgr2=0x557643e920b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.455+0000 7fdd18649b80 1 -- 172.21.15.26:0/3454698929 shutdown_connections 2023-12-01T01:06:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.455+0000 7fdd18649b80 1 -- 172.21.15.26:0/3454698929 wait complete. 2023-12-01T01:06:59.462 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.455+0000 7fdd18649b80 20 client.16017 trim_cache size 0 max 16384 2023-12-01T01:06:59.475 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd18649b80 1 Processor -- start 2023-12-01T01:06:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd18649b80 1 -- start start 2023-12-01T01:06:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd18649b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9a600 0x557643e93360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd18649b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd18649b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643ea2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd18649b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x557643ea2240 con 0x557643e9b300 2023-12-01T01:06:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd18649b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x557643ea49d0 con 0x557643e9a600 2023-12-01T01:06:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd18649b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x557643e99e70 con 0x557643e9bc80 2023-12-01T01:06:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd09a54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.477 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd09a54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56682/0 (socket says 172.21.15.26:56682) 2023-12-01T01:06:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd09a54700 1 -- 172.21.15.26:0/3769707203 learned_addr learned my addr 172.21.15.26:0/3769707203 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd0aa56700 1 --2- 172.21.15.26:0/3769707203 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643ea2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd09a54700 1 -- 172.21.15.26:0/3769707203 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 msgr2=0x557643ea2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd09a54700 1 --2- 172.21.15.26:0/3769707203 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643ea2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd09a54700 1 -- 172.21.15.26:0/3769707203 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9a600 msgr2=0x557643e93360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd0a255700 1 --2- 172.21.15.26:0/3769707203 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9a600 0x557643e93360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd09a54700 1 --2- 172.21.15.26:0/3769707203 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9a600 0x557643e93360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd09a54700 1 -- 172.21.15.26:0/3769707203 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557643c3d250 con 0x557643e9b300 2023-12-01T01:06:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd0aa56700 1 --2- 172.21.15.26:0/3769707203 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643ea2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:06:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.468+0000 7fdd09a54700 1 --2- 172.21.15.26:0/3769707203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea9050 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4000c00 tx=0x7fdcf40039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeeee1df4ea569bc server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.469+0000 7fdcf97fa700 1 -- 172.21.15.26:0/3769707203 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4038070 con 0x557643e9b300 2023-12-01T01:06:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.469+0000 7fdcf97fa700 1 -- 172.21.15.26:0/3769707203 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdcf402e070 con 0x557643e9b300 2023-12-01T01:06:59.478 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.469+0000 7fdcf97fa700 1 -- 172.21.15.26:0/3769707203 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4004530 con 0x557643e9b300 2023-12-01T01:06:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.469+0000 7fdd18649b80 1 -- 172.21.15.26:0/3769707203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 msgr2=0x557643ea9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.469+0000 7fdd18649b80 1 --2- 172.21.15.26:0/3769707203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea9050 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4000c00 tx=0x7fdcf40039d0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.469+0000 7fdd18649b80 1 -- 172.21.15.26:0/3769707203 shutdown_connections 2023-12-01T01:06:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.469+0000 7fdd18649b80 1 --2- 172.21.15.26:0/3769707203 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643ea2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.469+0000 7fdd18649b80 1 --2- 172.21.15.26:0/3769707203 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9a600 0x557643e93360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.469+0000 7fdd18649b80 1 --2- 172.21.15.26:0/3769707203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea9050 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.469+0000 7fdd18649b80 1 -- 172.21.15.26:0/3769707203 >> 172.21.15.26:0/3769707203 conn(0x557643df70d0 msgr2=0x557643e9a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.469+0000 7fdd18649b80 1 -- 172.21.15.26:0/3769707203 shutdown_connections 2023-12-01T01:06:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.469+0000 7fdd18649b80 1 -- 172.21.15.26:0/3769707203 wait complete. 2023-12-01T01:06:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.469+0000 7fdd18649b80 1 -- start start 2023-12-01T01:06:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd18649b80 1 Processor -- start 2023-12-01T01:06:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd18649b80 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9a600 0x557643ea51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd18649b80 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd18649b80 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643ea8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.479 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd18649b80 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x557643ea8870 con 0x557643e9b300 2023-12-01T01:06:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd18649b80 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x557643ea89e0 con 0x557643e9a600 2023-12-01T01:06:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd18649b80 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x557643ea8ba0 con 0x557643e9bc80 2023-12-01T01:06:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd18649b80 10 client.0 _ll_register_callbacks cb 0x7fdcf4010aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-01T01:06:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd09a54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd09a54700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56688/0 (socket says 172.21.15.26:56688) 2023-12-01T01:06:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd09a54700 1 -- 172.21.15.26:0/938314133 learned_addr learned my addr 172.21.15.26:0/938314133 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd0a255700 1 --2- 172.21.15.26:0/938314133 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9a600 0x557643ea51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd0aa56700 1 --2- 172.21.15.26:0/938314133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643ea8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd09a54700 1 -- 172.21.15.26:0/938314133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 msgr2=0x557643ea8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd09a54700 1 --2- 172.21.15.26:0/938314133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643ea8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd09a54700 1 -- 172.21.15.26:0/938314133 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9a600 msgr2=0x557643ea51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-01T01:06:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd09a54700 1 --2- 172.21.15.26:0/938314133 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9a600 0x557643ea51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.480 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd09a54700 1 -- 172.21.15.26:0/938314133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557643bffc60 con 0x557643e9b300 2023-12-01T01:06:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd0aa56700 1 --2- 172.21.15.26:0/938314133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643ea8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:06:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdd09a54700 1 --2- 172.21.15.26:0/938314133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea5720 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40038b0 tx=0x7fdcf4012f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9ed4539892d6d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.470+0000 7fdcedffb700 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2023-12-01T01:06:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.471+0000 7fdcedffb700 1 -- 172.21.15.26:0/938314133 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4038070 con 0x557643e9b300 2023-12-01T01:06:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.471+0000 7fdcedffb700 1 -- 172.21.15.26:0/938314133 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fdcf4033450 con 0x557643e9b300 2023-12-01T01:06:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.471+0000 7fdd18649b80 1 -- 172.21.15.26:0/938314133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdcfc00a0d0 con 0x557643e9b300 2023-12-01T01:06:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.471+0000 7fdcedffb700 1 -- 172.21.15.26:0/938314133 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcf4033610 con 0x557643e9b300 2023-12-01T01:06:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.471+0000 7fdd18649b80 10 client.16023 fetch_fsmap learned FSMap version 32 2023-12-01T01:06:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.471+0000 7fdd18649b80 1 -- 172.21.15.26:0/938314133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) v3 -- 0x557643c152b0 con 0x557643e9b300 2023-12-01T01:06:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.471+0000 7fdcedffb700 1 -- 172.21.15.26:0/938314133 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fdcf404b020 con 0x557643e9b300 2023-12-01T01:06:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.471+0000 7fdcedffb700 1 -- 172.21.15.26:0/938314133 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 32) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fdcf4043020 con 0x557643e9b300 2023-12-01T01:06:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.471+0000 7fdd18649b80 10 client.16023 fetch_fsmap finished waiting for FSMap version 32 2023-12-01T01:06:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.471+0000 7fdd18649b80 10 client.16023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-12-01T01:06:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.471+0000 7fdd18649b80 20 client.16023 populate_metadata read hostname 'smithi026' 2023-12-01T01:06:59.481 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.471+0000 7fdd18649b80 1 --2- 172.21.15.26:0/938314133 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x557643f04470 0x557643f06890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.471+0000 7fdd18649b80 4 client.16023 mds_command: new command op to 24509 tid=0[{"prefix": "damage ls"}] 2023-12-01T01:06:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.471+0000 7fdd18649b80 1 -- 172.21.15.26:0/938314133 --> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557643de1d40 con 0x557643f04470 2023-12-01T01:06:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.471+0000 7fdd0a255700 1 --2- 172.21.15.26:0/938314133 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x557643f04470 0x557643f06890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdcedffb700 10 client.16023 ms_handle_connect on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdd0a255700 1 --2- 172.21.15.26:0/938314133 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x557643f04470 0x557643f06890 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0cbfeddbe66acd6 server_cookie=4b9ceef229a43c1c in_seq=0 out_seq=0 2023-12-01T01:06:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdcedffb700 1 -- 172.21.15.26:0/938314133 <== mds.0 v2:172.21.15.93:6838/3364532241 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557643de1d40 con 0x557643f04470 2023-12-01T01:06:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdcedffb700 10 client.16023 handle_command_reply: tid=0 2023-12-01T01:06:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdd18649b80 1 client.16023 shutdown 2023-12-01T01:06:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdd18649b80 1 -- 172.21.15.26:0/938314133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 msgr2=0x557643ea5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdd18649b80 1 --2- 172.21.15.26:0/938314133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea5720 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40038b0 tx=0x7fdcf4012f00 comp rx=0 tx=0).stop 2023-12-01T01:06:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdd18649b80 1 -- 172.21.15.26:0/938314133 shutdown_connections 2023-12-01T01:06:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdd18649b80 1 --2- 172.21.15.26:0/938314133 >> [v2:172.21.15.93:6838/3364532241,v1:172.21.15.93:6839/3364532241] conn(0x557643f04470 0x557643f06890 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdd18649b80 1 --2- 172.21.15.26:0/938314133 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x557643e9bc80 0x557643ea8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.482 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdd18649b80 1 --2- 172.21.15.26:0/938314133 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x557643e9a600 0x557643ea51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdd18649b80 1 --2- 172.21.15.26:0/938314133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557643e9b300 0x557643ea5720 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdcedffb700 0 client.16023 ms_handle_reset on v2:172.21.15.93:6838/3364532241 2023-12-01T01:06:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdd18649b80 1 -- 172.21.15.26:0/938314133 >> 172.21.15.26:0/938314133 conn(0x557643df70d0 msgr2=0x557643e92850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdd18649b80 1 -- 172.21.15.26:0/938314133 shutdown_connections 2023-12-01T01:06:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdd18649b80 1 -- 172.21.15.26:0/938314133 wait complete. 2023-12-01T01:06:59.483 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.472+0000 7fdd18649b80 20 client.16023 trim_cache size 0 max 16384 2023-12-01T01:06:59.483 INFO:teuthology.orchestra.run.smithi026.stdout:[] 2023-12-01T01:06:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.473+0000 7fdd0c4b9700 1 -- 172.21.15.26:0/3400716627 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdcf00a0520 msgr2=0x7fdcf00a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.473+0000 7fdd0c4b9700 1 --2- 172.21.15.26:0/3400716627 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdcf00a0520 0x7fdcf00a29e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4009be0 tx=0x7fdcf4009260 comp rx=0 tx=0).stop 2023-12-01T01:06:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.473+0000 7fdd0c4b9700 1 -- 172.21.15.26:0/3400716627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd040ff3f0 msgr2=0x7fdd04194a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.473+0000 7fdd0c4b9700 1 --2- 172.21.15.26:0/3400716627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd040ff3f0 0x7fdd04194a60 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000e970 tx=0x7fdd0000ed30 comp rx=0 tx=0).stop 2023-12-01T01:06:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.473+0000 7fdd0c4b9700 1 -- 172.21.15.26:0/3400716627 shutdown_connections 2023-12-01T01:06:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.473+0000 7fdd0c4b9700 1 --2- 172.21.15.26:0/3400716627 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fdcf00a0520 0x7fdcf00a29e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.473+0000 7fdd0c4b9700 1 --2- 172.21.15.26:0/3400716627 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fdd04100f80 0x7fdd0419c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.484 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.473+0000 7fdd0c4b9700 1 --2- 172.21.15.26:0/3400716627 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd040ff3f0 0x7fdd04194a60 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.473+0000 7fdd0c4b9700 1 --2- 172.21.15.26:0/3400716627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fdd041005e0 0x7fdd04194fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.473+0000 7fdd0c4b9700 1 -- 172.21.15.26:0/3400716627 >> 172.21.15.26:0/3400716627 conn(0x7fdd040fa960 msgr2=0x7fdd040fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.473+0000 7fdd0c4b9700 1 -- 172.21.15.26:0/3400716627 shutdown_connections 2023-12-01T01:06:59.485 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.473+0000 7fdd0c4b9700 1 -- 172.21.15.26:0/3400716627 wait complete. 2023-12-01T01:06:59.486 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 58446341, 'ino': 1099511631343, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/notifier.txt'}, {'damage_type': 'backtrace', 'id': 94261605, 'ino': 1099511631331, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/ff.txt'}, {'damage_type': 'backtrace', 'id': 129425733, 'ino': 1099511631888, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/README.cycladesZ'}, {'damage_type': 'backtrace', 'id': 152669321, 'ino': 1099511631347, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/shape.fig'}, {'damage_type': 'backtrace', 'id': 218633739, 'ino': 1099511631316, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/user_verbs.txt'}, {'damage_type': 'backtrace', 'id': 386339953, 'ino': 1099511632264, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/tlb.txt'}, {'damage_type': 'backtrace', 'id': 580970615, 'ino': 1099511632010, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/highres.txt'}, {'damage_type': 'backtrace', 'id': 588528755, 'ino': 1099511631338, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/interactive.fig'}, {'damage_type': 'backtrace', 'id': 610830469, 'ino': 1099511631332, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gamepad.txt'}, {'damage_type': 'backtrace', 'id': 676556634, 'ino': 1099511631098, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/consumer.txt'}, {'damage_type': 'backtrace', 'id': 731962053, 'ino': 1099511632253, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/00-INDEX'}, {'damage_type': 'backtrace', 'id': 750673011, 'ino': 1099511632006, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/.gitignore'}, {'damage_type': 'backtrace', 'id': 754320475, 'ino': 1099511632261, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/intel_mpx.txt'}, {'damage_type': 'backtrace', 'id': 759526491, 'ino': 1099511632273, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/mm.txt'}, {'damage_type': 'backtrace', 'id': 771621714, 'ino': 1099511631324, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/bcm5974.txt'}, {'damage_type': 'backtrace', 'id': 772856660, 'ino': 1099511632013, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hrtimers.txt'}, {'damage_type': 'backtrace', 'id': 789663195, 'ino': 1099511632255, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/early-microcode.txt'}, {'damage_type': 'backtrace', 'id': 906036515, 'ino': 1099511631676, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/nios2/README'}, {'damage_type': 'backtrace', 'id': 997844613, 'ino': 1099511631097, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/board.txt'}, {'damage_type': 'backtrace', 'id': 1005112340, 'ino': 1099511632270, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets'}, {'damage_type': 'backtrace', 'id': 1006618001, 'ino': 1099511631349, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/xpad.txt'}, {'damage_type': 'backtrace', 'id': 1048344162, 'ino': 1099511631350, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/yealink.txt'}, {'damage_type': 'backtrace', 'id': 1054207550, 'ino': 1099511631898, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh/register-banks.txt'}, {'damage_type': 'backtrace', 'id': 1111972834, 'ino': 1099511632254, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/boot.txt'}, {'damage_type': 'backtrace', 'id': 1230654353, 'ino': 1099511631314, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/sysfs.txt'}, {'damage_type': 'backtrace', 'id': 1245848670, 'ino': 1099511631344, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/ntrig.txt'}, {'damage_type': 'backtrace', 'id': 1325531038, 'ino': 1099511632009, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/NO_HZ.txt'}, {'damage_type': 'backtrace', 'id': 1376117736, 'ino': 1099511632012, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hpet_example.c'}, {'damage_type': 'backtrace', 'id': 1392347934, 'ino': 1099511631339, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick-api.txt'}, {'damage_type': 'backtrace', 'id': 1402397272, 'ino': 1099511632007, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/00-INDEX'}, {'damage_type': 'backtrace', 'id': 1407842612, 'ino': 1099511632257, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/entry_64.txt'}, {'damage_type': 'backtrace', 'id': 1411182439, 'ino': 1099511631325, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cd32.txt'}, {'damage_type': 'backtrace', 'id': 1419761617, 'ino': 1099511631321, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/amijoy.txt'}, {'damage_type': 'backtrace', 'id': 1451620687, 'ino': 1099511631345, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/rotary-encoder.txt'}, {'damage_type': 'backtrace', 'id': 1493800365, 'ino': 1099511631329, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/elantech.txt'}, {'damage_type': 'backtrace', 'id': 1633098313, 'ino': 1099511631326, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cma3000_d0x.txt'}, {'damage_type': 'backtrace', 'id': 1712697548, 'ino': 1099511632265, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/usb-legacy-support.txt'}, {'damage_type': 'backtrace', 'id': 1767141053, 'ino': 1099511631323, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/atarikbd.txt'}, {'damage_type': 'backtrace', 'id': 1782323512, 'ino': 1099511632260, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386/IO-APIC.txt'}, {'damage_type': 'backtrace', 'id': 1825797750, 'ino': 1099511631099, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/driver.txt'}, {'damage_type': 'backtrace', 'id': 1925079346, 'ino': 1099511631100, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/gpio-legacy.txt'}, {'damage_type': 'backtrace', 'id': 1947119413, 'ino': 1099511631312, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/core_locking.txt'}, {'damage_type': 'backtrace', 'id': 2030590783, 'ino': 1099511632258, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/exception-tables.txt'}, {'damage_type': 'backtrace', 'id': 2049349982, 'ino': 1099511631893, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/serial-rs485.txt'}, {'damage_type': 'backtrace', 'id': 2115642970, 'ino': 1099511631897, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/sh/new-machine.txt'}, {'damage_type': 'backtrace', 'id': 2191491150, 'ino': 1099511632263, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/pat.txt'}, {'damage_type': 'backtrace', 'id': 2217911882, 'ino': 1099511632272, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/machinecheck'}, {'damage_type': 'backtrace', 'id': 2263465409, 'ino': 1099511631334, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gpio-tilt.txt'}, {'damage_type': 'backtrace', 'id': 2325556636, 'ino': 1099511631342, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/multi-touch-protocol.txt'}, {'damage_type': 'backtrace', 'id': 2419800994, 'ino': 1099511631320, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/alps.txt'}, {'damage_type': 'backtrace', 'id': 2513715216, 'ino': 1099511632256, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/earlyprintk.txt'}, {'damage_type': 'backtrace', 'id': 2579173790, 'ino': 1099511631892, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/rocket.txt'}, {'damage_type': 'backtrace', 'id': 2612133298, 'ino': 1099511631327, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/cs461x.txt'}, {'damage_type': 'backtrace', 'id': 2773321592, 'ino': 1099511631333, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/gameport-programming.txt'}, {'damage_type': 'backtrace', 'id': 2789981648, 'ino': 1099511631887, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/00-INDEX'}, {'damage_type': 'backtrace', 'id': 2801329735, 'ino': 1099511631102, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/sysfs.txt'}, {'damage_type': 'backtrace', 'id': 2814930084, 'ino': 1099511631889, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/driver'}, {'damage_type': 'backtrace', 'id': 2839714955, 'ino': 1099511632014, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timekeeping.txt'}, {'damage_type': 'backtrace', 'id': 2849491351, 'ino': 1099511631313, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/ipoib.txt'}, {'damage_type': 'backtrace', 'id': 2929549835, 'ino': 1099511631348, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/walkera0701.txt'}, {'damage_type': 'backtrace', 'id': 2962986668, 'ino': 1099511631335, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/iforce-protocol.txt'}, {'damage_type': 'backtrace', 'id': 3008294810, 'ino': 1099511632011, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/hpet.txt'}, {'damage_type': 'backtrace', 'id': 3084068900, 'ino': 1099511631346, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/sentelic.txt'}, {'damage_type': 'backtrace', 'id': 3220511958, 'ino': 1099511631096, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/gpio/00-INDEX'}, {'damage_type': 'backtrace', 'id': 3226302381, 'ino': 1099511632275, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/zero-page.txt'}, {'damage_type': 'backtrace', 'id': 3276129160, 'ino': 1099511632016, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timers-howto.txt'}, {'damage_type': 'backtrace', 'id': 3316666558, 'ino': 1099511631894, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/tty.txt'}, {'damage_type': 'backtrace', 'id': 3332334209, 'ino': 1099511631336, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/input-programming.txt'}, {'damage_type': 'backtrace', 'id': 3393213677, 'ino': 1099511632268, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/boot-options.txt'}, {'damage_type': 'backtrace', 'id': 3409965248, 'ino': 1099511632266, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64'}, {'damage_type': 'backtrace', 'id': 3416350924, 'ino': 1099511631315, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/infiniband/user_mad.txt'}, {'damage_type': 'backtrace', 'id': 3472716653, 'ino': 1099511631322, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/appletouch.txt'}, {'damage_type': 'backtrace', 'id': 3500524853, 'ino': 1099511632274, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/uefi.txt'}, {'damage_type': 'backtrace', 'id': 3590694870, 'ino': 1099511632015, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/timer_stats.txt'}, {'damage_type': 'backtrace', 'id': 3735876049, 'ino': 1099511632008, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/timers/Makefile'}, {'damage_type': 'backtrace', 'id': 3786673785, 'ino': 1099511631330, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/event-codes.txt'}, {'damage_type': 'backtrace', 'id': 3794341028, 'ino': 1099511632271, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/kernel-stacks'}, {'damage_type': 'backtrace', 'id': 3852195355, 'ino': 1099511632269, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec'}, {'damage_type': 'backtrace', 'id': 3917174253, 'ino': 1099511631341, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick.txt'}, {'damage_type': 'backtrace', 'id': 3943859548, 'ino': 1099511631891, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/n_gsm.txt'}, {'damage_type': 'backtrace', 'id': 4014504487, 'ino': 1099511632262, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/mtrr.txt'}, {'damage_type': 'backtrace', 'id': 4014689811, 'ino': 1099511631328, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/edt-ft5x06.txt'}, {'damage_type': 'backtrace', 'id': 4128071133, 'ino': 1099511631337, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/input.txt'}, {'damage_type': 'backtrace', 'id': 4196721339, 'ino': 1099511631340, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/input/joystick-parport.txt'}, {'damage_type': 'backtrace', 'id': 4217959207, 'ino': 1099511632259, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/i386'}, {'damage_type': 'backtrace', 'id': 4234958974, 'ino': 1099511632267, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/x86/x86_64/00-INDEX'}, {'damage_type': 'backtrace', 'id': 4237821154, 'ino': 1099511631890, 'path': '/volumes/_nogroup/sv_1/1269805c-0108-4654-9485-1af971b31c50/client.0/tmp/untar_tar/linux-4.0.5/Documentation/serial/moxa-smartio'}] 2023-12-01T01:06:59.486 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2023-12-01T01:06:59.487 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/github.com_ceph_ceph-c_a6f82997ac57b70a895455dfed6256360a1e4c32/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-12-01T01:06:59.487 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-12-01T01:06:59.498 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:06:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.624+0000 7fca9b4bb700 1 -- 172.21.15.26:0/1564951778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca941041e0 msgr2=0x7fca941065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.627 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.624+0000 7fca9b4bb700 1 --2- 172.21.15.26:0/1564951778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca941041e0 0x7fca941065d0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fca84009990 tx=0x7fca84009ca0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.624+0000 7fca9b4bb700 1 -- 172.21.15.26:0/1564951778 shutdown_connections 2023-12-01T01:06:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.624+0000 7fca9b4bb700 1 --2- 172.21.15.26:0/1564951778 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca94106b10 0x7fca94108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.624+0000 7fca9b4bb700 1 --2- 172.21.15.26:0/1564951778 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca941018b0 0x7fca94103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.624+0000 7fca9b4bb700 1 --2- 172.21.15.26:0/1564951778 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca941041e0 0x7fca941065d0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.624+0000 7fca9b4bb700 1 -- 172.21.15.26:0/1564951778 >> 172.21.15.26:0/1564951778 conn(0x7fca940fb220 msgr2=0x7fca940fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.624+0000 7fca9b4bb700 1 -- 172.21.15.26:0/1564951778 shutdown_connections 2023-12-01T01:06:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.624+0000 7fca9b4bb700 1 -- 172.21.15.26:0/1564951778 wait complete. 2023-12-01T01:06:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca9b4bb700 1 Processor -- start 2023-12-01T01:06:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca9b4bb700 1 -- start start 2023-12-01T01:06:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca9b4bb700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca941018b0 0x7fca94196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca9b4bb700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca941041e0 0x7fca94196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca9b4bb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca94106b10 0x7fca9419dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca9b4bb700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9419e5b0 con 0x7fca941018b0 2023-12-01T01:06:59.628 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca9b4bb700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9419e6f0 con 0x7fca94106b10 2023-12-01T01:06:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca9b4bb700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9419e880 con 0x7fca941041e0 2023-12-01T01:06:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca99257700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca941018b0 0x7fca94196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca99257700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca941018b0 0x7fca94196a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56700/0 (socket says 172.21.15.26:56700) 2023-12-01T01:06:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca99257700 1 -- 172.21.15.26:0/3972889048 learned_addr learned my addr 172.21.15.26:0/3972889048 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca99a58700 1 --2- 172.21.15.26:0/3972889048 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca94106b10 0x7fca9419dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca98a56700 1 --2- 172.21.15.26:0/3972889048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca941041e0 0x7fca94196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca99257700 1 -- 172.21.15.26:0/3972889048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca941041e0 msgr2=0x7fca94196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca99257700 1 --2- 172.21.15.26:0/3972889048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca941041e0 0x7fca94196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca99257700 1 -- 172.21.15.26:0/3972889048 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca94106b10 msgr2=0x7fca9419dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca99257700 1 --2- 172.21.15.26:0/3972889048 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca94106b10 0x7fca9419dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca99257700 1 -- 172.21.15.26:0/3972889048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca840095f0 con 0x7fca941018b0 2023-12-01T01:06:59.629 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca99a58700 1 --2- 172.21.15.26:0/3972889048 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca94106b10 0x7fca9419dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:06:59.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.625+0000 7fca99257700 1 --2- 172.21.15.26:0/3972889048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca941018b0 0x7fca94196a30 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fca9000e9a0 tx=0x7fca9000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.626+0000 7fca8a7fc700 1 -- 172.21.15.26:0/3972889048 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca90009790 con 0x7fca941018b0 2023-12-01T01:06:59.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.626+0000 7fca9b4bb700 1 -- 172.21.15.26:0/3972889048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9419eb60 con 0x7fca941018b0 2023-12-01T01:06:59.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.626+0000 7fca8a7fc700 1 -- 172.21.15.26:0/3972889048 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fca9000cbd0 con 0x7fca941018b0 2023-12-01T01:06:59.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.626+0000 7fca8a7fc700 1 -- 172.21.15.26:0/3972889048 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca90018730 con 0x7fca941018b0 2023-12-01T01:06:59.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.626+0000 7fca9b4bb700 1 -- 172.21.15.26:0/3972889048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9419f070 con 0x7fca941018b0 2023-12-01T01:06:59.630 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.626+0000 7fca9b4bb700 1 -- 172.21.15.26:0/3972889048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca940fcda0 con 0x7fca941018b0 2023-12-01T01:06:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.628+0000 7fca8a7fc700 1 -- 172.21.15.26:0/3972889048 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fca90010430 con 0x7fca941018b0 2023-12-01T01:06:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.628+0000 7fca8a7fc700 1 --2- 172.21.15.26:0/3972889048 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fca800a0570 0x7fca800a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.629+0000 7fca8a7fc700 1 -- 172.21.15.26:0/3972889048 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fca90014070 con 0x7fca941018b0 2023-12-01T01:06:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.629+0000 7fca98a56700 1 --2- 172.21.15.26:0/3972889048 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fca800a0570 0x7fca800a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.631 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.629+0000 7fca98a56700 1 --2- 172.21.15.26:0/3972889048 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fca800a0570 0x7fca800a2a30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fca84006010 tx=0x7fca8400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.633 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.632+0000 7fca8a7fc700 1 -- 172.21.15.26:0/3972889048 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fca90095ca0 con 0x7fca941018b0 2023-12-01T01:06:59.842 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.841+0000 7fca9b4bb700 1 -- 172.21.15.26:0/3972889048 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca9402cc70 con 0x7fca941018b0 2023-12-01T01:06:59.843 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.843+0000 7fca8a7fc700 1 -- 172.21.15.26:0/3972889048 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22481 (secure 0 0 0) 0x7fca900992c0 con 0x7fca941018b0 2023-12-01T01:06:59.844 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:06:59.844 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":84,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:05:53.540747+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:06:59.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.845+0000 7fca9b4bb700 1 -- 172.21.15.26:0/3972889048 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fca800a0570 msgr2=0x7fca800a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.845+0000 7fca9b4bb700 1 --2- 172.21.15.26:0/3972889048 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fca800a0570 0x7fca800a2a30 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fca84006010 tx=0x7fca8400b260 comp rx=0 tx=0).stop 2023-12-01T01:06:59.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.845+0000 7fca9b4bb700 1 -- 172.21.15.26:0/3972889048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca941018b0 msgr2=0x7fca94196a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.845+0000 7fca9b4bb700 1 --2- 172.21.15.26:0/3972889048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca941018b0 0x7fca94196a30 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fca9000e9a0 tx=0x7fca9000ed60 comp rx=0 tx=0).stop 2023-12-01T01:06:59.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.845+0000 7fca9b4bb700 1 -- 172.21.15.26:0/3972889048 shutdown_connections 2023-12-01T01:06:59.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.845+0000 7fca9b4bb700 1 --2- 172.21.15.26:0/3972889048 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fca800a0570 0x7fca800a2a30 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.845+0000 7fca9b4bb700 1 --2- 172.21.15.26:0/3972889048 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fca94106b10 0x7fca9419dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.846 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.845+0000 7fca9b4bb700 1 --2- 172.21.15.26:0/3972889048 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fca941018b0 0x7fca94196a30 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.845+0000 7fca9b4bb700 1 --2- 172.21.15.26:0/3972889048 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fca941041e0 0x7fca94196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.845+0000 7fca9b4bb700 1 -- 172.21.15.26:0/3972889048 >> 172.21.15.26:0/3972889048 conn(0x7fca940fb220 msgr2=0x7fca94102520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.845+0000 7fca9b4bb700 1 -- 172.21.15.26:0/3972889048 shutdown_connections 2023-12-01T01:06:59.847 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.845+0000 7fca9b4bb700 1 -- 172.21.15.26:0/3972889048 wait complete. 2023-12-01T01:06:59.859 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T00:59:06.411348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T01:02:45.762784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T01:02:46.638998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T01:06:59.859 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T01:06:59.991 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.988+0000 7f3e48776700 1 -- 172.21.15.26:0/2706601305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e40100e70 msgr2=0x7f3e401012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.988+0000 7f3e48776700 1 --2- 172.21.15.26:0/2706601305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e40100e70 0x7f3e401012d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0099c0 tx=0x7f3e3c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.988+0000 7f3e48776700 1 -- 172.21.15.26:0/2706601305 shutdown_connections 2023-12-01T01:06:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.988+0000 7f3e48776700 1 --2- 172.21.15.26:0/2706601305 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e40101810 0x7f3e401080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.988+0000 7f3e48776700 1 --2- 172.21.15.26:0/2706601305 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e400ffc80 0x7f3e401000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.988+0000 7f3e48776700 1 --2- 172.21.15.26:0/2706601305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e40100e70 0x7f3e401012d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.988+0000 7f3e48776700 1 -- 172.21.15.26:0/2706601305 >> 172.21.15.26:0/2706601305 conn(0x7f3e400fb1f0 msgr2=0x7f3e400fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:06:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.988+0000 7f3e48776700 1 -- 172.21.15.26:0/2706601305 shutdown_connections 2023-12-01T01:06:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.988+0000 7f3e48776700 1 -- 172.21.15.26:0/2706601305 wait complete. 2023-12-01T01:06:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e48776700 1 Processor -- start 2023-12-01T01:06:59.992 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e48776700 1 -- start start 2023-12-01T01:06:59.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e48776700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e400ffc80 0x7f3e40068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e48776700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e40100e70 0x7f3e4019b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e48776700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e40101810 0x7f3e4019df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e48776700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4019e6f0 con 0x7f3e400ffc80 2023-12-01T01:06:59.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e48776700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4019e860 con 0x7f3e40100e70 2023-12-01T01:06:59.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e48776700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e4019ea20 con 0x7f3e40101810 2023-12-01T01:06:59.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e46512700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e400ffc80 0x7f3e40068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e46512700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e400ffc80 0x7f3e40068a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56714/0 (socket says 172.21.15.26:56714) 2023-12-01T01:06:59.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e46512700 1 -- 172.21.15.26:0/2352785470 learned_addr learned my addr 172.21.15.26:0/2352785470 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:06:59.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e45d11700 1 --2- 172.21.15.26:0/2352785470 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e40100e70 0x7f3e4019b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.993 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e46d13700 1 --2- 172.21.15.26:0/2352785470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e40101810 0x7f3e4019df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e46512700 1 -- 172.21.15.26:0/2352785470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e40101810 msgr2=0x7f3e4019df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e46512700 1 --2- 172.21.15.26:0/2352785470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e40101810 0x7f3e4019df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e46512700 1 -- 172.21.15.26:0/2352785470 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e40100e70 msgr2=0x7f3e4019b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:06:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e46512700 1 --2- 172.21.15.26:0/2352785470 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e40100e70 0x7f3e4019b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:06:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e46512700 1 -- 172.21.15.26:0/2352785470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c0095f0 con 0x7f3e400ffc80 2023-12-01T01:06:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e46d13700 1 --2- 172.21.15.26:0/2352785470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e40101810 0x7f3e4019df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:06:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e45d11700 1 --2- 172.21.15.26:0/2352785470 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e40100e70 0x7f3e4019b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:06:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e46512700 1 --2- 172.21.15.26:0/2352785470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e400ffc80 0x7f3e40068a60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400d980 tx=0x7f3e3400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.994 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.989+0000 7f3e337fe700 1 -- 172.21.15.26:0/2352785470 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400bb60 con 0x7f3e400ffc80 2023-12-01T01:06:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.990+0000 7f3e337fe700 1 -- 172.21.15.26:0/2352785470 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f3e34007620 con 0x7f3e400ffc80 2023-12-01T01:06:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.990+0000 7f3e48776700 1 -- 172.21.15.26:0/2352785470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e4019ed00 con 0x7f3e400ffc80 2023-12-01T01:06:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.990+0000 7f3e337fe700 1 -- 172.21.15.26:0/2352785470 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400f620 con 0x7f3e400ffc80 2023-12-01T01:06:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.990+0000 7f3e48776700 1 -- 172.21.15.26:0/2352785470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e4019f1c0 con 0x7f3e400ffc80 2023-12-01T01:06:59.995 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.990+0000 7f3e48776700 1 -- 172.21.15.26:0/2352785470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e4010b620 con 0x7f3e400ffc80 2023-12-01T01:06:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.992+0000 7f3e337fe700 1 -- 172.21.15.26:0/2352785470 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f3e34010460 con 0x7f3e400ffc80 2023-12-01T01:06:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.992+0000 7f3e337fe700 1 --2- 172.21.15.26:0/2352785470 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3e2c0a0520 0x7f3e2c0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:06:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.993+0000 7f3e337fe700 1 -- 172.21.15.26:0/2352785470 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f3e340cc170 con 0x7f3e400ffc80 2023-12-01T01:06:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.993+0000 7f3e45d11700 1 --2- 172.21.15.26:0/2352785470 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3e2c0a0520 0x7f3e2c0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:06:59.996 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.993+0000 7f3e45d11700 1 --2- 172.21.15.26:0/2352785470 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3e2c0a0520 0x7f3e2c0a29e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0098e0 tx=0x7f3e3c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:06:59.997 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:06:59.997+0000 7f3e337fe700 1 -- 172.21.15.26:0/2352785470 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3e34095d20 con 0x7f3e400ffc80 2023-12-01T01:07:00.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:59 smithi116 ceph-mon[103554]: pgmap v374: 97 pgs: 97 active+clean; 53 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 378 KiB/s wr, 121 op/s 2023-12-01T01:07:00.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:06:59 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1577164075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:07:00.200 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.199+0000 7f3e48776700 1 -- 172.21.15.26:0/2352785470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e40106b60 con 0x7f3e400ffc80 2023-12-01T01:07:00.201 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.200+0000 7f3e337fe700 1 -- 172.21.15.26:0/2352785470 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3e3400de60 con 0x7f3e400ffc80 2023-12-01T01:07:00.201 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-12-01T01:07:00.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.202+0000 7f3e48776700 1 -- 172.21.15.26:0/2352785470 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3e2c0a0520 msgr2=0x7f3e2c0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:00.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.202+0000 7f3e48776700 1 --2- 172.21.15.26:0/2352785470 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3e2c0a0520 0x7f3e2c0a29e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c0098e0 tx=0x7f3e3c000bc0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.202+0000 7f3e48776700 1 -- 172.21.15.26:0/2352785470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e400ffc80 msgr2=0x7f3e40068a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.202+0000 7f3e48776700 1 --2- 172.21.15.26:0/2352785470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e400ffc80 0x7f3e40068a60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400d980 tx=0x7f3e3400dd40 comp rx=0 tx=0).stop 2023-12-01T01:07:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.202+0000 7f3e48776700 1 -- 172.21.15.26:0/2352785470 shutdown_connections 2023-12-01T01:07:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.202+0000 7f3e48776700 1 --2- 172.21.15.26:0/2352785470 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f3e2c0a0520 0x7f3e2c0a29e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.202+0000 7f3e48776700 1 --2- 172.21.15.26:0/2352785470 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f3e40101810 0x7f3e4019df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.202+0000 7f3e48776700 1 --2- 172.21.15.26:0/2352785470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e400ffc80 0x7f3e40068a60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.202+0000 7f3e48776700 1 --2- 172.21.15.26:0/2352785470 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e40100e70 0x7f3e4019b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.202+0000 7f3e48776700 1 -- 172.21.15.26:0/2352785470 >> 172.21.15.26:0/2352785470 conn(0x7f3e400fb1f0 msgr2=0x7f3e400fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.202+0000 7f3e48776700 1 -- 172.21.15.26:0/2352785470 shutdown_connections 2023-12-01T01:07:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.202+0000 7f3e48776700 1 -- 172.21.15.26:0/2352785470 wait complete. 2023-12-01T01:07:00.214 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:59 smithi026 ceph-mon[98801]: pgmap v374: 97 pgs: 97 active+clean; 53 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 378 KiB/s wr, 121 op/s 2023-12-01T01:07:00.214 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:06:59 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1577164075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:07:00.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:59 smithi093 ceph-mon[103327]: pgmap v374: 97 pgs: 97 active+clean; 53 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 469 KiB/s rd, 378 KiB/s wr, 121 op/s 2023-12-01T01:07:00.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:06:59 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1577164075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:07:00.216 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T01:07:00.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.343+0000 7efc3989d700 1 -- 172.21.15.26:0/3334170377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc34101810 msgr2=0x7efc341080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:00.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.343+0000 7efc3989d700 1 --2- 172.21.15.26:0/3334170377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc34101810 0x7efc341080c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00b0d0 tx=0x7efc2c00b3e0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.343+0000 7efc3989d700 1 -- 172.21.15.26:0/3334170377 shutdown_connections 2023-12-01T01:07:00.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.343+0000 7efc3989d700 1 --2- 172.21.15.26:0/3334170377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc34101810 0x7efc341080c0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.343+0000 7efc3989d700 1 --2- 172.21.15.26:0/3334170377 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc340ffc80 0x7efc341000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.343+0000 7efc3989d700 1 --2- 172.21.15.26:0/3334170377 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc34100e70 0x7efc341012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.343+0000 7efc3989d700 1 -- 172.21.15.26:0/3334170377 >> 172.21.15.26:0/3334170377 conn(0x7efc340fb1f0 msgr2=0x7efc340fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:00.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.343+0000 7efc3989d700 1 -- 172.21.15.26:0/3334170377 shutdown_connections 2023-12-01T01:07:00.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.343+0000 7efc3989d700 1 -- 172.21.15.26:0/3334170377 wait complete. 2023-12-01T01:07:00.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.344+0000 7efc3989d700 1 Processor -- start 2023-12-01T01:07:00.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.344+0000 7efc3989d700 1 -- start start 2023-12-01T01:07:00.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.344+0000 7efc3989d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc340ffc80 0x7efc34195b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:00.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.344+0000 7efc3989d700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc34100e70 0x7efc34196080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:00.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.344+0000 7efc3989d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc34101810 0x7efc3419d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:00.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.344+0000 7efc3989d700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3419d6c0 con 0x7efc34101810 2023-12-01T01:07:00.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.344+0000 7efc3989d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3419d800 con 0x7efc340ffc80 2023-12-01T01:07:00.347 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.344+0000 7efc3989d700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3419d990 con 0x7efc34100e70 2023-12-01T01:07:00.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.345+0000 7efc337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc34101810 0x7efc3419d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:00.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.345+0000 7efc337fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc34101810 0x7efc3419d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56732/0 (socket says 172.21.15.26:56732) 2023-12-01T01:07:00.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.345+0000 7efc337fe700 1 -- 172.21.15.26:0/3553144544 learned_addr learned my addr 172.21.15.26:0/3553144544 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:07:00.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.345+0000 7efc327fc700 1 --2- 172.21.15.26:0/3553144544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc34100e70 0x7efc34196080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:00.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.345+0000 7efc32ffd700 1 --2- 172.21.15.26:0/3553144544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc340ffc80 0x7efc34195b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:00.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.345+0000 7efc337fe700 1 -- 172.21.15.26:0/3553144544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc34100e70 msgr2=0x7efc34196080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:00.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.345+0000 7efc337fe700 1 --2- 172.21.15.26:0/3553144544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc34100e70 0x7efc34196080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.345+0000 7efc337fe700 1 -- 172.21.15.26:0/3553144544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc340ffc80 msgr2=0x7efc34195b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:00.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.345+0000 7efc337fe700 1 --2- 172.21.15.26:0/3553144544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc340ffc80 0x7efc34195b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.345+0000 7efc337fe700 1 -- 172.21.15.26:0/3553144544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c009d00 con 0x7efc34101810 2023-12-01T01:07:00.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.345+0000 7efc337fe700 1 --2- 172.21.15.26:0/3553144544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc34101810 0x7efc3419d0f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00d010 tx=0x7efc2c00bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:00.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.345+0000 7efc3889b700 1 -- 172.21.15.26:0/3553144544 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c00e040 con 0x7efc34101810 2023-12-01T01:07:00.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.345+0000 7efc3989d700 1 -- 172.21.15.26:0/3553144544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3419dc10 con 0x7efc34101810 2023-12-01T01:07:00.348 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.345+0000 7efc3889b700 1 -- 172.21.15.26:0/3553144544 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7efc2c012e60 con 0x7efc34101810 2023-12-01T01:07:00.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.345+0000 7efc3889b700 1 -- 172.21.15.26:0/3553144544 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c01b450 con 0x7efc34101810 2023-12-01T01:07:00.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.345+0000 7efc3989d700 1 -- 172.21.15.26:0/3553144544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3419e0e0 con 0x7efc34101810 2023-12-01T01:07:00.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.346+0000 7efc3989d700 1 -- 172.21.15.26:0/3553144544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3410b5e0 con 0x7efc34101810 2023-12-01T01:07:00.349 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.347+0000 7efc3889b700 1 -- 172.21.15.26:0/3553144544 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7efc2c012980 con 0x7efc34101810 2023-12-01T01:07:00.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.348+0000 7efc3889b700 1 --2- 172.21.15.26:0/3553144544 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efc1c0a0520 0x7efc1c0a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:00.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.348+0000 7efc32ffd700 1 --2- 172.21.15.26:0/3553144544 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efc1c0a0520 0x7efc1c0a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:00.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.348+0000 7efc3889b700 1 -- 172.21.15.26:0/3553144544 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7efc2c0cd640 con 0x7efc34101810 2023-12-01T01:07:00.350 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.349+0000 7efc32ffd700 1 --2- 172.21.15.26:0/3553144544 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efc1c0a0520 0x7efc1c0a29e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efc24005950 tx=0x7efc240058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:00.353 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.352+0000 7efc3889b700 1 -- 172.21.15.26:0/3553144544 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7efc2c097280 con 0x7efc34101810 2023-12-01T01:07:00.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.558+0000 7efc3989d700 1 -- 172.21.15.26:0/3553144544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efc34106b10 con 0x7efc34101810 2023-12-01T01:07:00.559 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.558+0000 7efc3889b700 1 -- 172.21.15.26:0/3553144544 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7efc2c09a8a0 con 0x7efc34101810 2023-12-01T01:07:00.559 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-12-01T01:07:00.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.560+0000 7efc3989d700 1 -- 172.21.15.26:0/3553144544 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efc1c0a0520 msgr2=0x7efc1c0a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:00.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.560+0000 7efc3989d700 1 --2- 172.21.15.26:0/3553144544 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efc1c0a0520 0x7efc1c0a29e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7efc24005950 tx=0x7efc240058e0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.561 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.560+0000 7efc3989d700 1 -- 172.21.15.26:0/3553144544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc34101810 msgr2=0x7efc3419d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:00.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.560+0000 7efc3989d700 1 --2- 172.21.15.26:0/3553144544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc34101810 0x7efc3419d0f0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7efc2c00d010 tx=0x7efc2c00bdc0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.560+0000 7efc3989d700 1 -- 172.21.15.26:0/3553144544 shutdown_connections 2023-12-01T01:07:00.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.560+0000 7efc3989d700 1 --2- 172.21.15.26:0/3553144544 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7efc1c0a0520 0x7efc1c0a29e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.560+0000 7efc3989d700 1 --2- 172.21.15.26:0/3553144544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efc34101810 0x7efc3419d0f0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.560+0000 7efc3989d700 1 --2- 172.21.15.26:0/3553144544 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7efc340ffc80 0x7efc34195b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.560+0000 7efc3989d700 1 --2- 172.21.15.26:0/3553144544 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7efc34100e70 0x7efc34196080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.560+0000 7efc3989d700 1 -- 172.21.15.26:0/3553144544 >> 172.21.15.26:0/3553144544 conn(0x7efc340fb1f0 msgr2=0x7efc340fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:00.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.560+0000 7efc3989d700 1 -- 172.21.15.26:0/3553144544 shutdown_connections 2023-12-01T01:07:00.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.560+0000 7efc3989d700 1 -- 172.21.15.26:0/3553144544 wait complete. 2023-12-01T01:07:00.574 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T01:07:00.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.701+0000 7fed83615700 1 -- 172.21.15.26:0/3190088871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c106a60 msgr2=0x7fed7c108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:00.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.701+0000 7fed83615700 1 --2- 172.21.15.26:0/3190088871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c106a60 0x7fed7c108ed0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fed7400b0a0 tx=0x7fed7400b3b0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.701+0000 7fed83615700 1 -- 172.21.15.26:0/3190088871 shutdown_connections 2023-12-01T01:07:00.704 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.701+0000 7fed83615700 1 --2- 172.21.15.26:0/3190088871 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c106a60 0x7fed7c108ed0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.701+0000 7fed83615700 1 --2- 172.21.15.26:0/3190088871 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed7c101800 0x7fed7c103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.701+0000 7fed83615700 1 --2- 172.21.15.26:0/3190088871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed7c104130 0x7fed7c106520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.701+0000 7fed83615700 1 -- 172.21.15.26:0/3190088871 >> 172.21.15.26:0/3190088871 conn(0x7fed7c0fb1f0 msgr2=0x7fed7c0fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.701+0000 7fed83615700 1 -- 172.21.15.26:0/3190088871 shutdown_connections 2023-12-01T01:07:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.701+0000 7fed83615700 1 -- 172.21.15.26:0/3190088871 wait complete. 2023-12-01T01:07:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed83615700 1 Processor -- start 2023-12-01T01:07:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed83615700 1 -- start start 2023-12-01T01:07:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed83615700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c101800 0x7fed7c196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed83615700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed7c104130 0x7fed7c197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed83615700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed7c106a60 0x7fed7c19e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed83615700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c19e780 con 0x7fed7c101800 2023-12-01T01:07:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed83615700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c19e8f0 con 0x7fed7c104130 2023-12-01T01:07:00.705 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed83615700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c19eab0 con 0x7fed7c106a60 2023-12-01T01:07:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed813b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c101800 0x7fed7c196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed813b1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c101800 0x7fed7c196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56742/0 (socket says 172.21.15.26:56742) 2023-12-01T01:07:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed813b1700 1 -- 172.21.15.26:0/1961742505 learned_addr learned my addr 172.21.15.26:0/1961742505 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:07:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed80bb0700 1 --2- 172.21.15.26:0/1961742505 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed7c104130 0x7fed7c197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed81bb2700 1 --2- 172.21.15.26:0/1961742505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed7c106a60 0x7fed7c19e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed813b1700 1 -- 172.21.15.26:0/1961742505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed7c106a60 msgr2=0x7fed7c19e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed813b1700 1 --2- 172.21.15.26:0/1961742505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed7c106a60 0x7fed7c19e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed813b1700 1 -- 172.21.15.26:0/1961742505 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed7c104130 msgr2=0x7fed7c197180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed813b1700 1 --2- 172.21.15.26:0/1961742505 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed7c104130 0x7fed7c197180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed813b1700 1 -- 172.21.15.26:0/1961742505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed74009d00 con 0x7fed7c101800 2023-12-01T01:07:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.702+0000 7fed813b1700 1 --2- 172.21.15.26:0/1961742505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c101800 0x7fed7c196c40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fed7000d980 tx=0x7fed7000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:00.706 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.703+0000 7fed6e7fc700 1 -- 172.21.15.26:0/1961742505 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7000bb60 con 0x7fed7c101800 2023-12-01T01:07:00.709 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.703+0000 7fed6e7fc700 1 -- 172.21.15.26:0/1961742505 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fed70007640 con 0x7fed7c101800 2023-12-01T01:07:00.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.703+0000 7fed83615700 1 -- 172.21.15.26:0/1961742505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7c19ed90 con 0x7fed7c101800 2023-12-01T01:07:00.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.703+0000 7fed6e7fc700 1 -- 172.21.15.26:0/1961742505 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed70005020 con 0x7fed7c101800 2023-12-01T01:07:00.710 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.703+0000 7fed83615700 1 -- 172.21.15.26:0/1961742505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7c19f1e0 con 0x7fed7c101800 2023-12-01T01:07:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.704+0000 7fed83615700 1 -- 172.21.15.26:0/1961742505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7c0fcd70 con 0x7fed7c101800 2023-12-01T01:07:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.705+0000 7fed6e7fc700 1 -- 172.21.15.26:0/1961742505 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fed70004020 con 0x7fed7c101800 2023-12-01T01:07:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.705+0000 7fed6e7fc700 1 --2- 172.21.15.26:0/1961742505 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fed680a0520 0x7fed680a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.705+0000 7fed6e7fc700 1 -- 172.21.15.26:0/1961742505 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fed700cbd70 con 0x7fed7c101800 2023-12-01T01:07:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.705+0000 7fed80bb0700 1 --2- 172.21.15.26:0/1961742505 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fed680a0520 0x7fed680a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.706+0000 7fed80bb0700 1 --2- 172.21.15.26:0/1961742505 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fed680a0520 0x7fed680a29e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fed7800dad0 tx=0x7fed7800d4b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:00.711 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.708+0000 7fed6e7fc700 1 -- 172.21.15.26:0/1961742505 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fed70095920 con 0x7fed7c101800 2023-12-01T01:07:00.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.908+0000 7fed83615700 1 -- 172.21.15.26:0/1961742505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fed7c02cee0 con 0x7fed7c101800 2023-12-01T01:07:00.909 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.908+0000 7fed6e7fc700 1 -- 172.21.15.26:0/1961742505 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7fed70016020 con 0x7fed7c101800 2023-12-01T01:07:00.910 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-12-01T01:07:00.913 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.911+0000 7fed83615700 1 -- 172.21.15.26:0/1961742505 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fed680a0520 msgr2=0x7fed680a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.911+0000 7fed83615700 1 --2- 172.21.15.26:0/1961742505 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fed680a0520 0x7fed680a29e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fed7800dad0 tx=0x7fed7800d4b0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.911+0000 7fed83615700 1 -- 172.21.15.26:0/1961742505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c101800 msgr2=0x7fed7c196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.911+0000 7fed83615700 1 --2- 172.21.15.26:0/1961742505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c101800 0x7fed7c196c40 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fed7000d980 tx=0x7fed7000dd40 comp rx=0 tx=0).stop 2023-12-01T01:07:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.911+0000 7fed83615700 1 -- 172.21.15.26:0/1961742505 shutdown_connections 2023-12-01T01:07:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.911+0000 7fed83615700 1 --2- 172.21.15.26:0/1961742505 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fed680a0520 0x7fed680a29e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.911+0000 7fed83615700 1 --2- 172.21.15.26:0/1961742505 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fed7c106a60 0x7fed7c19e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.911+0000 7fed83615700 1 --2- 172.21.15.26:0/1961742505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed7c101800 0x7fed7c196c40 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.911+0000 7fed83615700 1 --2- 172.21.15.26:0/1961742505 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed7c104130 0x7fed7c197180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.911+0000 7fed83615700 1 -- 172.21.15.26:0/1961742505 >> 172.21.15.26:0/1961742505 conn(0x7fed7c0fb1f0 msgr2=0x7fed7c102490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.911+0000 7fed83615700 1 -- 172.21.15.26:0/1961742505 shutdown_connections 2023-12-01T01:07:00.914 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:00.911+0000 7fed83615700 1 -- 172.21.15.26:0/1961742505 wait complete. 2023-12-01T01:07:00.923 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:00 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3972889048' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:07:00.923 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:00 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2352785470' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:07:00.923 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:00 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3553144544' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:07:00.924 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-12-01T01:07:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.051+0000 7fde1be65700 1 -- 172.21.15.26:0/167178526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde140fff70 msgr2=0x7fde141003f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.051+0000 7fde1be65700 1 --2- 172.21.15.26:0/167178526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde140fff70 0x7fde141003f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fde04009990 tx=0x7fde04009ca0 comp rx=0 tx=0).stop 2023-12-01T01:07:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.051+0000 7fde1be65700 1 -- 172.21.15.26:0/167178526 shutdown_connections 2023-12-01T01:07:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.051+0000 7fde1be65700 1 --2- 172.21.15.26:0/167178526 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde14100930 0x7fde14100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.051+0000 7fde1be65700 1 --2- 172.21.15.26:0/167178526 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde140ff610 0x7fde140ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.051+0000 7fde1be65700 1 --2- 172.21.15.26:0/167178526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde140fff70 0x7fde141003f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.051+0000 7fde1be65700 1 -- 172.21.15.26:0/167178526 >> 172.21.15.26:0/167178526 conn(0x7fde140fb210 msgr2=0x7fde140fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.051+0000 7fde1be65700 1 -- 172.21.15.26:0/167178526 shutdown_connections 2023-12-01T01:07:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.051+0000 7fde1be65700 1 -- 172.21.15.26:0/167178526 wait complete. 2023-12-01T01:07:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde1be65700 1 Processor -- start 2023-12-01T01:07:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde1be65700 1 -- start start 2023-12-01T01:07:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde1be65700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde140ff610 0x7fde14198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde1be65700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde140fff70 0x7fde141991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde1be65700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde14100930 0x7fde141a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde1be65700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde141a07e0 con 0x7fde14100930 2023-12-01T01:07:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde1be65700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde141a0950 con 0x7fde140fff70 2023-12-01T01:07:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde1be65700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde141a0b10 con 0x7fde140ff610 2023-12-01T01:07:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde1a402700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde14100930 0x7fde141a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde1a402700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde14100930 0x7fde141a0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56760/0 (socket says 172.21.15.26:56760) 2023-12-01T01:07:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde1a402700 1 -- 172.21.15.26:0/2581002276 learned_addr learned my addr 172.21.15.26:0/2581002276 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:07:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde19400700 1 --2- 172.21.15.26:0/2581002276 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde140fff70 0x7fde141991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde19c01700 1 --2- 172.21.15.26:0/2581002276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde140ff610 0x7fde14198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde1a402700 1 -- 172.21.15.26:0/2581002276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde140ff610 msgr2=0x7fde14198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde1a402700 1 --2- 172.21.15.26:0/2581002276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde140ff610 0x7fde14198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde1a402700 1 -- 172.21.15.26:0/2581002276 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde140fff70 msgr2=0x7fde141991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde1a402700 1 --2- 172.21.15.26:0/2581002276 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde140fff70 0x7fde141991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.052+0000 7fde1a402700 1 -- 172.21.15.26:0/2581002276 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde040095f0 con 0x7fde14100930 2023-12-01T01:07:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.053+0000 7fde1a402700 1 --2- 172.21.15.26:0/2581002276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde14100930 0x7fde141a0210 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fde0c007ee0 tx=0x7fde0c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.053+0000 7fde0affd700 1 -- 172.21.15.26:0/2581002276 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0c017070 con 0x7fde14100930 2023-12-01T01:07:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.053+0000 7fde0affd700 1 -- 172.21.15.26:0/2581002276 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fde0c00f040 con 0x7fde14100930 2023-12-01T01:07:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.053+0000 7fde1be65700 1 -- 172.21.15.26:0/2581002276 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde141a0df0 con 0x7fde14100930 2023-12-01T01:07:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.053+0000 7fde0affd700 1 -- 172.21.15.26:0/2581002276 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0c005740 con 0x7fde14100930 2023-12-01T01:07:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.053+0000 7fde1be65700 1 -- 172.21.15.26:0/2581002276 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde141a1220 con 0x7fde14100930 2023-12-01T01:07:01.057 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.054+0000 7fde1be65700 1 -- 172.21.15.26:0/2581002276 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde1410a3f0 con 0x7fde14100930 2023-12-01T01:07:01.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.055+0000 7fde0affd700 1 -- 172.21.15.26:0/2581002276 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fde0c005000 con 0x7fde14100930 2023-12-01T01:07:01.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.055+0000 7fde0affd700 1 --2- 172.21.15.26:0/2581002276 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fde000a0570 0x7fde000a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:01.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.056+0000 7fde19c01700 1 --2- 172.21.15.26:0/2581002276 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fde000a0570 0x7fde000a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:01.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.056+0000 7fde0affd700 1 -- 172.21.15.26:0/2581002276 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fde0c0cb7e0 con 0x7fde14100930 2023-12-01T01:07:01.058 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.056+0000 7fde19c01700 1 --2- 172.21.15.26:0/2581002276 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fde000a0570 0x7fde000a2a30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fde14199b40 tx=0x7fde10009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:01.059 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.059+0000 7fde0affd700 1 -- 172.21.15.26:0/2581002276 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fde0c095390 con 0x7fde14100930 2023-12-01T01:07:01.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:00 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3972889048' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:07:01.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:00 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2352785470' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:07:01.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:00 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3553144544' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:07:01.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:00 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3972889048' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:07:01.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:00 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2352785470' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:07:01.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:00 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3553144544' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:07:01.321 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.320+0000 7fde1be65700 1 -- 172.21.15.26:0/2581002276 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fde1402cec0 con 0x7fde14100930 2023-12-01T01:07:01.329 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.328+0000 7fde0affd700 1 -- 172.21.15.26:0/2581002276 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+729706 (secure 0 0 0) 0x7fde0c0052b0 con 0x7fde14100930 2023-12-01T01:07:01.338 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:07:01.339 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:07:01.339 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 18, 2023-12-01T01:07:01.339 INFO:teuthology.orchestra.run.smithi026.stdout: "active_gid": 14152, 2023-12-01T01:07:01.339 INFO:teuthology.orchestra.run.smithi026.stdout: "active_name": "x", 2023-12-01T01:07:01.339 INFO:teuthology.orchestra.run.smithi026.stdout: "active_addrs": { 2023-12-01T01:07:01.339 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-12-01T01:07:01.339 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.339 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v2", 2023-12-01T01:07:01.339 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6800", 2023-12-01T01:07:01.339 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 4255346255 2023-12-01T01:07:01.339 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.339 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.339 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2023-12-01T01:07:01.340 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:6801", 2023-12-01T01:07:01.340 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 4255346255 2023-12-01T01:07:01.340 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.340 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-12-01T01:07:01.340 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.340 INFO:teuthology.orchestra.run.smithi026.stdout: "active_addr": "172.21.15.26:6801/4255346255", 2023-12-01T01:07:01.340 INFO:teuthology.orchestra.run.smithi026.stdout: "active_change": "2023-12-01T00:56:57.880046+0000", 2023-12-01T01:07:01.340 INFO:teuthology.orchestra.run.smithi026.stdout: "active_mgr_features": 4540138322906710015, 2023-12-01T01:07:01.341 INFO:teuthology.orchestra.run.smithi026.stdout: "available": true, 2023-12-01T01:07:01.341 INFO:teuthology.orchestra.run.smithi026.stdout: "standbys": [ 2023-12-01T01:07:01.341 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.341 INFO:teuthology.orchestra.run.smithi026.stdout: "gid": 24115, 2023-12-01T01:07:01.341 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "z", 2023-12-01T01:07:01.341 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr_features": 4540138322906710015, 2023-12-01T01:07:01.341 INFO:teuthology.orchestra.run.smithi026.stdout: "available_modules": [ 2023-12-01T01:07:01.341 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.341 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "alerts", 2023-12-01T01:07:01.341 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.341 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.342 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.342 INFO:teuthology.orchestra.run.smithi026.stdout: "interval": { 2023-12-01T01:07:01.342 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "interval", 2023-12-01T01:07:01.342 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.342 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.342 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.342 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "60", 2023-12-01T01:07:01.342 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.342 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.342 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.342 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "How frequently to reexamine health status", 2023-12-01T01:07:01.342 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.342 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.342 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.342 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.343 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.343 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.343 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.343 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.343 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.343 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.343 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.343 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.343 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.343 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.343 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.343 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.343 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.343 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.344 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.344 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.344 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.344 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.344 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.344 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.344 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.344 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.344 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.344 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.344 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.344 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.344 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.344 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.345 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.345 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.345 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.345 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.345 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.345 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.345 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.345 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.345 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.345 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.345 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.345 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.345 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.345 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.345 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.346 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.346 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.346 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.346 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.346 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.346 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.346 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.346 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.346 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.346 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.346 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.346 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.347 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.347 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.347 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.347 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.347 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.347 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.347 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.347 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.347 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.347 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.347 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.347 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.347 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.347 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.347 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.348 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_destination": { 2023-12-01T01:07:01.348 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_destination", 2023-12-01T01:07:01.348 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.348 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.348 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.348 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.348 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.348 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.348 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.348 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Email address to send alerts to", 2023-12-01T01:07:01.348 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.348 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.348 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.349 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.349 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_from_name": { 2023-12-01T01:07:01.349 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_from_name", 2023-12-01T01:07:01.349 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.349 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.349 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.349 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "Ceph", 2023-12-01T01:07:01.349 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.349 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.349 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.349 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Email From: name", 2023-12-01T01:07:01.349 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.349 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.349 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.349 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.350 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_host": { 2023-12-01T01:07:01.350 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_host", 2023-12-01T01:07:01.350 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.350 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.350 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.350 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.350 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.350 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.350 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.350 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "SMTP server", 2023-12-01T01:07:01.350 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.350 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.350 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.351 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.351 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_password": { 2023-12-01T01:07:01.351 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_password", 2023-12-01T01:07:01.351 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.351 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.351 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.351 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.351 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.351 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.351 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.351 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Password to authenticate with", 2023-12-01T01:07:01.351 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.351 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.351 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.352 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.352 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_port": { 2023-12-01T01:07:01.352 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_port", 2023-12-01T01:07:01.352 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.352 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.352 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.352 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "465", 2023-12-01T01:07:01.352 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.352 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.352 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.352 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "SMTP port", 2023-12-01T01:07:01.352 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.353 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.353 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.353 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.353 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_sender": { 2023-12-01T01:07:01.353 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_sender", 2023-12-01T01:07:01.353 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.353 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.353 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.353 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.353 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.353 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.353 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.353 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "SMTP envelope sender", 2023-12-01T01:07:01.353 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.354 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.354 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.354 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.354 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_ssl": { 2023-12-01T01:07:01.354 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_ssl", 2023-12-01T01:07:01.354 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.354 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.354 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.354 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.354 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.354 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.354 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.355 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Use SSL to connect to SMTP server", 2023-12-01T01:07:01.355 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.355 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.355 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.355 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.355 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_user": { 2023-12-01T01:07:01.355 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_user", 2023-12-01T01:07:01.355 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.355 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.355 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.355 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.355 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.355 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.356 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.356 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "User to authenticate as", 2023-12-01T01:07:01.356 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.356 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.356 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.356 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.356 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.356 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.356 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.356 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "balancer", 2023-12-01T01:07:01.356 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.356 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.356 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.356 INFO:teuthology.orchestra.run.smithi026.stdout: "active": { 2023-12-01T01:07:01.356 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "active", 2023-12-01T01:07:01.357 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.357 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.357 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.357 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.357 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.357 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.357 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.357 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "automatically balance PGs across cluster", 2023-12-01T01:07:01.357 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.357 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.357 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.357 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.357 INFO:teuthology.orchestra.run.smithi026.stdout: "begin_time": { 2023-12-01T01:07:01.357 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "begin_time", 2023-12-01T01:07:01.357 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.358 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.358 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.358 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0000", 2023-12-01T01:07:01.358 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.358 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.358 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.358 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "beginning time of day to automatically balance", 2023-12-01T01:07:01.358 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-01T01:07:01.358 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.358 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.358 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.358 INFO:teuthology.orchestra.run.smithi026.stdout: "begin_weekday": { 2023-12-01T01:07:01.358 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "begin_weekday", 2023-12-01T01:07:01.358 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "uint", 2023-12-01T01:07:01.359 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.359 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.359 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0", 2023-12-01T01:07:01.359 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "0", 2023-12-01T01:07:01.359 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "6", 2023-12-01T01:07:01.359 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.359 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-12-01T01:07:01.359 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-01T01:07:01.359 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.359 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.359 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.359 INFO:teuthology.orchestra.run.smithi026.stdout: "crush_compat_max_iterations": { 2023-12-01T01:07:01.359 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "crush_compat_max_iterations", 2023-12-01T01:07:01.359 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "uint", 2023-12-01T01:07:01.360 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.360 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.360 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "25", 2023-12-01T01:07:01.360 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "1", 2023-12-01T01:07:01.360 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "250", 2023-12-01T01:07:01.360 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.360 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-12-01T01:07:01.360 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.360 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.360 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.360 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.360 INFO:teuthology.orchestra.run.smithi026.stdout: "crush_compat_metrics": { 2023-12-01T01:07:01.360 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "crush_compat_metrics", 2023-12-01T01:07:01.360 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.361 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.361 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.361 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "pgs,objects,bytes", 2023-12-01T01:07:01.361 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.361 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.361 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.361 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-12-01T01:07:01.361 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-12-01T01:07:01.361 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.361 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.361 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.361 INFO:teuthology.orchestra.run.smithi026.stdout: "crush_compat_step": { 2023-12-01T01:07:01.361 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "crush_compat_step", 2023-12-01T01:07:01.361 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:01.361 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.362 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.362 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0.5", 2023-12-01T01:07:01.362 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "0.001", 2023-12-01T01:07:01.362 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "0.999", 2023-12-01T01:07:01.362 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.362 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "aggressiveness of optimization", 2023-12-01T01:07:01.362 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-12-01T01:07:01.362 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.362 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.362 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.362 INFO:teuthology.orchestra.run.smithi026.stdout: "end_time": { 2023-12-01T01:07:01.362 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "end_time", 2023-12-01T01:07:01.362 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.362 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.362 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.363 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "2359", 2023-12-01T01:07:01.363 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.363 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.363 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.363 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "ending time of day to automatically balance", 2023-12-01T01:07:01.363 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-01T01:07:01.363 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.363 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.363 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.363 INFO:teuthology.orchestra.run.smithi026.stdout: "end_weekday": { 2023-12-01T01:07:01.363 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "end_weekday", 2023-12-01T01:07:01.363 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "uint", 2023-12-01T01:07:01.363 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.364 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.364 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0", 2023-12-01T01:07:01.364 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "0", 2023-12-01T01:07:01.364 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "6", 2023-12-01T01:07:01.364 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.364 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-12-01T01:07:01.364 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-01T01:07:01.364 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.364 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.364 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.365 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.365 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.365 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.365 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.365 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.365 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.365 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.365 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.365 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.365 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.365 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.365 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.365 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.365 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.366 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.366 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.366 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.366 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.366 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.366 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.367 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.367 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.367 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.367 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.367 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.367 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.367 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.368 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.368 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.368 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.368 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.368 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.368 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.368 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.368 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.368 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.368 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.368 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.368 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.368 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.368 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.369 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.369 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.369 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.369 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.369 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.369 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.369 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.369 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.369 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.369 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.369 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.369 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.369 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.369 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.370 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.370 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.370 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.370 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.370 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.370 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.370 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.370 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.370 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.370 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.370 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.370 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.370 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.370 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.370 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.371 INFO:teuthology.orchestra.run.smithi026.stdout: "min_score": { 2023-12-01T01:07:01.371 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "min_score", 2023-12-01T01:07:01.371 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:01.371 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.371 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.371 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0", 2023-12-01T01:07:01.371 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.371 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.371 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.371 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-12-01T01:07:01.371 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.371 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.371 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.371 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.372 INFO:teuthology.orchestra.run.smithi026.stdout: "mode": { 2023-12-01T01:07:01.372 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mode", 2023-12-01T01:07:01.372 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.372 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.372 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.372 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "upmap", 2023-12-01T01:07:01.372 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.372 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.372 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.372 INFO:teuthology.orchestra.run.smithi026.stdout: "crush-compat", 2023-12-01T01:07:01.372 INFO:teuthology.orchestra.run.smithi026.stdout: "none", 2023-12-01T01:07:01.372 INFO:teuthology.orchestra.run.smithi026.stdout: "upmap" 2023-12-01T01:07:01.372 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.372 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Balancer mode", 2023-12-01T01:07:01.372 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.373 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.373 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.373 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.373 INFO:teuthology.orchestra.run.smithi026.stdout: "pool_ids": { 2023-12-01T01:07:01.373 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "pool_ids", 2023-12-01T01:07:01.373 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.373 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.373 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.373 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.373 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.373 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.373 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.373 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-12-01T01:07:01.373 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.373 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.374 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.374 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.374 INFO:teuthology.orchestra.run.smithi026.stdout: "sleep_interval": { 2023-12-01T01:07:01.374 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "sleep_interval", 2023-12-01T01:07:01.374 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.374 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.374 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.374 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "60", 2023-12-01T01:07:01.374 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.374 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.374 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.374 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-12-01T01:07:01.374 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.374 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.374 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.375 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.375 INFO:teuthology.orchestra.run.smithi026.stdout: "upmap_max_deviation": { 2023-12-01T01:07:01.375 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "upmap_max_deviation", 2023-12-01T01:07:01.375 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.375 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.375 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.375 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "5", 2023-12-01T01:07:01.375 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "1", 2023-12-01T01:07:01.375 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.375 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.375 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "deviation below which no optimization is attempted", 2023-12-01T01:07:01.375 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-12-01T01:07:01.375 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.375 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.376 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.376 INFO:teuthology.orchestra.run.smithi026.stdout: "upmap_max_optimizations": { 2023-12-01T01:07:01.376 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "upmap_max_optimizations", 2023-12-01T01:07:01.376 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "uint", 2023-12-01T01:07:01.376 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.376 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.376 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:01.376 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.376 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.376 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.376 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-12-01T01:07:01.376 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.376 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.376 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.376 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.376 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.377 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.377 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.377 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephadm", 2023-12-01T01:07:01.377 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.377 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.377 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.377 INFO:teuthology.orchestra.run.smithi026.stdout: "agent_down_multiplier": { 2023-12-01T01:07:01.377 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "agent_down_multiplier", 2023-12-01T01:07:01.377 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:01.377 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.377 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.377 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "3.0", 2023-12-01T01:07:01.377 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.377 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.377 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.378 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-12-01T01:07:01.378 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.378 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.378 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.378 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.378 INFO:teuthology.orchestra.run.smithi026.stdout: "agent_refresh_rate": { 2023-12-01T01:07:01.378 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "agent_refresh_rate", 2023-12-01T01:07:01.378 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.378 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.378 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.378 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "20", 2023-12-01T01:07:01.378 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.378 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.378 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.379 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-12-01T01:07:01.379 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.379 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.379 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.379 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.379 INFO:teuthology.orchestra.run.smithi026.stdout: "agent_starting_port": { 2023-12-01T01:07:01.379 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "agent_starting_port", 2023-12-01T01:07:01.379 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.379 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.379 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.379 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "4721", 2023-12-01T01:07:01.379 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.379 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.379 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.379 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-12-01T01:07:01.379 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.380 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.380 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.380 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.380 INFO:teuthology.orchestra.run.smithi026.stdout: "allow_ptrace": { 2023-12-01T01:07:01.380 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "allow_ptrace", 2023-12-01T01:07:01.380 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.380 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.380 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.380 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.380 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.380 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.380 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.381 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-12-01T01:07:01.381 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-12-01T01:07:01.381 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.381 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.381 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.381 INFO:teuthology.orchestra.run.smithi026.stdout: "autotune_interval": { 2023-12-01T01:07:01.381 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "autotune_interval", 2023-12-01T01:07:01.381 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.381 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.381 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.381 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "600", 2023-12-01T01:07:01.381 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.381 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.381 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.381 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how frequently to autotune daemon memory", 2023-12-01T01:07:01.382 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.382 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.382 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.382 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.382 INFO:teuthology.orchestra.run.smithi026.stdout: "autotune_memory_target_ratio": { 2023-12-01T01:07:01.382 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "autotune_memory_target_ratio", 2023-12-01T01:07:01.382 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:01.382 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.382 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.382 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0.7", 2023-12-01T01:07:01.382 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.382 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.382 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.382 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-12-01T01:07:01.383 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.383 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.383 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.383 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.383 INFO:teuthology.orchestra.run.smithi026.stdout: "cgroups_split": { 2023-12-01T01:07:01.383 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cgroups_split", 2023-12-01T01:07:01.383 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.383 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.383 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.383 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.383 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.383 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.383 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.383 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-12-01T01:07:01.384 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.384 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.384 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.384 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.384 INFO:teuthology.orchestra.run.smithi026.stdout: "config_checks_enabled": { 2023-12-01T01:07:01.384 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "config_checks_enabled", 2023-12-01T01:07:01.384 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.384 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.384 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.384 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.384 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.384 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.384 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.384 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-12-01T01:07:01.384 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.385 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.385 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.385 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.385 INFO:teuthology.orchestra.run.smithi026.stdout: "config_dashboard": { 2023-12-01T01:07:01.385 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "config_dashboard", 2023-12-01T01:07:01.385 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.385 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.385 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.385 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.385 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.385 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.385 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.385 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-12-01T01:07:01.385 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.385 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.386 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.386 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.386 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_alertmanager": { 2023-12-01T01:07:01.386 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_alertmanager", 2023-12-01T01:07:01.386 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.386 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.386 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.386 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-12-01T01:07:01.386 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.386 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.386 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.386 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Prometheus container image", 2023-12-01T01:07:01.386 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.386 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.387 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.387 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.387 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_base": { 2023-12-01T01:07:01.387 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_base", 2023-12-01T01:07:01.387 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.387 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.387 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.387 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/ceph/ceph", 2023-12-01T01:07:01.387 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.387 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.387 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.387 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Container image name, without the tag", 2023-12-01T01:07:01.387 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.387 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.388 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.388 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.388 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_elasticsearch": { 2023-12-01T01:07:01.388 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_elasticsearch", 2023-12-01T01:07:01.388 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.388 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.388 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.388 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-12-01T01:07:01.388 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.388 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.388 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.388 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "elasticsearch container image", 2023-12-01T01:07:01.388 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.388 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.389 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.389 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.389 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_grafana": { 2023-12-01T01:07:01.389 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_grafana", 2023-12-01T01:07:01.389 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.389 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.389 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.389 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-12-01T01:07:01.389 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.389 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.389 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.389 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Prometheus container image", 2023-12-01T01:07:01.389 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.389 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.389 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.390 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.390 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_haproxy": { 2023-12-01T01:07:01.390 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_haproxy", 2023-12-01T01:07:01.390 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.390 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.390 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.390 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-12-01T01:07:01.390 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.390 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.390 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.390 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "HAproxy container image", 2023-12-01T01:07:01.390 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.390 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.390 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.390 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.391 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_jaeger_agent": { 2023-12-01T01:07:01.391 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_jaeger_agent", 2023-12-01T01:07:01.391 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.391 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.391 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.391 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-12-01T01:07:01.391 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.391 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.391 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.391 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Jaeger agent container image", 2023-12-01T01:07:01.391 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.391 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.391 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.392 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.392 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_jaeger_collector": { 2023-12-01T01:07:01.392 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_jaeger_collector", 2023-12-01T01:07:01.392 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.392 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.392 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.392 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-12-01T01:07:01.392 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.392 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.392 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.392 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Jaeger collector container image", 2023-12-01T01:07:01.392 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.392 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.392 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.393 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.393 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_jaeger_query": { 2023-12-01T01:07:01.393 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_jaeger_query", 2023-12-01T01:07:01.393 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.393 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.393 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.393 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-12-01T01:07:01.393 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.393 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.393 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.393 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Jaeger query container image", 2023-12-01T01:07:01.393 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.393 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.393 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.394 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.394 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_keepalived": { 2023-12-01T01:07:01.394 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_keepalived", 2023-12-01T01:07:01.394 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.394 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.394 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.394 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-12-01T01:07:01.394 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.394 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.394 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.394 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Keepalived container image", 2023-12-01T01:07:01.394 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.394 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.394 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.395 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.395 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_loki": { 2023-12-01T01:07:01.395 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_loki", 2023-12-01T01:07:01.395 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.395 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.395 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.395 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-12-01T01:07:01.395 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.395 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.395 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.396 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Loki container image", 2023-12-01T01:07:01.396 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.396 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.396 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.396 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.396 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_node_exporter": { 2023-12-01T01:07:01.396 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_node_exporter", 2023-12-01T01:07:01.396 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.396 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.396 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.396 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-12-01T01:07:01.396 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.396 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.397 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.397 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Prometheus container image", 2023-12-01T01:07:01.397 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.397 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.397 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.397 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.397 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_nvmeof": { 2023-12-01T01:07:01.397 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_nvmeof", 2023-12-01T01:07:01.397 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.397 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.397 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.397 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.2", 2023-12-01T01:07:01.397 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.398 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.398 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.398 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Nvme-of container image", 2023-12-01T01:07:01.398 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.398 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.398 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.398 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.398 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_prometheus": { 2023-12-01T01:07:01.398 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_prometheus", 2023-12-01T01:07:01.398 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.398 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.398 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.398 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-12-01T01:07:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Prometheus container image", 2023-12-01T01:07:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_promtail": { 2023-12-01T01:07:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_promtail", 2023-12-01T01:07:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.399 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-12-01T01:07:01.400 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.400 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.400 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.400 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Promtail container image", 2023-12-01T01:07:01.400 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.400 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.400 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.400 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.400 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_snmp_gateway": { 2023-12-01T01:07:01.400 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_snmp_gateway", 2023-12-01T01:07:01.400 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.400 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-12-01T01:07:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "SNMP Gateway container image", 2023-12-01T01:07:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "container_init": { 2023-12-01T01:07:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_init", 2023-12-01T01:07:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.401 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Run podman/docker with `--init`", 2023-12-01T01:07:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "daemon_cache_timeout": { 2023-12-01T01:07:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "daemon_cache_timeout", 2023-12-01T01:07:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.402 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.403 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "600", 2023-12-01T01:07:01.403 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.403 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.403 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.403 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-12-01T01:07:01.403 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.403 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.403 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.403 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.403 INFO:teuthology.orchestra.run.smithi026.stdout: "default_cephadm_command_timeout": { 2023-12-01T01:07:01.403 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "default_cephadm_command_timeout", 2023-12-01T01:07:01.403 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.403 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.403 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.403 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "900", 2023-12-01T01:07:01.404 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.404 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.404 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.404 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-12-01T01:07:01.404 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.404 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.404 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.404 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.404 INFO:teuthology.orchestra.run.smithi026.stdout: "default_registry": { 2023-12-01T01:07:01.404 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "default_registry", 2023-12-01T01:07:01.404 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.404 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.404 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.405 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "docker.io", 2023-12-01T01:07:01.405 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.405 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.405 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.405 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-12-01T01:07:01.405 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.405 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.405 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.405 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.405 INFO:teuthology.orchestra.run.smithi026.stdout: "device_cache_timeout": { 2023-12-01T01:07:01.405 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "device_cache_timeout", 2023-12-01T01:07:01.405 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.405 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.405 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.405 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "1800", 2023-12-01T01:07:01.406 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.406 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.406 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.406 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "seconds to cache device inventory", 2023-12-01T01:07:01.406 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.406 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.406 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.406 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.406 INFO:teuthology.orchestra.run.smithi026.stdout: "device_enhanced_scan": { 2023-12-01T01:07:01.406 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "device_enhanced_scan", 2023-12-01T01:07:01.406 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.406 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.406 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.406 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.406 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.407 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.407 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.407 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Use libstoragemgmt during device scans", 2023-12-01T01:07:01.407 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.407 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.407 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.407 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.407 INFO:teuthology.orchestra.run.smithi026.stdout: "facts_cache_timeout": { 2023-12-01T01:07:01.407 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "facts_cache_timeout", 2023-12-01T01:07:01.407 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.407 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.407 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.407 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "60", 2023-12-01T01:07:01.407 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.407 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.408 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.408 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "seconds to cache host facts data", 2023-12-01T01:07:01.408 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.408 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.408 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.408 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.408 INFO:teuthology.orchestra.run.smithi026.stdout: "host_check_interval": { 2023-12-01T01:07:01.408 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "host_check_interval", 2023-12-01T01:07:01.408 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.408 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.408 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.408 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "600", 2023-12-01T01:07:01.408 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.408 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.409 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.409 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how frequently to perform a host check", 2023-12-01T01:07:01.409 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.409 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.409 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.409 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.409 INFO:teuthology.orchestra.run.smithi026.stdout: "inventory_list_all": { 2023-12-01T01:07:01.409 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "inventory_list_all", 2023-12-01T01:07:01.409 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.409 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.409 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.409 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.409 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.409 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.409 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.410 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-12-01T01:07:01.410 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.410 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.410 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.410 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.410 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.410 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.410 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.410 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.410 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.410 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.410 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.410 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.410 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.410 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.411 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.411 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.411 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.411 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.411 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.411 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.411 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.411 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.411 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.411 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.411 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.411 INFO:teuthology.orchestra.run.smithi026.stdout: "log_refresh_metadata": { 2023-12-01T01:07:01.411 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_refresh_metadata", 2023-12-01T01:07:01.411 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.411 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.411 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.412 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.412 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.412 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.412 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.412 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-12-01T01:07:01.412 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.412 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.412 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.412 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.412 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.412 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.412 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.412 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.412 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.412 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.413 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.413 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.413 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.413 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-12-01T01:07:01.413 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.413 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.413 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.413 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.413 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.413 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.413 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.413 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.413 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.413 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.413 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.413 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.414 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.414 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.414 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.414 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.414 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.414 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.414 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.414 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.414 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.414 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.414 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.414 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.414 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.414 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.414 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.415 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.415 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.415 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.415 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.415 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.415 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.415 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.415 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.415 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.415 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.415 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.415 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.415 INFO:teuthology.orchestra.run.smithi026.stdout: "manage_etc_ceph_ceph_conf": { 2023-12-01T01:07:01.415 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-12-01T01:07:01.415 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.416 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.416 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.416 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.416 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.416 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.416 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.416 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-12-01T01:07:01.416 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.416 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.416 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.416 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.416 INFO:teuthology.orchestra.run.smithi026.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-12-01T01:07:01.416 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-12-01T01:07:01.417 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.417 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.417 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.417 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "*", 2023-12-01T01:07:01.417 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.417 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.417 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.417 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-12-01T01:07:01.417 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.417 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.417 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.417 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.417 INFO:teuthology.orchestra.run.smithi026.stdout: "max_count_per_host": { 2023-12-01T01:07:01.417 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "max_count_per_host", 2023-12-01T01:07:01.417 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.418 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.418 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.418 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:01.418 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.418 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.418 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.418 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "max number of daemons per service per host", 2023-12-01T01:07:01.418 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.418 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.418 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.418 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.418 INFO:teuthology.orchestra.run.smithi026.stdout: "max_osd_draining_count": { 2023-12-01T01:07:01.418 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "max_osd_draining_count", 2023-12-01T01:07:01.418 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.419 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.419 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.419 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:01.419 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.419 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.419 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.419 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-12-01T01:07:01.419 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.419 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.419 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.419 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.419 INFO:teuthology.orchestra.run.smithi026.stdout: "migration_current": { 2023-12-01T01:07:01.419 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "migration_current", 2023-12-01T01:07:01.420 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.420 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.420 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.420 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.420 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.420 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.420 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.420 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "internal - do not modify", 2023-12-01T01:07:01.420 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.420 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.420 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.420 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.420 INFO:teuthology.orchestra.run.smithi026.stdout: "mode": { 2023-12-01T01:07:01.420 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mode", 2023-12-01T01:07:01.420 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.421 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.421 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.421 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "root", 2023-12-01T01:07:01.421 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.421 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.421 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.421 INFO:teuthology.orchestra.run.smithi026.stdout: "cephadm-package", 2023-12-01T01:07:01.421 INFO:teuthology.orchestra.run.smithi026.stdout: "root" 2023-12-01T01:07:01.421 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.421 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "mode for remote execution of cephadm", 2023-12-01T01:07:01.421 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.421 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.421 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.421 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.422 INFO:teuthology.orchestra.run.smithi026.stdout: "prometheus_alerts_path": { 2023-12-01T01:07:01.422 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "prometheus_alerts_path", 2023-12-01T01:07:01.422 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.422 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.422 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.422 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-12-01T01:07:01.422 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.422 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.422 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.422 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-12-01T01:07:01.422 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.422 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.422 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.422 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.422 INFO:teuthology.orchestra.run.smithi026.stdout: "registry_insecure": { 2023-12-01T01:07:01.423 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "registry_insecure", 2023-12-01T01:07:01.423 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.423 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.423 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.423 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.423 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.423 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.423 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.423 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-12-01T01:07:01.423 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.423 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.423 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.423 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.423 INFO:teuthology.orchestra.run.smithi026.stdout: "registry_password": { 2023-12-01T01:07:01.423 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "registry_password", 2023-12-01T01:07:01.423 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.424 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.424 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.424 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.424 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.424 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.424 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.424 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-12-01T01:07:01.424 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.424 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.424 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.424 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.424 INFO:teuthology.orchestra.run.smithi026.stdout: "registry_url": { 2023-12-01T01:07:01.424 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "registry_url", 2023-12-01T01:07:01.424 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.424 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.425 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.425 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.425 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.425 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.425 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.425 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-12-01T01:07:01.425 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.425 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.425 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.425 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.425 INFO:teuthology.orchestra.run.smithi026.stdout: "registry_username": { 2023-12-01T01:07:01.425 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "registry_username", 2023-12-01T01:07:01.425 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.425 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.425 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.426 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.426 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.426 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.426 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.426 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-12-01T01:07:01.426 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.426 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.426 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.426 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.426 INFO:teuthology.orchestra.run.smithi026.stdout: "secure_monitoring_stack": { 2023-12-01T01:07:01.426 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "secure_monitoring_stack", 2023-12-01T01:07:01.426 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.426 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.426 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.426 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.427 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.427 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.427 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.427 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-12-01T01:07:01.427 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.427 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.427 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.427 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.427 INFO:teuthology.orchestra.run.smithi026.stdout: "service_discovery_port": { 2023-12-01T01:07:01.427 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "service_discovery_port", 2023-12-01T01:07:01.427 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.427 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.427 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.427 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "8765", 2023-12-01T01:07:01.428 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.428 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.428 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.428 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "cephadm service discovery port", 2023-12-01T01:07:01.428 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.428 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.428 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.428 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.428 INFO:teuthology.orchestra.run.smithi026.stdout: "ssh_config_file": { 2023-12-01T01:07:01.428 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ssh_config_file", 2023-12-01T01:07:01.428 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.428 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.428 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.428 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.429 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.429 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.429 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.429 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-12-01T01:07:01.429 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.429 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.429 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.429 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.429 INFO:teuthology.orchestra.run.smithi026.stdout: "use_agent": { 2023-12-01T01:07:01.429 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "use_agent", 2023-12-01T01:07:01.429 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.429 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.429 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.429 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.429 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-12-01T01:07:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "use_repo_digest": { 2023-12-01T01:07:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "use_repo_digest", 2023-12-01T01:07:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.430 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-12-01T01:07:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "warn_on_failed_host_check": { 2023-12-01T01:07:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "warn_on_failed_host_check", 2023-12-01T01:07:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.431 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.432 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "raise a health warning if the host check fails", 2023-12-01T01:07:01.432 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.432 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.432 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.432 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.432 INFO:teuthology.orchestra.run.smithi026.stdout: "warn_on_stray_daemons": { 2023-12-01T01:07:01.432 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "warn_on_stray_daemons", 2023-12-01T01:07:01.432 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.432 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.432 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.432 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.432 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.432 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.432 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.432 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-12-01T01:07:01.433 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.433 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.433 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.433 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.433 INFO:teuthology.orchestra.run.smithi026.stdout: "warn_on_stray_hosts": { 2023-12-01T01:07:01.433 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "warn_on_stray_hosts", 2023-12-01T01:07:01.433 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.433 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.433 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.433 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.433 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.433 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.433 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.433 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-12-01T01:07:01.434 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.434 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.434 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.434 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.434 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.434 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.434 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.434 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "crash", 2023-12-01T01:07:01.434 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.434 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.434 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.434 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.434 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.434 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.434 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.435 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.435 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.435 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.435 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.435 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.435 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.435 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.435 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.435 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.435 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.435 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.435 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.435 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.435 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.435 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.436 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.437 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.437 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.437 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.437 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.437 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.437 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.437 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.437 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.437 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.437 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.437 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.437 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.437 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.437 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.437 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.438 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.438 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.438 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.438 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.438 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.438 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.438 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.438 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.438 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.438 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.438 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.438 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.438 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.438 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.438 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.439 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.439 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.439 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.439 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.439 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.439 INFO:teuthology.orchestra.run.smithi026.stdout: "retain_interval": { 2023-12-01T01:07:01.439 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "retain_interval", 2023-12-01T01:07:01.439 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.439 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.439 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.439 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "31536000", 2023-12-01T01:07:01.439 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.439 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.439 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.439 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how long to retain crashes before pruning them", 2023-12-01T01:07:01.439 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.440 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.440 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.440 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.440 INFO:teuthology.orchestra.run.smithi026.stdout: "warn_recent_interval": { 2023-12-01T01:07:01.440 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "warn_recent_interval", 2023-12-01T01:07:01.440 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.440 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.440 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.440 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "1209600", 2023-12-01T01:07:01.440 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.440 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.440 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.440 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "time interval in which to warn about recent crashes", 2023-12-01T01:07:01.441 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.441 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.441 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.441 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.441 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.441 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.441 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.441 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "dashboard", 2023-12-01T01:07:01.441 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.441 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.441 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.441 INFO:teuthology.orchestra.run.smithi026.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-12-01T01:07:01.441 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-12-01T01:07:01.441 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.441 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.442 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.442 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:01.442 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.442 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.442 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.442 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.442 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.442 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.442 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.442 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.442 INFO:teuthology.orchestra.run.smithi026.stdout: "ALERTMANAGER_API_HOST": { 2023-12-01T01:07:01.442 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ALERTMANAGER_API_HOST", 2023-12-01T01:07:01.442 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.442 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.442 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.443 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.443 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.443 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.443 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.443 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.443 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.443 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.443 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.443 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.443 INFO:teuthology.orchestra.run.smithi026.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-12-01T01:07:01.443 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-12-01T01:07:01.443 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.443 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.443 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.443 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.444 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.444 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.444 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.444 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.444 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.444 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.444 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.444 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.444 INFO:teuthology.orchestra.run.smithi026.stdout: "AUDIT_API_ENABLED": { 2023-12-01T01:07:01.444 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "AUDIT_API_ENABLED", 2023-12-01T01:07:01.444 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.444 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.444 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.444 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.444 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.445 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.445 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.445 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.445 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.445 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.445 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.445 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.445 INFO:teuthology.orchestra.run.smithi026.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-12-01T01:07:01.445 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-12-01T01:07:01.445 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.445 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.445 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.445 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.445 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.445 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.446 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.446 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.446 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.446 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.446 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.446 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.446 INFO:teuthology.orchestra.run.smithi026.stdout: "ENABLE_BROWSABLE_API": { 2023-12-01T01:07:01.446 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ENABLE_BROWSABLE_API", 2023-12-01T01:07:01.446 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.446 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.446 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.446 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.446 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.446 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.446 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.446 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.447 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.447 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.447 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.447 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.447 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-12-01T01:07:01.447 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-12-01T01:07:01.447 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.447 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.447 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.447 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.447 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.447 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.447 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.447 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.447 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.448 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.448 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.448 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.448 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-12-01T01:07:01.448 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-12-01T01:07:01.448 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.448 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.448 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.448 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.448 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.448 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.448 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.448 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.448 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.448 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.449 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.449 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.449 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-12-01T01:07:01.449 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-12-01T01:07:01.449 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.449 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.449 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.449 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.449 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.449 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.449 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.449 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.449 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.449 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.449 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.450 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.450 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-12-01T01:07:01.450 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-12-01T01:07:01.450 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.450 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.450 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.450 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.450 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.450 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.450 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.450 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.450 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.450 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.450 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.450 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.451 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_NFS": { 2023-12-01T01:07:01.451 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-12-01T01:07:01.451 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.451 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.451 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.451 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.451 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.451 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.451 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.451 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.451 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.451 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.451 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.451 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.452 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_RBD": { 2023-12-01T01:07:01.452 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-12-01T01:07:01.452 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.452 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.452 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.452 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.452 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.452 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.452 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.452 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.452 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.452 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.452 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.452 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.453 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_RGW": { 2023-12-01T01:07:01.453 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-12-01T01:07:01.453 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.453 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.453 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.453 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.453 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.453 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.453 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.453 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.453 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.453 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.453 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.453 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.453 INFO:teuthology.orchestra.run.smithi026.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-12-01T01:07:01.454 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-12-01T01:07:01.454 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.454 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.454 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.454 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.454 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.454 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.454 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.454 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.454 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.454 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.454 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.454 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.454 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_API_PASSWORD": { 2023-12-01T01:07:01.454 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_API_PASSWORD", 2023-12-01T01:07:01.455 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.455 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.455 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.455 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "admin", 2023-12-01T01:07:01.455 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.455 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.455 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.455 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.455 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.455 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.455 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.455 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.455 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-12-01T01:07:01.455 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-12-01T01:07:01.455 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_API_URL": { 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_API_URL", 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.456 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_API_USERNAME": { 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_API_USERNAME", 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "admin", 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.457 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.458 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.458 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.458 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.458 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.458 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.458 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-12-01T01:07:01.458 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-12-01T01:07:01.458 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.458 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.458 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.458 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.458 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.458 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.458 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.459 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.459 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.459 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.459 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.459 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.459 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-12-01T01:07:01.459 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-12-01T01:07:01.459 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.459 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.459 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.459 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.459 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.459 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.459 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.459 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.460 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.460 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.460 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.460 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.460 INFO:teuthology.orchestra.run.smithi026.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-12-01T01:07:01.460 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-12-01T01:07:01.460 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.460 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.460 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.460 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.460 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.460 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.460 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.460 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.460 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.461 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.461 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.461 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.461 INFO:teuthology.orchestra.run.smithi026.stdout: "ISSUE_TRACKER_API_KEY": { 2023-12-01T01:07:01.461 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-12-01T01:07:01.461 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.461 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.461 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.461 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.461 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.461 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.461 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.461 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.461 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.461 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.461 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.462 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.462 INFO:teuthology.orchestra.run.smithi026.stdout: "PROMETHEUS_API_HOST": { 2023-12-01T01:07:01.462 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PROMETHEUS_API_HOST", 2023-12-01T01:07:01.462 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.462 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.462 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.462 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.462 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.462 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.462 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.462 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.462 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.462 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.462 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.462 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.463 INFO:teuthology.orchestra.run.smithi026.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-12-01T01:07:01.463 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-12-01T01:07:01.463 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.463 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.463 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.463 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.463 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.463 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.463 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.463 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.463 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.463 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.463 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.463 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.464 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-12-01T01:07:01.464 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-12-01T01:07:01.464 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.464 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.464 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.464 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.464 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.464 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.464 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.464 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.464 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.464 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.464 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.464 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.465 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-12-01T01:07:01.465 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-12-01T01:07:01.465 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.465 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.465 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.465 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.465 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.465 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.465 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.465 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.465 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.465 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.465 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.465 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.466 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-12-01T01:07:01.466 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-12-01T01:07:01.466 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.466 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.466 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.466 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.466 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.466 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.466 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.466 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.466 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.466 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.466 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.466 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.467 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-12-01T01:07:01.467 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-12-01T01:07:01.467 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.467 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.467 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.467 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.467 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.467 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.467 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.467 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.467 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.467 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.467 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.467 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.468 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-12-01T01:07:01.468 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-12-01T01:07:01.468 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.468 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.468 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.468 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.468 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.468 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.468 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.468 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.468 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.468 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.468 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.468 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.469 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-12-01T01:07:01.469 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-12-01T01:07:01.469 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.469 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.469 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.469 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.469 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.469 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.469 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.469 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.469 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.469 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.469 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.469 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.469 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-12-01T01:07:01.470 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-12-01T01:07:01.470 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.470 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.470 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.470 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.470 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.470 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.470 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.470 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.470 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.470 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.470 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.470 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.470 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_ENABLED": { 2023-12-01T01:07:01.470 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_ENABLED", 2023-12-01T01:07:01.471 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.471 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.471 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.471 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.471 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.471 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.471 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.471 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.471 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.471 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.471 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.471 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.471 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-12-01T01:07:01.471 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-12-01T01:07:01.472 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.472 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.472 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.472 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-12-01T01:07:01.472 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.472 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.472 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.472 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.472 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.472 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.472 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.472 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.472 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-12-01T01:07:01.472 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-12-01T01:07:01.473 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.473 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.473 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.473 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:01.473 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.473 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.473 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.473 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.473 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.473 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.473 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.473 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.473 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-12-01T01:07:01.473 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-12-01T01:07:01.473 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.474 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.474 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.474 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "8", 2023-12-01T01:07:01.474 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.474 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.474 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.474 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.474 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.474 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.474 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.474 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.474 INFO:teuthology.orchestra.run.smithi026.stdout: "REST_REQUESTS_TIMEOUT": { 2023-12-01T01:07:01.474 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-12-01T01:07:01.474 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.474 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.475 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.475 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "45", 2023-12-01T01:07:01.475 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.475 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.475 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.475 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.475 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.475 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.475 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.475 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.475 INFO:teuthology.orchestra.run.smithi026.stdout: "RGW_API_ACCESS_KEY": { 2023-12-01T01:07:01.475 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RGW_API_ACCESS_KEY", 2023-12-01T01:07:01.475 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.475 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.476 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.476 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.476 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.476 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.476 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.476 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.476 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.476 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.476 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.476 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.476 INFO:teuthology.orchestra.run.smithi026.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-12-01T01:07:01.476 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-12-01T01:07:01.476 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.476 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.476 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.476 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "admin", 2023-12-01T01:07:01.477 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.477 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.477 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.477 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.477 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.477 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.477 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.477 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.477 INFO:teuthology.orchestra.run.smithi026.stdout: "RGW_API_SECRET_KEY": { 2023-12-01T01:07:01.477 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RGW_API_SECRET_KEY", 2023-12-01T01:07:01.477 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.477 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.477 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.478 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.478 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.478 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.478 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.478 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.478 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.478 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.478 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.478 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.478 INFO:teuthology.orchestra.run.smithi026.stdout: "RGW_API_SSL_VERIFY": { 2023-12-01T01:07:01.478 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RGW_API_SSL_VERIFY", 2023-12-01T01:07:01.478 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.478 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.478 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.479 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.479 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.479 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.479 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.479 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.479 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.479 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.479 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.479 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.479 INFO:teuthology.orchestra.run.smithi026.stdout: "UNSAFE_TLS_v1_2": { 2023-12-01T01:07:01.479 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "UNSAFE_TLS_v1_2", 2023-12-01T01:07:01.479 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.479 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.479 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.480 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.480 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.480 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.480 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.480 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.480 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.480 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.480 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.480 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.480 INFO:teuthology.orchestra.run.smithi026.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-12-01T01:07:01.480 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-12-01T01:07:01.480 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.480 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.480 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.480 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0", 2023-12-01T01:07:01.481 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.481 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.481 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.481 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.481 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.481 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.481 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.481 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.481 INFO:teuthology.orchestra.run.smithi026.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-12-01T01:07:01.481 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-12-01T01:07:01.481 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.481 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.481 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.482 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:01.482 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.482 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.482 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.482 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.482 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.482 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.482 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.482 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.482 INFO:teuthology.orchestra.run.smithi026.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-12-01T01:07:01.482 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-12-01T01:07:01.482 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.482 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.482 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.482 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "5", 2023-12-01T01:07:01.483 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.483 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.483 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.483 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.483 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.483 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.483 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.483 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.483 INFO:teuthology.orchestra.run.smithi026.stdout: "cross_origin_url": { 2023-12-01T01:07:01.483 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cross_origin_url", 2023-12-01T01:07:01.483 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.483 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.483 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.483 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.484 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.484 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.484 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.484 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.484 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.484 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.484 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.484 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.484 INFO:teuthology.orchestra.run.smithi026.stdout: "crt_file": { 2023-12-01T01:07:01.484 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "crt_file", 2023-12-01T01:07:01.484 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.484 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.484 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.484 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.485 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.485 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.485 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.485 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.485 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.485 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.485 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.485 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.485 INFO:teuthology.orchestra.run.smithi026.stdout: "debug": { 2023-12-01T01:07:01.485 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "debug", 2023-12-01T01:07:01.485 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.485 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.485 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.485 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.485 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.486 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.486 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.486 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Enable/disable debug options", 2023-12-01T01:07:01.486 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.486 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.486 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.486 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.486 INFO:teuthology.orchestra.run.smithi026.stdout: "jwt_token_ttl": { 2023-12-01T01:07:01.486 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "jwt_token_ttl", 2023-12-01T01:07:01.486 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.486 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.486 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.486 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "28800", 2023-12-01T01:07:01.486 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.487 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.487 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.487 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.487 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.487 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.487 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.487 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.487 INFO:teuthology.orchestra.run.smithi026.stdout: "key_file": { 2023-12-01T01:07:01.487 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "key_file", 2023-12-01T01:07:01.487 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.487 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.487 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.487 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.487 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.487 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.488 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.489 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.490 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.491 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.492 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.492 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.492 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.492 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.492 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.492 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.492 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.492 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.492 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.492 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.492 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.492 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.492 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.492 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.492 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.493 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.493 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.493 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.493 INFO:teuthology.orchestra.run.smithi026.stdout: "motd": { 2023-12-01T01:07:01.493 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "motd", 2023-12-01T01:07:01.493 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.493 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.493 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.493 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.493 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.493 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.493 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.493 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "The message of the day", 2023-12-01T01:07:01.493 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.494 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.494 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.494 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.494 INFO:teuthology.orchestra.run.smithi026.stdout: "redirect_resolve_ip_addr": { 2023-12-01T01:07:01.494 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "redirect_resolve_ip_addr", 2023-12-01T01:07:01.494 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.494 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.494 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.494 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.494 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.494 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.494 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.494 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.494 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.495 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.495 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.495 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.495 INFO:teuthology.orchestra.run.smithi026.stdout: "server_addr": { 2023-12-01T01:07:01.495 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_addr", 2023-12-01T01:07:01.495 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.495 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.495 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.495 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "::", 2023-12-01T01:07:01.495 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.495 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.495 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.495 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.495 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.495 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.496 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.496 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.496 INFO:teuthology.orchestra.run.smithi026.stdout: "server_port": { 2023-12-01T01:07:01.496 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_port", 2023-12-01T01:07:01.496 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.496 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.496 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.496 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "8080", 2023-12-01T01:07:01.496 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.496 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.496 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.496 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.496 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.496 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.496 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.497 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.497 INFO:teuthology.orchestra.run.smithi026.stdout: "ssl": { 2023-12-01T01:07:01.497 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ssl", 2023-12-01T01:07:01.497 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.497 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.497 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.497 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.497 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.497 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.497 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.497 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.497 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.497 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.497 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.497 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.497 INFO:teuthology.orchestra.run.smithi026.stdout: "ssl_server_port": { 2023-12-01T01:07:01.498 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ssl_server_port", 2023-12-01T01:07:01.498 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.498 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.498 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.498 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "8443", 2023-12-01T01:07:01.498 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.498 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.498 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.498 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.498 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.498 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.498 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.498 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.498 INFO:teuthology.orchestra.run.smithi026.stdout: "standby_behaviour": { 2023-12-01T01:07:01.498 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "standby_behaviour", 2023-12-01T01:07:01.499 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.499 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.499 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.499 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "redirect", 2023-12-01T01:07:01.499 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.499 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.499 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.499 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.499 INFO:teuthology.orchestra.run.smithi026.stdout: "redirect" 2023-12-01T01:07:01.499 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.499 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.499 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.499 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.499 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.499 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.500 INFO:teuthology.orchestra.run.smithi026.stdout: "standby_error_status_code": { 2023-12-01T01:07:01.500 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "standby_error_status_code", 2023-12-01T01:07:01.500 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.500 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.500 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.500 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "500", 2023-12-01T01:07:01.500 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "400", 2023-12-01T01:07:01.500 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "599", 2023-12-01T01:07:01.500 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.500 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.500 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.500 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.500 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.500 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.500 INFO:teuthology.orchestra.run.smithi026.stdout: "url_prefix": { 2023-12-01T01:07:01.501 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "url_prefix", 2023-12-01T01:07:01.501 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.501 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.501 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.501 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.501 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.501 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.501 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.501 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.501 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.501 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.501 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.501 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.501 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.501 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.502 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.502 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "devicehealth", 2023-12-01T01:07:01.502 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.502 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.502 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.502 INFO:teuthology.orchestra.run.smithi026.stdout: "enable_monitoring": { 2023-12-01T01:07:01.502 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "enable_monitoring", 2023-12-01T01:07:01.502 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.502 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.502 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.502 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.502 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.502 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.502 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.502 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "monitor device health metrics", 2023-12-01T01:07:01.503 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.503 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.503 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.503 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.503 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.503 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.503 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.503 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.503 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.503 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.503 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.503 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.503 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.503 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.504 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.504 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.504 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.504 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.504 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.504 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.504 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.504 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.504 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.504 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.504 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.504 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.504 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.504 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.505 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.505 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.505 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.505 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.505 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.505 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.505 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.505 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.505 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.505 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.505 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.505 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.505 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.505 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.505 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.506 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.506 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.506 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.506 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.506 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.506 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.506 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.506 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.506 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.506 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.506 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.506 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.506 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.507 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.507 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.507 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.507 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.507 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.507 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.507 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.507 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.507 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.507 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.507 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.507 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.507 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.507 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.507 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.508 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.508 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.508 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.508 INFO:teuthology.orchestra.run.smithi026.stdout: "mark_out_threshold": { 2023-12-01T01:07:01.508 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mark_out_threshold", 2023-12-01T01:07:01.508 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.508 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.508 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.508 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "2419200", 2023-12-01T01:07:01.508 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.508 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.508 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.508 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-12-01T01:07:01.508 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.508 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.509 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.509 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.509 INFO:teuthology.orchestra.run.smithi026.stdout: "pool_name": { 2023-12-01T01:07:01.509 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "pool_name", 2023-12-01T01:07:01.509 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.509 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.509 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.509 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "device_health_metrics", 2023-12-01T01:07:01.509 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.509 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.509 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.509 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "name of pool in which to store device health metrics", 2023-12-01T01:07:01.509 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.509 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.509 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.509 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.510 INFO:teuthology.orchestra.run.smithi026.stdout: "retention_period": { 2023-12-01T01:07:01.510 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "retention_period", 2023-12-01T01:07:01.510 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.510 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.510 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.510 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "15552000", 2023-12-01T01:07:01.510 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.510 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.510 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.510 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how long to retain device health metrics", 2023-12-01T01:07:01.510 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.510 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.510 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.510 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.510 INFO:teuthology.orchestra.run.smithi026.stdout: "scrape_frequency": { 2023-12-01T01:07:01.511 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "scrape_frequency", 2023-12-01T01:07:01.511 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.511 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.511 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.511 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "86400", 2023-12-01T01:07:01.511 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.511 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.511 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.511 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how frequently to scrape device health metrics", 2023-12-01T01:07:01.511 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.511 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.511 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.511 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.511 INFO:teuthology.orchestra.run.smithi026.stdout: "self_heal": { 2023-12-01T01:07:01.511 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "self_heal", 2023-12-01T01:07:01.512 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.512 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.512 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.512 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.512 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.512 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.512 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.512 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-12-01T01:07:01.512 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.512 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.512 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.512 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.512 INFO:teuthology.orchestra.run.smithi026.stdout: "sleep_interval": { 2023-12-01T01:07:01.512 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "sleep_interval", 2023-12-01T01:07:01.512 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.512 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.513 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.513 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "600", 2023-12-01T01:07:01.513 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.513 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.513 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.513 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how frequently to wake up and check device health", 2023-12-01T01:07:01.513 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.513 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.513 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.513 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.513 INFO:teuthology.orchestra.run.smithi026.stdout: "warn_threshold": { 2023-12-01T01:07:01.513 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "warn_threshold", 2023-12-01T01:07:01.513 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.513 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.513 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.514 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "7257600", 2023-12-01T01:07:01.514 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.514 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.514 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.514 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-12-01T01:07:01.514 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.514 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.514 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.514 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.514 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.514 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.514 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.514 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "diskprediction_local", 2023-12-01T01:07:01.514 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.514 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.515 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.515 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.515 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.515 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.515 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.515 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.515 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.515 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.515 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.515 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.515 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.515 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.515 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.516 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.516 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.516 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.516 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.516 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.516 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.516 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.516 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.516 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.516 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.516 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.516 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.516 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.516 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.516 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.517 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.517 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.517 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.517 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.517 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.517 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.517 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.517 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.517 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.517 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.517 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.517 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.517 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.517 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.517 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.518 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.518 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.518 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.518 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.518 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.518 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.518 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.518 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.518 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.518 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.518 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.518 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.518 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.518 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.519 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.519 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.519 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.519 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.519 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.519 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.519 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.519 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.519 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.519 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.519 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.519 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.519 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.520 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.520 INFO:teuthology.orchestra.run.smithi026.stdout: "predict_interval": { 2023-12-01T01:07:01.520 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "predict_interval", 2023-12-01T01:07:01.520 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.520 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.520 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.520 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "86400", 2023-12-01T01:07:01.520 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.520 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.520 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.520 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.520 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.520 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.521 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.521 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.521 INFO:teuthology.orchestra.run.smithi026.stdout: "predictor_model": { 2023-12-01T01:07:01.521 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "predictor_model", 2023-12-01T01:07:01.521 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.521 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.521 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.521 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "prophetstor", 2023-12-01T01:07:01.521 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.521 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.521 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.521 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.521 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.522 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.522 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.522 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.522 INFO:teuthology.orchestra.run.smithi026.stdout: "sleep_interval": { 2023-12-01T01:07:01.522 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "sleep_interval", 2023-12-01T01:07:01.522 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.522 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.525 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.525 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "600", 2023-12-01T01:07:01.525 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.525 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.525 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.525 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.525 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.525 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.525 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.525 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.525 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.526 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.526 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.526 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "influx", 2023-12-01T01:07:01.526 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": false, 2023-12-01T01:07:01.526 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "influxdb python module not found", 2023-12-01T01:07:01.526 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.526 INFO:teuthology.orchestra.run.smithi026.stdout: "batch_size": { 2023-12-01T01:07:01.526 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "batch_size", 2023-12-01T01:07:01.526 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.526 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.526 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.526 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "5000", 2023-12-01T01:07:01.526 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.526 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.527 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.527 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-12-01T01:07:01.527 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.527 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.527 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.527 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.527 INFO:teuthology.orchestra.run.smithi026.stdout: "database": { 2023-12-01T01:07:01.527 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "database", 2023-12-01T01:07:01.527 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.527 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.527 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.527 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "ceph", 2023-12-01T01:07:01.527 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.527 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.527 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.528 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-12-01T01:07:01.528 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.528 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.528 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.528 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.528 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": { 2023-12-01T01:07:01.528 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "hostname", 2023-12-01T01:07:01.528 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.528 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.528 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.528 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.528 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.528 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.528 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.528 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "InfluxDB server hostname", 2023-12-01T01:07:01.529 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.529 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.529 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.529 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.529 INFO:teuthology.orchestra.run.smithi026.stdout: "interval": { 2023-12-01T01:07:01.529 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "interval", 2023-12-01T01:07:01.529 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.529 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.529 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.529 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "30", 2023-12-01T01:07:01.529 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "5", 2023-12-01T01:07:01.529 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.529 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.529 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-12-01T01:07:01.529 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.529 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.530 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.530 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.530 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.530 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.530 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.530 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.530 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.530 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.530 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.530 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.530 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.530 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.530 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.530 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.531 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.531 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.531 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.531 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.531 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.531 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.531 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.531 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.531 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.531 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.531 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.531 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.531 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.531 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.532 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.532 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.532 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.532 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.532 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.532 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.532 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.532 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.532 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.532 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.532 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.532 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.532 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.532 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.532 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.533 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.533 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.533 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.533 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.533 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.533 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.533 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.533 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.533 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.533 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.533 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.533 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.533 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.533 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.534 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.534 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.534 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.534 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.534 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.534 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.534 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.534 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.534 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.534 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.534 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.535 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.535 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.535 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.535 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.535 INFO:teuthology.orchestra.run.smithi026.stdout: "password": { 2023-12-01T01:07:01.535 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "password", 2023-12-01T01:07:01.535 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.535 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.535 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.535 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.535 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.535 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.536 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.536 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "password of InfluxDB server user", 2023-12-01T01:07:01.536 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.536 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.536 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.536 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.536 INFO:teuthology.orchestra.run.smithi026.stdout: "port": { 2023-12-01T01:07:01.536 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "port", 2023-12-01T01:07:01.536 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.536 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.536 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.536 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "8086", 2023-12-01T01:07:01.536 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.536 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.536 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.537 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "InfluxDB server port", 2023-12-01T01:07:01.537 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.537 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.537 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.537 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.537 INFO:teuthology.orchestra.run.smithi026.stdout: "ssl": { 2023-12-01T01:07:01.537 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ssl", 2023-12-01T01:07:01.537 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.537 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.537 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.537 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "false", 2023-12-01T01:07:01.537 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.537 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.537 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.538 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-12-01T01:07:01.538 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.538 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.538 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.538 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.538 INFO:teuthology.orchestra.run.smithi026.stdout: "threads": { 2023-12-01T01:07:01.538 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "threads", 2023-12-01T01:07:01.538 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.538 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.538 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.538 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "5", 2023-12-01T01:07:01.538 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "1", 2023-12-01T01:07:01.538 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "32", 2023-12-01T01:07:01.539 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.539 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-12-01T01:07:01.539 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.539 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.539 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.539 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.539 INFO:teuthology.orchestra.run.smithi026.stdout: "username": { 2023-12-01T01:07:01.539 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "username", 2023-12-01T01:07:01.539 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.539 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.539 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.539 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.539 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.539 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.540 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.540 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "username of InfluxDB server user", 2023-12-01T01:07:01.540 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.540 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.540 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.540 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.540 INFO:teuthology.orchestra.run.smithi026.stdout: "verify_ssl": { 2023-12-01T01:07:01.540 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "verify_ssl", 2023-12-01T01:07:01.540 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.540 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.540 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.540 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "true", 2023-12-01T01:07:01.540 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.540 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.541 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.541 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-12-01T01:07:01.541 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.541 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.541 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.541 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.541 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.541 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.541 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.541 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "insights", 2023-12-01T01:07:01.541 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.541 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.541 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.542 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.542 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.542 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.542 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.542 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.542 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.542 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.542 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.542 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.542 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.542 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.542 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.542 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.542 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.543 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.543 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.543 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.543 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.543 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.543 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.543 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.543 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.543 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.543 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.543 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.543 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.543 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.544 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.544 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.544 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.544 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.544 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.544 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.544 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.544 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.544 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.544 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.544 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.544 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.544 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.544 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.545 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.545 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.545 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.545 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.545 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.545 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.545 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.545 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.545 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.545 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.545 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.545 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.545 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.545 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.546 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.546 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.546 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.546 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.546 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.546 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.546 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.546 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.546 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.546 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.546 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.546 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.546 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.546 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.547 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.547 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.547 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.547 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.547 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "iostat", 2023-12-01T01:07:01.547 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.547 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.547 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.547 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.547 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.547 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.547 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.547 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.547 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.547 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.548 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.548 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.548 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.548 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.548 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.548 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.548 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.548 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.548 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.548 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.548 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.548 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.548 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.548 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.548 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.549 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.549 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.549 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.549 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.549 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.549 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.549 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.549 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.549 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.549 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.549 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.549 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.549 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.549 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.549 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.550 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.550 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.550 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.550 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.550 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.550 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.550 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.550 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.550 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.550 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.550 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.550 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.550 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.550 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.550 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.551 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.551 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.551 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.551 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.551 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.551 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.551 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.551 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.551 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.551 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.551 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.551 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.551 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.551 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.551 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "k8sevents", 2023-12-01T01:07:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_event_retention_days": { 2023-12-01T01:07:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ceph_event_retention_days", 2023-12-01T01:07:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.552 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "7", 2023-12-01T01:07:01.553 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.553 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.553 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.553 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Days to hold ceph event information within local cache", 2023-12-01T01:07:01.553 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.553 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.553 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.553 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.553 INFO:teuthology.orchestra.run.smithi026.stdout: "config_check_secs": { 2023-12-01T01:07:01.553 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "config_check_secs", 2023-12-01T01:07:01.553 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.553 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.553 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.553 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:01.553 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "10", 2023-12-01T01:07:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-12-01T01:07:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.554 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.555 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.555 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.555 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.555 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.555 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.555 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.555 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.555 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.555 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.555 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.555 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.555 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.555 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.555 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.555 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.555 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.556 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.556 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.556 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.556 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.556 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.556 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.556 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.556 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.556 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.556 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.556 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.556 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.556 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.556 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.556 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.556 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.557 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.557 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.557 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.557 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.557 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.557 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.557 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.557 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.557 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.557 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.557 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.557 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.557 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.557 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.557 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.558 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.558 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.558 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.558 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.558 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.558 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.558 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.558 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.558 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.558 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.558 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.558 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.558 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.559 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.559 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.559 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.559 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.559 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.559 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "localpool", 2023-12-01T01:07:01.559 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.559 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.559 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.559 INFO:teuthology.orchestra.run.smithi026.stdout: "failure_domain": { 2023-12-01T01:07:01.559 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "failure_domain", 2023-12-01T01:07:01.559 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.559 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.559 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.559 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "host", 2023-12-01T01:07:01.560 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.560 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.560 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.560 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "failure domain for any created local pool", 2023-12-01T01:07:01.560 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-12-01T01:07:01.560 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.560 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.560 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.560 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.560 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.560 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.560 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.560 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.560 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.560 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.561 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.561 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.561 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.561 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.561 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.561 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.561 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.561 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.561 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.561 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.561 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.561 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.561 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.561 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.561 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.562 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.562 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.562 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.562 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.562 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.562 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.562 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.562 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.562 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.562 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.562 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.562 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.562 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.562 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.563 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.563 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.563 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.563 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.563 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.563 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.563 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.563 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.563 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.563 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.563 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.563 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.563 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.563 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.563 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.564 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.564 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.564 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.564 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.564 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.564 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.564 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.564 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.564 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.564 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.564 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.564 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.564 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.564 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.564 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.564 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.565 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.565 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.565 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.565 INFO:teuthology.orchestra.run.smithi026.stdout: "min_size": { 2023-12-01T01:07:01.565 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "min_size", 2023-12-01T01:07:01.565 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.565 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.565 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.565 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.565 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.565 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.565 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.565 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "default min_size for any created local pool", 2023-12-01T01:07:01.565 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-12-01T01:07:01.565 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.566 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.566 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.566 INFO:teuthology.orchestra.run.smithi026.stdout: "num_rep": { 2023-12-01T01:07:01.566 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "num_rep", 2023-12-01T01:07:01.566 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.566 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.566 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.566 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "3", 2023-12-01T01:07:01.566 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.566 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.566 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.566 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "default replica count for any created local pool", 2023-12-01T01:07:01.566 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.566 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.566 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.567 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.567 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num": { 2023-12-01T01:07:01.567 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "pg_num", 2023-12-01T01:07:01.567 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.567 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.567 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.567 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "128", 2023-12-01T01:07:01.567 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.567 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.567 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.567 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "default pg_num for any created local pool", 2023-12-01T01:07:01.567 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.567 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.567 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.567 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.568 INFO:teuthology.orchestra.run.smithi026.stdout: "prefix": { 2023-12-01T01:07:01.568 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "prefix", 2023-12-01T01:07:01.568 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.568 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.568 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.568 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.568 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.568 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.568 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.568 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "name prefix for any created local pool", 2023-12-01T01:07:01.568 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.568 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.568 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.568 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.568 INFO:teuthology.orchestra.run.smithi026.stdout: "subtree": { 2023-12-01T01:07:01.569 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "subtree", 2023-12-01T01:07:01.569 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.569 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.569 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.569 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "rack", 2023-12-01T01:07:01.569 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.569 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.569 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.569 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "CRUSH level for which to create a local pool", 2023-12-01T01:07:01.569 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-12-01T01:07:01.569 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.569 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.569 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.569 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.569 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.569 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.570 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mds_autoscaler", 2023-12-01T01:07:01.570 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.570 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.570 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.570 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.570 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.570 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.570 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.570 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.570 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.570 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.570 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.570 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.570 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.570 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.571 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.571 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.571 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.571 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.571 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.571 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.571 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.571 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.571 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.571 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.571 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.571 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.571 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.571 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.572 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.572 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.572 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.572 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.572 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.572 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.572 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.572 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.572 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.572 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.572 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.572 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.572 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.572 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.572 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.573 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.573 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.573 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.573 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.573 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.573 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.573 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.573 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.573 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.573 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.573 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.573 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.573 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.573 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.573 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.574 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.574 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.574 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.574 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.574 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.574 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.574 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.574 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.574 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.574 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.574 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.574 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.574 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.574 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.574 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.575 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.575 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.575 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.575 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mirroring", 2023-12-01T01:07:01.575 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.575 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.575 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.575 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.575 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.575 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.575 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.575 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.575 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.575 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.576 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.576 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.576 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.576 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.576 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.576 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.576 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.576 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.576 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.576 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.576 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.576 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.576 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.576 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.576 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.577 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.577 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.577 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.577 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.577 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.577 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.577 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.577 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.577 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.577 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.577 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.577 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.577 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.577 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.577 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.577 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.578 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.578 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.578 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.578 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.578 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.578 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.578 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.578 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.578 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.578 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.578 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.578 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.578 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.578 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.578 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.579 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.579 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.579 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.579 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.579 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.579 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.579 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.579 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.579 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.579 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.579 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.579 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.579 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.579 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.579 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.580 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.580 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.580 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.580 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.580 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.580 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "nfs", 2023-12-01T01:07:01.580 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.580 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.580 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.580 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.580 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.580 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.580 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.580 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.581 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.581 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.581 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.581 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.581 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.581 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.581 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.581 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.581 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.581 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.581 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.581 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.581 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.581 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.581 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.582 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.582 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.582 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.582 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.582 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.582 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.582 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.582 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.582 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.582 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.582 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.582 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.582 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.582 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.582 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.583 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.583 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.583 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.583 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.583 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.583 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.583 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.583 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.583 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.583 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.583 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.583 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.583 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.583 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.583 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.583 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.584 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.584 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.584 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.584 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.584 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.584 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.584 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.584 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.584 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.584 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.584 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.584 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.584 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.585 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.585 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.585 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.585 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.585 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.585 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.585 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.585 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.585 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.585 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "orchestrator", 2023-12-01T01:07:01.585 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.585 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.585 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.585 INFO:teuthology.orchestra.run.smithi026.stdout: "fail_fs": { 2023-12-01T01:07:01.585 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "fail_fs", 2023-12-01T01:07:01.586 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.586 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.586 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.586 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.586 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.586 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.586 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.586 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-12-01T01:07:01.586 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.586 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.586 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.586 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.586 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.586 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.586 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.587 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.587 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.587 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.587 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.587 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.587 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.587 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.587 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.587 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.587 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.587 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.587 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.587 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.587 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.587 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.588 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.588 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.588 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.588 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.588 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.588 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.588 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.588 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.588 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.588 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.588 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.588 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.588 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.588 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.588 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.588 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.589 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.589 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.589 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.589 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.589 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.589 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.589 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.589 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.589 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.589 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.589 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.589 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.589 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.589 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.589 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.590 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.590 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.590 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.590 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.590 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.590 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.590 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.590 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.590 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.590 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.590 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.590 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.590 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.590 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.590 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "orchestrator": { 2023-12-01T01:07:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "orchestrator", 2023-12-01T01:07:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.591 INFO:teuthology.orchestra.run.smithi026.stdout: "cephadm", 2023-12-01T01:07:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: "rook", 2023-12-01T01:07:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: "test_orchestrator" 2023-12-01T01:07:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Orchestrator backend", 2023-12-01T01:07:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "osd_perf_query", 2023-12-01T01:07:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.592 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.594 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.595 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.596 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.597 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.597 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.597 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.597 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.597 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.597 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.597 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.597 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.597 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.597 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.597 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.597 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.598 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.598 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "osd_support", 2023-12-01T01:07:01.598 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.598 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.598 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.598 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.598 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.598 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.598 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.598 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.598 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.598 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.598 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.598 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.598 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.599 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.599 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.599 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.599 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.599 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.599 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.599 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.599 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.599 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.599 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.599 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.599 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.599 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.599 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.599 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.600 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.600 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.600 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.600 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.600 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.600 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.600 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.600 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.600 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.600 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.600 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.600 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.600 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.600 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.600 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.601 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.601 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.601 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.601 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.601 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.601 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.601 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.601 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.601 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.601 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.601 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.601 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.601 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.601 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.601 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.601 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.602 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.602 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.602 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.602 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.602 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.602 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.602 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.602 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.602 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.602 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.602 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.602 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.602 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.602 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.603 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.603 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.603 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.603 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "pg_autoscaler", 2023-12-01T01:07:01.603 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.603 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.603 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.603 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.603 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.603 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.603 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.603 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.603 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.603 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.603 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.604 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.604 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.604 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.604 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.604 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.604 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.604 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.604 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.604 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.604 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.604 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.604 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.604 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.604 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.604 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.604 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.605 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.605 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.605 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.605 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.605 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.605 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.605 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.605 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.605 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.605 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.605 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.605 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.605 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.605 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.605 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.606 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.606 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.606 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.606 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.606 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.606 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.606 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.606 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.606 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.606 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.606 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.606 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.606 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.606 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.607 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.607 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.607 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.607 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.607 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.607 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.607 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.607 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.607 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.607 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.607 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.607 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.607 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.607 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.607 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.608 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.608 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.608 INFO:teuthology.orchestra.run.smithi026.stdout: "sleep_interval": { 2023-12-01T01:07:01.608 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "sleep_interval", 2023-12-01T01:07:01.608 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.608 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.608 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.608 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "60", 2023-12-01T01:07:01.608 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.608 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.608 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.608 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.608 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.608 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.608 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.609 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.609 INFO:teuthology.orchestra.run.smithi026.stdout: "threshold": { 2023-12-01T01:07:01.609 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "threshold", 2023-12-01T01:07:01.609 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:01.609 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.609 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.609 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "3.0", 2023-12-01T01:07:01.609 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "1.0", 2023-12-01T01:07:01.609 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.609 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.609 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "scaling threshold", 2023-12-01T01:07:01.609 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-12-01T01:07:01.609 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.609 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.701 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.701 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.701 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.701 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "progress", 2023-12-01T01:07:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: "allow_pg_recovery_event": { 2023-12-01T01:07:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "allow_pg_recovery_event", 2023-12-01T01:07:01.702 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.703 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.703 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.703 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.703 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.703 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.703 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.703 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "allow the module to show pg recovery progress", 2023-12-01T01:07:01.704 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.704 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.704 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.704 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.704 INFO:teuthology.orchestra.run.smithi026.stdout: "enabled": { 2023-12-01T01:07:01.704 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "enabled", 2023-12-01T01:07:01.704 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.704 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.705 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.705 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.705 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.705 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.705 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.705 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.705 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.705 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.705 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.705 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.705 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.706 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.706 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.706 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.706 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.706 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.706 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.706 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.706 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.707 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.707 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.707 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.707 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.707 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.707 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.707 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.707 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.708 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.708 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.708 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.708 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.708 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.708 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.708 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.708 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.708 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.708 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.708 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.709 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.709 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.709 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.709 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.709 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.709 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.709 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.709 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.709 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.709 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.709 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.709 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.709 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.710 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.710 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.710 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.710 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.710 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.710 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.710 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.710 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.710 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.710 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.710 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.710 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.711 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.711 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.711 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.711 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.711 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.711 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.711 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.711 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.711 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.712 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.712 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.712 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.712 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.712 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.712 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.712 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.712 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.712 INFO:teuthology.orchestra.run.smithi026.stdout: "max_completed_events": { 2023-12-01T01:07:01.712 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "max_completed_events", 2023-12-01T01:07:01.713 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.713 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.713 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.713 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "50", 2023-12-01T01:07:01.713 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.713 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.713 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.713 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "number of past completed events to remember", 2023-12-01T01:07:01.713 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.713 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.714 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.714 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.714 INFO:teuthology.orchestra.run.smithi026.stdout: "sleep_interval": { 2023-12-01T01:07:01.714 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "sleep_interval", 2023-12-01T01:07:01.714 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.714 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.714 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.714 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "5", 2023-12-01T01:07:01.714 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how long the module is going to sleep", 2023-12-01T01:07:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.715 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "prometheus", 2023-12-01T01:07:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: "cache": { 2023-12-01T01:07:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cache", 2023-12-01T01:07:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.716 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: "exclude_perf_counters": { 2023-12-01T01:07:01.717 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "exclude_perf_counters", 2023-12-01T01:07:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-12-01T01:07:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-12-01T01:07:01.718 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.719 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.720 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.721 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.722 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.723 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.724 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.724 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.724 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.724 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.724 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.724 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.724 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.724 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.724 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.724 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.724 INFO:teuthology.orchestra.run.smithi026.stdout: "rbd_stats_pools": { 2023-12-01T01:07:01.724 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rbd_stats_pools", 2023-12-01T01:07:01.724 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.724 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.725 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.725 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.725 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.725 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.725 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.725 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.725 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.725 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.725 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.725 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.725 INFO:teuthology.orchestra.run.smithi026.stdout: "rbd_stats_pools_refresh_interval": { 2023-12-01T01:07:01.725 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-12-01T01:07:01.725 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.725 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.725 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.726 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "300", 2023-12-01T01:07:01.726 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.726 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.726 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.726 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.726 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.726 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.726 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.726 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.726 INFO:teuthology.orchestra.run.smithi026.stdout: "scrape_interval": { 2023-12-01T01:07:01.726 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "scrape_interval", 2023-12-01T01:07:01.726 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:01.726 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.727 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.727 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "15.0", 2023-12-01T01:07:01.727 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.727 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.727 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.727 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.729 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.729 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.729 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.729 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.729 INFO:teuthology.orchestra.run.smithi026.stdout: "server_addr": { 2023-12-01T01:07:01.729 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_addr", 2023-12-01T01:07:01.729 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.729 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.729 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.729 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "::", 2023-12-01T01:07:01.729 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.730 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.730 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.730 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-12-01T01:07:01.730 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.730 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.730 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.730 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.730 INFO:teuthology.orchestra.run.smithi026.stdout: "server_port": { 2023-12-01T01:07:01.730 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_port", 2023-12-01T01:07:01.730 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.730 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.730 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.731 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "9283", 2023-12-01T01:07:01.731 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.731 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.731 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.731 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-12-01T01:07:01.731 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.731 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.731 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.731 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.731 INFO:teuthology.orchestra.run.smithi026.stdout: "stale_cache_strategy": { 2023-12-01T01:07:01.731 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "stale_cache_strategy", 2023-12-01T01:07:01.731 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.731 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.731 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.732 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "log", 2023-12-01T01:07:01.732 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.732 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.732 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.732 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.732 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.732 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.732 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.732 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.732 INFO:teuthology.orchestra.run.smithi026.stdout: "standby_behaviour": { 2023-12-01T01:07:01.732 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "standby_behaviour", 2023-12-01T01:07:01.732 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.732 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.733 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.733 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "default", 2023-12-01T01:07:01.733 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.733 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.733 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.733 INFO:teuthology.orchestra.run.smithi026.stdout: "default", 2023-12-01T01:07:01.733 INFO:teuthology.orchestra.run.smithi026.stdout: "error" 2023-12-01T01:07:01.733 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.733 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.733 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.733 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.733 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.733 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.733 INFO:teuthology.orchestra.run.smithi026.stdout: "standby_error_status_code": { 2023-12-01T01:07:01.733 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "standby_error_status_code", 2023-12-01T01:07:01.734 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.734 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.734 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.734 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "500", 2023-12-01T01:07:01.734 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "400", 2023-12-01T01:07:01.734 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "599", 2023-12-01T01:07:01.734 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.734 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.734 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.734 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.734 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.734 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.735 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.735 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.735 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.735 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rbd_support", 2023-12-01T01:07:01.735 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.735 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.735 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.735 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.735 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.735 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.735 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.735 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.735 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.736 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.736 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.736 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.736 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.736 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.736 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.736 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.736 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.736 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.736 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.736 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.736 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.737 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.737 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.737 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.737 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.737 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.737 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.737 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.737 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.737 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.737 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.738 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.738 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.738 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.738 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.738 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.738 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.738 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.738 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.738 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.738 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.738 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.739 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.739 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.739 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.739 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.739 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.739 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.739 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.739 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.739 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.739 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.739 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.739 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.739 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.739 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.739 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.740 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.740 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.740 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.740 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.740 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.740 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.740 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.740 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.740 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.740 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.740 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.740 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.740 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.741 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.741 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.741 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.741 INFO:teuthology.orchestra.run.smithi026.stdout: "max_concurrent_snap_create": { 2023-12-01T01:07:01.741 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "max_concurrent_snap_create", 2023-12-01T01:07:01.741 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.741 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.741 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.741 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:01.741 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.741 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.741 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.741 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.741 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.741 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.742 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.742 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.742 INFO:teuthology.orchestra.run.smithi026.stdout: "mirror_snapshot_schedule": { 2023-12-01T01:07:01.742 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mirror_snapshot_schedule", 2023-12-01T01:07:01.742 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.742 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.742 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.742 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.742 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.742 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.742 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.742 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.742 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.743 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.743 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.743 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.743 INFO:teuthology.orchestra.run.smithi026.stdout: "trash_purge_schedule": { 2023-12-01T01:07:01.743 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "trash_purge_schedule", 2023-12-01T01:07:01.743 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.743 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.743 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.743 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.743 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.743 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.743 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.743 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.743 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.744 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.744 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.744 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.744 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.744 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.744 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.744 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "restful", 2023-12-01T01:07:01.744 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.744 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.744 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.744 INFO:teuthology.orchestra.run.smithi026.stdout: "enable_auth": { 2023-12-01T01:07:01.744 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "enable_auth", 2023-12-01T01:07:01.744 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.744 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.745 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.745 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.745 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.745 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.745 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.745 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.745 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.745 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.745 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.745 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.745 INFO:teuthology.orchestra.run.smithi026.stdout: "key_file": { 2023-12-01T01:07:01.745 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "key_file", 2023-12-01T01:07:01.746 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.746 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.746 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.746 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.746 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.746 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.746 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.746 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.746 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.746 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.746 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.747 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.747 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.747 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.747 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.747 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.747 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.747 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.747 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.747 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.747 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.747 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.747 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.747 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.747 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.747 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.748 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.748 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.748 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.748 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.748 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.748 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.748 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.748 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.748 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.748 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.748 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.748 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.748 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.748 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.748 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.749 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.749 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.749 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.749 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.749 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.749 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.749 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.749 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.749 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.749 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.749 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.749 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.749 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.749 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.749 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.749 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.750 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.750 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.750 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.750 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.750 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.750 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.750 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.750 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.750 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.750 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.750 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.750 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.750 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.750 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.750 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.751 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.751 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.751 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.751 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.751 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.751 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.751 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.751 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.751 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.751 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.752 INFO:teuthology.orchestra.run.smithi026.stdout: "server_addr": { 2023-12-01T01:07:01.752 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_addr", 2023-12-01T01:07:01.752 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.752 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.752 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.752 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.752 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.752 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.752 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.752 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.752 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.752 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.752 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.752 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.753 INFO:teuthology.orchestra.run.smithi026.stdout: "server_port": { 2023-12-01T01:07:01.753 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_port", 2023-12-01T01:07:01.753 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.753 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.753 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.753 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.753 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.753 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.753 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.753 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.753 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.753 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.753 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.754 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.754 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.754 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.754 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.754 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rgw", 2023-12-01T01:07:01.754 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.754 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.754 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.754 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.754 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.754 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.754 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.754 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.754 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.755 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.755 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.755 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.755 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.755 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.755 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.755 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.755 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.755 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.755 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.755 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.755 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.755 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.755 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.755 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.756 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.756 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.756 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.756 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.756 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.756 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.756 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.756 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.756 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.756 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.756 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.756 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.756 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.756 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.756 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.757 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.757 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.757 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.757 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.757 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.757 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.757 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.757 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.757 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.757 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.757 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.757 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.757 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.757 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.758 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.758 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.758 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.758 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.758 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.758 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.758 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.758 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.758 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.758 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.758 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.758 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.758 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.758 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.759 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.759 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.759 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.759 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.759 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.759 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.759 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.759 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.759 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.759 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rook", 2023-12-01T01:07:01.759 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.759 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.759 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.759 INFO:teuthology.orchestra.run.smithi026.stdout: "drive_group_interval": { 2023-12-01T01:07:01.759 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "drive_group_interval", 2023-12-01T01:07:01.760 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:01.760 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.760 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.760 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "300.0", 2023-12-01T01:07:01.760 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.760 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.760 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.760 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-12-01T01:07:01.760 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.760 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.760 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.760 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.760 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.760 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.760 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.761 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.761 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.761 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.761 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.761 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.761 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.761 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.761 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.761 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.761 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.761 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.761 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.761 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.761 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.761 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.761 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.762 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.762 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.762 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.762 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.762 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.762 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.762 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.762 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.762 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.762 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.762 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.762 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.762 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.762 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.762 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.763 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.763 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.763 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.763 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.763 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.763 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.763 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.763 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.763 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.763 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.763 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.763 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.763 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.763 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.763 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.764 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.764 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.764 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.764 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.764 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.764 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.764 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.764 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.764 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.764 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.764 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.764 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.764 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.764 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.764 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.765 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.765 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.765 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.765 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.765 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.765 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.765 INFO:teuthology.orchestra.run.smithi026.stdout: "storage_class": { 2023-12-01T01:07:01.765 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "storage_class", 2023-12-01T01:07:01.765 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.765 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.765 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.765 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "local", 2023-12-01T01:07:01.765 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.766 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.766 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.766 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-12-01T01:07:01.766 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.766 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.766 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.766 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.766 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.766 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.766 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.766 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "selftest", 2023-12-01T01:07:01.766 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.766 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.766 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.767 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.767 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.767 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.767 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.767 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.767 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.767 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.767 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.767 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.767 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.767 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.767 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.767 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.767 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.767 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.768 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.768 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.768 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.768 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.768 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.768 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.768 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.768 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.768 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.768 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.768 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.768 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.769 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.769 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.769 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.769 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.769 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.769 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.769 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.769 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.769 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.769 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.769 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.769 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.769 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.769 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.770 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.770 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.770 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.770 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.770 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.770 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.770 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.770 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.770 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.770 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.770 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.770 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.770 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.770 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.770 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.771 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.771 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.771 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.771 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.771 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.771 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.771 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.771 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.771 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.771 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.771 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.771 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.771 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.771 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.771 INFO:teuthology.orchestra.run.smithi026.stdout: "roption1": { 2023-12-01T01:07:01.772 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "roption1", 2023-12-01T01:07:01.772 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.772 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.772 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.772 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.772 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.772 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.772 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.772 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.772 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.772 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.772 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.772 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.772 INFO:teuthology.orchestra.run.smithi026.stdout: "roption2": { 2023-12-01T01:07:01.772 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "roption2", 2023-12-01T01:07:01.772 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.773 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.773 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.773 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "xyz", 2023-12-01T01:07:01.773 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.773 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.773 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.773 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.773 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.773 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.773 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.773 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.773 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption1": { 2023-12-01T01:07:01.773 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption1", 2023-12-01T01:07:01.773 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.773 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.774 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.774 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.774 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.774 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.774 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.774 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.774 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.774 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.774 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.774 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.774 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption2": { 2023-12-01T01:07:01.774 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption2", 2023-12-01T01:07:01.774 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.774 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.775 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.775 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.775 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.775 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.775 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.775 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.775 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.775 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.775 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.775 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.775 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption3": { 2023-12-01T01:07:01.775 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption3", 2023-12-01T01:07:01.775 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:01.775 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.775 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.775 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.776 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.776 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.776 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.776 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.776 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.776 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.776 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.776 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.776 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption4": { 2023-12-01T01:07:01.776 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption4", 2023-12-01T01:07:01.776 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.776 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.776 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.776 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.777 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.777 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.777 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.777 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.777 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.777 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.777 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.777 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.777 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption5": { 2023-12-01T01:07:01.777 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption5", 2023-12-01T01:07:01.777 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.777 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.777 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.777 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.777 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.778 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.778 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.778 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.778 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.778 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.778 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.778 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.778 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption6": { 2023-12-01T01:07:01.778 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption6", 2023-12-01T01:07:01.778 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.778 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.778 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.778 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.779 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.779 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.779 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.779 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.779 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.779 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.779 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.779 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.779 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption7": { 2023-12-01T01:07:01.779 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption7", 2023-12-01T01:07:01.779 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.779 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.779 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.779 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.779 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "1", 2023-12-01T01:07:01.780 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "42", 2023-12-01T01:07:01.780 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.780 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.780 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.780 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.780 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.780 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.780 INFO:teuthology.orchestra.run.smithi026.stdout: "testkey": { 2023-12-01T01:07:01.780 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "testkey", 2023-12-01T01:07:01.780 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.780 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.781 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.781 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.781 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.781 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.781 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.781 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.781 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.781 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.781 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.781 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.782 INFO:teuthology.orchestra.run.smithi026.stdout: "testlkey": { 2023-12-01T01:07:01.782 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "testlkey", 2023-12-01T01:07:01.782 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.782 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.782 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.782 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.782 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.782 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.782 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.782 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.782 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.782 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.782 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.782 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.783 INFO:teuthology.orchestra.run.smithi026.stdout: "testnewline": { 2023-12-01T01:07:01.783 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "testnewline", 2023-12-01T01:07:01.783 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.783 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.783 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.783 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.783 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.783 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.783 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.783 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.783 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.783 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.783 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.783 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.783 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.784 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.784 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.784 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "snap_schedule", 2023-12-01T01:07:01.784 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.784 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.784 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.784 INFO:teuthology.orchestra.run.smithi026.stdout: "allow_m_granularity": { 2023-12-01T01:07:01.784 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "allow_m_granularity", 2023-12-01T01:07:01.784 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.784 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.784 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.784 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.784 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.784 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.784 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.785 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "allow minute scheduled snapshots", 2023-12-01T01:07:01.785 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.785 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.785 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.785 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.785 INFO:teuthology.orchestra.run.smithi026.stdout: "dump_on_update": { 2023-12-01T01:07:01.785 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "dump_on_update", 2023-12-01T01:07:01.785 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.785 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.785 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.785 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.785 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.785 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.785 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.785 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "dump database to debug log on update", 2023-12-01T01:07:01.786 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.786 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.786 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.786 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.786 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.786 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.786 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.786 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.786 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.786 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.786 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.786 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.786 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.786 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.787 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.787 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.787 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.787 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.787 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.787 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.787 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.787 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.787 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.787 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.787 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.787 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.787 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.787 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.788 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.788 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.788 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.788 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.788 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.788 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.788 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.788 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.788 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.788 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.788 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.788 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.788 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.788 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.788 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.789 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.789 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.789 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.789 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.789 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.789 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.789 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.789 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.789 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.789 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.789 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.789 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.789 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.789 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.790 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.790 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.790 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.790 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.790 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.790 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.790 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.790 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.790 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.790 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.790 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.790 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.790 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.790 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.790 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.791 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.791 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.791 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.791 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.791 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.791 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "stats", 2023-12-01T01:07:01.791 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.791 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.791 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.791 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.791 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.791 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.791 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.791 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.791 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.792 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.792 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.792 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.792 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.792 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.792 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.792 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.792 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.792 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.792 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.792 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.792 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.792 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.793 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.793 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.793 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.793 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.793 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.793 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.793 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.793 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.793 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.793 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.793 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.793 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.793 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.793 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.793 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.794 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.794 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.794 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.794 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.794 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.794 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.794 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.794 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.794 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.794 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.794 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.794 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.794 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.794 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.795 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.795 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.795 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.795 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.795 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.795 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.795 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.795 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.795 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.795 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.795 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.795 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.795 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.795 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.795 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.796 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.796 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.796 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.796 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.796 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.796 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.796 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.796 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.796 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.796 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.796 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "status", 2023-12-01T01:07:01.796 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.796 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.796 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.796 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.796 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.797 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.797 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.797 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.797 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.797 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.797 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.797 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.797 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.797 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.797 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.797 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.797 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.797 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.797 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.797 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.798 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.798 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.798 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.798 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.798 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.798 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.798 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.798 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.798 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.798 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.798 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.798 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.798 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.798 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.798 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.799 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.799 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.799 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.799 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.799 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.799 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.799 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.799 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.799 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.799 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.799 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.799 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.799 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.799 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.799 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.800 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.800 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.800 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.800 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.800 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.800 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.800 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.800 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.800 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.800 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.800 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.800 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.800 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.800 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.800 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.800 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.801 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.801 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.801 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.801 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.801 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.801 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.801 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.801 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.801 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.801 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.801 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "telegraf", 2023-12-01T01:07:01.801 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.801 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.801 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.802 INFO:teuthology.orchestra.run.smithi026.stdout: "address": { 2023-12-01T01:07:01.802 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "address", 2023-12-01T01:07:01.802 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.802 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.802 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.802 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-12-01T01:07:01.802 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.802 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.802 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.802 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.802 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.802 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.802 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.802 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.802 INFO:teuthology.orchestra.run.smithi026.stdout: "interval": { 2023-12-01T01:07:01.803 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "interval", 2023-12-01T01:07:01.803 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.803 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.803 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.803 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "15", 2023-12-01T01:07:01.803 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.803 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.803 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.803 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.803 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.803 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.803 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.803 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.803 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.803 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.804 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.804 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.804 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.804 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.804 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.804 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.804 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.804 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.804 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.804 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.804 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.804 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.804 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.804 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.804 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.804 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.805 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.805 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.805 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.805 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.805 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.805 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.805 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.805 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.805 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.805 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.805 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.805 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.805 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.805 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.805 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.806 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.806 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.806 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.806 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.806 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.806 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.806 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.806 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.806 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.806 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.806 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.806 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.806 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.806 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.806 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.807 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.807 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.807 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.807 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.807 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.807 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.807 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.807 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.807 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.807 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.807 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.807 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.807 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.807 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.807 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.808 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.808 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.808 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.808 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.808 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.808 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.808 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.808 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.808 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.808 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.808 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "telemetry", 2023-12-01T01:07:01.808 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.808 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.808 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.808 INFO:teuthology.orchestra.run.smithi026.stdout: "channel_basic": { 2023-12-01T01:07:01.809 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "channel_basic", 2023-12-01T01:07:01.809 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.809 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.809 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.809 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.809 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.809 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.809 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.809 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Share basic cluster information (size, version)", 2023-12-01T01:07:01.809 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.809 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.809 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.809 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.809 INFO:teuthology.orchestra.run.smithi026.stdout: "channel_crash": { 2023-12-01T01:07:01.810 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "channel_crash", 2023-12-01T01:07:01.810 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.810 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.810 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.810 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.810 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.810 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.810 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.810 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-12-01T01:07:01.810 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.810 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.810 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.810 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.810 INFO:teuthology.orchestra.run.smithi026.stdout: "channel_device": { 2023-12-01T01:07:01.811 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "channel_device", 2023-12-01T01:07:01.811 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.811 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.811 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.811 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.811 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.811 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.811 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.811 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-12-01T01:07:01.811 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.811 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.811 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.811 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.811 INFO:teuthology.orchestra.run.smithi026.stdout: "channel_ident": { 2023-12-01T01:07:01.812 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "channel_ident", 2023-12-01T01:07:01.812 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.812 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.812 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.812 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.812 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.812 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.812 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.812 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-12-01T01:07:01.812 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.812 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.812 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.812 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.812 INFO:teuthology.orchestra.run.smithi026.stdout: "channel_perf": { 2023-12-01T01:07:01.812 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "channel_perf", 2023-12-01T01:07:01.812 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.813 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.813 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.813 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.813 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.813 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.813 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.813 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Share various performance metrics of a cluster", 2023-12-01T01:07:01.813 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.813 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.813 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.813 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.813 INFO:teuthology.orchestra.run.smithi026.stdout: "contact": { 2023-12-01T01:07:01.813 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "contact", 2023-12-01T01:07:01.813 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.814 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.814 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.814 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.814 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.814 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.814 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.814 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.814 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.814 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.814 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.814 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.814 INFO:teuthology.orchestra.run.smithi026.stdout: "description": { 2023-12-01T01:07:01.814 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "description", 2023-12-01T01:07:01.814 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.815 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.815 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.815 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.815 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.815 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.815 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.815 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.815 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.815 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.815 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.815 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.815 INFO:teuthology.orchestra.run.smithi026.stdout: "device_url": { 2023-12-01T01:07:01.815 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "device_url", 2023-12-01T01:07:01.815 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.815 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.816 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.816 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-12-01T01:07:01.816 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.816 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.816 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.816 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.816 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.816 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.816 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.816 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.816 INFO:teuthology.orchestra.run.smithi026.stdout: "enabled": { 2023-12-01T01:07:01.816 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "enabled", 2023-12-01T01:07:01.816 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.816 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.817 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.817 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.817 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.817 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.817 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.817 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.817 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.817 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.817 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.817 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.817 INFO:teuthology.orchestra.run.smithi026.stdout: "interval": { 2023-12-01T01:07:01.817 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "interval", 2023-12-01T01:07:01.817 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.817 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.817 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.818 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "24", 2023-12-01T01:07:01.818 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "8", 2023-12-01T01:07:01.818 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.818 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.818 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.818 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.818 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.818 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.818 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.818 INFO:teuthology.orchestra.run.smithi026.stdout: "last_opt_revision": { 2023-12-01T01:07:01.818 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "last_opt_revision", 2023-12-01T01:07:01.818 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.818 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.818 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.819 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "1", 2023-12-01T01:07:01.819 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.819 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.819 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.819 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.819 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.819 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.819 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.819 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.819 INFO:teuthology.orchestra.run.smithi026.stdout: "leaderboard": { 2023-12-01T01:07:01.819 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "leaderboard", 2023-12-01T01:07:01.819 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.819 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.819 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.819 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.820 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.820 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.820 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.820 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.820 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.820 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.820 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.820 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.820 INFO:teuthology.orchestra.run.smithi026.stdout: "leaderboard_description": { 2023-12-01T01:07:01.820 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "leaderboard_description", 2023-12-01T01:07:01.820 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.820 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.820 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.820 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.821 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.821 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.821 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.821 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.821 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.821 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.821 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.821 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.821 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.821 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.821 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.821 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.821 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.821 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.822 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.822 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.822 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.822 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.822 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.822 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.822 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.822 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.822 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.822 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.822 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.822 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.822 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.822 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.822 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.823 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.823 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.823 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.823 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.823 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.823 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.823 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.823 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.823 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.823 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.823 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.823 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.823 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.823 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.823 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.824 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.824 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.824 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.824 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.824 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.824 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.824 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.824 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.824 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.824 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.824 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.824 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.824 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.824 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.825 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.825 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.825 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.825 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.825 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.825 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.825 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.825 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.825 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.825 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.825 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.825 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.825 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.825 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.825 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.826 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.826 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.826 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.826 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.826 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.826 INFO:teuthology.orchestra.run.smithi026.stdout: "organization": { 2023-12-01T01:07:01.826 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "organization", 2023-12-01T01:07:01.826 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.826 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.826 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.826 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.826 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.826 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.826 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.826 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.827 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.827 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.827 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.827 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.827 INFO:teuthology.orchestra.run.smithi026.stdout: "proxy": { 2023-12-01T01:07:01.827 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "proxy", 2023-12-01T01:07:01.827 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.827 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.827 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.827 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.827 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.827 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.827 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.827 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.827 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: "url": { 2023-12-01T01:07:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "url", 2023-12-01T01:07:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-12-01T01:07:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.828 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.829 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.829 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.829 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.829 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.829 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.829 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "test_orchestrator", 2023-12-01T01:07:01.829 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.829 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.829 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.829 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.829 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.829 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.829 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.829 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.829 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.830 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.830 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.830 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.830 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.830 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.830 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.830 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.830 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.830 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.830 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.830 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.830 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.830 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.830 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.830 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.830 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.831 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.831 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.831 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.831 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.831 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.831 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.831 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.831 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.831 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.831 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.831 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.831 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.831 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.831 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.832 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.832 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.832 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.832 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.832 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.832 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.832 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.832 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.832 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.832 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.832 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.832 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.832 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.832 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.833 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.833 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.833 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.833 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.833 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.833 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.833 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.833 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.833 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.833 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.833 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.833 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.833 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.833 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.833 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.834 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.834 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.834 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.834 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.834 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.834 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.834 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.834 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.834 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "volumes", 2023-12-01T01:07:01.834 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.834 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.834 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.834 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.834 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.835 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.835 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.835 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.835 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.835 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.835 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.835 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.835 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.835 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.835 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.835 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.835 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.835 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.835 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.836 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.836 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.836 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.836 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.836 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.836 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.836 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.836 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.836 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.836 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.836 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.836 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.836 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.836 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.837 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.837 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.837 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.837 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.837 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.837 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.837 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.837 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.837 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.837 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.837 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.837 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.837 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.837 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.837 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.837 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.838 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.838 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.838 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.838 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.838 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.838 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.838 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.838 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.838 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.838 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.838 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.838 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.839 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.839 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.839 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.839 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.839 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.839 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.839 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.839 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.839 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.839 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.839 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.839 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.839 INFO:teuthology.orchestra.run.smithi026.stdout: "max_concurrent_clones": { 2023-12-01T01:07:01.839 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "max_concurrent_clones", 2023-12-01T01:07:01.839 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "4", 2023-12-01T01:07:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Number of asynchronous cloner threads", 2023-12-01T01:07:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: "snapshot_clone_delay": { 2023-12-01T01:07:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "snapshot_clone_delay", 2023-12-01T01:07:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.840 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.841 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0", 2023-12-01T01:07:01.841 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.841 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.841 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.841 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-12-01T01:07:01.841 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.841 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.841 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.841 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.841 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.841 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.841 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.841 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "zabbix", 2023-12-01T01:07:01.841 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.841 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.842 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.842 INFO:teuthology.orchestra.run.smithi026.stdout: "discovery_interval": { 2023-12-01T01:07:01.842 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "discovery_interval", 2023-12-01T01:07:01.842 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "uint", 2023-12-01T01:07:01.842 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.842 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.842 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "100", 2023-12-01T01:07:01.842 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.842 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.842 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.842 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.842 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.842 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.842 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.842 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.843 INFO:teuthology.orchestra.run.smithi026.stdout: "identifier": { 2023-12-01T01:07:01.843 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "identifier", 2023-12-01T01:07:01.843 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.843 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.843 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.843 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.843 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.843 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.843 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.843 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.843 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.843 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.843 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.843 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.843 INFO:teuthology.orchestra.run.smithi026.stdout: "interval": { 2023-12-01T01:07:01.844 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "interval", 2023-12-01T01:07:01.844 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.844 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.844 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.844 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "60", 2023-12-01T01:07:01.844 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.844 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.844 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.844 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.844 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.844 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.844 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.844 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.844 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.844 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.844 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.845 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.845 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.845 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.845 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.845 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.845 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.845 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.845 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.845 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.845 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.845 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.845 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.845 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.845 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.846 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.846 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.846 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.846 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.846 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.846 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.846 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.846 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.846 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.846 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.846 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.847 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.847 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.847 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.847 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.847 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.847 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.847 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.847 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.847 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.847 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.847 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.847 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.847 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.847 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.848 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.848 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.848 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.848 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.848 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.848 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.848 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.848 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.848 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.848 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.848 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.848 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.848 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.848 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.848 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.849 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.849 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.849 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.849 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.849 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.849 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.849 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.849 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.849 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.849 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.849 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.849 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.849 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.849 INFO:teuthology.orchestra.run.smithi026.stdout: "zabbix_host": { 2023-12-01T01:07:01.849 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "zabbix_host", 2023-12-01T01:07:01.849 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.850 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.850 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.850 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.850 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.850 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.850 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.850 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.850 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.850 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.850 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.850 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.850 INFO:teuthology.orchestra.run.smithi026.stdout: "zabbix_port": { 2023-12-01T01:07:01.850 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "zabbix_port", 2023-12-01T01:07:01.850 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.850 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.851 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.851 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10051", 2023-12-01T01:07:01.851 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.851 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.851 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.851 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.851 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.851 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.851 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.851 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.851 INFO:teuthology.orchestra.run.smithi026.stdout: "zabbix_sender": { 2023-12-01T01:07:01.851 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "zabbix_sender", 2023-12-01T01:07:01.851 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.851 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.851 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.852 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-12-01T01:07:01.852 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.852 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.852 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.852 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.852 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.852 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.852 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.852 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.852 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.852 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.852 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-12-01T01:07:01.852 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.852 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.853 INFO:teuthology.orchestra.run.smithi026.stdout: "gid": 24116, 2023-12-01T01:07:01.853 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "y", 2023-12-01T01:07:01.853 INFO:teuthology.orchestra.run.smithi026.stdout: "mgr_features": 4540138322906710015, 2023-12-01T01:07:01.853 INFO:teuthology.orchestra.run.smithi026.stdout: "available_modules": [ 2023-12-01T01:07:01.853 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.853 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "alerts", 2023-12-01T01:07:01.853 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.853 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.853 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.853 INFO:teuthology.orchestra.run.smithi026.stdout: "interval": { 2023-12-01T01:07:01.853 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "interval", 2023-12-01T01:07:01.853 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.853 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.853 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.854 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "60", 2023-12-01T01:07:01.854 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.854 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.854 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.854 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "How frequently to reexamine health status", 2023-12-01T01:07:01.854 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.854 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.854 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.854 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.854 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.854 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.854 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.854 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.855 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.855 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.855 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.855 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.855 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.855 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.855 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.855 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.855 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.855 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.855 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.855 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.855 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.855 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.855 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.856 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.856 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.856 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.856 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.856 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.856 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.856 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.856 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.856 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.856 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.856 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.856 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.856 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.856 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.857 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.857 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.857 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.857 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.857 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.857 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.857 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.857 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.857 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.857 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.857 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.857 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.857 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.858 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.858 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.858 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.858 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.858 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.858 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.858 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.858 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.858 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.858 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.858 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.858 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.858 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.858 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.859 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.859 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.859 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.859 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.859 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.859 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.859 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.859 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.859 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.859 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.859 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_destination": { 2023-12-01T01:07:01.860 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_destination", 2023-12-01T01:07:01.860 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.860 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.860 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.860 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.860 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.860 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.860 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.860 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Email address to send alerts to", 2023-12-01T01:07:01.860 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.860 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.860 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.860 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.860 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_from_name": { 2023-12-01T01:07:01.861 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_from_name", 2023-12-01T01:07:01.861 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.861 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.861 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.861 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "Ceph", 2023-12-01T01:07:01.861 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.861 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.861 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.861 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Email From: name", 2023-12-01T01:07:01.861 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.861 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.861 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.861 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.861 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_host": { 2023-12-01T01:07:01.861 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_host", 2023-12-01T01:07:01.862 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.862 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.862 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.862 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.862 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.862 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.862 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.862 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "SMTP server", 2023-12-01T01:07:01.862 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.862 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.862 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.862 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.862 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_password": { 2023-12-01T01:07:01.862 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_password", 2023-12-01T01:07:01.863 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.863 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.863 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.863 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.863 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.863 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.863 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.863 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Password to authenticate with", 2023-12-01T01:07:01.863 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.863 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.863 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.863 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.863 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_port": { 2023-12-01T01:07:01.863 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_port", 2023-12-01T01:07:01.863 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.863 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.864 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.864 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "465", 2023-12-01T01:07:01.864 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.864 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.864 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.864 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "SMTP port", 2023-12-01T01:07:01.864 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.864 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.864 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.864 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.864 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_sender": { 2023-12-01T01:07:01.864 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_sender", 2023-12-01T01:07:01.864 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.864 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.865 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.865 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.865 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.865 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.865 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.865 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "SMTP envelope sender", 2023-12-01T01:07:01.865 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.865 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.865 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.865 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.865 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_ssl": { 2023-12-01T01:07:01.865 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_ssl", 2023-12-01T01:07:01.865 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.865 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.865 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.866 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.866 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.866 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.866 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.866 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Use SSL to connect to SMTP server", 2023-12-01T01:07:01.866 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.866 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.866 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.866 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.866 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_user": { 2023-12-01T01:07:01.866 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_user", 2023-12-01T01:07:01.866 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.866 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.866 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.867 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.867 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.867 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.867 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.867 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "User to authenticate as", 2023-12-01T01:07:01.867 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.867 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.867 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.867 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.867 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.867 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.867 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.867 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "balancer", 2023-12-01T01:07:01.867 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.867 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.868 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.868 INFO:teuthology.orchestra.run.smithi026.stdout: "active": { 2023-12-01T01:07:01.868 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "active", 2023-12-01T01:07:01.868 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.868 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.868 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.868 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.868 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.868 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.868 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.868 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "automatically balance PGs across cluster", 2023-12-01T01:07:01.868 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.868 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.868 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.868 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.869 INFO:teuthology.orchestra.run.smithi026.stdout: "begin_time": { 2023-12-01T01:07:01.869 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "begin_time", 2023-12-01T01:07:01.869 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.869 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.869 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.869 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0000", 2023-12-01T01:07:01.869 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.869 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.869 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.869 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "beginning time of day to automatically balance", 2023-12-01T01:07:01.869 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-01T01:07:01.869 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.869 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.869 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.870 INFO:teuthology.orchestra.run.smithi026.stdout: "begin_weekday": { 2023-12-01T01:07:01.870 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "begin_weekday", 2023-12-01T01:07:01.870 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "uint", 2023-12-01T01:07:01.870 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.870 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.870 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0", 2023-12-01T01:07:01.870 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "0", 2023-12-01T01:07:01.870 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "6", 2023-12-01T01:07:01.870 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.870 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-12-01T01:07:01.870 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-01T01:07:01.870 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.870 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.870 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.871 INFO:teuthology.orchestra.run.smithi026.stdout: "crush_compat_max_iterations": { 2023-12-01T01:07:01.871 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "crush_compat_max_iterations", 2023-12-01T01:07:01.871 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "uint", 2023-12-01T01:07:01.871 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.871 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.871 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "25", 2023-12-01T01:07:01.871 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "1", 2023-12-01T01:07:01.871 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "250", 2023-12-01T01:07:01.871 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.871 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-12-01T01:07:01.871 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.871 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.871 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.871 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.872 INFO:teuthology.orchestra.run.smithi026.stdout: "crush_compat_metrics": { 2023-12-01T01:07:01.872 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "crush_compat_metrics", 2023-12-01T01:07:01.872 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.872 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.872 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.872 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "pgs,objects,bytes", 2023-12-01T01:07:01.872 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.872 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.872 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.872 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-12-01T01:07:01.872 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-12-01T01:07:01.872 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.872 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.872 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.872 INFO:teuthology.orchestra.run.smithi026.stdout: "crush_compat_step": { 2023-12-01T01:07:01.873 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "crush_compat_step", 2023-12-01T01:07:01.873 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:01.873 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.873 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.873 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0.5", 2023-12-01T01:07:01.873 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "0.001", 2023-12-01T01:07:01.873 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "0.999", 2023-12-01T01:07:01.873 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.873 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "aggressiveness of optimization", 2023-12-01T01:07:01.873 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-12-01T01:07:01.873 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.873 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.873 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.873 INFO:teuthology.orchestra.run.smithi026.stdout: "end_time": { 2023-12-01T01:07:01.873 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "end_time", 2023-12-01T01:07:01.874 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.874 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.874 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.874 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "2359", 2023-12-01T01:07:01.874 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.874 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.874 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.874 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "ending time of day to automatically balance", 2023-12-01T01:07:01.874 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-01T01:07:01.874 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.874 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.874 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.874 INFO:teuthology.orchestra.run.smithi026.stdout: "end_weekday": { 2023-12-01T01:07:01.874 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "end_weekday", 2023-12-01T01:07:01.875 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "uint", 2023-12-01T01:07:01.875 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.875 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.875 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0", 2023-12-01T01:07:01.875 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "0", 2023-12-01T01:07:01.875 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "6", 2023-12-01T01:07:01.875 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.875 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-12-01T01:07:01.875 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-01T01:07:01.875 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.875 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.875 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.875 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.875 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.875 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.876 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.876 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.876 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.876 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.876 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.876 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.876 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.876 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.876 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.876 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.876 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.876 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.876 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.876 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.876 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.876 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.877 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.877 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.877 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.877 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.877 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.877 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.877 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.877 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.877 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.877 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.877 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.877 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.877 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.877 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.878 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.878 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.878 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.878 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.878 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.878 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.878 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.878 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.878 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.878 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.878 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.878 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.878 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.878 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.878 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.879 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.879 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.879 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.879 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.879 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.879 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.879 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.879 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.879 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.879 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.879 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.879 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.879 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.879 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.879 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.879 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.880 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.880 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.880 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.880 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.880 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.880 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.880 INFO:teuthology.orchestra.run.smithi026.stdout: "min_score": { 2023-12-01T01:07:01.880 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "min_score", 2023-12-01T01:07:01.880 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:01.880 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.880 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.880 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0", 2023-12-01T01:07:01.880 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.880 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.880 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.881 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-12-01T01:07:01.881 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.881 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.881 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.881 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.881 INFO:teuthology.orchestra.run.smithi026.stdout: "mode": { 2023-12-01T01:07:01.881 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mode", 2023-12-01T01:07:01.881 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.881 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.881 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.881 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "upmap", 2023-12-01T01:07:01.881 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.881 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.881 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.881 INFO:teuthology.orchestra.run.smithi026.stdout: "crush-compat", 2023-12-01T01:07:01.882 INFO:teuthology.orchestra.run.smithi026.stdout: "none", 2023-12-01T01:07:01.882 INFO:teuthology.orchestra.run.smithi026.stdout: "upmap" 2023-12-01T01:07:01.882 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.882 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Balancer mode", 2023-12-01T01:07:01.882 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.882 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.882 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.882 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.882 INFO:teuthology.orchestra.run.smithi026.stdout: "pool_ids": { 2023-12-01T01:07:01.882 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "pool_ids", 2023-12-01T01:07:01.882 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.882 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.882 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.882 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.882 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.883 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.883 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.883 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-12-01T01:07:01.883 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.883 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.883 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.883 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.883 INFO:teuthology.orchestra.run.smithi026.stdout: "sleep_interval": { 2023-12-01T01:07:01.883 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "sleep_interval", 2023-12-01T01:07:01.883 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.883 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.883 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.883 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "60", 2023-12-01T01:07:01.883 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.884 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.884 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.884 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-12-01T01:07:01.884 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.884 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.884 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.884 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.884 INFO:teuthology.orchestra.run.smithi026.stdout: "upmap_max_deviation": { 2023-12-01T01:07:01.884 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "upmap_max_deviation", 2023-12-01T01:07:01.884 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.884 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.884 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.884 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "5", 2023-12-01T01:07:01.884 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "1", 2023-12-01T01:07:01.884 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.885 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.885 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "deviation below which no optimization is attempted", 2023-12-01T01:07:01.885 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-12-01T01:07:01.885 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.885 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.885 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.885 INFO:teuthology.orchestra.run.smithi026.stdout: "upmap_max_optimizations": { 2023-12-01T01:07:01.885 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "upmap_max_optimizations", 2023-12-01T01:07:01.885 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "uint", 2023-12-01T01:07:01.885 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.885 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.885 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:01.885 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.885 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.885 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.886 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-12-01T01:07:01.886 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.886 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.886 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.886 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.886 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.886 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.886 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.886 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephadm", 2023-12-01T01:07:01.886 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.886 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.886 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.886 INFO:teuthology.orchestra.run.smithi026.stdout: "agent_down_multiplier": { 2023-12-01T01:07:01.886 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "agent_down_multiplier", 2023-12-01T01:07:01.887 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:01.887 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.887 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.887 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "3.0", 2023-12-01T01:07:01.887 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.887 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.887 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.887 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-12-01T01:07:01.887 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.887 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.887 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.887 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.887 INFO:teuthology.orchestra.run.smithi026.stdout: "agent_refresh_rate": { 2023-12-01T01:07:01.887 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "agent_refresh_rate", 2023-12-01T01:07:01.887 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.888 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.888 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.888 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "20", 2023-12-01T01:07:01.888 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.888 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.888 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.888 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-12-01T01:07:01.888 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.888 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.888 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.888 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.888 INFO:teuthology.orchestra.run.smithi026.stdout: "agent_starting_port": { 2023-12-01T01:07:01.888 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "agent_starting_port", 2023-12-01T01:07:01.888 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.888 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.889 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.889 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "4721", 2023-12-01T01:07:01.889 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.889 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.889 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.889 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-12-01T01:07:01.889 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.889 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.889 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.889 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.889 INFO:teuthology.orchestra.run.smithi026.stdout: "allow_ptrace": { 2023-12-01T01:07:01.889 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "allow_ptrace", 2023-12-01T01:07:01.889 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.889 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.889 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.890 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.890 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.890 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.890 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.890 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-12-01T01:07:01.890 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-12-01T01:07:01.890 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.890 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.890 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.890 INFO:teuthology.orchestra.run.smithi026.stdout: "autotune_interval": { 2023-12-01T01:07:01.890 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "autotune_interval", 2023-12-01T01:07:01.890 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.890 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.890 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.891 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "600", 2023-12-01T01:07:01.891 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.891 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.891 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.891 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how frequently to autotune daemon memory", 2023-12-01T01:07:01.891 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.891 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.891 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.891 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.891 INFO:teuthology.orchestra.run.smithi026.stdout: "autotune_memory_target_ratio": { 2023-12-01T01:07:01.891 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "autotune_memory_target_ratio", 2023-12-01T01:07:01.891 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:01.891 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.891 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.891 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0.7", 2023-12-01T01:07:01.891 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.892 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.892 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.892 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-12-01T01:07:01.892 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.892 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.892 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.892 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.892 INFO:teuthology.orchestra.run.smithi026.stdout: "cgroups_split": { 2023-12-01T01:07:01.892 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cgroups_split", 2023-12-01T01:07:01.892 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.892 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.892 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.892 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.892 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.893 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.893 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.893 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-12-01T01:07:01.893 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.893 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.893 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.893 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.893 INFO:teuthology.orchestra.run.smithi026.stdout: "config_checks_enabled": { 2023-12-01T01:07:01.893 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "config_checks_enabled", 2023-12-01T01:07:01.893 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.893 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.893 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.893 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.893 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.893 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.894 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.894 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-12-01T01:07:01.894 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.894 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.894 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.894 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.894 INFO:teuthology.orchestra.run.smithi026.stdout: "config_dashboard": { 2023-12-01T01:07:01.894 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "config_dashboard", 2023-12-01T01:07:01.894 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.894 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.894 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.894 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.894 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.894 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.895 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.895 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-12-01T01:07:01.895 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.895 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.895 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.895 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.895 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_alertmanager": { 2023-12-01T01:07:01.895 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_alertmanager", 2023-12-01T01:07:01.895 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.895 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.895 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.895 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-12-01T01:07:01.895 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.895 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.895 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.896 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Prometheus container image", 2023-12-01T01:07:01.896 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.896 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.896 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.896 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.896 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_base": { 2023-12-01T01:07:01.896 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_base", 2023-12-01T01:07:01.896 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.896 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.896 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.896 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/ceph/ceph", 2023-12-01T01:07:01.896 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.896 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.896 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.896 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Container image name, without the tag", 2023-12-01T01:07:01.897 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.897 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.897 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.897 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.897 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_elasticsearch": { 2023-12-01T01:07:01.897 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_elasticsearch", 2023-12-01T01:07:01.897 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.897 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.897 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.897 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-12-01T01:07:01.897 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.897 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.897 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.897 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "elasticsearch container image", 2023-12-01T01:07:01.897 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.898 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.898 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.898 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.898 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_grafana": { 2023-12-01T01:07:01.898 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_grafana", 2023-12-01T01:07:01.898 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.898 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.898 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.898 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-12-01T01:07:01.898 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.898 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.898 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.898 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Prometheus container image", 2023-12-01T01:07:01.898 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.899 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.899 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.899 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.899 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_haproxy": { 2023-12-01T01:07:01.899 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_haproxy", 2023-12-01T01:07:01.899 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.899 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.899 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.899 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-12-01T01:07:01.899 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.899 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.899 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.899 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "HAproxy container image", 2023-12-01T01:07:01.899 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.899 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.900 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.900 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.900 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_jaeger_agent": { 2023-12-01T01:07:01.900 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_jaeger_agent", 2023-12-01T01:07:01.900 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.900 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.900 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.900 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-12-01T01:07:01.900 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.900 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.900 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.900 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Jaeger agent container image", 2023-12-01T01:07:01.900 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.900 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.900 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.901 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.901 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_jaeger_collector": { 2023-12-01T01:07:01.901 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_jaeger_collector", 2023-12-01T01:07:01.901 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.901 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.901 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.901 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-12-01T01:07:01.901 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.901 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.901 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.901 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Jaeger collector container image", 2023-12-01T01:07:01.901 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.901 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.901 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.901 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.902 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_jaeger_query": { 2023-12-01T01:07:01.902 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_jaeger_query", 2023-12-01T01:07:01.902 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.902 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.902 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.902 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-12-01T01:07:01.902 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.902 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.902 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.902 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Jaeger query container image", 2023-12-01T01:07:01.902 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.902 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.902 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.902 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.903 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_keepalived": { 2023-12-01T01:07:01.903 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_keepalived", 2023-12-01T01:07:01.903 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.903 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.903 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.903 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-12-01T01:07:01.903 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.903 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.903 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.903 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Keepalived container image", 2023-12-01T01:07:01.903 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.903 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.903 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.903 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.903 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_loki": { 2023-12-01T01:07:01.904 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_loki", 2023-12-01T01:07:01.904 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.904 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.904 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.904 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-12-01T01:07:01.904 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.904 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.904 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.904 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Loki container image", 2023-12-01T01:07:01.904 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.904 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.904 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.904 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.904 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_node_exporter": { 2023-12-01T01:07:01.904 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_node_exporter", 2023-12-01T01:07:01.905 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.905 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.905 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.905 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-12-01T01:07:01.905 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.905 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.905 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.905 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Prometheus container image", 2023-12-01T01:07:01.905 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.905 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.905 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.905 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.905 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_nvmeof": { 2023-12-01T01:07:01.905 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_nvmeof", 2023-12-01T01:07:01.905 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.905 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.906 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.906 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.2", 2023-12-01T01:07:01.906 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.906 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.906 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.906 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Nvme-of container image", 2023-12-01T01:07:01.906 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.906 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.906 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.906 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.906 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_prometheus": { 2023-12-01T01:07:01.906 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_prometheus", 2023-12-01T01:07:01.906 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.907 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.907 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.907 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-12-01T01:07:01.907 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.907 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.907 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.907 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Prometheus container image", 2023-12-01T01:07:01.907 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.907 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.907 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.907 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.907 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_promtail": { 2023-12-01T01:07:01.907 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_promtail", 2023-12-01T01:07:01.907 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.907 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.908 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.908 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-12-01T01:07:01.908 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.908 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.908 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.908 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Promtail container image", 2023-12-01T01:07:01.908 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.908 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.908 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.908 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.908 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_snmp_gateway": { 2023-12-01T01:07:01.908 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_snmp_gateway", 2023-12-01T01:07:01.908 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.908 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.909 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.909 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-12-01T01:07:01.909 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.909 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.909 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.909 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "SNMP Gateway container image", 2023-12-01T01:07:01.909 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.909 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.909 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.909 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.909 INFO:teuthology.orchestra.run.smithi026.stdout: "container_init": { 2023-12-01T01:07:01.909 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_init", 2023-12-01T01:07:01.909 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.909 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.909 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.910 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.910 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.910 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.910 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.910 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Run podman/docker with `--init`", 2023-12-01T01:07:01.910 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.910 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.910 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.910 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.910 INFO:teuthology.orchestra.run.smithi026.stdout: "daemon_cache_timeout": { 2023-12-01T01:07:01.910 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "daemon_cache_timeout", 2023-12-01T01:07:01.910 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.910 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.910 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.911 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "600", 2023-12-01T01:07:01.911 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.911 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.911 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.911 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-12-01T01:07:01.911 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.911 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.911 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.911 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.911 INFO:teuthology.orchestra.run.smithi026.stdout: "default_cephadm_command_timeout": { 2023-12-01T01:07:01.911 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "default_cephadm_command_timeout", 2023-12-01T01:07:01.911 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.911 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.911 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.911 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "900", 2023-12-01T01:07:01.912 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.912 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.912 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.912 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-12-01T01:07:01.912 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.912 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.912 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.912 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.912 INFO:teuthology.orchestra.run.smithi026.stdout: "default_registry": { 2023-12-01T01:07:01.912 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "default_registry", 2023-12-01T01:07:01.912 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.912 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.912 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.912 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "docker.io", 2023-12-01T01:07:01.912 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.913 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.913 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.913 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-12-01T01:07:01.913 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.913 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.913 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.913 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.913 INFO:teuthology.orchestra.run.smithi026.stdout: "device_cache_timeout": { 2023-12-01T01:07:01.913 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "device_cache_timeout", 2023-12-01T01:07:01.913 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.913 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.913 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.913 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "1800", 2023-12-01T01:07:01.913 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.914 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.914 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.914 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "seconds to cache device inventory", 2023-12-01T01:07:01.914 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.914 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.914 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.914 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.914 INFO:teuthology.orchestra.run.smithi026.stdout: "device_enhanced_scan": { 2023-12-01T01:07:01.914 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "device_enhanced_scan", 2023-12-01T01:07:01.914 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.914 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.914 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.914 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.914 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.914 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.915 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.915 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Use libstoragemgmt during device scans", 2023-12-01T01:07:01.915 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.915 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.915 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.915 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.915 INFO:teuthology.orchestra.run.smithi026.stdout: "facts_cache_timeout": { 2023-12-01T01:07:01.915 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "facts_cache_timeout", 2023-12-01T01:07:01.915 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.915 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.915 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.915 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "60", 2023-12-01T01:07:01.915 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.915 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.915 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "seconds to cache host facts data", 2023-12-01T01:07:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: "host_check_interval": { 2023-12-01T01:07:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "host_check_interval", 2023-12-01T01:07:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "600", 2023-12-01T01:07:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how frequently to perform a host check", 2023-12-01T01:07:01.916 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.917 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.917 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.917 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.917 INFO:teuthology.orchestra.run.smithi026.stdout: "inventory_list_all": { 2023-12-01T01:07:01.917 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "inventory_list_all", 2023-12-01T01:07:01.917 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.917 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.917 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.917 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.917 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.917 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.917 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.917 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-12-01T01:07:01.917 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.917 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.918 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.918 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.918 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.918 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.918 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.918 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.918 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.918 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.918 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.918 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.918 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.918 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.918 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.918 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.919 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.919 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.919 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.919 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.919 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.919 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.919 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.919 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.919 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.919 INFO:teuthology.orchestra.run.smithi026.stdout: "log_refresh_metadata": { 2023-12-01T01:07:01.919 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_refresh_metadata", 2023-12-01T01:07:01.919 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.919 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.919 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.920 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.920 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.920 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.920 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.920 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-12-01T01:07:01.920 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.920 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.920 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.920 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.920 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.920 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.920 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.920 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.920 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.921 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.921 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.921 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.921 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.921 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-12-01T01:07:01.921 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.921 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.921 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.921 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.921 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.921 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.921 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.921 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.921 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.921 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.922 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.922 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.922 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.922 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.922 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.922 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.922 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.922 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.922 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.922 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.922 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.922 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.922 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.922 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.923 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.923 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.923 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.923 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.923 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.923 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.923 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.923 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.923 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.923 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.923 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.923 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.923 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.923 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.924 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.924 INFO:teuthology.orchestra.run.smithi026.stdout: "manage_etc_ceph_ceph_conf": { 2023-12-01T01:07:01.924 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-12-01T01:07:01.924 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.924 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.924 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.924 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.924 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.924 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.924 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.924 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-12-01T01:07:01.924 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.924 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.924 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.924 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.925 INFO:teuthology.orchestra.run.smithi026.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-12-01T01:07:01.925 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-12-01T01:07:01.925 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.925 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.925 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.925 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "*", 2023-12-01T01:07:01.925 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.925 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.925 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.925 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-12-01T01:07:01.925 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.925 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.925 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.925 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.925 INFO:teuthology.orchestra.run.smithi026.stdout: "max_count_per_host": { 2023-12-01T01:07:01.926 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "max_count_per_host", 2023-12-01T01:07:01.926 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.926 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.926 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.926 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:01.926 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.926 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.926 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.926 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "max number of daemons per service per host", 2023-12-01T01:07:01.926 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.926 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.926 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.926 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.926 INFO:teuthology.orchestra.run.smithi026.stdout: "max_osd_draining_count": { 2023-12-01T01:07:01.927 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "max_osd_draining_count", 2023-12-01T01:07:01.927 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.927 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.927 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.927 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:01.927 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.927 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.927 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.927 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-12-01T01:07:01.927 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.927 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.927 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.927 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.927 INFO:teuthology.orchestra.run.smithi026.stdout: "migration_current": { 2023-12-01T01:07:01.928 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "migration_current", 2023-12-01T01:07:01.928 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.928 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.928 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.928 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.928 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.928 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.928 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.928 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "internal - do not modify", 2023-12-01T01:07:01.928 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.928 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.928 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.928 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.928 INFO:teuthology.orchestra.run.smithi026.stdout: "mode": { 2023-12-01T01:07:01.929 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mode", 2023-12-01T01:07:01.929 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.929 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.929 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.929 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "root", 2023-12-01T01:07:01.929 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.929 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.929 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.929 INFO:teuthology.orchestra.run.smithi026.stdout: "cephadm-package", 2023-12-01T01:07:01.929 INFO:teuthology.orchestra.run.smithi026.stdout: "root" 2023-12-01T01:07:01.929 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.929 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "mode for remote execution of cephadm", 2023-12-01T01:07:01.929 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.929 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.929 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.929 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.930 INFO:teuthology.orchestra.run.smithi026.stdout: "prometheus_alerts_path": { 2023-12-01T01:07:01.930 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "prometheus_alerts_path", 2023-12-01T01:07:01.930 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.930 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.930 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.930 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-12-01T01:07:01.930 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.930 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.930 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.930 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-12-01T01:07:01.930 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.930 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.930 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.930 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.931 INFO:teuthology.orchestra.run.smithi026.stdout: "registry_insecure": { 2023-12-01T01:07:01.931 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "registry_insecure", 2023-12-01T01:07:01.931 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.931 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.931 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.931 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.931 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.931 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.931 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.931 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-12-01T01:07:01.931 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.931 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.931 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.931 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.932 INFO:teuthology.orchestra.run.smithi026.stdout: "registry_password": { 2023-12-01T01:07:01.932 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "registry_password", 2023-12-01T01:07:01.932 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.932 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.932 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.932 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.932 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.932 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.932 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.932 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-12-01T01:07:01.932 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.932 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.932 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.932 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.932 INFO:teuthology.orchestra.run.smithi026.stdout: "registry_url": { 2023-12-01T01:07:01.933 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "registry_url", 2023-12-01T01:07:01.933 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.933 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.933 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.933 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.933 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.933 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.933 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.933 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-12-01T01:07:01.933 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.933 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.933 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.933 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.933 INFO:teuthology.orchestra.run.smithi026.stdout: "registry_username": { 2023-12-01T01:07:01.933 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "registry_username", 2023-12-01T01:07:01.934 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.934 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.934 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.934 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.934 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.934 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.934 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.934 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-12-01T01:07:01.934 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.934 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.934 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.934 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.934 INFO:teuthology.orchestra.run.smithi026.stdout: "secure_monitoring_stack": { 2023-12-01T01:07:01.935 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "secure_monitoring_stack", 2023-12-01T01:07:01.935 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.935 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.935 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.935 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.935 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.935 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.935 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.935 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-12-01T01:07:01.935 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.935 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.935 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.935 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.935 INFO:teuthology.orchestra.run.smithi026.stdout: "service_discovery_port": { 2023-12-01T01:07:01.935 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "service_discovery_port", 2023-12-01T01:07:01.936 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.936 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.936 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.936 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "8765", 2023-12-01T01:07:01.936 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.936 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.936 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.936 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "cephadm service discovery port", 2023-12-01T01:07:01.936 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.936 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.936 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.936 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.936 INFO:teuthology.orchestra.run.smithi026.stdout: "ssh_config_file": { 2023-12-01T01:07:01.936 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ssh_config_file", 2023-12-01T01:07:01.936 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.937 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.937 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.937 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.937 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.937 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.937 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.937 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-12-01T01:07:01.937 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.937 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.937 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.937 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.937 INFO:teuthology.orchestra.run.smithi026.stdout: "use_agent": { 2023-12-01T01:07:01.937 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "use_agent", 2023-12-01T01:07:01.937 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.937 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.938 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.938 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.938 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.938 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.938 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.938 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-12-01T01:07:01.938 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.938 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.938 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.938 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.938 INFO:teuthology.orchestra.run.smithi026.stdout: "use_repo_digest": { 2023-12-01T01:07:01.938 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "use_repo_digest", 2023-12-01T01:07:01.938 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.938 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.939 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.939 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.939 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.939 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.939 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.939 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-12-01T01:07:01.939 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.939 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.939 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.939 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.939 INFO:teuthology.orchestra.run.smithi026.stdout: "warn_on_failed_host_check": { 2023-12-01T01:07:01.939 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "warn_on_failed_host_check", 2023-12-01T01:07:01.939 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.939 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.939 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.940 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.940 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.940 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.940 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.940 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "raise a health warning if the host check fails", 2023-12-01T01:07:01.940 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.940 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.940 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.940 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.940 INFO:teuthology.orchestra.run.smithi026.stdout: "warn_on_stray_daemons": { 2023-12-01T01:07:01.940 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "warn_on_stray_daemons", 2023-12-01T01:07:01.940 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.940 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.940 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.940 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.941 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.941 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.941 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.941 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-12-01T01:07:01.941 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.941 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.941 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.941 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.941 INFO:teuthology.orchestra.run.smithi026.stdout: "warn_on_stray_hosts": { 2023-12-01T01:07:01.941 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "warn_on_stray_hosts", 2023-12-01T01:07:01.941 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.941 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.941 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.941 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.941 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.942 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.942 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.942 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-12-01T01:07:01.942 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.942 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.942 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.942 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.942 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.942 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.942 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.942 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "crash", 2023-12-01T01:07:01.942 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.942 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.942 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.943 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.943 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.943 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.943 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.943 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.943 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.943 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.943 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.943 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.943 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.943 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.943 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.943 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.943 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.943 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.944 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.944 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.944 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.944 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.944 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.944 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.944 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.944 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.944 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.944 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.944 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.944 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.944 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.944 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.944 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.945 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.945 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.945 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.945 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.945 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.945 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.945 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.945 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.945 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.945 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.945 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.945 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.945 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.945 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.945 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.946 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.946 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.946 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.946 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.946 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.946 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.946 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.946 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.946 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.946 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.946 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.946 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:01.946 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:01.946 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.947 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.947 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.947 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.947 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.947 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.947 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.947 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.947 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.947 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.947 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.947 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.947 INFO:teuthology.orchestra.run.smithi026.stdout: "retain_interval": { 2023-12-01T01:07:01.947 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "retain_interval", 2023-12-01T01:07:01.947 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.947 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.948 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.948 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "31536000", 2023-12-01T01:07:01.948 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.948 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.948 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.948 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how long to retain crashes before pruning them", 2023-12-01T01:07:01.948 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.948 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.948 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.948 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.948 INFO:teuthology.orchestra.run.smithi026.stdout: "warn_recent_interval": { 2023-12-01T01:07:01.948 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "warn_recent_interval", 2023-12-01T01:07:01.948 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:01.948 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.948 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.949 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "1209600", 2023-12-01T01:07:01.949 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.949 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.949 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.949 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "time interval in which to warn about recent crashes", 2023-12-01T01:07:01.949 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.949 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.949 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.949 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.949 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:01.949 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.949 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:01.949 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "dashboard", 2023-12-01T01:07:01.949 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:01.950 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:01.950 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:01.950 INFO:teuthology.orchestra.run.smithi026.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-12-01T01:07:01.950 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-12-01T01:07:01.950 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.950 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.950 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.950 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:01.950 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.950 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.950 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.950 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.950 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.950 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.951 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.951 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.951 INFO:teuthology.orchestra.run.smithi026.stdout: "ALERTMANAGER_API_HOST": { 2023-12-01T01:07:01.951 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ALERTMANAGER_API_HOST", 2023-12-01T01:07:01.951 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.951 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.951 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.951 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.951 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.951 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.951 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.951 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.951 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.951 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.951 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.952 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.952 INFO:teuthology.orchestra.run.smithi026.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-12-01T01:07:01.952 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-12-01T01:07:01.952 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.952 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.952 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.952 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.952 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.952 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.952 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.952 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.952 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.952 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.952 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.952 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.953 INFO:teuthology.orchestra.run.smithi026.stdout: "AUDIT_API_ENABLED": { 2023-12-01T01:07:01.953 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "AUDIT_API_ENABLED", 2023-12-01T01:07:01.953 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.953 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.953 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.953 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.953 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.953 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.953 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.953 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.953 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.953 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.953 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.953 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.953 INFO:teuthology.orchestra.run.smithi026.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-12-01T01:07:01.954 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-12-01T01:07:01.954 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.954 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.954 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.954 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.954 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.954 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.954 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.954 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.954 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.954 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.954 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.954 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.954 INFO:teuthology.orchestra.run.smithi026.stdout: "ENABLE_BROWSABLE_API": { 2023-12-01T01:07:01.955 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ENABLE_BROWSABLE_API", 2023-12-01T01:07:01.955 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.955 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.955 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.955 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.955 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.955 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.955 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.955 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.955 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.955 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.955 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.955 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.955 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-12-01T01:07:01.956 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-12-01T01:07:01.956 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.956 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.956 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.956 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.956 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.956 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.956 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.956 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.956 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.956 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.956 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.956 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.956 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-12-01T01:07:01.956 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-12-01T01:07:01.957 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.957 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.957 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.957 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.957 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.957 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.957 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.957 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.957 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.957 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.957 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.957 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.957 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-12-01T01:07:01.957 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-12-01T01:07:01.957 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.958 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.958 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.958 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.958 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.958 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.958 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.958 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.958 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.958 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.958 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.958 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.958 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-12-01T01:07:01.958 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-12-01T01:07:01.958 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.959 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.959 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.959 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.959 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.959 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.959 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.959 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.959 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.959 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.959 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.959 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.959 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_NFS": { 2023-12-01T01:07:01.959 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-12-01T01:07:01.959 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.959 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.959 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.960 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.960 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.960 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.960 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.960 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.960 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.960 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.960 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.960 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.960 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_RBD": { 2023-12-01T01:07:01.960 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-12-01T01:07:01.960 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.960 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.960 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.960 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.961 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.961 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.961 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.961 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.961 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.961 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.961 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.961 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.961 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_RGW": { 2023-12-01T01:07:01.961 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-12-01T01:07:01.961 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.961 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.961 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.961 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.961 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.962 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.962 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.962 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.962 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.962 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.962 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.962 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.962 INFO:teuthology.orchestra.run.smithi026.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-12-01T01:07:01.962 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-12-01T01:07:01.962 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.962 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.962 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.962 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.962 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.962 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.963 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.963 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.963 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.963 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.963 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.963 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.963 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_API_PASSWORD": { 2023-12-01T01:07:01.963 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_API_PASSWORD", 2023-12-01T01:07:01.963 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.963 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.963 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.963 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "admin", 2023-12-01T01:07:01.963 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.963 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.964 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.964 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.964 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.964 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.964 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.964 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.964 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-12-01T01:07:01.964 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-12-01T01:07:01.964 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.964 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.964 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.964 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.964 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.964 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.964 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.964 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.965 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.965 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.965 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.965 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.965 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_API_URL": { 2023-12-01T01:07:01.965 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_API_URL", 2023-12-01T01:07:01.965 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.965 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.965 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.965 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.965 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.965 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.965 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.965 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.966 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.966 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.966 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.966 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.966 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_API_USERNAME": { 2023-12-01T01:07:01.966 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_API_USERNAME", 2023-12-01T01:07:01.966 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.966 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.966 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.966 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "admin", 2023-12-01T01:07:01.966 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.966 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.966 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.966 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.966 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.967 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.967 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.967 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.967 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-12-01T01:07:01.967 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-12-01T01:07:01.967 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.967 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.967 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.967 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.967 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.967 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.967 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.967 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.967 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.968 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.968 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.968 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.968 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-12-01T01:07:01.968 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-12-01T01:07:01.968 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.968 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.968 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.968 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.968 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.968 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.968 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.968 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.968 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.968 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-12-01T01:07:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-12-01T01:07:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.969 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.970 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.970 INFO:teuthology.orchestra.run.smithi026.stdout: "ISSUE_TRACKER_API_KEY": { 2023-12-01T01:07:01.970 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-12-01T01:07:01.970 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.970 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.970 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.970 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.970 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.970 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.970 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.970 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.970 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.970 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.970 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.970 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.971 INFO:teuthology.orchestra.run.smithi026.stdout: "PROMETHEUS_API_HOST": { 2023-12-01T01:07:01.971 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PROMETHEUS_API_HOST", 2023-12-01T01:07:01.971 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.971 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.971 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.971 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.971 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.971 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.971 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.971 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.971 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.971 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.971 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.971 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.971 INFO:teuthology.orchestra.run.smithi026.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-12-01T01:07:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-12-01T01:07:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-12-01T01:07:01.972 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-12-01T01:07:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-12-01T01:07:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-12-01T01:07:01.973 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.974 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.974 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.974 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.974 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.974 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.974 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.974 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.974 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.974 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.974 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.974 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.974 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-12-01T01:07:01.974 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-12-01T01:07:01.974 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.974 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.975 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.975 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.975 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.975 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.975 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.975 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.975 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.975 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.975 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.975 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.975 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-12-01T01:07:01.975 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-12-01T01:07:01.975 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.975 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.975 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-12-01T01:07:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-12-01T01:07:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.976 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-12-01T01:07:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-12-01T01:07:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.977 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-12-01T01:07:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-12-01T01:07:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.978 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.979 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.979 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.979 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.979 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.979 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.979 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.979 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.979 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_ENABLED": { 2023-12-01T01:07:01.979 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_ENABLED", 2023-12-01T01:07:01.979 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.979 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.979 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.979 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.979 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.980 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.980 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.980 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.980 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.980 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.980 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.980 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.980 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-12-01T01:07:01.980 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-12-01T01:07:01.980 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.980 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.980 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.980 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-12-01T01:07:01.980 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.981 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.981 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.981 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.981 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.981 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.981 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.981 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.981 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-12-01T01:07:01.981 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-12-01T01:07:01.981 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.981 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.981 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.981 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:01.981 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.981 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.982 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.982 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.982 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.982 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.982 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.982 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.982 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-12-01T01:07:01.982 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-12-01T01:07:01.982 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.982 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.982 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.982 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "8", 2023-12-01T01:07:01.982 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.982 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.983 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.983 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.983 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.983 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.983 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.983 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.983 INFO:teuthology.orchestra.run.smithi026.stdout: "REST_REQUESTS_TIMEOUT": { 2023-12-01T01:07:01.983 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-12-01T01:07:01.983 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.983 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.983 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.983 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "45", 2023-12-01T01:07:01.983 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.983 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.983 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.984 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.984 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.984 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.984 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.984 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.984 INFO:teuthology.orchestra.run.smithi026.stdout: "RGW_API_ACCESS_KEY": { 2023-12-01T01:07:01.984 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RGW_API_ACCESS_KEY", 2023-12-01T01:07:01.984 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.984 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.984 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.984 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.984 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.984 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.984 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.984 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.984 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.985 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.985 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.985 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.985 INFO:teuthology.orchestra.run.smithi026.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-12-01T01:07:01.985 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-12-01T01:07:01.985 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.985 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.985 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.985 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "admin", 2023-12-01T01:07:01.985 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.985 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.985 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.985 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.985 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.985 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.986 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.986 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.986 INFO:teuthology.orchestra.run.smithi026.stdout: "RGW_API_SECRET_KEY": { 2023-12-01T01:07:01.986 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RGW_API_SECRET_KEY", 2023-12-01T01:07:01.986 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.986 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.986 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.986 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.986 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.986 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.986 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.986 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.986 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.986 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.986 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.987 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.987 INFO:teuthology.orchestra.run.smithi026.stdout: "RGW_API_SSL_VERIFY": { 2023-12-01T01:07:01.987 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RGW_API_SSL_VERIFY", 2023-12-01T01:07:01.987 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.987 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.987 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.987 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:01.987 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.987 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.987 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.987 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.987 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.987 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.987 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.987 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.988 INFO:teuthology.orchestra.run.smithi026.stdout: "UNSAFE_TLS_v1_2": { 2023-12-01T01:07:01.988 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "UNSAFE_TLS_v1_2", 2023-12-01T01:07:01.988 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.988 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.988 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.988 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.988 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.988 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.988 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.988 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.988 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.988 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.988 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.988 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.989 INFO:teuthology.orchestra.run.smithi026.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-12-01T01:07:01.989 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-12-01T01:07:01.989 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.989 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.989 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.989 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0", 2023-12-01T01:07:01.989 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.989 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.989 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.989 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.989 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.989 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.989 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.989 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.989 INFO:teuthology.orchestra.run.smithi026.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-12-01T01:07:01.989 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-12-01T01:07:01.990 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.990 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.990 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.990 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:01.990 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.990 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.990 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.990 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.990 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.990 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.990 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.990 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.990 INFO:teuthology.orchestra.run.smithi026.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-12-01T01:07:01.990 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-12-01T01:07:01.990 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.991 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.991 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.991 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "5", 2023-12-01T01:07:01.991 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.991 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.991 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.991 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.991 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.991 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.991 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.991 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.991 INFO:teuthology.orchestra.run.smithi026.stdout: "cross_origin_url": { 2023-12-01T01:07:01.991 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cross_origin_url", 2023-12-01T01:07:01.991 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.991 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.991 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.992 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.992 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.992 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.992 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.992 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.992 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.992 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.992 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.992 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.992 INFO:teuthology.orchestra.run.smithi026.stdout: "crt_file": { 2023-12-01T01:07:01.992 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "crt_file", 2023-12-01T01:07:01.992 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.992 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.993 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.993 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.993 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.993 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.993 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.993 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.993 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.993 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.993 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.993 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.993 INFO:teuthology.orchestra.run.smithi026.stdout: "debug": { 2023-12-01T01:07:01.993 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "debug", 2023-12-01T01:07:01.993 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.993 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.993 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.993 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.994 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.994 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.994 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.994 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Enable/disable debug options", 2023-12-01T01:07:01.994 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.994 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.994 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.994 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.994 INFO:teuthology.orchestra.run.smithi026.stdout: "jwt_token_ttl": { 2023-12-01T01:07:01.994 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "jwt_token_ttl", 2023-12-01T01:07:01.994 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:01.994 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.994 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.994 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "28800", 2023-12-01T01:07:01.995 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.995 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.995 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.995 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.995 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.995 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.995 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.995 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.995 INFO:teuthology.orchestra.run.smithi026.stdout: "key_file": { 2023-12-01T01:07:01.995 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "key_file", 2023-12-01T01:07:01.995 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.995 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.995 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:01.995 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.995 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:01.996 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.997 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:01.998 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:01.998 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:01.998 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.998 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.998 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:01.998 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.998 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.998 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:01.998 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:01.998 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:01.998 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:01.998 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:01.998 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:01.998 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:01.999 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:01.999 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:01.999 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:01.999 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:01.999 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:01.999 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:01.999 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:01.999 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:01.999 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:01.999 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:01.999 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:01.999 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:01.999 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.000 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: "motd": { 2023-12-01T01:07:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "motd", 2023-12-01T01:07:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.001 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.002 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "The message of the day", 2023-12-01T01:07:02.002 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.002 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.002 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.002 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.002 INFO:teuthology.orchestra.run.smithi026.stdout: "redirect_resolve_ip_addr": { 2023-12-01T01:07:02.002 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "redirect_resolve_ip_addr", 2023-12-01T01:07:02.002 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.002 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.002 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.002 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.002 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.002 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.002 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.002 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.003 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.003 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.003 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.003 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.003 INFO:teuthology.orchestra.run.smithi026.stdout: "server_addr": { 2023-12-01T01:07:02.003 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_addr", 2023-12-01T01:07:02.003 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.003 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.003 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.003 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "::", 2023-12-01T01:07:02.003 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.003 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.003 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.003 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.003 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: "server_port": { 2023-12-01T01:07:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_port", 2023-12-01T01:07:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "8080", 2023-12-01T01:07:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.004 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.005 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.005 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.005 INFO:teuthology.orchestra.run.smithi026.stdout: "ssl": { 2023-12-01T01:07:02.005 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ssl", 2023-12-01T01:07:02.005 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.005 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.005 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.005 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.005 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.005 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.005 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.005 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.005 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.005 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: "ssl_server_port": { 2023-12-01T01:07:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ssl_server_port", 2023-12-01T01:07:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "8443", 2023-12-01T01:07:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.006 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: "standby_behaviour": { 2023-12-01T01:07:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "standby_behaviour", 2023-12-01T01:07:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "redirect", 2023-12-01T01:07:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: "redirect" 2023-12-01T01:07:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.007 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: "standby_error_status_code": { 2023-12-01T01:07:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "standby_error_status_code", 2023-12-01T01:07:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "500", 2023-12-01T01:07:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "400", 2023-12-01T01:07:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "599", 2023-12-01T01:07:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.008 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.009 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.009 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.009 INFO:teuthology.orchestra.run.smithi026.stdout: "url_prefix": { 2023-12-01T01:07:02.009 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "url_prefix", 2023-12-01T01:07:02.009 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.009 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.009 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.009 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.009 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.009 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.009 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.009 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.009 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.009 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.009 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.010 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.010 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.010 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.010 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.010 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "devicehealth", 2023-12-01T01:07:02.010 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.010 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.010 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.010 INFO:teuthology.orchestra.run.smithi026.stdout: "enable_monitoring": { 2023-12-01T01:07:02.010 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "enable_monitoring", 2023-12-01T01:07:02.010 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.010 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.010 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.011 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.011 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.011 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.011 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.011 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "monitor device health metrics", 2023-12-01T01:07:02.011 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.011 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.011 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.011 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.011 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.011 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.012 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.012 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.012 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.012 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.012 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.012 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.012 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.012 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.012 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.012 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.012 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.013 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.013 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.013 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.013 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.013 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.013 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.013 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.013 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.013 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.013 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.013 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.013 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.013 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.014 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.014 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.014 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.014 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.014 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.014 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.014 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.014 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.014 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.014 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.014 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.015 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.015 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.015 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.015 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.015 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.015 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.015 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.015 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.015 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.015 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.015 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.016 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.016 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.016 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.016 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.016 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.016 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.016 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.016 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.016 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.016 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.017 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.017 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.017 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.017 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.017 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.017 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.017 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.017 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.017 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.017 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.017 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.017 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.018 INFO:teuthology.orchestra.run.smithi026.stdout: "mark_out_threshold": { 2023-12-01T01:07:02.018 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mark_out_threshold", 2023-12-01T01:07:02.018 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.018 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.018 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.018 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "2419200", 2023-12-01T01:07:02.018 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.018 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.018 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.018 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-12-01T01:07:02.018 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.018 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.018 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.018 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.019 INFO:teuthology.orchestra.run.smithi026.stdout: "pool_name": { 2023-12-01T01:07:02.019 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "pool_name", 2023-12-01T01:07:02.019 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.019 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.019 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.019 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "device_health_metrics", 2023-12-01T01:07:02.019 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.019 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.019 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.019 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "name of pool in which to store device health metrics", 2023-12-01T01:07:02.019 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.019 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.019 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.019 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.020 INFO:teuthology.orchestra.run.smithi026.stdout: "retention_period": { 2023-12-01T01:07:02.020 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "retention_period", 2023-12-01T01:07:02.020 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.020 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.020 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.020 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "15552000", 2023-12-01T01:07:02.020 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.020 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.020 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.020 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how long to retain device health metrics", 2023-12-01T01:07:02.020 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.020 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.020 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.020 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.021 INFO:teuthology.orchestra.run.smithi026.stdout: "scrape_frequency": { 2023-12-01T01:07:02.021 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "scrape_frequency", 2023-12-01T01:07:02.021 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.021 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.021 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.021 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "86400", 2023-12-01T01:07:02.021 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.021 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.021 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.021 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how frequently to scrape device health metrics", 2023-12-01T01:07:02.021 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.021 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.021 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.021 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.021 INFO:teuthology.orchestra.run.smithi026.stdout: "self_heal": { 2023-12-01T01:07:02.022 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "self_heal", 2023-12-01T01:07:02.022 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.022 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.022 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.022 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.022 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.022 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.022 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.022 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-12-01T01:07:02.022 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.022 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.022 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.022 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.022 INFO:teuthology.orchestra.run.smithi026.stdout: "sleep_interval": { 2023-12-01T01:07:02.023 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "sleep_interval", 2023-12-01T01:07:02.023 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.023 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.023 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.023 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "600", 2023-12-01T01:07:02.023 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.023 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.023 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.023 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how frequently to wake up and check device health", 2023-12-01T01:07:02.023 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.023 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.023 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.023 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.023 INFO:teuthology.orchestra.run.smithi026.stdout: "warn_threshold": { 2023-12-01T01:07:02.024 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "warn_threshold", 2023-12-01T01:07:02.024 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.024 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.024 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.024 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "7257600", 2023-12-01T01:07:02.024 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.024 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.024 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.024 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-12-01T01:07:02.024 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.024 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.024 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.024 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.024 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.024 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.025 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.025 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "diskprediction_local", 2023-12-01T01:07:02.025 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.025 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.025 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.025 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.025 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.025 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.025 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.025 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.025 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.025 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.025 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.025 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.025 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.025 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.026 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.026 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.026 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.026 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.026 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.026 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.026 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.026 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.026 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.026 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.026 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.026 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.026 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.026 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.027 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.027 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.027 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.027 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.027 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.027 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.027 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.027 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.027 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.027 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.027 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.027 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.027 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.027 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.027 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.028 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.028 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.028 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.028 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.028 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.028 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.028 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.028 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.028 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.028 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.028 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.028 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.028 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.028 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.028 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.028 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.029 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.029 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.029 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.029 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.029 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.029 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.029 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.029 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.029 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.029 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.029 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.029 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.029 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.029 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.029 INFO:teuthology.orchestra.run.smithi026.stdout: "predict_interval": { 2023-12-01T01:07:02.030 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "predict_interval", 2023-12-01T01:07:02.030 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.030 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.030 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.030 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "86400", 2023-12-01T01:07:02.030 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.030 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.030 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.030 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.030 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.030 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.030 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.030 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.030 INFO:teuthology.orchestra.run.smithi026.stdout: "predictor_model": { 2023-12-01T01:07:02.030 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "predictor_model", 2023-12-01T01:07:02.031 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.031 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.031 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.031 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "prophetstor", 2023-12-01T01:07:02.031 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.031 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.031 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.031 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.031 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.031 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.031 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.031 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.031 INFO:teuthology.orchestra.run.smithi026.stdout: "sleep_interval": { 2023-12-01T01:07:02.031 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "sleep_interval", 2023-12-01T01:07:02.031 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.031 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.032 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.032 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "600", 2023-12-01T01:07:02.032 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.032 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.032 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.032 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.032 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.032 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.032 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.032 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.032 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.032 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.032 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.033 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "influx", 2023-12-01T01:07:02.033 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": false, 2023-12-01T01:07:02.033 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "influxdb python module not found", 2023-12-01T01:07:02.033 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.033 INFO:teuthology.orchestra.run.smithi026.stdout: "batch_size": { 2023-12-01T01:07:02.033 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "batch_size", 2023-12-01T01:07:02.033 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.033 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.033 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.033 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "5000", 2023-12-01T01:07:02.033 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.033 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.033 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.033 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-12-01T01:07:02.033 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.033 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.034 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.034 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.034 INFO:teuthology.orchestra.run.smithi026.stdout: "database": { 2023-12-01T01:07:02.034 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "database", 2023-12-01T01:07:02.034 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.034 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.034 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.034 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "ceph", 2023-12-01T01:07:02.034 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.034 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.034 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.034 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-12-01T01:07:02.034 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.034 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.035 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.035 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.035 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": { 2023-12-01T01:07:02.035 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "hostname", 2023-12-01T01:07:02.035 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.035 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.035 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.035 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.035 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.035 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.035 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.035 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "InfluxDB server hostname", 2023-12-01T01:07:02.035 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.035 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.035 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.036 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.036 INFO:teuthology.orchestra.run.smithi026.stdout: "interval": { 2023-12-01T01:07:02.036 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "interval", 2023-12-01T01:07:02.036 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.036 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.036 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.036 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "30", 2023-12-01T01:07:02.036 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "5", 2023-12-01T01:07:02.036 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.036 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.036 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-12-01T01:07:02.036 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.036 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.036 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.036 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.037 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.037 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.037 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.037 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.037 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.037 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.037 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.037 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.037 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.037 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.037 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.037 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.038 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.038 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.038 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.038 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.038 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.038 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.038 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.038 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.038 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.038 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.038 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.038 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.038 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.038 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.039 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.039 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.039 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.039 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.039 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.039 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.039 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.039 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.039 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.039 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.039 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.040 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.040 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.040 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.040 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.040 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.040 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.040 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.040 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.040 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.040 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.040 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.040 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.040 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.041 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.041 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.041 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.041 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.041 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.041 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.041 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.041 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.041 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.041 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.041 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.042 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.042 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.042 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.042 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.042 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.042 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.042 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.042 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.042 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.042 INFO:teuthology.orchestra.run.smithi026.stdout: "password": { 2023-12-01T01:07:02.042 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "password", 2023-12-01T01:07:02.042 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.042 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.042 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.042 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.043 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.043 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.043 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.043 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "password of InfluxDB server user", 2023-12-01T01:07:02.043 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.043 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.043 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.043 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.043 INFO:teuthology.orchestra.run.smithi026.stdout: "port": { 2023-12-01T01:07:02.043 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "port", 2023-12-01T01:07:02.043 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.044 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.044 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.044 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "8086", 2023-12-01T01:07:02.044 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.044 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.044 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.044 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "InfluxDB server port", 2023-12-01T01:07:02.044 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.044 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.044 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.044 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.044 INFO:teuthology.orchestra.run.smithi026.stdout: "ssl": { 2023-12-01T01:07:02.044 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ssl", 2023-12-01T01:07:02.045 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.045 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.045 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.045 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "false", 2023-12-01T01:07:02.045 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.045 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.045 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.045 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-12-01T01:07:02.045 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.045 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.045 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.046 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.046 INFO:teuthology.orchestra.run.smithi026.stdout: "threads": { 2023-12-01T01:07:02.046 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "threads", 2023-12-01T01:07:02.046 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.046 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.046 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.046 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "5", 2023-12-01T01:07:02.046 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "1", 2023-12-01T01:07:02.046 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "32", 2023-12-01T01:07:02.046 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.046 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-12-01T01:07:02.047 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.047 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.047 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.047 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.047 INFO:teuthology.orchestra.run.smithi026.stdout: "username": { 2023-12-01T01:07:02.047 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "username", 2023-12-01T01:07:02.047 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.047 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.047 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.047 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.047 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.047 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.047 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.047 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "username of InfluxDB server user", 2023-12-01T01:07:02.047 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.048 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.048 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.048 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.048 INFO:teuthology.orchestra.run.smithi026.stdout: "verify_ssl": { 2023-12-01T01:07:02.048 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "verify_ssl", 2023-12-01T01:07:02.048 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.048 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.048 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.048 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "true", 2023-12-01T01:07:02.048 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.048 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.048 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.048 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-12-01T01:07:02.048 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.049 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.049 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.049 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.049 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.049 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.049 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.049 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "insights", 2023-12-01T01:07:02.049 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.049 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.049 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.049 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.049 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.049 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.049 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.049 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.050 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.050 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.050 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.050 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.050 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.050 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.050 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.050 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.050 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.050 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.050 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.050 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.050 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.051 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.051 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.051 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.051 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.051 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.051 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.051 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.051 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.051 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.052 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.052 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.052 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.052 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.052 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.052 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.052 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.052 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.052 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.052 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.053 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.053 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.053 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.053 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.053 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.053 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.053 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.053 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.053 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.053 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.053 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.053 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.053 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.053 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.054 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.054 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.054 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.054 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.054 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.054 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.054 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.054 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.054 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.054 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.054 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.054 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.054 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.054 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.055 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.055 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.055 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.055 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.055 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.055 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.055 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.055 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.055 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "iostat", 2023-12-01T01:07:02.055 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.055 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.055 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.055 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.055 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.055 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.056 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.057 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.058 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.059 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.059 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.059 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.059 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.059 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.059 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.059 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.059 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.059 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.059 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.059 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.059 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.059 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.059 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.059 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.060 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.060 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.060 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.060 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.060 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.060 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.060 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.060 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.060 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.060 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.060 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.060 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.060 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.060 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "k8sevents", 2023-12-01T01:07:02.060 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.060 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.061 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.061 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_event_retention_days": { 2023-12-01T01:07:02.061 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ceph_event_retention_days", 2023-12-01T01:07:02.061 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.061 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.061 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.061 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "7", 2023-12-01T01:07:02.061 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.061 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.061 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.061 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Days to hold ceph event information within local cache", 2023-12-01T01:07:02.061 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.061 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.061 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.061 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.061 INFO:teuthology.orchestra.run.smithi026.stdout: "config_check_secs": { 2023-12-01T01:07:02.062 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "config_check_secs", 2023-12-01T01:07:02.062 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.062 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.062 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.062 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:02.062 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "10", 2023-12-01T01:07:02.062 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.062 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.062 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-12-01T01:07:02.062 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.062 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.062 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.062 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.062 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.063 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.063 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.063 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.063 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.063 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.063 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.063 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.063 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.063 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.063 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.063 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.063 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.063 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.063 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.064 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.064 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.064 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.064 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.064 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.064 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.064 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.064 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.064 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.064 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.064 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.064 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.064 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.064 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.064 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.065 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.065 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.065 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.065 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.065 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.065 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.065 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.065 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.065 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.065 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.065 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.065 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.065 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.065 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.065 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.066 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.066 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.066 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.066 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.066 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.066 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.066 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.066 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.066 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.066 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.066 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.066 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.066 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.067 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.067 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.067 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.067 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.067 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.067 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.067 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.067 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.067 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.067 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.067 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.067 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.067 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.067 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.067 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.068 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "localpool", 2023-12-01T01:07:02.068 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.068 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.068 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.068 INFO:teuthology.orchestra.run.smithi026.stdout: "failure_domain": { 2023-12-01T01:07:02.068 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "failure_domain", 2023-12-01T01:07:02.068 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.068 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.068 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.068 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "host", 2023-12-01T01:07:02.068 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.068 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.068 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.068 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "failure domain for any created local pool", 2023-12-01T01:07:02.068 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-12-01T01:07:02.069 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.069 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.069 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.069 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.069 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.069 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.069 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.069 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.069 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.069 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.069 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.069 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.069 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.069 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.069 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.070 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.070 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.070 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.070 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.070 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.070 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.070 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.070 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.070 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.070 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.070 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.070 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.070 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.070 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.071 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.072 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.073 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: "min_size": { 2023-12-01T01:07:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "min_size", 2023-12-01T01:07:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.074 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "default min_size for any created local pool", 2023-12-01T01:07:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-12-01T01:07:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: "num_rep": { 2023-12-01T01:07:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "num_rep", 2023-12-01T01:07:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.075 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "3", 2023-12-01T01:07:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "default replica count for any created local pool", 2023-12-01T01:07:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num": { 2023-12-01T01:07:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "pg_num", 2023-12-01T01:07:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "128", 2023-12-01T01:07:02.076 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "default pg_num for any created local pool", 2023-12-01T01:07:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: "prefix": { 2023-12-01T01:07:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "prefix", 2023-12-01T01:07:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.077 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "name prefix for any created local pool", 2023-12-01T01:07:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: "subtree": { 2023-12-01T01:07:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "subtree", 2023-12-01T01:07:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.078 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "rack", 2023-12-01T01:07:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "CRUSH level for which to create a local pool", 2023-12-01T01:07:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-12-01T01:07:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.079 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mds_autoscaler", 2023-12-01T01:07:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.080 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.081 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.082 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.083 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.083 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.083 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.083 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.083 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.083 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.083 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.083 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.083 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.083 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.083 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.084 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.084 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.084 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.084 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.084 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.084 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.084 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.084 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.084 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.084 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.085 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.085 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.085 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.085 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.085 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.085 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.085 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.085 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.085 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.085 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.085 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.085 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mirroring", 2023-12-01T01:07:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.086 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.087 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.088 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.088 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.088 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.088 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.088 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.088 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.088 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.088 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.088 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.088 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.088 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.088 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.088 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.088 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.088 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.089 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.089 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.089 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.089 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.089 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.089 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.089 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.089 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.089 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.089 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.089 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.090 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.090 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.090 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.090 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.090 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.090 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.090 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.090 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.090 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.090 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.090 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.090 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.090 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.090 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.091 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.091 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.091 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.091 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.091 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.091 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.091 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.091 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.091 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.091 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.091 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.091 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.091 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.091 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.091 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.092 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.092 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.092 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.092 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.092 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "nfs", 2023-12-01T01:07:02.092 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.092 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.092 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.092 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.092 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.092 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.092 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.092 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.092 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.092 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.093 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.093 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.093 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.093 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.093 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.093 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.093 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.093 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.093 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.093 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.093 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.093 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.093 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.093 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.093 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.094 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.094 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.094 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.094 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.094 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.094 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.094 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.094 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.094 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.094 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.094 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.094 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.094 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.094 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.094 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.095 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.095 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.095 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.095 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.095 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.095 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.095 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.095 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.095 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.095 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.095 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.095 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.095 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.095 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.095 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.096 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.096 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.096 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.096 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.096 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.096 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.096 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.096 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.096 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.096 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.096 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.096 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.096 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.096 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.096 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.096 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.097 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.097 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.097 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.097 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.097 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.097 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "orchestrator", 2023-12-01T01:07:02.097 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.097 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.097 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.097 INFO:teuthology.orchestra.run.smithi026.stdout: "fail_fs": { 2023-12-01T01:07:02.097 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "fail_fs", 2023-12-01T01:07:02.097 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.097 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.097 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.097 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.098 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.098 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.098 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.098 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-12-01T01:07:02.098 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.098 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.098 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.098 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.098 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.098 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.098 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.098 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.098 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.098 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.098 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.099 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.099 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.099 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.099 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.099 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.099 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.099 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.099 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.099 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.099 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.099 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.099 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.099 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.099 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.099 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.100 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.100 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.100 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.100 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.100 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.100 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.100 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.100 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.100 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.100 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.100 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.100 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.100 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.100 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.100 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.100 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.101 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.101 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.101 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.101 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.101 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.101 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.101 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.101 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.101 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.101 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.101 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.101 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.101 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.101 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.101 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.102 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.102 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.102 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.102 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.102 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.102 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.102 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.102 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.102 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.102 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.102 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.102 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.102 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.103 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.103 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.103 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.103 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.103 INFO:teuthology.orchestra.run.smithi026.stdout: "orchestrator": { 2023-12-01T01:07:02.103 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "orchestrator", 2023-12-01T01:07:02.103 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.103 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.103 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.103 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.103 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.103 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.103 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.103 INFO:teuthology.orchestra.run.smithi026.stdout: "cephadm", 2023-12-01T01:07:02.104 INFO:teuthology.orchestra.run.smithi026.stdout: "rook", 2023-12-01T01:07:02.104 INFO:teuthology.orchestra.run.smithi026.stdout: "test_orchestrator" 2023-12-01T01:07:02.104 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.104 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Orchestrator backend", 2023-12-01T01:07:02.104 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.104 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.104 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.104 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.104 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.104 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.104 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.104 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "osd_perf_query", 2023-12-01T01:07:02.104 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.104 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.104 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.105 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.106 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.106 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.106 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.106 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.106 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.106 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.106 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.106 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.106 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.106 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.106 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.106 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.106 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.106 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.106 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.107 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.107 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.107 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.107 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.107 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.107 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.107 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.107 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.107 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.107 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.107 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.107 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.107 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.107 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.107 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.108 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.108 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.108 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.108 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.108 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.108 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.108 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.108 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.108 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.108 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.108 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.108 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.108 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.108 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.108 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.108 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.109 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.109 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.109 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.109 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.109 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.109 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.109 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.109 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.109 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.109 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.109 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.109 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "osd_support", 2023-12-01T01:07:02.109 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.109 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.110 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.110 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.110 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.110 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.110 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.110 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.110 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.110 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.110 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.110 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.110 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.110 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.110 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.110 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.110 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.110 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.111 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.111 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.111 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.111 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.111 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.111 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.111 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.111 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.111 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.111 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.111 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.111 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.111 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.111 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.111 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.112 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.112 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.112 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.112 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.112 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.112 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.112 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.112 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.112 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.112 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.112 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.112 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.112 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.112 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.112 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.113 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "pg_autoscaler", 2023-12-01T01:07:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.114 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.115 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.116 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.116 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.116 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.116 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.116 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.116 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.116 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.116 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.116 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.116 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.116 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.116 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.116 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.117 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.117 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.117 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.117 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.117 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.117 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.117 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.117 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.117 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.117 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.117 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.117 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.117 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.117 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.117 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.118 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.118 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.118 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.118 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.118 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.118 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.118 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.118 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.118 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.118 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.118 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.118 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.118 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.118 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.119 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.119 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.119 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.119 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.119 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.119 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.119 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.119 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.119 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.119 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.119 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.119 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.119 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.119 INFO:teuthology.orchestra.run.smithi026.stdout: "sleep_interval": { 2023-12-01T01:07:02.120 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "sleep_interval", 2023-12-01T01:07:02.120 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.120 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.120 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.120 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "60", 2023-12-01T01:07:02.120 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.120 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.120 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.120 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.120 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.120 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.120 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.121 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.121 INFO:teuthology.orchestra.run.smithi026.stdout: "threshold": { 2023-12-01T01:07:02.121 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "threshold", 2023-12-01T01:07:02.121 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:02.121 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.121 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.121 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "3.0", 2023-12-01T01:07:02.121 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "1.0", 2023-12-01T01:07:02.121 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.121 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.121 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "scaling threshold", 2023-12-01T01:07:02.121 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-12-01T01:07:02.121 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.121 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.122 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.122 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.122 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.122 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.122 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "progress", 2023-12-01T01:07:02.122 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.122 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.122 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.122 INFO:teuthology.orchestra.run.smithi026.stdout: "allow_pg_recovery_event": { 2023-12-01T01:07:02.122 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "allow_pg_recovery_event", 2023-12-01T01:07:02.122 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.122 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.122 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.122 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.123 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.123 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.123 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.123 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "allow the module to show pg recovery progress", 2023-12-01T01:07:02.123 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.123 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.123 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.123 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.123 INFO:teuthology.orchestra.run.smithi026.stdout: "enabled": { 2023-12-01T01:07:02.123 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "enabled", 2023-12-01T01:07:02.123 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.123 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.123 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.123 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.123 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.124 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.124 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.124 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.124 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.124 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.124 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.124 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.124 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.124 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.124 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.124 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.124 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.124 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.124 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.124 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.124 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.125 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.125 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.125 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.125 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.125 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.125 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.125 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.125 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.125 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.125 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.125 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.125 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.125 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.125 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.126 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.126 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.126 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.126 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.126 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.126 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.126 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.126 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.126 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.126 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.126 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.126 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.126 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.126 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.126 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.127 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.127 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.127 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.127 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.127 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.127 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.127 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.127 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.127 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.127 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.127 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.127 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.127 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.127 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.127 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.128 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.128 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.128 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.128 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.128 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.128 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.128 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.128 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.128 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.128 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.128 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.128 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.128 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.128 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.129 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.129 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.129 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.129 INFO:teuthology.orchestra.run.smithi026.stdout: "max_completed_events": { 2023-12-01T01:07:02.129 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "max_completed_events", 2023-12-01T01:07:02.129 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.129 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.129 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.129 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "50", 2023-12-01T01:07:02.129 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.129 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.129 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.129 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "number of past completed events to remember", 2023-12-01T01:07:02.129 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.130 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.130 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.130 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.130 INFO:teuthology.orchestra.run.smithi026.stdout: "sleep_interval": { 2023-12-01T01:07:02.130 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "sleep_interval", 2023-12-01T01:07:02.130 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.130 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.130 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.130 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "5", 2023-12-01T01:07:02.130 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.130 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.130 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.130 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how long the module is going to sleep", 2023-12-01T01:07:02.130 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.130 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.131 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.131 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.131 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.131 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.131 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.131 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "prometheus", 2023-12-01T01:07:02.131 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.131 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.131 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.131 INFO:teuthology.orchestra.run.smithi026.stdout: "cache": { 2023-12-01T01:07:02.131 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cache", 2023-12-01T01:07:02.131 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.131 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.131 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.131 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.132 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.132 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.132 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.132 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.132 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.132 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.132 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.132 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.132 INFO:teuthology.orchestra.run.smithi026.stdout: "exclude_perf_counters": { 2023-12-01T01:07:02.132 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "exclude_perf_counters", 2023-12-01T01:07:02.132 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.132 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.132 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.132 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.133 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.133 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.133 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.133 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-12-01T01:07:02.133 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-12-01T01:07:02.133 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.133 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.133 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.133 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.133 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.133 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.133 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.133 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.133 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.133 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.134 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.134 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.134 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.134 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.134 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.134 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.134 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.134 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.134 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.134 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.134 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.134 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.134 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.134 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.134 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.135 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.135 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.135 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.135 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.135 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.135 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.135 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.135 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.135 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.135 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.135 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.135 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.135 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.135 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.135 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.136 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.136 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.136 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.136 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.136 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.136 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.136 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.136 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.136 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.136 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.136 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.136 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.136 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.136 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.137 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.137 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.137 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.137 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.137 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.137 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.137 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.137 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.137 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.137 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.137 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.137 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.137 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.137 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.137 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.138 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.138 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.138 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.138 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.138 INFO:teuthology.orchestra.run.smithi026.stdout: "rbd_stats_pools": { 2023-12-01T01:07:02.138 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rbd_stats_pools", 2023-12-01T01:07:02.138 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.138 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.138 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.138 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.138 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.138 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.138 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.138 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.138 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.139 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.139 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.141 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.141 INFO:teuthology.orchestra.run.smithi026.stdout: "rbd_stats_pools_refresh_interval": { 2023-12-01T01:07:02.141 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-12-01T01:07:02.141 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.141 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.141 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.141 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "300", 2023-12-01T01:07:02.141 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.141 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.142 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.142 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.142 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.142 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.142 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.142 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.142 INFO:teuthology.orchestra.run.smithi026.stdout: "scrape_interval": { 2023-12-01T01:07:02.142 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "scrape_interval", 2023-12-01T01:07:02.142 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:02.142 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.142 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.142 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "15.0", 2023-12-01T01:07:02.142 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.142 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.142 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.143 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.143 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.143 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.143 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.143 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.143 INFO:teuthology.orchestra.run.smithi026.stdout: "server_addr": { 2023-12-01T01:07:02.143 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_addr", 2023-12-01T01:07:02.143 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.143 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.143 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.143 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "::", 2023-12-01T01:07:02.143 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.143 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.143 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.144 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-12-01T01:07:02.144 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.144 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.144 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.144 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.144 INFO:teuthology.orchestra.run.smithi026.stdout: "server_port": { 2023-12-01T01:07:02.144 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_port", 2023-12-01T01:07:02.144 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.144 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.144 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.144 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "9283", 2023-12-01T01:07:02.144 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.144 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.144 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.144 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-12-01T01:07:02.145 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.145 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.145 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.145 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.145 INFO:teuthology.orchestra.run.smithi026.stdout: "stale_cache_strategy": { 2023-12-01T01:07:02.145 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "stale_cache_strategy", 2023-12-01T01:07:02.145 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.145 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.145 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.145 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "log", 2023-12-01T01:07:02.145 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.145 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.145 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.145 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.145 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.146 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.146 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.146 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.146 INFO:teuthology.orchestra.run.smithi026.stdout: "standby_behaviour": { 2023-12-01T01:07:02.146 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "standby_behaviour", 2023-12-01T01:07:02.146 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.146 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.146 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.146 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "default", 2023-12-01T01:07:02.146 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.146 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.146 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.146 INFO:teuthology.orchestra.run.smithi026.stdout: "default", 2023-12-01T01:07:02.146 INFO:teuthology.orchestra.run.smithi026.stdout: "error" 2023-12-01T01:07:02.146 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.147 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.147 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.147 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.147 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.147 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.147 INFO:teuthology.orchestra.run.smithi026.stdout: "standby_error_status_code": { 2023-12-01T01:07:02.147 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "standby_error_status_code", 2023-12-01T01:07:02.147 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.147 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.147 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.147 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "500", 2023-12-01T01:07:02.147 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "400", 2023-12-01T01:07:02.147 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "599", 2023-12-01T01:07:02.147 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.147 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.147 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.148 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.148 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.148 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.148 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.148 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.148 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.148 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rbd_support", 2023-12-01T01:07:02.148 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.148 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.148 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.148 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.148 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.148 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.148 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.148 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.149 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.149 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.149 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.149 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.149 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.149 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.149 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.149 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.149 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.149 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.149 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.149 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.149 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.149 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.149 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.149 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.150 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.150 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.150 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.150 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.150 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.150 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.150 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.150 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.150 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.150 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.150 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.150 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.150 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.150 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.150 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.151 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.151 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.151 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.151 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.151 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.151 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.151 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.151 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.151 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.151 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.151 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.151 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.151 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.151 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.151 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.151 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.152 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.152 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.152 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.152 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.152 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.152 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.152 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.152 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.152 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.152 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.152 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.152 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.152 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.152 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.152 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.153 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.153 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.153 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.153 INFO:teuthology.orchestra.run.smithi026.stdout: "max_concurrent_snap_create": { 2023-12-01T01:07:02.153 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "max_concurrent_snap_create", 2023-12-01T01:07:02.153 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.153 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.153 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.153 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:02.153 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.153 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.153 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.153 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.153 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.153 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.154 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.154 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.154 INFO:teuthology.orchestra.run.smithi026.stdout: "mirror_snapshot_schedule": { 2023-12-01T01:07:02.154 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mirror_snapshot_schedule", 2023-12-01T01:07:02.154 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.154 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.154 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.154 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.154 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.154 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.154 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.154 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.154 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.154 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.154 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.155 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.155 INFO:teuthology.orchestra.run.smithi026.stdout: "trash_purge_schedule": { 2023-12-01T01:07:02.155 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "trash_purge_schedule", 2023-12-01T01:07:02.155 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.155 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.155 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.155 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.155 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.155 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.155 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.155 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.155 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.155 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.155 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.155 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.155 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.156 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.156 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.156 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "restful", 2023-12-01T01:07:02.156 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.156 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.156 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.156 INFO:teuthology.orchestra.run.smithi026.stdout: "enable_auth": { 2023-12-01T01:07:02.156 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "enable_auth", 2023-12-01T01:07:02.156 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.156 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.156 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.156 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.156 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.156 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.157 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.157 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.157 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.157 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.157 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.157 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.157 INFO:teuthology.orchestra.run.smithi026.stdout: "key_file": { 2023-12-01T01:07:02.157 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "key_file", 2023-12-01T01:07:02.157 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.157 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.157 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.157 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.157 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.157 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.157 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.158 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.158 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.158 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.158 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.158 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.158 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.158 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.158 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.158 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.158 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.158 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.158 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.158 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.158 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.158 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.159 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.159 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.159 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.159 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.159 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.159 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.159 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.159 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.159 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.159 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.159 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.159 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.159 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.159 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.159 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.160 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.160 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.160 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.160 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.160 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.160 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.160 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.160 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.160 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.160 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.160 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.160 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.160 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.160 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.161 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.161 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.161 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.161 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.161 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.161 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.161 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.161 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.161 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.161 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.161 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.161 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.161 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.161 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.161 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.162 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.162 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.162 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.162 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.162 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.162 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.162 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.162 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.162 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.162 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.162 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.162 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.162 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.162 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.162 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.163 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.163 INFO:teuthology.orchestra.run.smithi026.stdout: "server_addr": { 2023-12-01T01:07:02.163 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_addr", 2023-12-01T01:07:02.163 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.163 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.163 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.163 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.163 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.163 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.163 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.163 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.163 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.163 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.163 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.163 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.163 INFO:teuthology.orchestra.run.smithi026.stdout: "server_port": { 2023-12-01T01:07:02.164 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_port", 2023-12-01T01:07:02.164 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.164 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.164 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.164 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.164 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.164 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.164 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.164 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.164 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.164 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.164 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.164 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.164 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.164 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.165 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.165 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rgw", 2023-12-01T01:07:02.165 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.165 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.165 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.165 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.165 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.165 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.165 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.165 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.165 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.165 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.165 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.165 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.165 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.165 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.166 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.166 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.166 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.166 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.166 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.166 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.166 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.166 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.166 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.166 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.166 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.166 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.166 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.166 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.167 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.167 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.167 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.167 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.167 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.167 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.167 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.167 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.167 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.167 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.167 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.167 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.167 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.167 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.167 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.168 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.168 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.168 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.168 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.168 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.168 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.168 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.168 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.168 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.168 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.168 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.168 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.168 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.168 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.168 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.168 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.169 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.169 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.169 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.169 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.169 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.169 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.169 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.169 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.169 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.169 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.169 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.169 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.169 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.169 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.170 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.170 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.170 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.170 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rook", 2023-12-01T01:07:02.170 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.170 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.170 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.170 INFO:teuthology.orchestra.run.smithi026.stdout: "drive_group_interval": { 2023-12-01T01:07:02.170 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "drive_group_interval", 2023-12-01T01:07:02.170 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:02.170 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.170 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.170 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "300.0", 2023-12-01T01:07:02.170 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.171 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.171 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.171 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-12-01T01:07:02.171 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.171 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.171 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.171 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.171 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.171 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.171 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.171 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.171 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.171 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.171 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.171 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.172 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.172 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.172 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.172 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.172 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.172 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.172 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.172 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.172 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.172 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.172 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.172 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.172 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.172 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.173 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.173 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.173 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.173 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.173 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.173 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.173 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.173 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.173 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.173 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.173 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.173 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.173 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.173 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.173 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.174 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.174 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.174 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.174 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.174 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.174 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.174 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.174 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.174 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.174 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.174 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.174 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.174 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.174 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.175 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.175 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.175 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.175 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.175 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.175 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.175 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.175 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.175 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.175 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.175 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.175 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.175 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.175 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.176 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.176 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.176 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.176 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.176 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.176 INFO:teuthology.orchestra.run.smithi026.stdout: "storage_class": { 2023-12-01T01:07:02.176 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "storage_class", 2023-12-01T01:07:02.176 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.176 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.176 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.176 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "local", 2023-12-01T01:07:02.176 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.176 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.176 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.176 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-12-01T01:07:02.177 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.177 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.177 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.177 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.177 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.177 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.177 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.177 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "selftest", 2023-12-01T01:07:02.177 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.177 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.177 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.177 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.177 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.177 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.177 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.178 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.178 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.178 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.178 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.178 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.178 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.178 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.178 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.178 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.178 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.178 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.178 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.178 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.178 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.178 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.179 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.179 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.179 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.179 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.179 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.179 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.179 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.179 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.179 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.179 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.179 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.179 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.179 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.179 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.179 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.180 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.180 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.180 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.180 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.180 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.180 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.180 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.180 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.180 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.180 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.180 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.180 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.180 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.180 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.180 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.181 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.182 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.182 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.182 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.182 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.182 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.182 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.182 INFO:teuthology.orchestra.run.smithi026.stdout: "roption1": { 2023-12-01T01:07:02.182 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "roption1", 2023-12-01T01:07:02.182 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.182 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.182 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.182 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.182 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.182 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.183 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.183 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.183 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.183 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.183 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.183 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.183 INFO:teuthology.orchestra.run.smithi026.stdout: "roption2": { 2023-12-01T01:07:02.183 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "roption2", 2023-12-01T01:07:02.183 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.183 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.183 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.183 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "xyz", 2023-12-01T01:07:02.183 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.183 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.183 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.184 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.184 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.184 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.184 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.184 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.184 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption1": { 2023-12-01T01:07:02.184 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption1", 2023-12-01T01:07:02.184 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.184 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.184 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.184 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.184 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.184 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.184 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.184 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.185 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.185 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.185 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.185 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.185 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption2": { 2023-12-01T01:07:02.185 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption2", 2023-12-01T01:07:02.185 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.185 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.185 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.185 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.185 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.185 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.185 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.185 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.185 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.185 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.186 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.186 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.186 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption3": { 2023-12-01T01:07:02.186 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption3", 2023-12-01T01:07:02.186 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:02.186 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.186 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.186 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.186 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.186 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.186 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.186 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.186 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.186 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.186 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.187 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.187 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption4": { 2023-12-01T01:07:02.187 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption4", 2023-12-01T01:07:02.187 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.187 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.187 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.187 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.187 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.187 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.187 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.187 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.187 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.187 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.187 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.187 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.188 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption5": { 2023-12-01T01:07:02.188 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption5", 2023-12-01T01:07:02.188 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.188 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.188 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.188 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.188 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.188 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.188 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.188 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.188 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.188 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.188 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.188 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.188 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption6": { 2023-12-01T01:07:02.189 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption6", 2023-12-01T01:07:02.189 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.189 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.189 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.189 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.189 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.189 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.189 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.189 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.189 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.189 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.189 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.189 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.189 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption7": { 2023-12-01T01:07:02.189 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption7", 2023-12-01T01:07:02.190 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.190 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.190 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.190 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.190 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "1", 2023-12-01T01:07:02.190 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "42", 2023-12-01T01:07:02.190 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.190 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.190 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.190 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.190 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.190 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.190 INFO:teuthology.orchestra.run.smithi026.stdout: "testkey": { 2023-12-01T01:07:02.190 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "testkey", 2023-12-01T01:07:02.190 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.190 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.191 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.191 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.191 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.191 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.191 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.191 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.191 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.191 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.191 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.191 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.191 INFO:teuthology.orchestra.run.smithi026.stdout: "testlkey": { 2023-12-01T01:07:02.191 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "testlkey", 2023-12-01T01:07:02.191 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.191 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.191 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.192 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.192 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.192 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.192 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.192 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.192 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.192 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.192 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.192 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.192 INFO:teuthology.orchestra.run.smithi026.stdout: "testnewline": { 2023-12-01T01:07:02.192 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "testnewline", 2023-12-01T01:07:02.192 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.192 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.192 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.192 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.193 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.193 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.193 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.193 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.193 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.193 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.193 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.193 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.193 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.193 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.193 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.193 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "snap_schedule", 2023-12-01T01:07:02.193 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.193 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.193 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.193 INFO:teuthology.orchestra.run.smithi026.stdout: "allow_m_granularity": { 2023-12-01T01:07:02.194 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "allow_m_granularity", 2023-12-01T01:07:02.194 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.194 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.194 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.194 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.194 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.194 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.194 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.194 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "allow minute scheduled snapshots", 2023-12-01T01:07:02.194 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.194 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.194 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.194 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.194 INFO:teuthology.orchestra.run.smithi026.stdout: "dump_on_update": { 2023-12-01T01:07:02.194 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "dump_on_update", 2023-12-01T01:07:02.195 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.195 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.195 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.195 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.195 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.195 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.195 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.195 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "dump database to debug log on update", 2023-12-01T01:07:02.195 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.195 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.195 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.195 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.195 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.196 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.196 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.196 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.196 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.196 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.196 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.196 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.196 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.196 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.196 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.196 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.196 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.196 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.196 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.196 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.197 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.197 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.197 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.197 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.197 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.197 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.197 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.197 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.197 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.197 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.197 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.197 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.197 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.197 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.197 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.198 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.198 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.198 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.198 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.198 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.198 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.198 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.198 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.198 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.198 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.198 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.198 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.198 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.198 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.198 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.199 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.200 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.200 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.200 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.200 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.200 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.200 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.200 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.200 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.200 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.200 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.200 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.200 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.200 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "stats", 2023-12-01T01:07:02.200 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.200 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.201 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.201 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.201 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.201 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.201 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.201 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.201 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.201 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.201 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.201 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.201 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.201 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.201 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.201 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.201 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.202 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.202 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.202 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.202 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.202 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.202 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.202 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.202 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.202 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.202 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.202 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.202 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.202 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.202 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.202 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.203 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.203 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.203 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.203 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.203 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.203 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.203 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.203 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.203 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.203 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.203 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.203 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.203 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.204 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.205 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "status", 2023-12-01T01:07:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.206 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.207 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.207 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.207 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.207 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.207 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.207 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.207 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.207 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.207 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.207 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.207 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.207 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.207 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.207 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.207 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.208 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.208 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.208 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.208 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.208 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.208 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.208 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.208 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.208 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.208 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.208 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.208 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.208 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.208 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.208 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.209 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.209 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.209 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.209 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.209 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.209 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.209 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.209 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.209 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.209 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.209 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.209 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.209 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.209 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.210 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.210 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.210 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.210 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.210 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.210 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.210 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.210 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.210 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.210 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.210 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.210 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.210 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.210 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.210 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.211 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.211 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.211 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.211 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.211 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "telegraf", 2023-12-01T01:07:02.211 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.211 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.211 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.211 INFO:teuthology.orchestra.run.smithi026.stdout: "address": { 2023-12-01T01:07:02.211 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "address", 2023-12-01T01:07:02.211 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.211 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.211 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.211 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-12-01T01:07:02.212 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.212 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.212 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.212 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.212 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.212 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.212 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.212 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.212 INFO:teuthology.orchestra.run.smithi026.stdout: "interval": { 2023-12-01T01:07:02.213 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "interval", 2023-12-01T01:07:02.213 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.213 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.213 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.213 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "15", 2023-12-01T01:07:02.213 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.213 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.213 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.213 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.214 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.214 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.214 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.214 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.214 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.214 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.214 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.214 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.215 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.215 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.215 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.215 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.215 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.215 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.215 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.215 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.216 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.216 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.216 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.216 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.216 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.216 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.216 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.216 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.216 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.216 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.216 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.216 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.217 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.217 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.217 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.217 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.217 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.217 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.217 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.217 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.217 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.217 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.217 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.217 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.217 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.217 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.217 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.217 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.218 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.218 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.218 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.218 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.218 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.218 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.218 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.218 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.218 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.218 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.218 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.218 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.218 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.218 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.219 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.219 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.219 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.219 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.219 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.219 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.219 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.219 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.219 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.219 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.219 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.219 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.219 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.219 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.219 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.220 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.220 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.220 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.220 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.220 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "telemetry", 2023-12-01T01:07:02.220 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.220 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.220 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.220 INFO:teuthology.orchestra.run.smithi026.stdout: "channel_basic": { 2023-12-01T01:07:02.220 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "channel_basic", 2023-12-01T01:07:02.220 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.220 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.220 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.220 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.220 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.221 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.221 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.221 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Share basic cluster information (size, version)", 2023-12-01T01:07:02.221 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.221 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.221 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.221 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.221 INFO:teuthology.orchestra.run.smithi026.stdout: "channel_crash": { 2023-12-01T01:07:02.221 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "channel_crash", 2023-12-01T01:07:02.221 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.221 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.221 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.221 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.221 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.221 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.222 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.222 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-12-01T01:07:02.222 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.222 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.222 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.222 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.222 INFO:teuthology.orchestra.run.smithi026.stdout: "channel_device": { 2023-12-01T01:07:02.222 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "channel_device", 2023-12-01T01:07:02.222 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.222 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.222 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.222 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.223 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.223 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.223 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.223 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-12-01T01:07:02.223 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.223 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.223 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.223 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.223 INFO:teuthology.orchestra.run.smithi026.stdout: "channel_ident": { 2023-12-01T01:07:02.223 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "channel_ident", 2023-12-01T01:07:02.223 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.223 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.223 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.223 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.223 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.224 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.224 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.224 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-12-01T01:07:02.224 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.224 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.224 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.224 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.224 INFO:teuthology.orchestra.run.smithi026.stdout: "channel_perf": { 2023-12-01T01:07:02.224 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "channel_perf", 2023-12-01T01:07:02.224 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.224 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.224 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.224 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.224 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.225 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.225 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.225 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Share various performance metrics of a cluster", 2023-12-01T01:07:02.225 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.225 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.225 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.225 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.225 INFO:teuthology.orchestra.run.smithi026.stdout: "contact": { 2023-12-01T01:07:02.225 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "contact", 2023-12-01T01:07:02.225 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.225 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.225 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.225 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.225 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.226 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.226 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.226 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.226 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.226 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.226 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.226 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.226 INFO:teuthology.orchestra.run.smithi026.stdout: "description": { 2023-12-01T01:07:02.226 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "description", 2023-12-01T01:07:02.226 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.226 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.227 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.227 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.227 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.227 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.227 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.227 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.227 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.227 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.227 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.227 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.227 INFO:teuthology.orchestra.run.smithi026.stdout: "device_url": { 2023-12-01T01:07:02.227 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "device_url", 2023-12-01T01:07:02.227 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.227 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.227 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.228 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-12-01T01:07:02.228 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.228 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.228 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.228 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.228 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.228 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.228 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.228 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.228 INFO:teuthology.orchestra.run.smithi026.stdout: "enabled": { 2023-12-01T01:07:02.228 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "enabled", 2023-12-01T01:07:02.228 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.228 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.228 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.228 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.229 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.229 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.229 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.229 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.229 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.229 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.229 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.229 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.229 INFO:teuthology.orchestra.run.smithi026.stdout: "interval": { 2023-12-01T01:07:02.229 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "interval", 2023-12-01T01:07:02.229 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.229 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.229 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.229 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "24", 2023-12-01T01:07:02.229 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "8", 2023-12-01T01:07:02.230 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.230 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.230 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.230 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.230 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.230 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.230 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.230 INFO:teuthology.orchestra.run.smithi026.stdout: "last_opt_revision": { 2023-12-01T01:07:02.230 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "last_opt_revision", 2023-12-01T01:07:02.230 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.230 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.230 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.230 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "1", 2023-12-01T01:07:02.230 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.230 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.231 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.231 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.231 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.231 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.231 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.231 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.231 INFO:teuthology.orchestra.run.smithi026.stdout: "leaderboard": { 2023-12-01T01:07:02.231 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "leaderboard", 2023-12-01T01:07:02.231 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.231 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.231 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.231 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.231 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.231 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.231 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.232 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.232 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.232 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.232 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.232 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.232 INFO:teuthology.orchestra.run.smithi026.stdout: "leaderboard_description": { 2023-12-01T01:07:02.232 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "leaderboard_description", 2023-12-01T01:07:02.232 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.232 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.232 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.232 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.232 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.232 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.232 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.232 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.233 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.233 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.233 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.233 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.233 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.233 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.233 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.233 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.233 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.233 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.233 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.233 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.233 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.233 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.233 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.234 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.234 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.234 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.234 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.234 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.234 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.234 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.234 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.234 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.234 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.234 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.234 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.234 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.234 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.235 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.235 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.235 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.235 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.235 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.235 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.235 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.235 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.235 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.235 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.235 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.235 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.235 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.235 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.235 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.235 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.236 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.236 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.236 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.236 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.236 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.236 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.236 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.236 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.236 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.236 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.236 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.236 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.236 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.236 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.236 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.237 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.237 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.237 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.237 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.237 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.237 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.237 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.237 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.237 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.237 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.237 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.237 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.237 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.237 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.238 INFO:teuthology.orchestra.run.smithi026.stdout: "organization": { 2023-12-01T01:07:02.238 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "organization", 2023-12-01T01:07:02.238 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.238 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.238 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.238 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.238 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.238 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.238 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.238 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.238 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.238 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.238 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.238 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.238 INFO:teuthology.orchestra.run.smithi026.stdout: "proxy": { 2023-12-01T01:07:02.239 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "proxy", 2023-12-01T01:07:02.239 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.239 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.239 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.239 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.239 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.239 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.239 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.239 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.239 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.239 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.239 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.239 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.239 INFO:teuthology.orchestra.run.smithi026.stdout: "url": { 2023-12-01T01:07:02.239 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "url", 2023-12-01T01:07:02.240 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.240 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.240 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.240 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-12-01T01:07:02.240 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.240 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.240 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.240 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.240 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.240 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.240 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.240 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.240 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.240 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.240 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.241 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "test_orchestrator", 2023-12-01T01:07:02.241 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.241 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.241 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.241 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.241 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.241 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.241 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.241 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.241 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.241 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.241 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.241 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.241 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.241 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.242 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.242 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.242 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.242 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.242 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.242 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.242 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.242 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.242 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.242 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.242 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.242 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.242 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.242 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.243 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.243 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.243 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.243 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.243 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.243 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.243 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.243 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.243 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.243 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.243 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.243 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.243 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.243 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.243 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.244 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.244 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.244 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.244 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.244 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.244 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.244 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.244 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.244 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.244 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.244 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.244 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.244 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.244 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.244 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.245 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.245 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.245 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.245 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.245 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.245 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.245 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.245 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.245 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.245 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.245 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.245 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.245 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.245 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.245 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.246 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.246 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.246 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.246 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "volumes", 2023-12-01T01:07:02.246 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.246 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.246 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.246 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.246 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.246 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.246 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.246 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.246 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.246 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.246 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.247 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.247 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.247 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.247 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.247 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.247 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.247 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.247 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.247 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.247 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.247 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.247 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.247 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.247 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.247 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.247 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.248 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.248 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.248 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.248 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.248 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.248 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.248 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.248 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.248 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.248 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.248 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.248 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.248 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.248 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.248 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.248 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.249 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.249 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.249 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.249 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.249 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.249 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.249 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.249 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.249 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.249 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.249 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.249 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.249 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.249 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.249 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.250 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.250 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.250 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.250 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.250 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.250 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.250 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.250 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.250 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.250 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.250 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.250 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.250 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.250 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.251 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.251 INFO:teuthology.orchestra.run.smithi026.stdout: "max_concurrent_clones": { 2023-12-01T01:07:02.251 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "max_concurrent_clones", 2023-12-01T01:07:02.251 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.251 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.251 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.251 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "4", 2023-12-01T01:07:02.251 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.251 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.251 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.251 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Number of asynchronous cloner threads", 2023-12-01T01:07:02.251 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.251 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.251 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.251 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.252 INFO:teuthology.orchestra.run.smithi026.stdout: "snapshot_clone_delay": { 2023-12-01T01:07:02.252 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "snapshot_clone_delay", 2023-12-01T01:07:02.252 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.252 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.252 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.252 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0", 2023-12-01T01:07:02.252 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.252 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.252 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.252 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-12-01T01:07:02.252 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.252 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.252 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.252 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.252 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.253 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.253 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.253 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "zabbix", 2023-12-01T01:07:02.253 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.253 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.253 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.253 INFO:teuthology.orchestra.run.smithi026.stdout: "discovery_interval": { 2023-12-01T01:07:02.253 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "discovery_interval", 2023-12-01T01:07:02.253 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "uint", 2023-12-01T01:07:02.253 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.253 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.253 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "100", 2023-12-01T01:07:02.253 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.253 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.253 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.254 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.254 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.254 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.254 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.254 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.254 INFO:teuthology.orchestra.run.smithi026.stdout: "identifier": { 2023-12-01T01:07:02.254 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "identifier", 2023-12-01T01:07:02.254 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.254 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.254 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.254 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.254 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.254 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.254 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.254 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.255 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.255 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.255 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.255 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.255 INFO:teuthology.orchestra.run.smithi026.stdout: "interval": { 2023-12-01T01:07:02.255 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "interval", 2023-12-01T01:07:02.255 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.255 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.255 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.255 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "60", 2023-12-01T01:07:02.255 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.255 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.255 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.255 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.255 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.256 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.256 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.256 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.256 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.256 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.256 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.256 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.256 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.256 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.256 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.256 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.256 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.256 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.256 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.256 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.256 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.257 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.257 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.257 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.257 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.257 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.257 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.257 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.257 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.257 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.257 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.257 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.257 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.257 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.257 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.257 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.258 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.258 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.258 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.258 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.258 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.258 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.258 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.258 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.258 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.258 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.258 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.258 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.258 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.258 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.258 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.259 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.259 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.259 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.259 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.259 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.259 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.259 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.259 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.259 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.259 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.259 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.259 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.259 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.259 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.259 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.260 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.260 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.260 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.260 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.260 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.260 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.260 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.260 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.260 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.260 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.260 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.260 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.260 INFO:teuthology.orchestra.run.smithi026.stdout: "zabbix_host": { 2023-12-01T01:07:02.260 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "zabbix_host", 2023-12-01T01:07:02.261 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.261 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.261 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.261 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.261 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.261 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.261 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.261 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.261 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.261 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.261 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.261 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.261 INFO:teuthology.orchestra.run.smithi026.stdout: "zabbix_port": { 2023-12-01T01:07:02.261 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "zabbix_port", 2023-12-01T01:07:02.261 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.262 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.262 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.262 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10051", 2023-12-01T01:07:02.262 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.262 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.262 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.262 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.262 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.262 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.262 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.262 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.262 INFO:teuthology.orchestra.run.smithi026.stdout: "zabbix_sender": { 2023-12-01T01:07:02.262 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "zabbix_sender", 2023-12-01T01:07:02.262 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.262 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.263 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.263 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-12-01T01:07:02.263 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.263 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.263 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.263 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.263 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.263 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.263 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.263 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.263 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.263 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.263 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-12-01T01:07:02.263 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.264 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.264 INFO:teuthology.orchestra.run.smithi026.stdout: "modules": [ 2023-12-01T01:07:02.264 INFO:teuthology.orchestra.run.smithi026.stdout: "cephadm", 2023-12-01T01:07:02.264 INFO:teuthology.orchestra.run.smithi026.stdout: "dashboard", 2023-12-01T01:07:02.264 INFO:teuthology.orchestra.run.smithi026.stdout: "iostat", 2023-12-01T01:07:02.264 INFO:teuthology.orchestra.run.smithi026.stdout: "nfs", 2023-12-01T01:07:02.264 INFO:teuthology.orchestra.run.smithi026.stdout: "restful" 2023-12-01T01:07:02.264 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.264 INFO:teuthology.orchestra.run.smithi026.stdout: "available_modules": [ 2023-12-01T01:07:02.264 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.264 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "alerts", 2023-12-01T01:07:02.264 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.264 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.264 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.264 INFO:teuthology.orchestra.run.smithi026.stdout: "interval": { 2023-12-01T01:07:02.265 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "interval", 2023-12-01T01:07:02.265 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.265 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.265 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.265 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "60", 2023-12-01T01:07:02.265 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.265 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.265 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.265 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "How frequently to reexamine health status", 2023-12-01T01:07:02.265 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.265 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.265 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.265 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.265 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.266 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.266 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.266 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.266 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.266 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.266 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.266 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.266 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.266 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.266 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.266 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.266 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.266 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.266 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.266 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.267 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.267 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.267 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.267 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.267 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.267 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.267 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.267 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.267 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.267 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.267 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.267 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.267 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.267 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.267 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.267 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.268 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.268 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.268 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.268 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.268 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.268 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.268 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.268 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.268 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.268 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.268 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.268 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.268 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.268 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.268 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.269 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.269 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.269 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.269 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.269 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.269 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.269 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.269 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.269 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.269 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.269 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.269 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.269 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.269 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.269 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.270 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.270 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.270 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.270 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.270 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.270 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.270 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.270 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.270 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_destination": { 2023-12-01T01:07:02.270 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_destination", 2023-12-01T01:07:02.270 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.270 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.270 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.270 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.270 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.271 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.271 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.271 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Email address to send alerts to", 2023-12-01T01:07:02.271 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.271 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.271 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.271 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.271 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_from_name": { 2023-12-01T01:07:02.271 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_from_name", 2023-12-01T01:07:02.271 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.271 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.271 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.271 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "Ceph", 2023-12-01T01:07:02.271 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.271 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.272 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.272 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Email From: name", 2023-12-01T01:07:02.272 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.272 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.272 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.272 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.272 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_host": { 2023-12-01T01:07:02.272 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_host", 2023-12-01T01:07:02.272 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.272 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.272 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.272 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.272 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.272 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.272 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.273 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "SMTP server", 2023-12-01T01:07:02.273 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.273 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.273 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.273 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.273 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_password": { 2023-12-01T01:07:02.273 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_password", 2023-12-01T01:07:02.273 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.273 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.273 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.273 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.273 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.273 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.273 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.274 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Password to authenticate with", 2023-12-01T01:07:02.274 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.274 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.274 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.274 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.274 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_port": { 2023-12-01T01:07:02.274 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_port", 2023-12-01T01:07:02.274 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.274 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.275 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.275 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "465", 2023-12-01T01:07:02.275 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.275 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.275 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.275 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "SMTP port", 2023-12-01T01:07:02.275 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.275 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.275 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.275 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.275 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_sender": { 2023-12-01T01:07:02.275 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_sender", 2023-12-01T01:07:02.275 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.275 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.276 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.276 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.276 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.276 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.276 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.276 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "SMTP envelope sender", 2023-12-01T01:07:02.276 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.276 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.276 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.276 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.276 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_ssl": { 2023-12-01T01:07:02.276 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_ssl", 2023-12-01T01:07:02.276 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.276 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.277 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.277 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.277 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.277 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.277 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.277 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Use SSL to connect to SMTP server", 2023-12-01T01:07:02.277 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.277 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.277 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.277 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.277 INFO:teuthology.orchestra.run.smithi026.stdout: "smtp_user": { 2023-12-01T01:07:02.277 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "smtp_user", 2023-12-01T01:07:02.277 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.277 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.277 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.278 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.278 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.278 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.278 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.278 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "User to authenticate as", 2023-12-01T01:07:02.278 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.278 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.278 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.278 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.278 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.278 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.278 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.278 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "balancer", 2023-12-01T01:07:02.278 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.279 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.279 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.279 INFO:teuthology.orchestra.run.smithi026.stdout: "active": { 2023-12-01T01:07:02.279 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "active", 2023-12-01T01:07:02.279 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.279 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.279 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.279 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.279 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.279 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.279 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.279 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "automatically balance PGs across cluster", 2023-12-01T01:07:02.279 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.279 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.280 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.280 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.280 INFO:teuthology.orchestra.run.smithi026.stdout: "begin_time": { 2023-12-01T01:07:02.280 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "begin_time", 2023-12-01T01:07:02.280 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.280 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.280 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.280 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0000", 2023-12-01T01:07:02.280 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.280 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.280 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.280 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "beginning time of day to automatically balance", 2023-12-01T01:07:02.280 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-01T01:07:02.280 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.280 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.281 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.281 INFO:teuthology.orchestra.run.smithi026.stdout: "begin_weekday": { 2023-12-01T01:07:02.281 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "begin_weekday", 2023-12-01T01:07:02.281 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "uint", 2023-12-01T01:07:02.281 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.281 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.281 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0", 2023-12-01T01:07:02.281 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "0", 2023-12-01T01:07:02.281 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "6", 2023-12-01T01:07:02.281 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.281 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-12-01T01:07:02.281 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-01T01:07:02.281 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.281 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.281 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.282 INFO:teuthology.orchestra.run.smithi026.stdout: "crush_compat_max_iterations": { 2023-12-01T01:07:02.282 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "crush_compat_max_iterations", 2023-12-01T01:07:02.282 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "uint", 2023-12-01T01:07:02.282 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.282 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.282 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "25", 2023-12-01T01:07:02.282 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "1", 2023-12-01T01:07:02.282 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "250", 2023-12-01T01:07:02.282 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.282 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-12-01T01:07:02.282 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.282 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.282 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.282 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.283 INFO:teuthology.orchestra.run.smithi026.stdout: "crush_compat_metrics": { 2023-12-01T01:07:02.283 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "crush_compat_metrics", 2023-12-01T01:07:02.283 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.283 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.283 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.283 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "pgs,objects,bytes", 2023-12-01T01:07:02.283 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.283 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.283 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.283 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-12-01T01:07:02.283 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-12-01T01:07:02.283 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.283 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.283 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.283 INFO:teuthology.orchestra.run.smithi026.stdout: "crush_compat_step": { 2023-12-01T01:07:02.284 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "crush_compat_step", 2023-12-01T01:07:02.284 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:02.284 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.284 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.284 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0.5", 2023-12-01T01:07:02.284 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "0.001", 2023-12-01T01:07:02.284 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "0.999", 2023-12-01T01:07:02.284 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.284 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "aggressiveness of optimization", 2023-12-01T01:07:02.284 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-12-01T01:07:02.284 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.284 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.284 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.284 INFO:teuthology.orchestra.run.smithi026.stdout: "end_time": { 2023-12-01T01:07:02.285 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "end_time", 2023-12-01T01:07:02.285 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.285 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.285 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.285 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "2359", 2023-12-01T01:07:02.285 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.285 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.285 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.285 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "ending time of day to automatically balance", 2023-12-01T01:07:02.285 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-12-01T01:07:02.285 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.285 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.285 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.285 INFO:teuthology.orchestra.run.smithi026.stdout: "end_weekday": { 2023-12-01T01:07:02.285 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "end_weekday", 2023-12-01T01:07:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "uint", 2023-12-01T01:07:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0", 2023-12-01T01:07:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "0", 2023-12-01T01:07:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "6", 2023-12-01T01:07:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-12-01T01:07:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-12-01T01:07:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.286 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.287 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.288 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.288 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.288 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.288 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.288 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.288 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.288 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.288 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.288 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.288 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.288 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.288 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.288 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.288 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.289 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.289 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.289 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.289 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.289 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.289 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.289 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.289 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.289 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.289 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.289 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.289 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.289 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.289 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.289 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.289 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.290 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.290 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.290 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.290 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.290 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.290 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.290 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.290 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.290 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.290 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.290 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.290 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.290 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.290 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.291 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.291 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.291 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.291 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.291 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.291 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.291 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.291 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.291 INFO:teuthology.orchestra.run.smithi026.stdout: "min_score": { 2023-12-01T01:07:02.291 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "min_score", 2023-12-01T01:07:02.291 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:02.291 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.291 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.291 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0", 2023-12-01T01:07:02.291 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.292 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.292 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.292 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-12-01T01:07:02.292 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.292 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.292 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.292 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.292 INFO:teuthology.orchestra.run.smithi026.stdout: "mode": { 2023-12-01T01:07:02.292 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mode", 2023-12-01T01:07:02.292 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.292 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.292 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.292 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "upmap", 2023-12-01T01:07:02.292 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.292 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.293 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.293 INFO:teuthology.orchestra.run.smithi026.stdout: "crush-compat", 2023-12-01T01:07:02.293 INFO:teuthology.orchestra.run.smithi026.stdout: "none", 2023-12-01T01:07:02.293 INFO:teuthology.orchestra.run.smithi026.stdout: "upmap" 2023-12-01T01:07:02.293 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.293 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Balancer mode", 2023-12-01T01:07:02.293 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.293 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.293 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.293 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.293 INFO:teuthology.orchestra.run.smithi026.stdout: "pool_ids": { 2023-12-01T01:07:02.293 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "pool_ids", 2023-12-01T01:07:02.293 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.293 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.293 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.294 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.294 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.294 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.294 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.294 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-12-01T01:07:02.294 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.294 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.294 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.294 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.294 INFO:teuthology.orchestra.run.smithi026.stdout: "sleep_interval": { 2023-12-01T01:07:02.294 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "sleep_interval", 2023-12-01T01:07:02.294 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.294 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.294 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.295 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "60", 2023-12-01T01:07:02.295 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.295 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.295 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.295 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-12-01T01:07:02.295 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.295 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.295 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.295 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.295 INFO:teuthology.orchestra.run.smithi026.stdout: "upmap_max_deviation": { 2023-12-01T01:07:02.295 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "upmap_max_deviation", 2023-12-01T01:07:02.295 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.295 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.295 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "5", 2023-12-01T01:07:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "1", 2023-12-01T01:07:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "deviation below which no optimization is attempted", 2023-12-01T01:07:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-12-01T01:07:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: "upmap_max_optimizations": { 2023-12-01T01:07:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "upmap_max_optimizations", 2023-12-01T01:07:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "uint", 2023-12-01T01:07:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.296 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:02.297 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.297 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.297 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.297 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-12-01T01:07:02.297 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.297 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.297 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.297 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.297 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.297 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.297 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.297 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cephadm", 2023-12-01T01:07:02.297 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.297 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.297 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.298 INFO:teuthology.orchestra.run.smithi026.stdout: "agent_down_multiplier": { 2023-12-01T01:07:02.298 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "agent_down_multiplier", 2023-12-01T01:07:02.298 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:02.298 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.298 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.298 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "3.0", 2023-12-01T01:07:02.298 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.298 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.298 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.298 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-12-01T01:07:02.298 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.298 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.298 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.298 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.299 INFO:teuthology.orchestra.run.smithi026.stdout: "agent_refresh_rate": { 2023-12-01T01:07:02.299 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "agent_refresh_rate", 2023-12-01T01:07:02.299 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.299 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.299 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.299 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "20", 2023-12-01T01:07:02.299 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.299 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.299 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.299 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-12-01T01:07:02.299 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.299 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.299 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.299 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.299 INFO:teuthology.orchestra.run.smithi026.stdout: "agent_starting_port": { 2023-12-01T01:07:02.300 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "agent_starting_port", 2023-12-01T01:07:02.300 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.300 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.300 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.300 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "4721", 2023-12-01T01:07:02.300 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.300 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.300 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.300 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-12-01T01:07:02.300 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.300 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.300 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.300 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.300 INFO:teuthology.orchestra.run.smithi026.stdout: "allow_ptrace": { 2023-12-01T01:07:02.301 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "allow_ptrace", 2023-12-01T01:07:02.301 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.301 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.301 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.301 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.301 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.301 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.301 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.301 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-12-01T01:07:02.301 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-12-01T01:07:02.301 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.301 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.301 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.301 INFO:teuthology.orchestra.run.smithi026.stdout: "autotune_interval": { 2023-12-01T01:07:02.302 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "autotune_interval", 2023-12-01T01:07:02.302 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.302 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.302 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.302 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "600", 2023-12-01T01:07:02.302 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.302 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.302 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.302 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how frequently to autotune daemon memory", 2023-12-01T01:07:02.302 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.302 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.302 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.302 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.302 INFO:teuthology.orchestra.run.smithi026.stdout: "autotune_memory_target_ratio": { 2023-12-01T01:07:02.302 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "autotune_memory_target_ratio", 2023-12-01T01:07:02.303 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:02.303 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.303 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.303 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0.7", 2023-12-01T01:07:02.303 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.303 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.303 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.303 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-12-01T01:07:02.303 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.303 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.303 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.303 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.303 INFO:teuthology.orchestra.run.smithi026.stdout: "cgroups_split": { 2023-12-01T01:07:02.303 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cgroups_split", 2023-12-01T01:07:02.303 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.304 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.304 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.304 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.304 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.304 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.304 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.304 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-12-01T01:07:02.304 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.304 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.304 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.304 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.304 INFO:teuthology.orchestra.run.smithi026.stdout: "config_checks_enabled": { 2023-12-01T01:07:02.304 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "config_checks_enabled", 2023-12-01T01:07:02.304 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.304 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-12-01T01:07:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: "config_dashboard": { 2023-12-01T01:07:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "config_dashboard", 2023-12-01T01:07:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.305 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-12-01T01:07:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_alertmanager": { 2023-12-01T01:07:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_alertmanager", 2023-12-01T01:07:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-12-01T01:07:02.306 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.307 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.307 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.307 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Prometheus container image", 2023-12-01T01:07:02.307 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.307 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.307 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.307 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.307 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_base": { 2023-12-01T01:07:02.307 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_base", 2023-12-01T01:07:02.307 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.307 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.307 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.307 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/ceph/ceph", 2023-12-01T01:07:02.307 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.308 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.308 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.308 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Container image name, without the tag", 2023-12-01T01:07:02.308 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.308 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.308 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.308 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.308 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_elasticsearch": { 2023-12-01T01:07:02.308 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_elasticsearch", 2023-12-01T01:07:02.308 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.308 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.308 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.308 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-12-01T01:07:02.308 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.309 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.309 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.309 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "elasticsearch container image", 2023-12-01T01:07:02.309 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.309 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.309 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.309 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.309 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_grafana": { 2023-12-01T01:07:02.309 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_grafana", 2023-12-01T01:07:02.309 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.309 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.309 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.309 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-12-01T01:07:02.309 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.310 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.310 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.310 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Prometheus container image", 2023-12-01T01:07:02.310 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.310 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.310 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.310 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.310 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_haproxy": { 2023-12-01T01:07:02.310 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_haproxy", 2023-12-01T01:07:02.310 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.310 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.310 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.310 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-12-01T01:07:02.310 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.310 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.311 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.311 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "HAproxy container image", 2023-12-01T01:07:02.311 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.311 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.311 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.311 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.311 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_jaeger_agent": { 2023-12-01T01:07:02.311 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_jaeger_agent", 2023-12-01T01:07:02.311 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.311 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.311 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.311 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-12-01T01:07:02.311 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.311 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.312 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.312 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Jaeger agent container image", 2023-12-01T01:07:02.312 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.312 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.312 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.312 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.312 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_jaeger_collector": { 2023-12-01T01:07:02.312 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_jaeger_collector", 2023-12-01T01:07:02.312 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.312 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.312 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.312 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-12-01T01:07:02.312 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.312 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.312 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.312 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Jaeger collector container image", 2023-12-01T01:07:02.313 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.313 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.313 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.313 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.313 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_jaeger_query": { 2023-12-01T01:07:02.313 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_jaeger_query", 2023-12-01T01:07:02.313 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.313 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.313 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.313 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-12-01T01:07:02.313 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.313 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.313 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.313 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Jaeger query container image", 2023-12-01T01:07:02.313 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.314 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.314 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.314 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.314 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_keepalived": { 2023-12-01T01:07:02.314 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_keepalived", 2023-12-01T01:07:02.314 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.314 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.314 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.314 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-12-01T01:07:02.314 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.314 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.314 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.314 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Keepalived container image", 2023-12-01T01:07:02.314 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.315 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.315 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.315 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.315 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_loki": { 2023-12-01T01:07:02.315 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_loki", 2023-12-01T01:07:02.315 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.315 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.315 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.315 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-12-01T01:07:02.315 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.315 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.315 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.315 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Loki container image", 2023-12-01T01:07:02.315 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.315 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.316 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.316 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.316 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_node_exporter": { 2023-12-01T01:07:02.316 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_node_exporter", 2023-12-01T01:07:02.316 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.316 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.316 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.316 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-12-01T01:07:02.316 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.316 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.316 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.316 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Prometheus container image", 2023-12-01T01:07:02.316 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.316 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.316 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.317 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.317 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_nvmeof": { 2023-12-01T01:07:02.317 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_nvmeof", 2023-12-01T01:07:02.317 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.317 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.317 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.317 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.2", 2023-12-01T01:07:02.317 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.317 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.317 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.317 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Nvme-of container image", 2023-12-01T01:07:02.317 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.317 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.317 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.317 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.317 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_prometheus": { 2023-12-01T01:07:02.318 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_prometheus", 2023-12-01T01:07:02.318 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.318 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.318 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.318 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-12-01T01:07:02.318 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.318 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.318 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.318 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Prometheus container image", 2023-12-01T01:07:02.318 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.318 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.318 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.318 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.318 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_promtail": { 2023-12-01T01:07:02.318 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_promtail", 2023-12-01T01:07:02.319 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.319 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.319 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.319 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-12-01T01:07:02.319 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.319 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.319 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.319 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Promtail container image", 2023-12-01T01:07:02.319 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.319 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.319 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.319 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.319 INFO:teuthology.orchestra.run.smithi026.stdout: "container_image_snmp_gateway": { 2023-12-01T01:07:02.319 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_image_snmp_gateway", 2023-12-01T01:07:02.319 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.320 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.320 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.320 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-12-01T01:07:02.320 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.320 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.320 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.320 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "SNMP Gateway container image", 2023-12-01T01:07:02.320 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.320 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.320 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.320 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.320 INFO:teuthology.orchestra.run.smithi026.stdout: "container_init": { 2023-12-01T01:07:02.320 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "container_init", 2023-12-01T01:07:02.320 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.320 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Run podman/docker with `--init`", 2023-12-01T01:07:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: "daemon_cache_timeout": { 2023-12-01T01:07:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "daemon_cache_timeout", 2023-12-01T01:07:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.321 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.322 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "600", 2023-12-01T01:07:02.322 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.322 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.322 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.322 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-12-01T01:07:02.322 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.322 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.322 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.322 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.322 INFO:teuthology.orchestra.run.smithi026.stdout: "default_cephadm_command_timeout": { 2023-12-01T01:07:02.322 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "default_cephadm_command_timeout", 2023-12-01T01:07:02.322 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.322 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.322 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.322 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "900", 2023-12-01T01:07:02.323 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.323 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.323 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.323 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-12-01T01:07:02.323 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.323 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.323 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.323 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.323 INFO:teuthology.orchestra.run.smithi026.stdout: "default_registry": { 2023-12-01T01:07:02.323 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "default_registry", 2023-12-01T01:07:02.323 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.323 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.323 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.323 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "docker.io", 2023-12-01T01:07:02.323 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.324 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.324 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.324 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-12-01T01:07:02.324 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.324 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.324 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.324 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.324 INFO:teuthology.orchestra.run.smithi026.stdout: "device_cache_timeout": { 2023-12-01T01:07:02.324 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "device_cache_timeout", 2023-12-01T01:07:02.324 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.324 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.324 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.324 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "1800", 2023-12-01T01:07:02.324 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.324 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.325 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.325 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "seconds to cache device inventory", 2023-12-01T01:07:02.325 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.325 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.325 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.325 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.325 INFO:teuthology.orchestra.run.smithi026.stdout: "device_enhanced_scan": { 2023-12-01T01:07:02.325 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "device_enhanced_scan", 2023-12-01T01:07:02.325 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.325 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.325 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.325 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.325 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.325 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.325 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.326 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Use libstoragemgmt during device scans", 2023-12-01T01:07:02.326 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.326 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.326 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.326 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.326 INFO:teuthology.orchestra.run.smithi026.stdout: "facts_cache_timeout": { 2023-12-01T01:07:02.326 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "facts_cache_timeout", 2023-12-01T01:07:02.326 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.326 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.326 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.326 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "60", 2023-12-01T01:07:02.326 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.326 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.326 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.326 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "seconds to cache host facts data", 2023-12-01T01:07:02.327 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.327 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.327 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.327 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.327 INFO:teuthology.orchestra.run.smithi026.stdout: "host_check_interval": { 2023-12-01T01:07:02.327 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "host_check_interval", 2023-12-01T01:07:02.327 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.327 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.327 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.327 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "600", 2023-12-01T01:07:02.327 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.327 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.327 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.327 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how frequently to perform a host check", 2023-12-01T01:07:02.327 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.328 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.328 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.328 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.328 INFO:teuthology.orchestra.run.smithi026.stdout: "inventory_list_all": { 2023-12-01T01:07:02.328 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "inventory_list_all", 2023-12-01T01:07:02.328 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.328 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.328 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.328 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.328 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.328 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.328 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.328 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-12-01T01:07:02.328 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.329 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.329 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.329 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.329 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.329 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.329 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.329 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.329 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.329 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.329 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.329 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.329 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.329 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.329 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.330 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.330 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.330 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.330 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.330 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.330 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.330 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.330 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.330 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.330 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.330 INFO:teuthology.orchestra.run.smithi026.stdout: "log_refresh_metadata": { 2023-12-01T01:07:02.330 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_refresh_metadata", 2023-12-01T01:07:02.330 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.331 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.331 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.331 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.331 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.331 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.331 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.331 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-12-01T01:07:02.331 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.331 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.331 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.331 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.331 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.331 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.331 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.331 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.332 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.332 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.332 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.332 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.332 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.332 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-12-01T01:07:02.332 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.332 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.332 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.332 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.332 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.332 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.333 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.333 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.333 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.333 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.333 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.333 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.333 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.333 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.333 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.333 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.333 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.333 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.333 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.333 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.333 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.334 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.334 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.334 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.334 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.334 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.334 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.334 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.334 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.334 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.334 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.334 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.334 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.334 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.334 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.334 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.335 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.335 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.335 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.335 INFO:teuthology.orchestra.run.smithi026.stdout: "manage_etc_ceph_ceph_conf": { 2023-12-01T01:07:02.335 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-12-01T01:07:02.335 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.335 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.335 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.335 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.335 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.335 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.335 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.335 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-12-01T01:07:02.335 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.336 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.336 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.336 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.336 INFO:teuthology.orchestra.run.smithi026.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-12-01T01:07:02.336 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-12-01T01:07:02.336 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.336 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.336 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.336 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "*", 2023-12-01T01:07:02.336 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.336 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.336 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.336 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-12-01T01:07:02.336 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.337 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.337 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.337 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.337 INFO:teuthology.orchestra.run.smithi026.stdout: "max_count_per_host": { 2023-12-01T01:07:02.337 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "max_count_per_host", 2023-12-01T01:07:02.337 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.337 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.337 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.337 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:02.337 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.337 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.337 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.337 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "max number of daemons per service per host", 2023-12-01T01:07:02.337 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.337 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.338 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.338 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.338 INFO:teuthology.orchestra.run.smithi026.stdout: "max_osd_draining_count": { 2023-12-01T01:07:02.338 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "max_osd_draining_count", 2023-12-01T01:07:02.338 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.338 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.338 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.338 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:02.338 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.338 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.338 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.338 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-12-01T01:07:02.338 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.338 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.339 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.339 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.339 INFO:teuthology.orchestra.run.smithi026.stdout: "migration_current": { 2023-12-01T01:07:02.339 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "migration_current", 2023-12-01T01:07:02.339 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.339 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.339 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.339 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.339 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.339 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.339 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.339 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "internal - do not modify", 2023-12-01T01:07:02.339 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.339 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.339 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.340 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.340 INFO:teuthology.orchestra.run.smithi026.stdout: "mode": { 2023-12-01T01:07:02.340 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mode", 2023-12-01T01:07:02.340 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.340 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.340 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.340 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "root", 2023-12-01T01:07:02.340 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.340 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.340 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.340 INFO:teuthology.orchestra.run.smithi026.stdout: "cephadm-package", 2023-12-01T01:07:02.340 INFO:teuthology.orchestra.run.smithi026.stdout: "root" 2023-12-01T01:07:02.340 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.340 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "mode for remote execution of cephadm", 2023-12-01T01:07:02.340 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.341 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.341 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.341 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.341 INFO:teuthology.orchestra.run.smithi026.stdout: "prometheus_alerts_path": { 2023-12-01T01:07:02.341 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "prometheus_alerts_path", 2023-12-01T01:07:02.341 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.341 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.341 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.341 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-12-01T01:07:02.341 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.341 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.341 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.341 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-12-01T01:07:02.341 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.342 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.342 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.342 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.342 INFO:teuthology.orchestra.run.smithi026.stdout: "registry_insecure": { 2023-12-01T01:07:02.342 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "registry_insecure", 2023-12-01T01:07:02.342 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.342 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.342 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.342 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.342 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.342 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.342 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.342 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-12-01T01:07:02.342 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.342 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.343 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.343 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.343 INFO:teuthology.orchestra.run.smithi026.stdout: "registry_password": { 2023-12-01T01:07:02.343 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "registry_password", 2023-12-01T01:07:02.343 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.343 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.343 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.343 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.343 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.343 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.343 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.343 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-12-01T01:07:02.345 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.345 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.345 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.345 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.345 INFO:teuthology.orchestra.run.smithi026.stdout: "registry_url": { 2023-12-01T01:07:02.345 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "registry_url", 2023-12-01T01:07:02.345 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.345 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.345 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.345 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.346 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.346 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.346 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.346 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-12-01T01:07:02.346 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.346 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.346 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.346 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.346 INFO:teuthology.orchestra.run.smithi026.stdout: "registry_username": { 2023-12-01T01:07:02.346 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "registry_username", 2023-12-01T01:07:02.346 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.346 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.346 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.346 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.346 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.347 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.347 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.347 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-12-01T01:07:02.347 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.347 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.347 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.347 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.347 INFO:teuthology.orchestra.run.smithi026.stdout: "secure_monitoring_stack": { 2023-12-01T01:07:02.347 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "secure_monitoring_stack", 2023-12-01T01:07:02.347 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.347 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.347 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.347 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.347 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.347 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.348 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.348 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-12-01T01:07:02.348 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.348 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.348 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.348 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.348 INFO:teuthology.orchestra.run.smithi026.stdout: "service_discovery_port": { 2023-12-01T01:07:02.348 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "service_discovery_port", 2023-12-01T01:07:02.348 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.348 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.348 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.348 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "8765", 2023-12-01T01:07:02.348 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.348 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.348 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.349 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "cephadm service discovery port", 2023-12-01T01:07:02.349 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.349 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.349 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.349 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.349 INFO:teuthology.orchestra.run.smithi026.stdout: "ssh_config_file": { 2023-12-01T01:07:02.349 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ssh_config_file", 2023-12-01T01:07:02.349 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.349 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.349 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.349 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.349 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.349 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.349 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.349 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-12-01T01:07:02.350 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.350 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.350 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.350 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.350 INFO:teuthology.orchestra.run.smithi026.stdout: "use_agent": { 2023-12-01T01:07:02.350 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "use_agent", 2023-12-01T01:07:02.350 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.350 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.350 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.350 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.350 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.350 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.350 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.350 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-12-01T01:07:02.351 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.351 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.351 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.351 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.351 INFO:teuthology.orchestra.run.smithi026.stdout: "use_repo_digest": { 2023-12-01T01:07:02.351 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "use_repo_digest", 2023-12-01T01:07:02.351 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.351 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.351 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.351 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.351 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.351 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.351 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.351 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-12-01T01:07:02.352 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.352 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.352 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.352 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.352 INFO:teuthology.orchestra.run.smithi026.stdout: "warn_on_failed_host_check": { 2023-12-01T01:07:02.352 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "warn_on_failed_host_check", 2023-12-01T01:07:02.352 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.352 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.352 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.352 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.352 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.352 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.352 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.352 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "raise a health warning if the host check fails", 2023-12-01T01:07:02.352 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.352 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: "warn_on_stray_daemons": { 2023-12-01T01:07:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "warn_on_stray_daemons", 2023-12-01T01:07:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-12-01T01:07:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.353 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: "warn_on_stray_hosts": { 2023-12-01T01:07:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "warn_on_stray_hosts", 2023-12-01T01:07:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-12-01T01:07:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.354 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.355 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.355 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.355 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.355 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.355 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "crash", 2023-12-01T01:07:02.355 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.355 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.355 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.355 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.355 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.355 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.355 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.355 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.355 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.356 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.356 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.356 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.356 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.356 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.356 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.356 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.356 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.356 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.356 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.356 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.356 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.356 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.356 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.356 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.357 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.358 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.358 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.358 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.358 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.358 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.358 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.358 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.358 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.358 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.358 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.358 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.358 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.358 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.358 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.359 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.359 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.359 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.359 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.359 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.359 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.359 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.359 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.359 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.359 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.359 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.359 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.359 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.359 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.359 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.360 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.360 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.360 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.360 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.360 INFO:teuthology.orchestra.run.smithi026.stdout: "retain_interval": { 2023-12-01T01:07:02.360 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "retain_interval", 2023-12-01T01:07:02.360 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.360 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.360 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.360 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "31536000", 2023-12-01T01:07:02.360 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.360 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.360 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.360 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how long to retain crashes before pruning them", 2023-12-01T01:07:02.360 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.360 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.361 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.361 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.361 INFO:teuthology.orchestra.run.smithi026.stdout: "warn_recent_interval": { 2023-12-01T01:07:02.361 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "warn_recent_interval", 2023-12-01T01:07:02.361 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.361 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.361 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.361 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "1209600", 2023-12-01T01:07:02.361 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.361 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.361 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.361 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "time interval in which to warn about recent crashes", 2023-12-01T01:07:02.361 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.361 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.361 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.362 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.362 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.362 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.362 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.362 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "dashboard", 2023-12-01T01:07:02.362 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.362 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.362 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.362 INFO:teuthology.orchestra.run.smithi026.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-12-01T01:07:02.362 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-12-01T01:07:02.362 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.362 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.362 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.362 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:02.362 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.362 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.363 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.363 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.363 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.363 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.363 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.363 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.363 INFO:teuthology.orchestra.run.smithi026.stdout: "ALERTMANAGER_API_HOST": { 2023-12-01T01:07:02.363 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ALERTMANAGER_API_HOST", 2023-12-01T01:07:02.363 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.363 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.363 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.363 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.363 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.363 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.363 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.364 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.364 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.364 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.364 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.364 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.364 INFO:teuthology.orchestra.run.smithi026.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-12-01T01:07:02.364 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-12-01T01:07:02.364 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.364 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.364 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.364 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.364 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.364 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.364 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.364 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.364 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.365 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.365 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.365 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.365 INFO:teuthology.orchestra.run.smithi026.stdout: "AUDIT_API_ENABLED": { 2023-12-01T01:07:02.365 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "AUDIT_API_ENABLED", 2023-12-01T01:07:02.365 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.365 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.365 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.365 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.365 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.365 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.365 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.365 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.365 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.365 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.366 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.366 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.366 INFO:teuthology.orchestra.run.smithi026.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-12-01T01:07:02.366 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-12-01T01:07:02.366 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.366 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.366 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.366 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.366 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.366 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.366 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.366 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.366 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.366 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.367 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.367 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.367 INFO:teuthology.orchestra.run.smithi026.stdout: "ENABLE_BROWSABLE_API": { 2023-12-01T01:07:02.367 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ENABLE_BROWSABLE_API", 2023-12-01T01:07:02.367 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.367 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.367 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.367 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.367 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.367 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.367 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.367 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.367 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.367 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.367 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.368 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.368 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-12-01T01:07:02.368 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-12-01T01:07:02.368 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.368 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.368 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.368 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.368 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.368 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.368 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.368 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.368 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.368 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.368 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.368 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.369 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-12-01T01:07:02.369 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-12-01T01:07:02.369 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.369 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.369 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.369 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.369 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.369 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.369 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.369 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.369 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.369 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.369 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.369 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.369 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-12-01T01:07:02.370 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-12-01T01:07:02.370 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.370 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.370 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.370 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.370 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.370 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.370 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.370 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.370 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.370 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.370 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.370 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.370 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-12-01T01:07:02.371 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-12-01T01:07:02.371 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.371 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.371 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.371 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.371 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.371 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.371 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.371 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.371 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.371 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.371 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.371 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.371 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_NFS": { 2023-12-01T01:07:02.371 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-12-01T01:07:02.372 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.372 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.372 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.372 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.372 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.372 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.372 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.372 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.372 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.372 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.372 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.372 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.372 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_RBD": { 2023-12-01T01:07:02.372 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-12-01T01:07:02.372 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.372 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.373 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.373 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.373 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.373 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.373 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.373 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.373 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.373 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.373 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.373 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.373 INFO:teuthology.orchestra.run.smithi026.stdout: "FEATURE_TOGGLE_RGW": { 2023-12-01T01:07:02.373 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-12-01T01:07:02.373 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.373 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.373 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.374 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.374 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.374 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.374 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.374 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.374 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.374 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.374 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.374 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.374 INFO:teuthology.orchestra.run.smithi026.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-12-01T01:07:02.374 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-12-01T01:07:02.374 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.374 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.374 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.374 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.375 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.375 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.375 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.375 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.375 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.375 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.375 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.375 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.375 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_API_PASSWORD": { 2023-12-01T01:07:02.375 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_API_PASSWORD", 2023-12-01T01:07:02.375 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.375 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.375 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.375 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "admin", 2023-12-01T01:07:02.375 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.376 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.376 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.376 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.376 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.376 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.376 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.376 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.376 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-12-01T01:07:02.376 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-12-01T01:07:02.376 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.376 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.376 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.376 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.376 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.377 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.377 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.377 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.377 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.377 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.377 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.377 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.377 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_API_URL": { 2023-12-01T01:07:02.377 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_API_URL", 2023-12-01T01:07:02.377 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.377 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.377 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.377 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.377 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.377 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.377 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.378 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.378 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.378 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.378 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.378 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.378 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_API_USERNAME": { 2023-12-01T01:07:02.378 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_API_USERNAME", 2023-12-01T01:07:02.378 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.378 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.378 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.378 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "admin", 2023-12-01T01:07:02.378 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.378 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.378 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.379 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.379 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.379 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.379 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.379 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.379 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-12-01T01:07:02.379 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-12-01T01:07:02.379 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.379 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.379 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.379 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.379 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.379 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.379 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.379 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.380 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.380 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.380 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.380 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.380 INFO:teuthology.orchestra.run.smithi026.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-12-01T01:07:02.380 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-12-01T01:07:02.380 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.380 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.380 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.380 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.380 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.380 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.380 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.380 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.380 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.381 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.381 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.381 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.381 INFO:teuthology.orchestra.run.smithi026.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-12-01T01:07:02.381 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-12-01T01:07:02.381 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.381 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.381 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.381 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.381 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.381 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.381 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.381 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.381 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.382 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.382 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.382 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.382 INFO:teuthology.orchestra.run.smithi026.stdout: "ISSUE_TRACKER_API_KEY": { 2023-12-01T01:07:02.382 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-12-01T01:07:02.382 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.382 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.382 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.382 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.382 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.382 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.382 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.382 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.382 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.382 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.383 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.383 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.383 INFO:teuthology.orchestra.run.smithi026.stdout: "PROMETHEUS_API_HOST": { 2023-12-01T01:07:02.383 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PROMETHEUS_API_HOST", 2023-12-01T01:07:02.383 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.383 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.383 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.383 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.383 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.383 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.383 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.383 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.383 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.383 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.384 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.384 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.384 INFO:teuthology.orchestra.run.smithi026.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-12-01T01:07:02.384 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-12-01T01:07:02.384 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.384 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.384 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.384 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.384 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.384 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.384 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.384 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.384 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.384 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.384 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.385 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.385 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-12-01T01:07:02.385 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-12-01T01:07:02.385 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.385 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.385 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.385 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.385 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.385 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.385 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.385 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.385 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.385 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.385 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.385 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.385 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-12-01T01:07:02.386 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-12-01T01:07:02.386 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.386 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.386 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.386 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.386 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.386 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.386 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.386 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.386 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.386 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.386 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.386 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.386 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-12-01T01:07:02.387 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-12-01T01:07:02.387 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.387 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.387 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.387 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.387 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.387 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.387 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.387 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.387 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.387 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.387 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.387 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.387 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-12-01T01:07:02.387 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-12-01T01:07:02.387 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.388 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.388 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.388 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.388 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.388 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.388 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.388 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.388 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.388 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.388 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.388 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.388 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-12-01T01:07:02.388 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-12-01T01:07:02.388 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.388 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.389 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.389 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.389 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.389 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.389 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.389 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.389 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.389 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.389 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.389 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.389 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-12-01T01:07:02.389 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-12-01T01:07:02.389 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.389 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.389 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.390 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.390 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.390 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.390 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.390 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.390 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.390 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.390 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.390 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.390 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-12-01T01:07:02.390 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-12-01T01:07:02.390 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.390 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.390 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.390 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.391 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.391 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.391 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.391 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.391 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.391 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.391 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.391 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.391 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_ENABLED": { 2023-12-01T01:07:02.391 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_ENABLED", 2023-12-01T01:07:02.391 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.391 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.391 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.391 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.391 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.391 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.392 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.392 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.392 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.392 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.392 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.392 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.392 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-12-01T01:07:02.392 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-12-01T01:07:02.392 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.392 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.392 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.392 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-12-01T01:07:02.392 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.392 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.392 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.393 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.393 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.393 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.393 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.393 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.393 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-12-01T01:07:02.393 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-12-01T01:07:02.393 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.393 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.393 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.393 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:02.393 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.393 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.393 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.393 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.394 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.394 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.394 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.394 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.394 INFO:teuthology.orchestra.run.smithi026.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-12-01T01:07:02.394 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-12-01T01:07:02.394 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.394 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.394 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.394 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "8", 2023-12-01T01:07:02.394 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.394 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.394 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.394 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.394 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.395 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.395 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.395 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.395 INFO:teuthology.orchestra.run.smithi026.stdout: "REST_REQUESTS_TIMEOUT": { 2023-12-01T01:07:02.395 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-12-01T01:07:02.395 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.395 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.395 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.395 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "45", 2023-12-01T01:07:02.395 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.395 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.395 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.395 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.395 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.396 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.396 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.396 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.396 INFO:teuthology.orchestra.run.smithi026.stdout: "RGW_API_ACCESS_KEY": { 2023-12-01T01:07:02.396 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RGW_API_ACCESS_KEY", 2023-12-01T01:07:02.396 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.396 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.396 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.396 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.396 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.396 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.396 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.396 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.396 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.397 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.397 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.397 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.397 INFO:teuthology.orchestra.run.smithi026.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-12-01T01:07:02.397 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-12-01T01:07:02.397 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.397 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.397 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.397 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "admin", 2023-12-01T01:07:02.397 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.397 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.397 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.397 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.397 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.398 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.398 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.398 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.398 INFO:teuthology.orchestra.run.smithi026.stdout: "RGW_API_SECRET_KEY": { 2023-12-01T01:07:02.398 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RGW_API_SECRET_KEY", 2023-12-01T01:07:02.398 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.398 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.398 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.398 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.398 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.398 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.398 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.398 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.399 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.399 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.399 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.399 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.399 INFO:teuthology.orchestra.run.smithi026.stdout: "RGW_API_SSL_VERIFY": { 2023-12-01T01:07:02.399 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RGW_API_SSL_VERIFY", 2023-12-01T01:07:02.399 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.399 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.399 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.399 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.399 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.399 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.399 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.399 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.400 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.400 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.400 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.400 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.400 INFO:teuthology.orchestra.run.smithi026.stdout: "UNSAFE_TLS_v1_2": { 2023-12-01T01:07:02.400 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "UNSAFE_TLS_v1_2", 2023-12-01T01:07:02.400 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.400 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.400 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.400 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.400 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.400 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.400 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.400 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.400 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.401 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.401 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.401 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.401 INFO:teuthology.orchestra.run.smithi026.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-12-01T01:07:02.401 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-12-01T01:07:02.401 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.401 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.401 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.401 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0", 2023-12-01T01:07:02.401 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.401 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.401 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.401 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.401 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.401 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.401 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.402 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.402 INFO:teuthology.orchestra.run.smithi026.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-12-01T01:07:02.402 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-12-01T01:07:02.402 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.402 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.402 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.402 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:02.402 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.402 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.402 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.402 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.402 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.402 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.403 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.403 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.403 INFO:teuthology.orchestra.run.smithi026.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-12-01T01:07:02.403 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-12-01T01:07:02.403 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.403 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.403 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.403 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "5", 2023-12-01T01:07:02.403 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.403 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.403 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.404 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.404 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.404 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.404 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.404 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.404 INFO:teuthology.orchestra.run.smithi026.stdout: "cross_origin_url": { 2023-12-01T01:07:02.404 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cross_origin_url", 2023-12-01T01:07:02.404 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.404 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.404 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.404 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.404 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.405 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.405 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.405 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.405 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.405 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.405 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.405 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.405 INFO:teuthology.orchestra.run.smithi026.stdout: "crt_file": { 2023-12-01T01:07:02.405 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "crt_file", 2023-12-01T01:07:02.405 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.405 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.405 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.405 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.405 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.405 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.406 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.406 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.406 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.406 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.406 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.406 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.406 INFO:teuthology.orchestra.run.smithi026.stdout: "debug": { 2023-12-01T01:07:02.406 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "debug", 2023-12-01T01:07:02.406 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.406 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.406 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.406 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.406 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.406 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.406 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.407 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Enable/disable debug options", 2023-12-01T01:07:02.407 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.407 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.407 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.407 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.407 INFO:teuthology.orchestra.run.smithi026.stdout: "jwt_token_ttl": { 2023-12-01T01:07:02.407 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "jwt_token_ttl", 2023-12-01T01:07:02.407 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.407 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.407 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.407 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "28800", 2023-12-01T01:07:02.407 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.407 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.407 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.408 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.408 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.408 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.408 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.408 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.408 INFO:teuthology.orchestra.run.smithi026.stdout: "key_file": { 2023-12-01T01:07:02.408 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "key_file", 2023-12-01T01:07:02.408 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.408 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.408 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.408 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.408 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.408 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.408 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.408 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.409 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.409 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.409 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.409 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.409 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.409 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.409 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.409 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.409 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.409 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.409 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.409 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.409 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.409 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.409 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.410 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.410 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.410 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.410 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.410 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.410 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.410 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.410 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.410 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.410 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.410 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.410 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.410 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.410 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.410 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.411 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.411 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.411 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.411 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.411 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.411 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.411 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.411 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.411 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.411 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.411 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.411 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.411 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.411 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.411 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.411 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.412 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.412 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.412 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.412 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.412 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.412 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.412 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.412 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.412 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.412 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.412 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.412 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.412 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.412 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.413 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.413 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.413 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.413 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.413 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.413 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.413 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.413 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.413 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.413 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.413 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.413 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.413 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.413 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.413 INFO:teuthology.orchestra.run.smithi026.stdout: "motd": { 2023-12-01T01:07:02.413 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "motd", 2023-12-01T01:07:02.414 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.414 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.414 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.414 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.414 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.414 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.414 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.414 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "The message of the day", 2023-12-01T01:07:02.414 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.414 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.414 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.414 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.414 INFO:teuthology.orchestra.run.smithi026.stdout: "redirect_resolve_ip_addr": { 2023-12-01T01:07:02.414 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "redirect_resolve_ip_addr", 2023-12-01T01:07:02.414 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.415 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.415 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.415 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.415 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.415 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.415 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.415 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.415 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.415 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.415 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.415 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.415 INFO:teuthology.orchestra.run.smithi026.stdout: "server_addr": { 2023-12-01T01:07:02.415 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_addr", 2023-12-01T01:07:02.415 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.415 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.416 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.416 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "::", 2023-12-01T01:07:02.416 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.416 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.416 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.416 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.416 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.416 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.416 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.416 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.416 INFO:teuthology.orchestra.run.smithi026.stdout: "server_port": { 2023-12-01T01:07:02.416 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_port", 2023-12-01T01:07:02.416 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.416 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.416 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.417 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "8080", 2023-12-01T01:07:02.417 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.417 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.417 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.417 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.417 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.417 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.417 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.417 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.417 INFO:teuthology.orchestra.run.smithi026.stdout: "ssl": { 2023-12-01T01:07:02.417 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ssl", 2023-12-01T01:07:02.417 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.417 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.417 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.417 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.418 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.418 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.418 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.418 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.418 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.418 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.418 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.418 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.418 INFO:teuthology.orchestra.run.smithi026.stdout: "ssl_server_port": { 2023-12-01T01:07:02.418 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ssl_server_port", 2023-12-01T01:07:02.418 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.418 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.418 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.418 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "8443", 2023-12-01T01:07:02.418 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.419 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.419 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.419 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.419 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.419 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.419 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.419 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.419 INFO:teuthology.orchestra.run.smithi026.stdout: "standby_behaviour": { 2023-12-01T01:07:02.419 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "standby_behaviour", 2023-12-01T01:07:02.419 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.419 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.419 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.419 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "redirect", 2023-12-01T01:07:02.419 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.419 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: "redirect" 2023-12-01T01:07:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: "standby_error_status_code": { 2023-12-01T01:07:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "standby_error_status_code", 2023-12-01T01:07:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "500", 2023-12-01T01:07:02.420 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "400", 2023-12-01T01:07:02.421 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "599", 2023-12-01T01:07:02.421 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.421 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.421 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.421 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.421 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.421 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.421 INFO:teuthology.orchestra.run.smithi026.stdout: "url_prefix": { 2023-12-01T01:07:02.421 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "url_prefix", 2023-12-01T01:07:02.421 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.421 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.421 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.421 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.421 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.421 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.422 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.422 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.422 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.422 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.422 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.422 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.422 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.422 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.422 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.422 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "devicehealth", 2023-12-01T01:07:02.422 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.422 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.422 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.422 INFO:teuthology.orchestra.run.smithi026.stdout: "enable_monitoring": { 2023-12-01T01:07:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "enable_monitoring", 2023-12-01T01:07:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "monitor device health metrics", 2023-12-01T01:07:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.423 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.424 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.425 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.426 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.426 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.426 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.426 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.426 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.426 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.426 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.426 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.426 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.426 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.426 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.426 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.426 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.426 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.426 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.427 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.428 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.428 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.428 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.428 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.428 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.428 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.428 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.428 INFO:teuthology.orchestra.run.smithi026.stdout: "mark_out_threshold": { 2023-12-01T01:07:02.428 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mark_out_threshold", 2023-12-01T01:07:02.428 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.428 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.428 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.428 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "2419200", 2023-12-01T01:07:02.428 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.429 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.429 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.429 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-12-01T01:07:02.429 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.429 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.429 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.429 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.429 INFO:teuthology.orchestra.run.smithi026.stdout: "pool_name": { 2023-12-01T01:07:02.429 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "pool_name", 2023-12-01T01:07:02.429 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.429 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.429 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.429 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "device_health_metrics", 2023-12-01T01:07:02.429 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.429 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.429 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.430 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "name of pool in which to store device health metrics", 2023-12-01T01:07:02.430 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.430 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.430 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.430 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.430 INFO:teuthology.orchestra.run.smithi026.stdout: "retention_period": { 2023-12-01T01:07:02.430 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "retention_period", 2023-12-01T01:07:02.430 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.430 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.430 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.430 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "15552000", 2023-12-01T01:07:02.430 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.430 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.431 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.431 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how long to retain device health metrics", 2023-12-01T01:07:02.431 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.431 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.431 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.431 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.431 INFO:teuthology.orchestra.run.smithi026.stdout: "scrape_frequency": { 2023-12-01T01:07:02.431 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "scrape_frequency", 2023-12-01T01:07:02.431 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.431 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.431 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.431 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "86400", 2023-12-01T01:07:02.431 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.431 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.431 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.432 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how frequently to scrape device health metrics", 2023-12-01T01:07:02.432 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.432 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.432 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.432 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.432 INFO:teuthology.orchestra.run.smithi026.stdout: "self_heal": { 2023-12-01T01:07:02.432 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "self_heal", 2023-12-01T01:07:02.432 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.432 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.432 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.432 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.432 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.432 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.432 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.432 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-12-01T01:07:02.433 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.433 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.433 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.433 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.433 INFO:teuthology.orchestra.run.smithi026.stdout: "sleep_interval": { 2023-12-01T01:07:02.433 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "sleep_interval", 2023-12-01T01:07:02.433 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.433 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.433 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.433 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "600", 2023-12-01T01:07:02.433 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.433 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.433 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.433 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how frequently to wake up and check device health", 2023-12-01T01:07:02.433 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.434 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.434 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.434 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.434 INFO:teuthology.orchestra.run.smithi026.stdout: "warn_threshold": { 2023-12-01T01:07:02.434 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "warn_threshold", 2023-12-01T01:07:02.434 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.434 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.434 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.434 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "7257600", 2023-12-01T01:07:02.434 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.434 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.434 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.434 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-12-01T01:07:02.434 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.434 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "diskprediction_local", 2023-12-01T01:07:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.435 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.436 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.437 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.438 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.439 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.439 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.439 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.439 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.439 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.439 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.439 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.439 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.439 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.439 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.439 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.439 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.439 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.439 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.439 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.440 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.440 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.440 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.440 INFO:teuthology.orchestra.run.smithi026.stdout: "predict_interval": { 2023-12-01T01:07:02.440 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "predict_interval", 2023-12-01T01:07:02.440 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.440 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.440 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.440 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "86400", 2023-12-01T01:07:02.440 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.440 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.440 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.440 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.440 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.440 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.441 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.441 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.441 INFO:teuthology.orchestra.run.smithi026.stdout: "predictor_model": { 2023-12-01T01:07:02.441 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "predictor_model", 2023-12-01T01:07:02.441 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.441 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.441 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.441 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "prophetstor", 2023-12-01T01:07:02.441 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.441 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.441 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.441 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.441 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.441 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.441 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.441 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.442 INFO:teuthology.orchestra.run.smithi026.stdout: "sleep_interval": { 2023-12-01T01:07:02.442 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "sleep_interval", 2023-12-01T01:07:02.442 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.442 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.442 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.442 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "600", 2023-12-01T01:07:02.442 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.442 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.442 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.442 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.442 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.442 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.442 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.442 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.442 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.443 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.443 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.443 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "influx", 2023-12-01T01:07:02.443 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": false, 2023-12-01T01:07:02.443 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "influxdb python module not found", 2023-12-01T01:07:02.443 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.443 INFO:teuthology.orchestra.run.smithi026.stdout: "batch_size": { 2023-12-01T01:07:02.443 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "batch_size", 2023-12-01T01:07:02.443 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.443 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.443 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.443 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "5000", 2023-12-01T01:07:02.443 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.443 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.444 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.444 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-12-01T01:07:02.444 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.444 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.444 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.444 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.444 INFO:teuthology.orchestra.run.smithi026.stdout: "database": { 2023-12-01T01:07:02.444 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "database", 2023-12-01T01:07:02.444 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.444 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.444 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.444 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "ceph", 2023-12-01T01:07:02.444 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.444 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.444 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.445 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-12-01T01:07:02.445 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.445 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.445 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.445 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.445 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": { 2023-12-01T01:07:02.445 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "hostname", 2023-12-01T01:07:02.445 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.445 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.445 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.445 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.445 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.445 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.445 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.445 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "InfluxDB server hostname", 2023-12-01T01:07:02.446 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.446 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.446 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.446 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.446 INFO:teuthology.orchestra.run.smithi026.stdout: "interval": { 2023-12-01T01:07:02.446 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "interval", 2023-12-01T01:07:02.446 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.446 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.446 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.446 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "30", 2023-12-01T01:07:02.446 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "5", 2023-12-01T01:07:02.446 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.446 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.446 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-12-01T01:07:02.446 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.447 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.447 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.447 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.447 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.447 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.447 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.447 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.447 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.447 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.447 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.447 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.447 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.447 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.447 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.447 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.447 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.448 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.448 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.448 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.448 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.448 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.448 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.448 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.448 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.448 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.448 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.448 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.448 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.448 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.448 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.448 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.449 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.450 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: "password": { 2023-12-01T01:07:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "password", 2023-12-01T01:07:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.451 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "password of InfluxDB server user", 2023-12-01T01:07:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: "port": { 2023-12-01T01:07:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "port", 2023-12-01T01:07:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.452 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "8086", 2023-12-01T01:07:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "InfluxDB server port", 2023-12-01T01:07:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: "ssl": { 2023-12-01T01:07:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ssl", 2023-12-01T01:07:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "false", 2023-12-01T01:07:02.453 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-12-01T01:07:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: "threads": { 2023-12-01T01:07:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "threads", 2023-12-01T01:07:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "5", 2023-12-01T01:07:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "1", 2023-12-01T01:07:02.454 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "32", 2023-12-01T01:07:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-12-01T01:07:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: "username": { 2023-12-01T01:07:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "username", 2023-12-01T01:07:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.455 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "username of InfluxDB server user", 2023-12-01T01:07:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: "verify_ssl": { 2023-12-01T01:07:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "verify_ssl", 2023-12-01T01:07:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "true", 2023-12-01T01:07:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.456 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-12-01T01:07:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "insights", 2023-12-01T01:07:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.457 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.458 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.458 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.458 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.458 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.458 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.458 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.458 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.458 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.458 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.458 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.459 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.459 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.459 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.459 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.459 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.459 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.459 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.459 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.459 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.459 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.459 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.459 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.459 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.459 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.459 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.460 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.460 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.460 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.460 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.460 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.460 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.460 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.460 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.460 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.460 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.460 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.460 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.460 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.460 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.460 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.461 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.461 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.461 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.461 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.461 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.461 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.461 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.461 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.461 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.461 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.461 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.461 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.461 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.461 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.461 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.462 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.462 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.462 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.462 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.462 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.462 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.462 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.462 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.462 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.462 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.462 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.462 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.462 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.462 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "iostat", 2023-12-01T01:07:02.462 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.463 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.463 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.463 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.463 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.463 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.463 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.463 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.463 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.463 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.463 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.463 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.463 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.463 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.463 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.463 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.464 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.464 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.464 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.464 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.464 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.464 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.464 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.464 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.464 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.464 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.464 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.464 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.464 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.464 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.464 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.465 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.465 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.465 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.465 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.465 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.465 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.465 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.465 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.465 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.465 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.465 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.465 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.465 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.465 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.465 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.465 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.466 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.466 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.466 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.466 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.466 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.466 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.466 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.466 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.466 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.466 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.466 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.466 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.466 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.466 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.467 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.467 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.467 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.467 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.467 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.467 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.467 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.467 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.467 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.467 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.467 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.467 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.467 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.467 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.467 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.467 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "k8sevents", 2023-12-01T01:07:02.468 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.468 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.468 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.468 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_event_retention_days": { 2023-12-01T01:07:02.468 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "ceph_event_retention_days", 2023-12-01T01:07:02.468 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.468 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.468 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.468 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "7", 2023-12-01T01:07:02.468 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.468 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.468 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.468 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Days to hold ceph event information within local cache", 2023-12-01T01:07:02.468 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.468 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.469 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.469 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.469 INFO:teuthology.orchestra.run.smithi026.stdout: "config_check_secs": { 2023-12-01T01:07:02.469 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "config_check_secs", 2023-12-01T01:07:02.469 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.469 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.469 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.469 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:02.469 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "10", 2023-12-01T01:07:02.469 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.469 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.469 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-12-01T01:07:02.469 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.469 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.469 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.469 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.470 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.470 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.470 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.470 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.470 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.470 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.470 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.470 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.470 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.470 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.470 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.470 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.470 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.470 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.470 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.471 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.471 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.471 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.471 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.471 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.471 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.471 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.471 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.471 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.471 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.471 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.471 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.471 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.471 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.471 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.472 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.472 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.472 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.472 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.472 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.472 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.472 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.472 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.472 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.472 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.472 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.472 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.472 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.472 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.472 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.472 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.473 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.473 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.473 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.473 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.473 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.473 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.473 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.473 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.473 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.473 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.473 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.473 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.473 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.473 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.473 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.474 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.474 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.474 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.474 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.474 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.474 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.474 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.474 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.474 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.474 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.474 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.474 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.474 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "localpool", 2023-12-01T01:07:02.475 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.475 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.475 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.475 INFO:teuthology.orchestra.run.smithi026.stdout: "failure_domain": { 2023-12-01T01:07:02.475 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "failure_domain", 2023-12-01T01:07:02.475 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.475 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.475 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.475 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "host", 2023-12-01T01:07:02.475 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.475 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.475 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.475 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "failure domain for any created local pool", 2023-12-01T01:07:02.475 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-12-01T01:07:02.475 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.476 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.476 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.476 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.476 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.476 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.476 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.476 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.476 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.476 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.476 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.476 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.476 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.476 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.476 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.476 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.477 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.477 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.477 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.477 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.477 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.477 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.477 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.477 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.477 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.477 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.477 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.477 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.477 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.477 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.477 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.478 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.478 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.478 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.478 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.478 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.478 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.478 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.478 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.478 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.478 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.478 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.478 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.478 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.478 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.478 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.479 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.479 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.479 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.479 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.479 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.479 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.479 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.479 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.479 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.479 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.479 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.479 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.479 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.479 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.479 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.480 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.480 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.480 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.480 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.480 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.480 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.480 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.480 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.480 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.480 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.480 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.480 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.480 INFO:teuthology.orchestra.run.smithi026.stdout: "min_size": { 2023-12-01T01:07:02.480 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "min_size", 2023-12-01T01:07:02.481 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.481 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.481 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.481 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.481 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.481 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.481 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.481 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "default min_size for any created local pool", 2023-12-01T01:07:02.481 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-12-01T01:07:02.481 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.481 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.481 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.481 INFO:teuthology.orchestra.run.smithi026.stdout: "num_rep": { 2023-12-01T01:07:02.482 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "num_rep", 2023-12-01T01:07:02.482 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.482 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.482 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.482 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "3", 2023-12-01T01:07:02.482 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.482 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.482 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.482 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "default replica count for any created local pool", 2023-12-01T01:07:02.482 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.482 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.482 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.482 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.482 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_num": { 2023-12-01T01:07:02.482 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "pg_num", 2023-12-01T01:07:02.483 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.483 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.483 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.483 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "128", 2023-12-01T01:07:02.483 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.483 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.483 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.483 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "default pg_num for any created local pool", 2023-12-01T01:07:02.483 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.483 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.483 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.483 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.483 INFO:teuthology.orchestra.run.smithi026.stdout: "prefix": { 2023-12-01T01:07:02.483 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "prefix", 2023-12-01T01:07:02.483 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.484 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.484 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.484 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.484 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.484 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.484 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.484 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "name prefix for any created local pool", 2023-12-01T01:07:02.484 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.484 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.484 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.484 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.484 INFO:teuthology.orchestra.run.smithi026.stdout: "subtree": { 2023-12-01T01:07:02.484 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "subtree", 2023-12-01T01:07:02.484 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.485 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.485 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.485 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "rack", 2023-12-01T01:07:02.485 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.485 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.485 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.485 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "CRUSH level for which to create a local pool", 2023-12-01T01:07:02.485 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-12-01T01:07:02.485 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.485 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.485 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.485 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.485 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.485 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.485 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mds_autoscaler", 2023-12-01T01:07:02.486 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.486 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.486 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.486 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.486 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.486 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.486 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.486 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.486 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.486 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.486 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.486 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.486 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.487 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.487 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.487 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.487 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.487 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.487 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.487 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.487 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.487 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.487 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.487 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.487 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.487 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.487 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.488 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.488 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.488 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.488 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.488 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.488 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.488 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.488 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.488 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.488 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.488 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.488 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.488 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.488 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.488 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.489 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.489 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.489 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.489 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.489 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.489 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.489 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.489 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.489 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.489 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.489 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.489 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.489 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.489 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.490 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.490 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.490 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.490 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.490 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.490 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.490 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.490 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.490 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.490 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.490 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.490 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mirroring", 2023-12-01T01:07:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.491 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.492 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.493 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.493 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.493 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.493 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.493 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.493 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.493 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.493 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.493 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.493 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.493 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.493 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.493 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.493 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.493 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.494 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.494 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.494 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.494 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.494 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.494 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.494 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.494 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.494 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.494 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.494 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.494 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.494 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.494 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.495 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.495 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.495 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.495 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.495 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.495 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.495 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.495 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.495 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.495 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.495 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.495 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.495 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.495 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.495 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.496 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.496 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.496 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.496 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.496 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.496 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.496 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.496 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.496 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.496 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.496 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.496 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.496 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "nfs", 2023-12-01T01:07:02.496 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.496 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.497 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.497 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.497 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.497 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.497 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.497 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.497 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.497 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.497 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.497 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.497 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.497 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.497 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.497 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.497 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.497 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.498 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.498 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.498 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.498 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.498 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.498 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.498 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.498 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.498 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.498 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.498 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.498 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.498 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.498 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.499 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.499 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.499 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.499 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.499 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.499 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.499 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.499 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.499 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.499 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.499 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.499 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.499 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.499 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.499 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.499 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.500 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.500 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.500 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.500 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.500 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.500 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.500 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.500 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.500 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.500 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.500 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.500 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.500 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.500 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.500 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.501 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.501 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.501 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.501 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.501 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.501 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.501 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.501 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.501 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.501 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.501 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.501 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.501 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.501 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "orchestrator", 2023-12-01T01:07:02.501 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.501 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.502 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.502 INFO:teuthology.orchestra.run.smithi026.stdout: "fail_fs": { 2023-12-01T01:07:02.502 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "fail_fs", 2023-12-01T01:07:02.502 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.502 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.502 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.502 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.502 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.503 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.503 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.503 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-12-01T01:07:02.503 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.503 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.503 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.503 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.503 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.503 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.503 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.503 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.503 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.503 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.503 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.503 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.504 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.504 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.504 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.504 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.504 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.504 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.504 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.504 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.504 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.504 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.504 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.504 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.504 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.504 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.504 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.504 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.505 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.505 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.505 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.505 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.505 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.505 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.505 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.505 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.505 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.505 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.505 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.505 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.505 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.505 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.505 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.506 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.506 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.506 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.506 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.506 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.506 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.506 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.506 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.506 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.506 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.506 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.506 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.506 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.506 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.506 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.507 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.507 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.507 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.507 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.507 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.507 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.507 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.507 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.507 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.507 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.507 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.507 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.507 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.507 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.508 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.508 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.508 INFO:teuthology.orchestra.run.smithi026.stdout: "orchestrator": { 2023-12-01T01:07:02.508 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "orchestrator", 2023-12-01T01:07:02.508 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.508 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.508 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.508 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.508 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.508 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.508 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.508 INFO:teuthology.orchestra.run.smithi026.stdout: "cephadm", 2023-12-01T01:07:02.508 INFO:teuthology.orchestra.run.smithi026.stdout: "rook", 2023-12-01T01:07:02.508 INFO:teuthology.orchestra.run.smithi026.stdout: "test_orchestrator" 2023-12-01T01:07:02.508 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.509 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Orchestrator backend", 2023-12-01T01:07:02.509 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.509 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.509 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.509 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.509 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.509 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.509 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.509 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "osd_perf_query", 2023-12-01T01:07:02.509 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.509 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.509 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.509 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.509 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.509 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.509 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.510 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.510 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.510 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.510 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.510 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.510 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.510 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.510 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.510 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.510 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.510 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.510 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.510 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.510 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.510 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.511 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.511 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.511 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.511 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.511 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.511 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.511 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.511 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.511 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.511 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.511 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.511 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.511 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.511 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.511 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.512 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.512 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.512 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.512 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.512 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.512 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.512 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.512 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.512 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.512 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.512 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.512 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.512 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.512 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.512 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.513 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.513 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.513 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.513 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.513 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.513 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.513 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.513 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.513 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.513 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.513 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.513 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.513 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.513 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.513 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.513 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.514 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.514 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.514 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.514 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.514 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.514 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.514 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.514 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.514 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "osd_support", 2023-12-01T01:07:02.514 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.514 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.514 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.514 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.514 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.515 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.515 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.515 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.515 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.515 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.515 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.515 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.515 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.515 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.515 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.515 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.515 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.515 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.515 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.515 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.515 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.516 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.516 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.516 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.516 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.516 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.516 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.516 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.516 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.516 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.516 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.516 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.516 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.516 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.516 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.516 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.517 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.517 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.517 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.517 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.517 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.517 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.517 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.517 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.517 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.517 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.517 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.517 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.517 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.517 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.517 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.517 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.518 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.518 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.518 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.518 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.518 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.518 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.518 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.518 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.518 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.518 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.518 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.518 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.518 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.518 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.518 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.519 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.519 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.519 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.519 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.519 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.519 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.519 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.519 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.519 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.519 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "pg_autoscaler", 2023-12-01T01:07:02.519 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.519 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.519 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.519 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.519 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.520 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.520 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.520 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.520 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.520 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.520 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.520 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.520 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.520 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.520 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.520 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.520 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.520 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.520 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.520 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.520 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.521 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.522 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.522 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.522 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.522 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.522 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.522 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.522 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.522 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.522 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.522 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.522 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.522 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.522 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.522 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.523 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.523 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.523 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.523 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.523 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.523 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.523 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.523 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.523 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.523 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.523 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.523 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.523 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.523 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.523 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.524 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.524 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.524 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.524 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.524 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.524 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.524 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.524 INFO:teuthology.orchestra.run.smithi026.stdout: "sleep_interval": { 2023-12-01T01:07:02.524 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "sleep_interval", 2023-12-01T01:07:02.524 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.524 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.524 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.524 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "60", 2023-12-01T01:07:02.524 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.524 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.524 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.525 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.525 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.525 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.525 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.525 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.525 INFO:teuthology.orchestra.run.smithi026.stdout: "threshold": { 2023-12-01T01:07:02.525 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "threshold", 2023-12-01T01:07:02.525 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:02.525 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.525 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.525 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "3.0", 2023-12-01T01:07:02.525 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "1.0", 2023-12-01T01:07:02.525 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.525 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.525 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "scaling threshold", 2023-12-01T01:07:02.526 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-12-01T01:07:02.526 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.526 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.526 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.526 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.526 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.526 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.526 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "progress", 2023-12-01T01:07:02.526 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.526 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.526 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.526 INFO:teuthology.orchestra.run.smithi026.stdout: "allow_pg_recovery_event": { 2023-12-01T01:07:02.526 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "allow_pg_recovery_event", 2023-12-01T01:07:02.526 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.526 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.527 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.527 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.527 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.527 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.527 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.527 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "allow the module to show pg recovery progress", 2023-12-01T01:07:02.527 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.527 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.527 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.527 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.527 INFO:teuthology.orchestra.run.smithi026.stdout: "enabled": { 2023-12-01T01:07:02.527 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "enabled", 2023-12-01T01:07:02.527 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.527 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.527 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.528 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.528 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.528 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.528 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.528 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.528 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.528 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.528 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.528 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.528 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.528 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.528 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.528 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.528 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.528 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.528 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.529 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.529 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.529 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.529 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.529 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.529 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.529 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.529 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.529 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.529 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.529 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.529 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.529 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.529 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.529 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.530 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.530 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.530 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.530 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.530 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.530 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.530 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.530 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.530 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.530 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.530 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.530 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.530 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.530 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.530 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.531 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.531 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.531 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.531 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.531 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.531 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.531 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.531 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.531 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.531 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.531 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.531 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.531 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.531 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.531 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.531 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.532 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.532 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.532 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.532 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.532 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.532 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.532 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.532 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.532 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.532 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.532 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.532 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.532 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.532 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.533 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.533 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.533 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.533 INFO:teuthology.orchestra.run.smithi026.stdout: "max_completed_events": { 2023-12-01T01:07:02.533 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "max_completed_events", 2023-12-01T01:07:02.533 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.533 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.533 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.533 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "50", 2023-12-01T01:07:02.533 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.533 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.533 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.533 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "number of past completed events to remember", 2023-12-01T01:07:02.533 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.533 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.533 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.534 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.534 INFO:teuthology.orchestra.run.smithi026.stdout: "sleep_interval": { 2023-12-01T01:07:02.534 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "sleep_interval", 2023-12-01T01:07:02.534 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.534 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.534 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.534 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "5", 2023-12-01T01:07:02.534 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.534 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.534 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.534 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "how long the module is going to sleep", 2023-12-01T01:07:02.534 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.534 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.534 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.534 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.535 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.535 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.535 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.535 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "prometheus", 2023-12-01T01:07:02.535 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.535 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.535 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.535 INFO:teuthology.orchestra.run.smithi026.stdout: "cache": { 2023-12-01T01:07:02.535 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "cache", 2023-12-01T01:07:02.535 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.535 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.535 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.535 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.535 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.535 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.536 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.536 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.536 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.536 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.536 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.536 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.536 INFO:teuthology.orchestra.run.smithi026.stdout: "exclude_perf_counters": { 2023-12-01T01:07:02.536 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "exclude_perf_counters", 2023-12-01T01:07:02.536 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.536 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.536 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.536 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.536 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.536 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.536 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.537 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-12-01T01:07:02.537 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-12-01T01:07:02.537 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.537 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.537 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.537 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.537 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.537 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.537 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.537 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.537 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.537 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.537 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.537 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.537 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.538 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.538 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.538 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.538 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.538 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.538 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.538 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.538 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.538 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.538 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.538 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.538 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.538 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.538 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.539 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.539 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.539 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.539 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.539 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.539 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.539 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.539 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.539 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.539 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.539 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.539 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.539 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.539 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.539 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.539 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.540 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.540 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.540 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.540 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.540 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.540 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.540 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.540 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.540 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.540 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.540 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.540 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.540 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.540 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.540 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.541 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.541 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.541 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.541 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.541 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.541 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.541 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.541 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.541 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.541 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.541 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.541 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.541 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.541 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.541 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.542 INFO:teuthology.orchestra.run.smithi026.stdout: "rbd_stats_pools": { 2023-12-01T01:07:02.542 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rbd_stats_pools", 2023-12-01T01:07:02.542 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.542 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.542 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.542 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.542 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.542 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.542 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.542 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.542 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.542 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.542 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.542 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.543 INFO:teuthology.orchestra.run.smithi026.stdout: "rbd_stats_pools_refresh_interval": { 2023-12-01T01:07:02.543 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-12-01T01:07:02.543 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.543 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.543 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.543 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "300", 2023-12-01T01:07:02.543 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.543 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.543 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.543 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.543 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.543 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.543 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.543 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.544 INFO:teuthology.orchestra.run.smithi026.stdout: "scrape_interval": { 2023-12-01T01:07:02.544 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "scrape_interval", 2023-12-01T01:07:02.544 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:02.544 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.544 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.544 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "15.0", 2023-12-01T01:07:02.544 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.544 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.544 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.544 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.544 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.544 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.544 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.544 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.544 INFO:teuthology.orchestra.run.smithi026.stdout: "server_addr": { 2023-12-01T01:07:02.545 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_addr", 2023-12-01T01:07:02.545 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.545 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.545 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.545 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "::", 2023-12-01T01:07:02.545 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.545 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.545 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.545 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-12-01T01:07:02.545 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.545 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.545 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.545 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.545 INFO:teuthology.orchestra.run.smithi026.stdout: "server_port": { 2023-12-01T01:07:02.545 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_port", 2023-12-01T01:07:02.546 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.546 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.546 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.546 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "9283", 2023-12-01T01:07:02.546 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.546 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.546 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.546 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-12-01T01:07:02.546 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.546 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.546 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.546 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.546 INFO:teuthology.orchestra.run.smithi026.stdout: "stale_cache_strategy": { 2023-12-01T01:07:02.546 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "stale_cache_strategy", 2023-12-01T01:07:02.546 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.547 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.547 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.547 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "log", 2023-12-01T01:07:02.547 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.547 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.547 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.547 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.547 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.547 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.547 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.547 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.547 INFO:teuthology.orchestra.run.smithi026.stdout: "standby_behaviour": { 2023-12-01T01:07:02.547 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "standby_behaviour", 2023-12-01T01:07:02.547 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.547 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.548 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.548 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "default", 2023-12-01T01:07:02.548 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.548 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.548 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.548 INFO:teuthology.orchestra.run.smithi026.stdout: "default", 2023-12-01T01:07:02.548 INFO:teuthology.orchestra.run.smithi026.stdout: "error" 2023-12-01T01:07:02.548 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.548 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.548 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.548 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.548 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.548 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.548 INFO:teuthology.orchestra.run.smithi026.stdout: "standby_error_status_code": { 2023-12-01T01:07:02.549 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "standby_error_status_code", 2023-12-01T01:07:02.549 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.549 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.549 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.549 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "500", 2023-12-01T01:07:02.549 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "400", 2023-12-01T01:07:02.549 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "599", 2023-12-01T01:07:02.549 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.549 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.549 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.549 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.549 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.549 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.549 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.549 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.550 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.550 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rbd_support", 2023-12-01T01:07:02.550 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.550 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.550 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.550 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.550 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.550 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.550 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.550 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.550 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.550 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.550 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.550 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.550 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.551 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.551 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.551 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.551 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.551 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.551 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.551 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.551 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.551 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.551 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.551 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.551 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.551 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.551 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.551 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.552 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.552 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.552 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.552 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.552 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.552 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.552 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.552 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.552 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.552 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.552 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.552 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.552 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.552 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.552 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.553 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.553 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.553 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.553 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.553 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.553 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.553 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.553 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.553 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.553 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.553 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.553 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.553 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.553 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.553 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.554 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.554 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.554 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.554 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.554 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.554 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.554 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.554 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.554 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.554 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.554 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.554 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.554 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.555 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.555 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.555 INFO:teuthology.orchestra.run.smithi026.stdout: "max_concurrent_snap_create": { 2023-12-01T01:07:02.555 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "max_concurrent_snap_create", 2023-12-01T01:07:02.555 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.555 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.555 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.555 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10", 2023-12-01T01:07:02.555 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.555 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.555 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.555 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.555 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.555 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.555 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.556 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.556 INFO:teuthology.orchestra.run.smithi026.stdout: "mirror_snapshot_schedule": { 2023-12-01T01:07:02.556 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "mirror_snapshot_schedule", 2023-12-01T01:07:02.556 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.556 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.556 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.556 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.556 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.556 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.556 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.556 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.556 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.556 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.556 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.556 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.556 INFO:teuthology.orchestra.run.smithi026.stdout: "trash_purge_schedule": { 2023-12-01T01:07:02.557 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "trash_purge_schedule", 2023-12-01T01:07:02.557 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.557 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.557 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.557 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.557 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.557 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.557 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.557 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.557 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.557 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.557 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.557 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.557 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.557 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.558 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.558 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "restful", 2023-12-01T01:07:02.558 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.558 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.558 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.558 INFO:teuthology.orchestra.run.smithi026.stdout: "enable_auth": { 2023-12-01T01:07:02.558 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "enable_auth", 2023-12-01T01:07:02.558 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.558 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.558 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.558 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.558 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.558 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.558 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.559 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.559 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.559 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.559 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.559 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.559 INFO:teuthology.orchestra.run.smithi026.stdout: "key_file": { 2023-12-01T01:07:02.559 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "key_file", 2023-12-01T01:07:02.559 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.559 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.559 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.559 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.559 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.559 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.559 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.559 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.560 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.560 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.560 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.560 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.560 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.560 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.560 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.560 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.560 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.560 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.560 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.560 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.560 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.560 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.560 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.561 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.561 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.561 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.561 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.561 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.561 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.561 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.561 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.561 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.561 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.561 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.561 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.561 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.561 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.561 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.562 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.562 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.562 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.562 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.562 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.562 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.562 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.562 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.562 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.562 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.562 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.562 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.562 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.562 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.562 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.563 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.563 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.563 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.563 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.563 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.563 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.563 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.563 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.563 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.563 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.563 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.563 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.563 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.563 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.563 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.564 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.564 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.564 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.564 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.564 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.564 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.564 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.564 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.564 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.564 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.564 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.564 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.564 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.564 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.564 INFO:teuthology.orchestra.run.smithi026.stdout: "server_addr": { 2023-12-01T01:07:02.565 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_addr", 2023-12-01T01:07:02.565 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.565 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.565 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.565 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.565 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.565 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.565 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.565 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.565 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.565 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.565 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.565 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.565 INFO:teuthology.orchestra.run.smithi026.stdout: "server_port": { 2023-12-01T01:07:02.565 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "server_port", 2023-12-01T01:07:02.566 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.566 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.566 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.566 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.566 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.566 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.566 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.566 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.566 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.566 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.566 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.566 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.566 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.566 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.567 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.567 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rgw", 2023-12-01T01:07:02.567 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.567 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.567 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.567 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.567 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.567 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.567 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.567 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.567 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.567 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.567 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.567 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.567 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.568 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.568 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.568 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.568 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.568 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.568 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.568 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.568 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.568 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.568 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.568 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.568 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.568 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.568 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.568 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.569 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.569 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.569 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.569 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.569 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.569 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.569 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.569 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.569 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.569 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.569 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.569 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.569 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.569 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.569 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.569 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.570 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.570 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.570 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.570 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.570 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.570 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.570 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.570 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.570 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.570 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.570 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.570 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.570 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.570 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.571 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rook", 2023-12-01T01:07:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: "drive_group_interval": { 2023-12-01T01:07:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "drive_group_interval", 2023-12-01T01:07:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "300.0", 2023-12-01T01:07:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.572 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-12-01T01:07:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.573 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.574 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.574 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.574 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.574 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.574 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.574 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.574 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.574 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.574 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.574 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.574 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.574 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.574 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.574 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.574 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.575 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.575 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.575 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.575 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.575 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.575 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.575 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.575 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.575 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.575 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.575 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.575 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.575 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.575 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.575 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.576 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.576 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.576 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.576 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.576 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.576 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.576 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.576 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.576 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.576 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.576 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.576 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.576 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.576 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.576 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.576 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.577 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.577 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.577 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.577 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.577 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.577 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.577 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.577 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.577 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.577 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.577 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.577 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.577 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.577 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.577 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.578 INFO:teuthology.orchestra.run.smithi026.stdout: "storage_class": { 2023-12-01T01:07:02.578 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "storage_class", 2023-12-01T01:07:02.578 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.578 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.578 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.578 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "local", 2023-12-01T01:07:02.578 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.578 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.578 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.578 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-12-01T01:07:02.578 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.578 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.578 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.578 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.579 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.579 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.579 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.579 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "selftest", 2023-12-01T01:07:02.579 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.579 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.579 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.579 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.579 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.579 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.579 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.579 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.579 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.579 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.579 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.580 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.580 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.580 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.580 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.580 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.580 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.580 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.580 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.580 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.580 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.580 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.580 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.580 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.580 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.580 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.580 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.581 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.581 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.581 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.581 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.581 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.581 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.581 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.581 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.581 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.581 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.581 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.581 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.581 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.581 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.581 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.581 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.582 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.582 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.582 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.582 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.582 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.582 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.582 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.582 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.582 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.582 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.582 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.582 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.582 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.582 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.582 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.583 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.583 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.583 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.583 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.583 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.583 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.583 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.583 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.583 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.583 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.583 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.583 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.583 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.583 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.583 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.584 INFO:teuthology.orchestra.run.smithi026.stdout: "roption1": { 2023-12-01T01:07:02.584 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "roption1", 2023-12-01T01:07:02.584 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.584 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.584 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.584 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.584 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.584 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.584 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.584 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.584 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.584 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.584 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.584 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.584 INFO:teuthology.orchestra.run.smithi026.stdout: "roption2": { 2023-12-01T01:07:02.585 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "roption2", 2023-12-01T01:07:02.585 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.585 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.585 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.585 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "xyz", 2023-12-01T01:07:02.585 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.585 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.585 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.585 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.585 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.585 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.585 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.585 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.585 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption1": { 2023-12-01T01:07:02.585 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption1", 2023-12-01T01:07:02.586 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.586 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.586 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.586 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.586 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.586 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.586 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.586 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.586 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.586 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.586 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.586 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.586 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption2": { 2023-12-01T01:07:02.586 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption2", 2023-12-01T01:07:02.587 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.587 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.587 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.587 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.587 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.587 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.587 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.587 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.587 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.587 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.587 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.587 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.587 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption3": { 2023-12-01T01:07:02.587 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption3", 2023-12-01T01:07:02.587 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "float", 2023-12-01T01:07:02.588 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.588 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.588 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.588 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.588 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.588 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.588 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.588 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.588 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.588 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.588 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.588 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption4": { 2023-12-01T01:07:02.588 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption4", 2023-12-01T01:07:02.589 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.589 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.589 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.589 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.589 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.589 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.589 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.589 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.589 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.589 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.589 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.589 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.589 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption5": { 2023-12-01T01:07:02.589 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption5", 2023-12-01T01:07:02.590 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.590 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.590 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.590 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.590 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.590 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.590 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.590 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.590 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.590 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.590 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.590 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.590 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption6": { 2023-12-01T01:07:02.591 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption6", 2023-12-01T01:07:02.591 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.591 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.591 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.591 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.591 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.591 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.591 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.591 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.591 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.591 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.591 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.591 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.591 INFO:teuthology.orchestra.run.smithi026.stdout: "rwoption7": { 2023-12-01T01:07:02.591 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rwoption7", 2023-12-01T01:07:02.592 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.592 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.592 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.592 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.592 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "1", 2023-12-01T01:07:02.592 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "42", 2023-12-01T01:07:02.592 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.592 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.592 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.592 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.592 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.592 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.592 INFO:teuthology.orchestra.run.smithi026.stdout: "testkey": { 2023-12-01T01:07:02.592 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "testkey", 2023-12-01T01:07:02.592 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.592 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.593 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.593 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.593 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.593 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.593 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.593 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.593 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.593 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.593 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.593 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.593 INFO:teuthology.orchestra.run.smithi026.stdout: "testlkey": { 2023-12-01T01:07:02.593 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "testlkey", 2023-12-01T01:07:02.593 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.593 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.594 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.594 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.594 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.594 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.594 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.594 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.594 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.594 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.594 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.594 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.594 INFO:teuthology.orchestra.run.smithi026.stdout: "testnewline": { 2023-12-01T01:07:02.594 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "testnewline", 2023-12-01T01:07:02.594 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.594 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.595 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.595 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.595 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.595 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.595 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.595 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.595 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.595 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.595 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.595 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.595 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.595 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.595 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.595 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "snap_schedule", 2023-12-01T01:07:02.595 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.595 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.596 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.596 INFO:teuthology.orchestra.run.smithi026.stdout: "allow_m_granularity": { 2023-12-01T01:07:02.596 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "allow_m_granularity", 2023-12-01T01:07:02.596 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.596 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.596 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.596 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.596 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.596 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.596 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.596 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "allow minute scheduled snapshots", 2023-12-01T01:07:02.596 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.596 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.596 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.597 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.597 INFO:teuthology.orchestra.run.smithi026.stdout: "dump_on_update": { 2023-12-01T01:07:02.597 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "dump_on_update", 2023-12-01T01:07:02.597 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.597 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.597 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.597 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.597 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.597 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.597 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.597 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "dump database to debug log on update", 2023-12-01T01:07:02.597 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.597 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.597 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.597 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.598 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.598 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.598 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.598 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.598 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.598 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.598 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.598 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.598 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.598 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.598 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.598 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.598 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.598 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.598 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.599 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.599 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.599 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.599 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.599 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.599 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.599 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.599 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.599 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.599 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.599 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.599 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.599 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.599 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.599 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.600 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.600 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.600 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.600 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.600 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.600 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.600 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.600 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.600 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.600 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.600 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.600 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.600 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.600 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.600 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.600 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.601 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.601 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.601 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.601 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.601 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.601 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.601 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.601 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.601 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.601 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.601 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.601 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.601 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.601 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.601 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.602 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.602 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.602 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.602 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.602 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.602 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.602 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.602 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.602 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.602 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.602 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.602 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.602 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "stats", 2023-12-01T01:07:02.602 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.603 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.603 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.603 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.603 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.603 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.603 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.603 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.603 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.603 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.603 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.603 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.603 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.603 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.603 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.603 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.604 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.604 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.604 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.604 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.604 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.604 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.604 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.604 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.604 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.604 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.604 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.604 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.604 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.604 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.604 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.604 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.605 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.605 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.605 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.605 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.605 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.605 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.605 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.605 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.605 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.605 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.605 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.605 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.605 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.605 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.605 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.606 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.606 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.606 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.606 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.606 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.606 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.606 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.606 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.606 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.606 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.606 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.606 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.606 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.606 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.606 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.607 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.607 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.607 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.607 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.607 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.607 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.607 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.607 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.607 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.607 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.607 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.607 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.607 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.607 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.607 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "status", 2023-12-01T01:07:02.608 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.608 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.608 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.608 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.608 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.608 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.608 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.608 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.608 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.608 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.608 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.608 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.608 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.608 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.608 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.608 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.609 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.609 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.609 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.609 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.609 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.609 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.609 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.609 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.609 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.609 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.609 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.609 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.609 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.609 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.609 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.610 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.610 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.610 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.610 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.610 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.610 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.610 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.610 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.610 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.610 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.610 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.610 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.610 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.610 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.611 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.611 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.611 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.611 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.611 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.611 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.611 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.611 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.611 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.611 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.611 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.611 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.611 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.611 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.612 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.612 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.612 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.612 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.612 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.612 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.612 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.612 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.612 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.612 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.612 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.612 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.612 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.612 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.612 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.612 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.613 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.613 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "telegraf", 2023-12-01T01:07:02.613 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.613 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.613 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.613 INFO:teuthology.orchestra.run.smithi026.stdout: "address": { 2023-12-01T01:07:02.613 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "address", 2023-12-01T01:07:02.613 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.613 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.613 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.613 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-12-01T01:07:02.613 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.613 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.613 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.613 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.614 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.614 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.614 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.614 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.614 INFO:teuthology.orchestra.run.smithi026.stdout: "interval": { 2023-12-01T01:07:02.614 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "interval", 2023-12-01T01:07:02.614 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.614 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.614 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.614 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "15", 2023-12-01T01:07:02.614 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.614 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.614 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.614 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.614 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.614 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.615 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.615 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.615 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.615 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.615 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.615 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.615 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.615 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.615 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.615 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.615 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.615 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.615 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.615 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.615 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.616 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.616 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.616 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.616 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.616 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.616 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.616 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.616 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.616 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.616 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.616 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.616 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.616 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.616 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.616 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.616 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.617 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.617 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.617 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.617 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.617 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.617 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.617 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.617 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.617 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.617 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.617 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.617 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.617 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.617 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.617 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.618 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.618 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.618 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.618 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.618 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.618 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.618 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.618 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.618 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.618 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.618 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.618 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.618 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.618 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.618 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.619 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.619 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.619 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.619 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.619 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.619 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.619 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.619 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.619 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.619 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.619 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.619 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.619 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.619 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.619 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "telemetry", 2023-12-01T01:07:02.620 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.620 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.620 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.620 INFO:teuthology.orchestra.run.smithi026.stdout: "channel_basic": { 2023-12-01T01:07:02.620 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "channel_basic", 2023-12-01T01:07:02.620 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.620 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.620 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.620 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.620 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.620 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.620 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.620 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Share basic cluster information (size, version)", 2023-12-01T01:07:02.620 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.621 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.621 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.621 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.621 INFO:teuthology.orchestra.run.smithi026.stdout: "channel_crash": { 2023-12-01T01:07:02.621 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "channel_crash", 2023-12-01T01:07:02.621 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.621 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.621 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.621 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.621 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.621 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.621 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.621 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-12-01T01:07:02.621 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.621 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.622 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.622 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.622 INFO:teuthology.orchestra.run.smithi026.stdout: "channel_device": { 2023-12-01T01:07:02.622 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "channel_device", 2023-12-01T01:07:02.622 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.622 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.622 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.622 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "True", 2023-12-01T01:07:02.622 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.622 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.622 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.622 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-12-01T01:07:02.622 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.622 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.622 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.623 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.623 INFO:teuthology.orchestra.run.smithi026.stdout: "channel_ident": { 2023-12-01T01:07:02.623 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "channel_ident", 2023-12-01T01:07:02.623 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.623 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.623 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.623 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.623 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.623 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.623 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.623 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-12-01T01:07:02.623 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.623 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.623 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.623 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.624 INFO:teuthology.orchestra.run.smithi026.stdout: "channel_perf": { 2023-12-01T01:07:02.624 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "channel_perf", 2023-12-01T01:07:02.624 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.624 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.624 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.624 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.624 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.624 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.624 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.624 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Share various performance metrics of a cluster", 2023-12-01T01:07:02.624 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.624 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.624 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.624 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.624 INFO:teuthology.orchestra.run.smithi026.stdout: "contact": { 2023-12-01T01:07:02.625 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "contact", 2023-12-01T01:07:02.625 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.625 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.625 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.625 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.625 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.625 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.625 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.625 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.625 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.625 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.625 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.625 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.625 INFO:teuthology.orchestra.run.smithi026.stdout: "description": { 2023-12-01T01:07:02.625 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "description", 2023-12-01T01:07:02.626 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.626 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.626 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.626 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.626 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.626 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.626 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.626 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.626 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.626 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.626 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.626 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.626 INFO:teuthology.orchestra.run.smithi026.stdout: "device_url": { 2023-12-01T01:07:02.626 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "device_url", 2023-12-01T01:07:02.626 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.627 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.627 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.627 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-12-01T01:07:02.627 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.627 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.627 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.627 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.627 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.627 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.627 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.627 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.627 INFO:teuthology.orchestra.run.smithi026.stdout: "enabled": { 2023-12-01T01:07:02.627 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "enabled", 2023-12-01T01:07:02.627 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.627 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.628 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.628 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.628 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.628 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.628 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.628 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.628 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.628 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.628 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.628 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.628 INFO:teuthology.orchestra.run.smithi026.stdout: "interval": { 2023-12-01T01:07:02.628 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "interval", 2023-12-01T01:07:02.628 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.628 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.628 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.629 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "24", 2023-12-01T01:07:02.629 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "8", 2023-12-01T01:07:02.629 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.629 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.629 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.629 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.629 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.629 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.629 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.629 INFO:teuthology.orchestra.run.smithi026.stdout: "last_opt_revision": { 2023-12-01T01:07:02.629 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "last_opt_revision", 2023-12-01T01:07:02.629 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.629 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.629 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.629 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "1", 2023-12-01T01:07:02.630 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.630 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.630 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.630 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.630 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.630 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.630 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.630 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.630 INFO:teuthology.orchestra.run.smithi026.stdout: "leaderboard": { 2023-12-01T01:07:02.630 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "leaderboard", 2023-12-01T01:07:02.630 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.630 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.630 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.630 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.630 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.631 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.631 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.631 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.631 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.631 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.631 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.631 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.631 INFO:teuthology.orchestra.run.smithi026.stdout: "leaderboard_description": { 2023-12-01T01:07:02.631 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "leaderboard_description", 2023-12-01T01:07:02.631 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.631 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.631 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.631 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.631 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.631 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.631 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.632 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.632 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.632 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.632 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.632 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.632 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.632 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.632 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.632 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.632 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.632 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.632 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.632 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.632 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.632 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.633 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.633 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.633 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.633 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.633 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.633 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.633 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.633 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.633 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.633 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.633 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.633 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.633 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.633 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.633 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.633 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.634 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.634 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.634 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.634 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.634 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.634 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.634 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.634 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.634 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.634 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.634 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.634 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.634 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.634 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.635 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.635 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.635 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.635 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.635 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.635 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.635 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.635 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.635 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.635 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.635 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.635 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.635 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.635 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.635 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.636 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.636 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.636 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.636 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.636 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.636 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.636 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.636 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.636 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.636 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.636 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.636 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.636 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.636 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.636 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.637 INFO:teuthology.orchestra.run.smithi026.stdout: "organization": { 2023-12-01T01:07:02.637 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "organization", 2023-12-01T01:07:02.637 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.637 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.637 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.637 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.637 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.637 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.637 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.637 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.637 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.637 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.637 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.637 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.637 INFO:teuthology.orchestra.run.smithi026.stdout: "proxy": { 2023-12-01T01:07:02.638 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "proxy", 2023-12-01T01:07:02.638 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.638 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.638 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.638 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.638 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.638 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.638 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.638 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.638 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.638 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.638 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.638 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.638 INFO:teuthology.orchestra.run.smithi026.stdout: "url": { 2023-12-01T01:07:02.639 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "url", 2023-12-01T01:07:02.639 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.639 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.639 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.639 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-12-01T01:07:02.639 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.639 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.639 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.639 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.639 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.639 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.639 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.639 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.639 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.640 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.640 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.640 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "test_orchestrator", 2023-12-01T01:07:02.640 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.640 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.640 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.640 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.640 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.640 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.640 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.640 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.640 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.640 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.640 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.640 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.641 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.641 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.641 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.641 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.641 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.641 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.641 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.641 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.641 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.641 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.641 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.641 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.641 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.641 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.641 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.641 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.642 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.642 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.642 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.642 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.642 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.642 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.642 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.642 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.642 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.642 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.642 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.642 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.642 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.642 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.643 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.643 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.643 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.643 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.643 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.643 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.643 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.643 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.643 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.643 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.643 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.643 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.643 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.643 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.643 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.644 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.644 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.644 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.644 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.644 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.644 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.644 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.644 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.644 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.644 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.644 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.644 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.644 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.644 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.644 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.645 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.645 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.645 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.645 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.645 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "volumes", 2023-12-01T01:07:02.645 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.645 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.645 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.645 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.645 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.645 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.645 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.645 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.645 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.645 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.645 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.646 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.646 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.646 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.646 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.646 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.646 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.646 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.646 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.646 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.646 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.646 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.646 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.646 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.646 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.646 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.647 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.647 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.647 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.647 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.647 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.647 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.647 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.647 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.647 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.647 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.647 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.647 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.647 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.647 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.647 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.647 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.648 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.648 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.648 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.648 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.648 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.648 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.648 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.648 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.648 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.648 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.648 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.648 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.648 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.648 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.649 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.649 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.649 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.649 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.649 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.649 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.649 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.649 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.649 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.649 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.649 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.649 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.649 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.649 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.649 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.650 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.650 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.650 INFO:teuthology.orchestra.run.smithi026.stdout: "max_concurrent_clones": { 2023-12-01T01:07:02.650 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "max_concurrent_clones", 2023-12-01T01:07:02.650 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.650 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.650 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.650 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "4", 2023-12-01T01:07:02.650 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.650 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.650 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.650 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Number of asynchronous cloner threads", 2023-12-01T01:07:02.650 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.650 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.650 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.651 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.651 INFO:teuthology.orchestra.run.smithi026.stdout: "snapshot_clone_delay": { 2023-12-01T01:07:02.651 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "snapshot_clone_delay", 2023-12-01T01:07:02.651 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.651 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.651 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.651 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "0", 2023-12-01T01:07:02.651 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.651 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.651 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.651 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-12-01T01:07:02.651 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.651 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.651 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.652 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.652 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.652 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.652 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.652 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "zabbix", 2023-12-01T01:07:02.652 INFO:teuthology.orchestra.run.smithi026.stdout: "can_run": true, 2023-12-01T01:07:02.652 INFO:teuthology.orchestra.run.smithi026.stdout: "error_string": "", 2023-12-01T01:07:02.652 INFO:teuthology.orchestra.run.smithi026.stdout: "module_options": { 2023-12-01T01:07:02.652 INFO:teuthology.orchestra.run.smithi026.stdout: "discovery_interval": { 2023-12-01T01:07:02.652 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "discovery_interval", 2023-12-01T01:07:02.652 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "uint", 2023-12-01T01:07:02.652 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.652 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.652 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "100", 2023-12-01T01:07:02.652 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.653 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.653 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.653 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.653 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.653 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.653 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.653 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.653 INFO:teuthology.orchestra.run.smithi026.stdout: "identifier": { 2023-12-01T01:07:02.653 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "identifier", 2023-12-01T01:07:02.653 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.653 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.653 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.653 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.653 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.653 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.654 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.654 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.654 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.654 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.654 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.654 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.654 INFO:teuthology.orchestra.run.smithi026.stdout: "interval": { 2023-12-01T01:07:02.654 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "interval", 2023-12-01T01:07:02.654 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "secs", 2023-12-01T01:07:02.654 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.654 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.654 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "60", 2023-12-01T01:07:02.654 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.654 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.654 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.655 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.655 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.655 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.655 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.655 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.655 INFO:teuthology.orchestra.run.smithi026.stdout: "log_level": { 2023-12-01T01:07:02.655 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_level", 2023-12-01T01:07:02.655 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.655 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.655 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.655 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.655 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.655 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.655 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.655 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.655 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.656 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.656 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.656 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.656 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.656 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.656 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.656 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.656 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.656 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.656 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.656 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster": { 2023-12-01T01:07:02.656 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster", 2023-12-01T01:07:02.656 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.656 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.657 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.657 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.657 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.657 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.657 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.657 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.657 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.657 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.657 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.657 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.657 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_cluster_level": { 2023-12-01T01:07:02.657 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_cluster_level", 2023-12-01T01:07:02.657 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.657 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.658 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.658 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "info", 2023-12-01T01:07:02.658 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.658 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.658 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [ 2023-12-01T01:07:02.658 INFO:teuthology.orchestra.run.smithi026.stdout: "", 2023-12-01T01:07:02.658 INFO:teuthology.orchestra.run.smithi026.stdout: "critical", 2023-12-01T01:07:02.658 INFO:teuthology.orchestra.run.smithi026.stdout: "debug", 2023-12-01T01:07:02.658 INFO:teuthology.orchestra.run.smithi026.stdout: "error", 2023-12-01T01:07:02.658 INFO:teuthology.orchestra.run.smithi026.stdout: "info", 2023-12-01T01:07:02.658 INFO:teuthology.orchestra.run.smithi026.stdout: "warning" 2023-12-01T01:07:02.658 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.658 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.658 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.659 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.659 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.659 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.659 INFO:teuthology.orchestra.run.smithi026.stdout: "log_to_file": { 2023-12-01T01:07:02.659 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "log_to_file", 2023-12-01T01:07:02.659 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "bool", 2023-12-01T01:07:02.659 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.659 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 1, 2023-12-01T01:07:02.659 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "False", 2023-12-01T01:07:02.659 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.659 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.659 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.659 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.659 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.659 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.660 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.660 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.660 INFO:teuthology.orchestra.run.smithi026.stdout: "zabbix_host": { 2023-12-01T01:07:02.660 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "zabbix_host", 2023-12-01T01:07:02.660 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.660 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.660 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.660 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "", 2023-12-01T01:07:02.660 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.660 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.660 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.660 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.660 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.660 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.660 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.660 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.661 INFO:teuthology.orchestra.run.smithi026.stdout: "zabbix_port": { 2023-12-01T01:07:02.661 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "zabbix_port", 2023-12-01T01:07:02.661 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "int", 2023-12-01T01:07:02.661 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.661 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.661 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "10051", 2023-12-01T01:07:02.661 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.661 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.661 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.661 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.661 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.661 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.661 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.661 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.661 INFO:teuthology.orchestra.run.smithi026.stdout: "zabbix_sender": { 2023-12-01T01:07:02.662 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "zabbix_sender", 2023-12-01T01:07:02.662 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "str", 2023-12-01T01:07:02.662 INFO:teuthology.orchestra.run.smithi026.stdout: "level": "advanced", 2023-12-01T01:07:02.662 INFO:teuthology.orchestra.run.smithi026.stdout: "flags": 0, 2023-12-01T01:07:02.662 INFO:teuthology.orchestra.run.smithi026.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-12-01T01:07:02.662 INFO:teuthology.orchestra.run.smithi026.stdout: "min": "", 2023-12-01T01:07:02.662 INFO:teuthology.orchestra.run.smithi026.stdout: "max": "", 2023-12-01T01:07:02.662 INFO:teuthology.orchestra.run.smithi026.stdout: "enum_allowed": [], 2023-12-01T01:07:02.662 INFO:teuthology.orchestra.run.smithi026.stdout: "desc": "", 2023-12-01T01:07:02.662 INFO:teuthology.orchestra.run.smithi026.stdout: "long_desc": "", 2023-12-01T01:07:02.662 INFO:teuthology.orchestra.run.smithi026.stdout: "tags": [], 2023-12-01T01:07:02.662 INFO:teuthology.orchestra.run.smithi026.stdout: "see_also": [] 2023-12-01T01:07:02.662 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.662 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.663 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.663 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.663 INFO:teuthology.orchestra.run.smithi026.stdout: "services": { 2023-12-01T01:07:02.663 INFO:teuthology.orchestra.run.smithi026.stdout: "dashboard": "https://172.21.15.26:8443/" 2023-12-01T01:07:02.663 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.663 INFO:teuthology.orchestra.run.smithi026.stdout: "always_on_modules": { 2023-12-01T01:07:02.663 INFO:teuthology.orchestra.run.smithi026.stdout: "octopus": [ 2023-12-01T01:07:02.663 INFO:teuthology.orchestra.run.smithi026.stdout: "balancer", 2023-12-01T01:07:02.663 INFO:teuthology.orchestra.run.smithi026.stdout: "crash", 2023-12-01T01:07:02.663 INFO:teuthology.orchestra.run.smithi026.stdout: "devicehealth", 2023-12-01T01:07:02.663 INFO:teuthology.orchestra.run.smithi026.stdout: "orchestrator", 2023-12-01T01:07:02.663 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_autoscaler", 2023-12-01T01:07:02.663 INFO:teuthology.orchestra.run.smithi026.stdout: "progress", 2023-12-01T01:07:02.663 INFO:teuthology.orchestra.run.smithi026.stdout: "rbd_support", 2023-12-01T01:07:02.663 INFO:teuthology.orchestra.run.smithi026.stdout: "status", 2023-12-01T01:07:02.664 INFO:teuthology.orchestra.run.smithi026.stdout: "telemetry", 2023-12-01T01:07:02.664 INFO:teuthology.orchestra.run.smithi026.stdout: "volumes" 2023-12-01T01:07:02.664 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.664 INFO:teuthology.orchestra.run.smithi026.stdout: "pacific": [ 2023-12-01T01:07:02.664 INFO:teuthology.orchestra.run.smithi026.stdout: "balancer", 2023-12-01T01:07:02.664 INFO:teuthology.orchestra.run.smithi026.stdout: "crash", 2023-12-01T01:07:02.664 INFO:teuthology.orchestra.run.smithi026.stdout: "devicehealth", 2023-12-01T01:07:02.664 INFO:teuthology.orchestra.run.smithi026.stdout: "orchestrator", 2023-12-01T01:07:02.664 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_autoscaler", 2023-12-01T01:07:02.664 INFO:teuthology.orchestra.run.smithi026.stdout: "progress", 2023-12-01T01:07:02.664 INFO:teuthology.orchestra.run.smithi026.stdout: "rbd_support", 2023-12-01T01:07:02.664 INFO:teuthology.orchestra.run.smithi026.stdout: "status", 2023-12-01T01:07:02.664 INFO:teuthology.orchestra.run.smithi026.stdout: "telemetry", 2023-12-01T01:07:02.664 INFO:teuthology.orchestra.run.smithi026.stdout: "volumes" 2023-12-01T01:07:02.664 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.665 INFO:teuthology.orchestra.run.smithi026.stdout: "quincy": [ 2023-12-01T01:07:02.665 INFO:teuthology.orchestra.run.smithi026.stdout: "balancer", 2023-12-01T01:07:02.665 INFO:teuthology.orchestra.run.smithi026.stdout: "crash", 2023-12-01T01:07:02.665 INFO:teuthology.orchestra.run.smithi026.stdout: "devicehealth", 2023-12-01T01:07:02.665 INFO:teuthology.orchestra.run.smithi026.stdout: "orchestrator", 2023-12-01T01:07:02.665 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_autoscaler", 2023-12-01T01:07:02.665 INFO:teuthology.orchestra.run.smithi026.stdout: "progress", 2023-12-01T01:07:02.665 INFO:teuthology.orchestra.run.smithi026.stdout: "rbd_support", 2023-12-01T01:07:02.665 INFO:teuthology.orchestra.run.smithi026.stdout: "status", 2023-12-01T01:07:02.665 INFO:teuthology.orchestra.run.smithi026.stdout: "telemetry", 2023-12-01T01:07:02.665 INFO:teuthology.orchestra.run.smithi026.stdout: "volumes" 2023-12-01T01:07:02.665 INFO:teuthology.orchestra.run.smithi026.stdout: ], 2023-12-01T01:07:02.665 INFO:teuthology.orchestra.run.smithi026.stdout: "reef": [ 2023-12-01T01:07:02.665 INFO:teuthology.orchestra.run.smithi026.stdout: "balancer", 2023-12-01T01:07:02.665 INFO:teuthology.orchestra.run.smithi026.stdout: "crash", 2023-12-01T01:07:02.666 INFO:teuthology.orchestra.run.smithi026.stdout: "devicehealth", 2023-12-01T01:07:02.666 INFO:teuthology.orchestra.run.smithi026.stdout: "orchestrator", 2023-12-01T01:07:02.666 INFO:teuthology.orchestra.run.smithi026.stdout: "pg_autoscaler", 2023-12-01T01:07:02.666 INFO:teuthology.orchestra.run.smithi026.stdout: "progress", 2023-12-01T01:07:02.666 INFO:teuthology.orchestra.run.smithi026.stdout: "rbd_support", 2023-12-01T01:07:02.666 INFO:teuthology.orchestra.run.smithi026.stdout: "status", 2023-12-01T01:07:02.666 INFO:teuthology.orchestra.run.smithi026.stdout: "telemetry", 2023-12-01T01:07:02.666 INFO:teuthology.orchestra.run.smithi026.stdout: "volumes" 2023-12-01T01:07:02.666 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-12-01T01:07:02.666 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.666 INFO:teuthology.orchestra.run.smithi026.stdout: "last_failure_osd_epoch": 3, 2023-12-01T01:07:02.666 INFO:teuthology.orchestra.run.smithi026.stdout: "active_clients": [ 2023-12-01T01:07:02.666 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.666 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "devicehealth", 2023-12-01T01:07:02.666 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-12-01T01:07:02.667 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.667 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v2", 2023-12-01T01:07:02.667 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:0", 2023-12-01T01:07:02.667 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 1800968198 2023-12-01T01:07:02.667 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.667 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-12-01T01:07:02.667 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.667 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.667 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "libcephsqlite", 2023-12-01T01:07:02.667 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-12-01T01:07:02.667 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.667 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v2", 2023-12-01T01:07:02.667 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:0", 2023-12-01T01:07:02.667 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 4105078704 2023-12-01T01:07:02.668 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.668 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-12-01T01:07:02.668 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.668 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.668 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "rbd_support", 2023-12-01T01:07:02.668 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-12-01T01:07:02.668 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.668 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v2", 2023-12-01T01:07:02.668 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:0", 2023-12-01T01:07:02.668 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 3489999514 2023-12-01T01:07:02.668 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.668 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-12-01T01:07:02.668 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:02.668 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.668 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "volumes", 2023-12-01T01:07:02.668 INFO:teuthology.orchestra.run.smithi026.stdout: "addrvec": [ 2023-12-01T01:07:02.669 INFO:teuthology.orchestra.run.smithi026.stdout: { 2023-12-01T01:07:02.669 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v2", 2023-12-01T01:07:02.669 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "172.21.15.26:0", 2023-12-01T01:07:02.669 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 2555779830 2023-12-01T01:07:02.669 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.669 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-12-01T01:07:02.669 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:02.669 INFO:teuthology.orchestra.run.smithi026.stdout: ] 2023-12-01T01:07:02.669 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:07:02.670 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:01 smithi093 ceph-mon[103327]: pgmap v375: 97 pgs: 97 active+clean; 53 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 243 KiB/s wr, 89 op/s 2023-12-01T01:07:02.671 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:01 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/1961742505' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:07:02.671 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:01 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2581002276' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-12-01T01:07:02.671 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:01 smithi116 ceph-mon[103554]: pgmap v375: 97 pgs: 97 active+clean; 53 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 243 KiB/s wr, 89 op/s 2023-12-01T01:07:02.671 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:01 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/1961742505' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:07:02.671 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:01 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2581002276' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-12-01T01:07:02.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.333+0000 7fde1be65700 1 -- 172.21.15.26:0/2581002276 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fde000a0570 msgr2=0x7fde000a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:02.671 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.333+0000 7fde1be65700 1 --2- 172.21.15.26:0/2581002276 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fde000a0570 0x7fde000a2a30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fde14199b40 tx=0x7fde10009260 comp rx=0 tx=0).stop 2023-12-01T01:07:02.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.333+0000 7fde1be65700 1 -- 172.21.15.26:0/2581002276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde14100930 msgr2=0x7fde141a0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:02.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.333+0000 7fde1be65700 1 --2- 172.21.15.26:0/2581002276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde14100930 0x7fde141a0210 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fde0c007ee0 tx=0x7fde0c00d3b0 comp rx=0 tx=0).stop 2023-12-01T01:07:02.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.334+0000 7fde1be65700 1 -- 172.21.15.26:0/2581002276 shutdown_connections 2023-12-01T01:07:02.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.334+0000 7fde1be65700 1 --2- 172.21.15.26:0/2581002276 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fde000a0570 0x7fde000a2a30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:02.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.334+0000 7fde1be65700 1 --2- 172.21.15.26:0/2581002276 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde14100930 0x7fde141a0210 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:02.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.334+0000 7fde1be65700 1 --2- 172.21.15.26:0/2581002276 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde140ff610 0x7fde14198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:02.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.334+0000 7fde1be65700 1 --2- 172.21.15.26:0/2581002276 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde140fff70 0x7fde141991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:02.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.334+0000 7fde1be65700 1 -- 172.21.15.26:0/2581002276 >> 172.21.15.26:0/2581002276 conn(0x7fde140fb210 msgr2=0x7fde140fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:02.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.334+0000 7fde1be65700 1 -- 172.21.15.26:0/2581002276 shutdown_connections 2023-12-01T01:07:02.672 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:01.334+0000 7fde1be65700 1 -- 172.21.15.26:0/2581002276 wait complete. 2023-12-01T01:07:02.678 DEBUG:tasks.check_counter:Getting stats from a 2023-12-01T01:07:02.678 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph daemon mds.a perf dump 2023-12-01T01:07:02.679 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:01 smithi026 ceph-mon[98801]: pgmap v375: 97 pgs: 97 active+clean; 53 MiB data, 408 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 243 KiB/s wr, 89 op/s 2023-12-01T01:07:02.679 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:01 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/1961742505' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:07:02.679 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:01 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2581002276' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-12-01T01:07:03.253 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:07:04.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:03 smithi116 ceph-mon[103554]: pgmap v376: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 44 op/s 2023-12-01T01:07:04.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:03 smithi093 ceph-mon[103327]: pgmap v376: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 44 op/s 2023-12-01T01:07:04.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:03 smithi026 ceph-mon[98801]: pgmap v376: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 49 KiB/s wr, 44 op/s 2023-12-01T01:07:06.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:05 smithi116 ceph-mon[103554]: pgmap v377: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 25 op/s 2023-12-01T01:07:06.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:05 smithi093 ceph-mon[103327]: pgmap v377: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 25 op/s 2023-12-01T01:07:06.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:05 smithi026 ceph-mon[98801]: pgmap v377: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 25 op/s 2023-12-01T01:07:07.603 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:07:07.604 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-0": { 2023-12-01T01:07:07.604 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 79, 2023-12-01T01:07:07.604 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 76, 2023-12-01T01:07:07.604 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 429616, 2023-12-01T01:07:07.604 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 42336, 2023-12-01T01:07:07.604 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 4, 2023-12-01T01:07:07.604 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 0, 2023-12-01T01:07:07.604 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.014544442, 2023-12-01T01:07:07.604 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.004026890, 2023-12-01T01:07:07.604 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.010233335, 2023-12-01T01:07:07.604 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.001630097, 2023-12-01T01:07:07.604 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:07.605 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 75, 2023-12-01T01:07:07.605 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.004180400, 2023-12-01T01:07:07.605 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000055738 2023-12-01T01:07:07.605 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:07.605 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:07.605 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:07.605 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:07.605 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:07.605 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:07.605 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 429616, 2023-12-01T01:07:07.605 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 42336 2023-12-01T01:07:07.605 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:07.605 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-1": { 2023-12-01T01:07:07.605 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 5, 2023-12-01T01:07:07.605 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 59, 2023-12-01T01:07:07.606 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 3152, 2023-12-01T01:07:07.606 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 86432, 2023-12-01T01:07:07.606 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 3, 2023-12-01T01:07:07.606 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 2, 2023-12-01T01:07:07.606 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.005551046, 2023-12-01T01:07:07.606 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.003065863, 2023-12-01T01:07:07.606 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.001899541, 2023-12-01T01:07:07.606 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-01T01:07:07.606 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:07.606 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 58, 2023-12-01T01:07:07.606 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.003555813, 2023-12-01T01:07:07.606 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000061307 2023-12-01T01:07:07.606 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:07.606 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:07.607 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:07.607 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:07.607 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:07.607 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:07.607 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-12-01T01:07:07.607 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 86432 2023-12-01T01:07:07.607 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:07.607 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-2": { 2023-12-01T01:07:07.607 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 0, 2023-12-01T01:07:07.607 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 2, 2023-12-01T01:07:07.607 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 0, 2023-12-01T01:07:07.607 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 0, 2023-12-01T01:07:07.607 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 2, 2023-12-01T01:07:07.607 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 1, 2023-12-01T01:07:07.607 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.000497384, 2023-12-01T01:07:07.608 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.000000000, 2023-12-01T01:07:07.608 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.000423122, 2023-12-01T01:07:07.608 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-01T01:07:07.608 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:07.608 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:07.608 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:07.608 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:07.608 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:07.608 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:07.608 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:07.608 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:07.608 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:07.608 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:07.608 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-01T01:07:07.608 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 0 2023-12-01T01:07:07.609 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:07.609 INFO:teuthology.orchestra.run.smithi026.stdout: "cct": { 2023-12-01T01:07:07.609 INFO:teuthology.orchestra.run.smithi026.stdout: "total_workers": 0, 2023-12-01T01:07:07.609 INFO:teuthology.orchestra.run.smithi026.stdout: "unhealthy_workers": 0 2023-12-01T01:07:07.609 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:07.609 INFO:teuthology.orchestra.run.smithi026.stdout: "mempool": { 2023-12-01T01:07:07.609 INFO:teuthology.orchestra.run.smithi026.stdout: "bloom_filter_bytes": 0, 2023-12-01T01:07:07.609 INFO:teuthology.orchestra.run.smithi026.stdout: "bloom_filter_items": 0, 2023-12-01T01:07:07.609 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_alloc_bytes": 0, 2023-12-01T01:07:07.609 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_alloc_items": 0, 2023-12-01T01:07:07.609 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_data_bytes": 0, 2023-12-01T01:07:07.609 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_data_items": 0, 2023-12-01T01:07:07.609 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-01T01:07:07.609 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_onode_items": 0, 2023-12-01T01:07:07.609 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-01T01:07:07.610 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_meta_items": 0, 2023-12-01T01:07:07.610 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_other_bytes": 0, 2023-12-01T01:07:07.610 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_other_items": 0, 2023-12-01T01:07:07.610 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-01T01:07:07.610 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_buffer_items": 0, 2023-12-01T01:07:07.610 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_extent_bytes": 0, 2023-12-01T01:07:07.610 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_extent_items": 0, 2023-12-01T01:07:07.610 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_blob_bytes": 0, 2023-12-01T01:07:07.610 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_blob_items": 0, 2023-12-01T01:07:07.610 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-01T01:07:07.610 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_shared_blob_items": 0, 2023-12-01T01:07:07.610 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-01T01:07:07.610 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_inline_bl_items": 0, 2023-12-01T01:07:07.610 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_fsck_bytes": 0, 2023-12-01T01:07:07.610 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_fsck_items": 0, 2023-12-01T01:07:07.611 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_txc_bytes": 0, 2023-12-01T01:07:07.611 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_txc_items": 0, 2023-12-01T01:07:07.611 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-01T01:07:07.611 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_deferred_items": 0, 2023-12-01T01:07:07.611 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_bytes": 0, 2023-12-01T01:07:07.611 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_items": 0, 2023-12-01T01:07:07.611 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_bytes": 0, 2023-12-01T01:07:07.611 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_items": 0, 2023-12-01T01:07:07.611 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_reader_bytes": 0, 2023-12-01T01:07:07.611 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_reader_items": 0, 2023-12-01T01:07:07.611 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_writer_bytes": 0, 2023-12-01T01:07:07.611 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_writer_items": 0, 2023-12-01T01:07:07.611 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_anon_bytes": 148840, 2023-12-01T01:07:07.611 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_anon_items": 28, 2023-12-01T01:07:07.612 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_meta_bytes": 0, 2023-12-01T01:07:07.612 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_meta_items": 0, 2023-12-01T01:07:07.612 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_bytes": 0, 2023-12-01T01:07:07.612 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_items": 0, 2023-12-01T01:07:07.612 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_mapbl_bytes": 0, 2023-12-01T01:07:07.612 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_mapbl_items": 0, 2023-12-01T01:07:07.612 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_pglog_bytes": 0, 2023-12-01T01:07:07.612 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_pglog_items": 0, 2023-12-01T01:07:07.612 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_bytes": 0, 2023-12-01T01:07:07.612 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_items": 0, 2023-12-01T01:07:07.612 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_mapping_bytes": 0, 2023-12-01T01:07:07.612 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_mapping_items": 0, 2023-12-01T01:07:07.612 INFO:teuthology.orchestra.run.smithi026.stdout: "pgmap_bytes": 0, 2023-12-01T01:07:07.612 INFO:teuthology.orchestra.run.smithi026.stdout: "pgmap_items": 0, 2023-12-01T01:07:07.613 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_co_bytes": 928, 2023-12-01T01:07:07.613 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_co_items": 2, 2023-12-01T01:07:07.613 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_1_bytes": 0, 2023-12-01T01:07:07.613 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_1_items": 0, 2023-12-01T01:07:07.613 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_2_bytes": 0, 2023-12-01T01:07:07.613 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_2_items": 0 2023-12-01T01:07:07.613 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:07.613 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-01T01:07:07.613 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2023-12-01T01:07:07.613 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 104857600, 2023-12-01T01:07:07.613 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2023-12-01T01:07:07.613 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 80, 2023-12-01T01:07:07.613 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 418501, 2023-12-01T01:07:07.613 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:07.614 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 80, 2023-12-01T01:07:07.614 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2023-12-01T01:07:07.614 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2023-12-01T01:07:07.614 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 80, 2023-12-01T01:07:07.614 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 418501, 2023-12-01T01:07:07.614 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2023-12-01T01:07:07.614 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:07.614 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:07.614 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:07.614 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:07.614 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:07.614 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:07:07.954 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:07 smithi026 ceph-mon[98801]: pgmap v378: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 26 op/s 2023-12-01T01:07:08.043 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2023-12-01T01:07:08.044 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2023-12-01T01:07:08.044 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2023-12-01T01:07:08.044 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2023-12-01T01:07:08.044 DEBUG:tasks.check_counter:Getting stats from d 2023-12-01T01:07:08.044 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph daemon mds.d perf dump 2023-12-01T01:07:08.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:07 smithi116 ceph-mon[103554]: pgmap v378: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 26 op/s 2023-12-01T01:07:08.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:07 smithi093 ceph-mon[103327]: pgmap v378: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 38 KiB/s wr, 26 op/s 2023-12-01T01:07:08.606 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:07:09.932 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:07:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-0": { 2023-12-01T01:07:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 4, 2023-12-01T01:07:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 4, 2023-12-01T01:07:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 2992, 2023-12-01T01:07:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 448, 2023-12-01T01:07:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 4, 2023-12-01T01:07:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 0, 2023-12-01T01:07:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.001914247, 2023-12-01T01:07:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.000046038, 2023-12-01T01:07:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.000768997, 2023-12-01T01:07:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-01T01:07:09.933 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:09.934 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 3, 2023-12-01T01:07:09.934 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000716171, 2023-12-01T01:07:09.934 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000238723 2023-12-01T01:07:09.934 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:09.934 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:09.934 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:09.934 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:09.934 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:09.934 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:09.934 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-12-01T01:07:09.934 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 448 2023-12-01T01:07:09.934 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:09.934 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-1": { 2023-12-01T01:07:09.935 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 83, 2023-12-01T01:07:09.935 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 80, 2023-12-01T01:07:09.935 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 430704, 2023-12-01T01:07:09.935 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 44704, 2023-12-01T01:07:09.935 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 2, 2023-12-01T01:07:09.935 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 1, 2023-12-01T01:07:09.935 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.013667713, 2023-12-01T01:07:09.935 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.004294136, 2023-12-01T01:07:09.935 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.010205246, 2023-12-01T01:07:09.935 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.001692624, 2023-12-01T01:07:09.935 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:09.935 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 79, 2023-12-01T01:07:09.935 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.003433670, 2023-12-01T01:07:09.935 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000043464 2023-12-01T01:07:09.935 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:09.936 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:09.936 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:09.936 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:09.936 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:09.936 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:09.936 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 430704, 2023-12-01T01:07:09.936 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 44704 2023-12-01T01:07:09.936 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:09.936 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-2": { 2023-12-01T01:07:09.936 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 1, 2023-12-01T01:07:09.936 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 61, 2023-12-01T01:07:09.936 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 160, 2023-12-01T01:07:09.936 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 86688, 2023-12-01T01:07:09.936 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 3, 2023-12-01T01:07:09.937 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 2, 2023-12-01T01:07:09.937 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.004853937, 2023-12-01T01:07:09.937 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.003067243, 2023-12-01T01:07:09.937 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.001174647, 2023-12-01T01:07:09.937 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-01T01:07:09.937 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:09.937 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 59, 2023-12-01T01:07:09.937 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.002496196, 2023-12-01T01:07:09.937 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000042308 2023-12-01T01:07:09.937 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:09.937 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:09.937 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:09.937 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:09.937 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:09.937 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:09.937 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-01T01:07:09.938 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 86688 2023-12-01T01:07:09.938 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:09.938 INFO:teuthology.orchestra.run.smithi026.stdout: "cct": { 2023-12-01T01:07:09.938 INFO:teuthology.orchestra.run.smithi026.stdout: "total_workers": 0, 2023-12-01T01:07:09.938 INFO:teuthology.orchestra.run.smithi026.stdout: "unhealthy_workers": 0 2023-12-01T01:07:09.938 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:09.938 INFO:teuthology.orchestra.run.smithi026.stdout: "mempool": { 2023-12-01T01:07:09.938 INFO:teuthology.orchestra.run.smithi026.stdout: "bloom_filter_bytes": 0, 2023-12-01T01:07:09.939 INFO:teuthology.orchestra.run.smithi026.stdout: "bloom_filter_items": 0, 2023-12-01T01:07:09.939 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_alloc_bytes": 0, 2023-12-01T01:07:09.939 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_alloc_items": 0, 2023-12-01T01:07:09.939 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_data_bytes": 0, 2023-12-01T01:07:09.939 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_data_items": 0, 2023-12-01T01:07:09.939 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-01T01:07:09.939 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_onode_items": 0, 2023-12-01T01:07:09.939 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-01T01:07:09.939 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_meta_items": 0, 2023-12-01T01:07:09.940 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_other_bytes": 0, 2023-12-01T01:07:09.940 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_other_items": 0, 2023-12-01T01:07:09.940 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-01T01:07:09.940 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_buffer_items": 0, 2023-12-01T01:07:09.940 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_extent_bytes": 0, 2023-12-01T01:07:09.940 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_extent_items": 0, 2023-12-01T01:07:09.940 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_blob_bytes": 0, 2023-12-01T01:07:09.940 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_blob_items": 0, 2023-12-01T01:07:09.940 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-01T01:07:09.940 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_shared_blob_items": 0, 2023-12-01T01:07:09.940 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-01T01:07:09.940 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_inline_bl_items": 0, 2023-12-01T01:07:09.940 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_fsck_bytes": 0, 2023-12-01T01:07:09.941 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_fsck_items": 0, 2023-12-01T01:07:09.941 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_txc_bytes": 0, 2023-12-01T01:07:09.941 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_txc_items": 0, 2023-12-01T01:07:09.941 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-01T01:07:09.941 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_deferred_items": 0, 2023-12-01T01:07:09.941 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_bytes": 0, 2023-12-01T01:07:09.941 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_items": 0, 2023-12-01T01:07:09.941 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_bytes": 0, 2023-12-01T01:07:09.941 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_items": 0, 2023-12-01T01:07:09.941 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_reader_bytes": 0, 2023-12-01T01:07:09.941 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_reader_items": 0, 2023-12-01T01:07:09.941 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_writer_bytes": 0, 2023-12-01T01:07:09.941 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_writer_items": 0, 2023-12-01T01:07:09.941 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_anon_bytes": 148903, 2023-12-01T01:07:09.942 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_anon_items": 29, 2023-12-01T01:07:09.942 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_meta_bytes": 0, 2023-12-01T01:07:09.942 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_meta_items": 0, 2023-12-01T01:07:09.942 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_bytes": 0, 2023-12-01T01:07:09.942 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_items": 0, 2023-12-01T01:07:09.942 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_mapbl_bytes": 0, 2023-12-01T01:07:09.942 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_mapbl_items": 0, 2023-12-01T01:07:09.942 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_pglog_bytes": 0, 2023-12-01T01:07:09.942 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_pglog_items": 0, 2023-12-01T01:07:09.942 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_bytes": 0, 2023-12-01T01:07:09.942 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_items": 0, 2023-12-01T01:07:09.942 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_mapping_bytes": 0, 2023-12-01T01:07:09.942 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_mapping_items": 0, 2023-12-01T01:07:09.942 INFO:teuthology.orchestra.run.smithi026.stdout: "pgmap_bytes": 0, 2023-12-01T01:07:09.942 INFO:teuthology.orchestra.run.smithi026.stdout: "pgmap_items": 0, 2023-12-01T01:07:09.943 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_co_bytes": 928, 2023-12-01T01:07:09.943 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_co_items": 2, 2023-12-01T01:07:09.943 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_1_bytes": 0, 2023-12-01T01:07:09.943 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_1_items": 0, 2023-12-01T01:07:09.943 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_2_bytes": 0, 2023-12-01T01:07:09.943 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_2_items": 0 2023-12-01T01:07:09.943 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:09.943 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-01T01:07:09.943 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2023-12-01T01:07:09.943 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 104857600, 2023-12-01T01:07:09.943 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2023-12-01T01:07:09.943 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 84, 2023-12-01T01:07:09.943 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 419021, 2023-12-01T01:07:09.943 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:09.943 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 84, 2023-12-01T01:07:09.944 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2023-12-01T01:07:09.944 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2023-12-01T01:07:09.944 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 84, 2023-12-01T01:07:09.944 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 419021, 2023-12-01T01:07:09.944 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2023-12-01T01:07:09.944 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:09.944 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:09.944 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:09.944 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:09.944 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:09.944 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:07:10.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:09 smithi026 ceph-mon[98801]: pgmap v379: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2023-12-01T01:07:10.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:09 smithi116 ceph-mon[103554]: pgmap v379: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2023-12-01T01:07:10.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:09 smithi093 ceph-mon[103327]: pgmap v379: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.1 KiB/s wr, 10 op/s 2023-12-01T01:07:10.271 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-12-01T01:07:10.271 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-12-01T01:07:10.271 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2023-12-01T01:07:10.271 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2023-12-01T01:07:10.271 DEBUG:tasks.check_counter:Getting stats from g 2023-12-01T01:07:10.271 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph daemon mds.g perf dump 2023-12-01T01:07:10.837 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:07:12.084 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:07:12.085 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-0": { 2023-12-01T01:07:12.085 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 69123, 2023-12-01T01:07:12.085 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 65575, 2023-12-01T01:07:12.085 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 16799949, 2023-12-01T01:07:12.085 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 28203600, 2023-12-01T01:07:12.085 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 11, 2023-12-01T01:07:12.085 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 5, 2023-12-01T01:07:12.085 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 2.738096946, 2023-12-01T01:07:12.085 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 1.065294338, 2023-12-01T01:07:12.085 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 1.943444198, 2023-12-01T01:07:12.085 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.037477541, 2023-12-01T01:07:12.085 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:12.085 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 65573, 2023-12-01T01:07:12.086 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 1.277260321, 2023-12-01T01:07:12.086 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000019478 2023-12-01T01:07:12.086 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.086 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:12.086 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 132013, 2023-12-01T01:07:12.086 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.015267830, 2023-12-01T01:07:12.086 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000115 2023-12-01T01:07:12.086 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.086 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-01T01:07:12.086 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 0 2023-12-01T01:07:12.086 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.086 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-1": { 2023-12-01T01:07:12.086 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 9882, 2023-12-01T01:07:12.086 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 22572, 2023-12-01T01:07:12.087 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 3534142, 2023-12-01T01:07:12.087 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 13642882, 2023-12-01T01:07:12.087 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 10, 2023-12-01T01:07:12.087 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 6, 2023-12-01T01:07:12.087 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.865307778, 2023-12-01T01:07:12.087 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.451200479, 2023-12-01T01:07:12.087 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.743965292, 2023-12-01T01:07:12.087 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.036691724, 2023-12-01T01:07:12.087 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:12.087 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 22572, 2023-12-01T01:07:12.087 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 1.222848774, 2023-12-01T01:07:12.087 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000054175 2023-12-01T01:07:12.087 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.087 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:12.087 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 25148, 2023-12-01T01:07:12.088 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.005288384, 2023-12-01T01:07:12.088 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000210 2023-12-01T01:07:12.088 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.088 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 494624, 2023-12-01T01:07:12.088 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 50208 2023-12-01T01:07:12.088 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.088 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-2": { 2023-12-01T01:07:12.089 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 1922, 2023-12-01T01:07:12.089 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 1979, 2023-12-01T01:07:12.089 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 880404, 2023-12-01T01:07:12.089 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 5900939, 2023-12-01T01:07:12.089 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 17, 2023-12-01T01:07:12.090 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 5, 2023-12-01T01:07:12.090 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.146456507, 2023-12-01T01:07:12.090 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.051652538, 2023-12-01T01:07:12.090 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.037141358, 2023-12-01T01:07:12.090 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.047731247, 2023-12-01T01:07:12.090 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:12.090 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 1977, 2023-12-01T01:07:12.090 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.246447911, 2023-12-01T01:07:12.090 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000124657 2023-12-01T01:07:12.091 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.091 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:12.091 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 8, 2023-12-01T01:07:12.091 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000001168, 2023-12-01T01:07:12.091 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000146 2023-12-01T01:07:12.091 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.091 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-01T01:07:12.091 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 176592 2023-12-01T01:07:12.091 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.091 INFO:teuthology.orchestra.run.smithi026.stdout: "cct": { 2023-12-01T01:07:12.091 INFO:teuthology.orchestra.run.smithi026.stdout: "total_workers": 1, 2023-12-01T01:07:12.091 INFO:teuthology.orchestra.run.smithi026.stdout: "unhealthy_workers": 0 2023-12-01T01:07:12.091 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.091 INFO:teuthology.orchestra.run.smithi026.stdout: "finisher-MDSRank": { 2023-12-01T01:07:12.092 INFO:teuthology.orchestra.run.smithi026.stdout: "queue_len": 0, 2023-12-01T01:07:12.092 INFO:teuthology.orchestra.run.smithi026.stdout: "complete_latency": { 2023-12-01T01:07:12.092 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 552, 2023-12-01T01:07:12.092 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 6.682118893, 2023-12-01T01:07:12.092 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.012105287 2023-12-01T01:07:12.092 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:12.092 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.092 INFO:teuthology.orchestra.run.smithi026.stdout: "finisher-PurgeQueue": { 2023-12-01T01:07:12.092 INFO:teuthology.orchestra.run.smithi026.stdout: "queue_len": 0, 2023-12-01T01:07:12.092 INFO:teuthology.orchestra.run.smithi026.stdout: "complete_latency": { 2023-12-01T01:07:12.092 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 5567, 2023-12-01T01:07:12.092 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 1.665063491, 2023-12-01T01:07:12.092 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000299095 2023-12-01T01:07:12.092 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:12.092 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.093 INFO:teuthology.orchestra.run.smithi026.stdout: "mds": { 2023-12-01T01:07:12.093 INFO:teuthology.orchestra.run.smithi026.stdout: "request": 5388, 2023-12-01T01:07:12.093 INFO:teuthology.orchestra.run.smithi026.stdout: "reply": 5387, 2023-12-01T01:07:12.093 INFO:teuthology.orchestra.run.smithi026.stdout: "reply_latency": { 2023-12-01T01:07:12.093 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 5387, 2023-12-01T01:07:12.093 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 21.122861586, 2023-12-01T01:07:12.093 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.003921080 2023-12-01T01:07:12.093 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.093 INFO:teuthology.orchestra.run.smithi026.stdout: "slow_reply": 0, 2023-12-01T01:07:12.093 INFO:teuthology.orchestra.run.smithi026.stdout: "forward": 1, 2023-12-01T01:07:12.093 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_fetch_complete": 0, 2023-12-01T01:07:12.093 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_fetch_keys": 0, 2023-12-01T01:07:12.093 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_commit": 11, 2023-12-01T01:07:12.093 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_split": 0, 2023-12-01T01:07:12.094 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_merge": 0, 2023-12-01T01:07:12.094 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes": 16, 2023-12-01T01:07:12.094 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_top": 1, 2023-12-01T01:07:12.094 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_bottom": 2, 2023-12-01T01:07:12.094 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_pin_tail": 13, 2023-12-01T01:07:12.094 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_pinned": 13, 2023-12-01T01:07:12.094 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_expired": 1036, 2023-12-01T01:07:12.094 INFO:teuthology.orchestra.run.smithi026.stdout: "inodes_with_caps": 1, 2023-12-01T01:07:12.094 INFO:teuthology.orchestra.run.smithi026.stdout: "caps": 1, 2023-12-01T01:07:12.094 INFO:teuthology.orchestra.run.smithi026.stdout: "subtrees": 3, 2023-12-01T01:07:12.094 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse": 7562, 2023-12-01T01:07:12.094 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_hit": 6408, 2023-12-01T01:07:12.094 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_forward": 1, 2023-12-01T01:07:12.094 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_discover": 966, 2023-12-01T01:07:12.094 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_dir_fetch": 0, 2023-12-01T01:07:12.095 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_remote_ino": 0, 2023-12-01T01:07:12.095 INFO:teuthology.orchestra.run.smithi026.stdout: "traverse_lock": 0, 2023-12-01T01:07:12.095 INFO:teuthology.orchestra.run.smithi026.stdout: "load_cent": 109, 2023-12-01T01:07:12.096 INFO:teuthology.orchestra.run.smithi026.stdout: "q": 0, 2023-12-01T01:07:12.096 INFO:teuthology.orchestra.run.smithi026.stdout: "exported": 5, 2023-12-01T01:07:12.096 INFO:teuthology.orchestra.run.smithi026.stdout: "exported_inodes": 166, 2023-12-01T01:07:12.096 INFO:teuthology.orchestra.run.smithi026.stdout: "imported": 5, 2023-12-01T01:07:12.096 INFO:teuthology.orchestra.run.smithi026.stdout: "imported_inodes": 3018, 2023-12-01T01:07:12.096 INFO:teuthology.orchestra.run.smithi026.stdout: "openino_dir_fetch": 0, 2023-12-01T01:07:12.096 INFO:teuthology.orchestra.run.smithi026.stdout: "openino_backtrace_fetch": 0, 2023-12-01T01:07:12.096 INFO:teuthology.orchestra.run.smithi026.stdout: "openino_peer_discover": 0, 2023-12-01T01:07:12.096 INFO:teuthology.orchestra.run.smithi026.stdout: "root_rfiles": 3713, 2023-12-01T01:07:12.096 INFO:teuthology.orchestra.run.smithi026.stdout: "root_rbytes": 97765335, 2023-12-01T01:07:12.096 INFO:teuthology.orchestra.run.smithi026.stdout: "root_rsnaps": 0, 2023-12-01T01:07:12.096 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_backtrace_fetch": 0, 2023-12-01T01:07:12.096 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_set_tag": 0, 2023-12-01T01:07:12.096 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_backtrace_repaired": 0, 2023-12-01T01:07:12.097 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_inotable_repaired": 0, 2023-12-01T01:07:12.097 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_dir_inodes": 0, 2023-12-01T01:07:12.097 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_dir_base_inodes": 0, 2023-12-01T01:07:12.097 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_dirfrag_rstats": 0, 2023-12-01T01:07:12.098 INFO:teuthology.orchestra.run.smithi026.stdout: "scrub_file_inodes": 0, 2023-12-01T01:07:12.098 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_inode_file_caps": 0, 2023-12-01T01:07:12.098 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_revoke": 399, 2023-12-01T01:07:12.098 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_grant": 5428, 2023-12-01T01:07:12.098 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_trunc": 0, 2023-12-01T01:07:12.098 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-01T01:07:12.098 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-01T01:07:12.098 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_caps": 2679, 2023-12-01T01:07:12.099 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_caps_dirty": 1986, 2023-12-01T01:07:12.099 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_cap_release": 227, 2023-12-01T01:07:12.099 INFO:teuthology.orchestra.run.smithi026.stdout: "process_request_cap_release": 4151 2023-12-01T01:07:12.099 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.099 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_cache": { 2023-12-01T01:07:12.099 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_update": 86, 2023-12-01T01:07:12.099 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_update_receipt": 2348, 2023-12-01T01:07:12.099 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_try_discover": 1648, 2023-12-01T01:07:12.099 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_send_discover": 1295, 2023-12-01T01:07:12.099 INFO:teuthology.orchestra.run.smithi026.stdout: "dir_handle_discover": 142, 2023-12-01T01:07:12.099 INFO:teuthology.orchestra.run.smithi026.stdout: "num_strays": 0, 2023-12-01T01:07:12.099 INFO:teuthology.orchestra.run.smithi026.stdout: "num_strays_delayed": 0, 2023-12-01T01:07:12.099 INFO:teuthology.orchestra.run.smithi026.stdout: "num_strays_enqueuing": 0, 2023-12-01T01:07:12.099 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_created": 3900, 2023-12-01T01:07:12.099 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_enqueued": 3900, 2023-12-01T01:07:12.100 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_reintegrated": 0, 2023-12-01T01:07:12.100 INFO:teuthology.orchestra.run.smithi026.stdout: "strays_migrated": 0, 2023-12-01T01:07:12.100 INFO:teuthology.orchestra.run.smithi026.stdout: "num_recovering_processing": 0, 2023-12-01T01:07:12.100 INFO:teuthology.orchestra.run.smithi026.stdout: "num_recovering_enqueued": 0, 2023-12-01T01:07:12.100 INFO:teuthology.orchestra.run.smithi026.stdout: "num_recovering_prioritized": 0, 2023-12-01T01:07:12.100 INFO:teuthology.orchestra.run.smithi026.stdout: "recovery_started": 0, 2023-12-01T01:07:12.100 INFO:teuthology.orchestra.run.smithi026.stdout: "recovery_completed": 0, 2023-12-01T01:07:12.100 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_enqueue_scrub": 0, 2023-12-01T01:07:12.100 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_exportdir": 5, 2023-12-01T01:07:12.100 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_flush": 0, 2023-12-01T01:07:12.100 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_fragmentdir": 0, 2023-12-01T01:07:12.100 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_fragstats": 0, 2023-12-01T01:07:12.100 INFO:teuthology.orchestra.run.smithi026.stdout: "ireq_inodestats": 0 2023-12-01T01:07:12.100 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.101 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_log": { 2023-12-01T01:07:12.101 INFO:teuthology.orchestra.run.smithi026.stdout: "evadd": 11598, 2023-12-01T01:07:12.101 INFO:teuthology.orchestra.run.smithi026.stdout: "evex": 0, 2023-12-01T01:07:12.101 INFO:teuthology.orchestra.run.smithi026.stdout: "evtrm": 0, 2023-12-01T01:07:12.101 INFO:teuthology.orchestra.run.smithi026.stdout: "ev": 11598, 2023-12-01T01:07:12.101 INFO:teuthology.orchestra.run.smithi026.stdout: "evexg": 0, 2023-12-01T01:07:12.101 INFO:teuthology.orchestra.run.smithi026.stdout: "evexd": 0, 2023-12-01T01:07:12.101 INFO:teuthology.orchestra.run.smithi026.stdout: "segadd": 14, 2023-12-01T01:07:12.101 INFO:teuthology.orchestra.run.smithi026.stdout: "segex": 0, 2023-12-01T01:07:12.101 INFO:teuthology.orchestra.run.smithi026.stdout: "segtrm": 0, 2023-12-01T01:07:12.101 INFO:teuthology.orchestra.run.smithi026.stdout: "seg": 14, 2023-12-01T01:07:12.101 INFO:teuthology.orchestra.run.smithi026.stdout: "segexg": 0, 2023-12-01T01:07:12.101 INFO:teuthology.orchestra.run.smithi026.stdout: "segexd": 0, 2023-12-01T01:07:12.101 INFO:teuthology.orchestra.run.smithi026.stdout: "expos": 4194304, 2023-12-01T01:07:12.102 INFO:teuthology.orchestra.run.smithi026.stdout: "wrpos": 29341933, 2023-12-01T01:07:12.102 INFO:teuthology.orchestra.run.smithi026.stdout: "rdpos": 0, 2023-12-01T01:07:12.102 INFO:teuthology.orchestra.run.smithi026.stdout: "jlat": { 2023-12-01T01:07:12.102 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 265, 2023-12-01T01:07:12.102 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 4.357574168, 2023-12-01T01:07:12.102 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.016443676 2023-12-01T01:07:12.102 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.102 INFO:teuthology.orchestra.run.smithi026.stdout: "replayed": 0 2023-12-01T01:07:12.102 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.102 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_mem": { 2023-12-01T01:07:12.102 INFO:teuthology.orchestra.run.smithi026.stdout: "ino": 21, 2023-12-01T01:07:12.102 INFO:teuthology.orchestra.run.smithi026.stdout: "ino+": 4360, 2023-12-01T01:07:12.102 INFO:teuthology.orchestra.run.smithi026.stdout: "ino-": 4339, 2023-12-01T01:07:12.102 INFO:teuthology.orchestra.run.smithi026.stdout: "dir": 19, 2023-12-01T01:07:12.103 INFO:teuthology.orchestra.run.smithi026.stdout: "dir+": 730, 2023-12-01T01:07:12.103 INFO:teuthology.orchestra.run.smithi026.stdout: "dir-": 711, 2023-12-01T01:07:12.103 INFO:teuthology.orchestra.run.smithi026.stdout: "dn": 16, 2023-12-01T01:07:12.103 INFO:teuthology.orchestra.run.smithi026.stdout: "dn+": 7753, 2023-12-01T01:07:12.103 INFO:teuthology.orchestra.run.smithi026.stdout: "dn-": 7737, 2023-12-01T01:07:12.103 INFO:teuthology.orchestra.run.smithi026.stdout: "cap": 1, 2023-12-01T01:07:12.103 INFO:teuthology.orchestra.run.smithi026.stdout: "cap+": 3903, 2023-12-01T01:07:12.103 INFO:teuthology.orchestra.run.smithi026.stdout: "cap-": 3902, 2023-12-01T01:07:12.103 INFO:teuthology.orchestra.run.smithi026.stdout: "rss": 75372, 2023-12-01T01:07:12.103 INFO:teuthology.orchestra.run.smithi026.stdout: "heap": 198964 2023-12-01T01:07:12.103 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.103 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_server": { 2023-12-01T01:07:12.103 INFO:teuthology.orchestra.run.smithi026.stdout: "dispatch_client_request": 6600, 2023-12-01T01:07:12.103 INFO:teuthology.orchestra.run.smithi026.stdout: "dispatch_server_request": 2, 2023-12-01T01:07:12.103 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_request": 5388, 2023-12-01T01:07:12.103 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_client_session": 7, 2023-12-01T01:07:12.104 INFO:teuthology.orchestra.run.smithi026.stdout: "handle_peer_request": 12, 2023-12-01T01:07:12.104 INFO:teuthology.orchestra.run.smithi026.stdout: "req_create_latency": { 2023-12-01T01:07:12.104 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 1060, 2023-12-01T01:07:12.104 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 1.904338659, 2023-12-01T01:07:12.104 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.001796545 2023-12-01T01:07:12.104 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.104 INFO:teuthology.orchestra.run.smithi026.stdout: "req_getattr_latency": { 2023-12-01T01:07:12.104 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.104 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.104 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.104 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.104 INFO:teuthology.orchestra.run.smithi026.stdout: "req_getfilelock_latency": { 2023-12-01T01:07:12.104 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.104 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.105 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.105 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.105 INFO:teuthology.orchestra.run.smithi026.stdout: "req_link_latency": { 2023-12-01T01:07:12.106 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.106 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.106 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.107 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.107 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookup_latency": { 2023-12-01T01:07:12.107 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 338, 2023-12-01T01:07:12.107 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.209025715, 2023-12-01T01:07:12.107 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000618419 2023-12-01T01:07:12.107 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.107 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookuphash_latency": { 2023-12-01T01:07:12.107 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.107 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.107 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.107 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.107 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupino_latency": { 2023-12-01T01:07:12.107 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 1, 2023-12-01T01:07:12.107 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000157692, 2023-12-01T01:07:12.108 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000157692 2023-12-01T01:07:12.108 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.108 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupname_latency": { 2023-12-01T01:07:12.108 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.108 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.108 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.108 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.108 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupparent_latency": { 2023-12-01T01:07:12.108 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.108 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.108 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.108 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.108 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lookupsnap_latency": { 2023-12-01T01:07:12.108 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.109 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.109 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.109 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.109 INFO:teuthology.orchestra.run.smithi026.stdout: "req_lssnap_latency": { 2023-12-01T01:07:12.109 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.109 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.109 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.109 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.109 INFO:teuthology.orchestra.run.smithi026.stdout: "req_mkdir_latency": { 2023-12-01T01:07:12.109 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.109 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.109 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.109 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.109 INFO:teuthology.orchestra.run.smithi026.stdout: "req_mknod_latency": { 2023-12-01T01:07:12.110 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.110 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.110 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.110 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.110 INFO:teuthology.orchestra.run.smithi026.stdout: "req_mksnap_latency": { 2023-12-01T01:07:12.110 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.110 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.110 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.110 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.110 INFO:teuthology.orchestra.run.smithi026.stdout: "req_open_latency": { 2023-12-01T01:07:12.110 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.110 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.110 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.111 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.111 INFO:teuthology.orchestra.run.smithi026.stdout: "req_readdir_latency": { 2023-12-01T01:07:12.111 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 88, 2023-12-01T01:07:12.111 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.172146276, 2023-12-01T01:07:12.111 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.001956207 2023-12-01T01:07:12.111 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.111 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rename_latency": { 2023-12-01T01:07:12.111 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.111 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.111 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.111 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.111 INFO:teuthology.orchestra.run.smithi026.stdout: "req_renamesnap_latency": { 2023-12-01T01:07:12.111 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.111 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.111 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.112 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.112 INFO:teuthology.orchestra.run.smithi026.stdout: "req_snapdiff_latency": { 2023-12-01T01:07:12.112 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.112 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.112 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.112 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.112 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rmdir_latency": { 2023-12-01T01:07:12.112 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 195, 2023-12-01T01:07:12.112 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 9.980090997, 2023-12-01T01:07:12.112 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.051179953 2023-12-01T01:07:12.112 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.112 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rmsnap_latency": { 2023-12-01T01:07:12.112 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.112 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.113 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.113 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.113 INFO:teuthology.orchestra.run.smithi026.stdout: "req_rmxattr_latency": { 2023-12-01T01:07:12.113 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.113 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.113 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.113 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.113 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setattr_latency": { 2023-12-01T01:07:12.113 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.113 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.113 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.113 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.113 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setdirlayout_latency": { 2023-12-01T01:07:12.113 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.113 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.114 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.114 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.114 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setfilelock_latency": { 2023-12-01T01:07:12.114 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.114 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.114 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.114 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.114 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setlayout_latency": { 2023-12-01T01:07:12.114 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.114 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.114 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.114 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.114 INFO:teuthology.orchestra.run.smithi026.stdout: "req_setxattr_latency": { 2023-12-01T01:07:12.114 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.114 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.115 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.115 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.115 INFO:teuthology.orchestra.run.smithi026.stdout: "req_symlink_latency": { 2023-12-01T01:07:12.115 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.115 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.115 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.115 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.115 INFO:teuthology.orchestra.run.smithi026.stdout: "req_unlink_latency": { 2023-12-01T01:07:12.115 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 3705, 2023-12-01T01:07:12.115 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 8.857102247, 2023-12-01T01:07:12.115 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.002390580 2023-12-01T01:07:12.115 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.115 INFO:teuthology.orchestra.run.smithi026.stdout: "cap_revoke_eviction": 0, 2023-12-01T01:07:12.115 INFO:teuthology.orchestra.run.smithi026.stdout: "cap_acquisition_throttle": 0, 2023-12-01T01:07:12.115 INFO:teuthology.orchestra.run.smithi026.stdout: "req_getvxattr_latency": { 2023-12-01T01:07:12.116 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.116 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.116 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.116 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:12.116 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.116 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_sessions": { 2023-12-01T01:07:12.116 INFO:teuthology.orchestra.run.smithi026.stdout: "session_count": 1, 2023-12-01T01:07:12.116 INFO:teuthology.orchestra.run.smithi026.stdout: "session_add": 2, 2023-12-01T01:07:12.116 INFO:teuthology.orchestra.run.smithi026.stdout: "session_remove": 1, 2023-12-01T01:07:12.116 INFO:teuthology.orchestra.run.smithi026.stdout: "sessions_open": 1, 2023-12-01T01:07:12.116 INFO:teuthology.orchestra.run.smithi026.stdout: "sessions_stale": 0, 2023-12-01T01:07:12.116 INFO:teuthology.orchestra.run.smithi026.stdout: "total_load": 3872, 2023-12-01T01:07:12.116 INFO:teuthology.orchestra.run.smithi026.stdout: "average_load": 3872, 2023-12-01T01:07:12.116 INFO:teuthology.orchestra.run.smithi026.stdout: "avg_session_uptime": 181, 2023-12-01T01:07:12.117 INFO:teuthology.orchestra.run.smithi026.stdout: "mdthresh_evicted": 0 2023-12-01T01:07:12.117 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.117 INFO:teuthology.orchestra.run.smithi026.stdout: "mempool": { 2023-12-01T01:07:12.117 INFO:teuthology.orchestra.run.smithi026.stdout: "bloom_filter_bytes": 0, 2023-12-01T01:07:12.117 INFO:teuthology.orchestra.run.smithi026.stdout: "bloom_filter_items": 0, 2023-12-01T01:07:12.117 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_alloc_bytes": 0, 2023-12-01T01:07:12.117 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_alloc_items": 0, 2023-12-01T01:07:12.117 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_data_bytes": 0, 2023-12-01T01:07:12.117 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_data_items": 0, 2023-12-01T01:07:12.117 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-01T01:07:12.117 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_onode_items": 0, 2023-12-01T01:07:12.117 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-01T01:07:12.117 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_meta_items": 0, 2023-12-01T01:07:12.117 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_other_bytes": 0, 2023-12-01T01:07:12.117 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_other_items": 0, 2023-12-01T01:07:12.118 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-01T01:07:12.118 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_buffer_items": 0, 2023-12-01T01:07:12.118 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_extent_bytes": 0, 2023-12-01T01:07:12.118 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_extent_items": 0, 2023-12-01T01:07:12.118 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_blob_bytes": 0, 2023-12-01T01:07:12.118 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_blob_items": 0, 2023-12-01T01:07:12.118 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-01T01:07:12.118 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_shared_blob_items": 0, 2023-12-01T01:07:12.118 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-01T01:07:12.118 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_inline_bl_items": 0, 2023-12-01T01:07:12.118 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_fsck_bytes": 0, 2023-12-01T01:07:12.118 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_fsck_items": 0, 2023-12-01T01:07:12.118 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_txc_bytes": 0, 2023-12-01T01:07:12.118 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_txc_items": 0, 2023-12-01T01:07:12.118 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-01T01:07:12.119 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_deferred_items": 0, 2023-12-01T01:07:12.119 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_bytes": 0, 2023-12-01T01:07:12.119 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_items": 0, 2023-12-01T01:07:12.119 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_bytes": 0, 2023-12-01T01:07:12.119 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_items": 0, 2023-12-01T01:07:12.119 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_reader_bytes": 0, 2023-12-01T01:07:12.119 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_reader_items": 0, 2023-12-01T01:07:12.119 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_writer_bytes": 0, 2023-12-01T01:07:12.119 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_writer_items": 0, 2023-12-01T01:07:12.119 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_anon_bytes": 298225, 2023-12-01T01:07:12.119 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_anon_items": 116, 2023-12-01T01:07:12.119 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_meta_bytes": 176, 2023-12-01T01:07:12.119 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_meta_items": 2, 2023-12-01T01:07:12.119 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_bytes": 0, 2023-12-01T01:07:12.120 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_items": 0, 2023-12-01T01:07:12.120 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_mapbl_bytes": 0, 2023-12-01T01:07:12.120 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_mapbl_items": 0, 2023-12-01T01:07:12.120 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_pglog_bytes": 0, 2023-12-01T01:07:12.120 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_pglog_items": 0, 2023-12-01T01:07:12.120 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_bytes": 7528, 2023-12-01T01:07:12.120 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_items": 158, 2023-12-01T01:07:12.120 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_mapping_bytes": 0, 2023-12-01T01:07:12.120 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_mapping_items": 0, 2023-12-01T01:07:12.120 INFO:teuthology.orchestra.run.smithi026.stdout: "pgmap_bytes": 0, 2023-12-01T01:07:12.120 INFO:teuthology.orchestra.run.smithi026.stdout: "pgmap_items": 0, 2023-12-01T01:07:12.120 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_co_bytes": 82661, 2023-12-01T01:07:12.121 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_co_items": 416, 2023-12-01T01:07:12.121 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_1_bytes": 0, 2023-12-01T01:07:12.121 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_1_items": 0, 2023-12-01T01:07:12.121 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_2_bytes": 0, 2023-12-01T01:07:12.121 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_2_items": 0 2023-12-01T01:07:12.121 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.121 INFO:teuthology.orchestra.run.smithi026.stdout: "objecter": { 2023-12-01T01:07:12.121 INFO:teuthology.orchestra.run.smithi026.stdout: "op_active": 0, 2023-12-01T01:07:12.121 INFO:teuthology.orchestra.run.smithi026.stdout: "op_laggy": 0, 2023-12-01T01:07:12.121 INFO:teuthology.orchestra.run.smithi026.stdout: "op_send": 4449, 2023-12-01T01:07:12.121 INFO:teuthology.orchestra.run.smithi026.stdout: "op_send_bytes": 26003137, 2023-12-01T01:07:12.121 INFO:teuthology.orchestra.run.smithi026.stdout: "op_resend": 27, 2023-12-01T01:07:12.121 INFO:teuthology.orchestra.run.smithi026.stdout: "op_reply": 4449, 2023-12-01T01:07:12.121 INFO:teuthology.orchestra.run.smithi026.stdout: "op_latency": { 2023-12-01T01:07:12.121 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 4449, 2023-12-01T01:07:12.122 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 12.733809244, 2023-12-01T01:07:12.122 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.002862173 2023-12-01T01:07:12.122 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.122 INFO:teuthology.orchestra.run.smithi026.stdout: "op_inflight": 0, 2023-12-01T01:07:12.122 INFO:teuthology.orchestra.run.smithi026.stdout: "oplen_avg": { 2023-12-01T01:07:12.122 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 4449, 2023-12-01T01:07:12.122 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 4492 2023-12-01T01:07:12.122 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.122 INFO:teuthology.orchestra.run.smithi026.stdout: "op": 4449, 2023-12-01T01:07:12.122 INFO:teuthology.orchestra.run.smithi026.stdout: "op_r": 78, 2023-12-01T01:07:12.122 INFO:teuthology.orchestra.run.smithi026.stdout: "op_w": 4371, 2023-12-01T01:07:12.122 INFO:teuthology.orchestra.run.smithi026.stdout: "op_rmw": 0, 2023-12-01T01:07:12.122 INFO:teuthology.orchestra.run.smithi026.stdout: "op_pg": 0, 2023-12-01T01:07:12.122 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_stat": 0, 2023-12-01T01:07:12.123 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_create": 10, 2023-12-01T01:07:12.123 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_read": 78, 2023-12-01T01:07:12.123 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_write": 343, 2023-12-01T01:07:12.123 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_writefull": 43, 2023-12-01T01:07:12.123 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_writesame": 0, 2023-12-01T01:07:12.123 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_append": 0, 2023-12-01T01:07:12.123 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_zero": 0, 2023-12-01T01:07:12.123 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_truncate": 0, 2023-12-01T01:07:12.123 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_delete": 3949, 2023-12-01T01:07:12.123 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_mapext": 0, 2023-12-01T01:07:12.123 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_sparse_read": 0, 2023-12-01T01:07:12.123 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_clonerange": 0, 2023-12-01T01:07:12.123 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_getxattr": 0, 2023-12-01T01:07:12.123 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_setxattr": 20, 2023-12-01T01:07:12.123 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_cmpxattr": 0, 2023-12-01T01:07:12.124 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_rmxattr": 0, 2023-12-01T01:07:12.124 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_resetxattrs": 0, 2023-12-01T01:07:12.124 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_call": 0, 2023-12-01T01:07:12.124 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_watch": 0, 2023-12-01T01:07:12.124 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_notify": 0, 2023-12-01T01:07:12.124 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_src_cmpxattr": 0, 2023-12-01T01:07:12.124 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_pgls": 0, 2023-12-01T01:07:12.124 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_pgls_filter": 0, 2023-12-01T01:07:12.124 INFO:teuthology.orchestra.run.smithi026.stdout: "osdop_other": 0, 2023-12-01T01:07:12.124 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_active": 0, 2023-12-01T01:07:12.124 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_send": 0, 2023-12-01T01:07:12.124 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_resend": 0, 2023-12-01T01:07:12.124 INFO:teuthology.orchestra.run.smithi026.stdout: "linger_ping": 0, 2023-12-01T01:07:12.124 INFO:teuthology.orchestra.run.smithi026.stdout: "poolop_active": 0, 2023-12-01T01:07:12.124 INFO:teuthology.orchestra.run.smithi026.stdout: "poolop_send": 0, 2023-12-01T01:07:12.125 INFO:teuthology.orchestra.run.smithi026.stdout: "poolop_resend": 0, 2023-12-01T01:07:12.125 INFO:teuthology.orchestra.run.smithi026.stdout: "poolstat_active": 0, 2023-12-01T01:07:12.125 INFO:teuthology.orchestra.run.smithi026.stdout: "poolstat_send": 0, 2023-12-01T01:07:12.125 INFO:teuthology.orchestra.run.smithi026.stdout: "poolstat_resend": 0, 2023-12-01T01:07:12.125 INFO:teuthology.orchestra.run.smithi026.stdout: "statfs_active": 0, 2023-12-01T01:07:12.125 INFO:teuthology.orchestra.run.smithi026.stdout: "statfs_send": 0, 2023-12-01T01:07:12.125 INFO:teuthology.orchestra.run.smithi026.stdout: "statfs_resend": 0, 2023-12-01T01:07:12.125 INFO:teuthology.orchestra.run.smithi026.stdout: "command_active": 0, 2023-12-01T01:07:12.125 INFO:teuthology.orchestra.run.smithi026.stdout: "command_send": 0, 2023-12-01T01:07:12.125 INFO:teuthology.orchestra.run.smithi026.stdout: "command_resend": 0, 2023-12-01T01:07:12.125 INFO:teuthology.orchestra.run.smithi026.stdout: "map_epoch": 84, 2023-12-01T01:07:12.125 INFO:teuthology.orchestra.run.smithi026.stdout: "map_full": 0, 2023-12-01T01:07:12.125 INFO:teuthology.orchestra.run.smithi026.stdout: "map_inc": 3, 2023-12-01T01:07:12.125 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_sessions": 12, 2023-12-01T01:07:12.125 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_session_open": 12, 2023-12-01T01:07:12.125 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_session_close": 0, 2023-12-01T01:07:12.126 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_laggy": 0, 2023-12-01T01:07:12.126 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_wr": 38, 2023-12-01T01:07:12.126 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_rd": 0, 2023-12-01T01:07:12.126 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_del": 11 2023-12-01T01:07:12.126 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.126 INFO:teuthology.orchestra.run.smithi026.stdout: "oft": { 2023-12-01T01:07:12.126 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_objs": 1, 2023-12-01T01:07:12.126 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_kv_pairs": 0, 2023-12-01T01:07:12.126 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_updates": 0, 2023-12-01T01:07:12.126 INFO:teuthology.orchestra.run.smithi026.stdout: "omap_total_removes": 0 2023-12-01T01:07:12.126 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.126 INFO:teuthology.orchestra.run.smithi026.stdout: "osd-slow-ops": { 2023-12-01T01:07:12.126 INFO:teuthology.orchestra.run.smithi026.stdout: "slow_ops_count": 5395 2023-12-01T01:07:12.126 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.127 INFO:teuthology.orchestra.run.smithi026.stdout: "purge_queue": { 2023-12-01T01:07:12.127 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing_ops": 0, 2023-12-01T01:07:12.127 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing_ops_high_water": 18, 2023-12-01T01:07:12.127 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing": 0, 2023-12-01T01:07:12.127 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executing_high_water": 10, 2023-12-01T01:07:12.127 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_executed": 3900, 2023-12-01T01:07:12.127 INFO:teuthology.orchestra.run.smithi026.stdout: "pq_item_in_journal": 0 2023-12-01T01:07:12.127 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.127 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-01T01:07:12.127 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2023-12-01T01:07:12.127 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 104857600, 2023-12-01T01:07:12.127 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2023-12-01T01:07:12.127 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 80923, 2023-12-01T01:07:12.127 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 13922008, 2023-12-01T01:07:12.127 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:12.128 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 80923, 2023-12-01T01:07:12.128 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2023-12-01T01:07:12.128 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2023-12-01T01:07:12.128 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 80923, 2023-12-01T01:07:12.128 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 13922008, 2023-12-01T01:07:12.128 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2023-12-01T01:07:12.128 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.128 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.128 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.128 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:12.128 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.128 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-objecter_bytes": { 2023-12-01T01:07:12.128 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2023-12-01T01:07:12.128 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 104857600, 2023-12-01T01:07:12.128 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2023-12-01T01:07:12.129 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 0, 2023-12-01T01:07:12.129 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 0, 2023-12-01T01:07:12.129 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:12.129 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:12.129 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 4449, 2023-12-01T01:07:12.129 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 26397069, 2023-12-01T01:07:12.129 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 4449, 2023-12-01T01:07:12.129 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 26397069, 2023-12-01T01:07:12.129 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2023-12-01T01:07:12.129 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.129 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.129 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.129 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:12.129 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.130 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-objecter_ops": { 2023-12-01T01:07:12.130 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2023-12-01T01:07:12.130 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 1024, 2023-12-01T01:07:12.130 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2023-12-01T01:07:12.130 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 0, 2023-12-01T01:07:12.130 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 0, 2023-12-01T01:07:12.130 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:12.130 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:12.130 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 4449, 2023-12-01T01:07:12.130 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 4449, 2023-12-01T01:07:12.130 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 4449, 2023-12-01T01:07:12.130 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 4449, 2023-12-01T01:07:12.130 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2023-12-01T01:07:12.130 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.131 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.131 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.131 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:12.131 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.131 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-write_buf_throttle": { 2023-12-01T01:07:12.131 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2023-12-01T01:07:12.131 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 3758096384, 2023-12-01T01:07:12.131 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2023-12-01T01:07:12.131 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 3900, 2023-12-01T01:07:12.131 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 393932, 2023-12-01T01:07:12.131 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:12.132 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 3900, 2023-12-01T01:07:12.132 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2023-12-01T01:07:12.132 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2023-12-01T01:07:12.132 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 78, 2023-12-01T01:07:12.132 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 393932, 2023-12-01T01:07:12.132 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2023-12-01T01:07:12.132 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.132 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.132 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.132 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:12.132 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:12.132 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-write_buf_throttle-0x5621daa340a0": { 2023-12-01T01:07:12.132 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2023-12-01T01:07:12.132 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 3758096384, 2023-12-01T01:07:12.133 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2023-12-01T01:07:12.133 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 11598, 2023-12-01T01:07:12.133 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 25147629, 2023-12-01T01:07:12.133 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:12.133 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 11598, 2023-12-01T01:07:12.133 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2023-12-01T01:07:12.133 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2023-12-01T01:07:12.133 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 265, 2023-12-01T01:07:12.133 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 25147629, 2023-12-01T01:07:12.133 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2023-12-01T01:07:12.133 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:12.133 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:12.133 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:12.133 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:12.133 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:12.134 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:07:12.134 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:11 smithi026 ceph-mon[98801]: pgmap v380: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.6 KiB/s wr, 9 op/s 2023-12-01T01:07:12.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:11 smithi116 ceph-mon[103554]: pgmap v380: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.6 KiB/s wr, 9 op/s 2023-12-01T01:07:12.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:11 smithi093 ceph-mon[103327]: pgmap v380: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.6 KiB/s wr, 9 op/s 2023-12-01T01:07:12.491 INFO:tasks.check_counter:Daemon mds.g mds.exported=5 2023-12-01T01:07:12.492 INFO:tasks.check_counter:Daemon mds.g mds.imported=5 2023-12-01T01:07:12.492 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=86 2023-12-01T01:07:12.492 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=2348 2023-12-01T01:07:12.492 DEBUG:tasks.check_counter:Getting stats from j 2023-12-01T01:07:12.492 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph daemon mds.j perf dump 2023-12-01T01:07:13.051 INFO:teuthology.orchestra.run.smithi026.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.a/config 2023-12-01T01:07:14.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:13 smithi026 ceph-mon[98801]: pgmap v381: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-12-01T01:07:14.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:13 smithi116 ceph-mon[103554]: pgmap v381: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-12-01T01:07:14.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:13 smithi093 ceph-mon[103327]: pgmap v381: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2023-12-01T01:07:14.379 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2023-12-01T01:07:14.379 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-0": { 2023-12-01T01:07:14.379 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 0, 2023-12-01T01:07:14.379 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 2, 2023-12-01T01:07:14.379 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 0, 2023-12-01T01:07:14.379 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 0, 2023-12-01T01:07:14.380 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 4, 2023-12-01T01:07:14.380 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 0, 2023-12-01T01:07:14.380 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.001349563, 2023-12-01T01:07:14.380 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.000000000, 2023-12-01T01:07:14.380 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.000279916, 2023-12-01T01:07:14.380 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-01T01:07:14.380 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:14.380 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:14.380 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:14.380 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:14.380 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:14.380 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:14.380 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:14.381 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:14.381 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:14.381 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:14.381 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-01T01:07:14.381 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 0 2023-12-01T01:07:14.381 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:14.381 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-1": { 2023-12-01T01:07:14.381 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 89, 2023-12-01T01:07:14.381 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 84, 2023-12-01T01:07:14.381 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 434240, 2023-12-01T01:07:14.381 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 46336, 2023-12-01T01:07:14.381 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 2, 2023-12-01T01:07:14.381 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 1, 2023-12-01T01:07:14.381 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.015132428, 2023-12-01T01:07:14.381 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.004654669, 2023-12-01T01:07:14.382 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.011561978, 2023-12-01T01:07:14.382 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.001830526, 2023-12-01T01:07:14.382 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:14.382 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 84, 2023-12-01T01:07:14.382 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.004942699, 2023-12-01T01:07:14.382 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000058841 2023-12-01T01:07:14.382 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:14.382 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:14.382 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:14.382 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:14.382 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:14.382 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:14.382 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 434240, 2023-12-01T01:07:14.383 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 46336 2023-12-01T01:07:14.383 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:14.383 INFO:teuthology.orchestra.run.smithi026.stdout: "AsyncMessenger::Worker-2": { 2023-12-01T01:07:14.383 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_messages": 1, 2023-12-01T01:07:14.383 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages": 62, 2023-12-01T01:07:14.383 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_bytes": 160, 2023-12-01T01:07:14.383 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_bytes": 86864, 2023-12-01T01:07:14.383 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_created_connections": 3, 2023-12-01T01:07:14.383 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_active_connections": 2, 2023-12-01T01:07:14.384 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_total_time": 0.005007387, 2023-12-01T01:07:14.384 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_send_time": 0.003113243, 2023-12-01T01:07:14.384 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_recv_time": 0.001197823, 2023-12-01T01:07:14.384 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-01T01:07:14.384 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:14.384 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 60, 2023-12-01T01:07:14.384 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.003270875, 2023-12-01T01:07:14.384 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000054514 2023-12-01T01:07:14.384 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-01T01:07:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: "msgr_send_encrypted_bytes": 86864 2023-12-01T01:07:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: "cct": { 2023-12-01T01:07:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: "total_workers": 0, 2023-12-01T01:07:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: "unhealthy_workers": 0 2023-12-01T01:07:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:14.385 INFO:teuthology.orchestra.run.smithi026.stdout: "mempool": { 2023-12-01T01:07:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: "bloom_filter_bytes": 0, 2023-12-01T01:07:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: "bloom_filter_items": 0, 2023-12-01T01:07:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_alloc_bytes": 0, 2023-12-01T01:07:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_alloc_items": 0, 2023-12-01T01:07:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_data_bytes": 0, 2023-12-01T01:07:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_data_items": 0, 2023-12-01T01:07:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-01T01:07:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_onode_items": 0, 2023-12-01T01:07:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-01T01:07:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_meta_items": 0, 2023-12-01T01:07:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_other_bytes": 0, 2023-12-01T01:07:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_other_items": 0, 2023-12-01T01:07:14.386 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-01T01:07:14.387 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_cache_buffer_items": 0, 2023-12-01T01:07:14.387 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_extent_bytes": 0, 2023-12-01T01:07:14.387 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_extent_items": 0, 2023-12-01T01:07:14.387 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_blob_bytes": 0, 2023-12-01T01:07:14.387 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_blob_items": 0, 2023-12-01T01:07:14.387 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-01T01:07:14.387 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_shared_blob_items": 0, 2023-12-01T01:07:14.387 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-01T01:07:14.387 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_inline_bl_items": 0, 2023-12-01T01:07:14.387 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_fsck_bytes": 0, 2023-12-01T01:07:14.388 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_fsck_items": 0, 2023-12-01T01:07:14.388 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_txc_bytes": 0, 2023-12-01T01:07:14.388 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_txc_items": 0, 2023-12-01T01:07:14.388 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-01T01:07:14.388 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_deferred_items": 0, 2023-12-01T01:07:14.388 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_bytes": 0, 2023-12-01T01:07:14.388 INFO:teuthology.orchestra.run.smithi026.stdout: "bluestore_writing_items": 0, 2023-12-01T01:07:14.388 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_bytes": 0, 2023-12-01T01:07:14.388 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_items": 0, 2023-12-01T01:07:14.388 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_reader_bytes": 0, 2023-12-01T01:07:14.388 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_reader_items": 0, 2023-12-01T01:07:14.389 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_writer_bytes": 0, 2023-12-01T01:07:14.389 INFO:teuthology.orchestra.run.smithi026.stdout: "bluefs_file_writer_items": 0, 2023-12-01T01:07:14.389 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_anon_bytes": 148863, 2023-12-01T01:07:14.389 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_anon_items": 28, 2023-12-01T01:07:14.389 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_meta_bytes": 0, 2023-12-01T01:07:14.389 INFO:teuthology.orchestra.run.smithi026.stdout: "buffer_meta_items": 0, 2023-12-01T01:07:14.389 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_bytes": 0, 2023-12-01T01:07:14.389 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_items": 0, 2023-12-01T01:07:14.389 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_mapbl_bytes": 0, 2023-12-01T01:07:14.389 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_mapbl_items": 0, 2023-12-01T01:07:14.389 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_pglog_bytes": 0, 2023-12-01T01:07:14.389 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_pglog_items": 0, 2023-12-01T01:07:14.389 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_bytes": 0, 2023-12-01T01:07:14.389 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_items": 0, 2023-12-01T01:07:14.390 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_mapping_bytes": 0, 2023-12-01T01:07:14.390 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_mapping_items": 0, 2023-12-01T01:07:14.390 INFO:teuthology.orchestra.run.smithi026.stdout: "pgmap_bytes": 0, 2023-12-01T01:07:14.390 INFO:teuthology.orchestra.run.smithi026.stdout: "pgmap_items": 0, 2023-12-01T01:07:14.390 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_co_bytes": 928, 2023-12-01T01:07:14.390 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_co_items": 2, 2023-12-01T01:07:14.390 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_1_bytes": 0, 2023-12-01T01:07:14.390 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_1_items": 0, 2023-12-01T01:07:14.390 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_2_bytes": 0, 2023-12-01T01:07:14.390 INFO:teuthology.orchestra.run.smithi026.stdout: "unittest_2_items": 0 2023-12-01T01:07:14.390 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2023-12-01T01:07:14.390 INFO:teuthology.orchestra.run.smithi026.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-01T01:07:14.391 INFO:teuthology.orchestra.run.smithi026.stdout: "val": 0, 2023-12-01T01:07:14.391 INFO:teuthology.orchestra.run.smithi026.stdout: "max": 104857600, 2023-12-01T01:07:14.391 INFO:teuthology.orchestra.run.smithi026.stdout: "get_started": 0, 2023-12-01T01:07:14.391 INFO:teuthology.orchestra.run.smithi026.stdout: "get": 86, 2023-12-01T01:07:14.391 INFO:teuthology.orchestra.run.smithi026.stdout: "get_sum": 419281, 2023-12-01T01:07:14.391 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:14.391 INFO:teuthology.orchestra.run.smithi026.stdout: "get_or_fail_success": 86, 2023-12-01T01:07:14.391 INFO:teuthology.orchestra.run.smithi026.stdout: "take": 0, 2023-12-01T01:07:14.391 INFO:teuthology.orchestra.run.smithi026.stdout: "take_sum": 0, 2023-12-01T01:07:14.391 INFO:teuthology.orchestra.run.smithi026.stdout: "put": 86, 2023-12-01T01:07:14.391 INFO:teuthology.orchestra.run.smithi026.stdout: "put_sum": 419281, 2023-12-01T01:07:14.391 INFO:teuthology.orchestra.run.smithi026.stdout: "wait": { 2023-12-01T01:07:14.391 INFO:teuthology.orchestra.run.smithi026.stdout: "avgcount": 0, 2023-12-01T01:07:14.392 INFO:teuthology.orchestra.run.smithi026.stdout: "sum": 0.000000000, 2023-12-01T01:07:14.392 INFO:teuthology.orchestra.run.smithi026.stdout: "avgtime": 0.000000000 2023-12-01T01:07:14.392 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:14.392 INFO:teuthology.orchestra.run.smithi026.stdout: } 2023-12-01T01:07:14.392 INFO:teuthology.orchestra.run.smithi026.stdout:} 2023-12-01T01:07:14.821 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-12-01T01:07:14.821 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-12-01T01:07:14.821 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-12-01T01:07:14.821 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-12-01T01:07:14.821 DEBUG:tasks.check_counter:Getting stats from b 2023-12-01T01:07:14.822 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph daemon mds.b perf dump 2023-12-01T01:07:15.403 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.b/config 2023-12-01T01:07:15.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:15 smithi093 ceph-mon[103327]: pgmap v382: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-12-01T01:07:16.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:15 smithi116 ceph-mon[103554]: pgmap v382: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-12-01T01:07:16.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:15 smithi026 ceph-mon[98801]: pgmap v382: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2023-12-01T01:07:16.741 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-12-01T01:07:16.742 INFO:teuthology.orchestra.run.smithi093.stdout: "AsyncMessenger::Worker-0": { 2023-12-01T01:07:16.742 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_messages": 60679, 2023-12-01T01:07:16.742 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages": 59609, 2023-12-01T01:07:16.742 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_bytes": 12221991, 2023-12-01T01:07:16.742 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_bytes": 48204965, 2023-12-01T01:07:16.742 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_created_connections": 64, 2023-12-01T01:07:16.742 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_active_connections": 7, 2023-12-01T01:07:16.742 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_total_time": 1.935076068, 2023-12-01T01:07:16.742 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_send_time": 0.769809398, 2023-12-01T01:07:16.742 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_recv_time": 1.182915822, 2023-12-01T01:07:16.742 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_fast_dispatch_time": 0.117130228, 2023-12-01T01:07:16.743 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:16.743 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 59607, 2023-12-01T01:07:16.743 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 6.560309690, 2023-12-01T01:07:16.743 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000110059 2023-12-01T01:07:16.743 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.743 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:16.743 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 110295, 2023-12-01T01:07:16.743 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.010010428, 2023-12-01T01:07:16.743 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000090 2023-12-01T01:07:16.743 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.743 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-01T01:07:16.743 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_encrypted_bytes": 0 2023-12-01T01:07:16.743 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.744 INFO:teuthology.orchestra.run.smithi093.stdout: "AsyncMessenger::Worker-1": { 2023-12-01T01:07:16.744 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_messages": 32560, 2023-12-01T01:07:16.744 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages": 66030, 2023-12-01T01:07:16.744 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_bytes": 11531193, 2023-12-01T01:07:16.744 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_bytes": 38902684, 2023-12-01T01:07:16.744 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_created_connections": 11, 2023-12-01T01:07:16.744 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_active_connections": 6, 2023-12-01T01:07:16.744 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_total_time": 1.653465001, 2023-12-01T01:07:16.744 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_send_time": 0.712242179, 2023-12-01T01:07:16.744 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_recv_time": 8.177566713, 2023-12-01T01:07:16.744 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_fast_dispatch_time": 0.137289555, 2023-12-01T01:07:16.744 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:16.744 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 66029, 2023-12-01T01:07:16.744 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 5.534505118, 2023-12-01T01:07:16.745 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000083819 2023-12-01T01:07:16.745 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.745 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:16.745 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 80718, 2023-12-01T01:07:16.745 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.010315078, 2023-12-01T01:07:16.745 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000127 2023-12-01T01:07:16.745 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.745 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_encrypted_bytes": 546336, 2023-12-01T01:07:16.745 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_encrypted_bytes": 85504 2023-12-01T01:07:16.745 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.745 INFO:teuthology.orchestra.run.smithi093.stdout: "AsyncMessenger::Worker-2": { 2023-12-01T01:07:16.745 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_messages": 64198, 2023-12-01T01:07:16.745 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages": 66188, 2023-12-01T01:07:16.745 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_bytes": 11299369, 2023-12-01T01:07:16.746 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_bytes": 24500958, 2023-12-01T01:07:16.746 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_created_connections": 10, 2023-12-01T01:07:16.746 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_active_connections": 6, 2023-12-01T01:07:16.746 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_total_time": 2.218155583, 2023-12-01T01:07:16.746 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_send_time": 0.890958723, 2023-12-01T01:07:16.746 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_recv_time": 1.383340656, 2023-12-01T01:07:16.746 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_fast_dispatch_time": 0.113715073, 2023-12-01T01:07:16.746 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:16.746 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 66187, 2023-12-01T01:07:16.746 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 6.484580768, 2023-12-01T01:07:16.746 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000097973 2023-12-01T01:07:16.746 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.746 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:16.746 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 122761, 2023-12-01T01:07:16.747 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.012209402, 2023-12-01T01:07:16.747 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000099 2023-12-01T01:07:16.747 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.747 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-12-01T01:07:16.747 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_encrypted_bytes": 179888 2023-12-01T01:07:16.747 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.747 INFO:teuthology.orchestra.run.smithi093.stdout: "cct": { 2023-12-01T01:07:16.747 INFO:teuthology.orchestra.run.smithi093.stdout: "total_workers": 1, 2023-12-01T01:07:16.747 INFO:teuthology.orchestra.run.smithi093.stdout: "unhealthy_workers": 0 2023-12-01T01:07:16.747 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.747 INFO:teuthology.orchestra.run.smithi093.stdout: "finisher-MDSRank": { 2023-12-01T01:07:16.747 INFO:teuthology.orchestra.run.smithi093.stdout: "queue_len": 0, 2023-12-01T01:07:16.747 INFO:teuthology.orchestra.run.smithi093.stdout: "complete_latency": { 2023-12-01T01:07:16.748 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 2284, 2023-12-01T01:07:16.748 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 15.573451558, 2023-12-01T01:07:16.748 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.006818498 2023-12-01T01:07:16.748 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:16.748 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.748 INFO:teuthology.orchestra.run.smithi093.stdout: "finisher-PurgeQueue": { 2023-12-01T01:07:16.748 INFO:teuthology.orchestra.run.smithi093.stdout: "queue_len": 0, 2023-12-01T01:07:16.748 INFO:teuthology.orchestra.run.smithi093.stdout: "complete_latency": { 2023-12-01T01:07:16.748 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 6694, 2023-12-01T01:07:16.748 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 1.429621393, 2023-12-01T01:07:16.748 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000213567 2023-12-01T01:07:16.748 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:16.748 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.748 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": { 2023-12-01T01:07:16.749 INFO:teuthology.orchestra.run.smithi093.stdout: "request": 15972, 2023-12-01T01:07:16.749 INFO:teuthology.orchestra.run.smithi093.stdout: "reply": 15783, 2023-12-01T01:07:16.749 INFO:teuthology.orchestra.run.smithi093.stdout: "reply_latency": { 2023-12-01T01:07:16.749 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 15783, 2023-12-01T01:07:16.749 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 26.640506386, 2023-12-01T01:07:16.749 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.001687924 2023-12-01T01:07:16.749 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.749 INFO:teuthology.orchestra.run.smithi093.stdout: "slow_reply": 0, 2023-12-01T01:07:16.749 INFO:teuthology.orchestra.run.smithi093.stdout: "forward": 189, 2023-12-01T01:07:16.749 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_fetch_complete": 0, 2023-12-01T01:07:16.749 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_fetch_keys": 0, 2023-12-01T01:07:16.749 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_commit": 681, 2023-12-01T01:07:16.749 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_split": 15, 2023-12-01T01:07:16.749 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_merge": 5, 2023-12-01T01:07:16.749 INFO:teuthology.orchestra.run.smithi093.stdout: "inodes": 48, 2023-12-01T01:07:16.750 INFO:teuthology.orchestra.run.smithi093.stdout: "inodes_top": 20, 2023-12-01T01:07:16.750 INFO:teuthology.orchestra.run.smithi093.stdout: "inodes_bottom": 14, 2023-12-01T01:07:16.750 INFO:teuthology.orchestra.run.smithi093.stdout: "inodes_pin_tail": 14, 2023-12-01T01:07:16.750 INFO:teuthology.orchestra.run.smithi093.stdout: "inodes_pinned": 19, 2023-12-01T01:07:16.750 INFO:teuthology.orchestra.run.smithi093.stdout: "inodes_expired": 6930, 2023-12-01T01:07:16.750 INFO:teuthology.orchestra.run.smithi093.stdout: "inodes_with_caps": 1, 2023-12-01T01:07:16.750 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": 1, 2023-12-01T01:07:16.750 INFO:teuthology.orchestra.run.smithi093.stdout: "subtrees": 2, 2023-12-01T01:07:16.751 INFO:teuthology.orchestra.run.smithi093.stdout: "traverse": 17033, 2023-12-01T01:07:16.751 INFO:teuthology.orchestra.run.smithi093.stdout: "traverse_hit": 16451, 2023-12-01T01:07:16.751 INFO:teuthology.orchestra.run.smithi093.stdout: "traverse_forward": 0, 2023-12-01T01:07:16.751 INFO:teuthology.orchestra.run.smithi093.stdout: "traverse_discover": 266, 2023-12-01T01:07:16.751 INFO:teuthology.orchestra.run.smithi093.stdout: "traverse_dir_fetch": 0, 2023-12-01T01:07:16.751 INFO:teuthology.orchestra.run.smithi093.stdout: "traverse_remote_ino": 0, 2023-12-01T01:07:16.751 INFO:teuthology.orchestra.run.smithi093.stdout: "traverse_lock": 0, 2023-12-01T01:07:16.751 INFO:teuthology.orchestra.run.smithi093.stdout: "load_cent": 95, 2023-12-01T01:07:16.751 INFO:teuthology.orchestra.run.smithi093.stdout: "q": 0, 2023-12-01T01:07:16.751 INFO:teuthology.orchestra.run.smithi093.stdout: "exported": 11, 2023-12-01T01:07:16.751 INFO:teuthology.orchestra.run.smithi093.stdout: "exported_inodes": 6288, 2023-12-01T01:07:16.751 INFO:teuthology.orchestra.run.smithi093.stdout: "imported": 11, 2023-12-01T01:07:16.751 INFO:teuthology.orchestra.run.smithi093.stdout: "imported_inodes": 359, 2023-12-01T01:07:16.752 INFO:teuthology.orchestra.run.smithi093.stdout: "openino_dir_fetch": 0, 2023-12-01T01:07:16.752 INFO:teuthology.orchestra.run.smithi093.stdout: "openino_backtrace_fetch": 723, 2023-12-01T01:07:16.752 INFO:teuthology.orchestra.run.smithi093.stdout: "openino_peer_discover": 0, 2023-12-01T01:07:16.752 INFO:teuthology.orchestra.run.smithi093.stdout: "root_rfiles": 153, 2023-12-01T01:07:16.752 INFO:teuthology.orchestra.run.smithi093.stdout: "root_rbytes": 1316516, 2023-12-01T01:07:16.752 INFO:teuthology.orchestra.run.smithi093.stdout: "root_rsnaps": 0, 2023-12-01T01:07:16.752 INFO:teuthology.orchestra.run.smithi093.stdout: "scrub_backtrace_fetch": 723, 2023-12-01T01:07:16.752 INFO:teuthology.orchestra.run.smithi093.stdout: "scrub_set_tag": 0, 2023-12-01T01:07:16.752 INFO:teuthology.orchestra.run.smithi093.stdout: "scrub_backtrace_repaired": 0, 2023-12-01T01:07:16.752 INFO:teuthology.orchestra.run.smithi093.stdout: "scrub_inotable_repaired": 0, 2023-12-01T01:07:16.752 INFO:teuthology.orchestra.run.smithi093.stdout: "scrub_dir_inodes": 96, 2023-12-01T01:07:16.752 INFO:teuthology.orchestra.run.smithi093.stdout: "scrub_dir_base_inodes": 4, 2023-12-01T01:07:16.753 INFO:teuthology.orchestra.run.smithi093.stdout: "scrub_dirfrag_rstats": 92, 2023-12-01T01:07:16.753 INFO:teuthology.orchestra.run.smithi093.stdout: "scrub_file_inodes": 627, 2023-12-01T01:07:16.753 INFO:teuthology.orchestra.run.smithi093.stdout: "handle_inode_file_caps": 8, 2023-12-01T01:07:16.753 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_cap_op_revoke": 1328, 2023-12-01T01:07:16.753 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_cap_op_grant": 15018, 2023-12-01T01:07:16.753 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_cap_op_trunc": 0, 2023-12-01T01:07:16.753 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-01T01:07:16.753 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-01T01:07:16.753 INFO:teuthology.orchestra.run.smithi093.stdout: "handle_client_caps": 11186, 2023-12-01T01:07:16.753 INFO:teuthology.orchestra.run.smithi093.stdout: "handle_client_caps_dirty": 7652, 2023-12-01T01:07:16.753 INFO:teuthology.orchestra.run.smithi093.stdout: "handle_client_cap_release": 41, 2023-12-01T01:07:16.754 INFO:teuthology.orchestra.run.smithi093.stdout: "process_request_cap_release": 5995 2023-12-01T01:07:16.754 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.754 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_cache": { 2023-12-01T01:07:16.754 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_update": 1401, 2023-12-01T01:07:16.754 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_update_receipt": 568, 2023-12-01T01:07:16.754 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_try_discover": 356, 2023-12-01T01:07:16.754 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_send_discover": 387, 2023-12-01T01:07:16.754 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_handle_discover": 2591, 2023-12-01T01:07:16.754 INFO:teuthology.orchestra.run.smithi093.stdout: "num_strays": 3, 2023-12-01T01:07:16.754 INFO:teuthology.orchestra.run.smithi093.stdout: "num_strays_delayed": 0, 2023-12-01T01:07:16.754 INFO:teuthology.orchestra.run.smithi093.stdout: "num_strays_enqueuing": 0, 2023-12-01T01:07:16.754 INFO:teuthology.orchestra.run.smithi093.stdout: "strays_created": 4330, 2023-12-01T01:07:16.754 INFO:teuthology.orchestra.run.smithi093.stdout: "strays_enqueued": 4327, 2023-12-01T01:07:16.754 INFO:teuthology.orchestra.run.smithi093.stdout: "strays_reintegrated": 0, 2023-12-01T01:07:16.755 INFO:teuthology.orchestra.run.smithi093.stdout: "strays_migrated": 0, 2023-12-01T01:07:16.755 INFO:teuthology.orchestra.run.smithi093.stdout: "num_recovering_processing": 0, 2023-12-01T01:07:16.755 INFO:teuthology.orchestra.run.smithi093.stdout: "num_recovering_enqueued": 0, 2023-12-01T01:07:16.755 INFO:teuthology.orchestra.run.smithi093.stdout: "num_recovering_prioritized": 0, 2023-12-01T01:07:16.755 INFO:teuthology.orchestra.run.smithi093.stdout: "recovery_started": 0, 2023-12-01T01:07:16.755 INFO:teuthology.orchestra.run.smithi093.stdout: "recovery_completed": 0, 2023-12-01T01:07:16.755 INFO:teuthology.orchestra.run.smithi093.stdout: "ireq_enqueue_scrub": 4, 2023-12-01T01:07:16.755 INFO:teuthology.orchestra.run.smithi093.stdout: "ireq_exportdir": 11, 2023-12-01T01:07:16.755 INFO:teuthology.orchestra.run.smithi093.stdout: "ireq_flush": 0, 2023-12-01T01:07:16.755 INFO:teuthology.orchestra.run.smithi093.stdout: "ireq_fragmentdir": 20, 2023-12-01T01:07:16.755 INFO:teuthology.orchestra.run.smithi093.stdout: "ireq_fragstats": 0, 2023-12-01T01:07:16.755 INFO:teuthology.orchestra.run.smithi093.stdout: "ireq_inodestats": 0 2023-12-01T01:07:16.755 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.755 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_log": { 2023-12-01T01:07:16.756 INFO:teuthology.orchestra.run.smithi093.stdout: "evadd": 29178, 2023-12-01T01:07:16.756 INFO:teuthology.orchestra.run.smithi093.stdout: "evex": 29158, 2023-12-01T01:07:16.756 INFO:teuthology.orchestra.run.smithi093.stdout: "evtrm": 29158, 2023-12-01T01:07:16.756 INFO:teuthology.orchestra.run.smithi093.stdout: "ev": 20, 2023-12-01T01:07:16.756 INFO:teuthology.orchestra.run.smithi093.stdout: "evexg": 0, 2023-12-01T01:07:16.756 INFO:teuthology.orchestra.run.smithi093.stdout: "evexd": 1328, 2023-12-01T01:07:16.756 INFO:teuthology.orchestra.run.smithi093.stdout: "segadd": 44, 2023-12-01T01:07:16.756 INFO:teuthology.orchestra.run.smithi093.stdout: "segex": 43, 2023-12-01T01:07:16.756 INFO:teuthology.orchestra.run.smithi093.stdout: "segtrm": 43, 2023-12-01T01:07:16.756 INFO:teuthology.orchestra.run.smithi093.stdout: "seg": 3, 2023-12-01T01:07:16.756 INFO:teuthology.orchestra.run.smithi093.stdout: "segexg": 0, 2023-12-01T01:07:16.756 INFO:teuthology.orchestra.run.smithi093.stdout: "segexd": 2, 2023-12-01T01:07:16.756 INFO:teuthology.orchestra.run.smithi093.stdout: "expos": 65745263, 2023-12-01T01:07:16.756 INFO:teuthology.orchestra.run.smithi093.stdout: "wrpos": 65781726, 2023-12-01T01:07:16.756 INFO:teuthology.orchestra.run.smithi093.stdout: "rdpos": 0, 2023-12-01T01:07:16.756 INFO:teuthology.orchestra.run.smithi093.stdout: "jlat": { 2023-12-01T01:07:16.757 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 859, 2023-12-01T01:07:16.757 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 51.589084606, 2023-12-01T01:07:16.757 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.060057141 2023-12-01T01:07:16.757 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.757 INFO:teuthology.orchestra.run.smithi093.stdout: "replayed": 0 2023-12-01T01:07:16.757 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.757 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_mem": { 2023-12-01T01:07:16.757 INFO:teuthology.orchestra.run.smithi093.stdout: "ino": 22, 2023-12-01T01:07:16.757 INFO:teuthology.orchestra.run.smithi093.stdout: "ino+": 10717, 2023-12-01T01:07:16.757 INFO:teuthology.orchestra.run.smithi093.stdout: "ino-": 10695, 2023-12-01T01:07:16.757 INFO:teuthology.orchestra.run.smithi093.stdout: "dir": 22, 2023-12-01T01:07:16.757 INFO:teuthology.orchestra.run.smithi093.stdout: "dir+": 996, 2023-12-01T01:07:16.757 INFO:teuthology.orchestra.run.smithi093.stdout: "dir-": 974, 2023-12-01T01:07:16.757 INFO:teuthology.orchestra.run.smithi093.stdout: "dn": 48, 2023-12-01T01:07:16.758 INFO:teuthology.orchestra.run.smithi093.stdout: "dn+": 13336, 2023-12-01T01:07:16.758 INFO:teuthology.orchestra.run.smithi093.stdout: "dn-": 13288, 2023-12-01T01:07:16.758 INFO:teuthology.orchestra.run.smithi093.stdout: "cap": 1, 2023-12-01T01:07:16.758 INFO:teuthology.orchestra.run.smithi093.stdout: "cap+": 10420, 2023-12-01T01:07:16.758 INFO:teuthology.orchestra.run.smithi093.stdout: "cap-": 10419, 2023-12-01T01:07:16.758 INFO:teuthology.orchestra.run.smithi093.stdout: "rss": 98444, 2023-12-01T01:07:16.758 INFO:teuthology.orchestra.run.smithi093.stdout: "heap": 207156 2023-12-01T01:07:16.758 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.758 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_server": { 2023-12-01T01:07:16.758 INFO:teuthology.orchestra.run.smithi093.stdout: "dispatch_client_request": 18181, 2023-12-01T01:07:16.758 INFO:teuthology.orchestra.run.smithi093.stdout: "dispatch_server_request": 10, 2023-12-01T01:07:16.758 INFO:teuthology.orchestra.run.smithi093.stdout: "handle_client_request": 15972, 2023-12-01T01:07:16.758 INFO:teuthology.orchestra.run.smithi093.stdout: "handle_client_session": 18, 2023-12-01T01:07:16.758 INFO:teuthology.orchestra.run.smithi093.stdout: "handle_peer_request": 205, 2023-12-01T01:07:16.759 INFO:teuthology.orchestra.run.smithi093.stdout: "req_create_latency": { 2023-12-01T01:07:16.759 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 9795, 2023-12-01T01:07:16.759 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 14.704608549, 2023-12-01T01:07:16.759 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.001501236 2023-12-01T01:07:16.759 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.759 INFO:teuthology.orchestra.run.smithi093.stdout: "req_getattr_latency": { 2023-12-01T01:07:16.759 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 20, 2023-12-01T01:07:16.759 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.008618417, 2023-12-01T01:07:16.759 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000430920 2023-12-01T01:07:16.759 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.759 INFO:teuthology.orchestra.run.smithi093.stdout: "req_getfilelock_latency": { 2023-12-01T01:07:16.759 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.759 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.760 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.760 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.760 INFO:teuthology.orchestra.run.smithi093.stdout: "req_link_latency": { 2023-12-01T01:07:16.760 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.760 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.760 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.760 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.760 INFO:teuthology.orchestra.run.smithi093.stdout: "req_lookup_latency": { 2023-12-01T01:07:16.760 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 256, 2023-12-01T01:07:16.760 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.115747465, 2023-12-01T01:07:16.760 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000452138 2023-12-01T01:07:16.760 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.760 INFO:teuthology.orchestra.run.smithi093.stdout: "req_lookuphash_latency": { 2023-12-01T01:07:16.760 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.761 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.761 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.761 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.761 INFO:teuthology.orchestra.run.smithi093.stdout: "req_lookupino_latency": { 2023-12-01T01:07:16.761 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.761 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.761 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.761 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.761 INFO:teuthology.orchestra.run.smithi093.stdout: "req_lookupname_latency": { 2023-12-01T01:07:16.761 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.761 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.761 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.761 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.761 INFO:teuthology.orchestra.run.smithi093.stdout: "req_lookupparent_latency": { 2023-12-01T01:07:16.762 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.762 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.762 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.762 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.762 INFO:teuthology.orchestra.run.smithi093.stdout: "req_lookupsnap_latency": { 2023-12-01T01:07:16.762 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.762 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.762 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.762 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.762 INFO:teuthology.orchestra.run.smithi093.stdout: "req_lssnap_latency": { 2023-12-01T01:07:16.762 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.762 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.762 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.763 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.763 INFO:teuthology.orchestra.run.smithi093.stdout: "req_mkdir_latency": { 2023-12-01T01:07:16.763 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 623, 2023-12-01T01:07:16.763 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 1.638527974, 2023-12-01T01:07:16.763 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.002630060 2023-12-01T01:07:16.763 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.763 INFO:teuthology.orchestra.run.smithi093.stdout: "req_mknod_latency": { 2023-12-01T01:07:16.763 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.763 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.763 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.763 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.763 INFO:teuthology.orchestra.run.smithi093.stdout: "req_mksnap_latency": { 2023-12-01T01:07:16.763 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.763 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.763 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.764 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.764 INFO:teuthology.orchestra.run.smithi093.stdout: "req_open_latency": { 2023-12-01T01:07:16.764 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.764 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.764 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.764 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.764 INFO:teuthology.orchestra.run.smithi093.stdout: "req_readdir_latency": { 2023-12-01T01:07:16.764 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 749, 2023-12-01T01:07:16.764 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 1.428219269, 2023-12-01T01:07:16.764 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.001906834 2023-12-01T01:07:16.764 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.764 INFO:teuthology.orchestra.run.smithi093.stdout: "req_rename_latency": { 2023-12-01T01:07:16.764 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 2, 2023-12-01T01:07:16.764 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.002523975, 2023-12-01T01:07:16.764 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.001261987 2023-12-01T01:07:16.765 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.765 INFO:teuthology.orchestra.run.smithi093.stdout: "req_renamesnap_latency": { 2023-12-01T01:07:16.765 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.765 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.765 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.765 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.765 INFO:teuthology.orchestra.run.smithi093.stdout: "req_snapdiff_latency": { 2023-12-01T01:07:16.765 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.765 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.765 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.765 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.765 INFO:teuthology.orchestra.run.smithi093.stdout: "req_rmdir_latency": { 2023-12-01T01:07:16.766 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 177, 2023-12-01T01:07:16.766 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 2.769612238, 2023-12-01T01:07:16.766 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.015647526 2023-12-01T01:07:16.766 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.766 INFO:teuthology.orchestra.run.smithi093.stdout: "req_rmsnap_latency": { 2023-12-01T01:07:16.766 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.766 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.766 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.766 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.766 INFO:teuthology.orchestra.run.smithi093.stdout: "req_rmxattr_latency": { 2023-12-01T01:07:16.766 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.766 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.766 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.766 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.767 INFO:teuthology.orchestra.run.smithi093.stdout: "req_setattr_latency": { 2023-12-01T01:07:16.767 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 2, 2023-12-01T01:07:16.767 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.497678658, 2023-12-01T01:07:16.767 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.248839329 2023-12-01T01:07:16.767 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.767 INFO:teuthology.orchestra.run.smithi093.stdout: "req_setdirlayout_latency": { 2023-12-01T01:07:16.767 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.767 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.767 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.767 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.767 INFO:teuthology.orchestra.run.smithi093.stdout: "req_setfilelock_latency": { 2023-12-01T01:07:16.767 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.767 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.767 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.768 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.768 INFO:teuthology.orchestra.run.smithi093.stdout: "req_setlayout_latency": { 2023-12-01T01:07:16.768 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.768 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.768 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.768 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.768 INFO:teuthology.orchestra.run.smithi093.stdout: "req_setxattr_latency": { 2023-12-01T01:07:16.768 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 6, 2023-12-01T01:07:16.768 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.016536400, 2023-12-01T01:07:16.768 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.002756066 2023-12-01T01:07:16.768 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.768 INFO:teuthology.orchestra.run.smithi093.stdout: "req_symlink_latency": { 2023-12-01T01:07:16.768 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.768 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.769 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.769 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.769 INFO:teuthology.orchestra.run.smithi093.stdout: "req_unlink_latency": { 2023-12-01T01:07:16.769 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 4153, 2023-12-01T01:07:16.769 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 5.458433441, 2023-12-01T01:07:16.769 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.001314335 2023-12-01T01:07:16.769 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.769 INFO:teuthology.orchestra.run.smithi093.stdout: "cap_revoke_eviction": 0, 2023-12-01T01:07:16.769 INFO:teuthology.orchestra.run.smithi093.stdout: "cap_acquisition_throttle": 0, 2023-12-01T01:07:16.769 INFO:teuthology.orchestra.run.smithi093.stdout: "req_getvxattr_latency": { 2023-12-01T01:07:16.769 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.769 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.769 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.769 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:16.769 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.770 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_sessions": { 2023-12-01T01:07:16.770 INFO:teuthology.orchestra.run.smithi093.stdout: "session_count": 1, 2023-12-01T01:07:16.770 INFO:teuthology.orchestra.run.smithi093.stdout: "session_add": 2, 2023-12-01T01:07:16.770 INFO:teuthology.orchestra.run.smithi093.stdout: "session_remove": 1, 2023-12-01T01:07:16.770 INFO:teuthology.orchestra.run.smithi093.stdout: "sessions_open": 1, 2023-12-01T01:07:16.770 INFO:teuthology.orchestra.run.smithi093.stdout: "sessions_stale": 0, 2023-12-01T01:07:16.770 INFO:teuthology.orchestra.run.smithi093.stdout: "total_load": 9487, 2023-12-01T01:07:16.770 INFO:teuthology.orchestra.run.smithi093.stdout: "average_load": 9487, 2023-12-01T01:07:16.770 INFO:teuthology.orchestra.run.smithi093.stdout: "avg_session_uptime": 185, 2023-12-01T01:07:16.770 INFO:teuthology.orchestra.run.smithi093.stdout: "mdthresh_evicted": 0 2023-12-01T01:07:16.770 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.770 INFO:teuthology.orchestra.run.smithi093.stdout: "mempool": { 2023-12-01T01:07:16.770 INFO:teuthology.orchestra.run.smithi093.stdout: "bloom_filter_bytes": 360, 2023-12-01T01:07:16.770 INFO:teuthology.orchestra.run.smithi093.stdout: "bloom_filter_items": 360, 2023-12-01T01:07:16.770 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_alloc_bytes": 0, 2023-12-01T01:07:16.771 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_alloc_items": 0, 2023-12-01T01:07:16.771 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_data_bytes": 0, 2023-12-01T01:07:16.771 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_data_items": 0, 2023-12-01T01:07:16.771 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-01T01:07:16.771 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_onode_items": 0, 2023-12-01T01:07:16.771 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-01T01:07:16.771 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_meta_items": 0, 2023-12-01T01:07:16.771 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_other_bytes": 0, 2023-12-01T01:07:16.772 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_other_items": 0, 2023-12-01T01:07:16.772 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-01T01:07:16.772 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_buffer_items": 0, 2023-12-01T01:07:16.772 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_extent_bytes": 0, 2023-12-01T01:07:16.772 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_extent_items": 0, 2023-12-01T01:07:16.772 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_blob_bytes": 0, 2023-12-01T01:07:16.772 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_blob_items": 0, 2023-12-01T01:07:16.772 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-01T01:07:16.772 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_shared_blob_items": 0, 2023-12-01T01:07:16.773 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-01T01:07:16.773 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_inline_bl_items": 0, 2023-12-01T01:07:16.773 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_fsck_bytes": 0, 2023-12-01T01:07:16.773 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_fsck_items": 0, 2023-12-01T01:07:16.773 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_txc_bytes": 0, 2023-12-01T01:07:16.773 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_txc_items": 0, 2023-12-01T01:07:16.773 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-01T01:07:16.773 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_writing_deferred_items": 0, 2023-12-01T01:07:16.773 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_writing_bytes": 0, 2023-12-01T01:07:16.773 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_writing_items": 0, 2023-12-01T01:07:16.773 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_bytes": 0, 2023-12-01T01:07:16.773 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_items": 0, 2023-12-01T01:07:16.773 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_file_reader_bytes": 0, 2023-12-01T01:07:16.773 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_file_reader_items": 0, 2023-12-01T01:07:16.774 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_file_writer_bytes": 0, 2023-12-01T01:07:16.774 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_file_writer_items": 0, 2023-12-01T01:07:16.774 INFO:teuthology.orchestra.run.smithi093.stdout: "buffer_anon_bytes": 282765, 2023-12-01T01:07:16.774 INFO:teuthology.orchestra.run.smithi093.stdout: "buffer_anon_items": 132, 2023-12-01T01:07:16.774 INFO:teuthology.orchestra.run.smithi093.stdout: "buffer_meta_bytes": 1408, 2023-12-01T01:07:16.774 INFO:teuthology.orchestra.run.smithi093.stdout: "buffer_meta_items": 16, 2023-12-01T01:07:16.774 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_bytes": 0, 2023-12-01T01:07:16.774 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_items": 0, 2023-12-01T01:07:16.774 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_mapbl_bytes": 0, 2023-12-01T01:07:16.774 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_mapbl_items": 0, 2023-12-01T01:07:16.774 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_pglog_bytes": 0, 2023-12-01T01:07:16.774 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_pglog_items": 0, 2023-12-01T01:07:16.774 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_bytes": 7528, 2023-12-01T01:07:16.774 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_items": 158, 2023-12-01T01:07:16.775 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_mapping_bytes": 0, 2023-12-01T01:07:16.775 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_mapping_items": 0, 2023-12-01T01:07:16.775 INFO:teuthology.orchestra.run.smithi093.stdout: "pgmap_bytes": 0, 2023-12-01T01:07:16.775 INFO:teuthology.orchestra.run.smithi093.stdout: "pgmap_items": 0, 2023-12-01T01:07:16.775 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_co_bytes": 115863, 2023-12-01T01:07:16.775 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_co_items": 1295, 2023-12-01T01:07:16.775 INFO:teuthology.orchestra.run.smithi093.stdout: "unittest_1_bytes": 0, 2023-12-01T01:07:16.775 INFO:teuthology.orchestra.run.smithi093.stdout: "unittest_1_items": 0, 2023-12-01T01:07:16.775 INFO:teuthology.orchestra.run.smithi093.stdout: "unittest_2_bytes": 0, 2023-12-01T01:07:16.775 INFO:teuthology.orchestra.run.smithi093.stdout: "unittest_2_items": 0 2023-12-01T01:07:16.775 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.775 INFO:teuthology.orchestra.run.smithi093.stdout: "objecter": { 2023-12-01T01:07:16.775 INFO:teuthology.orchestra.run.smithi093.stdout: "op_active": 0, 2023-12-01T01:07:16.775 INFO:teuthology.orchestra.run.smithi093.stdout: "op_laggy": 0, 2023-12-01T01:07:16.776 INFO:teuthology.orchestra.run.smithi093.stdout: "op_send": 13495, 2023-12-01T01:07:16.776 INFO:teuthology.orchestra.run.smithi093.stdout: "op_send_bytes": 71896321, 2023-12-01T01:07:16.776 INFO:teuthology.orchestra.run.smithi093.stdout: "op_resend": 37, 2023-12-01T01:07:16.776 INFO:teuthology.orchestra.run.smithi093.stdout: "op_reply": 13495, 2023-12-01T01:07:16.776 INFO:teuthology.orchestra.run.smithi093.stdout: "op_latency": { 2023-12-01T01:07:16.776 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 13495, 2023-12-01T01:07:16.776 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 1034.609275891, 2023-12-01T01:07:16.776 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.076666118 2023-12-01T01:07:16.776 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.776 INFO:teuthology.orchestra.run.smithi093.stdout: "op_inflight": 0, 2023-12-01T01:07:16.776 INFO:teuthology.orchestra.run.smithi093.stdout: "oplen_avg": { 2023-12-01T01:07:16.776 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 13495, 2023-12-01T01:07:16.776 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 26322 2023-12-01T01:07:16.776 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.777 INFO:teuthology.orchestra.run.smithi093.stdout: "op": 13495, 2023-12-01T01:07:16.777 INFO:teuthology.orchestra.run.smithi093.stdout: "op_r": 806, 2023-12-01T01:07:16.777 INFO:teuthology.orchestra.run.smithi093.stdout: "op_w": 12689, 2023-12-01T01:07:16.777 INFO:teuthology.orchestra.run.smithi093.stdout: "op_rmw": 0, 2023-12-01T01:07:16.777 INFO:teuthology.orchestra.run.smithi093.stdout: "op_pg": 0, 2023-12-01T01:07:16.777 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_stat": 178, 2023-12-01T01:07:16.777 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_create": 5966, 2023-12-01T01:07:16.777 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_read": 79, 2023-12-01T01:07:16.777 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_write": 934, 2023-12-01T01:07:16.777 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_writefull": 86, 2023-12-01T01:07:16.777 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_writesame": 0, 2023-12-01T01:07:16.777 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_append": 0, 2023-12-01T01:07:16.777 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_zero": 0, 2023-12-01T01:07:16.777 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_truncate": 15, 2023-12-01T01:07:16.777 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_delete": 4963, 2023-12-01T01:07:16.778 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_mapext": 0, 2023-12-01T01:07:16.778 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_sparse_read": 0, 2023-12-01T01:07:16.778 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_clonerange": 0, 2023-12-01T01:07:16.778 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_getxattr": 727, 2023-12-01T01:07:16.778 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_setxattr": 11932, 2023-12-01T01:07:16.778 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_cmpxattr": 0, 2023-12-01T01:07:16.778 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_rmxattr": 0, 2023-12-01T01:07:16.778 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_resetxattrs": 0, 2023-12-01T01:07:16.778 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_call": 0, 2023-12-01T01:07:16.778 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_watch": 0, 2023-12-01T01:07:16.778 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_notify": 0, 2023-12-01T01:07:16.778 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_src_cmpxattr": 0, 2023-12-01T01:07:16.779 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_pgls": 0, 2023-12-01T01:07:16.779 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_pgls_filter": 0, 2023-12-01T01:07:16.779 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_other": 0, 2023-12-01T01:07:16.779 INFO:teuthology.orchestra.run.smithi093.stdout: "linger_active": 0, 2023-12-01T01:07:16.779 INFO:teuthology.orchestra.run.smithi093.stdout: "linger_send": 0, 2023-12-01T01:07:16.779 INFO:teuthology.orchestra.run.smithi093.stdout: "linger_resend": 0, 2023-12-01T01:07:16.779 INFO:teuthology.orchestra.run.smithi093.stdout: "linger_ping": 0, 2023-12-01T01:07:16.779 INFO:teuthology.orchestra.run.smithi093.stdout: "poolop_active": 0, 2023-12-01T01:07:16.779 INFO:teuthology.orchestra.run.smithi093.stdout: "poolop_send": 0, 2023-12-01T01:07:16.779 INFO:teuthology.orchestra.run.smithi093.stdout: "poolop_resend": 0, 2023-12-01T01:07:16.779 INFO:teuthology.orchestra.run.smithi093.stdout: "poolstat_active": 0, 2023-12-01T01:07:16.779 INFO:teuthology.orchestra.run.smithi093.stdout: "poolstat_send": 0, 2023-12-01T01:07:16.779 INFO:teuthology.orchestra.run.smithi093.stdout: "poolstat_resend": 0, 2023-12-01T01:07:16.779 INFO:teuthology.orchestra.run.smithi093.stdout: "statfs_active": 0, 2023-12-01T01:07:16.779 INFO:teuthology.orchestra.run.smithi093.stdout: "statfs_send": 0, 2023-12-01T01:07:16.779 INFO:teuthology.orchestra.run.smithi093.stdout: "statfs_resend": 0, 2023-12-01T01:07:16.780 INFO:teuthology.orchestra.run.smithi093.stdout: "command_active": 0, 2023-12-01T01:07:16.780 INFO:teuthology.orchestra.run.smithi093.stdout: "command_send": 0, 2023-12-01T01:07:16.780 INFO:teuthology.orchestra.run.smithi093.stdout: "command_resend": 0, 2023-12-01T01:07:16.780 INFO:teuthology.orchestra.run.smithi093.stdout: "map_epoch": 84, 2023-12-01T01:07:16.780 INFO:teuthology.orchestra.run.smithi093.stdout: "map_full": 0, 2023-12-01T01:07:16.780 INFO:teuthology.orchestra.run.smithi093.stdout: "map_inc": 4, 2023-12-01T01:07:16.780 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_sessions": 12, 2023-12-01T01:07:16.780 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_session_open": 12, 2023-12-01T01:07:16.780 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_session_close": 0, 2023-12-01T01:07:16.780 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_laggy": 0, 2023-12-01T01:07:16.780 INFO:teuthology.orchestra.run.smithi093.stdout: "omap_wr": 1372, 2023-12-01T01:07:16.780 INFO:teuthology.orchestra.run.smithi093.stdout: "omap_rd": 0, 2023-12-01T01:07:16.780 INFO:teuthology.orchestra.run.smithi093.stdout: "omap_del": 70 2023-12-01T01:07:16.780 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.781 INFO:teuthology.orchestra.run.smithi093.stdout: "oft": { 2023-12-01T01:07:16.781 INFO:teuthology.orchestra.run.smithi093.stdout: "omap_total_objs": 1, 2023-12-01T01:07:16.781 INFO:teuthology.orchestra.run.smithi093.stdout: "omap_total_kv_pairs": 0, 2023-12-01T01:07:16.781 INFO:teuthology.orchestra.run.smithi093.stdout: "omap_total_updates": 0, 2023-12-01T01:07:16.781 INFO:teuthology.orchestra.run.smithi093.stdout: "omap_total_removes": 0 2023-12-01T01:07:16.781 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.781 INFO:teuthology.orchestra.run.smithi093.stdout: "osd-slow-ops": { 2023-12-01T01:07:16.781 INFO:teuthology.orchestra.run.smithi093.stdout: "slow_ops_count": 16021 2023-12-01T01:07:16.781 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.781 INFO:teuthology.orchestra.run.smithi093.stdout: "purge_queue": { 2023-12-01T01:07:16.781 INFO:teuthology.orchestra.run.smithi093.stdout: "pq_executing_ops": 0, 2023-12-01T01:07:16.781 INFO:teuthology.orchestra.run.smithi093.stdout: "pq_executing_ops_high_water": 40, 2023-12-01T01:07:16.781 INFO:teuthology.orchestra.run.smithi093.stdout: "pq_executing": 0, 2023-12-01T01:07:16.781 INFO:teuthology.orchestra.run.smithi093.stdout: "pq_executing_high_water": 10, 2023-12-01T01:07:16.782 INFO:teuthology.orchestra.run.smithi093.stdout: "pq_executed": 4327, 2023-12-01T01:07:16.782 INFO:teuthology.orchestra.run.smithi093.stdout: "pq_item_in_journal": 0 2023-12-01T01:07:16.782 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.782 INFO:teuthology.orchestra.run.smithi093.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-01T01:07:16.782 INFO:teuthology.orchestra.run.smithi093.stdout: "val": 0, 2023-12-01T01:07:16.782 INFO:teuthology.orchestra.run.smithi093.stdout: "max": 104857600, 2023-12-01T01:07:16.782 INFO:teuthology.orchestra.run.smithi093.stdout: "get_started": 0, 2023-12-01T01:07:16.782 INFO:teuthology.orchestra.run.smithi093.stdout: "get": 157433, 2023-12-01T01:07:16.782 INFO:teuthology.orchestra.run.smithi093.stdout: "get_sum": 20867954, 2023-12-01T01:07:16.782 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:16.782 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_success": 157433, 2023-12-01T01:07:16.782 INFO:teuthology.orchestra.run.smithi093.stdout: "take": 0, 2023-12-01T01:07:16.782 INFO:teuthology.orchestra.run.smithi093.stdout: "take_sum": 0, 2023-12-01T01:07:16.782 INFO:teuthology.orchestra.run.smithi093.stdout: "put": 157433, 2023-12-01T01:07:16.782 INFO:teuthology.orchestra.run.smithi093.stdout: "put_sum": 20867954, 2023-12-01T01:07:16.783 INFO:teuthology.orchestra.run.smithi093.stdout: "wait": { 2023-12-01T01:07:16.783 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.783 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.783 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.783 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:16.783 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.783 INFO:teuthology.orchestra.run.smithi093.stdout: "throttle-objecter_bytes": { 2023-12-01T01:07:16.783 INFO:teuthology.orchestra.run.smithi093.stdout: "val": 0, 2023-12-01T01:07:16.783 INFO:teuthology.orchestra.run.smithi093.stdout: "max": 104857600, 2023-12-01T01:07:16.783 INFO:teuthology.orchestra.run.smithi093.stdout: "get_started": 0, 2023-12-01T01:07:16.783 INFO:teuthology.orchestra.run.smithi093.stdout: "get": 0, 2023-12-01T01:07:16.783 INFO:teuthology.orchestra.run.smithi093.stdout: "get_sum": 0, 2023-12-01T01:07:16.783 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:16.783 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:16.784 INFO:teuthology.orchestra.run.smithi093.stdout: "take": 13495, 2023-12-01T01:07:16.784 INFO:teuthology.orchestra.run.smithi093.stdout: "take_sum": 72333364, 2023-12-01T01:07:16.784 INFO:teuthology.orchestra.run.smithi093.stdout: "put": 13495, 2023-12-01T01:07:16.784 INFO:teuthology.orchestra.run.smithi093.stdout: "put_sum": 72333364, 2023-12-01T01:07:16.784 INFO:teuthology.orchestra.run.smithi093.stdout: "wait": { 2023-12-01T01:07:16.784 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.784 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.784 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.784 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:16.784 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.784 INFO:teuthology.orchestra.run.smithi093.stdout: "throttle-objecter_ops": { 2023-12-01T01:07:16.784 INFO:teuthology.orchestra.run.smithi093.stdout: "val": 0, 2023-12-01T01:07:16.784 INFO:teuthology.orchestra.run.smithi093.stdout: "max": 1024, 2023-12-01T01:07:16.784 INFO:teuthology.orchestra.run.smithi093.stdout: "get_started": 0, 2023-12-01T01:07:16.785 INFO:teuthology.orchestra.run.smithi093.stdout: "get": 0, 2023-12-01T01:07:16.785 INFO:teuthology.orchestra.run.smithi093.stdout: "get_sum": 0, 2023-12-01T01:07:16.785 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:16.785 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:16.785 INFO:teuthology.orchestra.run.smithi093.stdout: "take": 13495, 2023-12-01T01:07:16.785 INFO:teuthology.orchestra.run.smithi093.stdout: "take_sum": 13495, 2023-12-01T01:07:16.785 INFO:teuthology.orchestra.run.smithi093.stdout: "put": 13495, 2023-12-01T01:07:16.785 INFO:teuthology.orchestra.run.smithi093.stdout: "put_sum": 13495, 2023-12-01T01:07:16.785 INFO:teuthology.orchestra.run.smithi093.stdout: "wait": { 2023-12-01T01:07:16.785 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.785 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.785 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.785 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:16.785 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.785 INFO:teuthology.orchestra.run.smithi093.stdout: "throttle-write_buf_throttle": { 2023-12-01T01:07:16.785 INFO:teuthology.orchestra.run.smithi093.stdout: "val": 0, 2023-12-01T01:07:16.786 INFO:teuthology.orchestra.run.smithi093.stdout: "max": 3758096384, 2023-12-01T01:07:16.786 INFO:teuthology.orchestra.run.smithi093.stdout: "get_started": 0, 2023-12-01T01:07:16.786 INFO:teuthology.orchestra.run.smithi093.stdout: "get": 4327, 2023-12-01T01:07:16.786 INFO:teuthology.orchestra.run.smithi093.stdout: "get_sum": 437043, 2023-12-01T01:07:16.786 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:16.786 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_success": 4327, 2023-12-01T01:07:16.786 INFO:teuthology.orchestra.run.smithi093.stdout: "take": 0, 2023-12-01T01:07:16.786 INFO:teuthology.orchestra.run.smithi093.stdout: "take_sum": 0, 2023-12-01T01:07:16.786 INFO:teuthology.orchestra.run.smithi093.stdout: "put": 75, 2023-12-01T01:07:16.786 INFO:teuthology.orchestra.run.smithi093.stdout: "put_sum": 437043, 2023-12-01T01:07:16.786 INFO:teuthology.orchestra.run.smithi093.stdout: "wait": { 2023-12-01T01:07:16.786 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.786 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.786 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.786 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: "throttle-write_buf_throttle-0x562f68c200a0": { 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: "val": 0, 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: "max": 3758096384, 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: "get_started": 0, 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: "get": 29178, 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: "get_sum": 61587422, 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_success": 29178, 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: "take": 0, 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: "take_sum": 0, 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: "put": 859, 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: "put_sum": 61587422, 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: "wait": { 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:16.787 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:16.788 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:16.788 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:16.788 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-12-01T01:07:17.156 INFO:tasks.check_counter:Daemon mds.b mds.exported=11 2023-12-01T01:07:17.156 INFO:tasks.check_counter:Daemon mds.b mds.imported=11 2023-12-01T01:07:17.156 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=1401 2023-12-01T01:07:17.157 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=568 2023-12-01T01:07:17.157 DEBUG:tasks.check_counter:Getting stats from e 2023-12-01T01:07:17.157 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph daemon mds.e perf dump 2023-12-01T01:07:17.707 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.b/config 2023-12-01T01:07:18.101 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:17 smithi093 ceph-mon[103327]: pgmap v383: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2023-12-01T01:07:18.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:17 smithi116 ceph-mon[103554]: pgmap v383: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2023-12-01T01:07:18.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:17 smithi026 ceph-mon[98801]: pgmap v383: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.6 KiB/s wr, 8 op/s 2023-12-01T01:07:18.918 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-12-01T01:07:18.918 INFO:teuthology.orchestra.run.smithi093.stdout: "AsyncMessenger::Worker-0": { 2023-12-01T01:07:18.918 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_messages": 3, 2023-12-01T01:07:18.918 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages": 4, 2023-12-01T01:07:18.918 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_bytes": 2656, 2023-12-01T01:07:18.918 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_bytes": 448, 2023-12-01T01:07:18.918 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_created_connections": 4, 2023-12-01T01:07:18.918 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_active_connections": 0, 2023-12-01T01:07:18.918 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_total_time": 0.001498431, 2023-12-01T01:07:18.918 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_send_time": 0.000037990, 2023-12-01T01:07:18.918 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_recv_time": 0.000602194, 2023-12-01T01:07:18.918 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-01T01:07:18.919 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:18.919 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 3, 2023-12-01T01:07:18.919 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000904005, 2023-12-01T01:07:18.919 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000301335 2023-12-01T01:07:18.919 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:18.919 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:18.919 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:18.919 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:18.919 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:18.919 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:18.919 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_encrypted_bytes": 2656, 2023-12-01T01:07:18.919 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_encrypted_bytes": 448 2023-12-01T01:07:18.919 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:18.919 INFO:teuthology.orchestra.run.smithi093.stdout: "AsyncMessenger::Worker-1": { 2023-12-01T01:07:18.920 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_messages": 1, 2023-12-01T01:07:18.920 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages": 62, 2023-12-01T01:07:18.920 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_bytes": 160, 2023-12-01T01:07:18.920 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_bytes": 86864, 2023-12-01T01:07:18.920 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_created_connections": 3, 2023-12-01T01:07:18.920 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_active_connections": 2, 2023-12-01T01:07:18.920 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_total_time": 0.003880874, 2023-12-01T01:07:18.920 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_send_time": 0.002326769, 2023-12-01T01:07:18.920 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_recv_time": 0.000856685, 2023-12-01T01:07:18.920 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-01T01:07:18.920 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:18.920 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 60, 2023-12-01T01:07:18.920 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.002302322, 2023-12-01T01:07:18.920 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000038372 2023-12-01T01:07:18.920 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:18.921 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:18.921 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:18.921 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:18.921 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:18.921 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:18.921 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-01T01:07:18.921 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_encrypted_bytes": 86864 2023-12-01T01:07:18.921 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:18.921 INFO:teuthology.orchestra.run.smithi093.stdout: "AsyncMessenger::Worker-2": { 2023-12-01T01:07:18.921 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_messages": 85, 2023-12-01T01:07:18.921 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages": 82, 2023-12-01T01:07:18.921 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_bytes": 431248, 2023-12-01T01:07:18.921 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_bytes": 45888, 2023-12-01T01:07:18.921 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_created_connections": 2, 2023-12-01T01:07:18.921 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_active_connections": 1, 2023-12-01T01:07:18.921 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_total_time": 0.014859465, 2023-12-01T01:07:18.922 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_send_time": 0.004660223, 2023-12-01T01:07:18.922 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_recv_time": 0.009674397, 2023-12-01T01:07:18.922 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_fast_dispatch_time": 0.002215040, 2023-12-01T01:07:18.922 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:18.922 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 81, 2023-12-01T01:07:18.922 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.004783429, 2023-12-01T01:07:18.922 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000059054 2023-12-01T01:07:18.922 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:18.922 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:18.922 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:18.922 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:18.922 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:18.922 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:18.922 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_encrypted_bytes": 431248, 2023-12-01T01:07:18.922 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_encrypted_bytes": 45888 2023-12-01T01:07:18.923 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:18.923 INFO:teuthology.orchestra.run.smithi093.stdout: "cct": { 2023-12-01T01:07:18.923 INFO:teuthology.orchestra.run.smithi093.stdout: "total_workers": 0, 2023-12-01T01:07:18.923 INFO:teuthology.orchestra.run.smithi093.stdout: "unhealthy_workers": 0 2023-12-01T01:07:18.923 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:18.923 INFO:teuthology.orchestra.run.smithi093.stdout: "mempool": { 2023-12-01T01:07:18.923 INFO:teuthology.orchestra.run.smithi093.stdout: "bloom_filter_bytes": 0, 2023-12-01T01:07:18.923 INFO:teuthology.orchestra.run.smithi093.stdout: "bloom_filter_items": 0, 2023-12-01T01:07:18.923 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_alloc_bytes": 0, 2023-12-01T01:07:18.923 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_alloc_items": 0, 2023-12-01T01:07:18.923 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_data_bytes": 0, 2023-12-01T01:07:18.923 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_data_items": 0, 2023-12-01T01:07:18.923 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-01T01:07:18.923 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_onode_items": 0, 2023-12-01T01:07:18.923 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-01T01:07:18.924 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_meta_items": 0, 2023-12-01T01:07:18.924 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_other_bytes": 0, 2023-12-01T01:07:18.924 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_other_items": 0, 2023-12-01T01:07:18.924 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-01T01:07:18.924 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_buffer_items": 0, 2023-12-01T01:07:18.924 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_extent_bytes": 0, 2023-12-01T01:07:18.924 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_extent_items": 0, 2023-12-01T01:07:18.924 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_blob_bytes": 0, 2023-12-01T01:07:18.924 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_blob_items": 0, 2023-12-01T01:07:18.924 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-01T01:07:18.924 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_shared_blob_items": 0, 2023-12-01T01:07:18.924 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-01T01:07:18.924 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_inline_bl_items": 0, 2023-12-01T01:07:18.924 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_fsck_bytes": 0, 2023-12-01T01:07:18.924 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_fsck_items": 0, 2023-12-01T01:07:18.924 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_txc_bytes": 0, 2023-12-01T01:07:18.925 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_txc_items": 0, 2023-12-01T01:07:18.925 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-01T01:07:18.925 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_writing_deferred_items": 0, 2023-12-01T01:07:18.925 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_writing_bytes": 0, 2023-12-01T01:07:18.925 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_writing_items": 0, 2023-12-01T01:07:18.925 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_bytes": 0, 2023-12-01T01:07:18.925 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_items": 0, 2023-12-01T01:07:18.925 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_file_reader_bytes": 0, 2023-12-01T01:07:18.925 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_file_reader_items": 0, 2023-12-01T01:07:18.925 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_file_writer_bytes": 0, 2023-12-01T01:07:18.925 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_file_writer_items": 0, 2023-12-01T01:07:18.925 INFO:teuthology.orchestra.run.smithi093.stdout: "buffer_anon_bytes": 148823, 2023-12-01T01:07:18.925 INFO:teuthology.orchestra.run.smithi093.stdout: "buffer_anon_items": 27, 2023-12-01T01:07:18.925 INFO:teuthology.orchestra.run.smithi093.stdout: "buffer_meta_bytes": 0, 2023-12-01T01:07:18.926 INFO:teuthology.orchestra.run.smithi093.stdout: "buffer_meta_items": 0, 2023-12-01T01:07:18.926 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_bytes": 0, 2023-12-01T01:07:18.926 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_items": 0, 2023-12-01T01:07:18.926 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_mapbl_bytes": 0, 2023-12-01T01:07:18.926 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_mapbl_items": 0, 2023-12-01T01:07:18.926 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_pglog_bytes": 0, 2023-12-01T01:07:18.926 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_pglog_items": 0, 2023-12-01T01:07:18.926 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_bytes": 0, 2023-12-01T01:07:18.926 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_items": 0, 2023-12-01T01:07:18.926 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_mapping_bytes": 0, 2023-12-01T01:07:18.926 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_mapping_items": 0, 2023-12-01T01:07:18.926 INFO:teuthology.orchestra.run.smithi093.stdout: "pgmap_bytes": 0, 2023-12-01T01:07:18.926 INFO:teuthology.orchestra.run.smithi093.stdout: "pgmap_items": 0, 2023-12-01T01:07:18.926 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_co_bytes": 928, 2023-12-01T01:07:18.926 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_co_items": 2, 2023-12-01T01:07:18.927 INFO:teuthology.orchestra.run.smithi093.stdout: "unittest_1_bytes": 0, 2023-12-01T01:07:18.927 INFO:teuthology.orchestra.run.smithi093.stdout: "unittest_1_items": 0, 2023-12-01T01:07:18.927 INFO:teuthology.orchestra.run.smithi093.stdout: "unittest_2_bytes": 0, 2023-12-01T01:07:18.927 INFO:teuthology.orchestra.run.smithi093.stdout: "unittest_2_items": 0 2023-12-01T01:07:18.927 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:18.927 INFO:teuthology.orchestra.run.smithi093.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-01T01:07:18.927 INFO:teuthology.orchestra.run.smithi093.stdout: "val": 0, 2023-12-01T01:07:18.927 INFO:teuthology.orchestra.run.smithi093.stdout: "max": 104857600, 2023-12-01T01:07:18.927 INFO:teuthology.orchestra.run.smithi093.stdout: "get_started": 0, 2023-12-01T01:07:18.927 INFO:teuthology.orchestra.run.smithi093.stdout: "get": 86, 2023-12-01T01:07:18.927 INFO:teuthology.orchestra.run.smithi093.stdout: "get_sum": 419281, 2023-12-01T01:07:18.927 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:18.927 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_success": 86, 2023-12-01T01:07:18.927 INFO:teuthology.orchestra.run.smithi093.stdout: "take": 0, 2023-12-01T01:07:18.927 INFO:teuthology.orchestra.run.smithi093.stdout: "take_sum": 0, 2023-12-01T01:07:18.928 INFO:teuthology.orchestra.run.smithi093.stdout: "put": 86, 2023-12-01T01:07:18.928 INFO:teuthology.orchestra.run.smithi093.stdout: "put_sum": 419281, 2023-12-01T01:07:18.928 INFO:teuthology.orchestra.run.smithi093.stdout: "wait": { 2023-12-01T01:07:18.928 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:18.928 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:18.928 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:18.928 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:18.928 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:18.928 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-12-01T01:07:19.347 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.e 2023-12-01T01:07:19.348 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.e 2023-12-01T01:07:19.348 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.e 2023-12-01T01:07:19.348 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.e 2023-12-01T01:07:19.348 DEBUG:tasks.check_counter:Getting stats from h 2023-12-01T01:07:19.348 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph daemon mds.h perf dump 2023-12-01T01:07:19.896 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.b/config 2023-12-01T01:07:20.121 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:19 smithi093 ceph-mon[103327]: pgmap v384: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-01T01:07:20.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:19 smithi116 ceph-mon[103554]: pgmap v384: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-01T01:07:20.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:19 smithi026 ceph-mon[98801]: pgmap v384: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-01T01:07:21.206 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-12-01T01:07:21.206 INFO:teuthology.orchestra.run.smithi093.stdout: "AsyncMessenger::Worker-0": { 2023-12-01T01:07:21.206 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_messages": 164, 2023-12-01T01:07:21.206 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages": 166, 2023-12-01T01:07:21.206 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_bytes": 24210628, 2023-12-01T01:07:21.206 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_bytes": 51014, 2023-12-01T01:07:21.207 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_created_connections": 7, 2023-12-01T01:07:21.207 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_active_connections": 3, 2023-12-01T01:07:21.207 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_total_time": 0.027680747, 2023-12-01T01:07:21.207 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_send_time": 0.004440443, 2023-12-01T01:07:21.207 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_recv_time": 0.016720805, 2023-12-01T01:07:21.207 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_fast_dispatch_time": 0.004316591, 2023-12-01T01:07:21.207 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:21.207 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 164, 2023-12-01T01:07:21.207 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.011341466, 2023-12-01T01:07:21.207 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000069155 2023-12-01T01:07:21.207 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.207 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:21.207 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.207 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.207 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.208 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.208 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-01T01:07:21.208 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_encrypted_bytes": 0 2023-12-01T01:07:21.208 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.208 INFO:teuthology.orchestra.run.smithi093.stdout: "AsyncMessenger::Worker-1": { 2023-12-01T01:07:21.208 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_messages": 113, 2023-12-01T01:07:21.208 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages": 104, 2023-12-01T01:07:21.208 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_bytes": 21181271, 2023-12-01T01:07:21.208 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_bytes": 37262, 2023-12-01T01:07:21.208 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_created_connections": 5, 2023-12-01T01:07:21.208 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_active_connections": 4, 2023-12-01T01:07:21.208 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_total_time": 0.023435224, 2023-12-01T01:07:21.208 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_send_time": 0.002868664, 2023-12-01T01:07:21.208 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_recv_time": 0.019392414, 2023-12-01T01:07:21.208 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_fast_dispatch_time": 0.002199893, 2023-12-01T01:07:21.209 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:21.209 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 104, 2023-12-01T01:07:21.209 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.006511629, 2023-12-01T01:07:21.209 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000062611 2023-12-01T01:07:21.209 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.209 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:21.209 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.209 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.209 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.209 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.209 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_encrypted_bytes": 184656, 2023-12-01T01:07:21.209 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_encrypted_bytes": 16048 2023-12-01T01:07:21.209 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.209 INFO:teuthology.orchestra.run.smithi093.stdout: "AsyncMessenger::Worker-2": { 2023-12-01T01:07:21.209 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_messages": 136, 2023-12-01T01:07:21.210 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages": 156, 2023-12-01T01:07:21.210 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_bytes": 15484591, 2023-12-01T01:07:21.210 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_bytes": 158754, 2023-12-01T01:07:21.210 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_created_connections": 6, 2023-12-01T01:07:21.210 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_active_connections": 5, 2023-12-01T01:07:21.210 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_total_time": 0.019440930, 2023-12-01T01:07:21.210 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_send_time": 0.003127416, 2023-12-01T01:07:21.210 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_recv_time": 0.012165414, 2023-12-01T01:07:21.210 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_fast_dispatch_time": 0.003190566, 2023-12-01T01:07:21.210 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:21.210 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 154, 2023-12-01T01:07:21.210 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.005832285, 2023-12-01T01:07:21.210 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000037871 2023-12-01T01:07:21.210 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.210 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:21.211 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.211 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.211 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.211 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.211 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-01T01:07:21.211 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_encrypted_bytes": 116768 2023-12-01T01:07:21.211 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.211 INFO:teuthology.orchestra.run.smithi093.stdout: "cct": { 2023-12-01T01:07:21.211 INFO:teuthology.orchestra.run.smithi093.stdout: "total_workers": 1, 2023-12-01T01:07:21.211 INFO:teuthology.orchestra.run.smithi093.stdout: "unhealthy_workers": 0 2023-12-01T01:07:21.211 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.211 INFO:teuthology.orchestra.run.smithi093.stdout: "finisher-MDSRank": { 2023-12-01T01:07:21.211 INFO:teuthology.orchestra.run.smithi093.stdout: "queue_len": 0, 2023-12-01T01:07:21.211 INFO:teuthology.orchestra.run.smithi093.stdout: "complete_latency": { 2023-12-01T01:07:21.211 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 571, 2023-12-01T01:07:21.212 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.122566165, 2023-12-01T01:07:21.212 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000214651 2023-12-01T01:07:21.212 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:21.212 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.212 INFO:teuthology.orchestra.run.smithi093.stdout: "finisher-PurgeQueue": { 2023-12-01T01:07:21.212 INFO:teuthology.orchestra.run.smithi093.stdout: "queue_len": 0, 2023-12-01T01:07:21.212 INFO:teuthology.orchestra.run.smithi093.stdout: "complete_latency": { 2023-12-01T01:07:21.212 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.212 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.212 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.212 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:21.212 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.212 INFO:teuthology.orchestra.run.smithi093.stdout: "mds": { 2023-12-01T01:07:21.212 INFO:teuthology.orchestra.run.smithi093.stdout: "request": 0, 2023-12-01T01:07:21.212 INFO:teuthology.orchestra.run.smithi093.stdout: "reply": 0, 2023-12-01T01:07:21.212 INFO:teuthology.orchestra.run.smithi093.stdout: "reply_latency": { 2023-12-01T01:07:21.213 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.213 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.213 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.213 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.213 INFO:teuthology.orchestra.run.smithi093.stdout: "slow_reply": 0, 2023-12-01T01:07:21.213 INFO:teuthology.orchestra.run.smithi093.stdout: "forward": 0, 2023-12-01T01:07:21.213 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_fetch_complete": 0, 2023-12-01T01:07:21.213 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_fetch_keys": 0, 2023-12-01T01:07:21.213 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_commit": 0, 2023-12-01T01:07:21.213 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_split": 0, 2023-12-01T01:07:21.213 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_merge": 0, 2023-12-01T01:07:21.213 INFO:teuthology.orchestra.run.smithi093.stdout: "inodes": 792, 2023-12-01T01:07:21.213 INFO:teuthology.orchestra.run.smithi093.stdout: "inodes_top": 542, 2023-12-01T01:07:21.213 INFO:teuthology.orchestra.run.smithi093.stdout: "inodes_bottom": 237, 2023-12-01T01:07:21.213 INFO:teuthology.orchestra.run.smithi093.stdout: "inodes_pin_tail": 13, 2023-12-01T01:07:21.214 INFO:teuthology.orchestra.run.smithi093.stdout: "inodes_pinned": 17, 2023-12-01T01:07:21.214 INFO:teuthology.orchestra.run.smithi093.stdout: "inodes_expired": 3972, 2023-12-01T01:07:21.214 INFO:teuthology.orchestra.run.smithi093.stdout: "inodes_with_caps": 0, 2023-12-01T01:07:21.214 INFO:teuthology.orchestra.run.smithi093.stdout: "caps": 0, 2023-12-01T01:07:21.214 INFO:teuthology.orchestra.run.smithi093.stdout: "subtrees": 2, 2023-12-01T01:07:21.214 INFO:teuthology.orchestra.run.smithi093.stdout: "traverse": 0, 2023-12-01T01:07:21.214 INFO:teuthology.orchestra.run.smithi093.stdout: "traverse_hit": 0, 2023-12-01T01:07:21.214 INFO:teuthology.orchestra.run.smithi093.stdout: "traverse_forward": 0, 2023-12-01T01:07:21.214 INFO:teuthology.orchestra.run.smithi093.stdout: "traverse_discover": 0, 2023-12-01T01:07:21.214 INFO:teuthology.orchestra.run.smithi093.stdout: "traverse_dir_fetch": 0, 2023-12-01T01:07:21.214 INFO:teuthology.orchestra.run.smithi093.stdout: "traverse_remote_ino": 0, 2023-12-01T01:07:21.214 INFO:teuthology.orchestra.run.smithi093.stdout: "traverse_lock": 0, 2023-12-01T01:07:21.214 INFO:teuthology.orchestra.run.smithi093.stdout: "load_cent": 0, 2023-12-01T01:07:21.214 INFO:teuthology.orchestra.run.smithi093.stdout: "q": 0, 2023-12-01T01:07:21.214 INFO:teuthology.orchestra.run.smithi093.stdout: "exported": 0, 2023-12-01T01:07:21.215 INFO:teuthology.orchestra.run.smithi093.stdout: "exported_inodes": 0, 2023-12-01T01:07:21.215 INFO:teuthology.orchestra.run.smithi093.stdout: "imported": 0, 2023-12-01T01:07:21.215 INFO:teuthology.orchestra.run.smithi093.stdout: "imported_inodes": 0, 2023-12-01T01:07:21.215 INFO:teuthology.orchestra.run.smithi093.stdout: "openino_dir_fetch": 0, 2023-12-01T01:07:21.215 INFO:teuthology.orchestra.run.smithi093.stdout: "openino_backtrace_fetch": 0, 2023-12-01T01:07:21.215 INFO:teuthology.orchestra.run.smithi093.stdout: "openino_peer_discover": 0, 2023-12-01T01:07:21.215 INFO:teuthology.orchestra.run.smithi093.stdout: "root_rfiles": 153, 2023-12-01T01:07:21.215 INFO:teuthology.orchestra.run.smithi093.stdout: "root_rbytes": 1316516, 2023-12-01T01:07:21.215 INFO:teuthology.orchestra.run.smithi093.stdout: "root_rsnaps": 0, 2023-12-01T01:07:21.215 INFO:teuthology.orchestra.run.smithi093.stdout: "scrub_backtrace_fetch": 0, 2023-12-01T01:07:21.215 INFO:teuthology.orchestra.run.smithi093.stdout: "scrub_set_tag": 0, 2023-12-01T01:07:21.215 INFO:teuthology.orchestra.run.smithi093.stdout: "scrub_backtrace_repaired": 0, 2023-12-01T01:07:21.215 INFO:teuthology.orchestra.run.smithi093.stdout: "scrub_inotable_repaired": 0, 2023-12-01T01:07:21.215 INFO:teuthology.orchestra.run.smithi093.stdout: "scrub_dir_inodes": 0, 2023-12-01T01:07:21.215 INFO:teuthology.orchestra.run.smithi093.stdout: "scrub_dir_base_inodes": 0, 2023-12-01T01:07:21.215 INFO:teuthology.orchestra.run.smithi093.stdout: "scrub_dirfrag_rstats": 0, 2023-12-01T01:07:21.216 INFO:teuthology.orchestra.run.smithi093.stdout: "scrub_file_inodes": 0, 2023-12-01T01:07:21.216 INFO:teuthology.orchestra.run.smithi093.stdout: "handle_inode_file_caps": 0, 2023-12-01T01:07:21.216 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_cap_op_revoke": 0, 2023-12-01T01:07:21.216 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_cap_op_grant": 0, 2023-12-01T01:07:21.216 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_cap_op_trunc": 0, 2023-12-01T01:07:21.216 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-01T01:07:21.216 INFO:teuthology.orchestra.run.smithi093.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-01T01:07:21.216 INFO:teuthology.orchestra.run.smithi093.stdout: "handle_client_caps": 0, 2023-12-01T01:07:21.216 INFO:teuthology.orchestra.run.smithi093.stdout: "handle_client_caps_dirty": 0, 2023-12-01T01:07:21.216 INFO:teuthology.orchestra.run.smithi093.stdout: "handle_client_cap_release": 0, 2023-12-01T01:07:21.216 INFO:teuthology.orchestra.run.smithi093.stdout: "process_request_cap_release": 0 2023-12-01T01:07:21.216 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.216 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_cache": { 2023-12-01T01:07:21.216 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_update": 0, 2023-12-01T01:07:21.216 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_update_receipt": 0, 2023-12-01T01:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_try_discover": 0, 2023-12-01T01:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_send_discover": 0, 2023-12-01T01:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: "dir_handle_discover": 0, 2023-12-01T01:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: "num_strays": 0, 2023-12-01T01:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: "num_strays_delayed": 0, 2023-12-01T01:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: "num_strays_enqueuing": 0, 2023-12-01T01:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: "strays_created": 0, 2023-12-01T01:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: "strays_enqueued": 0, 2023-12-01T01:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: "strays_reintegrated": 0, 2023-12-01T01:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: "strays_migrated": 0, 2023-12-01T01:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: "num_recovering_processing": 0, 2023-12-01T01:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: "num_recovering_enqueued": 0, 2023-12-01T01:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: "num_recovering_prioritized": 0, 2023-12-01T01:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: "recovery_started": 0, 2023-12-01T01:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: "recovery_completed": 0, 2023-12-01T01:07:21.217 INFO:teuthology.orchestra.run.smithi093.stdout: "ireq_enqueue_scrub": 0, 2023-12-01T01:07:21.218 INFO:teuthology.orchestra.run.smithi093.stdout: "ireq_exportdir": 0, 2023-12-01T01:07:21.218 INFO:teuthology.orchestra.run.smithi093.stdout: "ireq_flush": 0, 2023-12-01T01:07:21.218 INFO:teuthology.orchestra.run.smithi093.stdout: "ireq_fragmentdir": 0, 2023-12-01T01:07:21.218 INFO:teuthology.orchestra.run.smithi093.stdout: "ireq_fragstats": 0, 2023-12-01T01:07:21.218 INFO:teuthology.orchestra.run.smithi093.stdout: "ireq_inodestats": 0 2023-12-01T01:07:21.218 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.218 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_log": { 2023-12-01T01:07:21.218 INFO:teuthology.orchestra.run.smithi093.stdout: "evadd": 0, 2023-12-01T01:07:21.218 INFO:teuthology.orchestra.run.smithi093.stdout: "evex": 0, 2023-12-01T01:07:21.218 INFO:teuthology.orchestra.run.smithi093.stdout: "evtrm": 0, 2023-12-01T01:07:21.218 INFO:teuthology.orchestra.run.smithi093.stdout: "ev": 28711, 2023-12-01T01:07:21.218 INFO:teuthology.orchestra.run.smithi093.stdout: "evexg": 0, 2023-12-01T01:07:21.218 INFO:teuthology.orchestra.run.smithi093.stdout: "evexd": 0, 2023-12-01T01:07:21.219 INFO:teuthology.orchestra.run.smithi093.stdout: "segadd": 0, 2023-12-01T01:07:21.219 INFO:teuthology.orchestra.run.smithi093.stdout: "segex": 0, 2023-12-01T01:07:21.219 INFO:teuthology.orchestra.run.smithi093.stdout: "segtrm": 0, 2023-12-01T01:07:21.220 INFO:teuthology.orchestra.run.smithi093.stdout: "seg": 2, 2023-12-01T01:07:21.220 INFO:teuthology.orchestra.run.smithi093.stdout: "segexg": 0, 2023-12-01T01:07:21.220 INFO:teuthology.orchestra.run.smithi093.stdout: "segexd": 0, 2023-12-01T01:07:21.220 INFO:teuthology.orchestra.run.smithi093.stdout: "expos": 65745263, 2023-12-01T01:07:21.220 INFO:teuthology.orchestra.run.smithi093.stdout: "wrpos": 65781726, 2023-12-01T01:07:21.220 INFO:teuthology.orchestra.run.smithi093.stdout: "rdpos": 65779733, 2023-12-01T01:07:21.220 INFO:teuthology.orchestra.run.smithi093.stdout: "jlat": { 2023-12-01T01:07:21.220 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.220 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.220 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.220 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.220 INFO:teuthology.orchestra.run.smithi093.stdout: "replayed": 28711 2023-12-01T01:07:21.220 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.220 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_mem": { 2023-12-01T01:07:21.220 INFO:teuthology.orchestra.run.smithi093.stdout: "ino": 20, 2023-12-01T01:07:21.221 INFO:teuthology.orchestra.run.smithi093.stdout: "ino+": 10213, 2023-12-01T01:07:21.221 INFO:teuthology.orchestra.run.smithi093.stdout: "ino-": 10193, 2023-12-01T01:07:21.221 INFO:teuthology.orchestra.run.smithi093.stdout: "dir": 22, 2023-12-01T01:07:21.221 INFO:teuthology.orchestra.run.smithi093.stdout: "dir+": 754, 2023-12-01T01:07:21.221 INFO:teuthology.orchestra.run.smithi093.stdout: "dir-": 732, 2023-12-01T01:07:21.221 INFO:teuthology.orchestra.run.smithi093.stdout: "dn": 792, 2023-12-01T01:07:21.221 INFO:teuthology.orchestra.run.smithi093.stdout: "dn+": 12537, 2023-12-01T01:07:21.221 INFO:teuthology.orchestra.run.smithi093.stdout: "dn-": 11745, 2023-12-01T01:07:21.221 INFO:teuthology.orchestra.run.smithi093.stdout: "cap": 0, 2023-12-01T01:07:21.221 INFO:teuthology.orchestra.run.smithi093.stdout: "cap+": 0, 2023-12-01T01:07:21.221 INFO:teuthology.orchestra.run.smithi093.stdout: "cap-": 0, 2023-12-01T01:07:21.221 INFO:teuthology.orchestra.run.smithi093.stdout: "rss": 59416, 2023-12-01T01:07:21.221 INFO:teuthology.orchestra.run.smithi093.stdout: "heap": 207156 2023-12-01T01:07:21.221 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.221 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_server": { 2023-12-01T01:07:21.222 INFO:teuthology.orchestra.run.smithi093.stdout: "dispatch_client_request": 0, 2023-12-01T01:07:21.222 INFO:teuthology.orchestra.run.smithi093.stdout: "dispatch_server_request": 0, 2023-12-01T01:07:21.222 INFO:teuthology.orchestra.run.smithi093.stdout: "handle_client_request": 0, 2023-12-01T01:07:21.222 INFO:teuthology.orchestra.run.smithi093.stdout: "handle_client_session": 0, 2023-12-01T01:07:21.222 INFO:teuthology.orchestra.run.smithi093.stdout: "handle_peer_request": 0, 2023-12-01T01:07:21.222 INFO:teuthology.orchestra.run.smithi093.stdout: "req_create_latency": { 2023-12-01T01:07:21.222 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.222 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.222 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.222 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.222 INFO:teuthology.orchestra.run.smithi093.stdout: "req_getattr_latency": { 2023-12-01T01:07:21.222 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.222 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.222 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.222 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.223 INFO:teuthology.orchestra.run.smithi093.stdout: "req_getfilelock_latency": { 2023-12-01T01:07:21.223 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.223 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.223 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.223 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.223 INFO:teuthology.orchestra.run.smithi093.stdout: "req_link_latency": { 2023-12-01T01:07:21.223 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.223 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.223 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.223 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.223 INFO:teuthology.orchestra.run.smithi093.stdout: "req_lookup_latency": { 2023-12-01T01:07:21.223 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.223 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.223 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.223 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.224 INFO:teuthology.orchestra.run.smithi093.stdout: "req_lookuphash_latency": { 2023-12-01T01:07:21.224 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.224 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.224 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.224 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.224 INFO:teuthology.orchestra.run.smithi093.stdout: "req_lookupino_latency": { 2023-12-01T01:07:21.224 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.224 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.224 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.224 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.224 INFO:teuthology.orchestra.run.smithi093.stdout: "req_lookupname_latency": { 2023-12-01T01:07:21.224 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.224 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.224 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.224 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.225 INFO:teuthology.orchestra.run.smithi093.stdout: "req_lookupparent_latency": { 2023-12-01T01:07:21.225 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.225 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.225 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.225 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.225 INFO:teuthology.orchestra.run.smithi093.stdout: "req_lookupsnap_latency": { 2023-12-01T01:07:21.225 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.225 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.225 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.225 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.225 INFO:teuthology.orchestra.run.smithi093.stdout: "req_lssnap_latency": { 2023-12-01T01:07:21.225 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.225 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.225 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.225 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.225 INFO:teuthology.orchestra.run.smithi093.stdout: "req_mkdir_latency": { 2023-12-01T01:07:21.226 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.226 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.226 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.226 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.226 INFO:teuthology.orchestra.run.smithi093.stdout: "req_mknod_latency": { 2023-12-01T01:07:21.226 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.226 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.226 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.226 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.226 INFO:teuthology.orchestra.run.smithi093.stdout: "req_mksnap_latency": { 2023-12-01T01:07:21.226 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.226 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.226 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.226 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.227 INFO:teuthology.orchestra.run.smithi093.stdout: "req_open_latency": { 2023-12-01T01:07:21.227 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.227 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.227 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.227 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.227 INFO:teuthology.orchestra.run.smithi093.stdout: "req_readdir_latency": { 2023-12-01T01:07:21.227 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.227 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.227 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.227 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.227 INFO:teuthology.orchestra.run.smithi093.stdout: "req_rename_latency": { 2023-12-01T01:07:21.227 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.227 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.227 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.227 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.228 INFO:teuthology.orchestra.run.smithi093.stdout: "req_renamesnap_latency": { 2023-12-01T01:07:21.228 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.228 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.228 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.228 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.228 INFO:teuthology.orchestra.run.smithi093.stdout: "req_snapdiff_latency": { 2023-12-01T01:07:21.228 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.228 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.228 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.228 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.228 INFO:teuthology.orchestra.run.smithi093.stdout: "req_rmdir_latency": { 2023-12-01T01:07:21.228 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.228 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.228 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.228 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.229 INFO:teuthology.orchestra.run.smithi093.stdout: "req_rmsnap_latency": { 2023-12-01T01:07:21.229 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.229 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.229 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.229 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.229 INFO:teuthology.orchestra.run.smithi093.stdout: "req_rmxattr_latency": { 2023-12-01T01:07:21.229 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.229 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.229 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.229 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.229 INFO:teuthology.orchestra.run.smithi093.stdout: "req_setattr_latency": { 2023-12-01T01:07:21.229 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.229 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.229 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.229 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.230 INFO:teuthology.orchestra.run.smithi093.stdout: "req_setdirlayout_latency": { 2023-12-01T01:07:21.230 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.230 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.230 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.230 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.230 INFO:teuthology.orchestra.run.smithi093.stdout: "req_setfilelock_latency": { 2023-12-01T01:07:21.230 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.230 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.230 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.230 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.230 INFO:teuthology.orchestra.run.smithi093.stdout: "req_setlayout_latency": { 2023-12-01T01:07:21.230 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.230 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.230 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.230 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.231 INFO:teuthology.orchestra.run.smithi093.stdout: "req_setxattr_latency": { 2023-12-01T01:07:21.231 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.231 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.231 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.231 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.231 INFO:teuthology.orchestra.run.smithi093.stdout: "req_symlink_latency": { 2023-12-01T01:07:21.231 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.231 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.231 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.231 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.231 INFO:teuthology.orchestra.run.smithi093.stdout: "req_unlink_latency": { 2023-12-01T01:07:21.231 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.231 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.231 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.231 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.232 INFO:teuthology.orchestra.run.smithi093.stdout: "cap_revoke_eviction": 0, 2023-12-01T01:07:21.232 INFO:teuthology.orchestra.run.smithi093.stdout: "cap_acquisition_throttle": 0, 2023-12-01T01:07:21.232 INFO:teuthology.orchestra.run.smithi093.stdout: "req_getvxattr_latency": { 2023-12-01T01:07:21.232 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.232 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.232 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.232 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:21.232 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.232 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_sessions": { 2023-12-01T01:07:21.232 INFO:teuthology.orchestra.run.smithi093.stdout: "session_count": 1, 2023-12-01T01:07:21.232 INFO:teuthology.orchestra.run.smithi093.stdout: "session_add": 1, 2023-12-01T01:07:21.232 INFO:teuthology.orchestra.run.smithi093.stdout: "session_remove": 0, 2023-12-01T01:07:21.232 INFO:teuthology.orchestra.run.smithi093.stdout: "sessions_open": 0, 2023-12-01T01:07:21.232 INFO:teuthology.orchestra.run.smithi093.stdout: "sessions_stale": 0, 2023-12-01T01:07:21.232 INFO:teuthology.orchestra.run.smithi093.stdout: "total_load": 0, 2023-12-01T01:07:21.233 INFO:teuthology.orchestra.run.smithi093.stdout: "average_load": 0, 2023-12-01T01:07:21.233 INFO:teuthology.orchestra.run.smithi093.stdout: "avg_session_uptime": 1508, 2023-12-01T01:07:21.233 INFO:teuthology.orchestra.run.smithi093.stdout: "mdthresh_evicted": 0 2023-12-01T01:07:21.233 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.233 INFO:teuthology.orchestra.run.smithi093.stdout: "mempool": { 2023-12-01T01:07:21.233 INFO:teuthology.orchestra.run.smithi093.stdout: "bloom_filter_bytes": 0, 2023-12-01T01:07:21.233 INFO:teuthology.orchestra.run.smithi093.stdout: "bloom_filter_items": 0, 2023-12-01T01:07:21.233 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_alloc_bytes": 0, 2023-12-01T01:07:21.233 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_alloc_items": 0, 2023-12-01T01:07:21.233 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_data_bytes": 0, 2023-12-01T01:07:21.233 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_data_items": 0, 2023-12-01T01:07:21.233 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-01T01:07:21.233 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_onode_items": 0, 2023-12-01T01:07:21.233 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-01T01:07:21.233 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_meta_items": 0, 2023-12-01T01:07:21.233 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_other_bytes": 0, 2023-12-01T01:07:21.234 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_other_items": 0, 2023-12-01T01:07:21.234 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-01T01:07:21.234 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_buffer_items": 0, 2023-12-01T01:07:21.234 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_extent_bytes": 0, 2023-12-01T01:07:21.234 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_extent_items": 0, 2023-12-01T01:07:21.234 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_blob_bytes": 0, 2023-12-01T01:07:21.234 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_blob_items": 0, 2023-12-01T01:07:21.234 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-01T01:07:21.234 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_shared_blob_items": 0, 2023-12-01T01:07:21.234 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-01T01:07:21.234 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_inline_bl_items": 0, 2023-12-01T01:07:21.234 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_fsck_bytes": 0, 2023-12-01T01:07:21.234 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_fsck_items": 0, 2023-12-01T01:07:21.234 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_txc_bytes": 0, 2023-12-01T01:07:21.234 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_txc_items": 0, 2023-12-01T01:07:21.235 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-01T01:07:21.235 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_writing_deferred_items": 0, 2023-12-01T01:07:21.235 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_writing_bytes": 0, 2023-12-01T01:07:21.235 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_writing_items": 0, 2023-12-01T01:07:21.235 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_bytes": 0, 2023-12-01T01:07:21.235 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_items": 0, 2023-12-01T01:07:21.235 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_file_reader_bytes": 0, 2023-12-01T01:07:21.235 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_file_reader_items": 0, 2023-12-01T01:07:21.235 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_file_writer_bytes": 0, 2023-12-01T01:07:21.235 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_file_writer_items": 0, 2023-12-01T01:07:21.235 INFO:teuthology.orchestra.run.smithi093.stdout: "buffer_anon_bytes": 220861, 2023-12-01T01:07:21.235 INFO:teuthology.orchestra.run.smithi093.stdout: "buffer_anon_items": 64, 2023-12-01T01:07:21.235 INFO:teuthology.orchestra.run.smithi093.stdout: "buffer_meta_bytes": 0, 2023-12-01T01:07:21.235 INFO:teuthology.orchestra.run.smithi093.stdout: "buffer_meta_items": 0, 2023-12-01T01:07:21.235 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_bytes": 0, 2023-12-01T01:07:21.236 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_items": 0, 2023-12-01T01:07:21.236 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_mapbl_bytes": 0, 2023-12-01T01:07:21.236 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_mapbl_items": 0, 2023-12-01T01:07:21.236 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_pglog_bytes": 0, 2023-12-01T01:07:21.236 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_pglog_items": 0, 2023-12-01T01:07:21.236 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_bytes": 7528, 2023-12-01T01:07:21.236 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_items": 158, 2023-12-01T01:07:21.236 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_mapping_bytes": 0, 2023-12-01T01:07:21.236 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_mapping_items": 0, 2023-12-01T01:07:21.236 INFO:teuthology.orchestra.run.smithi093.stdout: "pgmap_bytes": 0, 2023-12-01T01:07:21.236 INFO:teuthology.orchestra.run.smithi093.stdout: "pgmap_items": 0, 2023-12-01T01:07:21.236 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_co_bytes": 623162, 2023-12-01T01:07:21.236 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_co_items": 4055, 2023-12-01T01:07:21.236 INFO:teuthology.orchestra.run.smithi093.stdout: "unittest_1_bytes": 0, 2023-12-01T01:07:21.236 INFO:teuthology.orchestra.run.smithi093.stdout: "unittest_1_items": 0, 2023-12-01T01:07:21.236 INFO:teuthology.orchestra.run.smithi093.stdout: "unittest_2_bytes": 0, 2023-12-01T01:07:21.237 INFO:teuthology.orchestra.run.smithi093.stdout: "unittest_2_items": 0 2023-12-01T01:07:21.237 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.237 INFO:teuthology.orchestra.run.smithi093.stdout: "objecter": { 2023-12-01T01:07:21.237 INFO:teuthology.orchestra.run.smithi093.stdout: "op_active": 0, 2023-12-01T01:07:21.237 INFO:teuthology.orchestra.run.smithi093.stdout: "op_laggy": 0, 2023-12-01T01:07:21.237 INFO:teuthology.orchestra.run.smithi093.stdout: "op_send": 367, 2023-12-01T01:07:21.237 INFO:teuthology.orchestra.run.smithi093.stdout: "op_send_bytes": 26, 2023-12-01T01:07:21.237 INFO:teuthology.orchestra.run.smithi093.stdout: "op_resend": 4, 2023-12-01T01:07:21.237 INFO:teuthology.orchestra.run.smithi093.stdout: "op_reply": 367, 2023-12-01T01:07:21.237 INFO:teuthology.orchestra.run.smithi093.stdout: "op_latency": { 2023-12-01T01:07:21.237 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 367, 2023-12-01T01:07:21.237 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.814982097, 2023-12-01T01:07:21.237 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.002220659 2023-12-01T01:07:21.237 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.237 INFO:teuthology.orchestra.run.smithi093.stdout: "op_inflight": 0, 2023-12-01T01:07:21.238 INFO:teuthology.orchestra.run.smithi093.stdout: "oplen_avg": { 2023-12-01T01:07:21.238 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 367, 2023-12-01T01:07:21.238 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 368 2023-12-01T01:07:21.238 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.238 INFO:teuthology.orchestra.run.smithi093.stdout: "op": 367, 2023-12-01T01:07:21.238 INFO:teuthology.orchestra.run.smithi093.stdout: "op_r": 367, 2023-12-01T01:07:21.238 INFO:teuthology.orchestra.run.smithi093.stdout: "op_w": 0, 2023-12-01T01:07:21.238 INFO:teuthology.orchestra.run.smithi093.stdout: "op_rmw": 0, 2023-12-01T01:07:21.238 INFO:teuthology.orchestra.run.smithi093.stdout: "op_pg": 0, 2023-12-01T01:07:21.238 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_stat": 217, 2023-12-01T01:07:21.238 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_create": 0, 2023-12-01T01:07:21.238 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_read": 147, 2023-12-01T01:07:21.238 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_write": 0, 2023-12-01T01:07:21.238 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_writefull": 0, 2023-12-01T01:07:21.238 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_writesame": 0, 2023-12-01T01:07:21.239 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_append": 0, 2023-12-01T01:07:21.239 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_zero": 0, 2023-12-01T01:07:21.239 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_truncate": 0, 2023-12-01T01:07:21.239 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_delete": 0, 2023-12-01T01:07:21.239 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_mapext": 0, 2023-12-01T01:07:21.239 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_sparse_read": 0, 2023-12-01T01:07:21.239 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_clonerange": 0, 2023-12-01T01:07:21.239 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_getxattr": 2, 2023-12-01T01:07:21.239 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_setxattr": 0, 2023-12-01T01:07:21.239 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_cmpxattr": 0, 2023-12-01T01:07:21.239 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_rmxattr": 0, 2023-12-01T01:07:21.239 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_resetxattrs": 0, 2023-12-01T01:07:21.239 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_call": 0, 2023-12-01T01:07:21.239 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_watch": 0, 2023-12-01T01:07:21.239 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_notify": 0, 2023-12-01T01:07:21.239 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_src_cmpxattr": 0, 2023-12-01T01:07:21.240 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_pgls": 0, 2023-12-01T01:07:21.240 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_pgls_filter": 0, 2023-12-01T01:07:21.240 INFO:teuthology.orchestra.run.smithi093.stdout: "osdop_other": 0, 2023-12-01T01:07:21.240 INFO:teuthology.orchestra.run.smithi093.stdout: "linger_active": 0, 2023-12-01T01:07:21.240 INFO:teuthology.orchestra.run.smithi093.stdout: "linger_send": 0, 2023-12-01T01:07:21.240 INFO:teuthology.orchestra.run.smithi093.stdout: "linger_resend": 0, 2023-12-01T01:07:21.240 INFO:teuthology.orchestra.run.smithi093.stdout: "linger_ping": 0, 2023-12-01T01:07:21.240 INFO:teuthology.orchestra.run.smithi093.stdout: "poolop_active": 0, 2023-12-01T01:07:21.240 INFO:teuthology.orchestra.run.smithi093.stdout: "poolop_send": 0, 2023-12-01T01:07:21.240 INFO:teuthology.orchestra.run.smithi093.stdout: "poolop_resend": 0, 2023-12-01T01:07:21.240 INFO:teuthology.orchestra.run.smithi093.stdout: "poolstat_active": 0, 2023-12-01T01:07:21.240 INFO:teuthology.orchestra.run.smithi093.stdout: "poolstat_send": 0, 2023-12-01T01:07:21.240 INFO:teuthology.orchestra.run.smithi093.stdout: "poolstat_resend": 0, 2023-12-01T01:07:21.240 INFO:teuthology.orchestra.run.smithi093.stdout: "statfs_active": 0, 2023-12-01T01:07:21.240 INFO:teuthology.orchestra.run.smithi093.stdout: "statfs_send": 0, 2023-12-01T01:07:21.240 INFO:teuthology.orchestra.run.smithi093.stdout: "statfs_resend": 0, 2023-12-01T01:07:21.241 INFO:teuthology.orchestra.run.smithi093.stdout: "command_active": 0, 2023-12-01T01:07:21.241 INFO:teuthology.orchestra.run.smithi093.stdout: "command_send": 0, 2023-12-01T01:07:21.241 INFO:teuthology.orchestra.run.smithi093.stdout: "command_resend": 0, 2023-12-01T01:07:21.241 INFO:teuthology.orchestra.run.smithi093.stdout: "map_epoch": 0, 2023-12-01T01:07:21.241 INFO:teuthology.orchestra.run.smithi093.stdout: "map_full": 0, 2023-12-01T01:07:21.241 INFO:teuthology.orchestra.run.smithi093.stdout: "map_inc": 0, 2023-12-01T01:07:21.241 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_sessions": 9, 2023-12-01T01:07:21.241 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_session_open": 9, 2023-12-01T01:07:21.241 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_session_close": 0, 2023-12-01T01:07:21.241 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_laggy": 0, 2023-12-01T01:07:21.241 INFO:teuthology.orchestra.run.smithi093.stdout: "omap_wr": 0, 2023-12-01T01:07:21.241 INFO:teuthology.orchestra.run.smithi093.stdout: "omap_rd": 2, 2023-12-01T01:07:21.241 INFO:teuthology.orchestra.run.smithi093.stdout: "omap_del": 0 2023-12-01T01:07:21.241 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.241 INFO:teuthology.orchestra.run.smithi093.stdout: "oft": { 2023-12-01T01:07:21.242 INFO:teuthology.orchestra.run.smithi093.stdout: "omap_total_objs": 0, 2023-12-01T01:07:21.242 INFO:teuthology.orchestra.run.smithi093.stdout: "omap_total_kv_pairs": 0, 2023-12-01T01:07:21.242 INFO:teuthology.orchestra.run.smithi093.stdout: "omap_total_updates": 0, 2023-12-01T01:07:21.242 INFO:teuthology.orchestra.run.smithi093.stdout: "omap_total_removes": 0 2023-12-01T01:07:21.242 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.242 INFO:teuthology.orchestra.run.smithi093.stdout: "osd-slow-ops": { 2023-12-01T01:07:21.242 INFO:teuthology.orchestra.run.smithi093.stdout: "slow_ops_count": 0 2023-12-01T01:07:21.242 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.242 INFO:teuthology.orchestra.run.smithi093.stdout: "purge_queue": { 2023-12-01T01:07:21.242 INFO:teuthology.orchestra.run.smithi093.stdout: "pq_executing_ops": 0, 2023-12-01T01:07:21.242 INFO:teuthology.orchestra.run.smithi093.stdout: "pq_executing_ops_high_water": 0, 2023-12-01T01:07:21.242 INFO:teuthology.orchestra.run.smithi093.stdout: "pq_executing": 0, 2023-12-01T01:07:21.242 INFO:teuthology.orchestra.run.smithi093.stdout: "pq_executing_high_water": 0, 2023-12-01T01:07:21.242 INFO:teuthology.orchestra.run.smithi093.stdout: "pq_executed": 0, 2023-12-01T01:07:21.242 INFO:teuthology.orchestra.run.smithi093.stdout: "pq_item_in_journal": 0 2023-12-01T01:07:21.243 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.243 INFO:teuthology.orchestra.run.smithi093.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-01T01:07:21.243 INFO:teuthology.orchestra.run.smithi093.stdout: "val": 0, 2023-12-01T01:07:21.243 INFO:teuthology.orchestra.run.smithi093.stdout: "max": 104857600, 2023-12-01T01:07:21.243 INFO:teuthology.orchestra.run.smithi093.stdout: "get_started": 0, 2023-12-01T01:07:21.243 INFO:teuthology.orchestra.run.smithi093.stdout: "get": 409, 2023-12-01T01:07:21.243 INFO:teuthology.orchestra.run.smithi093.stdout: "get_sum": 60834627, 2023-12-01T01:07:21.243 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:21.243 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_success": 409, 2023-12-01T01:07:21.243 INFO:teuthology.orchestra.run.smithi093.stdout: "take": 0, 2023-12-01T01:07:21.243 INFO:teuthology.orchestra.run.smithi093.stdout: "take_sum": 0, 2023-12-01T01:07:21.243 INFO:teuthology.orchestra.run.smithi093.stdout: "put": 409, 2023-12-01T01:07:21.243 INFO:teuthology.orchestra.run.smithi093.stdout: "put_sum": 60834627, 2023-12-01T01:07:21.243 INFO:teuthology.orchestra.run.smithi093.stdout: "wait": { 2023-12-01T01:07:21.243 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.243 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.244 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.244 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:21.244 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.244 INFO:teuthology.orchestra.run.smithi093.stdout: "throttle-objecter_bytes": { 2023-12-01T01:07:21.244 INFO:teuthology.orchestra.run.smithi093.stdout: "val": 0, 2023-12-01T01:07:21.244 INFO:teuthology.orchestra.run.smithi093.stdout: "max": 104857600, 2023-12-01T01:07:21.244 INFO:teuthology.orchestra.run.smithi093.stdout: "get_started": 0, 2023-12-01T01:07:21.244 INFO:teuthology.orchestra.run.smithi093.stdout: "get": 0, 2023-12-01T01:07:21.244 INFO:teuthology.orchestra.run.smithi093.stdout: "get_sum": 0, 2023-12-01T01:07:21.244 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:21.244 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:21.244 INFO:teuthology.orchestra.run.smithi093.stdout: "take": 367, 2023-12-01T01:07:21.244 INFO:teuthology.orchestra.run.smithi093.stdout: "take_sum": 60585030, 2023-12-01T01:07:21.244 INFO:teuthology.orchestra.run.smithi093.stdout: "put": 367, 2023-12-01T01:07:21.244 INFO:teuthology.orchestra.run.smithi093.stdout: "put_sum": 60585030, 2023-12-01T01:07:21.245 INFO:teuthology.orchestra.run.smithi093.stdout: "wait": { 2023-12-01T01:07:21.245 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.245 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.245 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.245 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:21.245 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.245 INFO:teuthology.orchestra.run.smithi093.stdout: "throttle-objecter_ops": { 2023-12-01T01:07:21.245 INFO:teuthology.orchestra.run.smithi093.stdout: "val": 0, 2023-12-01T01:07:21.246 INFO:teuthology.orchestra.run.smithi093.stdout: "max": 1024, 2023-12-01T01:07:21.246 INFO:teuthology.orchestra.run.smithi093.stdout: "get_started": 0, 2023-12-01T01:07:21.246 INFO:teuthology.orchestra.run.smithi093.stdout: "get": 0, 2023-12-01T01:07:21.246 INFO:teuthology.orchestra.run.smithi093.stdout: "get_sum": 0, 2023-12-01T01:07:21.246 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:21.246 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:21.246 INFO:teuthology.orchestra.run.smithi093.stdout: "take": 367, 2023-12-01T01:07:21.246 INFO:teuthology.orchestra.run.smithi093.stdout: "take_sum": 367, 2023-12-01T01:07:21.246 INFO:teuthology.orchestra.run.smithi093.stdout: "put": 367, 2023-12-01T01:07:21.246 INFO:teuthology.orchestra.run.smithi093.stdout: "put_sum": 367, 2023-12-01T01:07:21.246 INFO:teuthology.orchestra.run.smithi093.stdout: "wait": { 2023-12-01T01:07:21.246 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.246 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.246 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.246 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:21.247 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.247 INFO:teuthology.orchestra.run.smithi093.stdout: "throttle-write_buf_throttle": { 2023-12-01T01:07:21.247 INFO:teuthology.orchestra.run.smithi093.stdout: "val": 0, 2023-12-01T01:07:21.247 INFO:teuthology.orchestra.run.smithi093.stdout: "max": 3758096384, 2023-12-01T01:07:21.247 INFO:teuthology.orchestra.run.smithi093.stdout: "get_started": 0, 2023-12-01T01:07:21.247 INFO:teuthology.orchestra.run.smithi093.stdout: "get": 0, 2023-12-01T01:07:21.247 INFO:teuthology.orchestra.run.smithi093.stdout: "get_sum": 0, 2023-12-01T01:07:21.247 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:21.247 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:21.247 INFO:teuthology.orchestra.run.smithi093.stdout: "take": 0, 2023-12-01T01:07:21.247 INFO:teuthology.orchestra.run.smithi093.stdout: "take_sum": 0, 2023-12-01T01:07:21.247 INFO:teuthology.orchestra.run.smithi093.stdout: "put": 0, 2023-12-01T01:07:21.247 INFO:teuthology.orchestra.run.smithi093.stdout: "put_sum": 0, 2023-12-01T01:07:21.247 INFO:teuthology.orchestra.run.smithi093.stdout: "wait": { 2023-12-01T01:07:21.247 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.248 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.248 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.248 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:21.248 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:21.248 INFO:teuthology.orchestra.run.smithi093.stdout: "throttle-write_buf_throttle-0x55be8a4b2500": { 2023-12-01T01:07:21.248 INFO:teuthology.orchestra.run.smithi093.stdout: "val": 0, 2023-12-01T01:07:21.248 INFO:teuthology.orchestra.run.smithi093.stdout: "max": 3758096384, 2023-12-01T01:07:21.248 INFO:teuthology.orchestra.run.smithi093.stdout: "get_started": 0, 2023-12-01T01:07:21.248 INFO:teuthology.orchestra.run.smithi093.stdout: "get": 0, 2023-12-01T01:07:21.248 INFO:teuthology.orchestra.run.smithi093.stdout: "get_sum": 0, 2023-12-01T01:07:21.248 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:21.248 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:21.248 INFO:teuthology.orchestra.run.smithi093.stdout: "take": 0, 2023-12-01T01:07:21.248 INFO:teuthology.orchestra.run.smithi093.stdout: "take_sum": 0, 2023-12-01T01:07:21.248 INFO:teuthology.orchestra.run.smithi093.stdout: "put": 0, 2023-12-01T01:07:21.248 INFO:teuthology.orchestra.run.smithi093.stdout: "put_sum": 0, 2023-12-01T01:07:21.249 INFO:teuthology.orchestra.run.smithi093.stdout: "wait": { 2023-12-01T01:07:21.249 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:21.249 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:21.249 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:21.249 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:21.249 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:21.249 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-12-01T01:07:21.555 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2023-12-01T01:07:21.555 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2023-12-01T01:07:21.555 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2023-12-01T01:07:21.555 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=0 2023-12-01T01:07:21.555 DEBUG:tasks.check_counter:Getting stats from k 2023-12-01T01:07:21.555 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph daemon mds.k perf dump 2023-12-01T01:07:22.104 INFO:teuthology.orchestra.run.smithi093.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.b/config 2023-12-01T01:07:22.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:21 smithi116 ceph-mon[103554]: pgmap v385: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-01T01:07:22.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:21 smithi093 ceph-mon[103327]: pgmap v385: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-01T01:07:22.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:21 smithi026 ceph-mon[98801]: pgmap v385: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 6 op/s 2023-12-01T01:07:23.315 INFO:teuthology.orchestra.run.smithi093.stdout:{ 2023-12-01T01:07:23.315 INFO:teuthology.orchestra.run.smithi093.stdout: "AsyncMessenger::Worker-0": { 2023-12-01T01:07:23.315 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_messages": 4, 2023-12-01T01:07:23.315 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages": 4, 2023-12-01T01:07:23.315 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_bytes": 2992, 2023-12-01T01:07:23.316 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_bytes": 448, 2023-12-01T01:07:23.316 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_created_connections": 4, 2023-12-01T01:07:23.316 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_active_connections": 0, 2023-12-01T01:07:23.316 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_total_time": 0.001847454, 2023-12-01T01:07:23.316 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_send_time": 0.000039114, 2023-12-01T01:07:23.316 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_recv_time": 0.000806391, 2023-12-01T01:07:23.316 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-01T01:07:23.316 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:23.316 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 3, 2023-12-01T01:07:23.316 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000796459, 2023-12-01T01:07:23.316 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000265486 2023-12-01T01:07:23.316 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:23.316 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:23.316 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:23.316 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:23.316 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:23.317 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:23.317 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_encrypted_bytes": 2992, 2023-12-01T01:07:23.317 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_encrypted_bytes": 448 2023-12-01T01:07:23.317 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:23.317 INFO:teuthology.orchestra.run.smithi093.stdout: "AsyncMessenger::Worker-1": { 2023-12-01T01:07:23.317 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_messages": 87, 2023-12-01T01:07:23.317 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages": 84, 2023-12-01T01:07:23.317 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_bytes": 431792, 2023-12-01T01:07:23.317 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_bytes": 47072, 2023-12-01T01:07:23.317 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_created_connections": 2, 2023-12-01T01:07:23.317 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_active_connections": 1, 2023-12-01T01:07:23.317 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_total_time": 0.015887094, 2023-12-01T01:07:23.317 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_send_time": 0.005141940, 2023-12-01T01:07:23.317 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_recv_time": 0.010683222, 2023-12-01T01:07:23.318 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_fast_dispatch_time": 0.002127742, 2023-12-01T01:07:23.318 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:23.318 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 83, 2023-12-01T01:07:23.318 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.006130585, 2023-12-01T01:07:23.318 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000073862 2023-12-01T01:07:23.318 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:23.318 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:23.318 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:23.318 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:23.318 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:23.318 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:23.318 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_encrypted_bytes": 431792, 2023-12-01T01:07:23.318 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_encrypted_bytes": 47072 2023-12-01T01:07:23.319 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:23.319 INFO:teuthology.orchestra.run.smithi093.stdout: "AsyncMessenger::Worker-2": { 2023-12-01T01:07:23.319 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_messages": 1, 2023-12-01T01:07:23.319 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages": 64, 2023-12-01T01:07:23.319 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_bytes": 160, 2023-12-01T01:07:23.319 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_bytes": 87216, 2023-12-01T01:07:23.319 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_created_connections": 3, 2023-12-01T01:07:23.319 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_active_connections": 2, 2023-12-01T01:07:23.319 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_total_time": 0.004715083, 2023-12-01T01:07:23.319 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_send_time": 0.002698062, 2023-12-01T01:07:23.319 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_recv_time": 0.001191706, 2023-12-01T01:07:23.319 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-01T01:07:23.319 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:23.319 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 62, 2023-12-01T01:07:23.320 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.003897198, 2023-12-01T01:07:23.320 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000062858 2023-12-01T01:07:23.320 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:23.320 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:23.320 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:23.320 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:23.320 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:23.320 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:23.320 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-01T01:07:23.320 INFO:teuthology.orchestra.run.smithi093.stdout: "msgr_send_encrypted_bytes": 87216 2023-12-01T01:07:23.320 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:23.320 INFO:teuthology.orchestra.run.smithi093.stdout: "cct": { 2023-12-01T01:07:23.320 INFO:teuthology.orchestra.run.smithi093.stdout: "total_workers": 0, 2023-12-01T01:07:23.321 INFO:teuthology.orchestra.run.smithi093.stdout: "unhealthy_workers": 0 2023-12-01T01:07:23.321 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:23.321 INFO:teuthology.orchestra.run.smithi093.stdout: "mempool": { 2023-12-01T01:07:23.321 INFO:teuthology.orchestra.run.smithi093.stdout: "bloom_filter_bytes": 0, 2023-12-01T01:07:23.321 INFO:teuthology.orchestra.run.smithi093.stdout: "bloom_filter_items": 0, 2023-12-01T01:07:23.321 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_alloc_bytes": 0, 2023-12-01T01:07:23.321 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_alloc_items": 0, 2023-12-01T01:07:23.321 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_data_bytes": 0, 2023-12-01T01:07:23.321 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_data_items": 0, 2023-12-01T01:07:23.321 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-01T01:07:23.321 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_onode_items": 0, 2023-12-01T01:07:23.321 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-01T01:07:23.321 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_meta_items": 0, 2023-12-01T01:07:23.321 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_other_bytes": 0, 2023-12-01T01:07:23.322 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_other_items": 0, 2023-12-01T01:07:23.322 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-01T01:07:23.322 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_cache_buffer_items": 0, 2023-12-01T01:07:23.322 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_extent_bytes": 0, 2023-12-01T01:07:23.322 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_extent_items": 0, 2023-12-01T01:07:23.322 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_blob_bytes": 0, 2023-12-01T01:07:23.322 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_blob_items": 0, 2023-12-01T01:07:23.322 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-01T01:07:23.322 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_shared_blob_items": 0, 2023-12-01T01:07:23.322 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-01T01:07:23.322 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_inline_bl_items": 0, 2023-12-01T01:07:23.322 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_fsck_bytes": 0, 2023-12-01T01:07:23.322 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_fsck_items": 0, 2023-12-01T01:07:23.322 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_txc_bytes": 0, 2023-12-01T01:07:23.322 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_txc_items": 0, 2023-12-01T01:07:23.323 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-01T01:07:23.323 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_writing_deferred_items": 0, 2023-12-01T01:07:23.323 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_writing_bytes": 0, 2023-12-01T01:07:23.323 INFO:teuthology.orchestra.run.smithi093.stdout: "bluestore_writing_items": 0, 2023-12-01T01:07:23.323 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_bytes": 0, 2023-12-01T01:07:23.323 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_items": 0, 2023-12-01T01:07:23.323 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_file_reader_bytes": 0, 2023-12-01T01:07:23.323 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_file_reader_items": 0, 2023-12-01T01:07:23.323 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_file_writer_bytes": 0, 2023-12-01T01:07:23.323 INFO:teuthology.orchestra.run.smithi093.stdout: "bluefs_file_writer_items": 0, 2023-12-01T01:07:23.323 INFO:teuthology.orchestra.run.smithi093.stdout: "buffer_anon_bytes": 148823, 2023-12-01T01:07:23.323 INFO:teuthology.orchestra.run.smithi093.stdout: "buffer_anon_items": 27, 2023-12-01T01:07:23.323 INFO:teuthology.orchestra.run.smithi093.stdout: "buffer_meta_bytes": 0, 2023-12-01T01:07:23.323 INFO:teuthology.orchestra.run.smithi093.stdout: "buffer_meta_items": 0, 2023-12-01T01:07:23.323 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_bytes": 0, 2023-12-01T01:07:23.324 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_items": 0, 2023-12-01T01:07:23.324 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_mapbl_bytes": 0, 2023-12-01T01:07:23.324 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_mapbl_items": 0, 2023-12-01T01:07:23.324 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_pglog_bytes": 0, 2023-12-01T01:07:23.324 INFO:teuthology.orchestra.run.smithi093.stdout: "osd_pglog_items": 0, 2023-12-01T01:07:23.324 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_bytes": 0, 2023-12-01T01:07:23.324 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_items": 0, 2023-12-01T01:07:23.324 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_mapping_bytes": 0, 2023-12-01T01:07:23.324 INFO:teuthology.orchestra.run.smithi093.stdout: "osdmap_mapping_items": 0, 2023-12-01T01:07:23.324 INFO:teuthology.orchestra.run.smithi093.stdout: "pgmap_bytes": 0, 2023-12-01T01:07:23.324 INFO:teuthology.orchestra.run.smithi093.stdout: "pgmap_items": 0, 2023-12-01T01:07:23.324 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_co_bytes": 928, 2023-12-01T01:07:23.324 INFO:teuthology.orchestra.run.smithi093.stdout: "mds_co_items": 2, 2023-12-01T01:07:23.324 INFO:teuthology.orchestra.run.smithi093.stdout: "unittest_1_bytes": 0, 2023-12-01T01:07:23.324 INFO:teuthology.orchestra.run.smithi093.stdout: "unittest_1_items": 0, 2023-12-01T01:07:23.325 INFO:teuthology.orchestra.run.smithi093.stdout: "unittest_2_bytes": 0, 2023-12-01T01:07:23.325 INFO:teuthology.orchestra.run.smithi093.stdout: "unittest_2_items": 0 2023-12-01T01:07:23.325 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2023-12-01T01:07:23.325 INFO:teuthology.orchestra.run.smithi093.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-01T01:07:23.325 INFO:teuthology.orchestra.run.smithi093.stdout: "val": 0, 2023-12-01T01:07:23.325 INFO:teuthology.orchestra.run.smithi093.stdout: "max": 104857600, 2023-12-01T01:07:23.325 INFO:teuthology.orchestra.run.smithi093.stdout: "get_started": 0, 2023-12-01T01:07:23.325 INFO:teuthology.orchestra.run.smithi093.stdout: "get": 88, 2023-12-01T01:07:23.325 INFO:teuthology.orchestra.run.smithi093.stdout: "get_sum": 419541, 2023-12-01T01:07:23.325 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:23.325 INFO:teuthology.orchestra.run.smithi093.stdout: "get_or_fail_success": 88, 2023-12-01T01:07:23.325 INFO:teuthology.orchestra.run.smithi093.stdout: "take": 0, 2023-12-01T01:07:23.325 INFO:teuthology.orchestra.run.smithi093.stdout: "take_sum": 0, 2023-12-01T01:07:23.325 INFO:teuthology.orchestra.run.smithi093.stdout: "put": 88, 2023-12-01T01:07:23.325 INFO:teuthology.orchestra.run.smithi093.stdout: "put_sum": 419541, 2023-12-01T01:07:23.325 INFO:teuthology.orchestra.run.smithi093.stdout: "wait": { 2023-12-01T01:07:23.326 INFO:teuthology.orchestra.run.smithi093.stdout: "avgcount": 0, 2023-12-01T01:07:23.326 INFO:teuthology.orchestra.run.smithi093.stdout: "sum": 0.000000000, 2023-12-01T01:07:23.326 INFO:teuthology.orchestra.run.smithi093.stdout: "avgtime": 0.000000000 2023-12-01T01:07:23.326 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:23.326 INFO:teuthology.orchestra.run.smithi093.stdout: } 2023-12-01T01:07:23.326 INFO:teuthology.orchestra.run.smithi093.stdout:} 2023-12-01T01:07:23.648 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2023-12-01T01:07:23.648 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2023-12-01T01:07:23.648 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2023-12-01T01:07:23.648 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2023-12-01T01:07:23.648 DEBUG:tasks.check_counter:Getting stats from c 2023-12-01T01:07:23.648 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph daemon mds.c perf dump 2023-12-01T01:07:23.965 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:23 smithi093 ceph-mon[103327]: pgmap v386: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2023-12-01T01:07:24.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:23 smithi116 ceph-mon[103554]: pgmap v386: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2023-12-01T01:07:24.220 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.c/config 2023-12-01T01:07:24.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:23 smithi026 ceph-mon[98801]: pgmap v386: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2023-12-01T01:07:25.558 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2023-12-01T01:07:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2023-12-01T01:07:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 666, 2023-12-01T01:07:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 668, 2023-12-01T01:07:25.558 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 16974727, 2023-12-01T01:07:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 207133, 2023-12-01T01:07:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 6, 2023-12-01T01:07:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 2, 2023-12-01T01:07:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.066945660, 2023-12-01T01:07:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.018026740, 2023-12-01T01:07:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.021477022, 2023-12-01T01:07:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.021679439, 2023-12-01T01:07:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 666, 2023-12-01T01:07:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.025283013, 2023-12-01T01:07:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000037962 2023-12-01T01:07:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.559 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-01T01:07:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 0 2023-12-01T01:07:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2023-12-01T01:07:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 172, 2023-12-01T01:07:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 158, 2023-12-01T01:07:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 4693452, 2023-12-01T01:07:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 68284, 2023-12-01T01:07:25.560 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 4, 2023-12-01T01:07:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 3, 2023-12-01T01:07:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.027198187, 2023-12-01T01:07:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.007029397, 2023-12-01T01:07:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.016475754, 2023-12-01T01:07:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.005157793, 2023-12-01T01:07:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 158, 2023-12-01T01:07:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.010284479, 2023-12-01T01:07:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000065091 2023-12-01T01:07:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.561 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 482768, 2023-12-01T01:07:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 47696 2023-12-01T01:07:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2023-12-01T01:07:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 69, 2023-12-01T01:07:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 131, 2023-12-01T01:07:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 4193755, 2023-12-01T01:07:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 203324, 2023-12-01T01:07:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 5, 2023-12-01T01:07:25.562 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 4, 2023-12-01T01:07:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.013857025, 2023-12-01T01:07:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.004310851, 2023-12-01T01:07:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.005773001, 2023-12-01T01:07:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.002372119, 2023-12-01T01:07:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 129, 2023-12-01T01:07:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.007906750, 2023-12-01T01:07:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000061292 2023-12-01T01:07:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.563 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 160, 2023-12-01T01:07:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 182176 2023-12-01T01:07:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2023-12-01T01:07:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 1, 2023-12-01T01:07:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2023-12-01T01:07:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-MDSRank": { 2023-12-01T01:07:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2023-12-01T01:07:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2023-12-01T01:07:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1351, 2023-12-01T01:07:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.040056227, 2023-12-01T01:07:25.564 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000029649 2023-12-01T01:07:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-PurgeQueue": { 2023-12-01T01:07:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2023-12-01T01:07:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2023-12-01T01:07:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": { 2023-12-01T01:07:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: "request": 0, 2023-12-01T01:07:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: "reply": 0, 2023-12-01T01:07:25.565 INFO:teuthology.orchestra.run.smithi116.stdout: "reply_latency": { 2023-12-01T01:07:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_reply": 0, 2023-12-01T01:07:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "forward": 0, 2023-12-01T01:07:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_complete": 0, 2023-12-01T01:07:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_keys": 0, 2023-12-01T01:07:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_commit": 0, 2023-12-01T01:07:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_split": 0, 2023-12-01T01:07:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_merge": 0, 2023-12-01T01:07:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes": 3910, 2023-12-01T01:07:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_top": 0, 2023-12-01T01:07:25.566 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_bottom": 0, 2023-12-01T01:07:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pin_tail": 3910, 2023-12-01T01:07:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pinned": 3910, 2023-12-01T01:07:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_expired": 0, 2023-12-01T01:07:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_with_caps": 0, 2023-12-01T01:07:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": 0, 2023-12-01T01:07:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "subtrees": 1, 2023-12-01T01:07:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse": 0, 2023-12-01T01:07:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_hit": 0, 2023-12-01T01:07:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_forward": 0, 2023-12-01T01:07:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_discover": 0, 2023-12-01T01:07:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_dir_fetch": 0, 2023-12-01T01:07:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_remote_ino": 0, 2023-12-01T01:07:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_lock": 0, 2023-12-01T01:07:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "load_cent": 0, 2023-12-01T01:07:25.567 INFO:teuthology.orchestra.run.smithi116.stdout: "q": 0, 2023-12-01T01:07:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "exported": 0, 2023-12-01T01:07:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "exported_inodes": 0, 2023-12-01T01:07:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "imported": 0, 2023-12-01T01:07:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "imported_inodes": 0, 2023-12-01T01:07:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_dir_fetch": 0, 2023-12-01T01:07:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_backtrace_fetch": 0, 2023-12-01T01:07:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_peer_discover": 0, 2023-12-01T01:07:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rfiles": 0, 2023-12-01T01:07:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rbytes": 0, 2023-12-01T01:07:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rsnaps": 0, 2023-12-01T01:07:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_fetch": 0, 2023-12-01T01:07:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_set_tag": 0, 2023-12-01T01:07:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_repaired": 0, 2023-12-01T01:07:25.568 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_inotable_repaired": 0, 2023-12-01T01:07:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_inodes": 0, 2023-12-01T01:07:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_base_inodes": 0, 2023-12-01T01:07:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dirfrag_rstats": 0, 2023-12-01T01:07:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_file_inodes": 0, 2023-12-01T01:07:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_inode_file_caps": 0, 2023-12-01T01:07:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_revoke": 0, 2023-12-01T01:07:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_grant": 0, 2023-12-01T01:07:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_trunc": 0, 2023-12-01T01:07:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-01T01:07:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-01T01:07:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps": 0, 2023-12-01T01:07:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps_dirty": 0, 2023-12-01T01:07:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_cap_release": 0, 2023-12-01T01:07:25.569 INFO:teuthology.orchestra.run.smithi116.stdout: "process_request_cap_release": 0 2023-12-01T01:07:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache": { 2023-12-01T01:07:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update": 0, 2023-12-01T01:07:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update_receipt": 0, 2023-12-01T01:07:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_try_discover": 0, 2023-12-01T01:07:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_send_discover": 0, 2023-12-01T01:07:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_handle_discover": 0, 2023-12-01T01:07:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays": 0, 2023-12-01T01:07:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_delayed": 0, 2023-12-01T01:07:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_enqueuing": 0, 2023-12-01T01:07:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_created": 0, 2023-12-01T01:07:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_enqueued": 0, 2023-12-01T01:07:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_reintegrated": 0, 2023-12-01T01:07:25.570 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_migrated": 0, 2023-12-01T01:07:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_processing": 0, 2023-12-01T01:07:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_enqueued": 0, 2023-12-01T01:07:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_prioritized": 0, 2023-12-01T01:07:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_started": 0, 2023-12-01T01:07:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_completed": 0, 2023-12-01T01:07:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_enqueue_scrub": 0, 2023-12-01T01:07:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_exportdir": 0, 2023-12-01T01:07:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_flush": 0, 2023-12-01T01:07:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragmentdir": 0, 2023-12-01T01:07:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragstats": 0, 2023-12-01T01:07:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_inodestats": 0 2023-12-01T01:07:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log": { 2023-12-01T01:07:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "evadd": 0, 2023-12-01T01:07:25.571 INFO:teuthology.orchestra.run.smithi116.stdout: "evex": 0, 2023-12-01T01:07:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "evtrm": 0, 2023-12-01T01:07:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "ev": 11598, 2023-12-01T01:07:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "evexg": 0, 2023-12-01T01:07:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "evexd": 0, 2023-12-01T01:07:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "segadd": 0, 2023-12-01T01:07:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "segex": 0, 2023-12-01T01:07:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "segtrm": 0, 2023-12-01T01:07:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "seg": 14, 2023-12-01T01:07:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "segexg": 0, 2023-12-01T01:07:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "segexd": 0, 2023-12-01T01:07:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "expos": 4194304, 2023-12-01T01:07:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "wrpos": 29341933, 2023-12-01T01:07:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "rdpos": 29340795, 2023-12-01T01:07:25.572 INFO:teuthology.orchestra.run.smithi116.stdout: "jlat": { 2023-12-01T01:07:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "replayed": 11598 2023-12-01T01:07:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_mem": { 2023-12-01T01:07:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "ino": 13, 2023-12-01T01:07:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "ino+": 3935, 2023-12-01T01:07:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "ino-": 3922, 2023-12-01T01:07:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "dir": 11, 2023-12-01T01:07:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "dir+": 261, 2023-12-01T01:07:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "dir-": 250, 2023-12-01T01:07:25.573 INFO:teuthology.orchestra.run.smithi116.stdout: "dn": 3910, 2023-12-01T01:07:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "dn+": 6950, 2023-12-01T01:07:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "dn-": 3040, 2023-12-01T01:07:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "cap": 0, 2023-12-01T01:07:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "cap+": 0, 2023-12-01T01:07:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "cap-": 0, 2023-12-01T01:07:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "rss": 52556, 2023-12-01T01:07:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "heap": 207156 2023-12-01T01:07:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server": { 2023-12-01T01:07:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_client_request": 0, 2023-12-01T01:07:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_server_request": 0, 2023-12-01T01:07:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_request": 0, 2023-12-01T01:07:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_session": 0, 2023-12-01T01:07:25.574 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_peer_request": 0, 2023-12-01T01:07:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "req_create_latency": { 2023-12-01T01:07:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getattr_latency": { 2023-12-01T01:07:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getfilelock_latency": { 2023-12-01T01:07:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.575 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "req_link_latency": { 2023-12-01T01:07:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookup_latency": { 2023-12-01T01:07:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookuphash_latency": { 2023-12-01T01:07:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.576 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupino_latency": { 2023-12-01T01:07:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupname_latency": { 2023-12-01T01:07:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupparent_latency": { 2023-12-01T01:07:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.577 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupsnap_latency": { 2023-12-01T01:07:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lssnap_latency": { 2023-12-01T01:07:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.578 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mkdir_latency": { 2023-12-01T01:07:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mknod_latency": { 2023-12-01T01:07:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mksnap_latency": { 2023-12-01T01:07:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.579 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "req_open_latency": { 2023-12-01T01:07:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "req_readdir_latency": { 2023-12-01T01:07:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rename_latency": { 2023-12-01T01:07:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.580 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "req_renamesnap_latency": { 2023-12-01T01:07:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "req_snapdiff_latency": { 2023-12-01T01:07:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmdir_latency": { 2023-12-01T01:07:25.581 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmsnap_latency": { 2023-12-01T01:07:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmxattr_latency": { 2023-12-01T01:07:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.582 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setattr_latency": { 2023-12-01T01:07:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setdirlayout_latency": { 2023-12-01T01:07:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setfilelock_latency": { 2023-12-01T01:07:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.583 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setlayout_latency": { 2023-12-01T01:07:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setxattr_latency": { 2023-12-01T01:07:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "req_symlink_latency": { 2023-12-01T01:07:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.584 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "req_unlink_latency": { 2023-12-01T01:07:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_revoke_eviction": 0, 2023-12-01T01:07:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_acquisition_throttle": 0, 2023-12-01T01:07:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getvxattr_latency": { 2023-12-01T01:07:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:25.585 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sessions": { 2023-12-01T01:07:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "session_count": 1, 2023-12-01T01:07:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "session_add": 2, 2023-12-01T01:07:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "session_remove": 1, 2023-12-01T01:07:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_open": 1, 2023-12-01T01:07:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_stale": 0, 2023-12-01T01:07:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "total_load": 0, 2023-12-01T01:07:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "average_load": 0, 2023-12-01T01:07:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "avg_session_uptime": 1528, 2023-12-01T01:07:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "mdthresh_evicted": 0 2023-12-01T01:07:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2023-12-01T01:07:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2023-12-01T01:07:25.586 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2023-12-01T01:07:25.587 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2023-12-01T01:07:25.587 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2023-12-01T01:07:25.587 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2023-12-01T01:07:25.587 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2023-12-01T01:07:25.587 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-01T01:07:25.587 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2023-12-01T01:07:25.587 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-01T01:07:25.587 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2023-12-01T01:07:25.587 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2023-12-01T01:07:25.587 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2023-12-01T01:07:25.587 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-01T01:07:25.587 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2023-12-01T01:07:25.587 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2023-12-01T01:07:25.587 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2023-12-01T01:07:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2023-12-01T01:07:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2023-12-01T01:07:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-01T01:07:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2023-12-01T01:07:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-01T01:07:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2023-12-01T01:07:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2023-12-01T01:07:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2023-12-01T01:07:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2023-12-01T01:07:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2023-12-01T01:07:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-01T01:07:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2023-12-01T01:07:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2023-12-01T01:07:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2023-12-01T01:07:25.588 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2023-12-01T01:07:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2023-12-01T01:07:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2023-12-01T01:07:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2023-12-01T01:07:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2023-12-01T01:07:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2023-12-01T01:07:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 197319, 2023-12-01T01:07:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 52, 2023-12-01T01:07:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2023-12-01T01:07:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2023-12-01T01:07:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2023-12-01T01:07:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2023-12-01T01:07:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2023-12-01T01:07:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2023-12-01T01:07:25.589 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2023-12-01T01:07:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2023-12-01T01:07:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 7528, 2023-12-01T01:07:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 158, 2023-12-01T01:07:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2023-12-01T01:07:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2023-12-01T01:07:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2023-12-01T01:07:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2023-12-01T01:07:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 2764120, 2023-12-01T01:07:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 15768, 2023-12-01T01:07:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2023-12-01T01:07:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2023-12-01T01:07:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2023-12-01T01:07:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2023-12-01T01:07:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.590 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter": { 2023-12-01T01:07:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "op_active": 0, 2023-12-01T01:07:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "op_laggy": 0, 2023-12-01T01:07:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send": 800, 2023-12-01T01:07:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send_bytes": 21, 2023-12-01T01:07:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "op_resend": 3, 2023-12-01T01:07:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "op_reply": 800, 2023-12-01T01:07:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "op_latency": { 2023-12-01T01:07:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 800, 2023-12-01T01:07:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.451992509, 2023-12-01T01:07:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000564990 2023-12-01T01:07:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.591 INFO:teuthology.orchestra.run.smithi116.stdout: "op_inflight": 0, 2023-12-01T01:07:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "oplen_avg": { 2023-12-01T01:07:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 800, 2023-12-01T01:07:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 801 2023-12-01T01:07:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "op": 800, 2023-12-01T01:07:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "op_r": 800, 2023-12-01T01:07:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "op_w": 0, 2023-12-01T01:07:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "op_rmw": 0, 2023-12-01T01:07:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "op_pg": 0, 2023-12-01T01:07:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_stat": 485, 2023-12-01T01:07:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_create": 0, 2023-12-01T01:07:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_read": 313, 2023-12-01T01:07:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_write": 0, 2023-12-01T01:07:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writefull": 0, 2023-12-01T01:07:25.592 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writesame": 0, 2023-12-01T01:07:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_append": 0, 2023-12-01T01:07:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_zero": 0, 2023-12-01T01:07:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_truncate": 0, 2023-12-01T01:07:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_delete": 0, 2023-12-01T01:07:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_mapext": 0, 2023-12-01T01:07:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_sparse_read": 0, 2023-12-01T01:07:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_clonerange": 0, 2023-12-01T01:07:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_getxattr": 1, 2023-12-01T01:07:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_setxattr": 0, 2023-12-01T01:07:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_cmpxattr": 0, 2023-12-01T01:07:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_rmxattr": 0, 2023-12-01T01:07:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_resetxattrs": 0, 2023-12-01T01:07:25.593 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_call": 0, 2023-12-01T01:07:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_watch": 0, 2023-12-01T01:07:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_notify": 0, 2023-12-01T01:07:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_src_cmpxattr": 0, 2023-12-01T01:07:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls": 0, 2023-12-01T01:07:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls_filter": 0, 2023-12-01T01:07:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_other": 0, 2023-12-01T01:07:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_active": 0, 2023-12-01T01:07:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_send": 0, 2023-12-01T01:07:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_resend": 0, 2023-12-01T01:07:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_ping": 0, 2023-12-01T01:07:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_active": 0, 2023-12-01T01:07:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_send": 0, 2023-12-01T01:07:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_resend": 0, 2023-12-01T01:07:25.594 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_active": 0, 2023-12-01T01:07:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_send": 0, 2023-12-01T01:07:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_resend": 0, 2023-12-01T01:07:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_active": 0, 2023-12-01T01:07:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_send": 0, 2023-12-01T01:07:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_resend": 0, 2023-12-01T01:07:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "command_active": 0, 2023-12-01T01:07:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "command_send": 0, 2023-12-01T01:07:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "command_resend": 0, 2023-12-01T01:07:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "map_epoch": 84, 2023-12-01T01:07:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "map_full": 0, 2023-12-01T01:07:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "map_inc": 3, 2023-12-01T01:07:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_sessions": 6, 2023-12-01T01:07:25.595 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_open": 6, 2023-12-01T01:07:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_close": 0, 2023-12-01T01:07:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_laggy": 0, 2023-12-01T01:07:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_wr": 0, 2023-12-01T01:07:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_rd": 2, 2023-12-01T01:07:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_del": 0 2023-12-01T01:07:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "oft": { 2023-12-01T01:07:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_objs": 0, 2023-12-01T01:07:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_kv_pairs": 0, 2023-12-01T01:07:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_updates": 0, 2023-12-01T01:07:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_removes": 0 2023-12-01T01:07:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "osd-slow-ops": { 2023-12-01T01:07:25.596 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_ops_count": 0 2023-12-01T01:07:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "purge_queue": { 2023-12-01T01:07:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops": 0, 2023-12-01T01:07:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops_high_water": 0, 2023-12-01T01:07:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing": 0, 2023-12-01T01:07:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_high_water": 0, 2023-12-01T01:07:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed": 0, 2023-12-01T01:07:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_item_in_journal": 0 2023-12-01T01:07:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-01T01:07:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2023-12-01T01:07:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2023-12-01T01:07:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2023-12-01T01:07:25.597 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 903, 2023-12-01T01:07:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 25772503, 2023-12-01T01:07:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 903, 2023-12-01T01:07:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2023-12-01T01:07:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2023-12-01T01:07:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 903, 2023-12-01T01:07:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 25772503, 2023-12-01T01:07:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2023-12-01T01:07:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.598 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_bytes": { 2023-12-01T01:07:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2023-12-01T01:07:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2023-12-01T01:07:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2023-12-01T01:07:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2023-12-01T01:07:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2023-12-01T01:07:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 800, 2023-12-01T01:07:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 25152366, 2023-12-01T01:07:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 800, 2023-12-01T01:07:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 25152366, 2023-12-01T01:07:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2023-12-01T01:07:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.599 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_ops": { 2023-12-01T01:07:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2023-12-01T01:07:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 1024, 2023-12-01T01:07:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2023-12-01T01:07:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2023-12-01T01:07:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2023-12-01T01:07:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 800, 2023-12-01T01:07:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 800, 2023-12-01T01:07:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 800, 2023-12-01T01:07:25.600 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 800, 2023-12-01T01:07:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2023-12-01T01:07:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle": { 2023-12-01T01:07:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2023-12-01T01:07:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2023-12-01T01:07:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2023-12-01T01:07:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2023-12-01T01:07:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2023-12-01T01:07:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:25.601 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2023-12-01T01:07:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2023-12-01T01:07:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 0, 2023-12-01T01:07:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 0, 2023-12-01T01:07:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2023-12-01T01:07:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle-0x55fe76e3a5a0": { 2023-12-01T01:07:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2023-12-01T01:07:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2023-12-01T01:07:25.602 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2023-12-01T01:07:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2023-12-01T01:07:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2023-12-01T01:07:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2023-12-01T01:07:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2023-12-01T01:07:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 0, 2023-12-01T01:07:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 0, 2023-12-01T01:07:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2023-12-01T01:07:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:25.603 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:25.604 INFO:teuthology.orchestra.run.smithi116.stdout:} 2023-12-01T01:07:25.973 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2023-12-01T01:07:25.973 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2023-12-01T01:07:25.973 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2023-12-01T01:07:25.973 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2023-12-01T01:07:25.973 DEBUG:tasks.check_counter:Getting stats from f 2023-12-01T01:07:25.973 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph daemon mds.f perf dump 2023-12-01T01:07:26.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:25 smithi116 ceph-mon[103554]: pgmap v387: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-12-01T01:07:26.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:25 smithi093 ceph-mon[103327]: pgmap v387: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-12-01T01:07:26.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:25 smithi026 ceph-mon[98801]: pgmap v387: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 511 B/s wr, 6 op/s 2023-12-01T01:07:26.523 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.c/config 2023-12-01T01:07:27.628 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2023-12-01T01:07:27.629 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2023-12-01T01:07:27.629 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 290, 2023-12-01T01:07:27.629 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 292, 2023-12-01T01:07:27.629 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 8986679, 2023-12-01T01:07:27.629 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 90254, 2023-12-01T01:07:27.629 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 7, 2023-12-01T01:07:27.629 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 3, 2023-12-01T01:07:27.629 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.031016434, 2023-12-01T01:07:27.629 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.007407817, 2023-12-01T01:07:27.629 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.011794831, 2023-12-01T01:07:27.629 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.008375426, 2023-12-01T01:07:27.630 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:27.630 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 290, 2023-12-01T01:07:27.630 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.014043073, 2023-12-01T01:07:27.630 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000048424 2023-12-01T01:07:27.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.630 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:27.630 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.630 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.630 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.630 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.630 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-01T01:07:27.630 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 0 2023-12-01T01:07:27.631 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.631 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2023-12-01T01:07:27.631 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 307, 2023-12-01T01:07:27.631 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 295, 2023-12-01T01:07:27.631 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 13114174, 2023-12-01T01:07:27.631 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 111289, 2023-12-01T01:07:27.631 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 5, 2023-12-01T01:07:27.631 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 4, 2023-12-01T01:07:27.631 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.042453805, 2023-12-01T01:07:27.631 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.010307455, 2023-12-01T01:07:27.631 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.022614556, 2023-12-01T01:07:27.631 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.010014176, 2023-12-01T01:07:27.631 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:27.632 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 294, 2023-12-01T01:07:27.632 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.014034739, 2023-12-01T01:07:27.632 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000047737 2023-12-01T01:07:27.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.632 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:27.632 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.632 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.632 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.632 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 480048, 2023-12-01T01:07:27.632 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 47840 2023-12-01T01:07:27.632 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.633 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2023-12-01T01:07:27.633 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 351, 2023-12-01T01:07:27.633 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 411, 2023-12-01T01:07:27.633 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 4307728, 2023-12-01T01:07:27.633 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 290230, 2023-12-01T01:07:27.633 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 5, 2023-12-01T01:07:27.633 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 4, 2023-12-01T01:07:27.633 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.045760932, 2023-12-01T01:07:27.633 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.013220526, 2023-12-01T01:07:27.633 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.014155782, 2023-12-01T01:07:27.633 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.014017854, 2023-12-01T01:07:27.633 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:27.633 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 410, 2023-12-01T01:07:27.634 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.022042995, 2023-12-01T01:07:27.634 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000053763 2023-12-01T01:07:27.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.634 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:27.634 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.634 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.634 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.634 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-12-01T01:07:27.634 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 182624 2023-12-01T01:07:27.634 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.634 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2023-12-01T01:07:27.635 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 1, 2023-12-01T01:07:27.635 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2023-12-01T01:07:27.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.635 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-MDSRank": { 2023-12-01T01:07:27.635 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2023-12-01T01:07:27.635 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2023-12-01T01:07:27.635 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1385, 2023-12-01T01:07:27.635 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.042214328, 2023-12-01T01:07:27.635 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000030479 2023-12-01T01:07:27.635 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:27.635 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.635 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-PurgeQueue": { 2023-12-01T01:07:27.636 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2023-12-01T01:07:27.636 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2023-12-01T01:07:27.636 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.636 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.636 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.636 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:27.636 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.636 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": { 2023-12-01T01:07:27.636 INFO:teuthology.orchestra.run.smithi116.stdout: "request": 0, 2023-12-01T01:07:27.636 INFO:teuthology.orchestra.run.smithi116.stdout: "reply": 0, 2023-12-01T01:07:27.636 INFO:teuthology.orchestra.run.smithi116.stdout: "reply_latency": { 2023-12-01T01:07:27.636 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.636 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.637 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.637 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.637 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_reply": 0, 2023-12-01T01:07:27.637 INFO:teuthology.orchestra.run.smithi116.stdout: "forward": 0, 2023-12-01T01:07:27.637 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_complete": 0, 2023-12-01T01:07:27.637 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_keys": 0, 2023-12-01T01:07:27.637 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_commit": 0, 2023-12-01T01:07:27.637 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_split": 0, 2023-12-01T01:07:27.637 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_merge": 0, 2023-12-01T01:07:27.637 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes": 3958, 2023-12-01T01:07:27.637 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_top": 0, 2023-12-01T01:07:27.637 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_bottom": 0, 2023-12-01T01:07:27.637 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pin_tail": 3958, 2023-12-01T01:07:27.637 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pinned": 3958, 2023-12-01T01:07:27.638 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_expired": 0, 2023-12-01T01:07:27.638 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_with_caps": 0, 2023-12-01T01:07:27.638 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": 0, 2023-12-01T01:07:27.638 INFO:teuthology.orchestra.run.smithi116.stdout: "subtrees": 1, 2023-12-01T01:07:27.638 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse": 0, 2023-12-01T01:07:27.638 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_hit": 0, 2023-12-01T01:07:27.638 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_forward": 0, 2023-12-01T01:07:27.638 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_discover": 0, 2023-12-01T01:07:27.638 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_dir_fetch": 0, 2023-12-01T01:07:27.638 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_remote_ino": 0, 2023-12-01T01:07:27.638 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_lock": 0, 2023-12-01T01:07:27.638 INFO:teuthology.orchestra.run.smithi116.stdout: "load_cent": 0, 2023-12-01T01:07:27.639 INFO:teuthology.orchestra.run.smithi116.stdout: "q": 0, 2023-12-01T01:07:27.639 INFO:teuthology.orchestra.run.smithi116.stdout: "exported": 0, 2023-12-01T01:07:27.639 INFO:teuthology.orchestra.run.smithi116.stdout: "exported_inodes": 0, 2023-12-01T01:07:27.639 INFO:teuthology.orchestra.run.smithi116.stdout: "imported": 0, 2023-12-01T01:07:27.639 INFO:teuthology.orchestra.run.smithi116.stdout: "imported_inodes": 0, 2023-12-01T01:07:27.639 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_dir_fetch": 0, 2023-12-01T01:07:27.639 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_backtrace_fetch": 0, 2023-12-01T01:07:27.639 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_peer_discover": 0, 2023-12-01T01:07:27.639 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rfiles": 0, 2023-12-01T01:07:27.639 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rbytes": 0, 2023-12-01T01:07:27.639 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rsnaps": 0, 2023-12-01T01:07:27.639 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_fetch": 0, 2023-12-01T01:07:27.639 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_set_tag": 0, 2023-12-01T01:07:27.639 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_repaired": 0, 2023-12-01T01:07:27.640 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_inotable_repaired": 0, 2023-12-01T01:07:27.640 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_inodes": 0, 2023-12-01T01:07:27.640 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_base_inodes": 0, 2023-12-01T01:07:27.640 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dirfrag_rstats": 0, 2023-12-01T01:07:27.640 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_file_inodes": 0, 2023-12-01T01:07:27.640 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_inode_file_caps": 0, 2023-12-01T01:07:27.640 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_revoke": 0, 2023-12-01T01:07:27.640 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_grant": 0, 2023-12-01T01:07:27.640 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_trunc": 0, 2023-12-01T01:07:27.640 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-01T01:07:27.640 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-01T01:07:27.640 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps": 0, 2023-12-01T01:07:27.640 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps_dirty": 0, 2023-12-01T01:07:27.640 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_cap_release": 0, 2023-12-01T01:07:27.641 INFO:teuthology.orchestra.run.smithi116.stdout: "process_request_cap_release": 0 2023-12-01T01:07:27.641 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.641 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache": { 2023-12-01T01:07:27.641 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update": 0, 2023-12-01T01:07:27.641 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update_receipt": 0, 2023-12-01T01:07:27.641 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_try_discover": 0, 2023-12-01T01:07:27.641 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_send_discover": 0, 2023-12-01T01:07:27.641 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_handle_discover": 0, 2023-12-01T01:07:27.641 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays": 0, 2023-12-01T01:07:27.641 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_delayed": 0, 2023-12-01T01:07:27.641 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_enqueuing": 0, 2023-12-01T01:07:27.641 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_created": 0, 2023-12-01T01:07:27.641 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_enqueued": 0, 2023-12-01T01:07:27.641 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_reintegrated": 0, 2023-12-01T01:07:27.642 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_migrated": 0, 2023-12-01T01:07:27.642 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_processing": 0, 2023-12-01T01:07:27.642 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_enqueued": 0, 2023-12-01T01:07:27.642 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_prioritized": 0, 2023-12-01T01:07:27.642 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_started": 0, 2023-12-01T01:07:27.642 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_completed": 0, 2023-12-01T01:07:27.642 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_enqueue_scrub": 0, 2023-12-01T01:07:27.642 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_exportdir": 0, 2023-12-01T01:07:27.642 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_flush": 0, 2023-12-01T01:07:27.642 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragmentdir": 0, 2023-12-01T01:07:27.642 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragstats": 0, 2023-12-01T01:07:27.642 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_inodestats": 0 2023-12-01T01:07:27.642 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.642 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log": { 2023-12-01T01:07:27.643 INFO:teuthology.orchestra.run.smithi116.stdout: "evadd": 0, 2023-12-01T01:07:27.643 INFO:teuthology.orchestra.run.smithi116.stdout: "evex": 0, 2023-12-01T01:07:27.643 INFO:teuthology.orchestra.run.smithi116.stdout: "evtrm": 0, 2023-12-01T01:07:27.643 INFO:teuthology.orchestra.run.smithi116.stdout: "ev": 12421, 2023-12-01T01:07:27.643 INFO:teuthology.orchestra.run.smithi116.stdout: "evexg": 0, 2023-12-01T01:07:27.643 INFO:teuthology.orchestra.run.smithi116.stdout: "evexd": 0, 2023-12-01T01:07:27.643 INFO:teuthology.orchestra.run.smithi116.stdout: "segadd": 0, 2023-12-01T01:07:27.643 INFO:teuthology.orchestra.run.smithi116.stdout: "segex": 0, 2023-12-01T01:07:27.643 INFO:teuthology.orchestra.run.smithi116.stdout: "segtrm": 0, 2023-12-01T01:07:27.643 INFO:teuthology.orchestra.run.smithi116.stdout: "seg": 16, 2023-12-01T01:07:27.643 INFO:teuthology.orchestra.run.smithi116.stdout: "segexg": 0, 2023-12-01T01:07:27.643 INFO:teuthology.orchestra.run.smithi116.stdout: "segexd": 0, 2023-12-01T01:07:27.643 INFO:teuthology.orchestra.run.smithi116.stdout: "expos": 4194304, 2023-12-01T01:07:27.643 INFO:teuthology.orchestra.run.smithi116.stdout: "wrpos": 29880894, 2023-12-01T01:07:27.643 INFO:teuthology.orchestra.run.smithi116.stdout: "rdpos": 29879446, 2023-12-01T01:07:27.644 INFO:teuthology.orchestra.run.smithi116.stdout: "jlat": { 2023-12-01T01:07:27.644 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.644 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.644 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.644 INFO:teuthology.orchestra.run.smithi116.stdout: "replayed": 12421 2023-12-01T01:07:27.644 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.644 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_mem": { 2023-12-01T01:07:27.644 INFO:teuthology.orchestra.run.smithi116.stdout: "ino": 27, 2023-12-01T01:07:27.644 INFO:teuthology.orchestra.run.smithi116.stdout: "ino+": 3571, 2023-12-01T01:07:27.644 INFO:teuthology.orchestra.run.smithi116.stdout: "ino-": 3544, 2023-12-01T01:07:27.644 INFO:teuthology.orchestra.run.smithi116.stdout: "dir": 32, 2023-12-01T01:07:27.644 INFO:teuthology.orchestra.run.smithi116.stdout: "dir+": 324, 2023-12-01T01:07:27.645 INFO:teuthology.orchestra.run.smithi116.stdout: "dir-": 292, 2023-12-01T01:07:27.645 INFO:teuthology.orchestra.run.smithi116.stdout: "dn": 3958, 2023-12-01T01:07:27.645 INFO:teuthology.orchestra.run.smithi116.stdout: "dn+": 6838, 2023-12-01T01:07:27.645 INFO:teuthology.orchestra.run.smithi116.stdout: "dn-": 2880, 2023-12-01T01:07:27.645 INFO:teuthology.orchestra.run.smithi116.stdout: "cap": 0, 2023-12-01T01:07:27.645 INFO:teuthology.orchestra.run.smithi116.stdout: "cap+": 0, 2023-12-01T01:07:27.645 INFO:teuthology.orchestra.run.smithi116.stdout: "cap-": 0, 2023-12-01T01:07:27.645 INFO:teuthology.orchestra.run.smithi116.stdout: "rss": 55476, 2023-12-01T01:07:27.645 INFO:teuthology.orchestra.run.smithi116.stdout: "heap": 207156 2023-12-01T01:07:27.645 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.645 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server": { 2023-12-01T01:07:27.645 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_client_request": 0, 2023-12-01T01:07:27.645 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_server_request": 0, 2023-12-01T01:07:27.645 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_request": 0, 2023-12-01T01:07:27.646 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_session": 0, 2023-12-01T01:07:27.646 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_peer_request": 0, 2023-12-01T01:07:27.646 INFO:teuthology.orchestra.run.smithi116.stdout: "req_create_latency": { 2023-12-01T01:07:27.646 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.646 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.646 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.646 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getattr_latency": { 2023-12-01T01:07:27.646 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.646 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.646 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.646 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.646 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getfilelock_latency": { 2023-12-01T01:07:27.646 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.647 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.647 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.647 INFO:teuthology.orchestra.run.smithi116.stdout: "req_link_latency": { 2023-12-01T01:07:27.647 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.647 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.647 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.647 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookup_latency": { 2023-12-01T01:07:27.647 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.647 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.647 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.647 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.647 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookuphash_latency": { 2023-12-01T01:07:27.648 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.648 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.648 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.648 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupino_latency": { 2023-12-01T01:07:27.648 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.648 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.648 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.648 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupname_latency": { 2023-12-01T01:07:27.648 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.648 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.648 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.648 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.649 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupparent_latency": { 2023-12-01T01:07:27.649 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.649 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.649 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.649 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupsnap_latency": { 2023-12-01T01:07:27.649 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.649 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.649 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.649 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.649 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lssnap_latency": { 2023-12-01T01:07:27.649 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.649 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.649 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.650 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mkdir_latency": { 2023-12-01T01:07:27.650 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.650 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.650 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.650 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mknod_latency": { 2023-12-01T01:07:27.650 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.650 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.650 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.650 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.650 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mksnap_latency": { 2023-12-01T01:07:27.650 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.651 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.651 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.651 INFO:teuthology.orchestra.run.smithi116.stdout: "req_open_latency": { 2023-12-01T01:07:27.651 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.651 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.651 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.651 INFO:teuthology.orchestra.run.smithi116.stdout: "req_readdir_latency": { 2023-12-01T01:07:27.651 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.651 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.651 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.651 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.651 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rename_latency": { 2023-12-01T01:07:27.652 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.652 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.652 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.652 INFO:teuthology.orchestra.run.smithi116.stdout: "req_renamesnap_latency": { 2023-12-01T01:07:27.652 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.652 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.652 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.652 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.652 INFO:teuthology.orchestra.run.smithi116.stdout: "req_snapdiff_latency": { 2023-12-01T01:07:27.652 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.653 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.653 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.653 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmdir_latency": { 2023-12-01T01:07:27.653 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.653 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.653 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.653 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmsnap_latency": { 2023-12-01T01:07:27.653 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.653 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.653 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.653 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.654 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmxattr_latency": { 2023-12-01T01:07:27.654 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.654 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.654 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.654 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setattr_latency": { 2023-12-01T01:07:27.654 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.654 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.654 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.654 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.654 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setdirlayout_latency": { 2023-12-01T01:07:27.654 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.654 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.654 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.655 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setfilelock_latency": { 2023-12-01T01:07:27.655 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.655 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.655 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.655 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setlayout_latency": { 2023-12-01T01:07:27.655 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.655 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.655 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.655 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.655 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setxattr_latency": { 2023-12-01T01:07:27.655 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.656 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.656 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.656 INFO:teuthology.orchestra.run.smithi116.stdout: "req_symlink_latency": { 2023-12-01T01:07:27.656 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.656 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.656 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.656 INFO:teuthology.orchestra.run.smithi116.stdout: "req_unlink_latency": { 2023-12-01T01:07:27.656 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.656 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.656 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.656 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.657 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_revoke_eviction": 0, 2023-12-01T01:07:27.657 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_acquisition_throttle": 0, 2023-12-01T01:07:27.657 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getvxattr_latency": { 2023-12-01T01:07:27.657 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.657 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.657 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.657 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:27.657 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.657 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sessions": { 2023-12-01T01:07:27.657 INFO:teuthology.orchestra.run.smithi116.stdout: "session_count": 1, 2023-12-01T01:07:27.657 INFO:teuthology.orchestra.run.smithi116.stdout: "session_add": 2, 2023-12-01T01:07:27.657 INFO:teuthology.orchestra.run.smithi116.stdout: "session_remove": 1, 2023-12-01T01:07:27.657 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_open": 1, 2023-12-01T01:07:27.657 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_stale": 0, 2023-12-01T01:07:27.658 INFO:teuthology.orchestra.run.smithi116.stdout: "total_load": 0, 2023-12-01T01:07:27.658 INFO:teuthology.orchestra.run.smithi116.stdout: "average_load": 0, 2023-12-01T01:07:27.658 INFO:teuthology.orchestra.run.smithi116.stdout: "avg_session_uptime": 1526, 2023-12-01T01:07:27.658 INFO:teuthology.orchestra.run.smithi116.stdout: "mdthresh_evicted": 0 2023-12-01T01:07:27.658 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.658 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2023-12-01T01:07:27.658 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2023-12-01T01:07:27.658 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2023-12-01T01:07:27.658 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2023-12-01T01:07:27.658 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2023-12-01T01:07:27.658 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2023-12-01T01:07:27.658 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2023-12-01T01:07:27.658 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-01T01:07:27.658 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2023-12-01T01:07:27.659 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-01T01:07:27.659 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2023-12-01T01:07:27.659 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2023-12-01T01:07:27.659 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2023-12-01T01:07:27.659 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-01T01:07:27.659 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2023-12-01T01:07:27.659 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2023-12-01T01:07:27.659 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2023-12-01T01:07:27.659 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2023-12-01T01:07:27.659 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2023-12-01T01:07:27.659 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-01T01:07:27.659 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2023-12-01T01:07:27.659 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-01T01:07:27.659 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2023-12-01T01:07:27.660 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2023-12-01T01:07:27.660 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2023-12-01T01:07:27.660 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2023-12-01T01:07:27.660 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2023-12-01T01:07:27.660 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-01T01:07:27.660 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2023-12-01T01:07:27.660 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2023-12-01T01:07:27.660 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2023-12-01T01:07:27.660 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2023-12-01T01:07:27.660 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2023-12-01T01:07:27.660 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2023-12-01T01:07:27.660 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2023-12-01T01:07:27.660 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2023-12-01T01:07:27.660 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2023-12-01T01:07:27.661 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 213955, 2023-12-01T01:07:27.661 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 74, 2023-12-01T01:07:27.661 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2023-12-01T01:07:27.661 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2023-12-01T01:07:27.661 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2023-12-01T01:07:27.661 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2023-12-01T01:07:27.661 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2023-12-01T01:07:27.661 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2023-12-01T01:07:27.661 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2023-12-01T01:07:27.661 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2023-12-01T01:07:27.661 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 7528, 2023-12-01T01:07:27.661 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 158, 2023-12-01T01:07:27.661 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2023-12-01T01:07:27.661 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2023-12-01T01:07:27.662 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2023-12-01T01:07:27.662 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2023-12-01T01:07:27.662 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 2861860, 2023-12-01T01:07:27.662 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 19756, 2023-12-01T01:07:27.662 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2023-12-01T01:07:27.662 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2023-12-01T01:07:27.662 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2023-12-01T01:07:27.662 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2023-12-01T01:07:27.662 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.662 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter": { 2023-12-01T01:07:27.662 INFO:teuthology.orchestra.run.smithi116.stdout: "op_active": 0, 2023-12-01T01:07:27.662 INFO:teuthology.orchestra.run.smithi116.stdout: "op_laggy": 0, 2023-12-01T01:07:27.662 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send": 840, 2023-12-01T01:07:27.662 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send_bytes": 21, 2023-12-01T01:07:27.662 INFO:teuthology.orchestra.run.smithi116.stdout: "op_resend": 3, 2023-12-01T01:07:27.663 INFO:teuthology.orchestra.run.smithi116.stdout: "op_reply": 840, 2023-12-01T01:07:27.663 INFO:teuthology.orchestra.run.smithi116.stdout: "op_latency": { 2023-12-01T01:07:27.663 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 840, 2023-12-01T01:07:27.663 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.523991309, 2023-12-01T01:07:27.663 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000623799 2023-12-01T01:07:27.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.663 INFO:teuthology.orchestra.run.smithi116.stdout: "op_inflight": 0, 2023-12-01T01:07:27.663 INFO:teuthology.orchestra.run.smithi116.stdout: "oplen_avg": { 2023-12-01T01:07:27.663 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 840, 2023-12-01T01:07:27.663 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 841 2023-12-01T01:07:27.663 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.663 INFO:teuthology.orchestra.run.smithi116.stdout: "op": 840, 2023-12-01T01:07:27.663 INFO:teuthology.orchestra.run.smithi116.stdout: "op_r": 840, 2023-12-01T01:07:27.663 INFO:teuthology.orchestra.run.smithi116.stdout: "op_w": 0, 2023-12-01T01:07:27.664 INFO:teuthology.orchestra.run.smithi116.stdout: "op_rmw": 0, 2023-12-01T01:07:27.664 INFO:teuthology.orchestra.run.smithi116.stdout: "op_pg": 0, 2023-12-01T01:07:27.664 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_stat": 528, 2023-12-01T01:07:27.664 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_create": 0, 2023-12-01T01:07:27.664 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_read": 310, 2023-12-01T01:07:27.664 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_write": 0, 2023-12-01T01:07:27.664 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writefull": 0, 2023-12-01T01:07:27.664 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writesame": 0, 2023-12-01T01:07:27.664 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_append": 0, 2023-12-01T01:07:27.664 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_zero": 0, 2023-12-01T01:07:27.664 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_truncate": 0, 2023-12-01T01:07:27.664 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_delete": 0, 2023-12-01T01:07:27.664 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_mapext": 0, 2023-12-01T01:07:27.664 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_sparse_read": 0, 2023-12-01T01:07:27.664 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_clonerange": 0, 2023-12-01T01:07:27.665 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_getxattr": 1, 2023-12-01T01:07:27.665 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_setxattr": 0, 2023-12-01T01:07:27.665 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_cmpxattr": 0, 2023-12-01T01:07:27.665 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_rmxattr": 0, 2023-12-01T01:07:27.665 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_resetxattrs": 0, 2023-12-01T01:07:27.665 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_call": 0, 2023-12-01T01:07:27.665 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_watch": 0, 2023-12-01T01:07:27.665 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_notify": 0, 2023-12-01T01:07:27.665 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_src_cmpxattr": 0, 2023-12-01T01:07:27.665 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls": 0, 2023-12-01T01:07:27.665 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls_filter": 0, 2023-12-01T01:07:27.665 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_other": 0, 2023-12-01T01:07:27.665 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_active": 0, 2023-12-01T01:07:27.665 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_send": 0, 2023-12-01T01:07:27.665 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_resend": 0, 2023-12-01T01:07:27.666 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_ping": 0, 2023-12-01T01:07:27.666 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_active": 0, 2023-12-01T01:07:27.666 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_send": 0, 2023-12-01T01:07:27.666 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_resend": 0, 2023-12-01T01:07:27.666 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_active": 0, 2023-12-01T01:07:27.666 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_send": 0, 2023-12-01T01:07:27.666 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_resend": 0, 2023-12-01T01:07:27.666 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_active": 0, 2023-12-01T01:07:27.666 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_send": 0, 2023-12-01T01:07:27.666 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_resend": 0, 2023-12-01T01:07:27.666 INFO:teuthology.orchestra.run.smithi116.stdout: "command_active": 0, 2023-12-01T01:07:27.667 INFO:teuthology.orchestra.run.smithi116.stdout: "command_send": 0, 2023-12-01T01:07:27.667 INFO:teuthology.orchestra.run.smithi116.stdout: "command_resend": 0, 2023-12-01T01:07:27.667 INFO:teuthology.orchestra.run.smithi116.stdout: "map_epoch": 84, 2023-12-01T01:07:27.667 INFO:teuthology.orchestra.run.smithi116.stdout: "map_full": 0, 2023-12-01T01:07:27.667 INFO:teuthology.orchestra.run.smithi116.stdout: "map_inc": 3, 2023-12-01T01:07:27.667 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_sessions": 8, 2023-12-01T01:07:27.667 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_open": 8, 2023-12-01T01:07:27.667 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_close": 0, 2023-12-01T01:07:27.667 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_laggy": 0, 2023-12-01T01:07:27.667 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_wr": 0, 2023-12-01T01:07:27.667 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_rd": 2, 2023-12-01T01:07:27.667 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_del": 0 2023-12-01T01:07:27.667 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.667 INFO:teuthology.orchestra.run.smithi116.stdout: "oft": { 2023-12-01T01:07:27.667 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_objs": 0, 2023-12-01T01:07:27.668 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_kv_pairs": 0, 2023-12-01T01:07:27.668 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_updates": 0, 2023-12-01T01:07:27.668 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_removes": 0 2023-12-01T01:07:27.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.668 INFO:teuthology.orchestra.run.smithi116.stdout: "osd-slow-ops": { 2023-12-01T01:07:27.668 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_ops_count": 0 2023-12-01T01:07:27.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.668 INFO:teuthology.orchestra.run.smithi116.stdout: "purge_queue": { 2023-12-01T01:07:27.668 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops": 0, 2023-12-01T01:07:27.668 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops_high_water": 0, 2023-12-01T01:07:27.668 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing": 0, 2023-12-01T01:07:27.668 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_high_water": 0, 2023-12-01T01:07:27.668 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed": 0, 2023-12-01T01:07:27.668 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_item_in_journal": 0 2023-12-01T01:07:27.668 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.669 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-01T01:07:27.669 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2023-12-01T01:07:27.669 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2023-12-01T01:07:27.669 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2023-12-01T01:07:27.669 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 944, 2023-12-01T01:07:27.669 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 26315408, 2023-12-01T01:07:27.669 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:27.669 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 944, 2023-12-01T01:07:27.669 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2023-12-01T01:07:27.669 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2023-12-01T01:07:27.669 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 944, 2023-12-01T01:07:27.669 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 26315408, 2023-12-01T01:07:27.669 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2023-12-01T01:07:27.669 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.669 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.670 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.670 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:27.670 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.670 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_bytes": { 2023-12-01T01:07:27.670 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2023-12-01T01:07:27.670 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2023-12-01T01:07:27.670 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2023-12-01T01:07:27.670 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2023-12-01T01:07:27.670 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2023-12-01T01:07:27.670 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:27.670 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:27.670 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 840, 2023-12-01T01:07:27.670 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 25687665, 2023-12-01T01:07:27.670 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 840, 2023-12-01T01:07:27.670 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 25687665, 2023-12-01T01:07:27.671 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2023-12-01T01:07:27.671 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.671 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.671 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.671 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:27.671 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.671 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_ops": { 2023-12-01T01:07:27.671 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2023-12-01T01:07:27.671 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 1024, 2023-12-01T01:07:27.671 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2023-12-01T01:07:27.671 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2023-12-01T01:07:27.671 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2023-12-01T01:07:27.671 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:27.671 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:27.672 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 840, 2023-12-01T01:07:27.672 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 840, 2023-12-01T01:07:27.672 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 840, 2023-12-01T01:07:27.672 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 840, 2023-12-01T01:07:27.672 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2023-12-01T01:07:27.672 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.672 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.672 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.672 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:27.672 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.672 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle": { 2023-12-01T01:07:27.672 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2023-12-01T01:07:27.672 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2023-12-01T01:07:27.672 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2023-12-01T01:07:27.672 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2023-12-01T01:07:27.673 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2023-12-01T01:07:27.673 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:27.673 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:27.673 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2023-12-01T01:07:27.673 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2023-12-01T01:07:27.673 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 0, 2023-12-01T01:07:27.673 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 0, 2023-12-01T01:07:27.673 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2023-12-01T01:07:27.673 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.673 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.673 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.673 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:27.673 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:27.673 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle-0x5638365765a0": { 2023-12-01T01:07:27.673 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2023-12-01T01:07:27.673 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2023-12-01T01:07:27.674 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2023-12-01T01:07:27.674 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2023-12-01T01:07:27.674 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2023-12-01T01:07:27.674 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:27.674 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:27.674 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2023-12-01T01:07:27.674 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2023-12-01T01:07:27.674 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 0, 2023-12-01T01:07:27.674 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 0, 2023-12-01T01:07:27.674 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2023-12-01T01:07:27.674 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:27.674 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:27.674 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:27.675 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:27.675 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:27.675 INFO:teuthology.orchestra.run.smithi116.stdout:} 2023-12-01T01:07:27.966 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2023-12-01T01:07:27.966 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2023-12-01T01:07:27.966 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2023-12-01T01:07:27.966 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2023-12-01T01:07:27.966 DEBUG:tasks.check_counter:Getting stats from i 2023-12-01T01:07:27.966 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph daemon mds.i perf dump 2023-12-01T01:07:28.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:27 smithi116 ceph-mon[103554]: pgmap v388: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 7 op/s 2023-12-01T01:07:28.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:27 smithi093 ceph-mon[103327]: pgmap v388: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 7 op/s 2023-12-01T01:07:28.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:27 smithi026 ceph-mon[98801]: pgmap v388: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 682 B/s wr, 7 op/s 2023-12-01T01:07:28.516 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.c/config 2023-12-01T01:07:29.752 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2023-12-01T01:07:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2023-12-01T01:07:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 9006, 2023-12-01T01:07:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 20111, 2023-12-01T01:07:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 2882700, 2023-12-01T01:07:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 16388215, 2023-12-01T01:07:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 14, 2023-12-01T01:07:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 5, 2023-12-01T01:07:29.752 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.488514966, 2023-12-01T01:07:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.224354258, 2023-12-01T01:07:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.706202606, 2023-12-01T01:07:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.027436660, 2023-12-01T01:07:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 20109, 2023-12-01T01:07:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.643322773, 2023-12-01T01:07:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000031991 2023-12-01T01:07:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 21631, 2023-12-01T01:07:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.003136773, 2023-12-01T01:07:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000145 2023-12-01T01:07:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 912, 2023-12-01T01:07:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 688 2023-12-01T01:07:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2023-12-01T01:07:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 1961, 2023-12-01T01:07:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 1951, 2023-12-01T01:07:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 966755, 2023-12-01T01:07:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 9568281, 2023-12-01T01:07:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 16, 2023-12-01T01:07:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 7, 2023-12-01T01:07:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.160657705, 2023-12-01T01:07:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.073191712, 2023-12-01T01:07:29.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.038906149, 2023-12-01T01:07:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.043470905, 2023-12-01T01:07:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1948, 2023-12-01T01:07:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.181106772, 2023-12-01T01:07:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000092970 2023-12-01T01:07:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 8, 2023-12-01T01:07:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000757, 2023-12-01T01:07:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000094 2023-12-01T01:07:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 489008, 2023-12-01T01:07:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 89808 2023-12-01T01:07:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.755 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2023-12-01T01:07:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 59986, 2023-12-01T01:07:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 62731, 2023-12-01T01:07:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 15542304, 2023-12-01T01:07:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 17233307, 2023-12-01T01:07:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 8, 2023-12-01T01:07:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 5, 2023-12-01T01:07:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 1.882320221, 2023-12-01T01:07:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.718065149, 2023-12-01T01:07:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 1.331130167, 2023-12-01T01:07:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.028179725, 2023-12-01T01:07:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 62732, 2023-12-01T01:07:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.914658753, 2023-12-01T01:07:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000014580 2023-12-01T01:07:29.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 119248, 2023-12-01T01:07:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.011707383, 2023-12-01T01:07:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000098 2023-12-01T01:07:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-12-01T01:07:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 184416 2023-12-01T01:07:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2023-12-01T01:07:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 1, 2023-12-01T01:07:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2023-12-01T01:07:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-MDSRank": { 2023-12-01T01:07:29.757 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2023-12-01T01:07:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2023-12-01T01:07:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 710, 2023-12-01T01:07:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 4.629100529, 2023-12-01T01:07:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.006519859 2023-12-01T01:07:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "finisher-PurgeQueue": { 2023-12-01T01:07:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "queue_len": 0, 2023-12-01T01:07:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "complete_latency": { 2023-12-01T01:07:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 4951, 2023-12-01T01:07:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 1.201212519, 2023-12-01T01:07:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000242620 2023-12-01T01:07:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.758 INFO:teuthology.orchestra.run.smithi116.stdout: "mds": { 2023-12-01T01:07:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "request": 4145, 2023-12-01T01:07:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "reply": 4141, 2023-12-01T01:07:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "reply_latency": { 2023-12-01T01:07:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 4141, 2023-12-01T01:07:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 8.579819115, 2023-12-01T01:07:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.002071919 2023-12-01T01:07:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_reply": 0, 2023-12-01T01:07:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "forward": 0, 2023-12-01T01:07:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_complete": 0, 2023-12-01T01:07:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_fetch_keys": 0, 2023-12-01T01:07:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_commit": 11, 2023-12-01T01:07:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_split": 0, 2023-12-01T01:07:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_merge": 0, 2023-12-01T01:07:29.759 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes": 54, 2023-12-01T01:07:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_top": 18, 2023-12-01T01:07:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_bottom": 9, 2023-12-01T01:07:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pin_tail": 27, 2023-12-01T01:07:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_pinned": 27, 2023-12-01T01:07:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_expired": 860, 2023-12-01T01:07:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "inodes_with_caps": 1, 2023-12-01T01:07:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "caps": 1, 2023-12-01T01:07:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "subtrees": 3, 2023-12-01T01:07:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse": 6323, 2023-12-01T01:07:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_hit": 4929, 2023-12-01T01:07:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_forward": 0, 2023-12-01T01:07:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_discover": 962, 2023-12-01T01:07:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_dir_fetch": 0, 2023-12-01T01:07:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_remote_ino": 0, 2023-12-01T01:07:29.760 INFO:teuthology.orchestra.run.smithi116.stdout: "traverse_lock": 0, 2023-12-01T01:07:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "load_cent": 0, 2023-12-01T01:07:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "q": 0, 2023-12-01T01:07:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "exported": 6, 2023-12-01T01:07:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "exported_inodes": 193, 2023-12-01T01:07:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "imported": 6, 2023-12-01T01:07:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "imported_inodes": 3270, 2023-12-01T01:07:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_dir_fetch": 0, 2023-12-01T01:07:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_backtrace_fetch": 87, 2023-12-01T01:07:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "openino_peer_discover": 0, 2023-12-01T01:07:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rfiles": 3713, 2023-12-01T01:07:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rbytes": 97765335, 2023-12-01T01:07:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "root_rsnaps": 0, 2023-12-01T01:07:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_fetch": 87, 2023-12-01T01:07:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_set_tag": 0, 2023-12-01T01:07:29.761 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_backtrace_repaired": 0, 2023-12-01T01:07:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_inotable_repaired": 0, 2023-12-01T01:07:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_inodes": 2, 2023-12-01T01:07:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dir_base_inodes": 0, 2023-12-01T01:07:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_dirfrag_rstats": 2, 2023-12-01T01:07:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "scrub_file_inodes": 85, 2023-12-01T01:07:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_inode_file_caps": 0, 2023-12-01T01:07:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_revoke": 672, 2023-12-01T01:07:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_grant": 4363, 2023-12-01T01:07:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_trunc": 0, 2023-12-01T01:07:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-12-01T01:07:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "ceph_cap_op_flush_ack": 0, 2023-12-01T01:07:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps": 3703, 2023-12-01T01:07:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_caps_dirty": 2740, 2023-12-01T01:07:29.762 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_cap_release": 30, 2023-12-01T01:07:29.763 INFO:teuthology.orchestra.run.smithi116.stdout: "process_request_cap_release": 3872 2023-12-01T01:07:29.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.763 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_cache": { 2023-12-01T01:07:29.763 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update": 126, 2023-12-01T01:07:29.763 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_update_receipt": 2346, 2023-12-01T01:07:29.763 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_try_discover": 1645, 2023-12-01T01:07:29.763 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_send_discover": 1296, 2023-12-01T01:07:29.763 INFO:teuthology.orchestra.run.smithi116.stdout: "dir_handle_discover": 245, 2023-12-01T01:07:29.763 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays": 14, 2023-12-01T01:07:29.763 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_delayed": 0, 2023-12-01T01:07:29.763 INFO:teuthology.orchestra.run.smithi116.stdout: "num_strays_enqueuing": 0, 2023-12-01T01:07:29.763 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_created": 3531, 2023-12-01T01:07:29.763 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_enqueued": 3517, 2023-12-01T01:07:29.764 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_reintegrated": 0, 2023-12-01T01:07:29.764 INFO:teuthology.orchestra.run.smithi116.stdout: "strays_migrated": 0, 2023-12-01T01:07:29.764 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_processing": 0, 2023-12-01T01:07:29.764 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_enqueued": 0, 2023-12-01T01:07:29.764 INFO:teuthology.orchestra.run.smithi116.stdout: "num_recovering_prioritized": 0, 2023-12-01T01:07:29.764 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_started": 0, 2023-12-01T01:07:29.764 INFO:teuthology.orchestra.run.smithi116.stdout: "recovery_completed": 0, 2023-12-01T01:07:29.764 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_enqueue_scrub": 0, 2023-12-01T01:07:29.764 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_exportdir": 6, 2023-12-01T01:07:29.764 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_flush": 0, 2023-12-01T01:07:29.764 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragmentdir": 0, 2023-12-01T01:07:29.764 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_fragstats": 0, 2023-12-01T01:07:29.765 INFO:teuthology.orchestra.run.smithi116.stdout: "ireq_inodestats": 0 2023-12-01T01:07:29.765 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.765 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_log": { 2023-12-01T01:07:29.765 INFO:teuthology.orchestra.run.smithi116.stdout: "evadd": 12421, 2023-12-01T01:07:29.765 INFO:teuthology.orchestra.run.smithi116.stdout: "evex": 0, 2023-12-01T01:07:29.765 INFO:teuthology.orchestra.run.smithi116.stdout: "evtrm": 0, 2023-12-01T01:07:29.765 INFO:teuthology.orchestra.run.smithi116.stdout: "ev": 12421, 2023-12-01T01:07:29.765 INFO:teuthology.orchestra.run.smithi116.stdout: "evexg": 0, 2023-12-01T01:07:29.765 INFO:teuthology.orchestra.run.smithi116.stdout: "evexd": 0, 2023-12-01T01:07:29.765 INFO:teuthology.orchestra.run.smithi116.stdout: "segadd": 16, 2023-12-01T01:07:29.765 INFO:teuthology.orchestra.run.smithi116.stdout: "segex": 0, 2023-12-01T01:07:29.765 INFO:teuthology.orchestra.run.smithi116.stdout: "segtrm": 0, 2023-12-01T01:07:29.765 INFO:teuthology.orchestra.run.smithi116.stdout: "seg": 16, 2023-12-01T01:07:29.765 INFO:teuthology.orchestra.run.smithi116.stdout: "segexg": 0, 2023-12-01T01:07:29.765 INFO:teuthology.orchestra.run.smithi116.stdout: "segexd": 0, 2023-12-01T01:07:29.766 INFO:teuthology.orchestra.run.smithi116.stdout: "expos": 4194304, 2023-12-01T01:07:29.766 INFO:teuthology.orchestra.run.smithi116.stdout: "wrpos": 29880894, 2023-12-01T01:07:29.766 INFO:teuthology.orchestra.run.smithi116.stdout: "rdpos": 0, 2023-12-01T01:07:29.766 INFO:teuthology.orchestra.run.smithi116.stdout: "jlat": { 2023-12-01T01:07:29.766 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 321, 2023-12-01T01:07:29.766 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 3.970288016, 2023-12-01T01:07:29.766 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.012368498 2023-12-01T01:07:29.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.766 INFO:teuthology.orchestra.run.smithi116.stdout: "replayed": 0 2023-12-01T01:07:29.766 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.766 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_mem": { 2023-12-01T01:07:29.766 INFO:teuthology.orchestra.run.smithi116.stdout: "ino": 36, 2023-12-01T01:07:29.766 INFO:teuthology.orchestra.run.smithi116.stdout: "ino+": 3931, 2023-12-01T01:07:29.766 INFO:teuthology.orchestra.run.smithi116.stdout: "ino-": 3895, 2023-12-01T01:07:29.767 INFO:teuthology.orchestra.run.smithi116.stdout: "dir": 41, 2023-12-01T01:07:29.767 INFO:teuthology.orchestra.run.smithi116.stdout: "dir+": 728, 2023-12-01T01:07:29.767 INFO:teuthology.orchestra.run.smithi116.stdout: "dir-": 687, 2023-12-01T01:07:29.767 INFO:teuthology.orchestra.run.smithi116.stdout: "dn": 54, 2023-12-01T01:07:29.767 INFO:teuthology.orchestra.run.smithi116.stdout: "dn+": 7417, 2023-12-01T01:07:29.767 INFO:teuthology.orchestra.run.smithi116.stdout: "dn-": 7363, 2023-12-01T01:07:29.767 INFO:teuthology.orchestra.run.smithi116.stdout: "cap": 1, 2023-12-01T01:07:29.767 INFO:teuthology.orchestra.run.smithi116.stdout: "cap+": 3534, 2023-12-01T01:07:29.767 INFO:teuthology.orchestra.run.smithi116.stdout: "cap-": 3533, 2023-12-01T01:07:29.767 INFO:teuthology.orchestra.run.smithi116.stdout: "rss": 77796, 2023-12-01T01:07:29.767 INFO:teuthology.orchestra.run.smithi116.stdout: "heap": 198964 2023-12-01T01:07:29.767 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.767 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_server": { 2023-12-01T01:07:29.767 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_client_request": 6368, 2023-12-01T01:07:29.767 INFO:teuthology.orchestra.run.smithi116.stdout: "dispatch_server_request": 179, 2023-12-01T01:07:29.768 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_request": 4145, 2023-12-01T01:07:29.768 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_client_session": 7, 2023-12-01T01:07:29.768 INFO:teuthology.orchestra.run.smithi116.stdout: "handle_peer_request": 360, 2023-12-01T01:07:29.768 INFO:teuthology.orchestra.run.smithi116.stdout: "req_create_latency": { 2023-12-01T01:07:29.768 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 293, 2023-12-01T01:07:29.768 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.204114849, 2023-12-01T01:07:29.768 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000696637 2023-12-01T01:07:29.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.768 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getattr_latency": { 2023-12-01T01:07:29.768 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.768 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.768 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.768 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.768 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getfilelock_latency": { 2023-12-01T01:07:29.768 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.768 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.769 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.769 INFO:teuthology.orchestra.run.smithi116.stdout: "req_link_latency": { 2023-12-01T01:07:29.769 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.769 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.769 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.769 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookup_latency": { 2023-12-01T01:07:29.769 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 104, 2023-12-01T01:07:29.769 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.031130073, 2023-12-01T01:07:29.769 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000299327 2023-12-01T01:07:29.769 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.769 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookuphash_latency": { 2023-12-01T01:07:29.769 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.770 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.770 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.770 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupino_latency": { 2023-12-01T01:07:29.770 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 1, 2023-12-01T01:07:29.770 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000201637, 2023-12-01T01:07:29.770 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000201637 2023-12-01T01:07:29.770 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.770 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupname_latency": { 2023-12-01T01:07:29.770 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.770 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.771 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.771 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupparent_latency": { 2023-12-01T01:07:29.771 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.771 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.771 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.771 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lookupsnap_latency": { 2023-12-01T01:07:29.771 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.771 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.771 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.771 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.771 INFO:teuthology.orchestra.run.smithi116.stdout: "req_lssnap_latency": { 2023-12-01T01:07:29.771 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.771 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.772 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.772 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mkdir_latency": { 2023-12-01T01:07:29.772 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.772 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.772 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.772 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mknod_latency": { 2023-12-01T01:07:29.772 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.772 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.772 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.772 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.772 INFO:teuthology.orchestra.run.smithi116.stdout: "req_mksnap_latency": { 2023-12-01T01:07:29.772 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.772 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.773 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.773 INFO:teuthology.orchestra.run.smithi116.stdout: "req_open_latency": { 2023-12-01T01:07:29.773 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.773 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.773 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.773 INFO:teuthology.orchestra.run.smithi116.stdout: "req_readdir_latency": { 2023-12-01T01:07:29.773 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 212, 2023-12-01T01:07:29.773 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.171829287, 2023-12-01T01:07:29.773 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000810515 2023-12-01T01:07:29.773 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.773 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rename_latency": { 2023-12-01T01:07:29.773 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.774 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.774 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.774 INFO:teuthology.orchestra.run.smithi116.stdout: "req_renamesnap_latency": { 2023-12-01T01:07:29.774 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.774 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.774 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.774 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.774 INFO:teuthology.orchestra.run.smithi116.stdout: "req_snapdiff_latency": { 2023-12-01T01:07:29.774 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.774 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.775 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.775 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmdir_latency": { 2023-12-01T01:07:29.775 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 245, 2023-12-01T01:07:29.775 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 4.014662217, 2023-12-01T01:07:29.775 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.016386376 2023-12-01T01:07:29.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.775 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmsnap_latency": { 2023-12-01T01:07:29.775 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.775 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.775 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.775 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.775 INFO:teuthology.orchestra.run.smithi116.stdout: "req_rmxattr_latency": { 2023-12-01T01:07:29.775 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.776 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.776 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.776 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setattr_latency": { 2023-12-01T01:07:29.776 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.776 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.776 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.776 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.776 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setdirlayout_latency": { 2023-12-01T01:07:29.776 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.776 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.777 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.777 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setfilelock_latency": { 2023-12-01T01:07:29.777 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.777 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.777 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.777 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setlayout_latency": { 2023-12-01T01:07:29.777 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.777 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.777 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.777 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.777 INFO:teuthology.orchestra.run.smithi116.stdout: "req_setxattr_latency": { 2023-12-01T01:07:29.778 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.778 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.778 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.778 INFO:teuthology.orchestra.run.smithi116.stdout: "req_symlink_latency": { 2023-12-01T01:07:29.778 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.778 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.778 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.778 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.778 INFO:teuthology.orchestra.run.smithi116.stdout: "req_unlink_latency": { 2023-12-01T01:07:29.778 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 3286, 2023-12-01T01:07:29.778 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 4.157881052, 2023-12-01T01:07:29.778 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.001265332 2023-12-01T01:07:29.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.779 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_revoke_eviction": 0, 2023-12-01T01:07:29.779 INFO:teuthology.orchestra.run.smithi116.stdout: "cap_acquisition_throttle": 0, 2023-12-01T01:07:29.779 INFO:teuthology.orchestra.run.smithi116.stdout: "req_getvxattr_latency": { 2023-12-01T01:07:29.779 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.779 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.779 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.779 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:29.779 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.779 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_sessions": { 2023-12-01T01:07:29.779 INFO:teuthology.orchestra.run.smithi116.stdout: "session_count": 1, 2023-12-01T01:07:29.779 INFO:teuthology.orchestra.run.smithi116.stdout: "session_add": 2, 2023-12-01T01:07:29.779 INFO:teuthology.orchestra.run.smithi116.stdout: "session_remove": 1, 2023-12-01T01:07:29.780 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_open": 1, 2023-12-01T01:07:29.780 INFO:teuthology.orchestra.run.smithi116.stdout: "sessions_stale": 0, 2023-12-01T01:07:29.780 INFO:teuthology.orchestra.run.smithi116.stdout: "total_load": 3111, 2023-12-01T01:07:29.780 INFO:teuthology.orchestra.run.smithi116.stdout: "average_load": 3111, 2023-12-01T01:07:29.780 INFO:teuthology.orchestra.run.smithi116.stdout: "avg_session_uptime": 191, 2023-12-01T01:07:29.780 INFO:teuthology.orchestra.run.smithi116.stdout: "mdthresh_evicted": 0 2023-12-01T01:07:29.780 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.780 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2023-12-01T01:07:29.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2023-12-01T01:07:29.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2023-12-01T01:07:29.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2023-12-01T01:07:29.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2023-12-01T01:07:29.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2023-12-01T01:07:29.780 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2023-12-01T01:07:29.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-01T01:07:29.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2023-12-01T01:07:29.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-01T01:07:29.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2023-12-01T01:07:29.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2023-12-01T01:07:29.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2023-12-01T01:07:29.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-01T01:07:29.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2023-12-01T01:07:29.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2023-12-01T01:07:29.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2023-12-01T01:07:29.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2023-12-01T01:07:29.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2023-12-01T01:07:29.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-01T01:07:29.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2023-12-01T01:07:29.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-01T01:07:29.781 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2023-12-01T01:07:29.782 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2023-12-01T01:07:29.782 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2023-12-01T01:07:29.782 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2023-12-01T01:07:29.782 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2023-12-01T01:07:29.782 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-01T01:07:29.782 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2023-12-01T01:07:29.782 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2023-12-01T01:07:29.782 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2023-12-01T01:07:29.782 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2023-12-01T01:07:29.782 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2023-12-01T01:07:29.782 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2023-12-01T01:07:29.782 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2023-12-01T01:07:29.782 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2023-12-01T01:07:29.782 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2023-12-01T01:07:29.782 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 291646, 2023-12-01T01:07:29.783 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 137, 2023-12-01T01:07:29.783 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 880, 2023-12-01T01:07:29.783 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 10, 2023-12-01T01:07:29.783 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2023-12-01T01:07:29.783 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2023-12-01T01:07:29.783 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2023-12-01T01:07:29.783 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2023-12-01T01:07:29.783 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2023-12-01T01:07:29.783 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2023-12-01T01:07:29.783 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 7528, 2023-12-01T01:07:29.783 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 158, 2023-12-01T01:07:29.783 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2023-12-01T01:07:29.783 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2023-12-01T01:07:29.783 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2023-12-01T01:07:29.783 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2023-12-01T01:07:29.784 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 179048, 2023-12-01T01:07:29.784 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 3168, 2023-12-01T01:07:29.784 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2023-12-01T01:07:29.784 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2023-12-01T01:07:29.784 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2023-12-01T01:07:29.784 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2023-12-01T01:07:29.784 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.784 INFO:teuthology.orchestra.run.smithi116.stdout: "objecter": { 2023-12-01T01:07:29.784 INFO:teuthology.orchestra.run.smithi116.stdout: "op_active": 0, 2023-12-01T01:07:29.784 INFO:teuthology.orchestra.run.smithi116.stdout: "op_laggy": 0, 2023-12-01T01:07:29.784 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send": 4186, 2023-12-01T01:07:29.784 INFO:teuthology.orchestra.run.smithi116.stdout: "op_send_bytes": 26393015, 2023-12-01T01:07:29.784 INFO:teuthology.orchestra.run.smithi116.stdout: "op_resend": 28, 2023-12-01T01:07:29.784 INFO:teuthology.orchestra.run.smithi116.stdout: "op_reply": 4186, 2023-12-01T01:07:29.784 INFO:teuthology.orchestra.run.smithi116.stdout: "op_latency": { 2023-12-01T01:07:29.785 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 4186, 2023-12-01T01:07:29.785 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 10.604823786, 2023-12-01T01:07:29.785 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.002533402 2023-12-01T01:07:29.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.785 INFO:teuthology.orchestra.run.smithi116.stdout: "op_inflight": 0, 2023-12-01T01:07:29.785 INFO:teuthology.orchestra.run.smithi116.stdout: "oplen_avg": { 2023-12-01T01:07:29.785 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 4186, 2023-12-01T01:07:29.785 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 4225 2023-12-01T01:07:29.785 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.785 INFO:teuthology.orchestra.run.smithi116.stdout: "op": 4186, 2023-12-01T01:07:29.785 INFO:teuthology.orchestra.run.smithi116.stdout: "op_r": 158, 2023-12-01T01:07:29.785 INFO:teuthology.orchestra.run.smithi116.stdout: "op_w": 4028, 2023-12-01T01:07:29.785 INFO:teuthology.orchestra.run.smithi116.stdout: "op_rmw": 0, 2023-12-01T01:07:29.785 INFO:teuthology.orchestra.run.smithi116.stdout: "op_pg": 0, 2023-12-01T01:07:29.785 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_stat": 0, 2023-12-01T01:07:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_create": 10, 2023-12-01T01:07:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_read": 71, 2023-12-01T01:07:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_write": 392, 2023-12-01T01:07:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writefull": 35, 2023-12-01T01:07:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_writesame": 0, 2023-12-01T01:07:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_append": 0, 2023-12-01T01:07:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_zero": 0, 2023-12-01T01:07:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_truncate": 0, 2023-12-01T01:07:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_delete": 3567, 2023-12-01T01:07:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_mapext": 0, 2023-12-01T01:07:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_sparse_read": 0, 2023-12-01T01:07:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_clonerange": 0, 2023-12-01T01:07:29.786 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_getxattr": 87, 2023-12-01T01:07:29.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_setxattr": 20, 2023-12-01T01:07:29.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_cmpxattr": 0, 2023-12-01T01:07:29.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_rmxattr": 0, 2023-12-01T01:07:29.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_resetxattrs": 0, 2023-12-01T01:07:29.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_call": 0, 2023-12-01T01:07:29.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_watch": 0, 2023-12-01T01:07:29.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_notify": 0, 2023-12-01T01:07:29.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_src_cmpxattr": 0, 2023-12-01T01:07:29.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls": 0, 2023-12-01T01:07:29.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_pgls_filter": 0, 2023-12-01T01:07:29.787 INFO:teuthology.orchestra.run.smithi116.stdout: "osdop_other": 0, 2023-12-01T01:07:29.787 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_active": 0, 2023-12-01T01:07:29.787 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_send": 0, 2023-12-01T01:07:29.787 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_resend": 0, 2023-12-01T01:07:29.787 INFO:teuthology.orchestra.run.smithi116.stdout: "linger_ping": 0, 2023-12-01T01:07:29.788 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_active": 0, 2023-12-01T01:07:29.788 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_send": 0, 2023-12-01T01:07:29.788 INFO:teuthology.orchestra.run.smithi116.stdout: "poolop_resend": 0, 2023-12-01T01:07:29.788 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_active": 0, 2023-12-01T01:07:29.788 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_send": 0, 2023-12-01T01:07:29.788 INFO:teuthology.orchestra.run.smithi116.stdout: "poolstat_resend": 0, 2023-12-01T01:07:29.788 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_active": 0, 2023-12-01T01:07:29.788 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_send": 0, 2023-12-01T01:07:29.788 INFO:teuthology.orchestra.run.smithi116.stdout: "statfs_resend": 0, 2023-12-01T01:07:29.788 INFO:teuthology.orchestra.run.smithi116.stdout: "command_active": 0, 2023-12-01T01:07:29.788 INFO:teuthology.orchestra.run.smithi116.stdout: "command_send": 0, 2023-12-01T01:07:29.788 INFO:teuthology.orchestra.run.smithi116.stdout: "command_resend": 0, 2023-12-01T01:07:29.788 INFO:teuthology.orchestra.run.smithi116.stdout: "map_epoch": 84, 2023-12-01T01:07:29.788 INFO:teuthology.orchestra.run.smithi116.stdout: "map_full": 0, 2023-12-01T01:07:29.788 INFO:teuthology.orchestra.run.smithi116.stdout: "map_inc": 3, 2023-12-01T01:07:29.789 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_sessions": 12, 2023-12-01T01:07:29.789 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_open": 12, 2023-12-01T01:07:29.789 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_session_close": 0, 2023-12-01T01:07:29.789 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_laggy": 0, 2023-12-01T01:07:29.789 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_wr": 34, 2023-12-01T01:07:29.789 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_rd": 0, 2023-12-01T01:07:29.789 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_del": 9 2023-12-01T01:07:29.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.789 INFO:teuthology.orchestra.run.smithi116.stdout: "oft": { 2023-12-01T01:07:29.789 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_objs": 1, 2023-12-01T01:07:29.789 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_kv_pairs": 0, 2023-12-01T01:07:29.789 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_updates": 0, 2023-12-01T01:07:29.789 INFO:teuthology.orchestra.run.smithi116.stdout: "omap_total_removes": 0 2023-12-01T01:07:29.789 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.789 INFO:teuthology.orchestra.run.smithi116.stdout: "osd-slow-ops": { 2023-12-01T01:07:29.789 INFO:teuthology.orchestra.run.smithi116.stdout: "slow_ops_count": 4326 2023-12-01T01:07:29.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.790 INFO:teuthology.orchestra.run.smithi116.stdout: "purge_queue": { 2023-12-01T01:07:29.790 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops": 0, 2023-12-01T01:07:29.790 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_ops_high_water": 18, 2023-12-01T01:07:29.790 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing": 0, 2023-12-01T01:07:29.790 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executing_high_water": 10, 2023-12-01T01:07:29.790 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_executed": 3517, 2023-12-01T01:07:29.790 INFO:teuthology.orchestra.run.smithi116.stdout: "pq_item_in_journal": 0 2023-12-01T01:07:29.790 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.790 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-01T01:07:29.790 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2023-12-01T01:07:29.790 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2023-12-01T01:07:29.790 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2023-12-01T01:07:29.790 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 70949, 2023-12-01T01:07:29.790 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 12996640, 2023-12-01T01:07:29.791 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:29.791 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 70949, 2023-12-01T01:07:29.791 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2023-12-01T01:07:29.791 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2023-12-01T01:07:29.791 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 70949, 2023-12-01T01:07:29.791 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 12996640, 2023-12-01T01:07:29.791 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2023-12-01T01:07:29.791 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.791 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.791 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.791 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:29.791 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.791 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_bytes": { 2023-12-01T01:07:29.791 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2023-12-01T01:07:29.791 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2023-12-01T01:07:29.792 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2023-12-01T01:07:29.792 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2023-12-01T01:07:29.792 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2023-12-01T01:07:29.792 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:29.792 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:29.792 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 4186, 2023-12-01T01:07:29.792 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 26748264, 2023-12-01T01:07:29.792 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 4186, 2023-12-01T01:07:29.792 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 26748264, 2023-12-01T01:07:29.792 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2023-12-01T01:07:29.792 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.792 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.793 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.793 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:29.793 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.793 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-objecter_ops": { 2023-12-01T01:07:29.794 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2023-12-01T01:07:29.794 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 1024, 2023-12-01T01:07:29.794 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2023-12-01T01:07:29.794 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 0, 2023-12-01T01:07:29.794 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 0, 2023-12-01T01:07:29.794 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:29.794 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 0, 2023-12-01T01:07:29.794 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 4186, 2023-12-01T01:07:29.794 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 4186, 2023-12-01T01:07:29.795 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 4186, 2023-12-01T01:07:29.795 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 4186, 2023-12-01T01:07:29.795 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2023-12-01T01:07:29.795 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.795 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.795 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.795 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:29.795 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.795 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle": { 2023-12-01T01:07:29.795 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2023-12-01T01:07:29.795 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2023-12-01T01:07:29.795 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2023-12-01T01:07:29.795 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 3517, 2023-12-01T01:07:29.796 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 355249, 2023-12-01T01:07:29.796 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:29.796 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 3517, 2023-12-01T01:07:29.796 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2023-12-01T01:07:29.796 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2023-12-01T01:07:29.796 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 71, 2023-12-01T01:07:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 355249, 2023-12-01T01:07:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2023-12-01T01:07:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-write_buf_throttle-0x55b0b29aa0a0": { 2023-12-01T01:07:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2023-12-01T01:07:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 3758096384, 2023-12-01T01:07:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2023-12-01T01:07:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 12421, 2023-12-01T01:07:29.797 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 25686590, 2023-12-01T01:07:29.798 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:29.798 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 12421, 2023-12-01T01:07:29.798 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2023-12-01T01:07:29.798 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2023-12-01T01:07:29.798 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 321, 2023-12-01T01:07:29.798 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 25686590, 2023-12-01T01:07:29.798 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2023-12-01T01:07:29.798 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:29.799 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:29.799 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:29.799 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:29.799 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:29.799 INFO:teuthology.orchestra.run.smithi116.stdout:} 2023-12-01T01:07:30.067 INFO:tasks.check_counter:Daemon mds.i mds.exported=6 2023-12-01T01:07:30.068 INFO:tasks.check_counter:Daemon mds.i mds.imported=6 2023-12-01T01:07:30.068 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=126 2023-12-01T01:07:30.068 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=2346 2023-12-01T01:07:30.068 DEBUG:tasks.check_counter:Getting stats from l 2023-12-01T01:07:30.068 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a6f82997ac57b70a895455dfed6256360a1e4c32 shell --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 -- ceph daemon mds.l perf dump 2023-12-01T01:07:30.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:29 smithi116 ceph-mon[103554]: pgmap v389: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:07:30.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:29 smithi093 ceph-mon[103327]: pgmap v389: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:07:30.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:29 smithi026 ceph-mon[98801]: pgmap v389: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:07:30.618 INFO:teuthology.orchestra.run.smithi116.stderr:Inferring config /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/mon.c/config 2023-12-01T01:07:31.752 INFO:teuthology.orchestra.run.smithi116.stdout:{ 2023-12-01T01:07:31.753 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-0": { 2023-12-01T01:07:31.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 0, 2023-12-01T01:07:31.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 2, 2023-12-01T01:07:31.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 0, 2023-12-01T01:07:31.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 0, 2023-12-01T01:07:31.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 4, 2023-12-01T01:07:31.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 0, 2023-12-01T01:07:31.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.001257367, 2023-12-01T01:07:31.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.000000000, 2023-12-01T01:07:31.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.000416856, 2023-12-01T01:07:31.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-01T01:07:31.753 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:31.753 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:31.754 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:31.754 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:31.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:31.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:31.754 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:31.754 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:31.754 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:31.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:31.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 0, 2023-12-01T01:07:31.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 0 2023-12-01T01:07:31.754 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:31.754 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-1": { 2023-12-01T01:07:31.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 90, 2023-12-01T01:07:31.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 87, 2023-12-01T01:07:31.754 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 432608, 2023-12-01T01:07:31.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 48848, 2023-12-01T01:07:31.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 2, 2023-12-01T01:07:31.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 1, 2023-12-01T01:07:31.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.016154149, 2023-12-01T01:07:31.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.005281597, 2023-12-01T01:07:31.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.010537638, 2023-12-01T01:07:31.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.002261075, 2023-12-01T01:07:31.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:31.755 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 86, 2023-12-01T01:07:31.755 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.004203643, 2023-12-01T01:07:31.755 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000048879 2023-12-01T01:07:31.755 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:31.755 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:31.755 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:31.756 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:31.756 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:31.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:31.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 432608, 2023-12-01T01:07:31.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 48848 2023-12-01T01:07:31.756 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:31.756 INFO:teuthology.orchestra.run.smithi116.stdout: "AsyncMessenger::Worker-2": { 2023-12-01T01:07:31.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_messages": 5, 2023-12-01T01:07:31.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages": 68, 2023-12-01T01:07:31.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_bytes": 3152, 2023-12-01T01:07:31.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_bytes": 88016, 2023-12-01T01:07:31.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_created_connections": 3, 2023-12-01T01:07:31.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_active_connections": 2, 2023-12-01T01:07:31.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_total_time": 0.004518015, 2023-12-01T01:07:31.756 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_send_time": 0.002765443, 2023-12-01T01:07:31.757 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_recv_time": 0.000999971, 2023-12-01T01:07:31.757 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-12-01T01:07:31.757 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_messages_queue_lat": { 2023-12-01T01:07:31.757 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 67, 2023-12-01T01:07:31.757 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.005002984, 2023-12-01T01:07:31.757 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000074671 2023-12-01T01:07:31.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:31.757 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_handle_ack_lat": { 2023-12-01T01:07:31.757 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:31.757 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:31.757 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:31.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:31.757 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_recv_encrypted_bytes": 3152, 2023-12-01T01:07:31.757 INFO:teuthology.orchestra.run.smithi116.stdout: "msgr_send_encrypted_bytes": 88016 2023-12-01T01:07:31.757 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:31.758 INFO:teuthology.orchestra.run.smithi116.stdout: "cct": { 2023-12-01T01:07:31.758 INFO:teuthology.orchestra.run.smithi116.stdout: "total_workers": 0, 2023-12-01T01:07:31.758 INFO:teuthology.orchestra.run.smithi116.stdout: "unhealthy_workers": 0 2023-12-01T01:07:31.758 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:31.758 INFO:teuthology.orchestra.run.smithi116.stdout: "mempool": { 2023-12-01T01:07:31.758 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_bytes": 0, 2023-12-01T01:07:31.758 INFO:teuthology.orchestra.run.smithi116.stdout: "bloom_filter_items": 0, 2023-12-01T01:07:31.758 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_bytes": 0, 2023-12-01T01:07:31.758 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_alloc_items": 0, 2023-12-01T01:07:31.758 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_bytes": 0, 2023-12-01T01:07:31.758 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_data_items": 0, 2023-12-01T01:07:31.758 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_bytes": 0, 2023-12-01T01:07:31.758 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_onode_items": 0, 2023-12-01T01:07:31.758 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_bytes": 0, 2023-12-01T01:07:31.758 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_meta_items": 0, 2023-12-01T01:07:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_bytes": 0, 2023-12-01T01:07:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_other_items": 0, 2023-12-01T01:07:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_bytes": 0, 2023-12-01T01:07:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_cache_buffer_items": 0, 2023-12-01T01:07:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_bytes": 0, 2023-12-01T01:07:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_extent_items": 0, 2023-12-01T01:07:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_bytes": 0, 2023-12-01T01:07:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_blob_items": 0, 2023-12-01T01:07:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_bytes": 0, 2023-12-01T01:07:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_shared_blob_items": 0, 2023-12-01T01:07:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_bytes": 0, 2023-12-01T01:07:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_inline_bl_items": 0, 2023-12-01T01:07:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_bytes": 0, 2023-12-01T01:07:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_fsck_items": 0, 2023-12-01T01:07:31.759 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_bytes": 0, 2023-12-01T01:07:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_txc_items": 0, 2023-12-01T01:07:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_bytes": 0, 2023-12-01T01:07:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_deferred_items": 0, 2023-12-01T01:07:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_bytes": 0, 2023-12-01T01:07:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "bluestore_writing_items": 0, 2023-12-01T01:07:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_bytes": 0, 2023-12-01T01:07:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_items": 0, 2023-12-01T01:07:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_bytes": 0, 2023-12-01T01:07:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_reader_items": 0, 2023-12-01T01:07:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_bytes": 0, 2023-12-01T01:07:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "bluefs_file_writer_items": 0, 2023-12-01T01:07:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_bytes": 148840, 2023-12-01T01:07:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_anon_items": 28, 2023-12-01T01:07:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_bytes": 0, 2023-12-01T01:07:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "buffer_meta_items": 0, 2023-12-01T01:07:31.760 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_bytes": 0, 2023-12-01T01:07:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_items": 0, 2023-12-01T01:07:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_bytes": 0, 2023-12-01T01:07:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_mapbl_items": 0, 2023-12-01T01:07:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_bytes": 0, 2023-12-01T01:07:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "osd_pglog_items": 0, 2023-12-01T01:07:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_bytes": 0, 2023-12-01T01:07:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_items": 0, 2023-12-01T01:07:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_bytes": 0, 2023-12-01T01:07:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "osdmap_mapping_items": 0, 2023-12-01T01:07:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_bytes": 0, 2023-12-01T01:07:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "pgmap_items": 0, 2023-12-01T01:07:31.761 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_bytes": 928, 2023-12-01T01:07:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: "mds_co_items": 2, 2023-12-01T01:07:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_bytes": 0, 2023-12-01T01:07:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_1_items": 0, 2023-12-01T01:07:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_bytes": 0, 2023-12-01T01:07:31.762 INFO:teuthology.orchestra.run.smithi116.stdout: "unittest_2_items": 0 2023-12-01T01:07:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: }, 2023-12-01T01:07:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-12-01T01:07:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: "val": 0, 2023-12-01T01:07:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: "max": 104857600, 2023-12-01T01:07:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: "get_started": 0, 2023-12-01T01:07:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: "get": 91, 2023-12-01T01:07:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: "get_sum": 419931, 2023-12-01T01:07:31.763 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_fail": 0, 2023-12-01T01:07:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "get_or_fail_success": 91, 2023-12-01T01:07:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "take": 0, 2023-12-01T01:07:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "take_sum": 0, 2023-12-01T01:07:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "put": 91, 2023-12-01T01:07:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "put_sum": 419931, 2023-12-01T01:07:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "wait": { 2023-12-01T01:07:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "avgcount": 0, 2023-12-01T01:07:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "sum": 0.000000000, 2023-12-01T01:07:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: "avgtime": 0.000000000 2023-12-01T01:07:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:31.764 INFO:teuthology.orchestra.run.smithi116.stdout: } 2023-12-01T01:07:31.764 INFO:teuthology.orchestra.run.smithi116.stdout:} 2023-12-01T01:07:32.061 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2023-12-01T01:07:32.061 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2023-12-01T01:07:32.061 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2023-12-01T01:07:32.061 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2023-12-01T01:07:32.061 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-01T01:07:32.072 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-01T01:07:32.072 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T01:07:32.072 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-01T01:07:32.096 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T01:07:32.096 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-01T01:07:32.158 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:07:32.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:31 smithi116 ceph-mon[103554]: pgmap v390: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:07:32.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:31 smithi093 ceph-mon[103327]: pgmap v390: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:07:32.227 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:31 smithi026 ceph-mon[98801]: pgmap v390: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:07:32.337 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.336+0000 7fde58d45700 1 -- 172.21.15.26:0/4048915388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde540ffc70 msgr2=0x7fde54100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.336+0000 7fde58d45700 1 --2- 172.21.15.26:0/4048915388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde540ffc70 0x7fde54100090 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fde440099c0 tx=0x7fde44009cd0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.336+0000 7fde58d45700 1 -- 172.21.15.26:0/4048915388 shutdown_connections 2023-12-01T01:07:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.336+0000 7fde58d45700 1 --2- 172.21.15.26:0/4048915388 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde54101800 0x7fde541080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.336+0000 7fde58d45700 1 --2- 172.21.15.26:0/4048915388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde540ffc70 0x7fde54100090 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.336+0000 7fde58d45700 1 --2- 172.21.15.26:0/4048915388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde54100e60 0x7fde541012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.336+0000 7fde58d45700 1 -- 172.21.15.26:0/4048915388 >> 172.21.15.26:0/4048915388 conn(0x7fde540fb1c0 msgr2=0x7fde540fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.336+0000 7fde58d45700 1 -- 172.21.15.26:0/4048915388 shutdown_connections 2023-12-01T01:07:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.336+0000 7fde58d45700 1 -- 172.21.15.26:0/4048915388 wait complete. 2023-12-01T01:07:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.337+0000 7fde58d45700 1 Processor -- start 2023-12-01T01:07:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.337+0000 7fde58d45700 1 -- start start 2023-12-01T01:07:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.337+0000 7fde58d45700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde540ffc70 0x7fde54196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.337+0000 7fde58d45700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde54100e60 0x7fde54197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.337+0000 7fde58d45700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde54101800 0x7fde5419e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.337+0000 7fde58d45700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5419e6b0 con 0x7fde54101800 2023-12-01T01:07:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.337+0000 7fde58d45700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5419e7f0 con 0x7fde540ffc70 2023-12-01T01:07:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.337+0000 7fde58d45700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5419e980 con 0x7fde54100e60 2023-12-01T01:07:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.337+0000 7fde52d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde54101800 0x7fde5419e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.338+0000 7fde52d9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde54101800 0x7fde5419e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56770/0 (socket says 172.21.15.26:56770) 2023-12-01T01:07:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.338+0000 7fde52d9d700 1 -- 172.21.15.26:0/574981634 learned_addr learned my addr 172.21.15.26:0/574981634 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:07:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.338+0000 7fde5259c700 1 --2- 172.21.15.26:0/574981634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde540ffc70 0x7fde54196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.338+0000 7fde51d9b700 1 --2- 172.21.15.26:0/574981634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde54100e60 0x7fde54197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.338+0000 7fde52d9d700 1 -- 172.21.15.26:0/574981634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde54100e60 msgr2=0x7fde54197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.338+0000 7fde52d9d700 1 --2- 172.21.15.26:0/574981634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde54100e60 0x7fde54197070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.338+0000 7fde52d9d700 1 -- 172.21.15.26:0/574981634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde540ffc70 msgr2=0x7fde54196b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.338+0000 7fde52d9d700 1 --2- 172.21.15.26:0/574981634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde540ffc70 0x7fde54196b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.338+0000 7fde52d9d700 1 -- 172.21.15.26:0/574981634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde440095f0 con 0x7fde54101800 2023-12-01T01:07:32.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.338+0000 7fde52d9d700 1 --2- 172.21.15.26:0/574981634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde54101800 0x7fde5419e0e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fde4c007ee0 tx=0x7fde4c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:32.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.338+0000 7fde4b7fe700 1 -- 172.21.15.26:0/574981634 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c017070 con 0x7fde54101800 2023-12-01T01:07:32.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.338+0000 7fde58d45700 1 -- 172.21.15.26:0/574981634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5419ec60 con 0x7fde54101800 2023-12-01T01:07:32.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.338+0000 7fde4b7fe700 1 -- 172.21.15.26:0/574981634 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fde4c00f040 con 0x7fde54101800 2023-12-01T01:07:32.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.338+0000 7fde4b7fe700 1 -- 172.21.15.26:0/574981634 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c005760 con 0x7fde54101800 2023-12-01T01:07:32.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.338+0000 7fde58d45700 1 -- 172.21.15.26:0/574981634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5419f170 con 0x7fde54101800 2023-12-01T01:07:32.343 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.339+0000 7fde58d45700 1 -- 172.21.15.26:0/574981634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5410b5c0 con 0x7fde54101800 2023-12-01T01:07:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.341+0000 7fde4b7fe700 1 -- 172.21.15.26:0/574981634 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fde4c0058c0 con 0x7fde54101800 2023-12-01T01:07:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.342+0000 7fde4b7fe700 1 --2- 172.21.15.26:0/574981634 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fde400a0570 0x7fde400a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.342+0000 7fde4b7fe700 1 -- 172.21.15.26:0/574981634 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fde4c0cb790 con 0x7fde54101800 2023-12-01T01:07:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.342+0000 7fde5259c700 1 --2- 172.21.15.26:0/574981634 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fde400a0570 0x7fde400a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:32.345 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.342+0000 7fde5259c700 1 --2- 172.21.15.26:0/574981634 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fde400a0570 0x7fde400a2a30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fde44009990 tx=0x7fde44003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:32.346 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.345+0000 7fde4b7fe700 1 -- 172.21.15.26:0/574981634 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fde4c095340 con 0x7fde54101800 2023-12-01T01:07:32.551 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.550+0000 7fde58d45700 1 -- 172.21.15.26:0/574981634 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde5419f720 con 0x7fde54101800 2023-12-01T01:07:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.552+0000 7fde4b7fe700 1 -- 172.21.15.26:0/574981634 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22481 (secure 0 0 0) 0x7fde4c009390 con 0x7fde54101800 2023-12-01T01:07:32.553 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:07:32.553 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":84,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:05:53.540747+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:07:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.554+0000 7fde58d45700 1 -- 172.21.15.26:0/574981634 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fde400a0570 msgr2=0x7fde400a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.554+0000 7fde58d45700 1 --2- 172.21.15.26:0/574981634 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fde400a0570 0x7fde400a2a30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fde44009990 tx=0x7fde44003680 comp rx=0 tx=0).stop 2023-12-01T01:07:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.554+0000 7fde58d45700 1 -- 172.21.15.26:0/574981634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde54101800 msgr2=0x7fde5419e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.554+0000 7fde58d45700 1 --2- 172.21.15.26:0/574981634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde54101800 0x7fde5419e0e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fde4c007ee0 tx=0x7fde4c00d3b0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.554+0000 7fde58d45700 1 -- 172.21.15.26:0/574981634 shutdown_connections 2023-12-01T01:07:32.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.554+0000 7fde58d45700 1 --2- 172.21.15.26:0/574981634 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fde400a0570 0x7fde400a2a30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.554+0000 7fde58d45700 1 --2- 172.21.15.26:0/574981634 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fde54101800 0x7fde5419e0e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.554+0000 7fde58d45700 1 --2- 172.21.15.26:0/574981634 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fde540ffc70 0x7fde54196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.554+0000 7fde58d45700 1 --2- 172.21.15.26:0/574981634 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fde54100e60 0x7fde54197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.554+0000 7fde58d45700 1 -- 172.21.15.26:0/574981634 >> 172.21.15.26:0/574981634 conn(0x7fde540fb1c0 msgr2=0x7fde54067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:32.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.554+0000 7fde58d45700 1 -- 172.21.15.26:0/574981634 shutdown_connections 2023-12-01T01:07:32.556 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.554+0000 7fde58d45700 1 -- 172.21.15.26:0/574981634 wait complete. 2023-12-01T01:07:32.568 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-01T00:59:06.411348+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-01T01:02:45.762784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-01T01:02:46.638998+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-01T01:07:32.569 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-01T01:07:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.736+0000 7f4483aa1700 1 -- 172.21.15.26:0/1217510613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447c0ffcb0 msgr2=0x7f447c1000d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.736+0000 7f4483aa1700 1 --2- 172.21.15.26:0/1217510613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447c0ffcb0 0x7f447c1000d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f44780099c0 tx=0x7f4478009cd0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.736+0000 7f4483aa1700 1 -- 172.21.15.26:0/1217510613 shutdown_connections 2023-12-01T01:07:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.736+0000 7f4483aa1700 1 --2- 172.21.15.26:0/1217510613 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f447c101840 0x7f447c1080f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.736+0000 7f4483aa1700 1 --2- 172.21.15.26:0/1217510613 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447c0ffcb0 0x7f447c1000d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.736+0000 7f4483aa1700 1 --2- 172.21.15.26:0/1217510613 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f447c100ea0 0x7f447c101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.736+0000 7f4483aa1700 1 -- 172.21.15.26:0/1217510613 >> 172.21.15.26:0/1217510613 conn(0x7f447c0fb220 msgr2=0x7f447c0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.737+0000 7f4483aa1700 1 -- 172.21.15.26:0/1217510613 shutdown_connections 2023-12-01T01:07:32.738 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.737+0000 7f4483aa1700 1 -- 172.21.15.26:0/1217510613 wait complete. 2023-12-01T01:07:32.740 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.737+0000 7f4483aa1700 1 Processor -- start 2023-12-01T01:07:32.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.737+0000 7f4483aa1700 1 -- start start 2023-12-01T01:07:32.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f4483aa1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f447c0ffcb0 0x7f447c195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:32.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f4483aa1700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f447c100ea0 0x7f447c195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:32.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f4483aa1700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447c101840 0x7f447c19d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:32.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f4483aa1700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c19d5e0 con 0x7f447c101840 2023-12-01T01:07:32.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f4483aa1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c19d720 con 0x7f447c0ffcb0 2023-12-01T01:07:32.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f4483aa1700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f447c19d8b0 con 0x7f447c100ea0 2023-12-01T01:07:32.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f448203e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447c101840 0x7f447c19d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:32.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f448203e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447c101840 0x7f447c19d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56784/0 (socket says 172.21.15.26:56784) 2023-12-01T01:07:32.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f448203e700 1 -- 172.21.15.26:0/3126058003 learned_addr learned my addr 172.21.15.26:0/3126058003 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:07:32.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f448103c700 1 --2- 172.21.15.26:0/3126058003 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f447c100ea0 0x7f447c195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:32.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f448183d700 1 --2- 172.21.15.26:0/3126058003 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f447c0ffcb0 0x7f447c195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:32.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f448203e700 1 -- 172.21.15.26:0/3126058003 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f447c100ea0 msgr2=0x7f447c195fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:32.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f448203e700 1 --2- 172.21.15.26:0/3126058003 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f447c100ea0 0x7f447c195fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.741 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f448203e700 1 -- 172.21.15.26:0/3126058003 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f447c0ffcb0 msgr2=0x7f447c195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:32.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f448203e700 1 --2- 172.21.15.26:0/3126058003 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f447c0ffcb0 0x7f447c195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f448203e700 1 -- 172.21.15.26:0/3126058003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44780095f0 con 0x7f447c101840 2023-12-01T01:07:32.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f448103c700 1 --2- 172.21.15.26:0/3126058003 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f447c100ea0 0x7f447c195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:07:32.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f448203e700 1 --2- 172.21.15.26:0/3126058003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447c101840 0x7f447c19d010 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4474007d70 tx=0x7f447400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:32.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f4472ffd700 1 -- 172.21.15.26:0/3126058003 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447400ad40 con 0x7f447c101840 2023-12-01T01:07:32.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.738+0000 7f4483aa1700 1 -- 172.21.15.26:0/3126058003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f447c19db90 con 0x7f447c101840 2023-12-01T01:07:32.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.739+0000 7f4472ffd700 1 -- 172.21.15.26:0/3126058003 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4474012900 con 0x7f447c101840 2023-12-01T01:07:32.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.739+0000 7f4472ffd700 1 -- 172.21.15.26:0/3126058003 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4474011780 con 0x7f447c101840 2023-12-01T01:07:32.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.739+0000 7f4483aa1700 1 -- 172.21.15.26:0/3126058003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f447c19e0a0 con 0x7f447c101840 2023-12-01T01:07:32.742 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.739+0000 7f4483aa1700 1 -- 172.21.15.26:0/3126058003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447c107200 con 0x7f447c101840 2023-12-01T01:07:32.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.741+0000 7f4472ffd700 1 -- 172.21.15.26:0/3126058003 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f4474012a70 con 0x7f447c101840 2023-12-01T01:07:32.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.741+0000 7f4472ffd700 1 --2- 172.21.15.26:0/3126058003 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f44680a0520 0x7f44680a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:32.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.741+0000 7f448183d700 1 --2- 172.21.15.26:0/3126058003 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f44680a0520 0x7f44680a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:32.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.741+0000 7f4472ffd700 1 -- 172.21.15.26:0/3126058003 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f44740cbfd0 con 0x7f447c101840 2023-12-01T01:07:32.744 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.742+0000 7f448183d700 1 --2- 172.21.15.26:0/3126058003 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f44680a0520 0x7f44680a29e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f447800b580 tx=0x7f4478005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:32.745 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.744+0000 7f4472ffd700 1 -- 172.21.15.26:0/3126058003 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4474095b80 con 0x7f447c101840 2023-12-01T01:07:32.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.948+0000 7f4483aa1700 1 -- 172.21.15.26:0/3126058003 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f447c02ce00 con 0x7f447c101840 2023-12-01T01:07:32.949 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.948+0000 7f4472ffd700 1 -- 172.21.15.26:0/3126058003 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f44740160a0 con 0x7f447c101840 2023-12-01T01:07:32.949 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2023-12-01T01:07:32.951 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.950+0000 7f4483aa1700 1 -- 172.21.15.26:0/3126058003 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f44680a0520 msgr2=0x7f44680a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:32.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.950+0000 7f4483aa1700 1 --2- 172.21.15.26:0/3126058003 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f44680a0520 0x7f44680a29e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f447800b580 tx=0x7f4478005fb0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.950+0000 7f4483aa1700 1 -- 172.21.15.26:0/3126058003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447c101840 msgr2=0x7f447c19d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:32.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.950+0000 7f4483aa1700 1 --2- 172.21.15.26:0/3126058003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447c101840 0x7f447c19d010 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f4474007d70 tx=0x7f447400a340 comp rx=0 tx=0).stop 2023-12-01T01:07:32.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.950+0000 7f4483aa1700 1 -- 172.21.15.26:0/3126058003 shutdown_connections 2023-12-01T01:07:32.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.950+0000 7f4483aa1700 1 --2- 172.21.15.26:0/3126058003 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f44680a0520 0x7f44680a29e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.950+0000 7f4483aa1700 1 --2- 172.21.15.26:0/3126058003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f447c101840 0x7f447c19d010 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.950+0000 7f4483aa1700 1 --2- 172.21.15.26:0/3126058003 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f447c0ffcb0 0x7f447c195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.950+0000 7f4483aa1700 1 --2- 172.21.15.26:0/3126058003 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f447c100ea0 0x7f447c195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:32.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.950+0000 7f4483aa1700 1 -- 172.21.15.26:0/3126058003 >> 172.21.15.26:0/3126058003 conn(0x7f447c0fb220 msgr2=0x7f447c104340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:32.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.950+0000 7f4483aa1700 1 -- 172.21.15.26:0/3126058003 shutdown_connections 2023-12-01T01:07:32.952 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:32.950+0000 7f4483aa1700 1 -- 172.21.15.26:0/3126058003 wait complete. 2023-12-01T01:07:32.964 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-01T01:07:33.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.092+0000 7fcf87cb0700 1 -- 172.21.15.26:0/2827315330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf80101f70 msgr2=0x7fcf801023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:33.095 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.092+0000 7fcf87cb0700 1 --2- 172.21.15.26:0/2827315330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf80101f70 0x7fcf801023d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0099c0 tx=0x7fcf7c009cd0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.092+0000 7fcf87cb0700 1 -- 172.21.15.26:0/2827315330 shutdown_connections 2023-12-01T01:07:33.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.092+0000 7fcf87cb0700 1 --2- 172.21.15.26:0/2827315330 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf80102910 0x7fcf801091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.092+0000 7fcf87cb0700 1 --2- 172.21.15.26:0/2827315330 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf80100d80 0x7fcf801011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.092+0000 7fcf87cb0700 1 --2- 172.21.15.26:0/2827315330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf80101f70 0x7fcf801023d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.092+0000 7fcf87cb0700 1 -- 172.21.15.26:0/2827315330 >> 172.21.15.26:0/2827315330 conn(0x7fcf800fc310 msgr2=0x7fcf800fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:33.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.092+0000 7fcf87cb0700 1 -- 172.21.15.26:0/2827315330 shutdown_connections 2023-12-01T01:07:33.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.092+0000 7fcf87cb0700 1 -- 172.21.15.26:0/2827315330 wait complete. 2023-12-01T01:07:33.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.093+0000 7fcf87cb0700 1 Processor -- start 2023-12-01T01:07:33.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.093+0000 7fcf87cb0700 1 -- start start 2023-12-01T01:07:33.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.093+0000 7fcf87cb0700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf80100d80 0x7fcf80196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:33.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.093+0000 7fcf87cb0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf80101f70 0x7fcf801970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:33.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.093+0000 7fcf87cb0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf80102910 0x7fcf8019e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:33.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.093+0000 7fcf87cb0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8019e6e0 con 0x7fcf80102910 2023-12-01T01:07:33.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.093+0000 7fcf87cb0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8019e820 con 0x7fcf80101f70 2023-12-01T01:07:33.096 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.093+0000 7fcf87cb0700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8019e9b0 con 0x7fcf80100d80 2023-12-01T01:07:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.093+0000 7fcf8624d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf80102910 0x7fcf8019e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.093+0000 7fcf8624d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf80102910 0x7fcf8019e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56798/0 (socket says 172.21.15.26:56798) 2023-12-01T01:07:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.093+0000 7fcf8624d700 1 -- 172.21.15.26:0/2873278929 learned_addr learned my addr 172.21.15.26:0/2873278929 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:07:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.093+0000 7fcf85a4c700 1 --2- 172.21.15.26:0/2873278929 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf80100d80 0x7fcf80196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.094+0000 7fcf8524b700 1 --2- 172.21.15.26:0/2873278929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf80101f70 0x7fcf801970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.094+0000 7fcf8624d700 1 -- 172.21.15.26:0/2873278929 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf80100d80 msgr2=0x7fcf80196b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.094+0000 7fcf8624d700 1 --2- 172.21.15.26:0/2873278929 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf80100d80 0x7fcf80196b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.094+0000 7fcf8624d700 1 -- 172.21.15.26:0/2873278929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf80101f70 msgr2=0x7fcf801970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.094+0000 7fcf8624d700 1 --2- 172.21.15.26:0/2873278929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf80101f70 0x7fcf801970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.094+0000 7fcf8624d700 1 -- 172.21.15.26:0/2873278929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c0095f0 con 0x7fcf80102910 2023-12-01T01:07:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.094+0000 7fcf8524b700 1 --2- 172.21.15.26:0/2873278929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf80101f70 0x7fcf801970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:07:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.094+0000 7fcf8624d700 1 --2- 172.21.15.26:0/2873278929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf80102910 0x7fcf8019e110 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcf78007ee0 tx=0x7fcf7800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.094+0000 7fcf72ffd700 1 -- 172.21.15.26:0/2873278929 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78017070 con 0x7fcf80102910 2023-12-01T01:07:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.094+0000 7fcf72ffd700 1 -- 172.21.15.26:0/2873278929 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fcf7800f040 con 0x7fcf80102910 2023-12-01T01:07:33.097 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.094+0000 7fcf87cb0700 1 -- 172.21.15.26:0/2873278929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8019ec90 con 0x7fcf80102910 2023-12-01T01:07:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.094+0000 7fcf72ffd700 1 -- 172.21.15.26:0/2873278929 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78005760 con 0x7fcf80102910 2023-12-01T01:07:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.094+0000 7fcf87cb0700 1 -- 172.21.15.26:0/2873278929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8019f1a0 con 0x7fcf80102910 2023-12-01T01:07:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.095+0000 7fcf87cb0700 1 -- 172.21.15.26:0/2873278929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8010c750 con 0x7fcf80102910 2023-12-01T01:07:33.098 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.096+0000 7fcf72ffd700 1 -- 172.21.15.26:0/2873278929 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fcf780058c0 con 0x7fcf80102910 2023-12-01T01:07:33.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.097+0000 7fcf72ffd700 1 --2- 172.21.15.26:0/2873278929 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcf6c0a05a0 0x7fcf6c0a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:33.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.097+0000 7fcf72ffd700 1 -- 172.21.15.26:0/2873278929 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fcf780cb680 con 0x7fcf80102910 2023-12-01T01:07:33.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.097+0000 7fcf85a4c700 1 --2- 172.21.15.26:0/2873278929 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcf6c0a05a0 0x7fcf6c0a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:33.099 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.097+0000 7fcf85a4c700 1 --2- 172.21.15.26:0/2873278929 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcf6c0a05a0 0x7fcf6c0a2a60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcf80101dd0 tx=0x7fcf7400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:33.101 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.100+0000 7fcf72ffd700 1 -- 172.21.15.26:0/2873278929 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fcf78095230 con 0x7fcf80102910 2023-12-01T01:07:33.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:32 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/574981634' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:07:33.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:32 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/574981634' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:07:33.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:32 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/574981634' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:07:33.303 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.302+0000 7fcf87cb0700 1 -- 172.21.15.26:0/2873278929 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcf80107c30 con 0x7fcf80102910 2023-12-01T01:07:33.304 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.303+0000 7fcf72ffd700 1 -- 172.21.15.26:0/2873278929 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcf78009390 con 0x7fcf80102910 2023-12-01T01:07:33.304 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2023-12-01T01:07:33.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.305+0000 7fcf87cb0700 1 -- 172.21.15.26:0/2873278929 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcf6c0a05a0 msgr2=0x7fcf6c0a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:33.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.305+0000 7fcf87cb0700 1 --2- 172.21.15.26:0/2873278929 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcf6c0a05a0 0x7fcf6c0a2a60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcf80101dd0 tx=0x7fcf7400b410 comp rx=0 tx=0).stop 2023-12-01T01:07:33.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.305+0000 7fcf87cb0700 1 -- 172.21.15.26:0/2873278929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf80102910 msgr2=0x7fcf8019e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:33.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.305+0000 7fcf87cb0700 1 --2- 172.21.15.26:0/2873278929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf80102910 0x7fcf8019e110 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcf78007ee0 tx=0x7fcf7800d3b0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.305+0000 7fcf87cb0700 1 -- 172.21.15.26:0/2873278929 shutdown_connections 2023-12-01T01:07:33.307 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.305+0000 7fcf87cb0700 1 --2- 172.21.15.26:0/2873278929 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fcf6c0a05a0 0x7fcf6c0a2a60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.305+0000 7fcf87cb0700 1 --2- 172.21.15.26:0/2873278929 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcf80102910 0x7fcf8019e110 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.305+0000 7fcf87cb0700 1 --2- 172.21.15.26:0/2873278929 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fcf80100d80 0x7fcf80196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.305+0000 7fcf87cb0700 1 --2- 172.21.15.26:0/2873278929 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcf80101f70 0x7fcf801970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.305+0000 7fcf87cb0700 1 -- 172.21.15.26:0/2873278929 >> 172.21.15.26:0/2873278929 conn(0x7fcf800fc310 msgr2=0x7fcf800fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:33.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.305+0000 7fcf87cb0700 1 -- 172.21.15.26:0/2873278929 shutdown_connections 2023-12-01T01:07:33.308 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.305+0000 7fcf87cb0700 1 -- 172.21.15.26:0/2873278929 wait complete. 2023-12-01T01:07:33.318 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-01T01:07:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.446+0000 7f0bbb274700 1 -- 172.21.15.26:0/1214752172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb4101810 msgr2=0x7f0bb4103c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.446+0000 7f0bbb274700 1 --2- 172.21.15.26:0/1214752172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb4101810 0x7f0bb4103c00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009990 tx=0x7f0bb0009ca0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.446+0000 7f0bbb274700 1 -- 172.21.15.26:0/1214752172 shutdown_connections 2023-12-01T01:07:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.446+0000 7f0bbb274700 1 --2- 172.21.15.26:0/1214752172 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0bb4106a70 0x7f0bb4108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.446+0000 7f0bbb274700 1 --2- 172.21.15.26:0/1214752172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb4101810 0x7f0bb4103c00 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.446+0000 7f0bbb274700 1 --2- 172.21.15.26:0/1214752172 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bb4104140 0x7f0bb4106530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.446+0000 7f0bbb274700 1 -- 172.21.15.26:0/1214752172 >> 172.21.15.26:0/1214752172 conn(0x7f0bb40fb1a0 msgr2=0x7f0bb40fd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:33.449 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.446+0000 7f0bbb274700 1 -- 172.21.15.26:0/1214752172 shutdown_connections 2023-12-01T01:07:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.446+0000 7f0bbb274700 1 -- 172.21.15.26:0/1214752172 wait complete. 2023-12-01T01:07:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bbb274700 1 Processor -- start 2023-12-01T01:07:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bbb274700 1 -- start start 2023-12-01T01:07:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bbb274700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb4101810 0x7f0bb4198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bbb274700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0bb4104140 0x7f0bb4199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bbb274700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bb4106a70 0x7f0bb41a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bbb274700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb41a0860 con 0x7f0bb4101810 2023-12-01T01:07:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bbb274700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb41a09d0 con 0x7f0bb4106a70 2023-12-01T01:07:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bbb274700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bb41a0b90 con 0x7f0bb4104140 2023-12-01T01:07:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bb9010700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb4101810 0x7f0bb4198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bb9010700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb4101810 0x7f0bb4198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56808/0 (socket says 172.21.15.26:56808) 2023-12-01T01:07:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bb9010700 1 -- 172.21.15.26:0/328642388 learned_addr learned my addr 172.21.15.26:0/328642388 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:07:33.450 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bb880f700 1 --2- 172.21.15.26:0/328642388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0bb4104140 0x7f0bb4199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bb9811700 1 --2- 172.21.15.26:0/328642388 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bb4106a70 0x7f0bb41a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bb9010700 1 -- 172.21.15.26:0/328642388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0bb4104140 msgr2=0x7f0bb4199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bb9010700 1 --2- 172.21.15.26:0/328642388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0bb4104140 0x7f0bb4199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bb9010700 1 -- 172.21.15.26:0/328642388 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bb4106a70 msgr2=0x7f0bb41a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bb9010700 1 --2- 172.21.15.26:0/328642388 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bb4106a70 0x7f0bb41a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.447+0000 7f0bb9010700 1 -- 172.21.15.26:0/328642388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb00095f0 con 0x7f0bb4101810 2023-12-01T01:07:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.448+0000 7f0bb9010700 1 --2- 172.21.15.26:0/328642388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb4101810 0x7f0bb4198d20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00036f0 tx=0x7f0bb000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.448+0000 7f0baa7fc700 1 -- 172.21.15.26:0/328642388 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb001d070 con 0x7f0bb4101810 2023-12-01T01:07:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.448+0000 7f0baa7fc700 1 -- 172.21.15.26:0/328642388 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f0bb0005030 con 0x7f0bb4101810 2023-12-01T01:07:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.448+0000 7f0bbb274700 1 -- 172.21.15.26:0/328642388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bb41a0e10 con 0x7f0bb4101810 2023-12-01T01:07:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.448+0000 7f0baa7fc700 1 -- 172.21.15.26:0/328642388 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb0004ba0 con 0x7f0bb4101810 2023-12-01T01:07:33.451 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.448+0000 7f0bbb274700 1 -- 172.21.15.26:0/328642388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bb41a11d0 con 0x7f0bb4101810 2023-12-01T01:07:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.449+0000 7f0bbb274700 1 -- 172.21.15.26:0/328642388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bb4108610 con 0x7f0bb4101810 2023-12-01T01:07:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.450+0000 7f0baa7fc700 1 -- 172.21.15.26:0/328642388 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f0bb0004d00 con 0x7f0bb4101810 2023-12-01T01:07:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.450+0000 7f0baa7fc700 1 --2- 172.21.15.26:0/328642388 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0ba00a05a0 0x7f0ba00a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:33.452 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.451+0000 7f0bb880f700 1 --2- 172.21.15.26:0/328642388 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0ba00a05a0 0x7f0ba00a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:33.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.451+0000 7f0baa7fc700 1 -- 172.21.15.26:0/328642388 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f0bb00ccc40 con 0x7f0bb4101810 2023-12-01T01:07:33.453 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.451+0000 7f0bb880f700 1 --2- 172.21.15.26:0/328642388 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0ba00a05a0 0x7f0ba00a2a60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4005950 tx=0x7f0ba400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:33.455 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.454+0000 7f0baa7fc700 1 -- 172.21.15.26:0/328642388 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0bb0096820 con 0x7f0bb4101810 2023-12-01T01:07:33.656 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.655+0000 7f0bbb274700 1 -- 172.21.15.26:0/328642388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0bb402cec0 con 0x7f0bb4101810 2023-12-01T01:07:33.657 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.656+0000 7f0baa7fc700 1 -- 172.21.15.26:0/328642388 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0bb0026020 con 0x7f0bb4101810 2023-12-01T01:07:33.657 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2023-12-01T01:07:33.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.658+0000 7f0bbb274700 1 -- 172.21.15.26:0/328642388 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0ba00a05a0 msgr2=0x7f0ba00a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:33.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.658+0000 7f0bbb274700 1 --2- 172.21.15.26:0/328642388 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0ba00a05a0 0x7f0ba00a2a60 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4005950 tx=0x7f0ba400b410 comp rx=0 tx=0).stop 2023-12-01T01:07:33.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.658+0000 7f0bbb274700 1 -- 172.21.15.26:0/328642388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb4101810 msgr2=0x7f0bb4198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:33.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.658+0000 7f0bbb274700 1 --2- 172.21.15.26:0/328642388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb4101810 0x7f0bb4198d20 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00036f0 tx=0x7f0bb000f690 comp rx=0 tx=0).stop 2023-12-01T01:07:33.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.658+0000 7f0bbb274700 1 -- 172.21.15.26:0/328642388 shutdown_connections 2023-12-01T01:07:33.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.658+0000 7f0bbb274700 1 --2- 172.21.15.26:0/328642388 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f0ba00a05a0 0x7f0ba00a2a60 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.659 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.658+0000 7f0bbb274700 1 --2- 172.21.15.26:0/328642388 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0bb4106a70 0x7f0bb41a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.658+0000 7f0bbb274700 1 --2- 172.21.15.26:0/328642388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0bb4101810 0x7f0bb4198d20 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.658+0000 7f0bbb274700 1 --2- 172.21.15.26:0/328642388 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f0bb4104140 0x7f0bb4199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.658+0000 7f0bbb274700 1 -- 172.21.15.26:0/328642388 >> 172.21.15.26:0/328642388 conn(0x7f0bb40fb1a0 msgr2=0x7f0bb40ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:33.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.658+0000 7f0bbb274700 1 -- 172.21.15.26:0/328642388 shutdown_connections 2023-12-01T01:07:33.660 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.658+0000 7f0bbb274700 1 -- 172.21.15.26:0/328642388 wait complete. 2023-12-01T01:07:33.672 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-01T01:07:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.798+0000 7f4dae565700 1 -- 172.21.15.26:0/3694067826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4da8106ae0 msgr2=0x7f4da8108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.798+0000 7f4dae565700 1 --2- 172.21.15.26:0/3694067826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4da8106ae0 0x7f4da8108ed0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4da000b0a0 tx=0x7f4da000b3b0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.798+0000 7f4dae565700 1 -- 172.21.15.26:0/3694067826 shutdown_connections 2023-12-01T01:07:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.798+0000 7f4dae565700 1 --2- 172.21.15.26:0/3694067826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4da8106ae0 0x7f4da8108ed0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.801 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.798+0000 7f4dae565700 1 --2- 172.21.15.26:0/3694067826 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4da8101880 0x7f4da8103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.798+0000 7f4dae565700 1 --2- 172.21.15.26:0/3694067826 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4da81041b0 0x7f4da81065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.798+0000 7f4dae565700 1 -- 172.21.15.26:0/3694067826 >> 172.21.15.26:0/3694067826 conn(0x7f4da80fb1f0 msgr2=0x7f4da80fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.798+0000 7f4dae565700 1 -- 172.21.15.26:0/3694067826 shutdown_connections 2023-12-01T01:07:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.798+0000 7f4dae565700 1 -- 172.21.15.26:0/3694067826 wait complete. 2023-12-01T01:07:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.798+0000 7f4dae565700 1 Processor -- start 2023-12-01T01:07:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.798+0000 7f4dae565700 1 -- start start 2023-12-01T01:07:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4dae565700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4da8101880 0x7f4da8196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4dae565700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4da81041b0 0x7f4da8197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4dae565700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4da8106ae0 0x7f4da819e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4dae565700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da819e790 con 0x7f4da81041b0 2023-12-01T01:07:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4dae565700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da819e900 con 0x7f4da8106ae0 2023-12-01T01:07:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4dae565700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da819eac0 con 0x7f4da8101880 2023-12-01T01:07:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4da77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4da81041b0 0x7f4da8197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:33.802 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4da77fe700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4da81041b0 0x7f4da8197190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56822/0 (socket says 172.21.15.26:56822) 2023-12-01T01:07:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4da77fe700 1 -- 172.21.15.26:0/3357327399 learned_addr learned my addr 172.21.15.26:0/3357327399 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:07:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4da7fff700 1 --2- 172.21.15.26:0/3357327399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4da8101880 0x7f4da8196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4dacb02700 1 --2- 172.21.15.26:0/3357327399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4da8106ae0 0x7f4da819e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4da77fe700 1 -- 172.21.15.26:0/3357327399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4da8101880 msgr2=0x7f4da8196c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4da77fe700 1 --2- 172.21.15.26:0/3357327399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4da8101880 0x7f4da8196c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4da77fe700 1 -- 172.21.15.26:0/3357327399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4da8106ae0 msgr2=0x7f4da819e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4da77fe700 1 --2- 172.21.15.26:0/3357327399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4da8106ae0 0x7f4da819e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4da77fe700 1 -- 172.21.15.26:0/3357327399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da0009d00 con 0x7f4da81041b0 2023-12-01T01:07:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4dacb02700 1 --2- 172.21.15.26:0/3357327399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4da8106ae0 0x7f4da819e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:07:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4da77fe700 1 --2- 172.21.15.26:0/3357327399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4da81041b0 0x7f4da8197190 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00e9a0 tx=0x7f4d9c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.799+0000 7f4da57fa700 1 -- 172.21.15.26:0/3357327399 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c009790 con 0x7f4da81041b0 2023-12-01T01:07:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.800+0000 7f4da57fa700 1 -- 172.21.15.26:0/3357327399 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f4d9c00cbd0 con 0x7f4da81041b0 2023-12-01T01:07:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.800+0000 7f4da57fa700 1 -- 172.21.15.26:0/3357327399 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c018680 con 0x7f4da81041b0 2023-12-01T01:07:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.800+0000 7f4dae565700 1 -- 172.21.15.26:0/3357327399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da819eda0 con 0x7f4da81041b0 2023-12-01T01:07:33.803 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.800+0000 7f4dae565700 1 -- 172.21.15.26:0/3357327399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da819f1f0 con 0x7f4da81041b0 2023-12-01T01:07:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.800+0000 7f4dae565700 1 -- 172.21.15.26:0/3357327399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da80fcd70 con 0x7f4da81041b0 2023-12-01T01:07:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.802+0000 7f4da57fa700 1 -- 172.21.15.26:0/3357327399 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f4d9c0188a0 con 0x7f4da81041b0 2023-12-01T01:07:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.802+0000 7f4da57fa700 1 --2- 172.21.15.26:0/3357327399 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4d900a05a0 0x7f4d900a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:33.804 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.802+0000 7f4da7fff700 1 --2- 172.21.15.26:0/3357327399 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4d900a05a0 0x7f4d900a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:33.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.802+0000 7f4da57fa700 1 -- 172.21.15.26:0/3357327399 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f4d9c014070 con 0x7f4da81041b0 2023-12-01T01:07:33.805 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.803+0000 7f4da7fff700 1 --2- 172.21.15.26:0/3357327399 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4d900a05a0 0x7f4d900a2a60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4da8198120 tx=0x7f4d98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:33.806 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:33.806+0000 7f4da57fa700 1 -- 172.21.15.26:0/3357327399 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4d9c095c00 con 0x7f4da81041b0 2023-12-01T01:07:34.026 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.025+0000 7f4dae565700 1 -- 172.21.15.26:0/3357327399 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4da802cc70 con 0x7f4da81041b0 2023-12-01T01:07:34.027 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.026+0000 7f4da57fa700 1 -- 172.21.15.26:0/3357327399 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v84) v1 ==== 81+0+590 (secure 0 0 0) 0x7f4d9c026260 con 0x7f4da81041b0 2023-12-01T01:07:34.027 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/11604977 2023-12-02T00:56:57.879870+0000 2023-12-01T01:07:34.027 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6801/2565806966 2023-12-02T00:56:57.879870+0000 2023-12-01T01:07:34.027 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6800/2565806966 2023-12-02T00:56:57.879870+0000 2023-12-01T01:07:34.027 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6801/4102663452 2023-12-02T00:56:31.503558+0000 2023-12-01T01:07:34.027 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/3703480237 2023-12-02T00:56:31.503558+0000 2023-12-01T01:07:34.028 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/2854821205 2023-12-02T00:56:57.879870+0000 2023-12-01T01:07:34.028 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:6800/4102663452 2023-12-02T00:56:31.503558+0000 2023-12-01T01:07:34.028 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/3514831989 2023-12-02T00:56:57.879870+0000 2023-12-01T01:07:34.028 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/3968181141 2023-12-02T00:56:31.503558+0000 2023-12-01T01:07:34.028 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.15.26:0/3742997211 2023-12-02T00:56:31.503558+0000 2023-12-01T01:07:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.028+0000 7f4dae565700 1 -- 172.21.15.26:0/3357327399 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4d900a05a0 msgr2=0x7f4d900a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.028+0000 7f4dae565700 1 --2- 172.21.15.26:0/3357327399 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4d900a05a0 0x7f4d900a2a60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4da8198120 tx=0x7f4d98009260 comp rx=0 tx=0).stop 2023-12-01T01:07:34.029 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.028+0000 7f4dae565700 1 -- 172.21.15.26:0/3357327399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4da81041b0 msgr2=0x7f4da8197190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:34.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.028+0000 7f4dae565700 1 --2- 172.21.15.26:0/3357327399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4da81041b0 0x7f4da8197190 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00e9a0 tx=0x7f4d9c00ecb0 comp rx=0 tx=0).stop 2023-12-01T01:07:34.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.028+0000 7f4dae565700 1 -- 172.21.15.26:0/3357327399 shutdown_connections 2023-12-01T01:07:34.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.028+0000 7f4dae565700 1 --2- 172.21.15.26:0/3357327399 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f4d900a05a0 0x7f4d900a2a60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:34.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.028+0000 7f4dae565700 1 --2- 172.21.15.26:0/3357327399 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f4da8106ae0 0x7f4da819e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:34.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.028+0000 7f4dae565700 1 --2- 172.21.15.26:0/3357327399 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f4da8101880 0x7f4da8196c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:34.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.028+0000 7f4dae565700 1 --2- 172.21.15.26:0/3357327399 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4da81041b0 0x7f4da8197190 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:34.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.028+0000 7f4dae565700 1 -- 172.21.15.26:0/3357327399 >> 172.21.15.26:0/3357327399 conn(0x7f4da80fb1f0 msgr2=0x7f4da81024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:34.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.028+0000 7f4dae565700 1 -- 172.21.15.26:0/3357327399 shutdown_connections 2023-12-01T01:07:34.030 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.028+0000 7f4dae565700 1 -- 172.21.15.26:0/3357327399 wait complete. 2023-12-01T01:07:34.031 INFO:teuthology.orchestra.run.smithi026.stderr:listed 10 entries 2023-12-01T01:07:34.041 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:33 smithi026 ceph-mon[98801]: pgmap v391: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:07:34.041 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:33 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3126058003' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:07:34.041 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:33 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2873278929' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:07:34.041 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:33 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/328642388' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:07:34.042 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-01T01:07:34.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:07:34.042 DEBUG:teuthology.orchestra.run.smithi026:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-01T01:07:34.114 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2023-12-01T01:07:34.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:07:34.114 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-01T01:07:34.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:33 smithi116 ceph-mon[103554]: pgmap v391: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:07:34.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:33 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3126058003' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:07:34.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:33 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2873278929' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:07:34.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:33 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/328642388' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:07:34.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:33 smithi093 ceph-mon[103327]: pgmap v391: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:07:34.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:33 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3126058003' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-01T01:07:34.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:33 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2873278929' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-01T01:07:34.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:33 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/328642388' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-01T01:07:34.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:07:34.226 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-12-01T01:07:34.244 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-01T01:07:34.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:07:34.245 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-01T01:07:34.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:07:34.326 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2023-12-01T01:07:34.440 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-01T01:07:34.440 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2023-12-01T01:07:34.440 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-01T01:07:34.459 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287364k,nr_inodes=4071841,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=42,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15707 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/b2fbcc5f919f7bb50866460803ed69e3ab979c4220b371844b4e1fd4c705378b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/VTQJZJO5QPJ7EESKB3MCXFBXOD:/var/lib/containers/storage/overlay/l/2JPV43UNOKYQP4Q7KJ444WYQFI,upperdir=/var/lib/containers/storage/overlay/b2fbcc5f919f7bb50866460803ed69e3ab979c4220b371844b4e1fd4c705378b/diff,workdir=/var/lib/containers/storage/overlay/b2fbcc5f919f7bb50866460803ed69e3ab979c4220b371844b4e1fd4c705378b/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a61cdd81b90ef5519da2702f74fdbc6663953216a8fc2e73137edd18e09c4cdf/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/VTQJZJO5QPJ7EESKB3MCXFBXOD:/var/lib/containers/storage/overlay/l/2JPV43UNOKYQP4Q7KJ444WYQFI,upperdir=/var/lib/containers/storage/overlay/a61cdd81b90ef5519da2702f74fdbc6663953216a8fc2e73137edd18e09c4cdf/diff,workdir=/var/lib/containers/storage/overlay/a61cdd81b90ef5519da2702f74fdbc6663953216a8fc2e73137edd18e09c4cdf/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 overlay /var/lib/containers/storage/overlay/501f40e4a6e36e752a37d5ae8f99897026650634d42eeca0333800d59a9c1e7b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/VTQJZJO5QPJ7EESKB3MCXFBXOD:/var/lib/containers/storage/overlay/l/2JPV43UNOKYQP4Q7KJ444WYQFI,upperdir=/var/lib/containers/storage/overlay/501f40e4a6e36e752a37d5ae8f99897026650634d42eeca0333800d59a9c1e7b/diff,workdir=/var/lib/containers/storage/overlay/501f40e4a6e36e752a37d5ae8f99897026650634d42eeca0333800d59a9c1e7b/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/2ab3fc668d6e4b4fb94d6d625926bf3177dd341551ebac9f79257266efd4308e/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/VTQJZJO5QPJ7EESKB3MCXFBXOD:/var/lib/containers/storage/overlay/l/2JPV43UNOKYQP4Q7KJ444WYQFI,upperdir=/var/lib/containers/storage/overlay/2ab3fc668d6e4b4fb94d6d625926bf3177dd341551ebac9f79257266efd4308e/diff,workdir=/var/lib/containers/storage/overlay/2ab3fc668d6e4b4fb94d6d625926bf3177dd341551ebac9f79257266efd4308e/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/5a44f488966624f25fa98f87ed44c844ff24721d6dd73bff66ca2043ff21f4c3/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/VTQJZJO5QPJ7EESKB3MCXFBXOD:/var/lib/containers/storage/overlay/l/2JPV43UNOKYQP4Q7KJ444WYQFI,upperdir=/var/lib/containers/storage/overlay/5a44f488966624f25fa98f87ed44c844ff24721d6dd73bff66ca2043ff21f4c3/diff,workdir=/var/lib/containers/storage/overlay/5a44f488966624f25fa98f87ed44c844ff24721d6dd73bff66ca2043ff21f4c3/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/ad8e77661cdde5cd75c5c785da1d9b0f2469e9413c1b584e90aa514e4ee39233/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/VTQJZJO5QPJ7EESKB3MCXFBXOD:/var/lib/containers/storage/overlay/l/2JPV43UNOKYQP4Q7KJ444WYQFI,upperdir=/var/lib/containers/storage/overlay/ad8e77661cdde5cd75c5c785da1d9b0f2469e9413c1b584e90aa514e4ee39233/diff,workdir=/var/lib/containers/storage/overlay/ad8e77661cdde5cd75c5c785da1d9b0f2469e9413c1b584e90aa514e4ee39233/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f0dac27e8993bb9929f6621359153f8e9738f53e0c1ed4a4defc8044ecbfca79/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/VTQJZJO5QPJ7EESKB3MCXFBXOD:/var/lib/containers/storage/overlay/l/2JPV43UNOKYQP4Q7KJ444WYQFI,upperdir=/var/lib/containers/storage/overlay/f0dac27e8993bb9929f6621359153f8e9738f53e0c1ed4a4defc8044ecbfca79/diff,workdir=/var/lib/containers/storage/overlay/f0dac27e8993bb9929f6621359153f8e9738f53e0c1ed4a4defc8044ecbfca79/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/d10c99c8c4fa8d7a657688315d9b8319ca30150c1135e2af8e0370468dc16173/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/VTQJZJO5QPJ7EESKB3MCXFBXOD:/var/lib/containers/storage/overlay/l/2JPV43UNOKYQP4Q7KJ444WYQFI,upperdir=/var/lib/containers/storage/overlay/d10c99c8c4fa8d7a657688315d9b8319ca30150c1135e2af8e0370468dc16173/diff,workdir=/var/lib/containers/storage/overlay/d10c99c8c4fa8d7a657688315d9b8319ca30150c1135e2af8e0370468dc16173/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/7949226f841a03000c4bc7e42e08b17cf22d23afb90d6b1ac3128f84c4b792e8/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/VTQJZJO5QPJ7EESKB3MCXFBXOD:/var/lib/containers/storage/overlay/l/2JPV43UNOKYQP4Q7KJ444WYQFI,upperdir=/var/lib/containers/storage/overlay/7949226f841a03000c4bc7e42e08b17cf22d23afb90d6b1ac3128f84c4b792e8/diff,workdir=/var/lib/containers/storage/overlay/7949226f841a03000c4bc7e42e08b17cf22d23afb90d6b1ac3128f84c4b792e8/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8530d6de5d75d74a8bb5bdb2a843847fdda633cf28e2bd5a4e0f4c78c98f8406/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/VTQJZJO5QPJ7EESKB3MCXFBXOD:/var/lib/containers/storage/overlay/l/2JPV43UNOKYQP4Q7KJ444WYQFI,upperdir=/var/lib/containers/storage/overlay/8530d6de5d75d74a8bb5bdb2a843847fdda633cf28e2bd5a4e0f4c78c98f8406/diff,workdir=/var/lib/containers/storage/overlay/8530d6de5d75d74a8bb5bdb2a843847fdda633cf28e2bd5a4e0f4c78c98f8406/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-12-01T01:07:34.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:07:34.459 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2023-12-01T01:07:34.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-01T01:07:34.518 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2023-12-01T01:07:34.589 INFO:teuthology.orchestra.run.smithi026.stderr:Cannot find device "ceph-brx" 2023-12-01T01:07:34.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T01:07:34.591 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-01T01:07:34.602 INFO:tasks.cephadm:Teardown begin 2023-12-01T01:07:34.602 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-01T01:07:34.602 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:07:34.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.757+0000 7f3147864700 1 -- 172.21.15.26:0/2437611295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3140102010 msgr2=0x7f3140102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:34.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.757+0000 7f3147864700 1 --2- 172.21.15.26:0/2437611295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3140102010 0x7f3140102470 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3130009990 tx=0x7f3130009ca0 comp rx=0 tx=0).stop 2023-12-01T01:07:34.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.757+0000 7f3147864700 1 -- 172.21.15.26:0/2437611295 shutdown_connections 2023-12-01T01:07:34.760 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.757+0000 7f3147864700 1 --2- 172.21.15.26:0/2437611295 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31401029b0 0x7f3140109260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.757+0000 7f3147864700 1 --2- 172.21.15.26:0/2437611295 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31400ff040 0x7f31400ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.757+0000 7f3147864700 1 --2- 172.21.15.26:0/2437611295 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3140102010 0x7f3140102470 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.757+0000 7f3147864700 1 -- 172.21.15.26:0/2437611295 >> 172.21.15.26:0/2437611295 conn(0x7f31400fa950 msgr2=0x7f31400fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.757+0000 7f3147864700 1 -- 172.21.15.26:0/2437611295 shutdown_connections 2023-12-01T01:07:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.757+0000 7f3147864700 1 -- 172.21.15.26:0/2437611295 wait complete. 2023-12-01T01:07:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3147864700 1 Processor -- start 2023-12-01T01:07:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3147864700 1 -- start start 2023-12-01T01:07:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3147864700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31400ff040 0x7f3140196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3147864700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3140102010 0x7f3140197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3147864700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31401029b0 0x7f314019e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3147864700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314019e6c0 con 0x7f3140102010 2023-12-01T01:07:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3147864700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314019e800 con 0x7f31400ff040 2023-12-01T01:07:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3147864700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314019e990 con 0x7f31401029b0 2023-12-01T01:07:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3144dff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3140102010 0x7f3140197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:34.761 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3144dff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3140102010 0x7f3140197080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56836/0 (socket says 172.21.15.26:56836) 2023-12-01T01:07:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3144dff700 1 -- 172.21.15.26:0/3603286920 learned_addr learned my addr 172.21.15.26:0/3603286920 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:07:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3145e01700 1 --2- 172.21.15.26:0/3603286920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31401029b0 0x7f314019e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3145600700 1 --2- 172.21.15.26:0/3603286920 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31400ff040 0x7f3140196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3144dff700 1 -- 172.21.15.26:0/3603286920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31401029b0 msgr2=0x7f314019e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3144dff700 1 --2- 172.21.15.26:0/3603286920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31401029b0 0x7f314019e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3144dff700 1 -- 172.21.15.26:0/3603286920 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31400ff040 msgr2=0x7f3140196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3144dff700 1 --2- 172.21.15.26:0/3603286920 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31400ff040 0x7f3140196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.758+0000 7f3144dff700 1 -- 172.21.15.26:0/3603286920 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31300095f0 con 0x7f3140102010 2023-12-01T01:07:34.762 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.759+0000 7f3144dff700 1 --2- 172.21.15.26:0/3603286920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3140102010 0x7f3140197080 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f313000b5c0 tx=0x7f313000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.759+0000 7f31367fc700 1 -- 172.21.15.26:0/3603286920 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313001d070 con 0x7f3140102010 2023-12-01T01:07:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.759+0000 7f31367fc700 1 -- 172.21.15.26:0/3603286920 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f31300047d0 con 0x7f3140102010 2023-12-01T01:07:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.759+0000 7f3147864700 1 -- 172.21.15.26:0/3603286920 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314019ec10 con 0x7f3140102010 2023-12-01T01:07:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.759+0000 7f31367fc700 1 -- 172.21.15.26:0/3603286920 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130005360 con 0x7f3140102010 2023-12-01T01:07:34.763 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.759+0000 7f3147864700 1 -- 172.21.15.26:0/3603286920 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314019f030 con 0x7f3140102010 2023-12-01T01:07:34.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.760+0000 7f3147864700 1 -- 172.21.15.26:0/3603286920 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3140108310 con 0x7f3140102010 2023-12-01T01:07:34.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.762+0000 7f31367fc700 1 -- 172.21.15.26:0/3603286920 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f3130004c90 con 0x7f3140102010 2023-12-01T01:07:34.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.762+0000 7f31367fc700 1 --2- 172.21.15.26:0/3603286920 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f312c0a0570 0x7f312c0a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:34.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.762+0000 7f3145600700 1 --2- 172.21.15.26:0/3603286920 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f312c0a0570 0x7f312c0a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:34.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.762+0000 7f31367fc700 1 -- 172.21.15.26:0/3603286920 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f31300ccd00 con 0x7f3140102010 2023-12-01T01:07:34.764 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.763+0000 7f3145600700 1 --2- 172.21.15.26:0/3603286920 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f312c0a0570 0x7f312c0a2a30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3140067cf0 tx=0x7f313c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:34.766 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:34.766+0000 7f31367fc700 1 -- 172.21.15.26:0/3603286920 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3130096940 con 0x7f3140102010 2023-12-01T01:07:35.017 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.016+0000 7f3147864700 1 -- 172.21.15.26:0/3603286920 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f314002d090 con 0x7f3140102010 2023-12-01T01:07:35.018 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.017+0000 7f31367fc700 1 -- 172.21.15.26:0/3603286920 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+10787 (secure 0 0 0) 0x7f31300a0030 con 0x7f3140102010 2023-12-01T01:07:35.018 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:07:35.018 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6841/3515135915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6840","nonce":3515135915},{"type":"v1","addr":"172.21.15.26:6841","nonce":3515135915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-01T01:02:47.252972+0000","modified":"2023-12-01T01:06:32.422091+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24493,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":53,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6839/3364532241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":3364532241},{"type":"v1","addr":"172.21.15.93:6839","nonce":3364532241}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25385":{"gid":25385,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.93:6837/1672758793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":1672758793},{"type":"v1","addr":"172.21.15.93:6837","nonce":1672758793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T01:07:35.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.019+0000 7f3147864700 1 -- 172.21.15.26:0/3603286920 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f312c0a0570 msgr2=0x7f312c0a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:35.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.019+0000 7f3147864700 1 --2- 172.21.15.26:0/3603286920 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f312c0a0570 0x7f312c0a2a30 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f3140067cf0 tx=0x7f313c00b410 comp rx=0 tx=0).stop 2023-12-01T01:07:35.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.019+0000 7f3147864700 1 -- 172.21.15.26:0/3603286920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3140102010 msgr2=0x7f3140197080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:35.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.019+0000 7f3147864700 1 --2- 172.21.15.26:0/3603286920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3140102010 0x7f3140197080 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f313000b5c0 tx=0x7f313000f690 comp rx=0 tx=0).stop 2023-12-01T01:07:35.020 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.019+0000 7f3147864700 1 -- 172.21.15.26:0/3603286920 shutdown_connections 2023-12-01T01:07:35.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.019+0000 7f3147864700 1 --2- 172.21.15.26:0/3603286920 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f312c0a0570 0x7f312c0a2a30 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.019+0000 7f3147864700 1 --2- 172.21.15.26:0/3603286920 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f31401029b0 0x7f314019e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.019+0000 7f3147864700 1 --2- 172.21.15.26:0/3603286920 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f31400ff040 0x7f3140196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.019+0000 7f3147864700 1 --2- 172.21.15.26:0/3603286920 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3140102010 0x7f3140197080 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.019+0000 7f3147864700 1 -- 172.21.15.26:0/3603286920 >> 172.21.15.26:0/3603286920 conn(0x7f31400fa950 msgr2=0x7f3140105450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:35.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.019+0000 7f3147864700 1 -- 172.21.15.26:0/3603286920 shutdown_connections 2023-12-01T01:07:35.021 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.019+0000 7f3147864700 1 -- 172.21.15.26:0/3603286920 wait complete. 2023-12-01T01:07:35.021 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 32 2023-12-01T01:07:35.033 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-01T01:07:35.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.157+0000 7fb53794c700 1 -- 172.21.15.26:0/826034821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb530106ab0 msgr2=0x7fb530108ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:35.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.157+0000 7fb53794c700 1 --2- 172.21.15.26:0/826034821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb530106ab0 0x7fb530108ec0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb52800b0a0 tx=0x7fb52800b3b0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.160 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.157+0000 7fb53794c700 1 -- 172.21.15.26:0/826034821 shutdown_connections 2023-12-01T01:07:35.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.157+0000 7fb53794c700 1 --2- 172.21.15.26:0/826034821 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb530106ab0 0x7fb530108ec0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.157+0000 7fb53794c700 1 --2- 172.21.15.26:0/826034821 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb530101850 0x7fb530103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.157+0000 7fb53794c700 1 --2- 172.21.15.26:0/826034821 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb530104180 0x7fb530106570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.157+0000 7fb53794c700 1 -- 172.21.15.26:0/826034821 >> 172.21.15.26:0/826034821 conn(0x7fb5300fb1c0 msgr2=0x7fb5300fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:35.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.157+0000 7fb53794c700 1 -- 172.21.15.26:0/826034821 shutdown_connections 2023-12-01T01:07:35.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.157+0000 7fb53794c700 1 -- 172.21.15.26:0/826034821 wait complete. 2023-12-01T01:07:35.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.157+0000 7fb53794c700 1 Processor -- start 2023-12-01T01:07:35.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.157+0000 7fb53794c700 1 -- start start 2023-12-01T01:07:35.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb53794c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb530101850 0x7fb530196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:35.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb53794c700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb530104180 0x7fb530197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:35.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb53794c700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb530106ab0 0x7fb53019e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:35.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb53794c700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53019e6d0 con 0x7fb530106ab0 2023-12-01T01:07:35.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb53794c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53019e810 con 0x7fb530101850 2023-12-01T01:07:35.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb53794c700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53019e9a0 con 0x7fb530104180 2023-12-01T01:07:35.161 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb535ee9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb530106ab0 0x7fb53019e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb535ee9700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb530106ab0 0x7fb53019e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56852/0 (socket says 172.21.15.26:56852) 2023-12-01T01:07:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb535ee9700 1 -- 172.21.15.26:0/3855851075 learned_addr learned my addr 172.21.15.26:0/3855851075 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:07:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb534ee7700 1 --2- 172.21.15.26:0/3855851075 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb530104180 0x7fb530197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb5356e8700 1 --2- 172.21.15.26:0/3855851075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb530101850 0x7fb530196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb535ee9700 1 -- 172.21.15.26:0/3855851075 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb530104180 msgr2=0x7fb530197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb535ee9700 1 --2- 172.21.15.26:0/3855851075 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb530104180 0x7fb530197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb535ee9700 1 -- 172.21.15.26:0/3855851075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb530101850 msgr2=0x7fb530196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb535ee9700 1 --2- 172.21.15.26:0/3855851075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb530101850 0x7fb530196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb535ee9700 1 -- 172.21.15.26:0/3855851075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb528009d00 con 0x7fb530106ab0 2023-12-01T01:07:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb5356e8700 1 --2- 172.21.15.26:0/3855851075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb530101850 0x7fb530196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-01T01:07:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb535ee9700 1 --2- 172.21.15.26:0/3855851075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb530106ab0 0x7fb53019e100 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb5280062a0 tx=0x7fb5280094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb5267fc700 1 -- 172.21.15.26:0/3855851075 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52800e040 con 0x7fb530106ab0 2023-12-01T01:07:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb5267fc700 1 -- 172.21.15.26:0/3855851075 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fb528004de0 con 0x7fb530106ab0 2023-12-01T01:07:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb53794c700 1 -- 172.21.15.26:0/3855851075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53019ec20 con 0x7fb530106ab0 2023-12-01T01:07:35.162 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.158+0000 7fb5267fc700 1 -- 172.21.15.26:0/3855851075 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52801d6e0 con 0x7fb530106ab0 2023-12-01T01:07:35.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.159+0000 7fb53794c700 1 -- 172.21.15.26:0/3855851075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53019f050 con 0x7fb530106ab0 2023-12-01T01:07:35.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.159+0000 7fb53794c700 1 -- 172.21.15.26:0/3855851075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5300fcd40 con 0x7fb530106ab0 2023-12-01T01:07:35.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.161+0000 7fb5267fc700 1 -- 172.21.15.26:0/3855851075 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fb5280041b0 con 0x7fb530106ab0 2023-12-01T01:07:35.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.161+0000 7fb5267fc700 1 --2- 172.21.15.26:0/3855851075 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb51c0a0570 0x7fb51c0a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:35.163 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.161+0000 7fb5267fc700 1 -- 172.21.15.26:0/3855851075 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fb5280cdb60 con 0x7fb530106ab0 2023-12-01T01:07:35.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.161+0000 7fb5356e8700 1 --2- 172.21.15.26:0/3855851075 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb51c0a0570 0x7fb51c0a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:35.164 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.162+0000 7fb5356e8700 1 --2- 172.21.15.26:0/3855851075 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb51c0a0570 0x7fb51c0a2a30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb52c005fd0 tx=0x7fb52c005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:35.165 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.164+0000 7fb5267fc700 1 -- 172.21.15.26:0/3855851075 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb5280977a0 con 0x7fb530106ab0 2023-12-01T01:07:35.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:34 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3357327399' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-01T01:07:35.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:34 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3357327399' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-01T01:07:35.296 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:34 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3357327399' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-12-01T01:07:35.422 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.421+0000 7fb53794c700 1 -- 172.21.15.26:0/3855851075 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb53002cec0 con 0x7fb530106ab0 2023-12-01T01:07:35.423 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.422+0000 7fb5267fc700 1 -- 172.21.15.26:0/3855851075 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+10787 (secure 0 0 0) 0x7fb52802fe60 con 0x7fb530106ab0 2023-12-01T01:07:35.423 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:07:35.423 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/3831137706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":3831137706},{"type":"v1","addr":"172.21.15.26:6835","nonce":3831137706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1419946505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":1419946505},{"type":"v1","addr":"172.21.15.26:6837","nonce":1419946505}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14622,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6841/3515135915","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6840","nonce":3515135915},{"type":"v1","addr":"172.21.15.26:6841","nonce":3515135915}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24406,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.116:6833/2596033158","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6832","nonce":2596033158},{"type":"v1","addr":"172.21.15.116:6833","nonce":2596033158}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24422,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6833/2298418641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":2298418641},{"type":"v1","addr":"172.21.15.93:6833","nonce":2298418641}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24446,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/2286202770","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":2286202770},{"type":"v1","addr":"172.21.15.93:6835","nonce":2286202770}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-01T01:02:47.252972+0000","modified":"2023-12-01T01:06:32.422091+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24509,"mds_1":24493,"mds_2":24481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6835/1591216017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6834","nonce":1591216017},{"type":"v1","addr":"172.21.15.116:6835","nonce":1591216017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24460":{"gid":24460,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.116:6837/1714302836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6836","nonce":1714302836},{"type":"v1","addr":"172.21.15.116:6837","nonce":1714302836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24481":{"gid":24481,"name":"i","rank":2,"incarnation":21,"state":"up:active","state_seq":53,"addr":"172.21.15.116:6839/261568108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6838","nonce":261568108},{"type":"v1","addr":"172.21.15.116:6839","nonce":261568108}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24493":{"gid":24493,"name":"g","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.26:6839/1277894156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6838","nonce":1277894156},{"type":"v1","addr":"172.21.15.26:6839","nonce":1277894156}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24509":{"gid":24509,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.93:6839/3364532241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6838","nonce":3364532241},{"type":"v1","addr":"172.21.15.93:6839","nonce":3364532241}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_25385":{"gid":25385,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.93:6837/1672758793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6836","nonce":1672758793},{"type":"v1","addr":"172.21.15.93:6837","nonce":1672758793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-01T01:07:35.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.424+0000 7fb53794c700 1 -- 172.21.15.26:0/3855851075 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb51c0a0570 msgr2=0x7fb51c0a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:35.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.424+0000 7fb53794c700 1 --2- 172.21.15.26:0/3855851075 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb51c0a0570 0x7fb51c0a2a30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb52c005fd0 tx=0x7fb52c005e20 comp rx=0 tx=0).stop 2023-12-01T01:07:35.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.424+0000 7fb53794c700 1 -- 172.21.15.26:0/3855851075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb530106ab0 msgr2=0x7fb53019e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:35.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.424+0000 7fb53794c700 1 --2- 172.21.15.26:0/3855851075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb530106ab0 0x7fb53019e100 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb5280062a0 tx=0x7fb5280094c0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.424+0000 7fb53794c700 1 -- 172.21.15.26:0/3855851075 shutdown_connections 2023-12-01T01:07:35.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.424+0000 7fb53794c700 1 --2- 172.21.15.26:0/3855851075 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fb51c0a0570 0x7fb51c0a2a30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.424+0000 7fb53794c700 1 --2- 172.21.15.26:0/3855851075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb530106ab0 0x7fb53019e100 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.424+0000 7fb53794c700 1 --2- 172.21.15.26:0/3855851075 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb530101850 0x7fb530196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.424+0000 7fb53794c700 1 --2- 172.21.15.26:0/3855851075 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fb530104180 0x7fb530197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.424+0000 7fb53794c700 1 -- 172.21.15.26:0/3855851075 >> 172.21.15.26:0/3855851075 conn(0x7fb5300fb1c0 msgr2=0x7fb5301024c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:35.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.425+0000 7fb53794c700 1 -- 172.21.15.26:0/3855851075 shutdown_connections 2023-12-01T01:07:35.426 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.425+0000 7fb53794c700 1 -- 172.21.15.26:0/3855851075 wait complete. 2023-12-01T01:07:35.427 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 32 2023-12-01T01:07:35.438 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-01T01:07:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.562+0000 7fce5aac0700 1 -- 172.21.15.26:0/2524479430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce54100f90 msgr2=0x7fce54107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.562+0000 7fce5aac0700 1 --2- 172.21.15.26:0/2524479430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce54100f90 0x7fce54107840 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fce4c00c240 tx=0x7fce4c00c550 comp rx=0 tx=0).stop 2023-12-01T01:07:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.562+0000 7fce5aac0700 1 -- 172.21.15.26:0/2524479430 shutdown_connections 2023-12-01T01:07:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.562+0000 7fce5aac0700 1 --2- 172.21.15.26:0/2524479430 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce54100f90 0x7fce54107840 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.562+0000 7fce5aac0700 1 --2- 172.21.15.26:0/2524479430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce540ff400 0x7fce540ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.562+0000 7fce5aac0700 1 --2- 172.21.15.26:0/2524479430 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce541005f0 0x7fce54100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.563+0000 7fce5aac0700 1 -- 172.21.15.26:0/2524479430 >> 172.21.15.26:0/2524479430 conn(0x7fce540fa950 msgr2=0x7fce540fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.563+0000 7fce5aac0700 1 -- 172.21.15.26:0/2524479430 shutdown_connections 2023-12-01T01:07:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.563+0000 7fce5aac0700 1 -- 172.21.15.26:0/2524479430 wait complete. 2023-12-01T01:07:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.563+0000 7fce5aac0700 1 Processor -- start 2023-12-01T01:07:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.563+0000 7fce5aac0700 1 -- start start 2023-12-01T01:07:35.566 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.563+0000 7fce5aac0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce540ff400 0x7fce54196c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.563+0000 7fce5aac0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce541005f0 0x7fce541971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.563+0000 7fce5aac0700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce54100f90 0x7fce5419e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.563+0000 7fce5aac0700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5419e7a0 con 0x7fce541005f0 2023-12-01T01:07:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.563+0000 7fce5aac0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5419e910 con 0x7fce540ff400 2023-12-01T01:07:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.563+0000 7fce5aac0700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5419ead0 con 0x7fce54100f90 2023-12-01T01:07:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.564+0000 7fce53fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce541005f0 0x7fce541971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.564+0000 7fce53fff700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce541005f0 0x7fce541971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56864/0 (socket says 172.21.15.26:56864) 2023-12-01T01:07:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.564+0000 7fce53fff700 1 -- 172.21.15.26:0/3272401319 learned_addr learned my addr 172.21.15.26:0/3272401319 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:07:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.564+0000 7fce5885c700 1 --2- 172.21.15.26:0/3272401319 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce540ff400 0x7fce54196c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.564+0000 7fce5905d700 1 --2- 172.21.15.26:0/3272401319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce54100f90 0x7fce5419e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.564+0000 7fce53fff700 1 -- 172.21.15.26:0/3272401319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce54100f90 msgr2=0x7fce5419e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.564+0000 7fce53fff700 1 --2- 172.21.15.26:0/3272401319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce54100f90 0x7fce5419e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.564+0000 7fce53fff700 1 -- 172.21.15.26:0/3272401319 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce540ff400 msgr2=0x7fce54196c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.564+0000 7fce53fff700 1 --2- 172.21.15.26:0/3272401319 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce540ff400 0x7fce54196c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.567 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.564+0000 7fce53fff700 1 -- 172.21.15.26:0/3272401319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c00ae10 con 0x7fce541005f0 2023-12-01T01:07:35.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.564+0000 7fce53fff700 1 --2- 172.21.15.26:0/3272401319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce541005f0 0x7fce541971a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fce4000b530 tx=0x7fce4000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:35.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.564+0000 7fce51ffb700 1 -- 172.21.15.26:0/3272401319 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40011830 con 0x7fce541005f0 2023-12-01T01:07:35.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.564+0000 7fce51ffb700 1 -- 172.21.15.26:0/3272401319 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fce40011e70 con 0x7fce541005f0 2023-12-01T01:07:35.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.564+0000 7fce5aac0700 1 -- 172.21.15.26:0/3272401319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5419edb0 con 0x7fce541005f0 2023-12-01T01:07:35.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.564+0000 7fce51ffb700 1 -- 172.21.15.26:0/3272401319 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000f2e0 con 0x7fce541005f0 2023-12-01T01:07:35.568 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.564+0000 7fce5aac0700 1 -- 172.21.15.26:0/3272401319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5419f300 con 0x7fce541005f0 2023-12-01T01:07:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.565+0000 7fce5aac0700 1 -- 172.21.15.26:0/3272401319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5410a540 con 0x7fce541005f0 2023-12-01T01:07:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.566+0000 7fce51ffb700 1 -- 172.21.15.26:0/3272401319 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fce40010610 con 0x7fce541005f0 2023-12-01T01:07:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.567+0000 7fce51ffb700 1 --2- 172.21.15.26:0/3272401319 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fce440a05f0 0x7fce440a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.567+0000 7fce51ffb700 1 -- 172.21.15.26:0/3272401319 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7fce400cb2f0 con 0x7fce541005f0 2023-12-01T01:07:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.567+0000 7fce5885c700 1 --2- 172.21.15.26:0/3272401319 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fce440a05f0 0x7fce440a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:35.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.567+0000 7fce5885c700 1 --2- 172.21.15.26:0/3272401319 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fce440a05f0 0x7fce440a2ab0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fce54198130 tx=0x7fce48009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:35.572 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.571+0000 7fce51ffb700 1 -- 172.21.15.26:0/3272401319 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fce40094ea0 con 0x7fce541005f0 2023-12-01T01:07:35.777 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.776+0000 7fce5aac0700 1 -- 172.21.15.26:0/3272401319 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce541061e0 con 0x7fce541005f0 2023-12-01T01:07:35.778 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.777+0000 7fce51ffb700 1 -- 172.21.15.26:0/3272401319 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22481 (secure 0 0 0) 0x7fce400984c0 con 0x7fce541005f0 2023-12-01T01:07:35.779 INFO:teuthology.orchestra.run.smithi026.stdout: 2023-12-01T01:07:35.779 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":84,"fsid":"48bff570-8fe4-11ee-95a2-87774f69a715","created":"2023-12-01T00:55:57.221894+0000","modified":"2023-12-01T01:05:53.540747+0000","last_up_change":"2023-12-01T01:02:05.744672+0000","last_in_change":"2023-12-01T01:01:48.958565+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-01T00:59:06.411348+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-01T01:02:45.762784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-01T01:02:46.638998+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4b914664-c721-4904-8454-92092f5ea9d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6803","nonce":3366878148}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6805","nonce":3366878148}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6809","nonce":3366878148}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":3366878148},{"type":"v1","addr":"172.21.15.26:6807","nonce":3366878148}]},"public_addr":"172.21.15.26:6803/3366878148","cluster_addr":"172.21.15.26:6805/3366878148","heartbeat_back_addr":"172.21.15.26:6809/3366878148","heartbeat_front_addr":"172.21.15.26:6807/3366878148","state":["exists","up"]},{"osd":1,"uuid":"0b539f82-17c1-4f64-8246-fcd50237089c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6801","nonce":1078035045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6803","nonce":1078035045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6807","nonce":1078035045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":1078035045},{"type":"v1","addr":"172.21.15.93:6805","nonce":1078035045}]},"public_addr":"172.21.15.93:6801/1078035045","cluster_addr":"172.21.15.93:6803/1078035045","heartbeat_back_addr":"172.21.15.93:6807/1078035045","heartbeat_front_addr":"172.21.15.93:6805/1078035045","state":["exists","up"]},{"osd":2,"uuid":"c20d1850-e656-46c4-a25c-cf114bf23377","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6800","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6801","nonce":859484820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6802","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6803","nonce":859484820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6806","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6807","nonce":859484820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6804","nonce":859484820},{"type":"v1","addr":"172.21.15.116:6805","nonce":859484820}]},"public_addr":"172.21.15.116:6801/859484820","cluster_addr":"172.21.15.116:6803/859484820","heartbeat_back_addr":"172.21.15.116:6807/859484820","heartbeat_front_addr":"172.21.15.116:6805/859484820","state":["exists","up"]},{"osd":3,"uuid":"12dbd39e-b304-4d90-b9bc-a277f9a774e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6811","nonce":63607137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6813","nonce":63607137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6817","nonce":63607137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":63607137},{"type":"v1","addr":"172.21.15.26:6815","nonce":63607137}]},"public_addr":"172.21.15.26:6811/63607137","cluster_addr":"172.21.15.26:6813/63607137","heartbeat_back_addr":"172.21.15.26:6817/63607137","heartbeat_front_addr":"172.21.15.26:6815/63607137","state":["exists","up"]},{"osd":4,"uuid":"d18c3e93-6ffc-4ef6-94d6-99fb3753ded3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6808","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6809","nonce":4081534363}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6811","nonce":4081534363}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6815","nonce":4081534363}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6812","nonce":4081534363},{"type":"v1","addr":"172.21.15.93:6813","nonce":4081534363}]},"public_addr":"172.21.15.93:6809/4081534363","cluster_addr":"172.21.15.93:6811/4081534363","heartbeat_back_addr":"172.21.15.93:6815/4081534363","heartbeat_front_addr":"172.21.15.93:6813/4081534363","state":["exists","up"]},{"osd":5,"uuid":"32151c1a-3530-4ae9-a9e0-a71e47ad5a57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6808","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6809","nonce":2687669413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6810","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6811","nonce":2687669413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6814","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6815","nonce":2687669413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6812","nonce":2687669413},{"type":"v1","addr":"172.21.15.116:6813","nonce":2687669413}]},"public_addr":"172.21.15.116:6809/2687669413","cluster_addr":"172.21.15.116:6811/2687669413","heartbeat_back_addr":"172.21.15.116:6815/2687669413","heartbeat_front_addr":"172.21.15.116:6813/2687669413","state":["exists","up"]},{"osd":6,"uuid":"684e9975-f289-494d-b861-2411c8a3c7a1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6819","nonce":1321295002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6821","nonce":1321295002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6825","nonce":1321295002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1321295002},{"type":"v1","addr":"172.21.15.26:6823","nonce":1321295002}]},"public_addr":"172.21.15.26:6819/1321295002","cluster_addr":"172.21.15.26:6821/1321295002","heartbeat_back_addr":"172.21.15.26:6825/1321295002","heartbeat_front_addr":"172.21.15.26:6823/1321295002","state":["exists","up"]},{"osd":7,"uuid":"0f2745f6-611e-4176-8022-85d5e1942478","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6817","nonce":671599702}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6819","nonce":671599702}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6823","nonce":671599702}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":671599702},{"type":"v1","addr":"172.21.15.93:6821","nonce":671599702}]},"public_addr":"172.21.15.93:6817/671599702","cluster_addr":"172.21.15.93:6819/671599702","heartbeat_back_addr":"172.21.15.93:6823/671599702","heartbeat_front_addr":"172.21.15.93:6821/671599702","state":["exists","up"]},{"osd":8,"uuid":"c25114ab-8b08-4a55-a459-57b4f63a31d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6816","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6817","nonce":3617757980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6818","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6819","nonce":3617757980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6822","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6823","nonce":3617757980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6820","nonce":3617757980},{"type":"v1","addr":"172.21.15.116:6821","nonce":3617757980}]},"public_addr":"172.21.15.116:6817/3617757980","cluster_addr":"172.21.15.116:6819/3617757980","heartbeat_back_addr":"172.21.15.116:6823/3617757980","heartbeat_front_addr":"172.21.15.116:6821/3617757980","state":["exists","up"]},{"osd":9,"uuid":"92bdc232-1c3c-4e04-a92b-ceb1d0ee9f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6827","nonce":499283189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6829","nonce":499283189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6833","nonce":499283189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":499283189},{"type":"v1","addr":"172.21.15.26:6831","nonce":499283189}]},"public_addr":"172.21.15.26:6827/499283189","cluster_addr":"172.21.15.26:6829/499283189","heartbeat_back_addr":"172.21.15.26:6833/499283189","heartbeat_front_addr":"172.21.15.26:6831/499283189","state":["exists","up"]},{"osd":10,"uuid":"28902f77-02c2-43ec-b419-476eecd5aa77","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":69,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6825","nonce":1905842175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6827","nonce":1905842175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6831","nonce":1905842175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":1905842175},{"type":"v1","addr":"172.21.15.93:6829","nonce":1905842175}]},"public_addr":"172.21.15.93:6825/1905842175","cluster_addr":"172.21.15.93:6827/1905842175","heartbeat_back_addr":"172.21.15.93:6831/1905842175","heartbeat_front_addr":"172.21.15.93:6829/1905842175","state":["exists","up"]},{"osd":11,"uuid":"114b3337-37f0-41e0-b0ab-5b77682584c4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":76,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6824","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6825","nonce":3877607198}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6826","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6827","nonce":3877607198}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6830","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6831","nonce":3877607198}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.116:6828","nonce":3877607198},{"type":"v1","addr":"172.21.15.116:6829","nonce":3877607198}]},"public_addr":"172.21.15.116:6825/3877607198","cluster_addr":"172.21.15.116:6827/3877607198","heartbeat_back_addr":"172.21.15.116:6831/3877607198","heartbeat_front_addr":"172.21.15.116:6829/3877607198","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:22.521617+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:58:42.759419+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:02.577766+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:22.982947+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T00:59:42.982339+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:02.550943+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:22.931896+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:00:43.165368+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:03.003768+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:24.068781+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:01:44.481273+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-01T01:02:04.387521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.21","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.26:0/11604977":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/2565806966":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6801/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3703480237":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/2854821205":"2023-12-02T00:56:57.879870+0000","172.21.15.26:6800/4102663452":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3514831989":"2023-12-02T00:56:57.879870+0000","172.21.15.26:0/3968181141":"2023-12-02T00:56:31.503558+0000","172.21.15.26:0/3742997211":"2023-12-02T00:56:31.503558+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-01T01:07:35.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.780+0000 7fce5aac0700 1 -- 172.21.15.26:0/3272401319 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fce440a05f0 msgr2=0x7fce440a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:35.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.780+0000 7fce5aac0700 1 --2- 172.21.15.26:0/3272401319 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fce440a05f0 0x7fce440a2ab0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fce54198130 tx=0x7fce48009260 comp rx=0 tx=0).stop 2023-12-01T01:07:35.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.780+0000 7fce5aac0700 1 -- 172.21.15.26:0/3272401319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce541005f0 msgr2=0x7fce541971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:35.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.780+0000 7fce5aac0700 1 --2- 172.21.15.26:0/3272401319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce541005f0 0x7fce541971a0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fce4000b530 tx=0x7fce4000b840 comp rx=0 tx=0).stop 2023-12-01T01:07:35.781 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.780+0000 7fce5aac0700 1 -- 172.21.15.26:0/3272401319 shutdown_connections 2023-12-01T01:07:35.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.780+0000 7fce5aac0700 1 --2- 172.21.15.26:0/3272401319 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fce440a05f0 0x7fce440a2ab0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.780+0000 7fce5aac0700 1 --2- 172.21.15.26:0/3272401319 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fce54100f90 0x7fce5419e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.780+0000 7fce5aac0700 1 --2- 172.21.15.26:0/3272401319 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce540ff400 0x7fce54196c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.780+0000 7fce5aac0700 1 --2- 172.21.15.26:0/3272401319 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fce541005f0 0x7fce541971a0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.780+0000 7fce5aac0700 1 -- 172.21.15.26:0/3272401319 >> 172.21.15.26:0/3272401319 conn(0x7fce540fa950 msgr2=0x7fce540fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:35.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.780+0000 7fce5aac0700 1 -- 172.21.15.26:0/3272401319 shutdown_connections 2023-12-01T01:07:35.782 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.780+0000 7fce5aac0700 1 -- 172.21.15.26:0/3272401319 wait complete. 2023-12-01T01:07:35.794 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-01T01:07:35.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.919+0000 7f22cd1f3700 1 -- 172.21.15.26:0/2501111806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22c8074d50 msgr2=0x7f22c80731a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:35.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.919+0000 7f22cd1f3700 1 --2- 172.21.15.26:0/2501111806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22c8074d50 0x7f22c80731a0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f22b8009990 tx=0x7f22b8009ca0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.919+0000 7f22cd1f3700 1 -- 172.21.15.26:0/2501111806 shutdown_connections 2023-12-01T01:07:35.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.919+0000 7f22cd1f3700 1 --2- 172.21.15.26:0/2501111806 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22c8108c70 0x7f22c810b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.919+0000 7f22cd1f3700 1 --2- 172.21.15.26:0/2501111806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22c8074d50 0x7f22c80731a0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.919+0000 7f22cd1f3700 1 --2- 172.21.15.26:0/2501111806 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22c8073770 0x7f22c8073bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.919+0000 7f22cd1f3700 1 -- 172.21.15.26:0/2501111806 >> 172.21.15.26:0/2501111806 conn(0x7f22c80fc310 msgr2=0x7f22c80fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:35.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.919+0000 7f22cd1f3700 1 -- 172.21.15.26:0/2501111806 shutdown_connections 2023-12-01T01:07:35.921 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.919+0000 7f22cd1f3700 1 -- 172.21.15.26:0/2501111806 wait complete. 2023-12-01T01:07:35.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.920+0000 7f22cd1f3700 1 Processor -- start 2023-12-01T01:07:35.923 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.920+0000 7f22cd1f3700 1 -- start start 2023-12-01T01:07:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.920+0000 7f22cd1f3700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22c8073770 0x7f22c8198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.920+0000 7f22cd1f3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22c8074d50 0x7f22c8199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22cd1f3700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22c8108c70 0x7f22c81a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22cd1f3700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c81a0940 con 0x7f22c8108c70 2023-12-01T01:07:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22cd1f3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c81a0a80 con 0x7f22c8074d50 2023-12-01T01:07:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22cd1f3700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c81a0c10 con 0x7f22c8073770 2023-12-01T01:07:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22c759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22c8108c70 0x7f22c81a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22c759e700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22c8108c70 0x7f22c81a0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56878/0 (socket says 172.21.15.26:56878) 2023-12-01T01:07:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22c759e700 1 -- 172.21.15.26:0/2899259191 learned_addr learned my addr 172.21.15.26:0/2899259191 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:07:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22c6d9d700 1 --2- 172.21.15.26:0/2899259191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22c8073770 0x7f22c8198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22c659c700 1 --2- 172.21.15.26:0/2899259191 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22c8074d50 0x7f22c8199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22c759e700 1 -- 172.21.15.26:0/2899259191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22c8073770 msgr2=0x7f22c8198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22c759e700 1 --2- 172.21.15.26:0/2899259191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22c8073770 0x7f22c8198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.924 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22c759e700 1 -- 172.21.15.26:0/2899259191 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22c8074d50 msgr2=0x7f22c8199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:35.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22c759e700 1 --2- 172.21.15.26:0/2899259191 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22c8074d50 0x7f22c8199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:35.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22c759e700 1 -- 172.21.15.26:0/2899259191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b80095f0 con 0x7f22c8108c70 2023-12-01T01:07:35.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22c759e700 1 --2- 172.21.15.26:0/2899259191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22c8108c70 0x7f22c81a0370 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f22c0007d70 tx=0x7f22c000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:35.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22affff700 1 -- 172.21.15.26:0/2899259191 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c000ac90 con 0x7f22c8108c70 2023-12-01T01:07:35.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22cd1f3700 1 -- 172.21.15.26:0/2899259191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c81a0ef0 con 0x7f22c8108c70 2023-12-01T01:07:35.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22affff700 1 -- 172.21.15.26:0/2899259191 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f22c000adf0 con 0x7f22c8108c70 2023-12-01T01:07:35.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22affff700 1 -- 172.21.15.26:0/2899259191 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c00116b0 con 0x7f22c8108c70 2023-12-01T01:07:35.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.921+0000 7f22cd1f3700 1 -- 172.21.15.26:0/2899259191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c81a1370 con 0x7f22c8108c70 2023-12-01T01:07:35.925 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.922+0000 7f22cd1f3700 1 -- 172.21.15.26:0/2899259191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22c8107370 con 0x7f22c8108c70 2023-12-01T01:07:35.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.923+0000 7f22affff700 1 -- 172.21.15.26:0/2899259191 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f22c0004ad0 con 0x7f22c8108c70 2023-12-01T01:07:35.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.924+0000 7f22affff700 1 --2- 172.21.15.26:0/2899259191 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f22b00a05a0 0x7f22b00a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:35.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.924+0000 7f22c6d9d700 1 --2- 172.21.15.26:0/2899259191 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f22b00a05a0 0x7f22b00a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:35.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.924+0000 7f22affff700 1 -- 172.21.15.26:0/2899259191 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8211+0+0 (secure 0 0 0) 0x7f22c00cbe70 con 0x7f22c8108c70 2023-12-01T01:07:35.926 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.925+0000 7f22c6d9d700 1 --2- 172.21.15.26:0/2899259191 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f22b00a05a0 0x7f22b00a2a60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f22b8000c00 tx=0x7f22b8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:35.930 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:35.929+0000 7f22affff700 1 -- 172.21.15.26:0/2899259191 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f22c0095a20 con 0x7f22c8108c70 2023-12-01T01:07:36.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:35 smithi026 ceph-mon[98801]: pgmap v392: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:07:36.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:35 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3603286920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:07:36.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:35 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3855851075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:07:36.046 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:35 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3272401319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:07:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.178+0000 7f22cd1f3700 1 -- 172.21.15.26:0/2899259191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f22c802ce40 con 0x7f22c8108c70 2023-12-01T01:07:36.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:35 smithi116 ceph-mon[103554]: pgmap v392: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:07:36.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:35 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3603286920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:07:36.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:35 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3855851075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:07:36.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:35 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3272401319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:07:36.188 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.187+0000 7f22affff700 1 -- 172.21.15.26:0/2899259191 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f22c0016090 con 0x7f22c8108c70 2023-12-01T01:07:36.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.190+0000 7f22cd1f3700 1 -- 172.21.15.26:0/2899259191 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f22b00a05a0 msgr2=0x7f22b00a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:36.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.190+0000 7f22cd1f3700 1 --2- 172.21.15.26:0/2899259191 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f22b00a05a0 0x7f22b00a2a60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f22b8000c00 tx=0x7f22b8005fb0 comp rx=0 tx=0).stop 2023-12-01T01:07:36.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.190+0000 7f22cd1f3700 1 -- 172.21.15.26:0/2899259191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22c8108c70 msgr2=0x7f22c81a0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:36.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.190+0000 7f22cd1f3700 1 --2- 172.21.15.26:0/2899259191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22c8108c70 0x7f22c81a0370 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f22c0007d70 tx=0x7f22c000a340 comp rx=0 tx=0).stop 2023-12-01T01:07:36.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.190+0000 7f22cd1f3700 1 -- 172.21.15.26:0/2899259191 shutdown_connections 2023-12-01T01:07:36.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.190+0000 7f22cd1f3700 1 --2- 172.21.15.26:0/2899259191 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f22b00a05a0 0x7f22b00a2a60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:36.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.190+0000 7f22cd1f3700 1 --2- 172.21.15.26:0/2899259191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f22c8108c70 0x7f22c81a0370 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:36.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.190+0000 7f22cd1f3700 1 --2- 172.21.15.26:0/2899259191 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f22c8073770 0x7f22c8198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:36.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.190+0000 7f22cd1f3700 1 --2- 172.21.15.26:0/2899259191 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f22c8074d50 0x7f22c8199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:36.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.190+0000 7f22cd1f3700 1 -- 172.21.15.26:0/2899259191 >> 172.21.15.26:0/2899259191 conn(0x7f22c80fc310 msgr2=0x7f22c80fe700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:36.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.190+0000 7f22cd1f3700 1 -- 172.21.15.26:0/2899259191 shutdown_connections 2023-12-01T01:07:36.192 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.190+0000 7f22cd1f3700 1 -- 172.21.15.26:0/2899259191 wait complete. 2023-12-01T01:07:36.192 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-01T01:07:36.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-01T01:07:36.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:35 smithi093 ceph-mon[103327]: pgmap v392: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-12-01T01:07:36.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:35 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3603286920' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:07:36.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:35 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3855851075' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-01T01:07:36.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:35 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3272401319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-01T01:07:36.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.335+0000 7f32b504b700 1 -- 172.21.15.26:0/2649478335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32b00ffc80 msgr2=0x7f32b01000a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:36.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.335+0000 7f32b504b700 1 --2- 172.21.15.26:0/2649478335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32b00ffc80 0x7f32b01000a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f32a00099c0 tx=0x7f32a0009cd0 comp rx=0 tx=0).stop 2023-12-01T01:07:36.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.335+0000 7f32b504b700 1 -- 172.21.15.26:0/2649478335 shutdown_connections 2023-12-01T01:07:36.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.335+0000 7f32b504b700 1 --2- 172.21.15.26:0/2649478335 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32b0101810 0x7f32b01080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:36.338 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.335+0000 7f32b504b700 1 --2- 172.21.15.26:0/2649478335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32b00ffc80 0x7f32b01000a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.335+0000 7f32b504b700 1 --2- 172.21.15.26:0/2649478335 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32b0100e70 0x7f32b01012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.335+0000 7f32b504b700 1 -- 172.21.15.26:0/2649478335 >> 172.21.15.26:0/2649478335 conn(0x7f32b00fb1f0 msgr2=0x7f32b00fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.335+0000 7f32b504b700 1 -- 172.21.15.26:0/2649478335 shutdown_connections 2023-12-01T01:07:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.335+0000 7f32b504b700 1 -- 172.21.15.26:0/2649478335 wait complete. 2023-12-01T01:07:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32b504b700 1 Processor -- start 2023-12-01T01:07:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32b504b700 1 -- start start 2023-12-01T01:07:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32b504b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32b00ffc80 0x7f32b0196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32b504b700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32b0100e70 0x7f32b0197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32b504b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32b0101810 0x7f32b019e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32b504b700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b019e6d0 con 0x7f32b00ffc80 2023-12-01T01:07:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32b504b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b019e810 con 0x7f32b0101810 2023-12-01T01:07:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32b504b700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b019e9a0 con 0x7f32b0100e70 2023-12-01T01:07:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32aed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32b00ffc80 0x7f32b0196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:36.339 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32aed9d700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32b00ffc80 0x7f32b0196b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56900/0 (socket says 172.21.15.26:56900) 2023-12-01T01:07:36.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32aed9d700 1 -- 172.21.15.26:0/4125702484 learned_addr learned my addr 172.21.15.26:0/4125702484 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:07:36.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32af59e700 1 --2- 172.21.15.26:0/4125702484 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32b0101810 0x7f32b019e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:36.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32ae59c700 1 --2- 172.21.15.26:0/4125702484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32b0100e70 0x7f32b0197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:36.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32aed9d700 1 -- 172.21.15.26:0/4125702484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32b0100e70 msgr2=0x7f32b0197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:36.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32aed9d700 1 --2- 172.21.15.26:0/4125702484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32b0100e70 0x7f32b0197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:36.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32aed9d700 1 -- 172.21.15.26:0/4125702484 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32b0101810 msgr2=0x7f32b019e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:36.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32aed9d700 1 --2- 172.21.15.26:0/4125702484 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32b0101810 0x7f32b019e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:36.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.336+0000 7f32aed9d700 1 -- 172.21.15.26:0/4125702484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a00095f0 con 0x7f32b00ffc80 2023-12-01T01:07:36.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.337+0000 7f32aed9d700 1 --2- 172.21.15.26:0/4125702484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32b00ffc80 0x7f32b0196b50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009f50 tx=0x7f32a0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:36.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.337+0000 7f3297fff700 1 -- 172.21.15.26:0/4125702484 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a001d070 con 0x7f32b00ffc80 2023-12-01T01:07:36.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.337+0000 7f32b504b700 1 -- 172.21.15.26:0/4125702484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b019ec20 con 0x7f32b00ffc80 2023-12-01T01:07:36.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.337+0000 7f3297fff700 1 -- 172.21.15.26:0/4125702484 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f32a00040a0 con 0x7f32b00ffc80 2023-12-01T01:07:36.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.337+0000 7f3297fff700 1 -- 172.21.15.26:0/4125702484 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0022e70 con 0x7f32b00ffc80 2023-12-01T01:07:36.340 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.337+0000 7f32b504b700 1 -- 172.21.15.26:0/4125702484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b019f050 con 0x7f32b00ffc80 2023-12-01T01:07:36.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.338+0000 7f32b504b700 1 -- 172.21.15.26:0/4125702484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b010b5d0 con 0x7f32b00ffc80 2023-12-01T01:07:36.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.339+0000 7f3297fff700 1 -- 172.21.15.26:0/4125702484 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f32a0022570 con 0x7f32b00ffc80 2023-12-01T01:07:36.341 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.340+0000 7f3297fff700 1 --2- 172.21.15.26:0/4125702484 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f32980a0520 0x7f32980a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:36.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.340+0000 7f3297fff700 1 -- 172.21.15.26:0/4125702484 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8469+0+0 (secure 0 0 0) 0x7f32a00cd7b0 con 0x7f32b00ffc80 2023-12-01T01:07:36.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.340+0000 7f32ae59c700 1 --2- 172.21.15.26:0/4125702484 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f32980a0520 0x7f32980a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:36.342 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.340+0000 7f32ae59c700 1 --2- 172.21.15.26:0/4125702484 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f32980a0520 0x7f32980a29e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f32a400bbd0 tx=0x7f32a400b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:36.344 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.343+0000 7f3297fff700 1 -- 172.21.15.26:0/4125702484 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f32a00972f0 con 0x7f32b00ffc80 2023-12-01T01:07:36.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mon-a[98777]: 2023-12-01T01:07:36.179+0000 7f626bbc9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-01T01:07:36.546 INFO:journalctl@ceph.mds.g.smithi026.stdout:Dec 01 01:07:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-g[149589]: ignoring --setuser ceph since I am not root 2023-12-01T01:07:36.547 INFO:journalctl@ceph.mds.g.smithi026.stdout:Dec 01 01:07:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-g[149589]: ignoring --setgroup ceph since I am not root 2023-12-01T01:07:36.547 INFO:journalctl@ceph.mds.g.smithi026.stdout:Dec 01 01:07:36 smithi026 ceph-mds[149631]: -- 172.21.15.26:0/965195655 <== mon.0 v2:172.21.15.26:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f58d0631e0 con 0x55f58d038800 2023-12-01T01:07:36.547 INFO:journalctl@ceph.mds.g.smithi026.stdout:Dec 01 01:07:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-g[149589]: starting mds.g at 2023-12-01T01:07:36.593 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:36.592+0000 7f32b504b700 1 -- 172.21.15.26:0/4125702484 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f32b019f600 con 0x7f32b00ffc80 2023-12-01T01:07:36.680 INFO:journalctl@ceph.mds.c.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-c[141641]: ignoring --setuser ceph since I am not root 2023-12-01T01:07:36.680 INFO:journalctl@ceph.mds.c.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-c[141641]: ignoring --setgroup ceph since I am not root 2023-12-01T01:07:36.680 INFO:journalctl@ceph.mds.c.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-mds[141666]: -- 172.21.15.116:0/476372848 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c7314f11e0 con 0x55c7314c7000 2023-12-01T01:07:36.680 INFO:journalctl@ceph.mds.c.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-c[141641]: starting mds.c at 2023-12-01T01:07:36.681 INFO:journalctl@ceph.mds.f.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-f[141301]: ignoring --setuser ceph since I am not root 2023-12-01T01:07:36.681 INFO:journalctl@ceph.mds.f.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-f[141301]: ignoring --setgroup ceph since I am not root 2023-12-01T01:07:36.681 INFO:journalctl@ceph.mds.f.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-mds[141325]: -- 172.21.15.116:0/4139537942 <== mon.1 v2:172.21.15.116:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f7fdded1e0 con 0x55f7fddc2c00 2023-12-01T01:07:36.681 INFO:journalctl@ceph.mds.f.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-f[141301]: starting mds.f at 2023-12-01T01:07:36.681 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: ignoring --setuser ceph since I am not root 2023-12-01T01:07:36.681 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: ignoring --setgroup ceph since I am not root 2023-12-01T01:07:36.681 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-mds[142005]: -- 172.21.15.116:0/1418081980 <== mon.2 v2:172.21.15.93:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5644363c31e0 con 0x564436398800 2023-12-01T01:07:36.681 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: starting mds.i at 2023-12-01T01:07:36.715 INFO:journalctl@ceph.mds.b.smithi093.stdout:Dec 01 01:07:36 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-b[139375]: ignoring --setuser ceph since I am not root 2023-12-01T01:07:36.715 INFO:journalctl@ceph.mds.b.smithi093.stdout:Dec 01 01:07:36 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-b[139375]: ignoring --setgroup ceph since I am not root 2023-12-01T01:07:36.716 INFO:journalctl@ceph.mds.b.smithi093.stdout:Dec 01 01:07:36 smithi093 ceph-mds[139399]: -- 172.21.15.93:0/3315756276 <== mon.2 v2:172.21.15.93:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557e5a3b51e0 con 0x557e5a38b000 2023-12-01T01:07:36.716 INFO:journalctl@ceph.mds.b.smithi093.stdout:Dec 01 01:07:36 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-b[139375]: starting mds.b at 2023-12-01T01:07:36.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:07:36 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[141459]: ignoring --setuser ceph since I am not root 2023-12-01T01:07:36.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:07:36 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[141459]: ignoring --setgroup ceph since I am not root 2023-12-01T01:07:36.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:07:36 smithi093 ceph-mds[141483]: -- 172.21.15.93:0/333831377 <== mon.2 v2:172.21.15.93:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55dfebedb1e0 con 0x55dfebeb0800 2023-12-01T01:07:36.716 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:07:36 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[141459]: starting mds.h at 2023-12-01T01:07:37.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2899259191' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-12-01T01:07:37.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-mon[103554]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-01T01:07:37.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-mon[103554]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-01T01:07:37.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-mon[103554]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-12-01T01:07:37.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-mon[103554]: osdmap e85: 12 total, 12 up, 12 in 2023-12-01T01:07:37.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/2899259191' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-12-01T01:07:37.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-mon[103554]: fsmap cephfs:0/3 6 up:standby, 3 failed 2023-12-01T01:07:37.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:36 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/4125702484' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-12-01T01:07:37.191 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.190+0000 7f3297fff700 1 -- 172.21.15.26:0/4125702484 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7f32a009a910 con 0x7f32b00ffc80 2023-12-01T01:07:37.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.194+0000 7f32b504b700 1 -- 172.21.15.26:0/4125702484 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f32980a0520 msgr2=0x7f32980a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:37.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.194+0000 7f32b504b700 1 --2- 172.21.15.26:0/4125702484 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f32980a0520 0x7f32980a29e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f32a400bbd0 tx=0x7f32a400b5b0 comp rx=0 tx=0).stop 2023-12-01T01:07:37.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.194+0000 7f32b504b700 1 -- 172.21.15.26:0/4125702484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32b00ffc80 msgr2=0x7f32b0196b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:37.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.194+0000 7f32b504b700 1 --2- 172.21.15.26:0/4125702484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32b00ffc80 0x7f32b0196b50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009f50 tx=0x7f32a0005740 comp rx=0 tx=0).stop 2023-12-01T01:07:37.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.195+0000 7f32b504b700 1 -- 172.21.15.26:0/4125702484 shutdown_connections 2023-12-01T01:07:37.195 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.195+0000 7f32b504b700 1 --2- 172.21.15.26:0/4125702484 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f32980a0520 0x7f32980a29e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:37.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.195+0000 7f32b504b700 1 --2- 172.21.15.26:0/4125702484 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32b0101810 0x7f32b019e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:37.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.195+0000 7f32b504b700 1 --2- 172.21.15.26:0/4125702484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f32b00ffc80 0x7f32b0196b50 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:37.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.195+0000 7f32b504b700 1 --2- 172.21.15.26:0/4125702484 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f32b0100e70 0x7f32b0197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:37.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.195+0000 7f32b504b700 1 -- 172.21.15.26:0/4125702484 >> 172.21.15.26:0/4125702484 conn(0x7f32b00fb1f0 msgr2=0x7f32b0067eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:37.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.195+0000 7f32b504b700 1 -- 172.21.15.26:0/4125702484 shutdown_connections 2023-12-01T01:07:37.196 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.195+0000 7f32b504b700 1 -- 172.21.15.26:0/4125702484 wait complete. 2023-12-01T01:07:37.211 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:36 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2899259191' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-12-01T01:07:37.211 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:36 smithi026 ceph-mon[98801]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-01T01:07:37.211 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:36 smithi026 ceph-mon[98801]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-01T01:07:37.211 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:36 smithi026 ceph-mon[98801]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-12-01T01:07:37.211 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:36 smithi026 ceph-mon[98801]: osdmap e85: 12 total, 12 up, 12 in 2023-12-01T01:07:37.211 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:36 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/2899259191' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-12-01T01:07:37.212 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:36 smithi026 ceph-mon[98801]: fsmap cephfs:0/3 6 up:standby, 3 failed 2023-12-01T01:07:37.212 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:36 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/4125702484' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-12-01T01:07:37.213 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-01T01:07:37.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:36 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2899259191' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-12-01T01:07:37.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:36 smithi093 ceph-mon[103327]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-01T01:07:37.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:36 smithi093 ceph-mon[103327]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-01T01:07:37.215 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:36 smithi093 ceph-mon[103327]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-12-01T01:07:37.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:36 smithi093 ceph-mon[103327]: osdmap e85: 12 total, 12 up, 12 in 2023-12-01T01:07:37.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:36 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/2899259191' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-12-01T01:07:37.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:36 smithi093 ceph-mon[103327]: fsmap cephfs:0/3 6 up:standby, 3 failed 2023-12-01T01:07:37.216 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:36 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/4125702484' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-12-01T01:07:37.354 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.350+0000 7fc874f48700 1 -- 172.21.15.26:0/1322991974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc870100e70 msgr2=0x7fc8701012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:37.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.350+0000 7fc874f48700 1 --2- 172.21.15.26:0/1322991974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc870100e70 0x7fc8701012d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fc8640099c0 tx=0x7fc864009cd0 comp rx=0 tx=0).stop 2023-12-01T01:07:37.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.350+0000 7fc874f48700 1 -- 172.21.15.26:0/1322991974 shutdown_connections 2023-12-01T01:07:37.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.350+0000 7fc874f48700 1 --2- 172.21.15.26:0/1322991974 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc870101810 0x7fc8701080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:37.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.350+0000 7fc874f48700 1 --2- 172.21.15.26:0/1322991974 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc8700ffc80 0x7fc8701000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:37.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.350+0000 7fc874f48700 1 --2- 172.21.15.26:0/1322991974 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc870100e70 0x7fc8701012d0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:37.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.350+0000 7fc874f48700 1 -- 172.21.15.26:0/1322991974 >> 172.21.15.26:0/1322991974 conn(0x7fc8700fb1f0 msgr2=0x7fc8700fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:37.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.350+0000 7fc874f48700 1 -- 172.21.15.26:0/1322991974 shutdown_connections 2023-12-01T01:07:37.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.350+0000 7fc874f48700 1 -- 172.21.15.26:0/1322991974 wait complete. 2023-12-01T01:07:37.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.351+0000 7fc874f48700 1 Processor -- start 2023-12-01T01:07:37.355 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.351+0000 7fc874f48700 1 -- start start 2023-12-01T01:07:37.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.351+0000 7fc874f48700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8700ffc80 0x7fc870068a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:37.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.351+0000 7fc874f48700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc870100e70 0x7fc87019b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:37.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.351+0000 7fc874f48700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc870101810 0x7fc87019df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:37.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.351+0000 7fc874f48700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87019e6e0 con 0x7fc870100e70 2023-12-01T01:07:37.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.351+0000 7fc874f48700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87019e850 con 0x7fc8700ffc80 2023-12-01T01:07:37.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.351+0000 7fc874f48700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87019ea10 con 0x7fc870101810 2023-12-01T01:07:37.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.351+0000 7fc86dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc870100e70 0x7fc87019b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:37.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.351+0000 7fc86dd9b700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc870100e70 0x7fc87019b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56918/0 (socket says 172.21.15.26:56918) 2023-12-01T01:07:37.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.351+0000 7fc86dd9b700 1 -- 172.21.15.26:0/3144033056 learned_addr learned my addr 172.21.15.26:0/3144033056 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:07:37.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.351+0000 7fc86e59c700 1 --2- 172.21.15.26:0/3144033056 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8700ffc80 0x7fc870068a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:37.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.351+0000 7fc86ed9d700 1 --2- 172.21.15.26:0/3144033056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc870101810 0x7fc87019df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:37.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.352+0000 7fc86dd9b700 1 -- 172.21.15.26:0/3144033056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc870101810 msgr2=0x7fc87019df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:37.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.352+0000 7fc86dd9b700 1 --2- 172.21.15.26:0/3144033056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc870101810 0x7fc87019df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:37.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.352+0000 7fc86dd9b700 1 -- 172.21.15.26:0/3144033056 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8700ffc80 msgr2=0x7fc870068a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:37.356 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.352+0000 7fc86dd9b700 1 --2- 172.21.15.26:0/3144033056 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8700ffc80 0x7fc870068a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:37.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.352+0000 7fc86dd9b700 1 -- 172.21.15.26:0/3144033056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8640095f0 con 0x7fc870100e70 2023-12-01T01:07:37.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.352+0000 7fc86ed9d700 1 --2- 172.21.15.26:0/3144033056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc870101810 0x7fc87019df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-01T01:07:37.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.352+0000 7fc86dd9b700 1 --2- 172.21.15.26:0/3144033056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc870100e70 0x7fc87019b900 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc864003800 tx=0x7fc864005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:37.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.352+0000 7fc85f7fe700 1 -- 172.21.15.26:0/3144033056 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86401d070 con 0x7fc870100e70 2023-12-01T01:07:37.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.352+0000 7fc85f7fe700 1 -- 172.21.15.26:0/3144033056 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7fc8640040a0 con 0x7fc870100e70 2023-12-01T01:07:37.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.352+0000 7fc874f48700 1 -- 172.21.15.26:0/3144033056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87019ec90 con 0x7fc870100e70 2023-12-01T01:07:37.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.352+0000 7fc85f7fe700 1 -- 172.21.15.26:0/3144033056 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86400f460 con 0x7fc870100e70 2023-12-01T01:07:37.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.352+0000 7fc874f48700 1 -- 172.21.15.26:0/3144033056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc87019f0b0 con 0x7fc870100e70 2023-12-01T01:07:37.357 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.353+0000 7fc874f48700 1 -- 172.21.15.26:0/3144033056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc870107210 con 0x7fc870100e70 2023-12-01T01:07:37.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.354+0000 7fc85f7fe700 1 -- 172.21.15.26:0/3144033056 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7fc864022600 con 0x7fc870100e70 2023-12-01T01:07:37.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.355+0000 7fc85f7fe700 1 --2- 172.21.15.26:0/3144033056 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc8580a0520 0x7fc8580a29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:37.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.355+0000 7fc85f7fe700 1 -- 172.21.15.26:0/3144033056 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8469+0+0 (secure 0 0 0) 0x7fc8640ccf60 con 0x7fc870100e70 2023-12-01T01:07:37.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.355+0000 7fc86e59c700 1 --2- 172.21.15.26:0/3144033056 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc8580a0520 0x7fc8580a29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:37.358 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.355+0000 7fc86e59c700 1 --2- 172.21.15.26:0/3144033056 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc8580a0520 0x7fc8580a29e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc870100cd0 tx=0x7fc86000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:37.360 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.359+0000 7fc85f7fe700 1 -- 172.21.15.26:0/3144033056 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc864096aa0 con 0x7fc870100e70 2023-12-01T01:07:37.562 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:37.561+0000 7fc874f48700 1 -- 172.21.15.26:0/3144033056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc8700619a0 con 0x7fc870100e70 2023-12-01T01:07:38.180 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: pgmap v393: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 853 B/s wr, 7 op/s 2023-12-01T01:07:38.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-01T01:07:38.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-01T01:07:38.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: Cluster is now healthy 2023-12-01T01:07:38.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.93:6836/808417448,v1:172.21.15.93:6837/808417448] up:boot 2023-12-01T01:07:38.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.116:6834/818306117,v1:172.21.15.116:6835/818306117] up:boot 2023-12-01T01:07:38.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.93:6838/1960875244,v1:172.21.15.93:6839/1960875244] up:boot 2023-12-01T01:07:38.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.26:6838/3314514959,v1:172.21.15.26:6839/3314514959] up:boot 2023-12-01T01:07:38.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.116:6837/3837112930,v1:172.21.15.116:6839/3837112930] up:boot 2023-12-01T01:07:38.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: mds.? [v2:172.21.15.116:6836/84465748,v1:172.21.15.116:6838/84465748] up:boot 2023-12-01T01:07:38.181 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/4125702484' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-12-01T01:07:38.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: fsmap 12 up:standby 2023-12-01T01:07:38.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-01T01:07:38.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-01T01:07:38.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-01T01:07:38.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-01T01:07:38.182 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-01T01:07:38.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-01T01:07:38.183 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:37 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3144033056' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-01T01:07:38.194 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.193+0000 7fc85f7fe700 1 -- 172.21.15.26:0/3144033056 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v86) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc8640270d0 con 0x7fc870100e70 2023-12-01T01:07:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.196+0000 7fc874f48700 1 -- 172.21.15.26:0/3144033056 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc8580a0520 msgr2=0x7fc8580a29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:38.198 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.196+0000 7fc874f48700 1 --2- 172.21.15.26:0/3144033056 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc8580a0520 0x7fc8580a29e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc870100cd0 tx=0x7fc86000b410 comp rx=0 tx=0).stop 2023-12-01T01:07:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.197+0000 7fc874f48700 1 -- 172.21.15.26:0/3144033056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc870100e70 msgr2=0x7fc87019b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.197+0000 7fc874f48700 1 --2- 172.21.15.26:0/3144033056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc870100e70 0x7fc87019b900 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fc864003800 tx=0x7fc864005740 comp rx=0 tx=0).stop 2023-12-01T01:07:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.197+0000 7fc874f48700 1 -- 172.21.15.26:0/3144033056 shutdown_connections 2023-12-01T01:07:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.197+0000 7fc874f48700 1 --2- 172.21.15.26:0/3144033056 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7fc8580a0520 0x7fc8580a29e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.197+0000 7fc874f48700 1 --2- 172.21.15.26:0/3144033056 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7fc870101810 0x7fc87019df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.197+0000 7fc874f48700 1 --2- 172.21.15.26:0/3144033056 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc8700ffc80 0x7fc870068a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.197+0000 7fc874f48700 1 --2- 172.21.15.26:0/3144033056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc870100e70 0x7fc87019b900 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.197+0000 7fc874f48700 1 -- 172.21.15.26:0/3144033056 >> 172.21.15.26:0/3144033056 conn(0x7fc8700fb1f0 msgr2=0x7fc870104350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.197+0000 7fc874f48700 1 -- 172.21.15.26:0/3144033056 shutdown_connections 2023-12-01T01:07:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.197+0000 7fc874f48700 1 -- 172.21.15.26:0/3144033056 wait complete. 2023-12-01T01:07:38.199 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2023-12-01T01:07:38.213 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: pgmap v393: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 853 B/s wr, 7 op/s 2023-12-01T01:07:38.213 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-01T01:07:38.213 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-01T01:07:38.213 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: Cluster is now healthy 2023-12-01T01:07:38.213 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.93:6836/808417448,v1:172.21.15.93:6837/808417448] up:boot 2023-12-01T01:07:38.214 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.116:6834/818306117,v1:172.21.15.116:6835/818306117] up:boot 2023-12-01T01:07:38.214 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.93:6838/1960875244,v1:172.21.15.93:6839/1960875244] up:boot 2023-12-01T01:07:38.214 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.26:6838/3314514959,v1:172.21.15.26:6839/3314514959] up:boot 2023-12-01T01:07:38.214 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.116:6837/3837112930,v1:172.21.15.116:6839/3837112930] up:boot 2023-12-01T01:07:38.214 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: mds.? [v2:172.21.15.116:6836/84465748,v1:172.21.15.116:6838/84465748] up:boot 2023-12-01T01:07:38.214 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/4125702484' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-12-01T01:07:38.215 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: fsmap 12 up:standby 2023-12-01T01:07:38.215 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-01T01:07:38.215 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-01T01:07:38.215 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-01T01:07:38.215 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-01T01:07:38.216 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-01T01:07:38.216 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-01T01:07:38.216 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:37 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3144033056' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-01T01:07:38.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: pgmap v393: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 853 B/s wr, 7 op/s 2023-12-01T01:07:38.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-01T01:07:38.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-01T01:07:38.217 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: Cluster is now healthy 2023-12-01T01:07:38.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.93:6836/808417448,v1:172.21.15.93:6837/808417448] up:boot 2023-12-01T01:07:38.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.116:6834/818306117,v1:172.21.15.116:6835/818306117] up:boot 2023-12-01T01:07:38.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.93:6838/1960875244,v1:172.21.15.93:6839/1960875244] up:boot 2023-12-01T01:07:38.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.26:6838/3314514959,v1:172.21.15.26:6839/3314514959] up:boot 2023-12-01T01:07:38.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.116:6837/3837112930,v1:172.21.15.116:6839/3837112930] up:boot 2023-12-01T01:07:38.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: mds.? [v2:172.21.15.116:6836/84465748,v1:172.21.15.116:6838/84465748] up:boot 2023-12-01T01:07:38.218 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/4125702484' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-12-01T01:07:38.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: fsmap 12 up:standby 2023-12-01T01:07:38.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-01T01:07:38.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-01T01:07:38.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-01T01:07:38.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-01T01:07:38.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-01T01:07:38.219 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: from='mgr.14152 172.21.15.26:0/228689379' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-01T01:07:38.220 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:37 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3144033056' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-01T01:07:38.221 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-01T01:07:38.363 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.358+0000 7f718e5a2700 1 -- 172.21.15.26:0/2729605748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7188100ce0 msgr2=0x7f7188101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.358+0000 7f718e5a2700 1 --2- 172.21.15.26:0/2729605748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7188100ce0 0x7f7188101140 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f71840099c0 tx=0x7f7184009cd0 comp rx=0 tx=0).stop 2023-12-01T01:07:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.358+0000 7f718e5a2700 1 -- 172.21.15.26:0/2729605748 shutdown_connections 2023-12-01T01:07:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.358+0000 7f718e5a2700 1 --2- 172.21.15.26:0/2729605748 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7188101680 0x7f7188107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:38.364 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.358+0000 7f718e5a2700 1 --2- 172.21.15.26:0/2729605748 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f71880ffaf0 0x7f71880fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:38.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.358+0000 7f718e5a2700 1 --2- 172.21.15.26:0/2729605748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7188100ce0 0x7f7188101140 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:38.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.358+0000 7f718e5a2700 1 -- 172.21.15.26:0/2729605748 >> 172.21.15.26:0/2729605748 conn(0x7f71880fb040 msgr2=0x7f71880fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:38.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.358+0000 7f718e5a2700 1 -- 172.21.15.26:0/2729605748 shutdown_connections 2023-12-01T01:07:38.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.358+0000 7f718e5a2700 1 -- 172.21.15.26:0/2729605748 wait complete. 2023-12-01T01:07:38.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.358+0000 7f718e5a2700 1 Processor -- start 2023-12-01T01:07:38.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718e5a2700 1 -- start start 2023-12-01T01:07:38.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718e5a2700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71880ffaf0 0x7f7188069750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:38.365 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718e5a2700 1 --2- >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7188100ce0 0x7f718819b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718e5a2700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7188101680 0x7f718819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718e5a2700 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718819e350 con 0x7f71880ffaf0 2023-12-01T01:07:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718e5a2700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718819e4c0 con 0x7f7188101680 2023-12-01T01:07:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718e5a2700 1 -- --> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718819e680 con 0x7f7188100ce0 2023-12-01T01:07:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718d5a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71880ffaf0 0x7f7188069750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718d5a0700 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71880ffaf0 0x7f7188069750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56930/0 (socket says 172.21.15.26:56930) 2023-12-01T01:07:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718d5a0700 1 -- 172.21.15.26:0/845501720 learned_addr learned my addr 172.21.15.26:0/845501720 (peer_addr_for_me v2:172.21.15.26:0/0) 2023-12-01T01:07:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718dda1700 1 --2- 172.21.15.26:0/845501720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7188101680 0x7f718819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718cd9f700 1 --2- 172.21.15.26:0/845501720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7188100ce0 0x7f718819b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718d5a0700 1 -- 172.21.15.26:0/845501720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7188100ce0 msgr2=0x7f718819b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718d5a0700 1 --2- 172.21.15.26:0/845501720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7188100ce0 0x7f718819b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718d5a0700 1 -- 172.21.15.26:0/845501720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7188101680 msgr2=0x7f718819dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718d5a0700 1 --2- 172.21.15.26:0/845501720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7188101680 0x7f718819dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718d5a0700 1 -- 172.21.15.26:0/845501720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71840095f0 con 0x7f71880ffaf0 2023-12-01T01:07:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718d5a0700 1 --2- 172.21.15.26:0/845501720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71880ffaf0 0x7f7188069750 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f717c00e970 tx=0x7f717c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f717a7fc700 1 -- 172.21.15.26:0/845501720 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c009790 con 0x7f71880ffaf0 2023-12-01T01:07:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f718e5a2700 1 -- 172.21.15.26:0/845501720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718819e960 con 0x7f71880ffaf0 2023-12-01T01:07:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f717a7fc700 1 -- 172.21.15.26:0/845501720 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(27 keys) v1 ==== 1139+0+0 (secure 0 0 0) 0x7f717c004500 con 0x7f71880ffaf0 2023-12-01T01:07:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.359+0000 7f717a7fc700 1 -- 172.21.15.26:0/845501720 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c010430 con 0x7f71880ffaf0 2023-12-01T01:07:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.360+0000 7f718e5a2700 1 -- 172.21.15.26:0/845501720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718819eec0 con 0x7f71880ffaf0 2023-12-01T01:07:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.361+0000 7f718e5a2700 1 -- 172.21.15.26:0/845501720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71881068b0 con 0x7f71880ffaf0 2023-12-01T01:07:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.361+0000 7f717a7fc700 1 -- 172.21.15.26:0/845501720 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 18) v1 ==== 135070+0+0 (secure 0 0 0) 0x7f717c00cbd0 con 0x7f71880ffaf0 2023-12-01T01:07:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.362+0000 7f717a7fc700 1 --2- 172.21.15.26:0/845501720 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f71740a05c0 0x7f71740a2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-01T01:07:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.362+0000 7f717a7fc700 1 -- 172.21.15.26:0/845501720 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 7915+0+0 (secure 0 0 0) 0x7f717c014070 con 0x7f71880ffaf0 2023-12-01T01:07:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.362+0000 7f718cd9f700 1 --2- 172.21.15.26:0/845501720 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f71740a05c0 0x7f71740a2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-01T01:07:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.363+0000 7f718cd9f700 1 --2- 172.21.15.26:0/845501720 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f71740a05c0 0x7f71740a2a80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7184000c00 tx=0x7f7184005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-01T01:07:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.366+0000 7f717a7fc700 1 -- 172.21.15.26:0/845501720 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f717c0958a0 con 0x7f71880ffaf0 2023-12-01T01:07:38.569 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:38.569+0000 7f718e5a2700 1 -- 172.21.15.26:0/845501720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f718802cc70 con 0x7f71880ffaf0 2023-12-01T01:07:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:39.196+0000 7f717a7fc700 1 -- 172.21.15.26:0/845501720 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v87) v1 ==== 169+0+0 (secure 0 0 0) 0x7f717c095030 con 0x7f71880ffaf0 2023-12-01T01:07:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:39.201+0000 7f718e5a2700 1 -- 172.21.15.26:0/845501720 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f71740a05c0 msgr2=0x7f71740a2a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:39.201+0000 7f718e5a2700 1 --2- 172.21.15.26:0/845501720 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f71740a05c0 0x7f71740a2a80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7184000c00 tx=0x7f7184005fb0 comp rx=0 tx=0).stop 2023-12-01T01:07:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:39.201+0000 7f718e5a2700 1 -- 172.21.15.26:0/845501720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71880ffaf0 msgr2=0x7f7188069750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-01T01:07:39.202 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:39.201+0000 7f718e5a2700 1 --2- 172.21.15.26:0/845501720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71880ffaf0 0x7f7188069750 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f717c00e970 tx=0x7f717c00ed30 comp rx=0 tx=0).stop 2023-12-01T01:07:39.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:39.202+0000 7f718e5a2700 1 -- 172.21.15.26:0/845501720 shutdown_connections 2023-12-01T01:07:39.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:39.202+0000 7f718e5a2700 1 --2- 172.21.15.26:0/845501720 >> [v2:172.21.15.26:6800/4255346255,v1:172.21.15.26:6801/4255346255] conn(0x7f71740a05c0 0x7f71740a2a80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:39.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:39.202+0000 7f718e5a2700 1 --2- 172.21.15.26:0/845501720 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7188101680 0x7f718819dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:39.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:39.202+0000 7f718e5a2700 1 --2- 172.21.15.26:0/845501720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f71880ffaf0 0x7f7188069750 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:39.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:39.202+0000 7f718e5a2700 1 --2- 172.21.15.26:0/845501720 >> [v2:172.21.15.116:3300/0,v1:172.21.15.116:6789/0] conn(0x7f7188100ce0 0x7f718819b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-01T01:07:39.203 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:39.202+0000 7f718e5a2700 1 -- 172.21.15.26:0/845501720 >> 172.21.15.26:0/845501720 conn(0x7f71880fb040 msgr2=0x7f71880fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-01T01:07:39.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:39.203+0000 7f718e5a2700 1 -- 172.21.15.26:0/845501720 shutdown_connections 2023-12-01T01:07:39.204 INFO:teuthology.orchestra.run.smithi026.stderr:2023-12-01T01:07:39.203+0000 7f718e5a2700 1 -- 172.21.15.26:0/845501720 wait complete. 2023-12-01T01:07:39.206 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2023-12-01T01:07:39.223 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-01T01:07:39.253 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-01T01:07:39.288 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-01T01:07:39.324 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-01T01:07:39.325 DEBUG:teuthology.orchestra.run.smithi026:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-01T01:07:39.343 DEBUG:teuthology.orchestra.run.smithi093:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-01T01:07:39.362 DEBUG:teuthology.orchestra.run.smithi116:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-01T01:07:39.384 INFO:tasks.cephadm:Stopping all daemons... 2023-12-01T01:07:39.384 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-12-01T01:07:39.384 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mon.a 2023-12-01T01:07:39.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:39 smithi093 ceph-mon[103327]: pgmap v395: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2023-12-01T01:07:39.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:39 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/3144033056' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-12-01T01:07:39.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:39 smithi093 ceph-mon[103327]: osdmap e86: 12 total, 12 up, 12 in 2023-12-01T01:07:39.465 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:39 smithi093 ceph-mon[103327]: from='client.? 172.21.15.26:0/845501720' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-01T01:07:39.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:39 smithi026 ceph-mon[98801]: pgmap v395: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2023-12-01T01:07:39.546 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:39 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/3144033056' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-12-01T01:07:39.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:39 smithi026 ceph-mon[98801]: osdmap e86: 12 total, 12 up, 12 in 2023-12-01T01:07:39.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:39 smithi026 ceph-mon[98801]: from='client.? 172.21.15.26:0/845501720' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-01T01:07:39.547 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:39 smithi026 systemd[1]: Stopping Ceph mon.a for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:07:39.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:39 smithi116 ceph-mon[103554]: pgmap v395: 97 pgs: 97 active+clean; 53 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 921 B/s wr, 7 op/s 2023-12-01T01:07:39.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:39 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/3144033056' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-12-01T01:07:39.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:39 smithi116 ceph-mon[103554]: osdmap e86: 12 total, 12 up, 12 in 2023-12-01T01:07:39.680 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:39 smithi116 ceph-mon[103554]: from='client.? 172.21.15.26:0/845501720' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-01T01:07:39.994 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:39 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mon-a[98777]: 2023-12-01T01:07:39.733+0000 7f62713d4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:07:39.994 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:39 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mon-a[98777]: 2023-12-01T01:07:39.733+0000 7f62713d4700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-12-01T01:07:40.274 INFO:journalctl@ceph.mon.a.smithi026.stdout:Dec 01 01:07:39 smithi026 bash[169476]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mon-a 2023-12-01T01:07:40.282 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mon.a.service' 2023-12-01T01:07:40.337 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:07:40.337 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-12-01T01:07:40.337 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-12-01T01:07:40.337 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mon.b 2023-12-01T01:07:40.715 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:40 smithi093 systemd[1]: Stopping Ceph mon.b for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:07:41.271 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:40 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mon-b[103303]: 2023-12-01T01:07:40.989+0000 7fcc88db6700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:07:41.271 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:40 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mon-b[103303]: 2023-12-01T01:07:40.989+0000 7fcc88db6700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-12-01T01:07:41.588 INFO:journalctl@ceph.mon.b.smithi093.stdout:Dec 01 01:07:41 smithi093 bash[142866]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mon-b 2023-12-01T01:07:41.594 DEBUG:teuthology.orchestra.run.smithi093:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mon.b.service' 2023-12-01T01:07:41.648 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:07:41.648 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-12-01T01:07:41.648 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-12-01T01:07:41.648 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mon.c 2023-12-01T01:07:41.930 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:41 smithi116 systemd[1]: Stopping Ceph mon.c for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:07:42.285 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:42 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mon-c[103530]: 2023-12-01T01:07:42.025+0000 7fbf07e64700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:07:42.285 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:42 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mon-c[103530]: 2023-12-01T01:07:42.025+0000 7fbf07e64700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-12-01T01:07:42.648 INFO:journalctl@ceph.mon.c.smithi116.stdout:Dec 01 01:07:42 smithi116 bash[145338]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mon-c 2023-12-01T01:07:42.656 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mon.c.service' 2023-12-01T01:07:42.721 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:07:42.721 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-12-01T01:07:42.721 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-12-01T01:07:42.721 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mgr.x 2023-12-01T01:07:43.046 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 01:07:42 smithi026 systemd[1]: Stopping Ceph mgr.x for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:07:43.344 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 01:07:43 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x[99045]: 2023-12-01T01:07:43.069+0000 7fb102ebf700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:07:43.621 INFO:journalctl@ceph.mgr.x.smithi026.stdout:Dec 01 01:07:43 smithi026 bash[169614]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-x 2023-12-01T01:07:43.628 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mgr.x.service' 2023-12-01T01:07:43.667 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:07:43.667 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-12-01T01:07:43.667 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-12-01T01:07:43.667 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mgr.y 2023-12-01T01:07:43.965 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 01:07:43 smithi093 systemd[1]: Stopping Ceph mgr.y for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:07:44.376 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 01:07:44 smithi093 bash[143023]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-y 2023-12-01T01:07:44.377 INFO:journalctl@ceph.mgr.y.smithi093.stdout:Dec 01 01:07:44 smithi093 systemd[1]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-12-01T01:07:44.560 DEBUG:teuthology.orchestra.run.smithi093:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mgr.y.service' 2023-12-01T01:07:44.596 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:07:44.596 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-12-01T01:07:44.596 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-12-01T01:07:44.596 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mgr.z 2023-12-01T01:07:44.930 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 01:07:44 smithi116 systemd[1]: Stopping Ceph mgr.z for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:07:45.302 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 01:07:45 smithi116 bash[145493]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mgr-z 2023-12-01T01:07:45.485 INFO:journalctl@ceph.mgr.z.smithi116.stdout:Dec 01 01:07:45 smithi116 systemd[1]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-12-01T01:07:45.489 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mgr.z.service' 2023-12-01T01:07:45.525 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:07:45.526 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-12-01T01:07:45.526 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-01T01:07:45.526 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.0 2023-12-01T01:07:45.903 INFO:journalctl@ceph.osd.0.smithi026.stdout:Dec 01 01:07:45 smithi026 systemd[1]: Stopping Ceph osd.0 for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:07:46.296 INFO:journalctl@ceph.osd.0.smithi026.stdout:Dec 01 01:07:45 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-0[117435]: 2023-12-01T01:07:45.902+0000 7f3a803a7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:07:46.296 INFO:journalctl@ceph.osd.0.smithi026.stdout:Dec 01 01:07:45 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-0[117435]: 2023-12-01T01:07:45.902+0000 7f3a803a7700 -1 osd.0 87 *** Got signal Terminated *** 2023-12-01T01:07:46.296 INFO:journalctl@ceph.osd.0.smithi026.stdout:Dec 01 01:07:45 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-0[117435]: 2023-12-01T01:07:45.902+0000 7f3a803a7700 -1 osd.0 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-01T01:07:51.669 INFO:journalctl@ceph.osd.0.smithi026.stdout:Dec 01 01:07:51 smithi026 bash[169752]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-0 2023-12-01T01:07:52.953 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.0.service' 2023-12-01T01:07:52.996 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:07:52.996 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-01T01:07:52.996 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-01T01:07:52.996 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.1 2023-12-01T01:07:53.338 INFO:journalctl@ceph.osd.1.smithi093.stdout:Dec 01 01:07:53 smithi093 systemd[1]: Stopping Ceph osd.1 for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:07:53.715 INFO:journalctl@ceph.osd.1.smithi093.stdout:Dec 01 01:07:53 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-1[108412]: 2023-12-01T01:07:53.335+0000 7ffaa6784700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:07:53.715 INFO:journalctl@ceph.osd.1.smithi093.stdout:Dec 01 01:07:53 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-1[108412]: 2023-12-01T01:07:53.335+0000 7ffaa6784700 -1 osd.1 87 *** Got signal Terminated *** 2023-12-01T01:07:53.715 INFO:journalctl@ceph.osd.1.smithi093.stdout:Dec 01 01:07:53 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-1[108412]: 2023-12-01T01:07:53.335+0000 7ffaa6784700 -1 osd.1 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-01T01:07:59.715 INFO:journalctl@ceph.osd.1.smithi093.stdout:Dec 01 01:07:59 smithi093 bash[143169]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-1 2023-12-01T01:08:00.703 DEBUG:teuthology.orchestra.run.smithi093:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.1.service' 2023-12-01T01:08:00.743 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:08:00.743 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-01T01:08:00.743 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-01T01:08:00.743 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.2 2023-12-01T01:08:01.110 INFO:journalctl@ceph.osd.2.smithi116.stdout:Dec 01 01:08:00 smithi116 systemd[1]: Stopping Ceph osd.2 for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:08:01.430 INFO:journalctl@ceph.osd.2.smithi116.stdout:Dec 01 01:08:01 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-2[109406]: 2023-12-01T01:08:01.107+0000 7f73e9efe700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:08:01.430 INFO:journalctl@ceph.osd.2.smithi116.stdout:Dec 01 01:08:01 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-2[109406]: 2023-12-01T01:08:01.107+0000 7f73e9efe700 -1 osd.2 87 *** Got signal Terminated *** 2023-12-01T01:08:01.430 INFO:journalctl@ceph.osd.2.smithi116.stdout:Dec 01 01:08:01 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-2[109406]: 2023-12-01T01:08:01.107+0000 7f73e9efe700 -1 osd.2 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-01T01:08:07.180 INFO:journalctl@ceph.osd.2.smithi116.stdout:Dec 01 01:08:06 smithi116 bash[145641]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-2 2023-12-01T01:08:08.168 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.2.service' 2023-12-01T01:08:08.209 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:08:08.209 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-01T01:08:08.209 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-01T01:08:08.209 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.3 2023-12-01T01:08:08.546 INFO:journalctl@ceph.osd.3.smithi026.stdout:Dec 01 01:08:08 smithi026 systemd[1]: Stopping Ceph osd.3 for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:08:09.046 INFO:journalctl@ceph.osd.3.smithi026.stdout:Dec 01 01:08:08 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-3[125295]: 2023-12-01T01:08:08.582+0000 7fa437773700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:08:09.046 INFO:journalctl@ceph.osd.3.smithi026.stdout:Dec 01 01:08:08 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-3[125295]: 2023-12-01T01:08:08.582+0000 7fa437773700 -1 osd.3 87 *** Got signal Terminated *** 2023-12-01T01:08:09.046 INFO:journalctl@ceph.osd.3.smithi026.stdout:Dec 01 01:08:08 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-3[125295]: 2023-12-01T01:08:08.582+0000 7fa437773700 -1 osd.3 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-01T01:08:12.215 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:11 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:11.944+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:12.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:12 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:12.022+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:12.796 INFO:journalctl@ceph.osd.3.smithi026.stdout:Dec 01 01:08:12 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-3[125295]: 2023-12-01T01:08:12.333+0000 7fa42fd61700 -1 osd.3 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:48.062664+0000 front 2023-12-01T01:07:48.062698+0000 (oldest deadline 2023-12-01T01:08:11.562867+0000) 2023-12-01T01:08:13.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:12 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:12.994+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:13.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:12 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:12.991+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:13.546 INFO:journalctl@ceph.osd.3.smithi026.stdout:Dec 01 01:08:13 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-3[125295]: 2023-12-01T01:08:13.367+0000 7fa42fd61700 -1 osd.3 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:48.062664+0000 front 2023-12-01T01:07:48.062698+0000 (oldest deadline 2023-12-01T01:08:11.562867+0000) 2023-12-01T01:08:13.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:13 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:13.229+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:14.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:14 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:14.001+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:14.460 INFO:journalctl@ceph.osd.3.smithi026.stdout:Dec 01 01:08:14 smithi026 bash[170031]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-3 2023-12-01T01:08:14.461 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:14 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:14.187+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:14.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:14 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:14.017+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:14.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:14 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:14.430+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:45.436531+0000 front 2023-12-01T01:07:45.436459+0000 (oldest deadline 2023-12-01T01:08:14.237339+0000) 2023-12-01T01:08:15.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:15 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:15.219+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:15.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:14 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:14.981+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:15.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:15 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:15.026+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:15.729 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:15 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:15.514+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:15.736 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.3.service' 2023-12-01T01:08:15.767 INFO:journalctl@ceph.osd.3.smithi026.stdout:Dec 01 01:08:15 smithi026 systemd[1]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.3.service: Succeeded. 2023-12-01T01:08:15.767 INFO:journalctl@ceph.osd.3.smithi026.stdout:Dec 01 01:08:15 smithi026 systemd[1]: Stopped Ceph osd.3 for 48bff570-8fe4-11ee-95a2-87774f69a715. 2023-12-01T01:08:15.778 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:08:15.779 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-01T01:08:15.779 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-01T01:08:15.779 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.4 2023-12-01T01:08:15.931 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:15 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:15.448+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:45.436531+0000 front 2023-12-01T01:07:45.436459+0000 (oldest deadline 2023-12-01T01:08:14.237339+0000) 2023-12-01T01:08:16.134 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:15 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:15.998+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:16.134 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 01 01:08:15 smithi093 systemd[1]: Stopping Ceph osd.4 for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:08:16.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:15 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:15.988+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:16.465 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 01 01:08:16 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-4[117133]: 2023-12-01T01:08:16.132+0000 7fdfb6b87700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:08:16.465 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 01 01:08:16 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-4[117133]: 2023-12-01T01:08:16.132+0000 7fdfb6b87700 -1 osd.4 87 *** Got signal Terminated *** 2023-12-01T01:08:16.465 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 01 01:08:16 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-4[117133]: 2023-12-01T01:08:16.132+0000 7fdfb6b87700 -1 osd.4 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-01T01:08:16.543 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:16 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:16.171+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:16.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:16 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:16.541+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:16.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:16 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:16.480+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:45.436531+0000 front 2023-12-01T01:07:45.436459+0000 (oldest deadline 2023-12-01T01:08:14.237339+0000) 2023-12-01T01:08:17.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:16 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:16.992+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:17.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:17 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:17.036+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:17.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:17 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:17.172+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:17.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:17 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:17.470+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:45.436531+0000 front 2023-12-01T01:07:45.436459+0000 (oldest deadline 2023-12-01T01:08:14.237339+0000) 2023-12-01T01:08:18.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:17 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:17.564+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:18.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:18 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:18.000+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:18.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:18 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:18.033+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:18.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:18 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:18.186+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:18.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:18 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:18.438+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:45.436531+0000 front 2023-12-01T01:07:45.436459+0000 (oldest deadline 2023-12-01T01:08:14.237339+0000) 2023-12-01T01:08:19.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:18 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:18.605+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:19.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:18 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:18.971+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:19.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:19 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:19.080+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:19.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:19 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:19.080+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:19.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:19 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:19.165+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:19.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:19 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:19.477+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:45.436531+0000 front 2023-12-01T01:07:45.436459+0000 (oldest deadline 2023-12-01T01:08:14.237339+0000) 2023-12-01T01:08:19.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:19 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:19.558+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:20.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:19 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:19.566+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:20.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:19 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:19.993+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:20.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:20 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:20.113+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:20.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:20 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:20.113+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:20.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:20 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:20.122+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:20.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:20 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:20.480+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:45.436531+0000 front 2023-12-01T01:07:45.436459+0000 (oldest deadline 2023-12-01T01:08:14.237339+0000) 2023-12-01T01:08:20.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:20 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:20.597+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:21.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:20 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:20.603+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:21.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:21 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:21.049+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:21.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:21 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:21.041+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:21.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:21 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:21.138+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:21.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:21 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:21.138+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:21.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:21 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:21.139+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:21.907 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:21 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:21.573+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:21.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:21 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:21.527+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:45.436531+0000 front 2023-12-01T01:07:45.436459+0000 (oldest deadline 2023-12-01T01:08:14.237339+0000) 2023-12-01T01:08:22.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:21 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:21.582+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:22.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:21 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:21.582+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:22.187 INFO:journalctl@ceph.osd.4.smithi093.stdout:Dec 01 01:08:21 smithi093 bash[143437]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-4 2023-12-01T01:08:22.188 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:22 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:22.186+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:22.188 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:22 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:22.186+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:22.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:22 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:22.074+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:22.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:22 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:22.002+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:22.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:22 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:22.002+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:22.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:22 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:22.134+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:22.715 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:22 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:22.612+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:22.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:22 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:22.482+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:45.436531+0000 front 2023-12-01T01:07:45.436459+0000 (oldest deadline 2023-12-01T01:08:14.237339+0000) 2023-12-01T01:08:22.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:22 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:22.482+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.738473+0000 front 2023-12-01T01:07:57.738612+0000 (oldest deadline 2023-12-01T01:08:22.438535+0000) 2023-12-01T01:08:23.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:22 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:22.623+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:23.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:22 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:22.623+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:23.281 DEBUG:teuthology.orchestra.run.smithi093:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.4.service' 2023-12-01T01:08:23.321 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:08:23.321 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-01T01:08:23.321 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-01T01:08:23.322 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.5 2023-12-01T01:08:23.351 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:23 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:23.059+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:23.352 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:22 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:22.990+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:23.352 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:22 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:22.990+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:23.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:23 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:23.197+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:23.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:23 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:23.197+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:23.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:23 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:23.136+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:23.680 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:23 smithi116 systemd[1]: Stopping Ceph osd.5 for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:08:23.680 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:23 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:23.510+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:45.436531+0000 front 2023-12-01T01:07:45.436459+0000 (oldest deadline 2023-12-01T01:08:14.237339+0000) 2023-12-01T01:08:23.680 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:23 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:23.510+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.738473+0000 front 2023-12-01T01:07:57.738612+0000 (oldest deadline 2023-12-01T01:08:22.438535+0000) 2023-12-01T01:08:23.959 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:23 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:23.686+0000 7f6f76008700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:08:23.959 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:23 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:23.686+0000 7f6f76008700 -1 osd.5 87 *** Got signal Terminated *** 2023-12-01T01:08:23.960 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:23 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:23.686+0000 7f6f76008700 -1 osd.5 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-01T01:08:23.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:23 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:23.653+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:24.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:23 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:23.641+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:24.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:23 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:23.641+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:24.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:24 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:24.085+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:24.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:23 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:23.959+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:24.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:23 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:23.959+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:24.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:24 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:24.205+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:24.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:24 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:24.205+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:24.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:24 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:24.101+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:24.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:24 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:24.101+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.846402+0000 front 2023-12-01T01:07:57.846142+0000 (oldest deadline 2023-12-01T01:08:23.146193+0000) 2023-12-01T01:08:24.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:24 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:24.475+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:45.436531+0000 front 2023-12-01T01:07:45.436459+0000 (oldest deadline 2023-12-01T01:08:14.237339+0000) 2023-12-01T01:08:24.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:24 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:24.475+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.738473+0000 front 2023-12-01T01:07:57.738612+0000 (oldest deadline 2023-12-01T01:08:22.438535+0000) 2023-12-01T01:08:24.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:24 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:24.680+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:25.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:24 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:24.661+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:25.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:24 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:24.661+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:25.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:25 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:25.043+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:25.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:24 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:24.947+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:25.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:24 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:24.947+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:25.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:25 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:25.175+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:25.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:25 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:25.175+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:25.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:25 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:25.128+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:25.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:25 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:25.128+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.846402+0000 front 2023-12-01T01:07:57.846142+0000 (oldest deadline 2023-12-01T01:08:23.146193+0000) 2023-12-01T01:08:25.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:25 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:25.521+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:45.436531+0000 front 2023-12-01T01:07:45.436459+0000 (oldest deadline 2023-12-01T01:08:14.237339+0000) 2023-12-01T01:08:25.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:25 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:25.521+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.738473+0000 front 2023-12-01T01:07:57.738612+0000 (oldest deadline 2023-12-01T01:08:22.438535+0000) 2023-12-01T01:08:25.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:25 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:25.655+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:26.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:25 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:25.632+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:26.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:25 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:25.632+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:26.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:26 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:26.077+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:26.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:25 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:25.963+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:26.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:25 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:25.963+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:26.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:26 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:26.197+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:26.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:26 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:26.197+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:26.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:26 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:26.092+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:26.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:26 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:26.092+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.846402+0000 front 2023-12-01T01:07:57.846142+0000 (oldest deadline 2023-12-01T01:08:23.146193+0000) 2023-12-01T01:08:26.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:26 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:26.476+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:45.436531+0000 front 2023-12-01T01:07:45.436459+0000 (oldest deadline 2023-12-01T01:08:14.237339+0000) 2023-12-01T01:08:26.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:26 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:26.476+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.738473+0000 front 2023-12-01T01:07:57.738612+0000 (oldest deadline 2023-12-01T01:08:22.438535+0000) 2023-12-01T01:08:26.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:26 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:26.685+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:27.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:26 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:26.640+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:27.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:26 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:26.640+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:27.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:27 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:27.079+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:27.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:26 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:26.962+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:27.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:26 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:26.962+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:27.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:27 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:27.157+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:27.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:27 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:27.157+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:27.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:27 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:27.157+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:27.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:27 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:27.094+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:27.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:27 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:27.094+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.846402+0000 front 2023-12-01T01:07:57.846142+0000 (oldest deadline 2023-12-01T01:08:23.146193+0000) 2023-12-01T01:08:27.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:27 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:27.492+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:45.436531+0000 front 2023-12-01T01:07:45.436459+0000 (oldest deadline 2023-12-01T01:08:14.237339+0000) 2023-12-01T01:08:27.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:27 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:27.492+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.738473+0000 front 2023-12-01T01:07:57.738612+0000 (oldest deadline 2023-12-01T01:08:22.438535+0000) 2023-12-01T01:08:27.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:27 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:27.492+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:03.539698+0000 front 2023-12-01T01:08:03.539722+0000 (oldest deadline 2023-12-01T01:08:27.039871+0000) 2023-12-01T01:08:27.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:27 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:27.674+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:28.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:27 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:27.669+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:28.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:27 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:27.669+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:28.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:28 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:28.076+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:28.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:27 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:27.948+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:28.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:27 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:27.948+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:28.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:28 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:28.145+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:28.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:28 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:28.145+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:28.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:28 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:28.145+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:28.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:28 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:28.061+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:28.546 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:28 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:28.061+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.846402+0000 front 2023-12-01T01:07:57.846142+0000 (oldest deadline 2023-12-01T01:08:23.146193+0000) 2023-12-01T01:08:28.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:28 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:28.478+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:45.436531+0000 front 2023-12-01T01:07:45.436459+0000 (oldest deadline 2023-12-01T01:08:14.237339+0000) 2023-12-01T01:08:28.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:28 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:28.478+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.738473+0000 front 2023-12-01T01:07:57.738612+0000 (oldest deadline 2023-12-01T01:08:22.438535+0000) 2023-12-01T01:08:28.930 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:28 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5[117971]: 2023-12-01T01:08:28.478+0000 7f6f725fe700 -1 osd.5 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:03.539698+0000 front 2023-12-01T01:08:03.539722+0000 (oldest deadline 2023-12-01T01:08:27.039871+0000) 2023-12-01T01:08:28.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:28 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:28.633+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:29.030 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:28 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:28.646+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:29.030 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:28 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:28.646+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:29.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:29 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:29.029+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:29.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:29 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:29.029+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.846402+0000 front 2023-12-01T01:07:57.846142+0000 (oldest deadline 2023-12-01T01:08:23.146193+0000) 2023-12-01T01:08:29.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:29 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:29.029+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:03.146806+0000 front 2023-12-01T01:08:03.146891+0000 (oldest deadline 2023-12-01T01:08:28.446894+0000) 2023-12-01T01:08:29.414 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:29 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:29.084+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:29.414 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:29 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:29.084+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:29.414 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:28 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:28.949+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:29.414 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:28 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:28.949+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:29.414 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:28 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:28.949+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:29.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:29 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:29.166+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:29.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:29 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:29.166+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:29.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:29 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:29.166+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:29.680 INFO:journalctl@ceph.osd.5.smithi116.stdout:Dec 01 01:08:29 smithi116 bash[145914]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-5 2023-12-01T01:08:29.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:29 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:29.641+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:29.992 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:29 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:29.618+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:29.992 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:29 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:29.618+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:30.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:29 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:29.990+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:30.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:29 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:29.990+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.846402+0000 front 2023-12-01T01:07:57.846142+0000 (oldest deadline 2023-12-01T01:08:23.146193+0000) 2023-12-01T01:08:30.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:29 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:29.990+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:03.146806+0000 front 2023-12-01T01:08:03.146891+0000 (oldest deadline 2023-12-01T01:08:28.446894+0000) 2023-12-01T01:08:30.431 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:30 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:30.037+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:30.431 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:30 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:30.037+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:30.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:29 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:29.933+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:30.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:29 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:29.933+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:30.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:29 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:29.933+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:30.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:30 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:30.162+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:30.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:30 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:30.162+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:30.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:30 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:30.162+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:30.858 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.5.service' 2023-12-01T01:08:30.939 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:08:30.939 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-01T01:08:30.940 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-12-01T01:08:30.940 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.6 2023-12-01T01:08:30.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:30 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:30.625+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:30.970 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:30 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:30.602+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:30.970 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:30 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:30.602+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:30.970 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:30 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:30.602+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:31.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:31 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:31.049+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:31.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:31 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:31.049+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:31.180 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:30 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:30.902+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:31.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:30 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:30.902+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:31.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:30 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:30.902+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:31.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:30 smithi026 systemd[1]: Stopping Ceph osd.6 for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:08:31.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:31 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:31.005+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:31.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:31 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:31.005+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.846402+0000 front 2023-12-01T01:07:57.846142+0000 (oldest deadline 2023-12-01T01:08:23.146193+0000) 2023-12-01T01:08:31.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:31 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:31.005+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:03.146806+0000 front 2023-12-01T01:08:03.146891+0000 (oldest deadline 2023-12-01T01:08:28.446894+0000) 2023-12-01T01:08:31.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:31 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:31.204+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:31.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:31 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:31.204+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:31.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:31 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:31.204+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:31.566 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:31 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:31.302+0000 7fbc0db50700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:08:31.566 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:31 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:31.302+0000 7fbc0db50700 -1 osd.6 87 *** Got signal Terminated *** 2023-12-01T01:08:31.566 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:31 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:31.302+0000 7fbc0db50700 -1 osd.6 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-01T01:08:31.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:31 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:31.660+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:32.023 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:31 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:31.565+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:32.024 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:31 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:31.565+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:32.024 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:31 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:31.565+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:32.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:32 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:32.022+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:32.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:32 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:32.022+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.846402+0000 front 2023-12-01T01:07:57.846142+0000 (oldest deadline 2023-12-01T01:08:23.146193+0000) 2023-12-01T01:08:32.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:32 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:32.022+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:03.146806+0000 front 2023-12-01T01:08:03.146891+0000 (oldest deadline 2023-12-01T01:08:28.446894+0000) 2023-12-01T01:08:32.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:32 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:32.091+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:32.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:32 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:32.091+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:32.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:31 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:31.935+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:32.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:31 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:31.935+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:32.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:31 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:31.935+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:32.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:32 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:32.158+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:32.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:32 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:32.158+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:32.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:32 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:32.158+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:32.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:32 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:32.518+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:32.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:32 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:32.518+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:32.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:32 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:32.518+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:32.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:32 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:32.704+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:32.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:32 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:32.704+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.419653+0000 front 2023-12-01T01:08:02.419582+0000 (oldest deadline 2023-12-01T01:08:31.820309+0000) 2023-12-01T01:08:33.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:33 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:33.042+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:33.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:33 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:33.042+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.846402+0000 front 2023-12-01T01:07:57.846142+0000 (oldest deadline 2023-12-01T01:08:23.146193+0000) 2023-12-01T01:08:33.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:33 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:33.042+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:03.146806+0000 front 2023-12-01T01:08:03.146891+0000 (oldest deadline 2023-12-01T01:08:28.446894+0000) 2023-12-01T01:08:33.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:33 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:33.098+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:33.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:33 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:33.098+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:33.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:32 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:32.947+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:33.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:32 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:32.947+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:33.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:32 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:32.947+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:33.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:33 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:33.165+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:33.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:33 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:33.165+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:33.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:33 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:33.165+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:33.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:33 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:33.481+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:33.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:33 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:33.481+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:33.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:33 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:33.481+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:33.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:33 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:33.657+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:33.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:33 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:33.657+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.419653+0000 front 2023-12-01T01:08:02.419582+0000 (oldest deadline 2023-12-01T01:08:31.820309+0000) 2023-12-01T01:08:34.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:34 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:34.119+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:34.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:34 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:34.119+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:34.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:33 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:33.955+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:34.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:33 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:33.955+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:34.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:33 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:33.955+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:34.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:34 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:34.122+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:34.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:34 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:34.122+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:34.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:34 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:34.122+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:34.470 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:34 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:34.089+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:34.470 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:34 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:34.089+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.846402+0000 front 2023-12-01T01:07:57.846142+0000 (oldest deadline 2023-12-01T01:08:23.146193+0000) 2023-12-01T01:08:34.470 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:34 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:34.089+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:03.146806+0000 front 2023-12-01T01:08:03.146891+0000 (oldest deadline 2023-12-01T01:08:28.446894+0000) 2023-12-01T01:08:34.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:34 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:34.469+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:34.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:34 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:34.469+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:34.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:34 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:34.469+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:34.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:34 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:34.655+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:34.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:34 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:34.655+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.419653+0000 front 2023-12-01T01:08:02.419582+0000 (oldest deadline 2023-12-01T01:08:31.820309+0000) 2023-12-01T01:08:35.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:35 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:35.117+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:35.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:35 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:35.117+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:35.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:34 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:34.935+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:35.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:34 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:34.935+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:35.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:34 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:34.935+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:35.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:35 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:35.149+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:35.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:35 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:35.149+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:35.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:35 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:35.149+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:35.504 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:35 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:35.072+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:35.504 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:35 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:35.072+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.846402+0000 front 2023-12-01T01:07:57.846142+0000 (oldest deadline 2023-12-01T01:08:23.146193+0000) 2023-12-01T01:08:35.504 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:35 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:35.072+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:03.146806+0000 front 2023-12-01T01:08:03.146891+0000 (oldest deadline 2023-12-01T01:08:28.446894+0000) 2023-12-01T01:08:35.504 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:35 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:35.072+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:08.447371+0000 front 2023-12-01T01:08:08.447346+0000 (oldest deadline 2023-12-01T01:08:34.347520+0000) 2023-12-01T01:08:35.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:35 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:35.502+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:35.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:35 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:35.502+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:35.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:35 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:35.502+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:35.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:35 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:35.627+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:35.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:35 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:35.627+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.419653+0000 front 2023-12-01T01:08:02.419582+0000 (oldest deadline 2023-12-01T01:08:31.820309+0000) 2023-12-01T01:08:36.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:36.036+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:47.443566+0000 front 2023-12-01T01:07:47.443531+0000 (oldest deadline 2023-12-01T01:08:12.743754+0000) 2023-12-01T01:08:36.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:36.036+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.846402+0000 front 2023-12-01T01:07:57.846142+0000 (oldest deadline 2023-12-01T01:08:23.146193+0000) 2023-12-01T01:08:36.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:36.036+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:03.146806+0000 front 2023-12-01T01:08:03.146891+0000 (oldest deadline 2023-12-01T01:08:28.446894+0000) 2023-12-01T01:08:36.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6[133302]: 2023-12-01T01:08:36.036+0000 7fbc08142700 -1 osd.6 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:08.447371+0000 front 2023-12-01T01:08:08.447346+0000 (oldest deadline 2023-12-01T01:08:34.347520+0000) 2023-12-01T01:08:36.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:36 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:36.079+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:36.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:36 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:36.079+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:36.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:35 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:35.971+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:36.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:35 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:35.971+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:36.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:35 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:35.971+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:36.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:36 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:36.175+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:36.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:36 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:36.175+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:36.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:36 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:36.175+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:36.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:36 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:36.175+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:36.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:36.461+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:36.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:36.461+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:36.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:36.461+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:36.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:36 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:36.461+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:36.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:36 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:36.582+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:36.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:36 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:36.582+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.419653+0000 front 2023-12-01T01:08:02.419582+0000 (oldest deadline 2023-12-01T01:08:31.820309+0000) 2023-12-01T01:08:36.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:36 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:36.582+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:12.921727+0000 front 2023-12-01T01:08:12.921630+0000 (oldest deadline 2023-12-01T01:08:36.421732+0000) 2023-12-01T01:08:37.296 INFO:journalctl@ceph.osd.6.smithi026.stdout:Dec 01 01:08:36 smithi026 bash[170294]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-6 2023-12-01T01:08:37.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:37 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:37.088+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:37.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:37 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:37.088+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:37.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:37 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:37.088+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:13.544186+0000 front 2023-12-01T01:08:13.544292+0000 (oldest deadline 2023-12-01T01:08:36.344900+0000) 2023-12-01T01:08:37.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:36 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:36.937+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:37.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:36 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:36.937+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:37.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:36 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:36.937+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:37.562 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:37 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:37.222+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:37.562 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:37 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:37.222+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:37.562 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:37 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:37.222+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:37.562 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:37 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:37.222+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:37.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:37 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:37.434+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:37.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:37 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:37.434+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:37.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:37 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:37.434+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:37.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:37 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:37.434+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:37.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:37 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:37.561+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:37.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:37 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:37.561+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.419653+0000 front 2023-12-01T01:08:02.419582+0000 (oldest deadline 2023-12-01T01:08:31.820309+0000) 2023-12-01T01:08:37.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:37 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:37.561+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:12.921727+0000 front 2023-12-01T01:08:12.921630+0000 (oldest deadline 2023-12-01T01:08:36.421732+0000) 2023-12-01T01:08:38.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:38 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:38.087+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:38.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:38 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:38.087+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:38.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:38 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:38.087+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:13.544186+0000 front 2023-12-01T01:08:13.544292+0000 (oldest deadline 2023-12-01T01:08:36.344900+0000) 2023-12-01T01:08:38.180 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:37 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:37.904+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:38.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:37 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:37.904+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:38.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:37 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:37.904+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:38.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:37 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:37.904+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:38.363 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.6.service' 2023-12-01T01:08:38.446 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:08:38.446 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-12-01T01:08:38.446 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-12-01T01:08:38.446 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.7 2023-12-01T01:08:38.563 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:38 smithi093 systemd[1]: Stopping Ceph osd.7 for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:08:38.563 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:38 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:38.238+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:38.563 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:38 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:38.238+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:38.563 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:38 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:38.238+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:38.563 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:38 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:38.238+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:38.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:38 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:38.445+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:38.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:38 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:38.445+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:38.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:38 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:38.445+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:38.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:38 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:38.445+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:38.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:38 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:38.560+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:38.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:38 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:38.560+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.419653+0000 front 2023-12-01T01:08:02.419582+0000 (oldest deadline 2023-12-01T01:08:31.820309+0000) 2023-12-01T01:08:38.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:38 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:38.560+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:12.921727+0000 front 2023-12-01T01:08:12.921630+0000 (oldest deadline 2023-12-01T01:08:36.421732+0000) 2023-12-01T01:08:38.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:38 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:38.796+0000 7f44d4822700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:08:38.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:38 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:38.796+0000 7f44d4822700 -1 osd.7 87 *** Got signal Terminated *** 2023-12-01T01:08:38.966 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:38 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:38.796+0000 7f44d4822700 -1 osd.7 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-01T01:08:39.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:39 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:39.075+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:39.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:39 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:39.075+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:39.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:39 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:39.075+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:13.544186+0000 front 2023-12-01T01:08:13.544292+0000 (oldest deadline 2023-12-01T01:08:36.344900+0000) 2023-12-01T01:08:39.180 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:38 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:38.890+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:39.180 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:38 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:38.890+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:39.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:38 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:38.890+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:39.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:38 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:38.890+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:39.551 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:39 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:39.286+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:39.552 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:39 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:39.286+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:39.552 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:39 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:39.286+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:39.552 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:39 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:39.286+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:39.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:39 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:39.447+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:39.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:39 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:39.447+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:39.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:39 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:39.447+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:39.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:39 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:39.447+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:39.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:39 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:39.550+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:39.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:39 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:39.550+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.419653+0000 front 2023-12-01T01:08:02.419582+0000 (oldest deadline 2023-12-01T01:08:31.820309+0000) 2023-12-01T01:08:39.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:39 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:39.550+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:12.921727+0000 front 2023-12-01T01:08:12.921630+0000 (oldest deadline 2023-12-01T01:08:36.421732+0000) 2023-12-01T01:08:40.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:40 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:40.035+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:40.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:40 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:40.035+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:40.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:40 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:40.035+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:13.544186+0000 front 2023-12-01T01:08:13.544292+0000 (oldest deadline 2023-12-01T01:08:36.344900+0000) 2023-12-01T01:08:40.180 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:39 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:39.867+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:40.180 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:39 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:39.867+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:40.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:39 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:39.867+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:40.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:39 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:39.867+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:40.715 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:40 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:40.525+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:40.715 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:40 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:40.525+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.419653+0000 front 2023-12-01T01:08:02.419582+0000 (oldest deadline 2023-12-01T01:08:31.820309+0000) 2023-12-01T01:08:40.715 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:40 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:40.525+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:12.921727+0000 front 2023-12-01T01:08:12.921630+0000 (oldest deadline 2023-12-01T01:08:36.421732+0000) 2023-12-01T01:08:40.715 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:40 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:40.304+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:40.716 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:40 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:40.304+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:40.716 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:40 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:40.304+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:40.716 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:40 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:40.304+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:40.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:40 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:40.495+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:40.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:40 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:40.495+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:40.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:40 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:40.495+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:40.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:40 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:40.495+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:41.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:41 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:41.022+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:41.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:41 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:41.022+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:41.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:41 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:41.022+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:13.544186+0000 front 2023-12-01T01:08:13.544292+0000 (oldest deadline 2023-12-01T01:08:36.344900+0000) 2023-12-01T01:08:41.180 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:40 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:40.910+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:41.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:40 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:40.910+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:41.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:40 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:40.910+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:41.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:40 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:40.910+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:41.559 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:41 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:41.283+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:41.559 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:41 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:41.283+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:41.559 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:41 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:41.283+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:41.560 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:41 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:41.283+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:41.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:41 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:41.493+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:41.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:41 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:41.493+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:41.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:41 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:41.493+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:41.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:41 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:41.493+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:41.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:41 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:41.558+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:41.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:41 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:41.558+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.419653+0000 front 2023-12-01T01:08:02.419582+0000 (oldest deadline 2023-12-01T01:08:31.820309+0000) 2023-12-01T01:08:41.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:41 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:41.558+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:12.921727+0000 front 2023-12-01T01:08:12.921630+0000 (oldest deadline 2023-12-01T01:08:36.421732+0000) 2023-12-01T01:08:42.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:42 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:42.009+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:42.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:42 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:42.009+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:42.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:42 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:42.009+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:13.544186+0000 front 2023-12-01T01:08:13.544292+0000 (oldest deadline 2023-12-01T01:08:36.344900+0000) 2023-12-01T01:08:42.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:41 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:41.939+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:42.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:41 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:41.939+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:42.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:41 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:41.939+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:42.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:41 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:41.939+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:42.519 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:42.257+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:42.519 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:42.257+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:42.519 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:42.257+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:42.519 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:42.257+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:42.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:42 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:42.480+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:42.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:42 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:42.480+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:42.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:42 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:42.480+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:42.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:42 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:42.480+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:42.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:42.517+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:42.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:42.517+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.419653+0000 front 2023-12-01T01:08:02.419582+0000 (oldest deadline 2023-12-01T01:08:31.820309+0000) 2023-12-01T01:08:42.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:42.517+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:12.921727+0000 front 2023-12-01T01:08:12.921630+0000 (oldest deadline 2023-12-01T01:08:36.421732+0000) 2023-12-01T01:08:43.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:42 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:42.965+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:43.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:42 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:42.965+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:43.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:42 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:42.965+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:13.544186+0000 front 2023-12-01T01:08:13.544292+0000 (oldest deadline 2023-12-01T01:08:36.344900+0000) 2023-12-01T01:08:43.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:42 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:42.958+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:43.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:42 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:42.958+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:43.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:42 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:42.958+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:43.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:42 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:42.958+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:43.506 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:43 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:43.224+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:43.506 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:43 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:43.224+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:43.506 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:43 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:43.224+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:43.506 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:43 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:43.224+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:43.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:43 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:43.451+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:43.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:43 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:43.451+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:43.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:43 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:43.451+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:43.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:43 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:43.451+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:43.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:43 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:43.505+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:57.317428+0000 front 2023-12-01T01:07:57.317462+0000 (oldest deadline 2023-12-01T01:08:19.017573+0000) 2023-12-01T01:08:43.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:43 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:43.505+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.419653+0000 front 2023-12-01T01:08:02.419582+0000 (oldest deadline 2023-12-01T01:08:31.820309+0000) 2023-12-01T01:08:43.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:43 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:43.505+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:12.921727+0000 front 2023-12-01T01:08:12.921630+0000 (oldest deadline 2023-12-01T01:08:36.421732+0000) 2023-12-01T01:08:43.965 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:43 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7[124962]: 2023-12-01T01:08:43.505+0000 7f44cce10700 -1 osd.7 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:21.023319+0000 front 2023-12-01T01:08:21.023299+0000 (oldest deadline 2023-12-01T01:08:43.323633+0000) 2023-12-01T01:08:44.180 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:43 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:43.922+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:44.180 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:43 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:43.922+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:44.180 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:43 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:43.922+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:44.180 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:43 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:43.922+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:44.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:43 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:43.951+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:44.181 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:43 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:43.951+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:44.181 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:43 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:43.951+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:13.544186+0000 front 2023-12-01T01:08:13.544292+0000 (oldest deadline 2023-12-01T01:08:36.344900+0000) 2023-12-01T01:08:44.465 INFO:journalctl@ceph.osd.7.smithi093.stdout:Dec 01 01:08:44 smithi093 bash[143715]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-7 2023-12-01T01:08:44.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:44 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:44.206+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:44.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:44 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:44.206+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:44.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:44 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:44.206+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:44.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:44 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:44.206+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:44.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:44 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:44.406+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:44.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:44 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:44.406+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:44.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:44 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:44.406+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:44.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:44 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:44.406+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:45.401 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:45 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:45.211+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:45.401 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:45 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:45.211+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:45.401 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:45 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:45.211+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:45.401 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:45 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:45.211+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:45.402 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:45 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:45.211+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:08:45.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:44 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:44.958+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:45.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:44 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:44.958+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:45.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:44 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:44.958+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:13.544186+0000 front 2023-12-01T01:08:13.544292+0000 (oldest deadline 2023-12-01T01:08:36.344900+0000) 2023-12-01T01:08:45.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:44 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:44.942+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:45.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:44 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:44.942+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:45.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:44 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:44.942+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:45.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:44 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:44.942+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:45.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:45 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:45.452+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:45.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:45 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:45.452+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:45.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:45 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:45.452+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:45.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:45 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:45.452+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:45.847 DEBUG:teuthology.orchestra.run.smithi093:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.7.service' 2023-12-01T01:08:45.886 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:08:45.886 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-12-01T01:08:45.886 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-12-01T01:08:45.886 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.8 2023-12-01T01:08:46.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:45 smithi116 systemd[1]: Stopping Ceph osd.8 for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:08:46.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:45 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:45.970+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:46.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:45 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:45.970+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:46.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:45 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:45.970+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:13.544186+0000 front 2023-12-01T01:08:13.544292+0000 (oldest deadline 2023-12-01T01:08:36.344900+0000) 2023-12-01T01:08:46.180 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:45 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:45.970+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.946590+0000 front 2023-12-01T01:08:20.946492+0000 (oldest deadline 2023-12-01T01:08:45.646431+0000) 2023-12-01T01:08:46.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:45 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:45.955+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:46.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:45 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:45.955+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:46.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:45 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:45.955+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:46.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:45 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:45.955+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:46.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:45 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:45.955+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:08:46.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:46 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:46.201+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:46.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:46 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:46.201+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:46.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:46 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:46.201+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:46.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:46 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:46.201+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:46.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:46 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:46.201+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:08:46.680 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:46 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:46.240+0000 7f7d7ef94700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:08:46.680 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:46 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:46.240+0000 7f7d7ef94700 -1 osd.8 87 *** Got signal Terminated *** 2023-12-01T01:08:46.680 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:46 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:46.240+0000 7f7d7ef94700 -1 osd.8 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-01T01:08:46.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:46 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:46.430+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:46.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:46 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:46.430+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:46.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:46 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:46.430+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:46.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:46 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:46.430+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:46.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:46 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:46.430+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.823245+0000 front 2023-12-01T01:08:20.823388+0000 (oldest deadline 2023-12-01T01:08:46.123196+0000) 2023-12-01T01:08:47.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:46 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:46.971+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:47.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:46 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:46.971+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:47.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:46 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:46.971+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:13.544186+0000 front 2023-12-01T01:08:13.544292+0000 (oldest deadline 2023-12-01T01:08:36.344900+0000) 2023-12-01T01:08:47.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:46 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:46.971+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.946590+0000 front 2023-12-01T01:08:20.946492+0000 (oldest deadline 2023-12-01T01:08:45.646431+0000) 2023-12-01T01:08:47.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:46 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:46.980+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:47.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:46 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:46.980+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:47.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:46 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:46.980+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:47.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:46 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:46.980+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:47.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:46 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:46.980+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:08:47.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:47 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:47.174+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:47.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:47 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:47.174+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:47.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:47 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:47.174+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:47.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:47 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:47.174+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:47.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:47 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:47.174+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:08:47.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:47 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:47.479+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:47.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:47 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:47.479+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:47.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:47 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:47.479+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:47.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:47 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:47.479+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:47.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:47 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:47.479+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.823245+0000 front 2023-12-01T01:08:20.823388+0000 (oldest deadline 2023-12-01T01:08:46.123196+0000) 2023-12-01T01:08:48.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:48 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:48.000+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:48.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:48 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:48.000+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:48.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:48 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:48.000+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:13.544186+0000 front 2023-12-01T01:08:13.544292+0000 (oldest deadline 2023-12-01T01:08:36.344900+0000) 2023-12-01T01:08:48.431 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:48 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:48.000+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.946590+0000 front 2023-12-01T01:08:20.946492+0000 (oldest deadline 2023-12-01T01:08:45.646431+0000) 2023-12-01T01:08:48.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:48 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:48.026+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:48.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:48 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:48.026+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:48.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:48 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:48.026+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:48.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:48 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:48.026+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:48.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:48 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:48.026+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:08:48.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:48 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:48.188+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:48.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:48 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:48.188+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:48.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:48 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:48.188+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:48.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:48 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:48.188+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:48.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:48 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:48.188+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:08:48.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:48 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:48.469+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:48.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:48 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:48.469+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:48.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:48 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:48.469+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:48.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:48 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:48.469+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:48.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:48 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:48.469+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.823245+0000 front 2023-12-01T01:08:20.823388+0000 (oldest deadline 2023-12-01T01:08:46.123196+0000) 2023-12-01T01:08:49.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:49 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:49.008+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:49.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:49 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:49.008+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:49.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:49 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:49.008+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:13.544186+0000 front 2023-12-01T01:08:13.544292+0000 (oldest deadline 2023-12-01T01:08:36.344900+0000) 2023-12-01T01:08:49.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:49 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:49.008+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.946590+0000 front 2023-12-01T01:08:20.946492+0000 (oldest deadline 2023-12-01T01:08:45.646431+0000) 2023-12-01T01:08:49.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:49 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:49.030+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:49.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:49 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:49.030+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:49.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:49 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:49.030+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:49.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:49 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:49.030+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:49.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:49 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:49.030+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:08:49.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:49 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:49.167+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:49.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:49 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:49.167+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:49.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:49 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:49.167+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:49.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:49 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:49.167+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:49.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:49 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:49.167+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:08:49.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:49 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:49.465+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:49.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:49 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:49.465+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:49.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:49 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:49.465+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:49.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:49 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:49.465+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:49.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:49 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:49.465+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.823245+0000 front 2023-12-01T01:08:20.823388+0000 (oldest deadline 2023-12-01T01:08:46.123196+0000) 2023-12-01T01:08:50.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:49 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:49.977+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:50.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:49 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:49.977+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:50.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:49 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:49.977+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:13.544186+0000 front 2023-12-01T01:08:13.544292+0000 (oldest deadline 2023-12-01T01:08:36.344900+0000) 2023-12-01T01:08:50.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:49 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:49.977+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.946590+0000 front 2023-12-01T01:08:20.946492+0000 (oldest deadline 2023-12-01T01:08:45.646431+0000) 2023-12-01T01:08:50.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:50 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:50.072+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:50.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:50 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:50.072+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:50.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:50 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:50.072+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:50.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:50 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:50.072+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:50.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:50 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:50.072+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:08:50.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:50 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:50.072+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:08:50.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:50 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:50.123+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:50.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:50 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:50.123+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:50.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:50 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:50.123+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:50.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:50 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:50.123+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:50.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:50 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:50.123+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:08:50.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:50 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:50.487+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:50.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:50 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:50.487+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:50.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:50 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:50.487+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:50.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:50 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:50.487+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:50.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:50 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:50.487+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.823245+0000 front 2023-12-01T01:08:20.823388+0000 (oldest deadline 2023-12-01T01:08:46.123196+0000) 2023-12-01T01:08:50.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:50 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:50.487+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.623988+0000 front 2023-12-01T01:08:26.624034+0000 (oldest deadline 2023-12-01T01:08:50.124029+0000) 2023-12-01T01:08:51.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:50 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:50.943+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:54.741907+0000 front 2023-12-01T01:07:54.741874+0000 (oldest deadline 2023-12-01T01:08:20.041833+0000) 2023-12-01T01:08:51.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:50 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:50.943+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.342793+0000 front 2023-12-01T01:08:05.342953+0000 (oldest deadline 2023-12-01T01:08:28.842972+0000) 2023-12-01T01:08:51.430 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:50 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:50.943+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:13.544186+0000 front 2023-12-01T01:08:13.544292+0000 (oldest deadline 2023-12-01T01:08:36.344900+0000) 2023-12-01T01:08:51.431 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:50 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8[126710]: 2023-12-01T01:08:50.943+0000 7f7d79586700 -1 osd.8 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.946590+0000 front 2023-12-01T01:08:20.946492+0000 (oldest deadline 2023-12-01T01:08:45.646431+0000) 2023-12-01T01:08:51.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:51 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:51.041+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:51.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:51 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:51.041+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:51.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:51 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:51.041+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:51.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:51 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:51.041+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:51.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:51 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:51.041+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:08:51.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:51 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:51.041+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:08:51.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:51 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:51.152+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:51.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:51 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:51.152+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:51.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:51 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:51.153+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:51.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:51 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:51.153+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:51.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:51 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:51.153+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:08:51.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:51 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:51.153+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.678282+0000 front 2023-12-01T01:08:26.678211+0000 (oldest deadline 2023-12-01T01:08:50.178077+0000) 2023-12-01T01:08:51.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:51 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:51.517+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:51.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:51 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:51.517+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:51.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:51 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:51.517+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:51.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:51 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:51.517+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:51.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:51 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:51.517+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.823245+0000 front 2023-12-01T01:08:20.823388+0000 (oldest deadline 2023-12-01T01:08:46.123196+0000) 2023-12-01T01:08:51.796 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:51 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:51.517+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.623988+0000 front 2023-12-01T01:08:26.624034+0000 (oldest deadline 2023-12-01T01:08:50.124029+0000) 2023-12-01T01:08:52.023 INFO:journalctl@ceph.osd.8.smithi116.stdout:Dec 01 01:08:51 smithi116 bash[146185]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-8 2023-12-01T01:08:52.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:52 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:52.045+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:52.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:52 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:52.045+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:52.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:52 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:52.045+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:52.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:52 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:52.045+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:52.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:52 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:52.045+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:08:52.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:52 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:52.045+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:08:52.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:52 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:52.134+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:52.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:52 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:52.134+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:52.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:52 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:52.134+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:52.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:52 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:52.134+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:52.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:52 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:52.134+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:08:52.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:52 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:52.134+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.678282+0000 front 2023-12-01T01:08:26.678211+0000 (oldest deadline 2023-12-01T01:08:50.178077+0000) 2023-12-01T01:08:53.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:52 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:52.553+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:53.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:52 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:52.553+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:53.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:52 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:52.553+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:53.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:52 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:52.553+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:53.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:52 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:52.553+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.823245+0000 front 2023-12-01T01:08:20.823388+0000 (oldest deadline 2023-12-01T01:08:46.123196+0000) 2023-12-01T01:08:53.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:52 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:52.553+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.623988+0000 front 2023-12-01T01:08:26.624034+0000 (oldest deadline 2023-12-01T01:08:50.124029+0000) 2023-12-01T01:08:53.180 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:53 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:53.078+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:53.180 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:53 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:53.078+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:53.180 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:53 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:53.078+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:53.180 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:53 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:53.078+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:53.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:53 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:53.078+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:08:53.181 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:53 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:53.078+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:08:53.287 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.8.service' 2023-12-01T01:08:53.328 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:08:53.328 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-12-01T01:08:53.328 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-12-01T01:08:53.329 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.9 2023-12-01T01:08:53.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:53 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:53.107+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:53.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:53 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:53.107+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:53.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:53 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:53.107+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:53.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:53 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:53.107+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:53.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:53 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:53.107+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:08:53.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:53 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:53.107+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.678282+0000 front 2023-12-01T01:08:26.678211+0000 (oldest deadline 2023-12-01T01:08:50.178077+0000) 2023-12-01T01:08:53.701 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:53 smithi026 systemd[1]: Stopping Ceph osd.9 for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:08:53.702 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:53 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:53.570+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:53.702 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:53 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:53.570+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:53.702 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:53 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:53.570+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:53.702 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:53 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:53.570+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:53.702 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:53 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:53.570+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.823245+0000 front 2023-12-01T01:08:20.823388+0000 (oldest deadline 2023-12-01T01:08:46.123196+0000) 2023-12-01T01:08:53.702 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:53 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:53.570+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.623988+0000 front 2023-12-01T01:08:26.624034+0000 (oldest deadline 2023-12-01T01:08:50.124029+0000) 2023-12-01T01:08:53.703 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:53 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:53.700+0000 7ffa35335700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:08:54.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:53 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:53.700+0000 7ffa35335700 -1 osd.9 87 *** Got signal Terminated *** 2023-12-01T01:08:54.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:53 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:53.700+0000 7ffa35335700 -1 osd.9 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-01T01:08:54.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:54 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:54.067+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:54.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:54 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:54.067+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:54.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:54 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:54.067+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:54.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:54 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:54.067+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:54.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:54 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:54.067+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:08:54.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:54 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:54.067+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:08:54.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:54 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:54.058+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:54.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:54 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:54.058+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:54.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:54 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:54.058+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:54.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:54 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:54.058+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:54.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:54 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:54.058+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:08:54.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:54 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:54.058+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.678282+0000 front 2023-12-01T01:08:26.678211+0000 (oldest deadline 2023-12-01T01:08:50.178077+0000) 2023-12-01T01:08:55.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:54 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:54.609+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:55.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:54 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:54.609+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:55.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:54 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:54.609+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:55.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:54 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:54.609+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:55.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:54 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:54.609+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.823245+0000 front 2023-12-01T01:08:20.823388+0000 (oldest deadline 2023-12-01T01:08:46.123196+0000) 2023-12-01T01:08:55.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:54 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:54.609+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.623988+0000 front 2023-12-01T01:08:26.624034+0000 (oldest deadline 2023-12-01T01:08:50.124029+0000) 2023-12-01T01:08:55.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:55 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:55.088+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:55.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:55 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:55.088+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:55.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:55 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:55.088+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:55.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:55 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:55.088+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:55.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:55 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:55.088+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:08:55.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:55 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:55.088+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:08:55.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:55 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:55.054+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:55.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:55 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:55.054+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:55.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:55 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:55.054+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:55.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:55 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:55.054+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:55.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:55 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:55.054+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:08:55.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:55 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:55.054+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.678282+0000 front 2023-12-01T01:08:26.678211+0000 (oldest deadline 2023-12-01T01:08:50.178077+0000) 2023-12-01T01:08:56.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:55 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:55.626+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:56.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:55 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:55.626+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:56.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:55 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:55.626+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:56.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:55 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:55.626+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:56.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:55 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:55.626+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.823245+0000 front 2023-12-01T01:08:20.823388+0000 (oldest deadline 2023-12-01T01:08:46.123196+0000) 2023-12-01T01:08:56.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:55 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:55.626+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.623988+0000 front 2023-12-01T01:08:26.624034+0000 (oldest deadline 2023-12-01T01:08:50.124029+0000) 2023-12-01T01:08:56.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:56 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:56.049+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:56.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:56 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:56.049+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:56.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:56 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:56.049+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:56.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:56 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:56.049+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:56.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:56 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:56.049+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:08:56.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:56 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:56.049+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:08:56.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:56 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:56.037+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:56.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:56 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:56.037+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:56.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:56 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:56.037+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:56.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:56 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:56.037+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:56.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:56 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:56.037+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:08:56.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:56 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:56.037+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.678282+0000 front 2023-12-01T01:08:26.678211+0000 (oldest deadline 2023-12-01T01:08:50.178077+0000) 2023-12-01T01:08:57.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:56 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:56.661+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:57.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:56 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:56.661+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:57.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:56 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:56.661+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:57.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:56 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:56.661+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:57.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:56 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:56.661+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.823245+0000 front 2023-12-01T01:08:20.823388+0000 (oldest deadline 2023-12-01T01:08:46.123196+0000) 2023-12-01T01:08:57.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:56 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:56.661+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.623988+0000 front 2023-12-01T01:08:26.624034+0000 (oldest deadline 2023-12-01T01:08:50.124029+0000) 2023-12-01T01:08:57.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:57 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:57.053+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:57.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:57 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:57.053+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:57.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:57 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:57.053+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:57.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:57 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:57.053+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:57.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:57 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:57.053+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:08:57.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:57 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:57.053+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:08:57.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:57 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:57.085+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:57.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:57 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:57.085+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:57.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:57 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:57.085+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:57.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:57 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:57.085+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:57.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:57 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:57.085+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:08:57.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:57 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:57.085+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.678282+0000 front 2023-12-01T01:08:26.678211+0000 (oldest deadline 2023-12-01T01:08:50.178077+0000) 2023-12-01T01:08:58.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:57 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:57.630+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:58.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:57 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:57.630+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:58.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:57 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:57.630+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:58.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:57 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:57.630+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:58.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:57 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:57.630+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.823245+0000 front 2023-12-01T01:08:20.823388+0000 (oldest deadline 2023-12-01T01:08:46.123196+0000) 2023-12-01T01:08:58.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:57 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:57.630+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.623988+0000 front 2023-12-01T01:08:26.624034+0000 (oldest deadline 2023-12-01T01:08:50.124029+0000) 2023-12-01T01:08:58.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:58.011+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:58.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:58.011+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:58.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:58.011+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:58.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:58.011+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:58.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:58.011+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:08:58.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:58 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:58.011+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:08:58.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:58 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:58.054+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:58.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:58 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:58.054+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:58.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:58 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:58.054+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:58.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:58 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:58.054+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:58.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:58 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:58.054+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:08:58.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:58 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:58.054+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.678282+0000 front 2023-12-01T01:08:26.678211+0000 (oldest deadline 2023-12-01T01:08:50.178077+0000) 2023-12-01T01:08:59.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:58 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:58.614+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.417476+0000 front 2023-12-01T01:07:46.417503+0000 (oldest deadline 2023-12-01T01:08:15.218152+0000) 2023-12-01T01:08:59.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:58 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:58.614+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.218619+0000 front 2023-12-01T01:07:55.218804+0000 (oldest deadline 2023-12-01T01:08:21.118740+0000) 2023-12-01T01:08:59.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:58 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:58.614+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:05.021196+0000 front 2023-12-01T01:08:05.021304+0000 (oldest deadline 2023-12-01T01:08:29.721300+0000) 2023-12-01T01:08:59.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:58 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:58.614+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:09.721633+0000 front 2023-12-01T01:08:09.721751+0000 (oldest deadline 2023-12-01T01:08:35.621776+0000) 2023-12-01T01:08:59.046 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:58 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:58.614+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.823245+0000 front 2023-12-01T01:08:20.823388+0000 (oldest deadline 2023-12-01T01:08:46.123196+0000) 2023-12-01T01:08:59.047 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:58 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9[141366]: 2023-12-01T01:08:58.614+0000 7ffa3192b700 -1 osd.9 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.623988+0000 front 2023-12-01T01:08:26.624034+0000 (oldest deadline 2023-12-01T01:08:50.124029+0000) 2023-12-01T01:08:59.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:59 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:59.010+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:08:59.468 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:59 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:59.010+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:08:59.468 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:59 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:59.010+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:08:59.468 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:59 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:59.010+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:08:59.468 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:59 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:59.010+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:08:59.468 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:08:59 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:08:59.010+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:08:59.469 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:59 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:59.052+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:08:59.469 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:59 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:59.052+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:08:59.469 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:59 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:59.052+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:08:59.469 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:59 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:59.052+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:08:59.469 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:59 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:59.052+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:08:59.469 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:08:59 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:08:59.052+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.678282+0000 front 2023-12-01T01:08:26.678211+0000 (oldest deadline 2023-12-01T01:08:50.178077+0000) 2023-12-01T01:08:59.797 INFO:journalctl@ceph.osd.9.smithi026.stdout:Dec 01 01:08:59 smithi026 bash[170572]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-9 2023-12-01T01:09:00.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:00 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:00.044+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:09:00.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:00 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:00.044+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:09:00.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:00 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:00.044+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:09:00.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:00 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:00.044+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:09:00.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:00 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:00.044+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:09:00.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:00 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:00.044+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:09:00.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:00 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:00.014+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:09:00.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:00 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:00.014+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:09:00.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:00 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:00.014+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:09:00.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:00 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:00.014+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:09:00.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:00 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:00.014+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:09:00.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:00 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:00.014+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.678282+0000 front 2023-12-01T01:08:26.678211+0000 (oldest deadline 2023-12-01T01:08:50.178077+0000) 2023-12-01T01:09:00.780 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.9.service' 2023-12-01T01:09:00.820 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:09:00.821 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-12-01T01:09:00.821 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-12-01T01:09:00.821 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.10 2023-12-01T01:09:01.177 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:00 smithi093 systemd[1]: Stopping Ceph osd.10 for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:09:01.177 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:01.028+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:09:01.178 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:01.028+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:09:01.178 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:01.028+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:09:01.178 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:01.028+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:09:01.178 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:01.028+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:09:01.178 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:01.028+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.678282+0000 front 2023-12-01T01:08:26.678211+0000 (oldest deadline 2023-12-01T01:08:50.178077+0000) 2023-12-01T01:09:01.178 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:01.175+0000 7fb4daf89700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:09:01.178 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:01.175+0000 7fb4daf89700 -1 osd.10 87 *** Got signal Terminated *** 2023-12-01T01:09:01.178 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:01.175+0000 7fb4daf89700 -1 osd.10 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-01T01:09:01.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:01 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:01.088+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:09:01.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:01 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:01.088+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:09:01.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:01 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:01.088+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:09:01.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:01 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:01.088+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:09:01.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:01 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:01.088+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:09:01.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:01 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:01.088+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:09:02.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:02 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:02.085+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:09:02.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:02 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:02.085+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:09:02.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:02 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:02.085+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:09:02.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:02 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:02.085+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:09:02.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:02 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:02.085+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:09:02.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:02 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:02.085+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:09:02.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:01.987+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:09:02.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:01.987+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:09:02.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:01.987+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:09:02.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:01.987+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:09:02.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:01.987+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:09:02.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:01.987+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.678282+0000 front 2023-12-01T01:08:26.678211+0000 (oldest deadline 2023-12-01T01:08:50.178077+0000) 2023-12-01T01:09:02.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:01 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:01.987+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6822 osd.6 since back 2023-12-01T01:08:35.979441+0000 front 2023-12-01T01:08:35.979509+0000 (oldest deadline 2023-12-01T01:09:01.879416+0000) 2023-12-01T01:09:03.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:03 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:03.039+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:09:03.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:03 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:03.039+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:09:03.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:03 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:03.039+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:09:03.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:03 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:03.039+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:09:03.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:03 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:03.039+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:09:03.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:03 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:03.039+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:09:03.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:02 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:02.983+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:09:03.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:02 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:02.983+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:09:03.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:02 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:02.983+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:09:03.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:02 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:02.983+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:09:03.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:02 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:02.983+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:09:03.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:02 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:02.983+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.678282+0000 front 2023-12-01T01:08:26.678211+0000 (oldest deadline 2023-12-01T01:08:50.178077+0000) 2023-12-01T01:09:03.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:02 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:02.983+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6822 osd.6 since back 2023-12-01T01:08:35.979441+0000 front 2023-12-01T01:08:35.979509+0000 (oldest deadline 2023-12-01T01:09:01.879416+0000) 2023-12-01T01:09:04.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:04 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:04.024+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:09:04.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:04 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:04.024+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:09:04.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:04 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:04.024+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:09:04.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:04 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:04.024+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:09:04.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:04 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:04.024+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:09:04.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:04 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:04.024+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:09:04.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:04 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:04.024+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:09:04.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:04 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:04.024+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:09:04.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:04 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:04.024+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:09:04.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:04 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:04.024+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:09:04.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:04 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:04.024+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:09:04.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:04 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:04.024+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.678282+0000 front 2023-12-01T01:08:26.678211+0000 (oldest deadline 2023-12-01T01:08:50.178077+0000) 2023-12-01T01:09:04.466 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:04 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:04.024+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6822 osd.6 since back 2023-12-01T01:08:35.979441+0000 front 2023-12-01T01:08:35.979509+0000 (oldest deadline 2023-12-01T01:09:01.879416+0000) 2023-12-01T01:09:05.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:05 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:05.033+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:09:05.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:05 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:05.033+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:09:05.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:05 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:05.033+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:09:05.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:05 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:05.033+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:09:05.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:05 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:05.033+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:09:05.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:05 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:05.033+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:09:05.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:05 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:05.033+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6820 osd.7 since back 2023-12-01T01:08:40.907929+0000 front 2023-12-01T01:08:40.908000+0000 (oldest deadline 2023-12-01T01:09:04.407811+0000) 2023-12-01T01:09:05.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:05 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:05.010+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:09:05.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:05 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:05.010+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:09:05.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:05 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:05.010+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:09:05.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:05 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:05.010+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:09:05.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:05 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:05.010+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:09:05.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:05 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:05.010+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.678282+0000 front 2023-12-01T01:08:26.678211+0000 (oldest deadline 2023-12-01T01:08:50.178077+0000) 2023-12-01T01:09:05.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:05 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:05.010+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6822 osd.6 since back 2023-12-01T01:08:35.979441+0000 front 2023-12-01T01:08:35.979509+0000 (oldest deadline 2023-12-01T01:09:01.879416+0000) 2023-12-01T01:09:06.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:06 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:06.076+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:09:06.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:06 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:06.076+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:09:06.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:06 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:06.076+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:09:06.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:06 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:06.076+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:09:06.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:06 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:06.076+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:09:06.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:06 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:06.076+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:09:06.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:06 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:06.076+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6820 osd.7 since back 2023-12-01T01:08:40.907929+0000 front 2023-12-01T01:08:40.908000+0000 (oldest deadline 2023-12-01T01:09:04.407811+0000) 2023-12-01T01:09:06.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:06 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:06.005+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.069266+0000 front 2023-12-01T01:07:46.069390+0000 (oldest deadline 2023-12-01T01:08:11.369478+0000) 2023-12-01T01:09:06.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:06 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:06.005+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:56.571361+0000 front 2023-12-01T01:07:56.571393+0000 (oldest deadline 2023-12-01T01:08:18.871497+0000) 2023-12-01T01:09:06.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:06 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:06.005+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:02.372495+0000 front 2023-12-01T01:08:02.372518+0000 (oldest deadline 2023-12-01T01:08:27.072687+0000) 2023-12-01T01:09:06.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:06 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:06.005+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.074787+0000 front 2023-12-01T01:08:11.074707+0000 (oldest deadline 2023-12-01T01:08:35.774667+0000) 2023-12-01T01:09:06.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:06 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:06.005+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.376120+0000 front 2023-12-01T01:08:20.376138+0000 (oldest deadline 2023-12-01T01:08:44.377005+0000) 2023-12-01T01:09:06.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:06 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:06.005+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:26.678282+0000 front 2023-12-01T01:08:26.678211+0000 (oldest deadline 2023-12-01T01:08:50.178077+0000) 2023-12-01T01:09:06.465 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:06 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10[132992]: 2023-12-01T01:09:06.005+0000 7fb4d757f700 -1 osd.10 87 heartbeat_check: no reply from 172.21.15.26:6822 osd.6 since back 2023-12-01T01:08:35.979441+0000 front 2023-12-01T01:08:35.979509+0000 (oldest deadline 2023-12-01T01:09:01.879416+0000) 2023-12-01T01:09:06.957 INFO:journalctl@ceph.osd.10.smithi093.stdout:Dec 01 01:09:06 smithi093 bash[143976]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-10 2023-12-01T01:09:07.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:07 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:07.050+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:09:07.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:07 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:07.050+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:09:07.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:07 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:07.050+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:09:07.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:07 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:07.050+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:09:07.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:07 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:07.050+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:09:07.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:07 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:07.050+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:09:07.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:07 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:07.050+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6820 osd.7 since back 2023-12-01T01:08:40.907929+0000 front 2023-12-01T01:08:40.908000+0000 (oldest deadline 2023-12-01T01:09:04.407811+0000) 2023-12-01T01:09:08.218 DEBUG:teuthology.orchestra.run.smithi093:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.10.service' 2023-12-01T01:09:08.257 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:09:08.258 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-12-01T01:09:08.258 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-12-01T01:09:08.258 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.11 2023-12-01T01:09:08.289 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:08 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:08.035+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:09:08.289 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:08 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:08.035+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:09:08.289 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:08 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:08.035+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:09:08.289 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:08 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:08.035+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:09:08.289 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:08 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:08.035+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:09:08.289 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:08 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:08.035+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:09:08.289 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:08 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:08.035+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6820 osd.7 since back 2023-12-01T01:08:40.907929+0000 front 2023-12-01T01:08:40.908000+0000 (oldest deadline 2023-12-01T01:09:04.407811+0000) 2023-12-01T01:09:08.614 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:08 smithi116 systemd[1]: Stopping Ceph osd.11 for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:09:08.930 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:08 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:08.613+0000 7feb0a5a4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:09:08.930 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:08 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:08.613+0000 7feb0a5a4700 -1 osd.11 87 *** Got signal Terminated *** 2023-12-01T01:09:08.930 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:08 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:08.613+0000 7feb0a5a4700 -1 osd.11 87 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-01T01:09:09.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:09 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:09.028+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:09:09.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:09 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:09.028+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:09:09.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:09 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:09.028+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:09:09.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:09 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:09.028+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:09:09.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:09 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:09.028+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:09:09.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:09 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:09.028+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:09:09.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:09 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:09.028+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6820 osd.7 since back 2023-12-01T01:08:40.907929+0000 front 2023-12-01T01:08:40.908000+0000 (oldest deadline 2023-12-01T01:09:04.407811+0000) 2023-12-01T01:09:10.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:10 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:10.001+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:09:10.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:10 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:10.001+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:09:10.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:10 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:10.001+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:09:10.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:10 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:10.001+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:09:10.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:10 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:10.001+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:09:10.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:10 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:10.001+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:09:10.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:10 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:10.001+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6820 osd.7 since back 2023-12-01T01:08:40.907929+0000 front 2023-12-01T01:08:40.908000+0000 (oldest deadline 2023-12-01T01:09:04.407811+0000) 2023-12-01T01:09:11.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:10 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:10.990+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:09:11.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:10 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:10.990+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:09:11.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:10 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:10.990+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:09:11.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:10 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:10.990+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:09:11.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:10 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:10.990+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:09:11.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:10 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:10.990+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:09:11.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:10 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:10.990+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6820 osd.7 since back 2023-12-01T01:08:40.907929+0000 front 2023-12-01T01:08:40.908000+0000 (oldest deadline 2023-12-01T01:09:04.407811+0000) 2023-12-01T01:09:12.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:11 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:11.990+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:09:12.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:11 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:11.990+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:09:12.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:11 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:11.990+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:09:12.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:11 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:11.990+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:09:12.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:11 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:11.990+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:09:12.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:11 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:11.990+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:09:12.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:11 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:11.990+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6820 osd.7 since back 2023-12-01T01:08:40.907929+0000 front 2023-12-01T01:08:40.908000+0000 (oldest deadline 2023-12-01T01:09:04.407811+0000) 2023-12-01T01:09:13.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:12 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:12.952+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6806 osd.0 since back 2023-12-01T01:07:46.099017+0000 front 2023-12-01T01:07:46.098988+0000 (oldest deadline 2023-12-01T01:08:11.398994+0000) 2023-12-01T01:09:13.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:12 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:12.952+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6804 osd.1 since back 2023-12-01T01:07:55.500263+0000 front 2023-12-01T01:07:55.500051+0000 (oldest deadline 2023-12-01T01:08:21.400029+0000) 2023-12-01T01:09:13.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:12 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:12.952+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6804 osd.2 since back 2023-12-01T01:08:04.201654+0000 front 2023-12-01T01:08:04.201724+0000 (oldest deadline 2023-12-01T01:08:28.301804+0000) 2023-12-01T01:09:13.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:12 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:12.952+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.26:6814 osd.3 since back 2023-12-01T01:08:11.203205+0000 front 2023-12-01T01:08:11.203023+0000 (oldest deadline 2023-12-01T01:08:37.003674+0000) 2023-12-01T01:09:13.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:12 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:12.952+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6812 osd.4 since back 2023-12-01T01:08:20.405275+0000 front 2023-12-01T01:08:20.405361+0000 (oldest deadline 2023-12-01T01:08:45.105217+0000) 2023-12-01T01:09:13.430 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:12 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:12.952+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6812 osd.5 since back 2023-12-01T01:08:25.105586+0000 front 2023-12-01T01:08:25.105616+0000 (oldest deadline 2023-12-01T01:08:49.205711+0000) 2023-12-01T01:09:13.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:12 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:12.952+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.93:6820 osd.7 since back 2023-12-01T01:08:40.907929+0000 front 2023-12-01T01:08:40.908000+0000 (oldest deadline 2023-12-01T01:09:04.407811+0000) 2023-12-01T01:09:13.431 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:12 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11[134921]: 2023-12-01T01:09:12.952+0000 7feb05b98700 -1 osd.11 87 heartbeat_check: no reply from 172.21.15.116:6820 osd.8 since back 2023-12-01T01:08:50.308665+0000 front 2023-12-01T01:08:50.308683+0000 (oldest deadline 2023-12-01T01:09:12.509262+0000) 2023-12-01T01:09:14.297 INFO:journalctl@ceph.osd.11.smithi116.stdout:Dec 01 01:09:14 smithi116 bash[146455]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-osd-11 2023-12-01T01:09:15.565 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@osd.11.service' 2023-12-01T01:09:15.644 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:09:15.644 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-12-01T01:09:15.644 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-12-01T01:09:15.645 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.a 2023-12-01T01:09:16.014 INFO:journalctl@ceph.mds.a.smithi026.stdout:Dec 01 01:09:15 smithi026 systemd[1]: Stopping Ceph mds.a for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:09:16.296 INFO:journalctl@ceph.mds.a.smithi026.stdout:Dec 01 01:09:16 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-a[149952]: 2023-12-01T01:09:16.012+0000 7ff2f19ef700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:09:16.296 INFO:journalctl@ceph.mds.a.smithi026.stdout:Dec 01 01:09:16 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-a[149952]: 2023-12-01T01:09:16.013+0000 7ff2f19ef700 -1 mds.a *** got signal Terminated *** 2023-12-01T01:09:19.296 INFO:journalctl@ceph.mds.a.smithi026.stdout:Dec 01 01:09:18 smithi026 bash[170845]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-a 2023-12-01T01:09:19.365 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.a.service' 2023-12-01T01:09:19.402 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:09:19.403 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-12-01T01:09:19.403 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-12-01T01:09:19.403 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.d 2023-12-01T01:09:19.779 INFO:journalctl@ceph.mds.d.smithi026.stdout:Dec 01 01:09:19 smithi026 systemd[1]: Stopping Ceph mds.d for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:09:20.046 INFO:journalctl@ceph.mds.d.smithi026.stdout:Dec 01 01:09:19 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-d[148998]: 2023-12-01T01:09:19.777+0000 7fc62ea28700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:09:20.046 INFO:journalctl@ceph.mds.d.smithi026.stdout:Dec 01 01:09:19 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-d[148998]: 2023-12-01T01:09:19.777+0000 7fc62ea28700 -1 mds.d *** got signal Terminated *** 2023-12-01T01:09:24.248 INFO:journalctl@ceph.mds.d.smithi026.stdout:Dec 01 01:09:24 smithi026 bash[170995]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-d 2023-12-01T01:09:24.255 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.d.service' 2023-12-01T01:09:24.290 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:09:24.290 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-12-01T01:09:24.291 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-12-01T01:09:24.291 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.g 2023-12-01T01:09:24.546 INFO:journalctl@ceph.mds.g.smithi026.stdout:Dec 01 01:09:24 smithi026 systemd[1]: Stopping Ceph mds.g for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:09:25.046 INFO:journalctl@ceph.mds.g.smithi026.stdout:Dec 01 01:09:24 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-g[149589]: 2023-12-01T01:09:24.677+0000 7f1a54750700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:09:25.046 INFO:journalctl@ceph.mds.g.smithi026.stdout:Dec 01 01:09:24 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-g[149589]: 2023-12-01T01:09:24.677+0000 7f1a54750700 -1 mds.g *** got signal Terminated *** 2023-12-01T01:09:28.796 INFO:journalctl@ceph.mds.g.smithi026.stdout:Dec 01 01:09:28 smithi026 bash[171136]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-g 2023-12-01T01:09:28.818 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.g.service' 2023-12-01T01:09:28.853 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:09:28.853 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-12-01T01:09:28.853 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-12-01T01:09:28.853 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.j 2023-12-01T01:09:29.227 INFO:journalctl@ceph.mds.j.smithi026.stdout:Dec 01 01:09:28 smithi026 systemd[1]: Stopping Ceph mds.j for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:09:29.546 INFO:journalctl@ceph.mds.j.smithi026.stdout:Dec 01 01:09:29 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-j[148609]: 2023-12-01T01:09:29.225+0000 7fad829ea700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:09:29.546 INFO:journalctl@ceph.mds.j.smithi026.stdout:Dec 01 01:09:29 smithi026 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-j[148609]: 2023-12-01T01:09:29.225+0000 7fad829ea700 -1 mds.j *** got signal Terminated *** 2023-12-01T01:09:33.704 INFO:journalctl@ceph.mds.j.smithi026.stdout:Dec 01 01:09:33 smithi026 bash[171280]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-j 2023-12-01T01:09:33.709 DEBUG:teuthology.orchestra.run.smithi026:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.j.service' 2023-12-01T01:09:33.744 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:09:33.744 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-12-01T01:09:33.744 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-12-01T01:09:33.744 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.b 2023-12-01T01:09:34.106 INFO:journalctl@ceph.mds.b.smithi093.stdout:Dec 01 01:09:33 smithi093 systemd[1]: Stopping Ceph mds.b for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:09:34.466 INFO:journalctl@ceph.mds.b.smithi093.stdout:Dec 01 01:09:34 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-b[139375]: 2023-12-01T01:09:34.104+0000 7f4b0f6f2700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:09:34.466 INFO:journalctl@ceph.mds.b.smithi093.stdout:Dec 01 01:09:34 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-b[139375]: 2023-12-01T01:09:34.104+0000 7f4b0f6f2700 -1 mds.b *** got signal Terminated *** 2023-12-01T01:09:36.567 INFO:journalctl@ceph.mds.b.smithi093.stdout:Dec 01 01:09:36 smithi093 bash[144246]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-b 2023-12-01T01:09:36.753 DEBUG:teuthology.orchestra.run.smithi093:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.b.service' 2023-12-01T01:09:36.789 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:09:36.790 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-12-01T01:09:36.790 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-12-01T01:09:36.790 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.e 2023-12-01T01:09:37.172 INFO:journalctl@ceph.mds.e.smithi093.stdout:Dec 01 01:09:36 smithi093 systemd[1]: Stopping Ceph mds.e for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:09:37.465 INFO:journalctl@ceph.mds.e.smithi093.stdout:Dec 01 01:09:37 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-e[138696]: 2023-12-01T01:09:37.170+0000 7fbf01fd4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:09:37.465 INFO:journalctl@ceph.mds.e.smithi093.stdout:Dec 01 01:09:37 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-e[138696]: 2023-12-01T01:09:37.170+0000 7fbf01fd4700 -1 mds.e *** got signal Terminated *** 2023-12-01T01:09:41.697 INFO:journalctl@ceph.mds.e.smithi093.stdout:Dec 01 01:09:41 smithi093 bash[144387]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-e 2023-12-01T01:09:41.703 DEBUG:teuthology.orchestra.run.smithi093:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.e.service' 2023-12-01T01:09:41.736 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:09:41.736 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-12-01T01:09:41.736 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-12-01T01:09:41.736 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.h 2023-12-01T01:09:41.965 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:09:41 smithi093 systemd[1]: Stopping Ceph mds.h for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:09:42.465 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:09:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[141459]: 2023-12-01T01:09:42.103+0000 7fe1ade84700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:09:42.465 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:09:42 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h[141459]: 2023-12-01T01:09:42.103+0000 7fe1ade84700 -1 mds.h *** got signal Terminated *** 2023-12-01T01:09:44.575 INFO:journalctl@ceph.mds.h.smithi093.stdout:Dec 01 01:09:44 smithi093 bash[144534]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-h 2023-12-01T01:09:44.762 DEBUG:teuthology.orchestra.run.smithi093:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.h.service' 2023-12-01T01:09:44.796 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:09:44.797 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-12-01T01:09:44.797 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-12-01T01:09:44.797 DEBUG:teuthology.orchestra.run.smithi093:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.k 2023-12-01T01:09:45.186 INFO:journalctl@ceph.mds.k.smithi093.stdout:Dec 01 01:09:44 smithi093 systemd[1]: Stopping Ceph mds.k for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:09:45.465 INFO:journalctl@ceph.mds.k.smithi093.stdout:Dec 01 01:09:45 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-k[138349]: 2023-12-01T01:09:45.184+0000 7fb918d82700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:09:45.465 INFO:journalctl@ceph.mds.k.smithi093.stdout:Dec 01 01:09:45 smithi093 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-k[138349]: 2023-12-01T01:09:45.184+0000 7fb918d82700 -1 mds.k *** got signal Terminated *** 2023-12-01T01:09:47.965 INFO:journalctl@ceph.mds.k.smithi093.stdout:Dec 01 01:09:47 smithi093 bash[144674]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-k 2023-12-01T01:09:48.043 DEBUG:teuthology.orchestra.run.smithi093:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.k.service' 2023-12-01T01:09:48.076 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:09:48.077 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-12-01T01:09:48.077 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-12-01T01:09:48.077 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.c 2023-12-01T01:09:48.430 INFO:journalctl@ceph.mds.c.smithi116.stdout:Dec 01 01:09:48 smithi116 systemd[1]: Stopping Ceph mds.c for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:09:48.930 INFO:journalctl@ceph.mds.c.smithi116.stdout:Dec 01 01:09:48 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-c[141641]: 2023-12-01T01:09:48.432+0000 7f321ccfd700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:09:48.930 INFO:journalctl@ceph.mds.c.smithi116.stdout:Dec 01 01:09:48 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-c[141641]: 2023-12-01T01:09:48.432+0000 7f321ccfd700 -1 mds.c *** got signal Terminated *** 2023-12-01T01:09:52.680 INFO:journalctl@ceph.mds.c.smithi116.stdout:Dec 01 01:09:52 smithi116 bash[146718]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-c 2023-12-01T01:09:52.686 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.c.service' 2023-12-01T01:09:52.722 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:09:52.722 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-12-01T01:09:52.722 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-12-01T01:09:52.723 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.f 2023-12-01T01:09:53.099 INFO:journalctl@ceph.mds.f.smithi116.stdout:Dec 01 01:09:52 smithi116 systemd[1]: Stopping Ceph mds.f for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:09:53.430 INFO:journalctl@ceph.mds.f.smithi116.stdout:Dec 01 01:09:53 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-f[141301]: 2023-12-01T01:09:53.097+0000 7f45d9488700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:09:53.430 INFO:journalctl@ceph.mds.f.smithi116.stdout:Dec 01 01:09:53 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-f[141301]: 2023-12-01T01:09:53.097+0000 7f45d9488700 -1 mds.f *** got signal Terminated *** 2023-12-01T01:09:56.566 INFO:journalctl@ceph.mds.f.smithi116.stdout:Dec 01 01:09:56 smithi116 bash[146856]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-f 2023-12-01T01:09:56.754 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.f.service' 2023-12-01T01:09:56.787 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:09:56.787 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-12-01T01:09:56.787 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-12-01T01:09:56.788 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.i 2023-12-01T01:09:57.165 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:09:56 smithi116 systemd[1]: Stopping Ceph mds.i for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:09:57.430 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:09:57 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:09:57.164+0000 7f90f07bf700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:09:57.430 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:09:57 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i[141981]: 2023-12-01T01:09:57.164+0000 7f90f07bf700 -1 mds.i *** got signal Terminated *** 2023-12-01T01:10:00.563 INFO:journalctl@ceph.mds.i.smithi116.stdout:Dec 01 01:10:00 smithi116 bash[146995]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-i 2023-12-01T01:10:00.750 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.i.service' 2023-12-01T01:10:00.786 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:10:00.786 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-12-01T01:10:00.786 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-12-01T01:10:00.787 DEBUG:teuthology.orchestra.run.smithi116:> sudo systemctl stop ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.l 2023-12-01T01:10:01.165 INFO:journalctl@ceph.mds.l.smithi116.stdout:Dec 01 01:10:00 smithi116 systemd[1]: Stopping Ceph mds.l for 48bff570-8fe4-11ee-95a2-87774f69a715... 2023-12-01T01:10:01.430 INFO:journalctl@ceph.mds.l.smithi116.stdout:Dec 01 01:10:01 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-l[140959]: 2023-12-01T01:10:01.163+0000 7f656ae7b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-01T01:10:01.430 INFO:journalctl@ceph.mds.l.smithi116.stdout:Dec 01 01:10:01 smithi116 ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-l[140959]: 2023-12-01T01:10:01.163+0000 7f656ae7b700 -1 mds.l *** got signal Terminated *** 2023-12-01T01:10:05.647 INFO:journalctl@ceph.mds.l.smithi116.stdout:Dec 01 01:10:05 smithi116 bash[147143]: ceph-48bff570-8fe4-11ee-95a2-87774f69a715-mds-l 2023-12-01T01:10:05.653 DEBUG:teuthology.orchestra.run.smithi116:> sudo pkill -f 'journalctl -f -n 0 -u ceph-48bff570-8fe4-11ee-95a2-87774f69a715@mds.l.service' 2023-12-01T01:10:05.687 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-01T01:10:05.687 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-12-01T01:10:05.687 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 --force --keep-logs 2023-12-01T01:10:06.000 INFO:teuthology.orchestra.run.smithi026.stdout:Deleting cluster with fsid: 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T01:10:07.671 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 --force --keep-logs 2023-12-01T01:10:07.978 INFO:teuthology.orchestra.run.smithi093.stdout:Deleting cluster with fsid: 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T01:10:09.517 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 --force --keep-logs 2023-12-01T01:10:09.817 INFO:teuthology.orchestra.run.smithi116.stdout:Deleting cluster with fsid: 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T01:10:11.370 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-01T01:10:11.409 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-01T01:10:11.446 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-01T01:10:11.475 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-01T01:10:11.477 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/crash to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150/remote/smithi026/crash 2023-12-01T01:10:11.478 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/crash -- . 2023-12-01T01:10:11.509 INFO:teuthology.orchestra.run.smithi026.stderr:tar: /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/crash: Cannot open: No such file or directory 2023-12-01T01:10:11.509 INFO:teuthology.orchestra.run.smithi026.stderr:tar: Error is not recoverable: exiting now 2023-12-01T01:10:11.511 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/crash to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150/remote/smithi093/crash 2023-12-01T01:10:11.512 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/crash -- . 2023-12-01T01:10:11.548 INFO:teuthology.orchestra.run.smithi093.stderr:tar: /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/crash: Cannot open: No such file or directory 2023-12-01T01:10:11.548 INFO:teuthology.orchestra.run.smithi093.stderr:tar: Error is not recoverable: exiting now 2023-12-01T01:10:11.550 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/crash to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150/remote/smithi116/crash 2023-12-01T01:10:11.551 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/crash -- . 2023-12-01T01:10:11.587 INFO:teuthology.orchestra.run.smithi116.stderr:tar: /var/lib/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/crash: Cannot open: No such file or directory 2023-12-01T01:10:11.588 INFO:teuthology.orchestra.run.smithi116.stderr:tar: Error is not recoverable: exiting now 2023-12-01T01:10:11.589 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-01T01:10:11.589 DEBUG:teuthology.orchestra.run.smithi026:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-12-01T01:10:11.625 INFO:teuthology.orchestra.run.smithi026.stderr:grep: /var/log/ceph/48bff570-8fe4-11ee-95a2-87774f69a715/ceph.log: No such file or directory 2023-12-01T01:10:11.627 INFO:tasks.cephadm:Compressing logs... 2023-12-01T01:10:11.628 DEBUG:teuthology.orchestra.run.smithi026:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-01T01:10:11.670 DEBUG:teuthology.orchestra.run.smithi093:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-01T01:10:11.673 DEBUG:teuthology.orchestra.run.smithi116:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-01T01:10:11.699 INFO:teuthology.orchestra.run.smithi116.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-01T01:10:11.700 INFO:teuthology.orchestra.run.smithi026.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-01T01:10:11.701 INFO:teuthology.orchestra.run.smithi093.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-12-01T01:10:45.716 INFO:tasks.cephadm:Archiving logs... 2023-12-01T01:10:45.716 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150/remote/smithi026/log 2023-12-01T01:10:45.717 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-01T01:10:48.123 DEBUG:teuthology.misc:Transferring archived files from smithi093:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150/remote/smithi093/log 2023-12-01T01:10:48.124 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-01T01:10:52.205 DEBUG:teuthology.misc:Transferring archived files from smithi116:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150/remote/smithi116/log 2023-12-01T01:10:52.207 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-01T01:10:54.703 INFO:tasks.cephadm:Removing cluster... 2023-12-01T01:10:54.703 DEBUG:teuthology.orchestra.run.smithi026:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 --force 2023-12-01T01:10:55.012 INFO:teuthology.orchestra.run.smithi026.stdout:Deleting cluster with fsid: 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T01:10:55.498 DEBUG:teuthology.orchestra.run.smithi093:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 --force 2023-12-01T01:10:55.798 INFO:teuthology.orchestra.run.smithi093.stdout:Deleting cluster with fsid: 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T01:10:56.285 DEBUG:teuthology.orchestra.run.smithi116:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 48bff570-8fe4-11ee-95a2-87774f69a715 --force 2023-12-01T01:10:56.586 INFO:teuthology.orchestra.run.smithi116.stdout:Deleting cluster with fsid: 48bff570-8fe4-11ee-95a2-87774f69a715 2023-12-01T01:10:57.060 INFO:tasks.cephadm:Removing cephadm ... 2023-12-01T01:10:57.060 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-01T01:10:57.083 DEBUG:teuthology.orchestra.run.smithi093:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-01T01:10:57.103 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-01T01:10:57.121 INFO:tasks.cephadm:Teardown complete 2023-12-01T01:10:57.121 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-01T01:10:57.139 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-01T01:10:57.140 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-01T01:10:57.142 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-01T01:10:57.145 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-01T01:10:57.263 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-01T01:10:57.276 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-01T01:10:57.276 DEBUG:teuthology.orchestra.run.smithi026:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-01T01:10:57.279 DEBUG:teuthology.orchestra.run.smithi093:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-01T01:10:57.281 DEBUG:teuthology.orchestra.run.smithi116:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-01T01:10:57.296 INFO:teuthology.orchestra.run.smithi026.stderr:bash: ntpq: command not found 2023-12-01T01:10:57.296 INFO:teuthology.orchestra.run.smithi116.stderr:bash: ntpq: command not found 2023-12-01T01:10:57.296 INFO:teuthology.orchestra.run.smithi093.stderr:bash: ntpq: command not found 2023-12-01T01:10:57.300 INFO:teuthology.orchestra.run.smithi116.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-01T01:10:57.300 INFO:teuthology.orchestra.run.smithi116.stdout:=============================================================================== 2023-12-01T01:10:57.300 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 4 +303us[ +307us] +/- 99ms 2023-12-01T01:10:57.300 INFO:teuthology.orchestra.run.smithi116.stdout:^* hv02.front.sepia.ceph.com 3 6 377 2 -127us[ -123us] +/- 63ms 2023-12-01T01:10:57.300 INFO:teuthology.orchestra.run.smithi116.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 -52us[ -48us] +/- 65ms 2023-12-01T01:10:57.300 INFO:teuthology.orchestra.run.smithi116.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T01:10:57.302 INFO:teuthology.orchestra.run.smithi026.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-01T01:10:57.302 INFO:teuthology.orchestra.run.smithi026.stdout:=============================================================================== 2023-12-01T01:10:57.302 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 66 +288us[ +292us] +/- 98ms 2023-12-01T01:10:57.303 INFO:teuthology.orchestra.run.smithi026.stdout:^* hv02.front.sepia.ceph.com 3 6 377 2 -138us[ -135us] +/- 63ms 2023-12-01T01:10:57.303 INFO:teuthology.orchestra.run.smithi026.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 4 -69us[ -66us] +/- 65ms 2023-12-01T01:10:57.303 INFO:teuthology.orchestra.run.smithi026.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T01:10:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-01T01:10:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:=============================================================================== 2023-12-01T01:10:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 1 +330us[ +330us] +/- 99ms 2023-12-01T01:10:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:^* hv02.front.sepia.ceph.com 3 7 377 3 -119us[ -116us] +/- 63ms 2023-12-01T01:10:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 -52us[ -52us] +/- 65ms 2023-12-01T01:10:57.303 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-01T01:10:57.303 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-01T01:10:57.317 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-01T01:10:57.318 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-01T01:10:57.334 DEBUG:teuthology.orchestra.run.smithi026:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-01T01:10:57.454 DEBUG:teuthology.orchestra.run.smithi093:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-01T01:10:57.553 DEBUG:teuthology.orchestra.run.smithi116:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-01T01:10:57.647 DEBUG:teuthology.orchestra.run.smithi026:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-01T01:10:57.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T01:10:57.682 DEBUG:teuthology.orchestra.run.smithi093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-01T01:10:57.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T01:10:57.716 DEBUG:teuthology.orchestra.run.smithi116:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-01T01:10:57.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T01:10:57.748 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-01T01:10:57.761 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-01T01:10:57.786 INFO:teuthology.task.internal:Duration was 1662.048180 seconds 2023-12-01T01:10:57.786 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-01T01:10:57.797 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-01T01:10:57.797 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-01T01:10:57.799 DEBUG:teuthology.orchestra.run.smithi093:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-01T01:10:57.801 DEBUG:teuthology.orchestra.run.smithi116:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-01T01:10:57.846 INFO:teuthology.orchestra.run.smithi093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-01T01:10:57.847 INFO:teuthology.orchestra.run.smithi116.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-01T01:10:57.849 INFO:teuthology.orchestra.run.smithi026.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-01T01:10:58.228 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-01T01:10:58.228 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi026.front.sepia.ceph.com 2023-12-01T01:10:58.228 DEBUG:teuthology.orchestra.run.smithi026:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-01T01:10:58.255 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi093.front.sepia.ceph.com 2023-12-01T01:10:58.255 DEBUG:teuthology.orchestra.run.smithi093:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-01T01:10:58.277 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi116.front.sepia.ceph.com 2023-12-01T01:10:58.277 DEBUG:teuthology.orchestra.run.smithi116:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-01T01:10:58.300 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-01T01:10:58.300 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-01T01:10:58.302 DEBUG:teuthology.orchestra.run.smithi093:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-01T01:10:58.320 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-01T01:10:58.388 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-01T01:10:58.388 DEBUG:teuthology.orchestra.run.smithi026:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-01T01:10:58.390 DEBUG:teuthology.orchestra.run.smithi093:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-01T01:10:58.392 DEBUG:teuthology.orchestra.run.smithi116:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-01T01:10:58.499 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-01T01:10:58.511 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-01T01:10:58.511 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-01T01:10:58.539 DEBUG:teuthology.orchestra.run.smithi093:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-01T01:10:58.568 DEBUG:teuthology.orchestra.run.smithi116:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-01T01:10:58.594 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-01T01:10:58.606 DEBUG:teuthology.orchestra.run.smithi026:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-01T01:10:58.608 DEBUG:teuthology.orchestra.run.smithi093:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-01T01:10:58.610 DEBUG:teuthology.orchestra.run.smithi116:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-01T01:10:58.632 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = core 2023-12-01T01:10:58.634 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern = core 2023-12-01T01:10:58.659 INFO:teuthology.orchestra.run.smithi116.stdout:kernel.core_pattern = core 2023-12-01T01:10:58.676 DEBUG:teuthology.orchestra.run.smithi026:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-01T01:10:58.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T01:10:58.705 DEBUG:teuthology.orchestra.run.smithi093:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-01T01:10:58.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T01:10:58.722 DEBUG:teuthology.orchestra.run.smithi116:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-01T01:10:58.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-01T01:10:58.738 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-01T01:10:58.752 INFO:teuthology.task.internal:Transferring archived files... 2023-12-01T01:10:58.753 DEBUG:teuthology.misc:Transferring archived files from smithi026:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150/remote/smithi026 2023-12-01T01:10:58.753 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-01T01:10:58.796 DEBUG:teuthology.misc:Transferring archived files from smithi093:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150/remote/smithi093 2023-12-01T01:10:58.797 DEBUG:teuthology.orchestra.run.smithi093:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-01T01:10:58.834 DEBUG:teuthology.misc:Transferring archived files from smithi116:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150/remote/smithi116 2023-12-01T01:10:58.835 DEBUG:teuthology.orchestra.run.smithi116:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-01T01:10:58.874 INFO:teuthology.task.internal:Removing archive directory... 2023-12-01T01:10:58.874 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-01T01:10:58.877 DEBUG:teuthology.orchestra.run.smithi093:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-01T01:10:58.879 DEBUG:teuthology.orchestra.run.smithi116:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-01T01:10:58.926 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-01T01:10:58.941 INFO:teuthology.task.internal:Not uploading archives. 2023-12-01T01:10:58.941 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-01T01:10:58.953 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-01T01:10:58.953 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-01T01:10:58.956 DEBUG:teuthology.orchestra.run.smithi093:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-01T01:10:58.958 DEBUG:teuthology.orchestra.run.smithi116:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-01T01:10:58.970 INFO:teuthology.orchestra.run.smithi026.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 1 01:10 /home/ubuntu/cephtest 2023-12-01T01:10:58.972 INFO:teuthology.orchestra.run.smithi093.stdout: 262181 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 1 01:10 /home/ubuntu/cephtest 2023-12-01T01:10:58.982 INFO:teuthology.orchestra.run.smithi116.stdout: 262181 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 1 01:10 /home/ubuntu/cephtest 2023-12-01T01:10:58.984 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-01T01:10:58.995 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-01T01:10:59.019 INFO:teuthology.nuke:Checking targets against current locks 2023-12-01T01:10:59.043 DEBUG:teuthology.nuke:shortname: smithi026 2023-12-01T01:10:59.043 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T01:10:59.064 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 00:37:54.899274', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-01T01:10:59.068 DEBUG:teuthology.nuke:shortname: smithi093 2023-12-01T01:10:59.069 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T01:10:59.090 DEBUG:teuthology.nuke:shortname: smithi116 2023-12-01T01:10:59.090 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-01T01:10:59.095 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi093.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 00:37:54.898345', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-01T01:10:59.125 INFO:teuthology.orchestra.console.smithi026:Power off 2023-12-01T01:10:59.125 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T01:10:59.138 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi116.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-11-30_22:47:08-fs-reef-release-distro-default-smithi/7473150', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-01 00:37:54.900019', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-12-01T01:10:59.149 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2023-12-01T01:10:59.149 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T01:10:59.167 INFO:teuthology.orchestra.console.smithi093:Power off 2023-12-01T01:10:59.167 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T01:10:59.181 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-12-01T01:10:59.190 DEBUG:teuthology.orchestra.console.smithi093:power off output: Chassis Power Control: Down/Off 2023-12-01T01:10:59.190 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T01:10:59.208 INFO:teuthology.orchestra.console.smithi116:Power off 2023-12-01T01:10:59.208 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-01T01:10:59.218 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-12-01T01:10:59.233 DEBUG:teuthology.orchestra.console.smithi116:power off output: Chassis Power Control: Down/Off 2023-12-01T01:10:59.233 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T01:10:59.257 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-12-01T01:11:03.183 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T01:11:03.219 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T01:11:03.259 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T01:11:03.295 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2023-12-01T01:11:03.329 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is on 2023-12-01T01:11:03.371 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is on 2023-12-01T01:11:07.298 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T01:11:07.331 DEBUG:teuthology.orchestra.console.smithi093:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T01:11:07.372 DEBUG:teuthology.orchestra.console.smithi116:pexpect command: ipmitool -H smithi116.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-01T01:11:07.410 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2023-12-01T01:11:07.442 DEBUG:teuthology.orchestra.console.smithi093:check power output: Chassis Power is off 2023-12-01T01:11:07.483 DEBUG:teuthology.orchestra.console.smithi116:check power output: Chassis Power is off 2023-12-01T01:11:07.511 INFO:teuthology.orchestra.console.smithi026:Power off completed 2023-12-01T01:11:07.543 INFO:teuthology.orchestra.console.smithi093:Power off completed 2023-12-01T01:11:07.583 INFO:teuthology.orchestra.console.smithi116:Power off completed 2023-12-01T01:11:07.688 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/crc wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} duration: 1662.048180103302 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-12-01T01:11:07.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-01T01:11:07.768 INFO:teuthology.run:FAIL